Show simple item record

 
dc.contributor.author Octavian M., Machidon
dc.contributor.author Alina L., Machidon
dc.contributor.author Vojko, Strahovnik
dc.date.accessioned 2026-11-17T11:01:33Z
dc.date.available 2026-11-17T11:01:33Z
dc.date.issued 2026-11-16
dc.identifier.uri http://hdl.handle.net/11356/2670
dc.description Etika LLM 1.0 is a human-annotated corpus of 9,975 English-language ethical scenarios drawn from the ETHICS dataset. It covers five domains: Commonsense, Deontology, Justice, Utilitarianism, and Virtue, with 1,995 scenarios in each. Each scenario was independently evaluated by three human annotators from a group of 19, yielding 29,925 individual annotations. Annotators provided moral judgments and accompanying reasons, using predefined categories or short written explanations depending on the task. They also recorded whether scenarios were ambiguous or culturally specific. The corpus includes individual annotations, majority-vote labels, and the rationales associated with the majority judgments, together with annotation guidelines and data documentation. The dataset can be used to study human moral judgments, compare human and language-model evaluations of ethical situations, and support the training and evaluation of language models.
dc.language.iso eng
dc.publisher Faculty of Computer and Information Science, University of Ljubljana
dc.rights Creative Commons - Attribution 4.0 International (CC BY 4.0)
dc.rights.uri https://creativecommons.org/licenses/by/4.0/
dc.rights.label PUB
dc.subject ethics
dc.subject moral reasoning
dc.subject human annotation
dc.subject annotated corpus
dc.subject large language models
dc.subject AI alignment
dc.subject ETHICS dataset
dc.title Human-annotated corpus of ethical scenarios Etika LLM 1.0
dc.type corpus
metashare.ResourceInfo#ContentInfo.mediaType text
has.files yes
branding CLARIN.SI data & tools
contact.person Octavian M. Machidon octavian.machidon@fri.uni-lj.si University of Ljubljana, Faculty of Computer and Information Science
sponsor Jožef Stefan Institute CLARIN CLARIN.SI nationalFunds
size.info 9975 items
files.count 1
files.size 6820442


 Files in this item

This item is
Publicly Available
and licensed under:
Creative Commons - Attribution 4.0 International (CC BY 4.0)
Distributed under Creative Commons Attribution Required
Icon
Name
Etika-LLM-1.0.zip
Size
6.5 MB
Format
application/zip
Description
Dataset
MD5
7fc6093a2290c25f0bcc6ecdac343df3
 Download file  Preview
 File Preview  
  • Etika-LLM-1.0
    • documentation
      • methodology.pdf66 kB
      • annotation-guidelines.pdf84 kB
      • data-dictionary.txt8 kB
    • README.txt3 kB
    • LICENSE.txt1 kB
    • data
      • majority-labels.csv6 MB
      • individual-annotations.csv15 MB
      • aggregated-rationales.csv6 MB

Show simple item record