2026-05-22T09:29:58Zhttp://www.clarin.si/repository/oai/request

oai:www.clarin.si:11356/14042023-03-27T17:01:19Zhdl_11356_1023hdl_11356_1024

Choice of plausible alternatives dataset in Croatian COPA-HR Ljubešić, Nikola commonsense reasoning manual annotation manual translation The COPA-HR dataset (Choice of plausible alternatives in Croatian) is a translation of the English COPA dataset (https://people.ict.usc.edu/~gordon/copa.html) by following the XCOPA dataset translation methodology (https://arxiv.org/abs/2005.00333). The dataset consists of 1000 premises (My body cast a shadow over the grass), each given a question (What is the cause?), and two choices (The sun was rising; The grass was cut), with a label encoding which of the choices is more plausible given the annotator or translator (The sun was rising). The observed agreement of the English annotator and the Croatian translator is perfect on the training and the validation dataset, with one different label (agreement of 99.8%) on the test dataset. The current state-of-the-art on this dataset is held by the BERTić model (https://huggingface.co/CLASSLA/bcms-bertic), achieving an accuracy of 66% (50% is random). 2021-02-24 corpus http://hdl.handle.net/11356/1404 hrv https://arxiv.org/abs/2104.09243 Creative Commons - Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) https://creativecommons.org/licenses/by-sa/4.0/ PUB text/plain; charset=utf-8 application/octet-stream application/octet-stream application/octet-stream downloadable_files_count: 3 Jožef Stefan Institute https://www.clarin.si/info/k-centre/