2026-05-22T04:59:34Zhttp://www.clarin.si/repository/oai/request

oai:www.clarin.si:11356/19022023-11-27T09:15:19Zhdl_11356_1023hdl_11356_1024

Dataset for evaluation of Slovene spell- and grammar-checking tools Šolar-Eval 1.0 Arhar Holdt, Špela Gantar, Polona Bon, Mija Gapsa, Magdalena Lavrič, Polona Klemen, Matej evaluation student writing error annotation grammatical error correction Šolar-Eval is a specialized dataset designed for the evaluation of Slovene spell- and grammar-checking tools and methodologies. It encompasses 109 essays authored by Slovene primary and secondary school students, featuring 9,808 language corrections meticulously annotated based on the identified language problems. The essays are sourced from the Šolar 3.0 corpus, which integrates authentic corrections from language teachers (http://hdl.handle.net/11356/1589). However, inconsistencies and heterogeneity are common in teacher corrections, particularly in style improvements, making this corpus suboptimal for evaluation tasks. For Šolar-Eval, the corrections were conducted by researchers aiming to ensure consistency, homogeneity, and minimal language intervention. The corrections are annotated according to the reference guidelines found in the attached document. The codes for language errors are structured hierarchically, facilitating robust or fine-grained evaluation. The dataset is accessible in JSON format as generated by the CJVT Svala 1.1 annotation tool (https://orodja.cjvt.si/svala/). The source and target text is also available in the CoNLL-U format (https://universaldependencies.org/format.html). Furthermore, linguistic annotations were applied using the CLASSLA pipeline (https://github.com/clarinsi/classla/) across various levels, including tokenization, sentence segmentation, lemmatization, MULTEXT-East v6 MSD-tags, JOS-SYN dependency syntax, Universal Dependencies, and named entities (more about specific annotation layers: https://wiki.cjvt.si/shelves/linguistic-annotation-of-slovene-corpora). For better accessibility and wider usability, we provide versions with JOS-SYN as well as Universal Dependencies, and English as well as Slovene tags. 2023-11-27 corpus http://hdl.handle.net/11356/1902 slv Creative Commons - Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0) https://creativecommons.org/licenses/by-nc-sa/4.0/ PUB text/plain; charset=utf-8 application/zip application/zip application/pdf application/pdf downloadable_files_count: 4 Centre for Language Resources and Technologies, University of Ljubljana https://www.cjvt.si/prop/en/