Training corpus ssj500k 2.3

  Authors

Krek, Simon ; et al.show everyone

Krek, Simon ; Dobrovoljc, Kaja ; Erjavec, Tomaž ; Može, Sara ; Ledinek, Nina ; Holz, Nanika ; Zupan, Katja ; Gantar, Polona ; Kuzman, Taja ; Čibej, Jaka ; Arhar Holdt, Špela ; Kavčič, Teja ; Škrjanec, Iza ; Marko, Dafne ; Jezeršek, Lucija ; Zajc, Anja

  Item identifier

http://hdl.handle.net/11356/1434

 Referenced by

http://dx.doi.org/10.18653/v1/W17-1406

 Date issued

2021-07-07

 Type

corpus, text

 Size

586248 tokens, 27829 sentences, 500295 words

 Language(s)

Slovenian

 Description

The ssj500k training corpus contains about 500,000 tokens manually annotated on the levels of tokenisation, sentence segmentation, morphosyntactic tagging, and lemmatisation. About half of the corpus is also manually annotated with syntactic dependencies, named entities, and verbal multiword expressions. About a quarter of the corpus is also annotated with semantic role labels. The morphosyntactic tags and syntactic dependencies are included both in the JOS/MULTEXT-East framework, as well as in the framework of Universal Dependencies. The annotations of the ssj500k corpus follow (1) the MULTEXT-East V6 morphosyntactic specifications for Slovene, http://nl.ijs.si/ME/V6/msd/, (2) the JOS dependency schema, http://nl.ijs.si/jos/bib/jos-skladnja-navodila.pdf, the Universal Dependencies morphosyntactic specifications and syntactic dependencies for Slovene-SSJ, https://universaldependencies.org/, (4) the Janes annotation guidelines for Slovenian named entities, http://nl.ijs.si/janes/wp-content/uploads/2017/09/SlovenianNER-eng-v1.1.pdf, and (5) the Guidelines of the PARSEME shared task on verbal multiword expressions, http://parsemefr.lif.univ-mrs.fr/parseme-st-guidelines/1.1/ The vocabulary of (1) and (2) is provided in the back element and (3), (4), and (5) in the teiHeader of the TEI encoded corpus. The semantic role labels are also documented in the teiHeader. In contrast to the previous version 2.2, this version includes the corrected Universal Dependencies relations from UD version 2.8, updates the TEI encoding and adds UD annotations to the vertical file.

 Publisher

Centre for Language Resources and Technologies, University of Ljubljana

 Acknowledgement

Ministry of Education, Science and Sport 3311-08-986003 "Communication in Slovene"

ARRS (Slovenian Research Agency) P2-103 "Knowledge Technologies"

ARRS (Slovenian Research Agency) J6-8256 "New grammar of contemporary standard Slovene: sources and methods"

ARRS (Slovenian Research Agency) MR-37487 "Young Researcher Programme"

ARRS (Slovenian Research Agency) P6-0411 "Language Resources and Technologies for Slovene"

Ministry of Culture C3340-20-278001 "Development of Slovene in a Digital Environment"

 Subject(s)

part-of-speech tagging dependency treebank parsing named entities tokenisation manual annotation TEI verbal multiword expressions semantic role labelling CONLL-U

 Collection(s)

CLARIN.SI data & tools

 

This item is replaced by a newer submission:

http://hdl.handle.net/11356/1747

List all versions  

Show full item record