CMC training corpus Janes-Norm 1.1

  Authors

Erjavec, Tomaž ; Fišer, Darja ; Čibej, Jaka and Arhar Holdt, Špela

  Item identifier

http://hdl.handle.net/11356/1083

 Project URL

https://nl.ijs.si/janes/

 Date issued

2016-12-28

 Type

corpus, text

 Size

7816 texts, 184766 tokens

 Language(s)

Slovenian

 Description

Janes-Norm is a manually annotated corpus of Slovene Computer-Mediated Communication (CMC). It is meant as a gold-standard training and testing dataset for tokenisation, sentence segmentation and word normalisation of non-standard Slovene. The corpus is also automatically annotated with morphosyntactic descriptions and lemmas. As the corpus has been carefully manually annotated, it is also suitable for detailed linguistic explorations which require highly accurate and reliable annotations. The corpus is further described in: ERJAVEC, Tomaž, ČIBEJ, Jaka, ARHAR HOLDT, Špela, LJUBEŠIĆ, Nikola, FIŠER, Darja. Gold-standard datasets for annotation of Slovene computer-mediated communication. In Proceedings of RASLAN 2016: Recent Advances in Slavonic Natural Language Processing. Brno: Tribun EU, 2016, pp. 29-40, https://nlp.fi.muni.cz/raslan/raslan16.pdf Note that a related corpus, Janes-Tag is also available, cf. http://hdl.handle.net/11356/1081.

 Publisher

Jožef Stefan Institute

 Acknowledgement

ARRS (Slovenian Research Agency) J6-6842 "JANES: Resources, Tools and Methods for the Research of Nonstandard Internet Slovene"

ARRS (Slovenian Research Agency) P2-103 "Knowledge Technologies"

Swiss National Science Foundation 160501 "ReLDI"

 Subject(s)

computer-mediated communication tokenisation word normalisation manual annotation TEI

 Collection(s)

CLARIN.SI data & tools

 

This item is replaced by a newer submission:

http://hdl.handle.net/11356/1084

List all versions  

Show full item record