The CLASSLA-StanfordNLP model for lemmatisation of non-standard Croatian 1.1

  Authors

Ljubešić, Nikola and Štefanec, Vanja

  Item identifier

http://hdl.handle.net/11356/1352

 Project URL

https://github.com/clarinsi/classla-stanfordnlp

 Referenced by

http://dx.doi.org/10.18653/v1/W19-3704

 Date issued

2020-07-17

 Type

toolService

 Language(s)

Croatian

 Description

The model for lemmatisation of non-standard Croatian was built with the CLASSLA-StanfordNLP tool (https://github.com/clarinsi/classla-stanfordnlp) by training on the hr500k training corpus (http://hdl.handle.net/11356/1183), the ReLDI-NormTagNER-hr corpus (http://hdl.handle.net/11356/1241), the RAPUT corpus (https://www.aclweb.org/anthology/L16-1513/) and the ReLDI-NormTagNER-sr corpus (http://hdl.handle.net/11356/1240), using the hrLex inflectional lexicon (http://hdl.handle.net/11356/1232). These corpora were additionally augmented for handling missing diacritics by repeating parts of the corpora with diacritics removed. The estimated F1 of the lemma annotations is ~97.54. The difference to the previous version of the lemmatizer is that now it relies solely on XPOS annotations, and not on a combination of UPOS, FEATS (lexicon lookup) and XPOS (lemma prediction) annotations.

 Publisher

Jožef Stefan Institute

 Acknowledgement

ARRS (Slovenian Research Agency) P6-0411 "Language Resources and Technologies for Slovene"

Jožef Stefan Institute CLARIN "CLARIN.SI"

ARRS (Slovenian Research Agency) N6-0099 "LiLaH: Linguistic Landscape of Hate Speech"

European Structural and Investment Funds RC.2.2.08-0050 "Computer assistant for text input for persons with language impairment (RAPUT)"

 Subject(s)

lemmatisation computer-mediated communication language model

 Collection(s)

CLARIN.SI data & tools

 Other versions

List all versions  

Show full item record