The CLASSLA-StanfordNLP model for lemmatisation of non-standard Slovenian 1.1

  Avtorji

Ljubešić, Nikola

  Identifikator vnosa

http://hdl.handle.net/11356/1350

 URL projekta

https://github.com/clarinsi/classla-stanfordnlp

 Dokumentirano v

http://dx.doi.org/10.18653/v1/W19-3704

 Datum objave

2020-09-15

 Vrsta

toolService

 Jezik(i)

Slovenian

 Opis

The model for lemmatisation of non-standard Slovenian was built with the CLASSLA-StanfordNLP tool (https://github.com/clarinsi/classla-stanfordnlp) by training on the ssj500k training corpus (http://hdl.handle.net/11356/1210) and the Janes-Tag corpus (http://hdl.handle.net/11356/1238), using the Sloleks inflectional lexicon (http://hdl.handle.net/11356/1230). These corpora were additionally augmented for handling missing diacritics by repeating parts of the corpora with diacritics removed. The estimated F1 of the lemma annotations is ~98.86. The difference to the previous version of the lemmatizer is that now it relies solely on XPOS annotations, and not on a combination of UPOS, FEATS (lexicon lookup) and XPOS (lemma prediction) annotations.

 Izdajatelj

Jožef Stefan Institute

 Zahvala

ARRS (Slovenian Research Agency) P6-0411 "Language Resources and Technologies for Slovene"

ARRS (Slovenian Research Agency) N6-0099 "LiLaH: Linguistic Landscape of Hate Speech"

 Ključne besede

lemmatisation computer-mediated communication language model

 Zbirke

CLARIN.SI data & tools

 

Ta vnos je bil nadomeščen z novejšim.

http://hdl.handle.net/11356/1784

Seznam vseh različic  

Prikaži polni zapis vnosa