The CLASSLA-Stanza model for lemmatisation of non-standard Slovenian 2.1

  Avtorji

Terčon, Luka and Ljubešić, Nikola

  Identifikator vnosa

http://hdl.handle.net/11356/1784

 URL projekta

https://github.com/clarinsi/classla

 Dokumentirano v

https://aclanthology.org/W19-3704/

 Datum objave

2023-03-30

 Vrsta

toolService

 Jezik(i)

Slovenian

 Opis

This model for lemmatisation of non-standard Slovenian was built with the CLASSLA-Stanza tool (https://github.com/clarinsi/classla) by training on the SUK training corpus (http://hdl.handle.net/11356/1747) and the Janes-Tag corpus (http://hdl.handle.net/11356/1732), using the CLARIN.SI-embed.sl word embeddings (http://hdl.handle.net/11356/1204) that were expanded with the MaCoCu-sl Slovene web corpus (http://hdl.handle.net/11356/1517). These corpora were additionally augmented for handling missing diacritics by repeating parts of the corpora with diacritics removed. The estimated F1 of the lemma annotations is ~91.45. The difference to the previous version of the model is that the model was trained on the SUK training corpus and the 3.0 version of Janes-tag, uses new embeddings and the new version of the Slovene morphological lexicon Sloleks 3.0 (http://hdl.handle.net/11356/1745).

 Izdajatelj

Jožef Stefan Institute

 Zahvala

ARRS (Slovenian Research Agency) P6-0411 "Language Resources and Technologies for Slovene"

Ministry of Culture C3340-20-278001 "Development of Slovene in a Digital Environment"

ARRS (Slovenian Research Agency) J7-4642 "MEZZANINE"

 Ključne besede

lemmatisation computer-mediated communication language model

 Zbirke

CLARIN.SI data & tools

 Druge različice

Seznam vseh različic  

Prikaži polni zapis vnosa