The CLASSLA-StanfordNLP model for lemmatisation of non-standard Slovenian 1.0

The CLASSLA-StanfordNLP model for lemmatisation of non-standard Slovenian 1.0

CLARIN.SI data & tools

Authors: Ljubešić, Nikola

Item identifier: http://hdl.handle.net/11356/1338

Project URL: https://github.com/clarinsi/classla-stanfordnlp

Referenced by: http://dx.doi.org/10.18653/v1/W19-3704

Date issued: 2020-08-06

Type: toolService

Language(s): Slovenian

Description: The model for lemmatisation of non-standard Slovenian was built with the CLASSLA-StanfordNLP tool (https://github.com/clarinsi/classla-stanfordnlp) by training on the ssj500k training corpus (http://hdl.handle.net/11356/1210) and the Janes-Tag corpus (http://hdl.handle.net/11356/1238), using the Sloleks inflectional lexicon (http://hdl.handle.net/11356/1230). These corpora were additionally augmented for handling missing diacritics by repeating parts of the corpora with diacritics removed. The estimated F1 of the lemma annotations is ~98.86.

Publisher: Jožef Stefan Institute

Subject(s): lemmatisation computer-mediated communication language model

Collection(s): CLARIN.SI data & tools

This item is replaced by a newer submission:

http://hdl.handle.net/11356/1350

Show full item record

Files in this item

This item is

Publicly Available

and licensed under:
Creative Commons - Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)

Name: sl_all_Sloleks_lemmatizer.pt
Size: 321.22 MB
Format: Unknown
Description: Language model for CLASSLA-StanfordNLP
MD5: 665201abd24324bdbe4dbac3dadfffcd