dc.contributor.author | Ljubešić, Nikola |
dc.contributor.author | Štefanec, Vanja |
dc.date.accessioned | 2020-09-15T10:47:07Z |
dc.date.available | 2020-09-15T10:47:07Z |
dc.date.issued | 2020-09-15 |
dc.identifier.uri | http://hdl.handle.net/11356/1351 |
dc.description | The model for lemmatisation of non-standard Serbian was built with the CLASSLA-StanfordNLP tool (https://github.com/clarinsi/classla-stanfordnlp) by training on the SETimes.SR training corpus (http://hdl.handle.net/11356/1200), the ReLDI-NormTagNER-sr corpus (http://hdl.handle.net/11356/1240), the ReLDI-NormTagNER-hr corpus (http://hdl.handle.net/11356/1241), the hr500k training corpus (http://hdl.handle.net/11356/1183) and the RAPUT corpus (https://www.aclweb.org/anthology/L16-1513/), using the srLex inflectional lexicon (http://hdl.handle.net/11356/1233). These corpora were additionally augmented for handling missing diacritics by repeating parts of the corpora with diacritics removed. The estimated F1 of the lemma annotations is ~97.62. The difference to the previous version of the lemmatizer is that now it relies solely on XPOS annotations, and not on a combination of UPOS, FEATS (lexicon lookup) and XPOS (lemma prediction) annotations. |
dc.language.iso | srp |
dc.publisher | Jožef Stefan Institute |
dc.relation.isreferencedby | http://dx.doi.org/10.18653/v1/W19-3704 |
dc.relation.replaces | http://hdl.handle.net/11356/1334 |
dc.rights | Creative Commons - Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) |
dc.rights.uri | https://creativecommons.org/licenses/by-sa/4.0/ |
dc.rights.label | PUB |
dc.source.uri | https://github.com/clarinsi/classla-stanfordnlp |
dc.subject | lemmatisation |
dc.subject | computer-mediated communication |
dc.subject | language model |
dc.title | The CLASSLA-StanfordNLP model for lemmatisation of non-standard Serbian 1.1 |
dc.type | toolService |
metashare.ResourceInfo#ContentInfo.detailedType | tool |
metashare.ResourceInfo#ResourceComponentType#ToolServiceInfo.languageDependent | true |
has.files | yes |
branding | CLARIN.SI data & tools |
contact.person | Nikola Ljubešić nikola.ljubesic@ijs.si Jožef Stefan Institute |
sponsor | ARRS (Slovenian Research Agency) P6-0411 Language Resources and Technologies for Slovene nationalFunds |
sponsor | Jožef Stefan Institute CLARIN CLARIN.SI nationalFunds |
sponsor | ARRS (Slovenian Research Agency) N6-0099 LiLaH: Linguistic Landscape of Hate Speech nationalFunds |
sponsor | European Structural and Investment Funds RC.2.2.08-0050 Computer assistant for text input for persons with language impairment (RAPUT) Other |
files.count | 1 |
files.size | 94423447 |
Files in this item
This item is
Creative Commons - Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)
Publicly Available
and licensed under:Creative Commons - Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)




- Name
- sr_all_srLex_lemmatizer.pt.zip
- Size
- 90.05 MB
- Format
- application/zip
- Description
- Language model
- MD5
- 7c5c2ea1287c2ed72253e1eb70c14b62