Trankit model for SST 2.15

  Authors

Krsnik, Luka ; Dobrovoljc, Kaja and Terčon, Luka

  Item identifier

http://hdl.handle.net/11356/1966

 Project URL

https://github.com/clarinsi/trankit-train

 Referenced by

https://arxiv.org/pdf/2101.03289.pdf

 Date issued

2024-09-04

 Type

toolService

 Language(s)

Slovenian

 Description

This is a retrained Slovenian model for the Trankit v1.1.1 library for multilingual natural language processing (https://pypi.org/project/trankit/), trained on the SST treebank of spoken Slovenian (UD v2.15, https://github.com/UniversalDependencies/UD_Slovenian-SST/tree/dev) featuring transcriptions of spontaneous speech in various everyday settings. It is able to predict sentence segmentation, tokenization, lemmatization, language-specific morphological annotation (MULTEXT-East morphosyntactic tags), as well as universal part-of-speech tagging, morphological feature prediction, and dependency parses in accordance with the Universal Dependencies annotation scheme (https://universaldependencies.org/). Please note this model has been published for archiving purposes only. For production use, we recommend using the state-of-the art Trankit model available here: http://hdl.handle.net/11356/1965. The latter was trained on both spoken (SST) and written (SSJ) data, and demonstrates a significantly higher performance to the model featured in this submission.

 Publisher

Centre for Language Resources and Technologies, University of Ljubljana

 Acknowledgement

ARRS (Slovenian Research Agency) Z6-4617 "Treebank-Driven Approach to the Study of Spoken Slovenian"

ARRS (Slovenian Research Agency) P6-0411 "Language Resources and Technologies for Slovene"

 Subject(s)

language model lemmatisation tokenisation sentence segmentation part-of-speech tagging feature prediction parsing dependency parsing corpus annotation

 Collection(s)

CLARIN.SI data & tools

 

This item is replaced by a newer submission:

http://hdl.handle.net/11356/1965

List all versions  

Show full item record