Trankit model for SST 2.15

  Avtorji

Krsnik, Luka ; Dobrovoljc, Kaja and Terčon, Luka

  Identifikator vnosa

http://hdl.handle.net/11356/1966

 URL projekta

https://github.com/clarinsi/trankit-train

 Dokumentirano v

https://arxiv.org/pdf/2101.03289.pdf

 Datum objave

2024-09-04

 Vrsta

toolService

 Jezik(i)

Slovenian

 Opis

This is a retrained Slovenian model for the Trankit v1.1.1 library for multilingual natural language processing (https://pypi.org/project/trankit/), trained on the SST treebank of spoken Slovenian (UD v2.15, https://github.com/UniversalDependencies/UD_Slovenian-SST/tree/dev) featuring transcriptions of spontaneous speech in various everyday settings. It is able to predict sentence segmentation, tokenization, lemmatization, language-specific morphological annotation (MULTEXT-East morphosyntactic tags), as well as universal part-of-speech tagging, morphological feature prediction, and dependency parses in accordance with the Universal Dependencies annotation scheme (https://universaldependencies.org/). Please note this model has been published for archiving purposes only. For production use, we recommend using the state-of-the art Trankit model available here: http://hdl.handle.net/11356/1965. The latter was trained on both spoken (SST) and written (SSJ) data, and demonstrates a significantly higher performance to the model featured in this submission.

 Izdajatelj

Centre for Language Resources and Technologies, University of Ljubljana

 Zahvala

ARRS (Slovenian Research Agency) Z6-4617 "Treebank-Driven Approach to the Study of Spoken Slovenian"

ARRS (Slovenian Research Agency) P6-0411 "Language Resources and Technologies for Slovene"

 Ključne besede

language model lemmatisation tokenisation sentence segmentation part-of-speech tagging feature prediction parsing dependency parsing corpus annotation

 Zbirke

CLARIN.SI data & tools

 

Ta vnos je bil nadomeščen z novejšim.

http://hdl.handle.net/11356/1965

Seznam vseh različic  

Prikaži polni zapis vnosa