2026-05-21T19:15:17Zhttp://www.clarin.si/repository/oai/request

oai:www.clarin.si:11356/18702024-08-29T10:21:06Zhdl_11356_1023hdl_11356_1024

The Trankit model for linguistic processing of standard Slovenian Krsnik, Luka Dobrovoljc, Kaja language model lemmatisation tokenisation sentence segmentation part-of-speech tagging feature prediction parsing This is a retrained Slovenian standard model for Trankit v1.1.1 library (https://pypi.org/project/trankit/). It is able to predict sentence segmentation, tokenization, lemmatization, language-specific morphological annotation (MULTEXT-East morphosyntactic tags), as well as universal part-of-speech tagging, feature prediction, and dependency parsing in accordance with the Universal Dependencies annotation scheme (https://universaldependencies.org/). The model was trained using a dataset published by Universal Dependencies in release 2.12 (https://github.com/UniversalDependencies/UD_Slovenian-SSJ/tree/r2.12). Due to the larger training dataset compared to the original Trankit v1.1.1 model, this version yields superior results and achieves state-of-the art parsing performance for Slovenian (https://slobench.cjvt.si/leaderboard/view/11). To utilize this model, please follow the instructions provided in our github repository (https://github.com/clarinsi/trankit-train) or refer to the Trankit documentation (https://trankit.readthedocs.io/en/latest/training.html#loading). This ZIP file contains models for both xlm-roberta-large (which delivers better performance but requires more hardware resources) and xlm-roberta-base. 2023-09-29 toolService http://hdl.handle.net/11356/1870 slv https://arxiv.org/pdf/2101.03289.pdf http://hdl.handle.net/11356/1963 Apache License 2.0 https://opensource.org/licenses/Apache-2.0 PUB text/plain; charset=utf-8 application/zip downloadable_files_count: 1 Centre for Language Resources and Technologies, University of Ljubljana https://github.com/clarinsi/trankit-train