Slovene Punctuation and Capitalisation model RSDO-DS2-P&C 3.6

  Avtorji

Lebar Bajec, Iztok ; Bajec, Marko ; Bajec, Žan and Rizvič, Mitja

  Identifikator vnosa

http://hdl.handle.net/11356/1735

 URL projekta

https://rsdo.slovenscina.eu/en/speech-technologies

 Demo URL

https://www.slovenscina.eu/en/razpoznavalnik

 Dokumentirano v

https://github.com/clarinsi/Slovene_punctuator

 Datum objave

2022-12-01

 Vrsta

toolService

 Jezik(i)

Slovenian

 Opis

This Punctuation and Capitalisation model was trained following the NVIDIA NeMo Punctuation and Capitalisation recipe (for details see the official NVIDIA NeMo P&C documentation, https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en/stable/nlp/punctuation_and_capitalization.html, and NVIDIA NeMo GitHub repository https://github.com/NVIDIA/NeMo). It provides functionality for restoring punctuation (,.!?) and capital letters in lowercased non-punctuated Slovene text. The training corpus was built from publicly available datasets, as well as a small portion of proprietary data. In total the training corpus consisted of 38.829.529 sentences and the validation corpus consisted of 2.092.497 sentences.

 Izdajatelj

Faculty of Computer and Information Science, University of Ljubljana

 Zahvala

Ministry of Culture C3340-20-278001 "Development of Slovene in a Digital Environment"

 Ključne besede

punctuation capitalisation NeMo model

 Zbirke

CLARIN.SI data & tools

Prikaži polni zapis vnosa