Slovene Punctuation and Capitalisation model RSDO-DS2-P&C 3.6
- Authors
- Lebar Bajec, Iztok ; Bajec, Marko ; Bajec, Žan and Rizvič, Mitja
- Item identifier
- http://hdl.handle.net/11356/1735
- Referenced by
- https://github.com/clarinsi/Slovene_punctuator
- Date issued
- 2022-12-01
- Type
- toolService
- Language(s)
- Slovenian
- Description
- This Punctuation and Capitalisation model was trained following the NVIDIA NeMo Punctuation and Capitalisation recipe (for details see the official NVIDIA NeMo P&C documentation, https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en/stable/nlp/punctuation_and_capitalization.html, and NVIDIA NeMo GitHub repository https://github.com/NVIDIA/NeMo). It provides functionality for restoring punctuation (,.!?) and capital letters in lowercased non-punctuated Slovene text. The training corpus was built from publicly available datasets, as well as a small portion of proprietary data. In total the training corpus consisted of 38.829.529 sentences and the validation corpus consisted of 2.092.497 sentences.
- Acknowledgement
- Ministry of Culture C3340-20-278001 "Development of Slovene in a Digital Environment"
- Subject(s)
- punctuation capitalisation NeMo model
- Collection(s)
-
Files in this item
- Name
- sl-SI_GEN_nemo-3.6.tar.zst
- Size
- 387.75 MB
- Format
- Unknown
- Description
- RSDO DS2 P&C 3.6
- MD5
- 241ce5d62c822290b0b33b8327825d9e