2026-08-04T20:26:22Zhttp://www.clarin.si/repository/oai/request

oai:www.clarin.si:11356/14262023-03-27T17:01:19Zhdl_11356_1023hdl_11356_1024

Text collection for training the BERTić transformer model BERTić-data Ljubešić, Nikola web corpus language model The BERTić-data text collection contains more than 8 billion tokens of mostly web-crawled text written in Bosnian, Croatian, Montenegrin or Serbian. The collection was used to train the BERTić transformer model (https://huggingface.co/classla/bcms-bertic). The data consists of web crawls before 2015, i.e. bsWaC (http://hdl.handle.net/11356/1062), hrWaC (http://hdl.handle.net/11356/1064), and srWaC (http://hdl.handle.net/11356/1063); previously unpublished 2019-2020 crawls, i.e. cnrWaC, CLASSLA-bs, CLASSLA-hr, and CLASSLA-sr; the cc100-hr and cc100-sr parts of CommonCrawl (https://commoncrawl.org/); and the Riznica corpus (http://hdl.handle.net/11356/1180). All texts were transliterated to the Latin script. The format of the text collection is one-sentence-per-line, empty-line-as-document-boundary. More details, especially on the applied near-deduplication procedure, can be found in the BERTić paper (https://arxiv.org/pdf/2104.09243.pdf). 2021-05-05 corpus http://hdl.handle.net/11356/1426 bos hrv cnr srp https://arxiv.org/abs/2104.09243 Creative Commons - Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) https://creativecommons.org/licenses/by-sa/4.0/ PUB application/gzip application/gzip application/gzip application/gzip application/gzip application/gzip application/gzip application/gzip application/gzip application/gzip text/plain; charset=utf-8 downloadable_files_count: 10 Jožef Stefan Institute https://huggingface.co/classla/bcms-bertic