The news dataset for discriminating between Bosnian, Croatian and Serbian SETimes.HBS 1.0

Name: The news dataset for discriminating between Bosnian, Croatian and Serbian SETimes.HBS 1.0
License: https://creativecommons.org/licenses/by-sa/4.0/

Ljubešić, Nikola; Rupnik, Peter

The news dataset for discriminating between Bosnian, Croatian and Serbian SETimes.HBS 1.0

CLARIN.SI data & tools

Authors: Ljubešić, Nikola and Rupnik, Peter

Item identifier: http://hdl.handle.net/11356/1461

Project URL: https://www.clarin.si/info/k-centre/

Referenced by: https://aclanthology.org/C12-1160/

Date issued: 2022-01-26

Type: corpus, text

Size: 9258 texts

Language(s): Bosnian , Croatian , Serbian

Description: The SETimes.HBS dataset consists of parallel documents written in Bosnian, Croatian and Serbian, harvested from the already inactive setimes.com website publishing news in the languages of South-Eastern Europe. While the writing process of the documents is not known, they are quite likely independent translations from English. The main intended usage of this dataset is closely-related language discrimination. This dataset is not a traditional parallel dataset as there are no explicit links between parallel documents. Special care was taken that the training, development and testing bins of the dataset contain the same documents in all three languages as data leakage between the three bins, given the similarity of the three languages, could be problematic for benchmarking.