The Twitter user dataset for discriminating between Bosnian, Croatian, Montenegrin and Serbian Twitter-HBS 1.0

Name: The Twitter user dataset for discriminating between Bosnian, Croatian, Montenegrin and Serbian Twitter-HBS 1.0
License: https://creativecommons.org/licenses/by-sa/4.0/

Ljubešić, Nikola; Rupnik, Peter

The Twitter user dataset for discriminating between Bosnian, Croatian, Montenegrin and Serbian Twitter-HBS 1.0

CLARIN.SI data & tools

Avtorji: Ljubešić, Nikola and Rupnik, Peter

Identifikator vnosa: http://hdl.handle.net/11356/1482

URL projekta: https://www.clarin.si/info/k-centre/

Dokumentirano v: https://www.informatica.si/index.php/informatica/article/view/746

Datum objave: 2022-01-26

Vrsta: corpus, text

Velikost: 614 items, 390268 texts

Jezik(i): Bosnian , Croatian , Montenegrin , Serbian

Opis: The Twitter-HBS dataset consists of Twitter users, their tweets, and the label of their predominantly used language - Bosnian, Croatian, Montenegrin, or Serbian. Among the tweets, there are also tweets in other languages (mainly English) as the label encodes the predominantly used language of a user only. The main intended usage of this dataset is discrimination between closely-related languages on the level of a Twitter user (not a single tweet). The only pre-processing performed on the texts of the tweets is the transliteration from the Cyrillic into the Latin script so that the dataset measures the quality of the user classifications regardless of the script used.