The Twitter user dataset for discriminating between Bosnian, Croatian, Montenegrin and Serbian Twitter-HBS 1.0

  Authors

Ljubešić, Nikola and Rupnik, Peter

  Item identifier

http://hdl.handle.net/11356/1482

 Project URL

https://www.clarin.si/info/k-centre/

 Referenced by

https://www.informatica.si/index.php/informatica/article/view/746

 Date issued

2022-01-26

 Type

corpus, text

 Size

614 items, 390268 texts

 Language(s)

Bosnian , Croatian , Montenegrin , Serbian

 Description

The Twitter-HBS dataset consists of Twitter users, their tweets, and the label of their predominantly used language - Bosnian, Croatian, Montenegrin, or Serbian. Among the tweets, there are also tweets in other languages (mainly English) as the label encodes the predominantly used language of a user only. The main intended usage of this dataset is discrimination between closely-related languages on the level of a Twitter user (not a single tweet). The only pre-processing performed on the texts of the tweets is the transliteration from the Cyrillic into the Latin script so that the dataset measures the quality of the user classifications regardless of the script used.

 Publisher

Jožef Stefan Institute

 Acknowledgement

Connecting Europe Facility (CEF) Telecom INEA/CEF/ICT/A2020/2278341 "MaCoCu - Massive collection and curation of monolingual and bilingual data: focus on under-resourced languages"

ARRS (Slovenian Research Agency) N6-0099 "LiLaH: Linguistic Landscape of Hate Speech"

 Subject(s)

Twitter language identification closely related languages

 Collection(s)

CLARIN.SI data & tools

Show full item record