Dataset and baseline model of moderated content FRENK-STYRIA-24sata 1.0

  Avtorji

Ljubešić, Nikola ; Erjavec, Tomaž and Fišer, Darja

  Identifikator vnosa

http://hdl.handle.net/11356/1202

 URL projekta

http://nl.ijs.si/frenk/

 Dokumentirano v

https://drive.google.com/file/d/13m7PFn49_tnEfFjcbqk8cugG4ZTy2A5I/view

 Datum objave

2018-10-27

 Vrsta

corpus, text

 Velikost

17042965 texts, 407549127 words

 Jezik(i)

Croatian

 Opis

FRENK-STYRIA-24sata is a dataset of moderated newspaper comments from the website 24sata.hr with metadata on the time of publishing, user identifier, thread identifier and whether the comment was deleted by the moderators or not. The full text of each comment is encrypted via a character-replacement method so that the comments are not readable by humans. Basic punctuation is not encrypted in order to enable tokenization. The main use of this dataset are experiments on automating comment moderation. For real-world usage, a fastText classification model trained on non-encrypted data is made available as well.

 Izdajatelj

Jožef Stefan Institute

 Zahvala

ARRS (Slovenian Research Agency) J7-8280 "FRENK: Resources, methods, and tools for the understanding, identification, and classification of various forms of socially unacceptable discourse in the information society"

 Ključne besede

computer-mediated communication news comments content moderation

 Zbirke

CLARIN.SI data & tools

Prikaži polni zapis vnosa