Dataset and baseline model of moderated content FRENK-STYRIA-24sata 1.0

  Authors

Ljubešić, Nikola ; Erjavec, Tomaž and Fišer, Darja

  Item identifier

http://hdl.handle.net/11356/1202

 Project URL

http://nl.ijs.si/frenk/

 Referenced by

https://drive.google.com/file/d/13m7PFn49_tnEfFjcbqk8cugG4ZTy2A5I/view

 Date issued

2018-10-27

 Type

corpus, text

 Size

17042965 texts, 407549127 words

 Language(s)

Croatian

 Description

FRENK-STYRIA-24sata is a dataset of moderated newspaper comments from the website 24sata.hr with metadata on the time of publishing, user identifier, thread identifier and whether the comment was deleted by the moderators or not. The full text of each comment is encrypted via a character-replacement method so that the comments are not readable by humans. Basic punctuation is not encrypted in order to enable tokenization. The main use of this dataset are experiments on automating comment moderation. For real-world usage, a fastText classification model trained on non-encrypted data is made available as well.

 Publisher

Jožef Stefan Institute

 Acknowledgement

ARRS (Slovenian Research Agency) J7-8280 "FRENK: Resources, methods, and tools for the understanding, identification, and classification of various forms of socially unacceptable discourse in the information society"

 Subject(s)

computer-mediated communication news comments content moderation

 Collection(s)

CLARIN.SI data & tools

Show full item record