English YouTube Hate Speech Corpus

  Authors

Ljubešić, Nikola ; Mozetič, Igor ; Cinelli, Matteo and Kralj Novak, Petra

  Item identifier

http://hdl.handle.net/11356/1454

 Project URL

http://imsypp.ijs.si/

 Date issued

2021-10-14

 Type

corpus, text

 Size

62414 texts, 146345 items

 Language(s)

English

 Description

We present an English YouTube dataset manually annotated for hate speech types and targets. The comments to be annotated were sampled from the English YouTube comments on videos about the Covid-19 pandemic in the period from January 2020 to May 2020. Two sets were annotated: a training set with 51,655 comments (IMSyPP_EN_YouTube_comments_train.csv) and two evaluation sets, one annotated in-context (IMSyPP_EN_YouTube_comments_evaluation_context.csv), another out-of-context (IMSyPP_EN_YouTube_comments_evaluation_no_context.csv), each based on the same 10,759 comments. The dataset was annotated by 10 annotators with most (99.9%) of the comments being annotated by two annotators. It was used to train a classification model for hate speech types detection that is publicly available at the following URL: https://huggingface.co/IMSyPP/hate_speech_en. The dataset consists of the following fields: Video_ID - YouTube ID of the video under which the comment was posted Comment_ID - YouTube ID of the comment Text - text of the comment Type - type of hate speech Target - the target of hate speech Annotator - code of the human annotator

 Publisher

Jožef Stefan Institute

 Acknowledgement

European Union’s Rights,Equality and Citizenship Programme 875263 "IMSyPP - Innovative Monitoring Systems and PreventionPolicies of Online Hate Speech"

ARRS (Slovenian Research Agency) N6-0099 "LiLaH: Linguistic Landscape of Hate Speech"

Jožef Stefan Institute CLARIN "CLARIN.SI"

 Subject(s)

hate speech offensive language YouTube social media

 Collection(s)

CLARIN.SI data & tools

Show full item record