The news articles reporting on the 2021 Tokyo Olympics data set OG2021 (public)

Name: The news articles reporting on the 2021 Tokyo Olympics data set OG2021 (public)
License: https://creativecommons.org/licenses/by-nc-nd/4.0/

Novak, Erik; Calcina, Erik; Mladenić, Dunja; Grobelnik, Marko

The news articles reporting on the 2021 Tokyo Olympics data set OG2021 (public)

CLARIN.SI data & tools

Authors: Novak, Erik ; Calcina, Erik ; Mladenić, Dunja and Grobelnik, Marko

Item identifier: http://hdl.handle.net/11356/1922

Project URL: https://www.humane-ai.eu/

Demo URL: https://github.com/E3-JSI/dataset-OG2021

Date issued: 2024-02-27

Type: corpus, text

Size: 10940 articles

Language(s): Arabic , Chinese , English , French , German , Portuguese , Russian , Slovenian , Spanish

Description: The OG2021 corpus contains multilingual news articles that are reporting on the events happening during the 2021 Tokyo Olympics. The data set was created to evaluate the clustering algorithm. The articles were initially acquired via the EventRegistry service, clustered using an online news clustering algorithm, and finally manually inspected and annotated by a single evaluator using translation services to understand the meaning of the articles' content. The corpus consists of a single file called og2021.csv, which contains the data of 10.940 news articles grouped into 1.350 clusters. Each article has the following attributes: - id: The ID of the news article. - title: The title of the article. - lang: The language in which the article is written. Can be one of nine values. - source: The news publisher's name. - published_at: The date and time when the article was published. The published dates range between 2021-07-01 and 2021-08-14. - URL: The URL location of the news article. - cluster_id: The ID of the cluster the article is a member of. The dataset is also published with the body attribute but under a more restrictive licence. It can be found at http://hdl.handle.net/11356/1921.