Monitor corpus of Slovene Trendi 2022-10

  Authors

Kosem, Iztok ; et al.show everyone

Kosem, Iztok ; Čibej, Jaka ; Dobrovoljc, Kaja ; Erjavec, Tomaž ; Ljubešić, Nikola ; Ponikvar, Primož ; Šinkec, Mihael ; Krek, Simon

  Item identifier

http://hdl.handle.net/11356/1681

 Project URL

https://sled.ijs.si/

 Referenced by

http://euralex.org/wp-content/themes/euralex/proceedings/Euralex%202022/EURALEX2022_Pr_p230-239_Kosem.pdf
https://nl.ijs.si/jtdh22/pdf/JTDH2022_Kosem-et-al_Spremljevalni-korpus-Trendi.pdf

 Date issued

2022-11-21

 Type

corpus, text

 Size

641951202 tokens, 537445273 words, 28551916 sentences

 Language(s)

Slovenian

 Description

The Trendi corpus is a monitor corpus of Slovene. It contains news from 106 different media websites, published by 48 different publishers. Trendi 2022-10 covers the period from January 2019 to October 2022, complementing the Gigafida 2.0 reference corpus of written Slovene (http://hdl.handle.net/11356/1320). All the contents of the Trendi corpus are at the moment obtained using the Jožef Stefan Institute Newsfeed service (http://newsfeed.ijs.si/). The texts have been annotated using the CLASSLA-Stanza pipeline (https://github.com/clarinsi/classla), including syntactic parsing according to the Universal Dependencies (https://universaldependencies.org/sl/) and Named Entities (https://nl.ijs.si/janes/wp-content/uploads/2017/09/SlovenianNER-eng-v1.1.pdf). An important addition to this version are topics or thematical categories, which have been automatically assigned to each text. There are 13 categories altogether: Arts and culture, Crime and accidents, Economy, Environment, Health, Leisure, Politics and Law, Science and Technology, Society, Sports, Weather, Entertainment, and Education. Text classification models are available at http://hdl.handle.net/11356/1709 (Text classification model SloBERTa-Trendi-Topics 1.0), http://hdl.handle.net/11356/1710 (Text classification model fastText-Trendi-Topics 1.0), and https://huggingface.co/cjvt/sloberta-trendi-topics (SloBERTa model). At the moment, the corpus is not available as a dataset due to copyright restrictions but we hope to make at least some of it available in the near future. The corpus is accessible through CLARIN.SI concordancers.

 Publisher

Jožef Stefan Institute

 Acknowledgement

Ministry of Culture of the Republic of Slovenia JR-infrastruktura-SJ-2021-2022 "SLED - Monitor corpus of Slovene and related resources"

 Subject(s)

monitor corpus news corpus universal dependencies temporal trends topic attribution

 Collection(s)

CLARIN.SI data & tools

 

This item is replaced by a newer submission:

http://hdl.handle.net/11356/1782

List all versions  

Show full item record