Monitor corpus of Slovene Trendi 2022-10
- Avtorji
-
Kosem, Iztok ; et al.prikaži vse
Kosem, Iztok ; Čibej, Jaka ; Dobrovoljc, Kaja ; Erjavec, Tomaž ; Ljubešić, Nikola ; Ponikvar, Primož ; Šinkec, Mihael ; Krek, Simon
- Identifikator vnosa
- http://hdl.handle.net/11356/1681
- URL projekta
- https://sled.ijs.si/
- Dokumentirano v
-
http://euralex.org/wp-content/themes/euralex/proceedings/Euralex%202022/EURALEX2022_Pr_p230-239_Kosem.pdf
https://nl.ijs.si/jtdh22/pdf/JTDH2022_Kosem-et-al_Spremljevalni-korpus-Trendi.pdf
- Datum objave
- 2022-11-21
- Velikost
- 641951202 tokens, 537445273 words, 28551916 sentences
- Jezik(i)
- Slovenian
- Opis
- The Trendi corpus is a monitor corpus of Slovene. It contains news from 106 different media websites, published by 48 different publishers. Trendi 2022-10 covers the period from January 2019 to October 2022, complementing the Gigafida 2.0 reference corpus of written Slovene (http://hdl.handle.net/11356/1320). All the contents of the Trendi corpus are at the moment obtained using the Jožef Stefan Institute Newsfeed service (http://newsfeed.ijs.si/). The texts have been annotated using the CLASSLA-Stanza pipeline (https://github.com/clarinsi/classla), including syntactic parsing according to the Universal Dependencies (https://universaldependencies.org/sl/) and Named Entities (https://nl.ijs.si/janes/wp-content/uploads/2017/09/SlovenianNER-eng-v1.1.pdf). An important addition to this version are topics or thematical categories, which have been automatically assigned to each text. There are 13 categories altogether: Arts and culture, Crime and accidents, Economy, Environment, Health, Leisure, Politics and Law, Science and Technology, Society, Sports, Weather, Entertainment, and Education. Text classification models are available at http://hdl.handle.net/11356/1709 (Text classification model SloBERTa-Trendi-Topics 1.0), http://hdl.handle.net/11356/1710 (Text classification model fastText-Trendi-Topics 1.0), and https://huggingface.co/cjvt/sloberta-trendi-topics (SloBERTa model). At the moment, the corpus is not available as a dataset due to copyright restrictions but we hope to make at least some of it available in the near future. The corpus is accessible through CLARIN.SI concordancers.
- Izdajatelj
- Jožef Stefan Institute
- Zahvala
- Ministry of Culture of the Republic of Slovenia JR-infrastruktura-SJ-2021-2022 "SLED - Monitor corpus of Slovene and related resources"
- Zbirke
-
Ta vnos je bil nadomeščen z novejšim.