Comparable corpora of South-Slavic Wikipedias CLASSLA-Wikipedia 1.0

  Avtorji

Ljubešić, Nikola ; Markoski, Filip ; Markoska, Elena and Erjavec, Tomaž

  Identifikator vnosa

http://hdl.handle.net/11356/1427

 URL projekta

https://github.com/clarinsi/classla-wikipedia

 Dokumentirano v

https://aclanthology.org/2021.ranlp-1.104.pdf

 Datum objave

2021-05-05

 Vrsta

corpus, text

 Velikost

1928450 articles, 37677016 sentences, 486258862 tokens

 Jezik(i)

Bosnian , Croatian , Macedonian , Montenegrin , Serbian , Serbo-Croatian , Slovenian

 Opis

This comparable corpus collection consists of Wikipedia dumps of the Bosnian, Croatian, Macedonian, Montenegrin, Serbian, Serbo-Croatian and Slovenian Wikipedia, harvested on October 17th 2020. The text was extracted from the dumps with the process documented at https://github.com/clarinsi/classla-wikipedia, and linguistic annotation was performed with the classla package (https://pypi.org/project/classla/), on all levels available for a specific language, with the Bosnian and Serbo-Croatian Wikipedias processed with the standard Croatian models.

 Izdajatelj

Jožef Stefan Institute

 Zahvala

Jožef Stefan Institute CLARIN "CLARIN.SI"

ARRS (Slovenian Research Agency) P6-0411 "Language Resources and Technologies for Slovene"

ARRS (Slovenian Research Agency) N6-0099 "LiLaH: Linguistic Landscape of Hate Speech"

European Union’s Rights,Equality and Citizenship Programme 875263 "IMSyPP - Innovative Monitoring Systems and PreventionPolicies of Online Hate Speech"

 Ključne besede

comparable corpus Wikipedia

 Zbirke

CLARIN.SI data & tools

Prikaži polni zapis vnosa