Janes corpus n-grams 1.0

  Authors

Dobrovoljc, Kaja

  Item identifier

http://hdl.handle.net/11356/1192

 Referenced by

http://www.sdjt.si/wp/wp-content/uploads/2018/09/JTDH-2018_Dobrovoljc-K_Frekvencni-seznami-n-gramov-v-korpusih-slovenskega-jezika.pdf

 Date issued

2018-08-01

 Type

lexicalConceptualResource, text

 Size

2502460 unigrams, 35969381 bigrams, 89128455 trigrams, 113108440 4-grams, 110320967 5-grams, 351029703 n-grams

 Language(s)

Slovenian

 Description

A collection of n-grams extracted from the Janes corpus of Slovenian user-generated content version 1.0 (cf. http://nl.ijs.si/janes/). Three sets of n-gram lists are provided for lowercased word n-grams of length 1 to 5: - extensive frequency lists of all extracted n-grams - filtered frequency lists of n-grams with minimum frequency 10/mil. - adjusted frequency list of all n-grams with minimum frequency 10/mil. Only n-grams within sentences have been counted, ignoring punctuation. For the filtered and adjusted list, only n-grams occurring in at least 2 different texts have been extracted. Key references: - K. Dobrovoljc, 2018. N-gram frequency lists for reference corpora of Slovenian language. Proceedings of the Language Technologies & Digital Humanities Conference 2018. - T. Erjavec, N. Ljubešić, D. Fišer, 2018. Korpus slovenskih spletnih uporabniških vsebin Janes. V: FIŠER, Darja (ur.). Viri, orodja in metode za analizo spletne slovenščine. Znanstvena založba Filozofske fakultete Univerze v Ljubljani. https://e-knjige.ff.uni-lj.si/znanstvena-zalozba/catalog/book/111 - M. B. O’Donnell, 2010. The adjusted frequency list: A method to produce cluster-sensitive frequency lists. ICAME Journal 35, 135–169.

 Publisher

Centre for Language Resources and Technologies, University of Ljubljana

 Acknowledgement

ARRS (Slovenian Research Agency) MR-36491 "Young Researcher Programme"

ARRS (Slovenian Research Agency) J6-8256 "New grammar of contemporary standard Slovene: sources and methods"

 Subject(s)

n-grams wordlist multiword expressions

 Collection(s)

CLARIN.SI data & tools

Show full item record