Frequency lists of word-level n-grams from the GOS 1.0 corpus

  Authors

Čibej, Jaka ; Arhar Holdt, Špela ; Dobrovoljc, Kaja and Krek, Simon

  Item identifier

http://hdl.handle.net/11356/1271

 Project URL

http://slovnica.ijs.si/

 Date issued

2019-11-18

 Type

lexicalConceptualResource, text

 Size

23 files

 Language(s)

Slovenian

 Description

Frequency lists of word-level n-grams (or word sets) were extracted from the GOS 1.0 Corpus of Spoken Slovene (http://hdl.handle.net/11356/1040) using the LIST corpus extraction tool (http://hdl.handle.net/11356/1227). The lists contain all word-level 2-, 3-, 4- and 5-grams occurring in the corpus along with their absolute and relative frequencies, percentages, distribution across the text-types included in the corpus taxonomy, and five collocation measures: Dice, t-score, MI, MI3, logDice, and simple LL. The n-grams were extracted from lower-case word forms, normalized word forms, and morphosyntactic tags. For large lists, shortened versions with the first 150,000 lines were also prepared to facilitate further processing in spreadsheet analysis software.

 Publisher

Centre for Language Resources and Technologies, University of Ljubljana

 

Jožef Stefan Institute

 Acknowledgement

ARRS (Slovenian Research Agency) J6-8256 "New grammar of contemporary standard Slovene: sources and methods"

Ministry of Education, Science and Sport 3311-08-986003 "Communication in Slovene"

 Subject(s)

n-grams words word forms normalized forms spoken corpus word sets morphosyntactic tags

 Collection(s)

CLARIN.SI data & tools

 

This item is replaced by a newer submission:

http://hdl.handle.net/11356/1365

List all versions  

Show full item record