Gos corpus n-grams 2.0

Gos corpus n-grams 2.0

CLARIN.SI data & tools

Authors: Dobrovoljc, Kaja

Item identifier: http://hdl.handle.net/11356/1195

Referenced by: http://www.sdjt.si/wp/wp-content/uploads/2018/09/JTDH-2018_Dobrovoljc-K_Frekvencni-seznami-n-gramov-v-korpusih-slovenskega-jezika.pdf

Date issued: 2018-08-03

Type: lexicalConceptualResource, text

Size: 62710 unigrams, 394416 bigrams, 692260 trigrams, 750559 4-grams, 698208 5-grams, 2598153 n-grams

Language(s): Slovenian

Description: A collection of n-grams extracted from the Gos corpus of spoken Slovene (cf. http://eng.slovenscina.eu/korpusi/gos). Three sets of n-gram lists are provided for lowercased word n-grams of length 1 to 5: - extensive frequency lists of all extracted n-grams - filtered frequency lists of n-grams with minimum frequency 10/mil. - adjusted frequency list of all n-grams with minimum frequency 10/mil. Only n-grams within sentences have been counted, ignoring punctuation. For the filtered and adjusted list, only n-grams occurring in at least 2 different texts have been extracted. Key references: - K. Dobrovoljc, 2018. N-gram frequency lists for reference corpora of Slovenian language. Proceedings of the Language Technologies & Digital Humanities Conference 2018. - D. Verdonik, I. Kosem, A. Zwitter Vitez, S. Krek, M. Stabej, 2013. Compilation, transcription and usage of a reference speech corpus: The case of the Slovene corpus GOS. Language resources and evaluation, 47 (4), pp. 1031-1048, doi: 10.1007/s10579-013-9216-5. - M. B. O’Donnell, 2010. The adjusted frequency list: A method to produce cluster-sensitive frequency lists. ICAME Journal 35, 135–169.

Publisher: Centre for Language Resources and Technologies, University of Ljubljana

Subject(s): n-grams wordlist multiword expressions spoken corpus

Collection(s): CLARIN.SI data & tools

Other versions

Show full item record

Files in this item

Download all files in item (21.02 MB)

This item is

Publicly Available

and licensed under:
Creative Commons - Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)

Name: all_1-5-grams_Gos.zip
Size: 20.83 MB
Format: application/zip
Description: Collection of all n-grams.
MD5: 48e9597d1a39f29e2c65f38ef236c41a

Download file Preview

File Preview

- gos_lc_c-no_n-3_t-1_x-1.txt13 MB
- gos_lc_c-no_n-5_t-1_x-1.txt19 MB
- gos_lc_c-no_n-2_t-1_x-1.txt6 MB
- gos_lc_c-no_n-4_t-1_x-1.txt17 MB
- gos_lc_c-no_n-1_t-1_x-1.txt802 kB

Name: filtered_1-5-grams_Gos.zip
Size: 101.68 KB
Format: application/zip
Description: Collection of n-grams above frequency 10/mil.
MD5: b000a8afda2b5181d6c6bfbc0ff55206

Download file Preview

File Preview

- gos_lc_c-no_n-5_t-10_x-2.txt1 kB
- gos_lc_c-no_n-4_t-10_x-2.txt5 kB
- gos_lc_c-no_n-3_t-10_x-2.txt54 kB
- gos_lc_c-no_n-2_t-10_x-2.txt135 kB
- gos_lc_c-no_n-1_t-10_x-2.txt87 kB

Name: adjusted_1-5-grams_Gos.zip
Size: 91.73 KB
Format: application/zip
Description: List of all n-grams with adjusted frequency above 10/mil.
MD5: 2c5fe866fde6ff1cbc3cb76255d93039

Download file Preview

File Preview

- AFL_gos_lc_c-no_n-5_t-10_x-2.txt310 kB