IMP corpus n-grams 1.0

IMP corpus n-grams 1.0

CLARIN.SI data & tools

Authors: Dobrovoljc, Kaja

Item identifier: http://hdl.handle.net/11356/1053

Project URL: http://nl.ijs.si/imp/index-en.html

Date issued: 2015-07-01

Type: lexicalConceptualResource, text

Size: 61 mb, 2464719 items

Language(s): Slovenian

Description: This is a collection of n-grams extracted from the IMP corpus of historical Slovene (http://hdl.handle.net/11356/1031). In addition to the separate lists of n-grams for tokens and their attributes (modernised form, morphosyntacic tag, lemma), an adjusted frequency list with statistical substring reduction has also been added (as described in O'Donnell 2011). Only n-grams within sentences have been counted.

Publisher: Trojina, Institute for Applied Slovene Studies

Faculty of Arts, University of Ljubljana

Subject(s): n-grams wordlist multiword expressions historical language

Collection(s): CLARIN.SI data & tools

This item is replaced by a newer submission:

http://hdl.handle.net/11356/1194

Show full item record

Files in this item

Download all files in item (16.66 MB)

This item is

Publicly Available

and licensed under:
Creative Commons - Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)

Name: imp_ngrams_word_1-5.zip
Size: 3.01 MB
Format: application/zip
Description: 1- to 5-grams of words (historical spelling) excluding punctuation. The minimum frequency threshold is 5.
MD5: 9f5ef25bde132c88d881ac3f9302d554

Download file Preview

File Preview

- sorted_cut-5_imp_word_c-no_n-5_t-1.txt90 kB
- sorted_cut-5_imp_word_c-no_n-4_t-1.txt555 kB
- sorted_cut-5_imp_word_c-no_n-2_t-1.txt3 MB
- sorted_cut-5_imp_word_c-no_n-3_t-1.txt2 MB
- sorted_cut-5_imp_word_c-no_n-1_t-1.txt1 MB

Name: imp_ngrams_norm_1-5.zip
Size: 3 MB
Format: application/zip
Description: 1- to 5-grams of normalized words (modernised spelling) excluding punctuation. The minimum frequency threshold is 5.
MD5: 7e673805f64b452c63071fe25a7d4635

Download file Preview

File Preview

- sorted_cut-5_imp_lc_c-no_n-5_t-1.txt121 kB
- sorted_cut-5_imp_lc_c-no_n-3_t-1.txt2 MB
- sorted_cut-5_imp_lc_c-no_n-4_t-1.txt698 kB
- sorted_cut-5_imp_lc_c-no_n-2_t-1.txt3 MB
- sorted_cut-5_imp_lc_c-no_n-1_t-1.txt1 MB

Name: imp_ngrams_word-norm-lemma-tag_1-5.zip
Size: 8.61 MB
Format: application/zip
Description: 1- to 5-grams of words with normalized form, lemma and morphosyntactic tag including punctuation. The minimum frequency threshold is 5.
MD5: e0f78e9be4bc742c92c0d17e2d556f48

Download file Preview

File Preview

- sorted_cut-5_imp_word-lc-lemma-tag_c-yes_n-4_t-1.txt5 MB
- sorted_cut-5_imp_word-lc-lemma-tag_c-yes_n-5_t-1.txt1 MB
- sorted_cut-5_imp_word-lc-lemma-tag_c-yes_n-3_t-1.txt11 MB
- sorted_cut-5_imp_word-lc-lemma-tag_c-yes_n-2_t-1.txt15 MB
- sorted_cut-5_imp_word-lc-lemma-tag_c-yes_n-1_t-1.txt4 MB

Name: imp_AFL_norm_1-5_min5M.zip
Size: 2.04 MB
Format: application/zip
Description: Adjusted frequency list for 1- to 5-grams of normalized words (modernised spelling) excluding punctuation. The minimum relative frequency threshold for substring reduction is 5. Column 1: n-gram; column 2: length of n-gram, column 3: adjusted corpus frequency.
MD5: 79c94b6f4f462c7797e52724165087b7

Download file Preview

File Preview

- sorted_cut-1_AFL_imp_lc_c-no_n-5_t-75.txt5 MB