Word embeddings CLARIN.SI-embed.sl 2.0

  Authors

Terčon, Luka ; Ljubešić, Nikola and Erjavec, Tomaž

  Item identifier

http://hdl.handle.net/11356/1791

 Date issued

2023-04-11

 Type

lexicalConceptualResource, text

 Size

3471054 entries

 Language(s)

Slovenian

 Description

CLARIN.SI-embed.sl contains word embeddings induced from a large collection of Slovene texts composed of existing corpora of Slovene, e.g GigaFida, Janes, KAS, slWaC, MaCoCu-sl, etc. The embeddings are based on the skip-gram model of fastText trained on 5,791,405,942 tokens of running text for 3,471,054 lowercased surface forms. The difference to the previous version of the embeddings is that this version was trained on the original dataset expanded with the MaCoCu-sl web crawl corpus (http://hdl.handle.net/11356/1517).

 Publisher

Jožef Stefan Institute

 Acknowledgement

Jožef Stefan Institute CLARIN "CLARIN.SI"

Connecting Europe Facility (CEF) Telecom INEA/CEF/ICT/A2020/2278341 "MaCoCu - Massive collection and curation of monolingual and bilingual data: focus on under-resourced languages"

Ministry of Culture C3340-20-278001 "Development of Slovene in a Digital Environment"

ARRS (Slovenian Research Agency) J7-4642 "MEZZANINE"

ARRS (Slovenian Research Agency) P6-0411 "Language Resources and Technologies for Slovene"

 Subject(s)

word embeddings

 Collection(s)

CLARIN.SI data & tools

 Other versions

List all versions  

Show full item record