CroSloEngual BERT

Name: CroSloEngual BERT
License: https://creativecommons.org/licenses/by/4.0/

Ulčar, Matej; Robnik-Šikonja, Marko

CroSloEngual BERT

CLARIN.SI data & tools

Authors: Ulčar, Matej and Robnik-Šikonja, Marko

Item identifier: http://hdl.handle.net/11356/1317

Project URL: http://embeddia.eu

Referenced by: https://arxiv.org/abs/2006.07890

Date issued: 2020-06-16

Type: toolService

Language(s): Croatian , English , Slovenian

Description: Trilingual BERT (Bidirectional Encoder Representations from Transformers) model, trained on Croatian, Slovenian, and English data. State of the art tool representing words/tokens as contextually dependent word embeddings, used for various NLP classification tasks by finetuning the model end-to-end. CroSloEngual BERT are neural network weights and configuration files in pytorch format (ie. to be used with pytorch library).

Publisher: Faculty of Computer and Information Science, University of Ljubljana

Subject(s): word embeddings multilingual contextual embeddings BERT language model

Collection(s): CLARIN.SI data & tools

This item is replaced by a newer submission:

http://hdl.handle.net/11356/1330

Show full item record

Files in this item

Download all files in item (476.35 MB)

This item is

Publicly Available

and licensed under:
Creative Commons - Attribution 4.0 International (CC BY 4.0)

Name: pytorch_model.bin
Size: 476.04 MB
Format: Unknown
Description: CroSloEngual BERT model
MD5: 6b26401118943bf61b66a70d2ae68b9d

Download file

Name: config.json
Size: 520 bytes
Format: Unknown
Description: Configuration file, describing the model's architecture
MD5: db3bdd5c4db6ffffa9bf3edab2e7be70

Download file

Name: vocab.txt
Size: 321.41 KB
Format: Text file
Description: Subword token (WordPiece) vocabulary
MD5: 37b1484f6841d214c3101f878f2473ae

Download file Preview

File Preview

[PAD]
[EOS]
[PAD]
[unused0]
[unused1]
[unused2]
[unused3]
[unused4]
[unused5]
[unused6]
[unused7]
[unused8]
[unused9]
[unused10]
[unused11]
[unused12]
[unused13]
[unused14]
[unused15]
[unused16]
[unused17]
[unused18]
[unused19]
[unused20]
[unused21]
[unused22]
[unused23]
[unused24]
[unused25]
[unused26]
[unused27]
[unused28]
[unused29]
[unused30]
[unused31]
[unused32]
[unused33]
[unused34]
[unused35]
[unused36]
[unused37]
[unused38]
[unused39]
[unused40]
[unused41]
[unused42]
[unused43]
[unused44]
[unused45]
[unused46]
[unused47]
[unused48]
[unused49]
[unused50]
[unused51]
[unused52]
[unused53]
[unused54]
[unused55]
[unused56]
[unused57]
[unused58]
[unused59]
[unused60]
[unused61]
[unused62]
[unused63]
[unused64]
[unused65]
[unused66]
[unused67]
[unused68]
[unused69]
[unused70]
[unused71]
[unused72]
[unused73]
[unused74]
[unused75]
[unused76]
[unused77]
[unused78]
[unused79]
[unused80]
[unused81]
[unused82]
[unused83]
[unused84]
[unused85]
[unused86]
[unused87]
[unused88]
[unused89]
[u . . .

CroSloEngual BERT

Files in this item

Partners

Partners

Repository