Corpus of scientific texts from the Open Science Slovenia portal OSS 1.0

  Authors

Žagar, Kristjan ; Ferme, Marko ; Ojsteršek, Milan ; Jemec Tomazin, Mateja and Erjavec, Tomaž

  Item identifier

http://hdl.handle.net/11356/1774

 Project URL

https://rsdo.slovenscina.eu/terminoloski-portal

 Referenced by

https://openscience.si/

 Date issued

2023-02-26

 Type

corpus, text

 Size

151078 texts, 2594111172 words, 326194166 tokens

 Language(s)

Slovenian

 Description

OSS is a large collection of scientific writing in the Slovenian language gathered from the Open Science Slovenia portal (https://openscience.si). It consists of over 150 thousand monographs, articles, diploma, master's and doctoral theses, advanced textbooks, reviews etc. mostly published between 2000 and 2022 by Slovenian universities, research institutions, etc. Texts are accompanied by metadata, i.e. author, supervisor (for theses), year of publication, publisher (mostly faculties of the various universities), type of publication (according to SICRIS classification), keywords, and CERIF and UDC codes. The texts were obtained directly from PDFs, so it should be noted that they can contain various types of character noise. The texts are linguistically annotated with the CLASSLA pipeline (https://github.com/clarinsi/classla) on the levels lemmatisation, MULTEXT-East Version 6 morphosyntactic descriptions, Universal Dependencies part-of-spech and morphological features, and named entities. The corpus is distributed in CoNLL-U and vertical file formats, one file for each text. The text metadata is given as a TSV file. Note that there exist similar, but older and smaller corpora KAS 2.0 (http://hdl.handle.net/11356/1448) and KAS 1.0 (http://hdl.handle.net/11356/1244). These contain only theses and only up to 2018, but are cleaner and with more metadata. The repository also archives a number of KAS-derived datasets; pls. search for "KAS" to find them.

 Publisher

Faculty of Electrical Engineering and Computer Science, University of Maribor

 Acknowledgement

Ministry of Culture C3340-20-278001 "Development of Slovene in a Digital Environment"

 Subject(s)

Slovenian scientific texts

 Collection(s)

CLARIN.SI data & tools

Show full item record