Dataset of Slovene medical texts PoVeJMo-VeMo-Med 1.0

  Authors

Malenšek, Miha and Bajec, Marko

  Item identifier

http://hdl.handle.net/11356/1983

 Project URL

https://www.cjvt.si/povejmo/en/project/

 Date issued

2024-09-25

 Type

corpus, text

 Size

17701 texts

 Language(s)

Slovenian

 Description

PoVeJMo-VeMo-Med is a dataset containing Slovene medical texts. The bulk of it is comprised of instructions of use for different prescribed drugs. The texts were extracted from the Slovene Central Drug Database (Centralna baza zdravil; http://www.cbz.si/), with a minority of documents from the National Institute of Public Health (Nacionalni inštitut za javno zdravje; https://nijz.si/). The documents were converted from PDF-files to text format. The dataset can be used to fine-tune large language models for the medical domain. Version 1.0 contains two subversions of the corpus: the original (with 17,701 texts) and the deduplicated version (with 5,841 texts), in which duplicate texts have been removed. Please note that this dataset was also the basis for the automatic generation of the Slovene instruction-following dataset for large language models GaMS-Instruct-MED 1.0 (http://hdl.handle.net/11356/1982). For more information on how the two are related, please consult the entry for GaMS-Instruct-MED 1.0.

 Publisher

Faculty of Computer and Information Science, University of Ljubljana

 

VITASIS, d.o.o.

 Acknowledgement

ARIS (Slovenian Research and Innovation Agency) NOO "PoVeJMo research project (Adaptive Natural Language Processing with Large Language Models)"

ARRS (Slovenian Research Agency) P6-0411 "Language Resources and Technologies for Slovene"

 Subject(s)

specialised corpus medical texts large language models

 Collection(s)

CLARIN.SI data & tools

Show full item record