Post-OCR correction training dataset sPeriodika-postOCR

  Authors

Dobranić, Filip ; Konda, Karin ; Evkoski, Bojan and Ljubešić, Nikola

  Item identifier

http://hdl.handle.net/11356/1907

 Project URL

https://www.inz.si/en/dihur/

 Date issued

2024-01-10

 Type

corpus, text

 Size

409 texts

 Language(s)

Slovenian

 Description

The post-OCR correction dataset consists of paragraphs of text, at least 100 characters in length, extracted from documents randomly sampled from the sPeriodika dataset (http://hdl.handle.net/11356/1881) of Slovenian historical periodicals. From each document five paragraphs were randomly sampled. If the paragraph was longer than 500 characters, it was trimmed to that length. The correction was performed by one human annotator having access to the scan of the original document. Out of the original collection of 450 paragraphs, 41 were discarded due to non-running text or very bad quality of the OCR. The metadata in the CSV dataset are the following: - URN of the document - link to the original PDF in dLib - name of the periodical - publisher of the periodical - publication date - original text - corrected text - line offset (zero-indexed) - character length of the paragraph (trimmed to max. 500 characters)

 Publisher

Institute of Contemporary History

 Acknowledgement

Slovenian Research Agency (ARRS) P6-0436 "Basic national research program 'Digital Humanities' (2022-2027)"

Jožef Stefan Institute CLARIN "CLARIN.SI"

 Subject(s)

historical corpus optical character recognition post-correction

 Collection(s)

CLARIN.SI data & tools

Show full item record