The Orange workflow for observing collocation clusters ColEmbed 1.0

  Authors

Kosem, Iztok ; et al.show everyone

Kosem, Iztok ; Čibej, Jaka ; Ljubešić, Nikola ; Krek, Simon ; Gantar, Polona ; Arhar Holdt, Špela ; Logar, Nataša ; Laskowski, Cyprian ; Klemenc, Bojan ; Dobrovoljc, Kaja ; Gorjanc, Vojko ; Pori, Eva

  Item identifier

http://hdl.handle.net/11356/1425

 Project URL

https://www.cjvt.si/kolos/

 Date issued

2020-10-26

 Type

toolService

 Description

The Orange Workflow for Observing Collocation Clusters ColEmbed 1.0 ColEmbed is a workflow (.OWS file) for Orange Data Mining (an open-source machine learning and data visualization software: https://orangedatamining.com/) that allows the user to observe clusters of collocation candidates extracted from corpora. The workflow consists of a series of data filters, embedding processors, and visualizers. As input, the workflow takes a tab-separated file (.TSV/.TAB) with data on collocations extracted from a corpus, along with their relative frequencies by year of publication and other optional values (such as information on temporal trends). The workflow allows the user to select the features which are then used in the workflow to cluster collocation candidates, along with the embeddings generated based on the selected lemmas (either one lemma or both lemmas can be selected, depending on our clustering criteria; for instance, if we wish to cluster adjective+noun candidates based on the similarities of their noun components, we only select the second lemma to be taken into account in embedding generation). The obtained embedding clusters can be visualized and further processed (e.g. by finding the closest neighbors of a reference collocation). The workflow is described in more detail in the accompanying README file. The entry also contains three .TAB files that can be used to test the workflow. The files contain collocation candidates (along with their relative frequencies per year of publication and four measures describing their temporal trends; see http://hdl.handle.net/11356/1424 for more details) extracted from the Gigafida 2.0 Corpus of Written Slovene (https://viri.cjvt.si/gigafida/) with three different syntactic structures (as defined in http://hdl.handle.net/11356/1415): 1) p0-s0 (adjective + noun, e.g. rezervni sklad), 2) s0-s2 (noun + noun in the genitive case, e.g. ukinitev lastnine), and 3) gg-s4 (verb + noun in the accusative case, e.g. pripraviti besedilo). It should be noted that only collocation candidates with absolute frequency of 15 and above were extracted. Please note that the ColEmbed workflow requires the installation of the Text Mining add-on for Orange. For installation instructions as well as a more detailed description of the different phases of the workflow and the measures used to observe the collocation trends, please consult the README file.

 Publisher

Centre for Language Resources and Technologies, University of Ljubljana

 Acknowledgement

ARRS (Slovenian Research Agency) J6-8255 "Collocations as a basis for language description: semantic and temporal perspectives"

ARRS (Slovenian Research Agency) J6-8256 "New grammar of contemporary standard Slovene: sources and methods"

ARRS (Slovenian Research Agency) P6-0411 "Language Resources and Technologies for Slovene"

 Subject(s)

collocations clustering word embeddings temporal trends

 Collection(s)

CLARIN.SI data & tools

Show full item record