CMC training corpus Janes-Norm 1.2

CMC training corpus Janes-Norm 1.2

CLARIN.SI data & tools

Authors: Erjavec, Tomaž ; Fišer, Darja ; Čibej, Jaka and Arhar Holdt, Špela

Item identifier: http://hdl.handle.net/11356/1084

Project URL: https://nl.ijs.si/janes/

Referenced by: https://nl.ijs.si/janes/viri/rocno-oznaceni-korpusi/#Janes-Norm
https://doi.org/10.1007/s10579-018-9425-z

Date issued: 2016-12-30

Type: corpus, text

Size: 7816 texts, 184755 tokens

Language(s): Slovenian

Description: Janes-Norm is a manually annotated corpus of Slovene Computer-Mediated Communication (CMC). It is meant as a gold-standard training and testing dataset for tokenisation, sentence segmentation and word normalisation of non-standard Slovene. As the corpus has been carefully manually annotated, it is also suitable for detailed linguistic explorations which require highly accurate and reliable annotations. A slightly older version of this corpus is described in: ERJAVEC, Tomaž, ČIBEJ, Jaka, ARHAR HOLDT, Špela, LJUBEŠIĆ, Nikola, FIŠER, Darja. Gold-standard datasets for annotation of Slovene computer-mediated communication. In Proceedings of RASLAN 2016: Recent Advances in Slavonic Natural Language Processing. Brno: Tribun EU, 2016, pp. 29-40, https://nlp.fi.muni.cz/raslan/raslan16.pdf Note that the corpus is also annotated with morphosyntactic descriptions and lemmas. These annotations are manual where the texts correspond to the Janes-Tag corpus (http://hdl.handle.net/11356/1085) and automatic for the other texts.

Publisher: Jožef Stefan Institute

Subject(s): computer-mediated communication tokenisation word normalisation manual annotation TEI

Collection(s): CLARIN.SI data & tools

This item is replaced by a newer submission:

http://hdl.handle.net/11356/1733

Show full item record

Files in this item

Download all files in item (4.01 MB)

This item is

Publicly Available

and licensed under:
Creative Commons - Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)

Name: RASLAN16-Janes.pdf
Size: 210.85 KB
Format: PDF
Description: RASLAN'16 paper describing the corpus
MD5: 7487b904191a41f8cb38bbdfe12ba14e

Name: Janes-smernice-v1.0.pdf
Size: 339.69 KB
Format: PDF
Description: Annotation Guidelines (in Slovene)
MD5: 39845f938d68b0e3330259eab31c6043

Name: Janes-Norm.zip
Size: 2.1 MB
Format: application/zip
Description: Corpus in TEI format
MD5: 2a67d77dfecdacfca5d0b9268f26648c

Download file Preview

File Preview

Janes-Norm
- janes.norm.xml12 kB
- msd-fslib-sl.xml461 kB
- janes.norm.body.xml14 MB
- schema
  - tei_janes_doc.html2 MB
  - tei_janes.rng399 kB
  - tei_janes_schema.xml2 kB
  - tei_janes.zip44 kB
  - tei_janes.rnc188 kB

Name: Janes-Norm.vert.zip
Size: 1.37 MB
Format: application/zip
Description: Derived corpus in vertical format
MD5: 346a866ce28ed4bd095ba1115c3f29dd

Download file Preview

File Preview

- janes.norm.vert6 MB
- janes.norm.regi1 kB