-
Notifications
You must be signed in to change notification settings - Fork 2
License
UniversalDependencies/UD_Swedish-LinES
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
# Summary UD Swedish_LinES is the Swedish half of the LinES Parallel Treebank with UD annotations. All segments are translations from English and the sources cover literary genres, online manuals and Europarl data. # Introduction UD Swedish_LinES is the Swedish half of the LinES Parallel Treebank with UD annotations. All segments are translations of the corresponding English segments found in the UD English_LinES treebank.The original dependency annotation was first automatically converted to Universal Dependencies and then partially reviewed (Ahrenberg, 2015). In January-February 2017 it was converted to UD version 2 and again reviewed for errors. With version 2.1 lemmata and morphological features have been added. The treebank is being developed continuously. # Acknowledgements Three of the source texts were collected as part of the Linköping Translation Corpus Corpus (Merkel, 1999). The treebank was first developed in the project 'Micro- and macro-level analysis of translations' funded by the Swedish Research Council (Ahrenberg, 2007). # Details on the sources All sub-corpora have English originals with Swedish translations. Six of them are literary works: Paul Auster: Stad av glas [City of Glass], Tiden, 1995. Translation by Ulla Roseen. Saul Bellow: Jerusalem tur och retur [To Jerusalem and back: a personal accunt], Bonniers, 1977. Translation by Caj Lundgren. Joseph Conrad: Mörkrets hjärta [Heart of darkness], Wahlström & Widstrand, Stockholm, 1983. Translation by Margaretha Odelberg. Nadine Gordimer: Hedersgästen [A Guest of Honour], Bonniers, 1991. Translation by Magnus K:son Lindberg. J. K. Rowling: Harry Potter och Hemligheternas kammare [Harry Potter and the Chamber of Secrets], Tiden, 2001. Translation by Lena Fries-Gedin. Jennette Winterson: Vintergatan går genom magen [Gut Symmetries], Bakhåll, 2017. Translation by Ulla Roseen. In addition the corpus includes segments from Microsoft Access 2002 Online Help and the Swedish part of the Europarl corpus (v.7). DATA SPLITS For version 2.0 about 20% of the trees were randomly selected as test set, 20% as development set, and the rest as training set. This partitioning has remained the same since then. The partition applies in the same way to the English trees so that the order of corresponding trees is the same in the English and Swedish LinES files. The files are named - sv_lines-ud-dev.conllu - sv_lines-ud-train.conllu - sv_lines-ud-test.conllu BASIC STATISTICS Tree count: 4564 Word count: 79812 Token count: 79812 Dep. relations: 40 of which 7 are language-specific POS tags: 17 Category=value feature pairs: 0 TOKENIZATION The tokenization is largely based on whitespace, but punctuation marks except word-internal hyphens are treated as separate tokens. The original file also has several multi-word tokens, but these are separated in the UD version with all parts except the first assigned the UD dependency function 'fixed'. No tokens have internal blanks. MORPHOLOGY The morphological annotation in the UFEATS column is copied from the UD_Swedish treebank where overlaps occur. For other tokens it has been converted from the morphological information in the original treebank (found in the XPOS column). Nouns are annotated for case, number, species and gender. Verbs are annotated for mood, verb form, tense and diathesis, adjectives for case, degree, definiteness, and number. Pronouns are sub-divided in the morphological description into Personal, Demonstrative, Interrogative, Indefinite, Relative, Total, and Expletive, and are annotated for Case and Number, when relevant. The mapping from language-specific part-of-speech tags to universal tags was done automatically. There are no other tags than universal tags, but there may be errors. SYNTAX The syntactic annotation in the Swedish UD treebank follows the general guidelines but adds some language-specific relations: - nmod:poss - acl:relcl - acl:cleft - compound:prt - nsubj:pass - aux:pass - obl:agent - csubj:pass The syntactic annotation was first automatically converted from the original LinES annotation scheme as described in Ahrenberg (2015). After conversion to UD version 2.0 the analyses have been reviewed again. Occasional deviations from the guidelines may remain. REFERENCES Lars Ahrenberg, 2007. LinES: An English-Swedish Parallel Treebank. Proceedings of the 16th Nordic Conference of Computational Linguistics (NODALIDA, 2007). Lars Ahrenberg, 2015. Converting an English-Swedish Parallel Treebank to Universal Dependencies. Proceedings of the Third International Conference on Dependency Linguistics (DepLing 2015), Uppsala, August 24-26, 2015, pp. 10-19. ACL Anthology W15-2103. Magnus Merkel, 1999: Understanding and enhancing translation by parallel text processing. Linköping Studies in Science and Technology, Dissertation No. 607. Changelog From version 1.3 to version 2.0 the following changes have been made: - a new split of the treebank into train, dev and test data - addition of sentence id:s and text comment for every tree - addition of document boundaries - addition of SpaceAfter=No features in the MISC column - more fixed phrases have been recognized as such - sentences of the form '"I'm hungry", said John', where the root previously was 'said' have been reanalyzed in accordance with the UD guidelines, 'said' then linking to 'hungry' as 'parataxis' From version 2.0 to version 2.1 the following changes have been made: - all tokens have received a lemma and morphological features have been added to tokens that should have them. - the test data have been manually reviewed to fix errors and agree better with the version 2 guidelines. The changes affect some 9% of all tokens and 28% of all punctuation tokens. Changes for version 2.2, made in order to harmonize annotations with those of UD_Swedish_Talbanken - the relative pronoun 'som' has been recategorized as PRON and its dependencies have been changed accordingly to nsubj, nsubj:pass, obj, obl, dislocated as is contextually appropriate - adpositions that introduce a clause have had their dependency changed from 'case' to 'mark' - cleft sentences of the form 'EXPL är/var XP som ...' have been reanalyzed so that the head word of XP is annotaded as 'root' while the clause introduced by 'som' is annotated as 'acl:cleft' In addition many inconsistencies and errors have been rectified. From version 2.2 to version 2.3 English names, esp. of software products, such as Microsoft Office 2002, have been reanalysed so as to agree with the analysis in the English_Lines treebank. Found errors in the first parts of all three files have been corrected. From version 2.3 to version 2.4 all changes concern the correction of errors so as to meet the stricter conditions on validation. From version 2.4 to version 2.5. Extension of 679 sentences from Winterson's 'Vintergatan går genom magen'. They have been distributed with 120 sentences for development and test, respectively, and the rest to the training part. The lemmatisation has been further harmonised with Swedish_Talbanken. From version 2.5 to version 2.6 only minor error corrections, in particular regarding the features PronType, Gender and Number. For version 2.9 the negative adverb 'inte' has consistently been given the UPOS PART. Also a few error corrections. For version 2.14 major revision of lemmas and features for adjectives and determiners to make them consistent with other Swedish treebanks. For version 2.15 a major revision of the use of 'fixed' has been undertaken and coordinated with UD_Swedish-Talbanken --- Machine readable metadata --- Data available since: UD v1.3 License: CC BY-NC-SA 4.0 Includes text: yes Genre: fiction nonfiction spoken Lemmas: converted from manual UPOS: converted with corrections XPOS: manual native Features: automatic Relations: converted with corrections Contributors: Ahrenberg, Lars Contributing: elsewhere Contact: lars.ahrenberg@liu.se
About
No description, website, or topics provided.
Resources
License
Stars
Watchers
Forks
Packages 0
No packages published