Nothing Special   »   [go: up one dir, main page]

loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Authors: Yanis Ouakrim 1 ; 2 ; Hannah Bull 1 ; Michèle Gouiffès 1 ; Denis Beautemps 2 ; Thomas Hueber 2 and Annelies Braffort 1

Affiliations: 1 LISN, Univ. Paris-Saclay, CNRS, 91405 Orsay, France ; 2 Univ. Grenoble Alpes, GIPSA-Lab, CNRS, F-38000 Grenoble, France

Keyword(s): Sign Language Processing, Sign Language Translation, Sign Language Corpora, French Sign Language, LSF.

Abstract: We introduce Mediapi-RGB, a new dataset of French Sign Language (LSF) along with the first LSF-to-French machine translation model. With 86 hours of video, it the largest LSF corpora with translation. The corpus consists of original content in French Sign Language produced by deaf journalists, and has subtitles in written French aligned to the signing. The current release of Mediapi-RGB is available at the Ortolang corpus repository (https://www.ortolang.fr/workspaces/mediapi-rgb), and can be used for academic research purposes. The test and validation sets contain 13 and 7 hours of video respectively. The training set contains 66 hours of video that will be released progressively until December 2024. Additionally, the current release contains skeleton keypoints, sign temporal segmentation, spatio-temporal features and subtitles for all the videos in the train, validation and test sets, as well as a suggested vocabulary of nouns for evaluation purposes. In addition, we present the re sults obtained on this corpus with the first LSF-to-French translation baseline to give an overview of the possibilities offered by this corpus of unprecedented caliber for LSF. Finally, we suggest potential technological and linguistic applications for this new video-text dataset. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 65.254.225.175

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Ouakrim, Y.; Bull, H.; Gouiffès, M.; Beautemps, D.; Hueber, T. and Braffort, A. (2024). Mediapi-RGB: Enabling Technological Breakthroughs in French Sign Language (LSF) Research Through an Extensive Video-Text Corpus. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: VISAPP; ISBN 978-989-758-679-8; ISSN 2184-4321, SciTePress, pages 139-148. DOI: 10.5220/0012372600003660

@conference{visapp24,
author={Yanis Ouakrim. and Hannah Bull. and Michèle Gouiffès. and Denis Beautemps. and Thomas Hueber. and Annelies Braffort.},
title={Mediapi-RGB: Enabling Technological Breakthroughs in French Sign Language (LSF) Research Through an Extensive Video-Text Corpus},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: VISAPP},
year={2024},
pages={139-148},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012372600003660},
isbn={978-989-758-679-8},
issn={2184-4321},
}

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: VISAPP
TI - Mediapi-RGB: Enabling Technological Breakthroughs in French Sign Language (LSF) Research Through an Extensive Video-Text Corpus
SN - 978-989-758-679-8
IS - 2184-4321
AU - Ouakrim, Y.
AU - Bull, H.
AU - Gouiffès, M.
AU - Beautemps, D.
AU - Hueber, T.
AU - Braffort, A.
PY - 2024
SP - 139
EP - 148
DO - 10.5220/0012372600003660
PB - SciTePress

<style> #socialicons>a span { top: 0px; left: -100%; -webkit-transition: all 0.3s ease; -moz-transition: all 0.3s ease-in-out; -o-transition: all 0.3s ease-in-out; -ms-transition: all 0.3s ease-in-out; transition: all 0.3s ease-in-out;} #socialicons>ahover div{left: 0px;} </style>