FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN
Milind Agarwal, Sweta Agrawal, Antonios Anastasopoulos, Luisa Bentivogli, Ondřej Bojar, Claudia Borg, Marine Carpuat, Roldano Cattoni, Mauro Cettolo, Mingda Chen, William Chen, Khalid Choukri, Alexandra Chronopoulou, Anna Currey, Thierry Declerck, Qianqian Dong, Kevin Duh, Yannick Estève, Marcello Federico, Souhir Gahbiche, Barry Haddow, Benjamin Hsu, Phu Mon Htut, Hirofumi Inaguma, Dávid Javorský, John Judge, Yasumasa Kano, Tom Ko, Rishu Kumar, Pengwei Li, Xutai Ma, Prashant Mathur, Evgeny Matusov, Paul McNamee, John P. McCrae, Kenton Murray, Maria Nadejde, Satoshi Nakamura, Matteo Negri, Ha Nguyen, Jan Niehues, Xing Niu, Atul Kr. Ojha, John E. Ortega, Proyag Pal, Juan Pino, Lonneke van der Plas, Peter Polák, Elijah Rippeth, Elizabeth Salesky, Jiatong Shi, Matthias Sperber, Sebastian Stüker, Katsuhito Sudoh, Yun Tang, Brian Thompson, Kevin Tran, Marco Turchi, Alex Waibel, Mingxuan Wang, Shinji Watanabe, Rodolfo Zevallos
Abstract
This paper reports on the shared tasks organized by the 20th IWSLT Conference. The shared tasks address 9 scientific challenges in spoken language translation: simultaneous and offline translation, automatic subtitling and dubbing, speech-to-speech translation, multilingual, dialect and low-resource speech translation, and formality control. The shared tasks attracted a total of 38 submissions by 31 teams. The growing interest towards spoken language translation is also witnessed by the constantly increasing number of shared task organizers and contributors to the overview paper, almost evenly distributed across industry and academia.- Anthology ID:
- 2023.iwslt-1.1
- Original:
- 2023.iwslt-1.1v1
- Version 2:
- 2023.iwslt-1.1v2
- Volume:
- Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023)
- Month:
- July
- Year:
- 2023
- Address:
- Toronto, Canada (in-person and online)
- Editors:
- Elizabeth Salesky, Marcello Federico, Marine Carpuat
- Venue:
- IWSLT
- SIG:
- SIGSLT
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1–61
- Language:
- URL:
- https://aclanthology.org/2023.iwslt-1.1
- DOI:
- 10.18653/v1/2023.iwslt-1.1
- Bibkey:
- Cite (ACL):
- Milind Agarwal, Sweta Agrawal, Antonios Anastasopoulos, Luisa Bentivogli, Ondřej Bojar, Claudia Borg, Marine Carpuat, Roldano Cattoni, Mauro Cettolo, Mingda Chen, William Chen, Khalid Choukri, Alexandra Chronopoulou, Anna Currey, Thierry Declerck, Qianqian Dong, Kevin Duh, Yannick Estève, Marcello Federico, et al.. 2023. FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN. In Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023), pages 1–61, Toronto, Canada (in-person and online). Association for Computational Linguistics.
- Cite (Informal):
- FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN (Agarwal et al., IWSLT 2023)
- Copy Citation:
- PDF:
- https://aclanthology.org/2023.iwslt-1.1.pdf
Export citation
@inproceedings{agrawal-etal-2023-findings, title = "{FINDINGS} {OF} {THE} {IWSLT} 2023 {EVALUATION} {CAMPAIGN}", author = {Agarwal, Milind and Agrawal, Sweta and Anastasopoulos, Antonios and Bentivogli, Luisa and Bojar, Ond{\v{r}}ej and Borg, Claudia and Carpuat, Marine and Cattoni, Roldano and Cettolo, Mauro and Chen, Mingda and Chen, William and Choukri, Khalid and Chronopoulou, Alexandra and Currey, Anna and Declerck, Thierry and Dong, Qianqian and Duh, Kevin and Est{\`e}ve, Yannick and Federico, Marcello and Gahbiche, Souhir and Haddow, Barry and Hsu, Benjamin and Mon Htut, Phu and Inaguma, Hirofumi and Javorsk{\'y}, D{\'a}vid and Judge, John and Kano, Yasumasa and Ko, Tom and Kumar, Rishu and Li, Pengwei and Ma, Xutai and Mathur, Prashant and Matusov, Evgeny and McNamee, Paul and P. McCrae, John and Murray, Kenton and Nadejde, Maria and Nakamura, Satoshi and Negri, Matteo and Nguyen, Ha and Niehues, Jan and Niu, Xing and Kr. Ojha, Atul and E. Ortega, John and Pal, Proyag and Pino, Juan and van der Plas, Lonneke and Pol{\'a}k, Peter and Rippeth, Elijah and Salesky, Elizabeth and Shi, Jiatong and Sperber, Matthias and St{\"u}ker, Sebastian and Sudoh, Katsuhito and Tang, Yun and Thompson, Brian and Tran, Kevin and Turchi, Marco and Waibel, Alex and Wang, Mingxuan and Watanabe, Shinji and Zevallos, Rodolfo}, editor = "Salesky, Elizabeth and Federico, Marcello and Carpuat, Marine", booktitle = "Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023)", month = jul, year = "2023", address = "Toronto, Canada (in-person and online)", publisher = "Association for Computational Linguistics", url = "https://aclanthology.org/2023.iwslt-1.1", doi = "10.18653/v1/2023.iwslt-1.1", pages = "1--61", abstract = "This paper reports on the shared tasks organized by the 20th IWSLT Conference. The shared tasks address 9 scientific challenges in spoken language translation: simultaneous and offline translation, automatic subtitling and dubbing, speech-to-speech translation, multilingual, dialect and low-resource speech translation, and formality control. The shared tasks attracted a total of 38 submissions by 31 teams. The growing interest towards spoken language translation is also witnessed by the constantly increasing number of shared task organizers and contributors to the overview paper, almost evenly distributed across industry and academia.", }
<?xml version="1.0" encoding="UTF-8"?> <modsCollection xmlns="http://www.loc.gov/mods/v3"> <mods ID="agrawal-etal-2023-findings"> <titleInfo> <title>FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN</title> </titleInfo> <name type="personal"> <namePart type="given">Milind</namePart> <namePart type="family">Agarwal</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Sweta</namePart> <namePart type="family">Agrawal</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Antonios</namePart> <namePart type="family">Anastasopoulos</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Luisa</namePart> <namePart type="family">Bentivogli</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Ondřej</namePart> <namePart type="family">Bojar</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Claudia</namePart> <namePart type="family">Borg</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Marine</namePart> <namePart type="family">Carpuat</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Roldano</namePart> <namePart type="family">Cattoni</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Mauro</namePart> <namePart type="family">Cettolo</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Mingda</namePart> <namePart type="family">Chen</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">William</namePart> <namePart type="family">Chen</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Khalid</namePart> <namePart type="family">Choukri</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Alexandra</namePart> <namePart type="family">Chronopoulou</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Anna</namePart> <namePart type="family">Currey</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Thierry</namePart> <namePart type="family">Declerck</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Qianqian</namePart> <namePart type="family">Dong</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Kevin</namePart> <namePart type="family">Duh</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Yannick</namePart> <namePart type="family">Estève</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Marcello</namePart> <namePart type="family">Federico</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Souhir</namePart> <namePart type="family">Gahbiche</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Barry</namePart> <namePart type="family">Haddow</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Benjamin</namePart> <namePart type="family">Hsu</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Phu</namePart> <namePart type="family">Mon Htut</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Hirofumi</namePart> <namePart type="family">Inaguma</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Dávid</namePart> <namePart type="family">Javorský</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">John</namePart> <namePart type="family">Judge</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Yasumasa</namePart> <namePart type="family">Kano</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Tom</namePart> <namePart type="family">Ko</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Rishu</namePart> <namePart type="family">Kumar</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Pengwei</namePart> <namePart type="family">Li</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Xutai</namePart> <namePart type="family">Ma</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Prashant</namePart> <namePart type="family">Mathur</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Evgeny</namePart> <namePart type="family">Matusov</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Paul</namePart> <namePart type="family">McNamee</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">John</namePart> <namePart type="family">P. McCrae</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Kenton</namePart> <namePart type="family">Murray</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Maria</namePart> <namePart type="family">Nadejde</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Satoshi</namePart> <namePart type="family">Nakamura</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Matteo</namePart> <namePart type="family">Negri</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Ha</namePart> <namePart type="family">Nguyen</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Jan</namePart> <namePart type="family">Niehues</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Xing</namePart> <namePart type="family">Niu</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Atul</namePart> <namePart type="family">Kr. Ojha</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">John</namePart> <namePart type="family">E. Ortega</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Proyag</namePart> <namePart type="family">Pal</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Juan</namePart> <namePart type="family">Pino</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Lonneke</namePart> <namePart type="family">van der Plas</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Peter</namePart> <namePart type="family">Polák</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Elijah</namePart> <namePart type="family">Rippeth</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Elizabeth</namePart> <namePart type="family">Salesky</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Jiatong</namePart> <namePart type="family">Shi</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Matthias</namePart> <namePart type="family">Sperber</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Sebastian</namePart> <namePart type="family">Stüker</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Katsuhito</namePart> <namePart type="family">Sudoh</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Yun</namePart> <namePart type="family">Tang</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Brian</namePart> <namePart type="family">Thompson</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Kevin</namePart> <namePart type="family">Tran</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Marco</namePart> <namePart type="family">Turchi</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Alex</namePart> <namePart type="family">Waibel</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Mingxuan</namePart> <namePart type="family">Wang</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Shinji</namePart> <namePart type="family">Watanabe</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Rodolfo</namePart> <namePart type="family">Zevallos</namePart> <role> <roleTerm authority="marcrelator" type="text">author</roleTerm> </role> </name> <originInfo> <dateIssued>2023-07</dateIssued> </originInfo> <typeOfResource>text</typeOfResource> <relatedItem type="host"> <titleInfo> <title>Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023)</title> </titleInfo> <name type="personal"> <namePart type="given">Elizabeth</namePart> <namePart type="family">Salesky</namePart> <role> <roleTerm authority="marcrelator" type="text">editor</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Marcello</namePart> <namePart type="family">Federico</namePart> <role> <roleTerm authority="marcrelator" type="text">editor</roleTerm> </role> </name> <name type="personal"> <namePart type="given">Marine</namePart> <namePart type="family">Carpuat</namePart> <role> <roleTerm authority="marcrelator" type="text">editor</roleTerm> </role> </name> <originInfo> <publisher>Association for Computational Linguistics</publisher> <place> <placeTerm type="text">Toronto, Canada (in-person and online)</placeTerm> </place> </originInfo> <genre authority="marcgt">conference publication</genre> </relatedItem> <abstract>This paper reports on the shared tasks organized by the 20th IWSLT Conference. The shared tasks address 9 scientific challenges in spoken language translation: simultaneous and offline translation, automatic subtitling and dubbing, speech-to-speech translation, multilingual, dialect and low-resource speech translation, and formality control. The shared tasks attracted a total of 38 submissions by 31 teams. The growing interest towards spoken language translation is also witnessed by the constantly increasing number of shared task organizers and contributors to the overview paper, almost evenly distributed across industry and academia.</abstract> <identifier type="citekey">agrawal-etal-2023-findings</identifier> <identifier type="doi">10.18653/v1/2023.iwslt-1.1</identifier> <location> <url>https://aclanthology.org/2023.iwslt-1.1</url> </location> <part> <date>2023-07</date> <extent unit="page"> <start>1</start> <end>61</end> </extent> </part> </mods> </modsCollection>
%0 Conference Proceedings %T FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN %A Agarwal, Milind %A Agrawal, Sweta %A Anastasopoulos, Antonios %A Bentivogli, Luisa %A Bojar, Ondřej %A Borg, Claudia %A Carpuat, Marine %A Cattoni, Roldano %A Cettolo, Mauro %A Chen, Mingda %A Chen, William %A Choukri, Khalid %A Chronopoulou, Alexandra %A Currey, Anna %A Declerck, Thierry %A Dong, Qianqian %A Duh, Kevin %A Estève, Yannick %A Federico, Marcello %A Gahbiche, Souhir %A Haddow, Barry %A Hsu, Benjamin %A Mon Htut, Phu %A Inaguma, Hirofumi %A Javorský, Dávid %A Judge, John %A Kano, Yasumasa %A Ko, Tom %A Kumar, Rishu %A Li, Pengwei %A Ma, Xutai %A Mathur, Prashant %A Matusov, Evgeny %A McNamee, Paul %A P. McCrae, John %A Murray, Kenton %A Nadejde, Maria %A Nakamura, Satoshi %A Negri, Matteo %A Nguyen, Ha %A Niehues, Jan %A Niu, Xing %A Kr. Ojha, Atul %A E. Ortega, John %A Pal, Proyag %A Pino, Juan %A van der Plas, Lonneke %A Polák, Peter %A Rippeth, Elijah %A Salesky, Elizabeth %A Shi, Jiatong %A Sperber, Matthias %A Stüker, Sebastian %A Sudoh, Katsuhito %A Tang, Yun %A Thompson, Brian %A Tran, Kevin %A Turchi, Marco %A Waibel, Alex %A Wang, Mingxuan %A Watanabe, Shinji %A Zevallos, Rodolfo %Y Salesky, Elizabeth %Y Federico, Marcello %Y Carpuat, Marine %S Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023) %D 2023 %8 July %I Association for Computational Linguistics %C Toronto, Canada (in-person and online) %F agrawal-etal-2023-findings %X This paper reports on the shared tasks organized by the 20th IWSLT Conference. The shared tasks address 9 scientific challenges in spoken language translation: simultaneous and offline translation, automatic subtitling and dubbing, speech-to-speech translation, multilingual, dialect and low-resource speech translation, and formality control. The shared tasks attracted a total of 38 submissions by 31 teams. The growing interest towards spoken language translation is also witnessed by the constantly increasing number of shared task organizers and contributors to the overview paper, almost evenly distributed across industry and academia. %R 10.18653/v1/2023.iwslt-1.1 %U https://aclanthology.org/2023.iwslt-1.1 %U https://doi.org/10.18653/v1/2023.iwslt-1.1 %P 1-61
Markdown (Informal)
[FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN](https://aclanthology.org/2023.iwslt-1.1) (Agarwal et al., IWSLT 2023)
- FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN (Agarwal et al., IWSLT 2023)
ACL
- Milind Agarwal, Sweta Agrawal, Antonios Anastasopoulos, Luisa Bentivogli, Ondřej Bojar, Claudia Borg, Marine Carpuat, Roldano Cattoni, Mauro Cettolo, Mingda Chen, William Chen, Khalid Choukri, Alexandra Chronopoulou, Anna Currey, Thierry Declerck, Qianqian Dong, Kevin Duh, Yannick Estève, Marcello Federico, et al.. 2023. FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN. In Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023), pages 1–61, Toronto, Canada (in-person and online). Association for Computational Linguistics.