Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3460112.3471954acmconferencesArticle/Chapter ViewAbstractPublication PagescompassConference Proceedingsconference-collections
research-article

Language Translation as a Socio-Technical System:Case-Studies of Mixed-Initiative Interactions

Published: 23 September 2021 Publication History

Abstract

Seamless access to information in a rapidly globalizing world demands for availability of information across, ideally all but at the least a large number of, languages. Machine translation has been proposed as a technological solution to this complex problem. However, despite seven decades of research, and recently seen rapid progress in the field - thanks to deep learning and availability of large data-sets, perfect machine translation across a large number of the world’s languages still remains elusive. In fact, it is a distant and perhaps even an impossible goal. Erroneous translations, on the other hand, can be detrimental in critical situations such as talking to a law enforcement officer; or, they could potentially perpetuate social biases or stereotypes, for instance, by producing mis-gendered translations. In this work, we argue that language translation is inherently a socio-technical system, which has to be viewed, studied, and optimized for, as such. The need and context of translation, the socio-demographic factors behind the human translators as well as the consumers of the translated content affect the complexity of the translation system, as much as the accuracy of the technology and its interface. Through a series of case studies on mixed-initiative interaction based approach to translation, we bring out the various socio-technical factors and their complex interactions that one has to bear in mind while designing for the ideal human-machine translation systems. Through these observations, we make multiple recommendations which, at the core, suggest that ”solving” translation in the real sense would require more coordinated efforts between the technical (NLP) and social communities (HCI + CSCW + DEV).

References

[1]
Basil Abraham, Danish Goel, Divya Siddarth, Kalika Bali, Manu Chopra, Monojit Choudhury, Pratik Joshi, Preethi Jyoti, Sunayana Sitaram, and Vivek Seshadri. 2020. Crowdsourcing Speech Data for Low-Resource Languages from Low-Income Workers. In Proceedings of the 12th Language Resources and Evaluation Conference. European Language Resources Association, Marseille, France, 2819–2826. https://www.aclweb.org/anthology/2020.lrec-1.343
[2]
Mark S. Ackerman. 2000. The Intellectual Challenge of CSCW: The Gap between Social Requirements and Technical Feasibility. Hum.-Comput. Interact. 15, 2 (Sept. 2000), 179–203. https://doi.org/10.1207/S15327051HCI1523_5
[3]
Roee Aharoni, Melvin Johnson, and Orhan Firat. 2019. Massively Multilingual Neural Machine Translation. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 3874–3884. https://doi.org/10.18653/v1/N19-1388
[4]
Vicent Alabau, Christian Buck, Michael Carl, Francisco Casacuberta, Mercedes García-Martínez, Ulrich Germann, Jesús González-Rubio, Robin Hill, Philipp Koehn, Luis Leiva, Bartolomé Mesa-Lao, Daniel Ortiz-Martínez, Herve Saint-Amand, Germán Sanchis Trilles, and Chara Tsoukala. 2014. CASMACAT: A Computer-assisted Translation Workbench. In Proceedings of the Demonstrations at the 14th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, Gothenburg, Sweden, 25–28. https://doi.org/10.3115/v1/E14-2007
[5]
Jeffrey Allen. 2003. Post-editing. Benjamins Translation Library 35 (2003), 297–318.
[6]
Vamshi Ambati. 2012. Active Learning and Crowdsourcing for Machine Translation in Low Resource Scenarios. Ph.D. Dissertation. Carnegie Mellon University, USA. Advisor(s) Carbonell, Jaime. AAI3528171.
[7]
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300233
[8]
Antonios Anastasopoulos, Alessandro Cattelan, Zi-Yi Dou, Marcello Federico, Christian Federmann, Dmitriy Genzel, Franscisco Guzmán, Junjie Hu, Macduff Hughes, Philipp Koehn, Rosie Lazar, Will Lewis, Graham Neubig, Mengmeng Niu, Alp Öktem, Eric Paquin, Grace Tang, and Sylwia Tur. 2020. TICO-19: the Translation Initiative for COvid-19. In Proceedings of the 1st Workshop on NLP for COVID-19 (Part 2) at EMNLP 2020. Association for Computational Linguistics, Online. https://doi.org/10.18653/v1/2020.nlpcovid19-2.5
[9]
Mikel Artetxe and Holger Schwenk. 2019. Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond. Transactions of the Association for Computational Linguistics 7 (March 2019), 597–610. https://doi.org/10.1162/tacl_a_00288
[10]
Dzmitry Bahdanau, Kyung Hyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. 3rd International Conference on Learning Representations, ICLR 2015 ; Conference date: 07-05-2015 Through 09-05-2015.
[11]
Lois Bastide. 2018. Crisis communication during the Ebola outbreak in West Africa: The paradoxes of decontextualized contextualization. Springer International Publishing, Cham. https://archive-ouverte.unige.ch/unige:107132 ID: unige:107132.
[12]
Ludwig von Bertalanffy. 1968. General systems theory as integrating factor in contemporary science. Akten des XIV. Internationalen Kongresses für Philosophie 2 (1968), 335–340.
[13]
Erik Brynjolfsson, Xiang Hui, and Meng Liu. 2019. Does machine translation affect international trade? Evidence from a large digital platform. Management Science 65, 12 (2019), 5449–5460.
[14]
Jody Byrne. 2007. Caveat translator: Understanding the legal consequences of errors in professional translation. Journal of Specialised Translation 7 (2007), 2–24.
[15]
Patrick Cadwell. 2015. Translation and trust: a case study of how translation was experienced by foreign nationals resident in Japan for the 2011 great east Japan earthquake. Ph.D. Dissertation. Dublin City University.
[16]
Chris Callison-Burch. 2009. Fast, Cheap, and Creative: Evaluating Translation Quality Using Amazon’s Mechanical Turk. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Singapore, 286–295. https://aclanthology.org/D09-1030
[17]
Arun Chaganty, Stephen Mussmann, and Percy Liang. 2018. The price of debiasing automatic metrics in natural language evalaution. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Melbourne, Australia, 643–653. https://doi.org/10.18653/v1/P18-1060
[18]
Albert Cherns. 1976. The Principles of Sociotechnical Design. Human Relations 29, 8 (1976), 783–792. https://doi.org/10.1177/001872677602900806 arXiv:https://doi.org/10.1177/001872677602900806
[19]
Monojit Choudhury and Amit Deshpande. 2021. How Linguistically Fair Are Multilingual Pre-Trained Language Models?Proceedings of the AAAI Conference on Artificial Intelligence 35, 14 (May 2021), 12710–12718. https://ojs.aaai.org/index.php/AAAI/article/view/17505
[20]
Elizabeth Clark, Anne Spencer Ross, Chenhao Tan, Yangfeng Ji, and Noah A. Smith. 2018. Creative Writing with a Machine in the Loop: Case Studies on Slogans and Stories. In 23rd International Conference on Intelligent User Interfaces (Tokyo, Japan) (IUI ’18). Association for Computing Machinery, New York, NY, USA, 329–340. https://doi.org/10.1145/3172944.3172983
[21]
Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov. 2020. Unsupervised Cross-lingual Representation Learning at Scale. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Online, 8440–8451. https://doi.org/10.18653/v1/2020.acl-main.747
[22]
Alan Cooper. 2004. The Inmates Are Running the Asylum: Why High Tech Products Drive Us Crazy and How to Restore the Sanity (2nd Edition). Pearson Higher Education.
[23]
Sven Coppers, Jan Van den Bergh, Kris Luyten, Karin Coninx, Iulianna van der Lek-Ciudin, Tom Vanallemeersch, and Vincent Vandeghinste. 2018. Intellingo: An Intelligible Translation Environment. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174098
[24]
Francesco Croce, Maksym Andriushchenko, Vikash Sehwag, Nicolas Flammarion, Mung Chiang, Prateek Mittal, and Matthias Hein. 2020. RobustBench: a standardized adversarial robustness benchmark. arXiv preprint arXiv:2010.09670(2020).
[25]
Sandipan Dandapat and William Lewis. 2018. Training deployable general domain mt for a low resource language pair: English–bangla. (2018).
[26]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171–4186. https://doi.org/10.18653/v1/N19-1423
[27]
José Esteban, José Lorenzo, Antonio S. Valderrábanos, and Guy Lapalme. 2004. TransType2 - An Innovative Computer-Assisted Translation System. In Proceedings of the ACL Interactive Poster and Demonstration Sessions. Association for Computational Linguistics, Barcelona, Spain, 94–97. https://www.aclweb.org/anthology/P04-3001
[28]
Kawin Ethayarajh and Dan Jurafsky. 2020. Utility is in the Eye of the User: A Critique of NLP Leaderboards. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, Online, 4846–4853. https://doi.org/10.18653/v1/2020.emnlp-main.393
[29]
James Fiumara, Christopher Cieri, Mark Liberman, and Chris Callison-Burch (Eds.). 2020. Proceedings of the LREC 2020 Workshop on “Citizen Linguistics in Language Resource Development”. European Language Resources Association, Marseille, France. https://aclanthology.org/2020.cllrd-1.0
[30]
Michael Fleming and Robin Cohen. 2000. Mixed-initiative translation of Web pages. In Proceedings of the Fourth Conference of the Association for Machine Translation in the Americas: Technical Papers. Springer, Cuernavaca, Mexico, 25–29. https://link.springer.com/chapter/10.1007/3-540-39965-8_3
[31]
Raymond Flournoy and Christine Duran. 2009. Machine translation and document localization at Adobe: From pilot to production. MT Summit XII: proceedings of the twelfth Machine Translation Summit (2009), 425–428.
[32]
Raymond S Flournoy and Chris Callison-Burch. 2001. Secondary benefits of feedback and user interaction in machine translation tools. In Workshop paper for “MT2010: Towards a Roadmap for MT” of the MT, Summit, Vol. 8. Citeseer, 2–3.
[33]
Lena Foljanty. 2015. Legal Transfers as Processes of Cultural Translation: On the Consequences of a Metaphor. Kritische Vierteljahresschrift für Gesetzgebung und Rechtswissenschaft2(2015), 89–107.
[34]
Dmitriy Genzel, Jakob Uszkoreit, and Franz Och. 2010. “Poetic” Statistical Machine Translation: Rhyme and Meter. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Cambridge, MA, 158–166. https://www.aclweb.org/anthology/D10-1016
[35]
Kevin Gimpel, Dhruv Batra, Chris Dyer, and Gregory Shakhnarovich. 2013. A Systematic Exploration of Diversity in Machine Translation. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Seattle, Washington, USA, 1100–1111. https://www.aclweb.org/anthology/D13-1111
[36]
Jesús González-Rubio, Daniel Ortiz-Martínez, and Francisco Casacuberta. 2012. Active learning for interactive machine translation. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, Avignon, France, 245–254. https://www.aclweb.org/anthology/E12-1025
[37]
Spence Green, Jason Chuang, Jeffrey Heer, and Christopher D. Manning. 2014. Predictive Translation Memory: A Mixed-Initiative System for Human Language Translation. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 177–187. https://doi.org/10.1145/2642918.2647408
[38]
Spence Green, Jeffrey Heer, and Christopher D. Manning. 2013. The Efficacy of Human Post-Editing for Language Translation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 439–448. https://doi.org/10.1145/2470654.2470718
[39]
Ana Guerberof Arenas. 2009. Productivity and quality in MT post-editing. (2009).
[40]
Gholamreza Haffari, Maxim Roy, and Anoop Sarkar. 2009. Active Learning for Statistical Phrase-based Machine Translation. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, Boulder, Colorado, 415–423. https://www.aclweb.org/anthology/N09-1047
[41]
Hany Hassan, Anthony Aue, Chang Chen, Vishal Chowdhary, Jonathan Clark, Christian Federmann, Xuedong Huang, Marcin Junczys-Dowmunt, William Lewis, Mu Li, 2018. Achieving human parity on automatic chinese to english news translation. arXiv preprint arXiv:1803.05567(2018).
[42]
Eric Horvitz. 1999. Principles of Mixed-Initiative User Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Pittsburgh, Pennsylvania, USA) (CHI ’99). Association for Computing Machinery, New York, NY, USA, 159–166. https://doi.org/10.1145/302979.303030
[43]
W. John Hutchins. 2004. The Georgetown-IBM Experiment Demonstrated in January 1954. In Machine Translation: From Real Users to Research, Robert E. Frederkingand Kathryn B. Taylor (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 102–114.
[44]
Melvin Johnson, Mike Schuster, Quoc V. Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fernanda Viégas, Martin Wattenberg, Greg Corrado, Macduff Hughes, and Jeffrey Dean. 2017. Google’s Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation. Transactions of the Association for Computational Linguistics 5 (2017), 339–351. https://doi.org/10.1162/tacl_a_00065
[45]
Pratik Joshi, Christain Barnes, Sebastin Santy, Simran Khanuja, Sanket Shah, Anirudh Srinivasan, Satwik Bhattamishra, Sunayana Sitaram, Monojit Choudhury, and Kalika Bali. 2019. Unsung Challenges of Building and Deploying Language Technologies for Low Resource Language Communities. In Proceedings of the 16th International Conference on Natural Language Processing. NLP Association of India, International Institute of Information Technology, Hyderabad, India, 211–219. https://www.aclweb.org/anthology/2019.icon-1.25
[46]
Pratik Joshi, Sebastin Santy, Amar Budhiraja, Kalika Bali, and Monojit Choudhury. 2020. The State and Fate of Linguistic Diversity and Inclusion in the NLP World. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Online, 6282–6293. https://doi.org/10.18653/v1/2020.acl-main.560
[47]
Martin Kay. 1997. The Proper Place of Men and Machines in Language Translation. Machine Translation 12, 1/2 (1997), 3–23. http://www.jstor.org/stable/40009025
[48]
Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, and Alexander Rush. 2017. OpenNMT: Open-Source Toolkit for Neural Machine Translation. In Proceedings of ACL 2017, System Demonstrations. Association for Computational Linguistics, Vancouver, Canada, 67–72. https://www.aclweb.org/anthology/P17-4012
[49]
Rebecca Knowles and Philipp Koehn. 2016. Neural interactive translation prediction. In Proceedings of the Association for Machine Translation in the Americas. 107–120.
[50]
Rebecca Knowles, Marina Sanchez-Torron, and Philipp Koehn. 2019. A user study of neural interactive translation prediction. Machine Translation 33, 1-2 (2019), 135–154.
[51]
Catherine Kobus, Josep Crego, and Jean Senellart. 2017. Domain Control for Neural Machine Translation. In Proceedings of the International Conference Recent Advances in Natural Language Processing, RANLP 2017. INCOMA Ltd., Varna, Bulgaria, 372–378. https://doi.org/10.26615/978-954-452-049-6_049
[52]
Philipp Koehn. 2009. A Web-Based Interactive Computer Aided Translation Tool. In Proceedings of the ACL-IJCNLP 2009 Software Demonstrations. Association for Computational Linguistics, Suntec, Singapore, 17–20. https://www.aclweb.org/anthology/P09-4005
[53]
Philipp Koehn and Hieu Hoang. 2007. Factored Translation Models. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL). Association for Computational Linguistics, Prague, Czech Republic, 868–876. https://www.aclweb.org/anthology/D07-1091
[54]
Pang Wei Koh, Shiori Sagawa, Henrik Marklund, Sang Michael Xie, Marvin Zhang, Akshay Balsubramani, Weihua Hu, Michihiro Yasunaga, Richard Lanas Phillips, Sara Beery, 2020. WILDS: A Benchmark of in-the-Wild Distribution Shifts. arXiv preprint arXiv:2012.07421(2020).
[55]
Geza Kovacs. 2012. ScreenMatch: providing context to software translators by displaying screenshots. In CHI’12 Extended Abstracts on Human Factors in Computing Systems. 1375–1380.
[56]
Stacey Kuznetsov. 2006. Motivations of Contributors to Wikipedia. SIGCAS Comput. Soc. 36, 2 (June 2006), 1–es. https://doi.org/10.1145/1215942.1215943
[57]
Philippe Langlais, George Foster, and Guy Lapalme. 2000. TransType: a Computer-Aided Translation Typing System. In ANLP-NAACL 2000 Workshop: Embedded Machine Translation Systems. https://www.aclweb.org/anthology/W00-0507
[58]
Samuel Läubli, Chantal Amrhein, Patrick Düggelin, Beatriz Gonzalez, Alena Zwahlen, and Martin Volk. 2019. Post-editing Productivity with Neural Machine Translation: An Empirical Assessment of Speed and Quality in the Banking and Finance Domain. In Proceedings of Machine Translation Summit XVII Volume 1: Research Track. European Association for Machine Translation, Dublin, Ireland, 267–272. https://www.aclweb.org/anthology/W19-6626
[59]
Samuel Läubli, Rico Sennrich, and Martin Volk. 2018. Has Machine Translation Achieved Human Parity? A Case for Document-level Evaluation. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Brussels, Belgium, 4791–4796. https://doi.org/10.18653/v1/D18-1512
[60]
Anne-Marie Laurian. 1984. Machine Translation : What Type of Post-Editing on What Type of Documents for What Type of Users. In 10th International Conference on Computational Linguistics and 22nd Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Stanford, California, USA, 236–238. https://doi.org/10.3115/980491.980542
[61]
H J Leavitt and B M Bass. 1964. Organizational Psychology. Annual Review of Psychology 15, 1 (1964), 371–398. https://doi.org/10.1146/annurev.ps.15.020164.002103 arXiv:https://doi.org/10.1146/annurev.ps.15.020164.002103
[62]
Luis A. Leiva and Vicent Alabau. 2014. The Impact of Visual Contextualization on UI Localization. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 3739–3742. https://doi.org/10.1145/2556288.2556982
[63]
William Lewis. 2010. Haitian Creole: How to Build and Ship an MT Engine from Scratch in 4 days, 17 hours, & 30 minutes. In Proceedings of the 14th Annual conference of the European Association for Machine Translation. European Association for Machine Translation, Saint Raphaël, France. https://www.aclweb.org/anthology/2010.eamt-1.37
[64]
Donghui Lin, Yoshiaki Murakami, Toru Ishida, Yohei Murakami, and Masahiro Tanaka. 2010. Composing Human and Machine Translation Services: Language Grid for Improving Localization Processes. In Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC’10). European Language Resources Association (ELRA), Valletta, Malta. http://www.lrec-conf.org/proceedings/lrec2010/pdf/317_Paper.pdf
[65]
Adam Lopez and Matt Post. 2013. Beyond bitext: Five open problems in machine translation. In Twenty Years of Bitext.
[66]
Elliott Macklovitch. 2006. TransType2 : The Last Word. In Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06). European Language Resources Association (ELRA), Genoa, Italy. http://www.lrec-conf.org/proceedings/lrec2006/pdf/14_pdf.pdf
[67]
Devansh Mehta, Sebastin Santy, Ramaravind Kommiya Mothilal, Brij Mohan Lal Srivastava, Alok Sharma, Anurag Shukla, Vishnu Prasad, Venkanna U, Amit Sharma, and Kalika Bali. 2020. Learnings from Technological Interventions in a Low Resource Language: A Case-Study on Gondi. In Proceedings of the 12th Language Resources and Evaluation Conference. European Language Resources Association, Marseille, France, 2832–2838. https://www.aclweb.org/anthology/2020.lrec-1.345
[68]
Alan K. Melby, Melvin R. Smith, and Jill Peterson. 1980. ITS: Interactive Translation System. In COLING 1980 Volume 1: The 8th International Conference on Computational Linguistics. https://www.aclweb.org/anthology/C80-1064
[69]
Sewon Min, Jordan Boyd-Graber, Chris Alberti, Danqi Chen, Eunsol Choi, Michael Collins, Kelvin Guu, Hannaneh Hajishirzi, Kenton Lee, Jennimaria Palomaki, 2021. NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned. arXiv preprint arXiv:2101.00133(2021).
[70]
Robert R. Morris, Mira Dontcheva, and Elizabeth M. Gerber. 2012. Priming for Better Performance in Microtask Crowdsourcing Environments. IEEE Internet Computing 16, 5 (2012), 13–19. https://doi.org/10.1109/MIC.2012.68
[71]
Robert Munro, Steven Bethard, Victor Kuperman, Vicky Tzuyin Lai, Robin Melnick, Christopher Potts, Tyler Schnoebelen, and Harry Tily. 2010. Crowdsourcing and language studies: the new generation of linguistic data. In Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk. Association for Computational Linguistics, Los Angeles, 122–130. https://aclanthology.org/W10-0719
[72]
Victor Muntés-Mulero, Patricia Paladini Adell, Cristina España-Bonet, and Lluís Màrquez. 2012. Context-Aware Machine Translation for Software Localization. In Proceedings of the 16th Annual conference of the European Association for Machine Translation. European Association for Machine Translation, Trento, Italy, 77–80. https://www.aclweb.org/anthology/2012.eamt-1.15
[73]
Moin Nadeem, Anna Bethke, and Siva Reddy. 2020. Stereoset: Measuring stereotypical bias in pretrained language models. arXiv preprint arXiv:2004.09456(2020).
[74]
Nikita Nangia, Clara Vania, Rasika Bhalerao, and Samuel R. Bowman. 2020. CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, Online, 1953–1967. https://doi.org/10.18653/v1/2020.emnlp-main.154
[75]
Xing Niu, Marianna Martindale, and Marine Carpuat. 2017. A Study of Style in Machine Translation: Controlling the Formality of Machine Translation Output. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Copenhagen, Denmark, 2814–2819. https://doi.org/10.18653/v1/D17-1299
[76]
Sharon O’Brien and Federico Marco Federici. 2019. Crisis translation: Considering language needs in multilingual disaster settings. Disaster Prevention and Management: An International Journal (2019).
[77]
Minako O’Hagan. 2011. Community Translation: Translation as a social activity and its possible consequences in the advent of Web 2.0 and beyond. Linguistica Antverpiensia 10, 2011 (2011), 11–23.
[78]
Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a Method for Automatic Evaluation of Machine Translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Philadelphia, Pennsylvania, USA, 311–318. https://doi.org/10.3115/1073083.1073135
[79]
Álvaro Peris and Francisco Casacuberta. 2018. Active Learning for Interactive Neural Machine Translation of Data Streams. In Proceedings of the 22nd Conference on Computational Natural Language Learning. Association for Computational Linguistics, Brussels, Belgium, 151–160. https://doi.org/10.18653/v1/K18-1015
[80]
Jaana Porra and Rudy Hirschheim. 2007. A lifetime of theory and action on the ethical use of computers: A dialogue with Enid Mumford. Journal of the Association for Information Systems 8, 9 (2007), 29.
[81]
Ella Rabinovich, Raj Nath Patel, Shachar Mirkin, Lucia Specia, and Shuly Wintner. 2017. Personalized Machine Translation: Preserving Original Author Traits. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers. Association for Computational Linguistics, Valencia, Spain, 1074–1084. https://www.aclweb.org/anthology/E17-1101
[82]
Antonio Rizzo and Marco Palmonari. 1998. Context and Consciousness: Activity Theory and Human Computer Interaction, Bonnie A. Nardi (ed.). User Modeling and User-Adapted Interaction 8, 1-2 (1998), 153–157.
[83]
Sebastin Santy and Prasanta Bhattacharya. 2021. A Discussion on Building Practical NLP Leaderboards: The Case of Machine Translation. arXiv preprint arXiv:2106.06292(2021).
[84]
Sebastin Santy, Sandipan Dandapat, Monojit Choudhury, and Kalika Bali. 2019. INMT: Interactive Neural Machine Translation Prediction. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP): System Demonstrations. Association for Computational Linguistics, Hong Kong, China, 103–108. https://doi.org/10.18653/v1/D19-3018
[85]
Rico Sennrich. 2018. Why the time is ripe for discourse in machine translation. In Second Workshop on Neural Machine Translation and Generation.
[86]
Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016. Controlling Politeness in Neural Machine Translation via Side Constraints. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, San Diego, California, 35–40. https://doi.org/10.18653/v1/N16-1005
[87]
Sanket Shah, Pratik Joshi, Sebastin Santy, and Sunayana Sitaram. 2019. CoSSAT: Code-Switched Speech Annotation Tool. In Proceedings of the First Workshop on Aggregating and Analysing Crowdsourced Annotations for NLP. Association for Computational Linguistics, Hong Kong, 48–52. https://doi.org/10.18653/v1/D19-5907
[88]
Daniel Smilkov, Nikhil Thorat, Yannick Assogba, Ann Yuan, Nick Kreeger, Ping Yu, Kangyi Zhang, Shanqing Cai, Eric Nielsen, David Soergel, Stan Bileschi, Michael Terry, Charles Nicholson, Sandeep N. Gupta, Sarah Sirajuddin, D. Sculley, Rajat Monga, Greg Corrado, Fernanda B. Viegas, and Martin Wattenberg. 2019. TensorFlow.js: Machine Learning for the Web and Beyond. Palo Alto, CA, USA. https://arxiv.org/abs/1901.05350
[89]
Sara Stymne, Jörg Tiedemann, Christian Hardmeier, and Joakim Nivre. 2013. Statistical Machine Translation with Readability Constraints. In Proceedings of the 19th Nordic Conference of Computational Linguistics (NODALIDA 2013). Linköping University Electronic Press, Sweden, Oslo, Norway, 375–386. https://www.aclweb.org/anthology/W13-5634
[90]
Huatong Sun. 2001. Building a Culturally-Competent Corporate Web Site: An Exploratory Study of Cultural Markers in Multilingual Web Design. In Proceedings of the 19th Annual International Conference on Computer Documentation (Sante Fe, New Mexico, USA) (SIGDOC ’01). Association for Computing Machinery, New York, NY, USA, 95–102. https://doi.org/10.1145/501516.501536
[91]
Mustapha Taibi and Uldis Ozolins. 2016. Community translation. Bloomsbury Publishing.
[92]
Zhaopeng Tu, Yang Liu, Zhengdong Lu, Xiaohua Liu, and Hang Li. 2017. Context Gates for Neural Machine Translation. Transactions of the Association for Computational Linguistics 5 (2017), 87–99. https://doi.org/10.1162/tacl_a_00048
[93]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems, I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett(Eds.), Vol. 30. Curran Associates, Inc.https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf
[94]
Lucas Nunes Vieira, Minako O’Hagan, and Carol O’Sullivan. 2020. Understanding the societal impacts of machine translation: a critical review of the literature on medical and legal use cases. Information, Communication & Society 0, 0 (2020), 1–18. https://doi.org/10.1080/1369118X.2020.1776370 arXiv:https://doi.org/10.1080/1369118X.2020.1776370
[95]
Luis von Ahn. 2013. Duolingo: Learn a Language for Free While Helping to Translate the Web. In Proceedings of the 2013 International Conference on Intelligent User Interfaces (Santa Monica, California, USA) (IUI ’13). Association for Computing Machinery, New York, NY, USA, 1–2. https://doi.org/10.1145/2449396.2449398
[96]
Luis von Ahn, Benjamin Maurer, Colin McMillen, David Abraham, and Manuel Blum. 2008. reCAPTCHA: Human-Based Character Recognition via Web Security Measures. Science 321, 5895 (2008), 1465–1468. https://doi.org/10.1126/science.1160379 arXiv:http://www.sciencemag.org/content/321/5895/1465.full.pdf
[97]
Sida I. Wang, Percy Liang, and Christopher D. Manning. 2016. Learning Language Games through Interaction. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Berlin, Germany, 2368–2378. https://doi.org/10.18653/v1/P16-1224
[98]
Brian Whitworth, Jerry Fjermestad, and Edward Mahinda. 2006. The Web of System Performance. Commun. ACM 49, 5 (May 2006), 92–99. https://doi.org/10.1145/1125944.1125947
[99]
Joern Wuebker, Spence Green, John DeNero, Saša Hasan, and Minh-Thang Luong. 2016. Models and Inference for Prefix-Constrained Machine Translation. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Berlin, Germany, 66–75. https://doi.org/10.18653/v1/P16-1007
[100]
Wei Xu, Courtney Napoles, Ellie Pavlick, Quanze Chen, and Chris Callison-Burch. 2016. Optimizing Statistical Machine Translation for Text Simplification. Transactions of the Association for Computational Linguistics 4 (2016), 401–415. https://doi.org/10.1162/tacl_a_00107
[101]
Qiang Yang, Yang Liu, Yong Cheng, Yan Kang, Tianjian Chen, and Han Yu. 2019. Federated learning. Synthesis Lectures on Artificial Intelligence and Machine Learning 13, 3(2019), 1–207.
[102]
Xingdi Yuan, Marc-Alexandre Côté, Jie Fu, Zhouhan Lin, Chris Pal, Yoshua Bengio, and Adam Trischler. 2019. Interactive Language Learning by Question Answering. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, Hong Kong, China, 2796–2813. https://doi.org/10.18653/v1/D19-1280
[103]
NA Yurko, IM Styfanyshyn, UM Protsenko, and Yu R Slodynytska. 2020. Tourism translation: the key peculisrities. (2020).
[104]
Omar F. Zaidan and Chris Callison-Burch. 2011. Crowdsourcing Translation: Professional Quality from Non-Professionals. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, Portland, Oregon, USA, 1220–1229. https://aclanthology.org/P11-1122
[105]
Honglei Zhuang and Joel Young. 2015. Leveraging In-Batch Annotation Bias for Crowdsourced Active Learning. In Proceedings of the Eighth ACM International Conference on Web Search and Data Mining(Shanghai, China) (WSDM ’15). Association for Computing Machinery, New York, NY, USA, 243–252. https://doi.org/10.1145/2684822.2685301
[106]
Álvaro Peris, Miguel Domingo, and Francisco Casacuberta. 2017. Interactive neural machine translation. Computer Speech & Language 45 (2017), 201–220. https://doi.org/10.1016/j.csl.2016.12.003

Cited By

View all
  • (2024)What’s the weather story? Both-ways learning in Indigenous-led climate communication workshops in northern AustraliaProceedings of the Participatory Design Conference 2024: Exploratory Papers and Workshops - Volume 210.1145/3661455.3669886(166-174)Online publication date: 11-Aug-2024
  • (2023)Auditing Cross-Cultural Consistency of Human-Annotated Labels for Recommendation SystemsProceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency10.1145/3593013.3594098(1531-1552)Online publication date: 12-Jun-2023
  • (2023)What is Human-Centered about Human-Centered AI? A Map of the Research LandscapeProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580959(1-23)Online publication date: 19-Apr-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
COMPASS '21: Proceedings of the 4th ACM SIGCAS Conference on Computing and Sustainable Societies
June 2021
462 pages
ISBN:9781450384537
DOI:10.1145/3460112
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 September 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. human-agent interaction
  2. human-centered AI
  3. interactive translation
  4. mixed-initiative interaction
  5. socio-technical systems

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

COMPASS '21
Sponsor:

Acceptance Rates

Overall Acceptance Rate 25 of 50 submissions, 50%

Upcoming Conference

COMPASS '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)35
  • Downloads (Last 6 weeks)1
Reflects downloads up to 12 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)What’s the weather story? Both-ways learning in Indigenous-led climate communication workshops in northern AustraliaProceedings of the Participatory Design Conference 2024: Exploratory Papers and Workshops - Volume 210.1145/3661455.3669886(166-174)Online publication date: 11-Aug-2024
  • (2023)Auditing Cross-Cultural Consistency of Human-Annotated Labels for Recommendation SystemsProceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency10.1145/3593013.3594098(1531-1552)Online publication date: 12-Jun-2023
  • (2023)What is Human-Centered about Human-Centered AI? A Map of the Research LandscapeProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580959(1-23)Online publication date: 19-Apr-2023
  • (2022)The Six Conundrums of Building and Deploying Language Technologies for Social GoodProceedings of the 5th ACM SIGCAS/SIGCHI Conference on Computing and Sustainable Societies10.1145/3530190.3534792(12-19)Online publication date: 29-Jun-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media