Integrating automatic speech recognition into Chinese–Portuguese simultaneous interpreting
DOI :
https://doi.org/10.5007/2175-7968.2026.e104102Mots-clés :
simultaneous interpreting, automatic speech recognition, real-time transcription, Chinese–Portuguese, computer-assisted interpretingRésumé
The rapid development of automatic speech recognition (ASR) has created new opportunities for technology-enhanced simultaneous interpreting, yet empirical research has focused largely on English-paired combinations. This study examines the integration of real-time automatic transcription in Chinese–Portuguese simultaneous interpreting, investigating its effects on interpreter performance and on interpreters’ interaction with and perceptions of the technology. Ten first-year MA students completed simultaneous interpreting tasks with and without ASR-generated transcription in a mixed-methods design. Performance was assessed across four dimensions (information completeness, fluency, target language quality, holistic performance), with ear-voice span measured to capture temporal processing patterns. Qualitative data were collected through questionnaires and retrospective interviews. Results revealed that transcription support significantly improved information completeness but yielded no significant effects on fluency, target language quality, or holistic performance. Participants reported allocating, on average, 60% of their attention to the visual display, with ear-voice span nearly doubling when transcription was available. Perceptions of the tool were generally positive, though concerns were raised regarding cognitive fatigue and error propagation. Participants preferred continuous transcription with highlighted problem triggers, partly diverging from findings in other language pairs. Overall, the results show that ASR-generated transcription offers selective benefits while introducing risks of visual over-reliance, underscoring the need for targeted training and customizable, user-centered interface design in technology-supported simultaneous interpreting.
Références
Amaro, V., & Pires, M. J. (2024). Found in Translation, Lost in Education: Artificial Intelligence’s Impacts on Translation Tertiary Education in Macao. Asian Education and Development Studies, 13(4), 269–281. https://doi.org/10.1108/AEDS-01-2024-0012
Brooke, J. (1996). SUS: A ‘Quick and Dirty’ Usability Scale. In P. W. Jordan, B. Thomas, I. L. McClelland & B. Weerdmeester (Eds.), Usability Evaluation in Industry (pp. 189–194). CRC Press.
Cammoun, R., Davies, C., Ivanov, K., & Naimushin, B. (2009). Simultaneous Interpretation with Text: Is the Text ‘Friend’ or ‘Foe’? Laying Foundations for a Teaching Module [Seminar paper]. University of Geneva.
Chao, L. S., Wong, D. F., Ao, C. H., & Leal, A. L. (2018). UM-PCorpus: A Large Portuguese-Chinese Parallel Corpus. In E. Yang & L. Sun (Eds.), Proceedings of the LREC2018 Workshop “Belt & Road: Language Resources and Evaluation” (pp. 38–43). Beijing Advanced Innovation Center for Language Resources. https://aclanthology.org/L18-1236/
Cheung, A. K. F., & Li, T. (2022). Machine Aided Interpreting: An Experiment of Automatic Speech Recognition in Simultaneous Interpreting. Translation Quarterly, 104(2), 1–20.
Chmiel, A., Janikowski, P., & Lijewska, A. (2020). Multimodal Processing in Simultaneous Interpreting with Text: Interpreters Focus More on the Visual than the Auditory Modality. Target, 32(1), 37–58. https://doi.org/10.1075/target.18157.chm
Davis, F. D. (1989). Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Quarterly, 13(3), 319–340. https://doi.org/10.2307/249008
Defrancq, B., & Fantinuoli, C. (2021). Automatic Speech Recognition in the Booth: Assessment of System Performance, Interpreters’ Performances and Interactions in the Context of Numbers. Target, 33(1), 71–102. https://doi.org/10.1075/target.19166.def
Desmet, B., Vandierendonck, M., & Defrancq, B. (2018). Simultaneous Interpretation of Numbers and the Impact of Technological Support. In C. Fantinuoli (Ed.), Interpreting and Technology (pp. 13–27). Language Science Press.
EABM. (2021). Survey – Ergonomics for the Artificial Booth Mate (EABM). https://www.eabm.ugent.be/survey/
Fantinuoli, C. (2017). Speech Recognition in the Interpreter Workstation. In J. Esteves-Ferreira, J. Macan, R. Mitkov & O.-M. Stefanov (Eds.), Proceedings of the 39th Conference Translating and the Computer (pp. 25–34). ASLING.
Fantinuoli, C. (2018). Computer-assisted Interpreting: Challenges and Future Perspectives. In G. Corpas Pastor & I. Durán Muñoz (Eds.), Trends in E-tools and Resources for Translators and Interpreters (pp. 153–174). Brill.
Fantinuoli, C. (2023). Towards AI-enhanced Computer-assisted Interpreting. In G. Corpas Pastor & B. Defrancq (Eds.), Interpreting Technologies: Current and Future Trends (Vol. 37; pp. 46–72). John Benjamins.
Frittella, F. M. (2023). Usability Research for Interpreter-centred Technology. Language Science Press.
Gile, D. (2009). Basic Concepts and Models for Interpreter and Translator Training. John Benjamins.
Guo, M., Xie, Y., Han, L., Lei, V. L. C., & Li, D. (2025a). Automatic live captioning in Simultaneous Interpreting: A Comparative Analysis of Quality. Meta, 70(1), 221–242. https://doi.org/10.7202/1125409ar
Guo, M., Xie, Y., Han, L., Lei, V. L. C., & Li, D. (2025b). Bridging Traditional and AI-assisted Simultaneous Interpreting: Empirical Insights for Curriculum Design. The Interpreter and Translator Trainer, 19(3–4), 425–443. https://doi.org/10.1080/1750399X.2025.2533007
Guo, M., Xie, Y., Han, L., Lei, V. L. C., & Li, D. (2025c). From sight to insight: Unravelling student interpreters’ usage and perceptions of live captioning in Chinese–English simultaneous Interpreting. Linguistica Antverpiensia, New Series: Themes in Translation Studies, 24, 160–187. https://doi.org/10.52034/lans-tts.v24i.834
Guo, M., Xie, Y., Han, L., Lei, V. L. C., & Li, D. (2026). Automatic live captioning in Simultaneous Interpreting: A Comparative Analysis of Quality. Meta, 70(1), 221–242. https://doi.org/10.7202/1125409ar
Han, C. (2015a). Lacunae, Myths and Legends about Conference Interpreters: A Diary Study to Explore Conference Interpreting Practice in China. Perspectives, 23(3), 440–457. https://doi.org/10.1080/0907676X.2014.973422
Han, C. (2015b). (Para)linguistic Correlates of Perceived Fluency in English-to-Chinese Simultaneous Interpretation. International Journal of Comparative Literature and Translation Studies, 3(4), 32–37. https://doi.org/10.7575/aiac.ijclts.v.3n.4p.32
Han, C. (2018). Using Rating Scales to assess Interpretation: Practices, Problems and Prospects. Interpreting, 20(1), 59–95. https://doi.org/10.1075/intp.00003.han
Han, C. (2021). Analytic Rubric Scoring versus comparative judgment: A comparison of Two Approaches to Assessing Spoken-language Interpreting. Meta, 66(2), 337–361. https://doi.org/10.7202/1083182ar
Han, L., Lu, J., Wen, Z., & Tian, Y. (2023). Momentary Engagement in Simultaneous versus Consecutive Interpreting: Through the Lens of Translanguaging and CDST. Frontiers in Psychology, 14, 1180379. https://doi.org/10.3389/fpsyg.2023.1180379
He, Y., Sainath, T. N., Prabhavalkar, R., McGraw, I., Alvarez, R., Zhao, D., Rybach, D., Kannan, A., Wu, Y., Pang, R., Liang, Q., Bhatia, D., Shangguan, Y., Li, B., Pundak, G., Sim, K. C., Bagby, T., Chang, S., Rao, K., & Gruenstein, A. (2019). Streaming End-to-end Speech Recognition for Mobile Devices. In IEEE International Conference on Acoustics, Speech and Signal Processing (pp. 6381–6385). IEEE. https://doi.org/10.1109/ICASSP.2019.8682336
Huang, X., & Zhang, X. (2025). Translating Culture: The Rise and Resonance of Chinese Contemporary Literature in the Portuguese-speaking World. Humanities and Social Sciences Communications, 12(1), 168. https://doi.org/10.1057/s41599-025-04457-z
Jiang, L., Jiang, Y., & Han, L. (2024). The Potential of ChatGPT in Translation Evaluation: A Case Study of the Chinese–Portuguese Machine Translation. Cadernos de Tradução, 44, e98613. https://doi.org/10.5007/2175-7968.2024.e98613
Jurafsky, D., & Martin, J. H. (2024). Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition with Language Models (3rd ed.). Prentice Hall. https://web.stanford.edu/~jurafsky/slp3
Koo, T. K., & Li, M. Y. (2016). A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. Journal of Chiropractic Medicine, 15(2), 155–163.
Laugwitz, B., Held, T., & Schrepp, M. (2008). Construction and Evaluation of a User Experience Questionnaire. In A. Holzinger (Ed.), HCI and Usability for Education and Work (pp. 63–76). Springer.
Lewis, J. R. (1995). IBM computer Usability Satisfaction Questionnaires: Psychometric Evaluation and Instructions for Use. International Journal of Human–Computer Interaction, 7(1), 57–78. https://doi.org/10.1080/10447319509526110
Liu, S., Wang, L., & Liu, C.-H. (2018). Chinese–Portuguese Machine Translation: A Study on Building Parallel Corpora from Comparable Texts. In N. Calzolari, K. Choukri, C. Cieri, T. Declerck, S. Goggi, K. Hasida, H. Isahara, B. Maegaard, J. Mariani, H. Mazo, A. Moreno, J. Odijk, S. Piperidis, & T. Tokunaga (Eds.), Proceedings of the Eleventh International Conference on Language Resources and Evaluation (pp. 1485–1492). European Language Resources Association. https://aclanthology.org/L18-1236/
Luo, W., & Zhang, X. (2025). Lexical Features in the Portuguese Translations of Contemporary Political Discourse: A Corpus-based Analysis. Forum for Linguistic Studies, 7(8), 938–948. https://doi.org/10.30564/fls.v7i8.10785
Ma, X., & Cheung, A. K. F. (2020). Language Interference in English-Chinese Simultaneous Interpreting with and without Text. Babel, 66(3), 434–456. https://doi.org/10.1075/babel.00168.che
Macao Polytechnic University. (2025, July 4). Macao Polytechnic University Regulations on Research Ethics and Integrity. https://www.mpu.edu.mo/en/dei/guidelines_regulations
National Health Commission of the People’s Republic of China. (2023, February 27). Measures for the ethical review of life science and Medical Research Involving Human Subjects. https://www.nhc.gov.cn/qjjys/c100016/202302/6b6e447b3edc4338856c9a652a85f44b.shtml
Pisani, E., & Fantinuoli, C. (2021). Measuring the Impact of Automatic Speech Recognition on Number Rendition in Simultaneous Interpreting. In C. Wang & B. Zheng (Eds.), Empirical Studies of Translation and Interpreting (pp. 181–197). Routledge.
Pöchhacker, F. (2016). Introducing Interpreting Studies (2nd ed.). Routledge.
Prandi, B. (2023). Computer-assisted Simultaneous Interpreting: A Cognitive-experimental Study on Terminology. Language Science Press.
Saeed, M. A., González, E. R., Korybski, T., Davitti, E., & Braun, S. (2022). Connected yet Distant: An Experimental Study into the Visual Needs of the Interpreter in Remote Simultaneous Interpreting. In M. Kurosu (Ed.), Human-computer Interaction: User Experience and Behavior (pp. 214–232). Springer. https://doi.org/10.1007/978-3-031-05412-9_16
Seeber, K. G. (2017). Multimodal Processing in Simultaneous Interpreting. In J. W. Schwieter & A. Ferreira (Eds.), The Handbook of Translation and Cognition (pp. 461–475). Wiley-Blackwell. https://doi.org/10.1002/9781119241485.ch25
Seeber, K. G., Keller, L., & Hervais-Adelman, A. (2020). When the Ear Leads the Eye: The Use of Text during Simultaneous Interpretation. Language, Cognition and Neuroscience, 35(10), 1480–1494. https://doi.org/10.1080/23273798.2020.1799045
Setton, R. (2015). Simultaneous with Text. In F. Pöchhacker (Ed.), Routledge Encyclopedia of Interpreting Studies (pp. 385–386). Routledge.
Shreve, G. M., Lacruz, I., & Angelone, E. (2010). Cognitive Effort, Syntactic Disruption, and Visual Interference in a Sight Translation Task. In G. M. Shreve & E. Angelone (Eds.), Translation and Cognition (pp. 63–84). John Benjamins.
Silva, I. A. L., Alves, F., Schmaltz, M., Pagano, A., Wong, D., Chao, L., Leal, A. L. V., Quaresma, P., Garcia, C., & Silva, G. E. (2017). Translation, Post-editing and Directionality: A Study of Effort in the Chinese-Portuguese Language Pair. In A. L. Jakobsen & B. Mesa-Lao (Eds.), Translation in Transition: Between Cognition, Computing and Technology (pp. 107–134). John Benjamins.
Silva, I. A. L., Schmaltz, M., Alves, F., Pagano, A., Wong, D., Chao, L., Leal, A. L. V., Quaresma, P., & Garcia, C. (2015). Translating and Post-editing in the Chinese-Portuguese Language Pair: Insights from an Exploratory Study of Key Logging and Eye Tracking. Translation Spaces, 4(1), 145–169. https://doi.org/10.1075/ts.4.1.07sil
Sun, Y. (2017). Positive Language Transfer of Causative Verbs in Chinese-Portuguese Simultaneous Interpretations. Letras de Hoje, 52(3), 322–330. https://doi.org/10.15448/1984-7726.2017.3.29364
Wang, X., Wang, B., & Yuan, L. (2025). The Function of ASR-generated Live Transcription in Simultaneous Interpreting: Trainee Interpreters’ Perceptions from Post-task Interviews. Humanities and Social Sciences Communications, 12(1), 166. https://doi.org/10.1057/s41599-025-04492-w
Will, M. (2020). Computer-aided Interpreting (CAI) for Conference Interpreters: Concepts, Content and Prospects. Journal for Communication Studies, 13(1(25)), 37–71.
Yang, S., Li, D., & Lei, V. L. C. (2020). The Impact of Source Text Presence on Simultaneous Interpreting Performance in Fast Speeches: Will it Help Trainees or Not? Babel, 66(4–5), 588–603. https://doi.org/10.1075/babel.00189.yan
Yu, M., Jiang, X., & Yang, S. (2024). Brazilian sinologist Reis’s translation strategy: Comparing his Portuguese translation of Mo Yan’s novel Wa with Goldblatt’s English version. Theory and Practice in Language Studies, 14(3), 693–702. https://doi.org/10.17507/tpls.1403.09
Yuan, L., & Wang, B. (2023). Cognitive Processing of the Extra Visual Layer of Live Captioning in Simultaneous Interpreting: Triangulation of Eye-tracking and Performance Data. Ampersand, 11, 100131. https://doi.org/10.1016/j.amper.2023.100131
Yuan, L., & Wang, B. (2024). Eye-tracking the Processing of visual input of live transcripts in Remote Simultaneous Interpreting: Preliminary Findings. FORUM, 22(1), 119–145. https://doi.org/10.1075/forum.00038.yua
Zou, L., Carl, M., & Feng, J. (2022). Patterns of Attention and Quality in English-Chinese Simultaneous Interpreting with Text. International Journal of Chinese and English Translation & Interpreting, (2), 100131. https://doi.org/10.56395/ijceti.v2i2.50
Téléchargements
Publiée
Comment citer
Numéro
Rubrique
Licence
© Cadernos de Tradução 2026
Ce travail est disponible sous la licence Creative Commons Attribution 4.0 International .
Autores têm autorização para assumir contratos adicionais separadamente, para distribuição não exclusiva da versão do trabalho publicada nesta revista (ex.: publicar em repositório institucional ou como capítulo de livro, com reconhecimento de autoria e publicação inicial nesta revista).
