Evaluating the effectiveness of translation technology training in Iran: A perception-based mixed methods study
DOI:
https://doi.org/10.5007/2175-7968.2025.e104904Schlagworte:
Kirkpatrick model, translation technology training, evaluation of effectiveness, translation marketAbstract
Although evaluating the effectiveness of training courses on translation technology is essential, previous studies have primarily evaluated such courses based on trainee translators’ satisfaction or knowledge acquisition, paying little attention to behavioral changes in trainee translators and the long-term outcomes of the training. Drawing on convergent mixed methods design, this study aimed to evaluate the effectiveness of the translation technology course provided by Iranian universities at MA level based on the perceptions of Iranian MA translation students and graduates. To this end, both quantitative and qualitative data were collected from 63 Iranian MA translation students and graduates via two questionnaires. The results, according to the New World Kirkpatrick Model, indicated that the translation technology course provided by Iranian universities at MA level seems to lack training effectiveness. The findings suggest that there possibly exists a gap between what is taught and the needs of the translation market in the Iranian context.
Literaturhinweise
Abdi, H. (2020). Translation and technology: Investigating the employment of computer-aided translation (CAT) tools among Iranian freelance translators. Theory and Practice in Language Studies, 10(7), 811–818. https://doi.org/10.17507/tpls.1007.13
Abdi, H. (2022). Inquiry into students’ familiarity with computer-assisted translation tools. Global Journal of Information Technology: Emerging Technologies, 12(2), 124–135. https://doi.org/10.18844/gjit.v12i2.7880
Al Sharou, K. (2024). Open-source statistical machine technology in translator training: From machine translation users to machine translation. In M. Winters, S. Deane-Cox & U. Böser (Eds.), Translation, interpreting and technological change: Innovations in research, practice and training (pp. 159–179). Bloomsbury Publishing. https://doi.org/10.5040/9781350212978.0016
Al-Jarf, R. (2017). Technology integration in translator training in Saudi Arabia. International Journal of Research in Engineering and Social Sciences, 7(3), 1–7.
Alotaibi, H. M. (2024). Factors affecting acceptance of cloud-based computer-assisted translation tools among translation students. Theory and Practice in Language Studies, 14(4), 1057–1068. https://doi.org/10.17507/tpls.1404.14
Al-Rumaih, L. A. (2021). The integration of computer-aided translation tools in translator-training programs in Saudi universities: Toward a more visible state. Arab World English Journal for Translation and Literary Studies, 5(1), 336–362. https://doi.org/10.24093/awejtls/vol5no1.23
Alsalamah, A., & Callinan, C. (2021). The Kirkpatrick model for training evaluation: Bibliometric analysis after 60 years (1959–2020). Industrial and Commercial Training, 54(1), 36–63. https://doi.org/10.1108/ict-12-2020-0115
Álvarez-Álvarez, S., & Arnáiz-Uzquiza, V. (2017). Translation and interpreting graduates under construction: Do Spanish translation and interpreting studies curricula answer the challenges of employability? The Interpreter and Translator Trainer, 11(2–3), 139–159. https://doi.org/10.1080/1750399x.2017.1344812
Alzamil, A. M. (2024). Translation competence between industry and academia in Saudi Arabia: Job descriptions vs students’ perceptions. The Interpreter and Translator Trainer, 18(3), 442–464. https://doi.org/10.1080/1750399x.2024.2348962
Bilić, V. (2020). The online computer-assisted translation classroom. The International Journal of Translation and Interpreting Research, 12(1), 127–141. https://doi.org/10.12807/ti.112201.2020.a08
Bowker, L. (2023). De-mystifying translation: Introducing translation to non-translators. Routledge. https://doi.org/10.4324/9781003217718
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
Cadwell, P., O’Brien, S., & Teixeira, C. S. C. (2017). Resistance and accommodation: Factors for the (non-) adoption of machine translation among professional translators. Perspectives, 26(3), 301–321. https://doi.org/10.1080/0907676x.2017.1337210
Cahapay, M. (2021). Kirkpatrick model: Its limitations as used in higher education evaluation. International Journal of Assessment Tools in Education, 8(1), 135–144. https://doi.org/10.21449/ijate.856143
Chan, V., & Shuttleworth, M. (2023). Teaching translation technology. In C. Sin-wai (Ed.), Routledge encyclopedia of translation technology (2nd ed.) (pp. 259–279). Routledge. https://doi.org/10.4324/9781003168348-15
Chen, S., & Liu, Y. (2023). Identity formation and transformation of Chinese university translator trainers. The Interpreter and Translator Trainer, 17(3), 353–374. https://doi.org/10.1080/1750399x.2023.2237325
Creswell, J. W. (2021). A concise introduction to mixed methods research (2nd ed.). SAGE Publications.
Creswell, J. W., & Guetterman, T. C. (2019). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (6th ed.). Pearson.
Creswell, J. W., & Plano Clark, V. L. (2017). Designing and conducting mixed methods research (3rd ed.). SAGE Publications.
Daems, J. (2024). Students’ attitudes towards interactive and adaptive translation technology: Four years of working with LILT. In Y. Peng, H. Huang & D. Li (Eds.), New advances in translation technology: Applications and pedagogy (pp. 239–261). Springer Singapore. https://doi.org/10.1007/978-981-97-2958-6_12
Doherty, S. (2016). The impact of translation technologies on the process and product of translation. International Journal of Communication, 10, 947–969.
Hao, Y. (2023). Students’ emotional experiences in learning translation memory systems: A narrative-based study. The International Journal of Translation and Interpreting Research, 15(2), 157–175. https://doi.org/10.12807/ti.115202.2023.a10
Hazaea, A. N., & Qassem, M. (2024). Translation competence in translator training programs at Saudi universities: Empirical study. Open Education Studies, 6(1), 1–12. https://doi.org/10.1515/edu-2024-0029
He, Y., & Tao, Y. (2022). Unity of knowing and acting: An empirical study on a curriculum approach to developing students’ translation technological thinking competence. The Interpreter and Translator Trainer, 16(3), 348–366. https://doi.org/10.1080/1750399x.2022.2101849
Kaba, F., & Gjinali, A. (2023). Professional translators and translation technology. Journal of Educational and Social Research, 13(2), 217–222. https://doi.org/10.36941/jesr-2023-0045
Kenny, D. (2019). Technology and translator training. In M. O’Hagan (Ed.), The routledge handbook of translation and technology (pp. 498–515). Routledge. https://doi.org/10.4324/9781315311258-35
Khoshsaligheh, M., Moghaddas, M., & Ameri, S. (2019). English translator training curriculum revisited: Iranian trainees’ perspectives. Journal of Teaching English Language, 13(2), 181–212. https://doi.org/10.22132/tel.2019.96238
Kiettikunwong, N., & Narot, P. (2024). Determining outcomes and impacts of human resource development programs. Springer Singapore. https://doi.org/10.1007/978-981-97-0395-1
Kiraly, D. (2005). Project-based Learning: A case for situated translation. Meta, 50(4), 1098–1111. https://doi.org/10.7202/012063ar
Kiraly, D. (2012). Growing a project-based translation pedagogy: A fractal perspective. Meta, 57(1), 82–95. https://doi.org/10.7202/1012742ar
Kirkpatrick, J. D., & Kirkpatrick, W. K. (2016). Kirkpatrick’s four levels of training evaluation. Association for Talent Development.
Kodura, M. (2022). Evaluating the effectiveness of an online course in translation technology originally developed for a classroom environment. The Interpreter and Translator Trainer, 16(3), 309–324. https://doi.org/10.1080/1750399x.2022.2092830
Kornacki, M. (2018). Computer-assisted translation (CAT) tools in the translator training process. Peter Lang. https://doi.org/10.3726/b14783
Kornacki, M., & Pietrzak, P. (2021). New translator training environments: Towards improving translation students’ digital resilience. New Voices in Translation Studies, 24(1), 1–22. https://doi.org/10.14456/nvts.2021.2
Li, H. (2022). Evaluation of translation technology textbooks from the perspective of translator’s technological competence. Journal of Language Teaching, 2(5), 1–5. https://doi.org/10.54475/jlt.2022.005
Li, X., Gao, Z., & Liao, H. (2024). An empirical investigation of college students’ acceptance of translation technologies. PLoS ONE, 19(2), 1–21. https://doi.org/10.1371/journal.pone.0297297
Man, D., Mo, A., Chau, M. H., O’Toole, J. M., & Lee, C. (2019). Translation technology adoption: Evidence from a postgraduate programme for student translators in China. Perspectives, 28(2), 253–270. https://doi.org/10.1080/0907676x.2019.1677730
Matolić, T., Jurakić, D., Jurakić, Z. G., Maršić, T., & Pedišić, Ž. (2023). Development and validation of the educational course assessment toolkit (EDUCATOOL): A 12-item questionnaire for evaluation of training and learning programmes. Frontiers in Education, 8, 1–9. https://doi.org/10.3389/feduc.2023.1314584
Mellinger, C. D., & Hanson, T. A. (2017). Quantitative research methods in translation and interpreting studies. Routledge. https://doi.org/10.4324/9781315647845
Mellinger, C. D., & Hanson, T. A. (2021). Methodological considerations for survey research: Validity, reliability, and quantitative analysis. Linguistica Antverpiensia New Series – Themes in Translation Studies, 19, 172–190. https://doi.org/10.52034/lanstts.v19i0.549
Mitchell-Schuitevoerder, R. (2020). A project-based approach to translation technology. Routledge. https://doi.org/10.4324/9780367138851
Moghaddas, M., & Khoshsaligheh, M. (2019). Implementing project-based learning in a Persian translation class: A mixed-methods study. The Interpreter and Translator Trainer, 13(2), 190–209. https://doi.org/10.1080/1750399x.2018.1564542
Mohammed, T. A. S. (2022). The use of corpora in translation into the second language: A project-based approach. Frontiers in Education, 7, 1–14. https://doi.org/10.3389/feduc.2022.849056
Nawaz, F., Ahmad, W., & Khushnood, M. (2022). Kirkpatrick model and training effectiveness: A meta-analysis 1982 to 2021. Business & Economic Review, 14(2), 35–56. https://doi.org/10.22547/BER/14.2.2
Nitzke, J., Tardel, A., & Hansen-Schirra, S. (2019). Training the modern translator – the acquisition of digital competencies through blended learning. The Interpreter and Translator Trainer, 13(3), 292–306. https://doi.org/10.1080/1750399x.2019.1656410
Omar, A., F, A., & El-Nabawi, I. (2020). The impact of translation software on improving the performance of translation majors. International Journal of Advanced Computer Science and Applications, 11(4), 287–292. https://doi.org/10.14569/ijacsa.2020.0110439
Pan, J., Wong, B. T., & Wang, H. (2022). Navigating learner data in translator and interpreter training. Babel, 68(2), 236–266. https://doi.org/10.1075/babel.00260.pan
Qassem, M., & Al Thowaini, B. M. (2024). Effectiveness of an online training course for trainee translators: Analysis of keylogging data. Education and Information Technologies, 15711–15735. https://doi.org/10.1007/s10639-024-12484-7
Reio, T. G., Rocco, T. S., Smith, D. H., & Chang, E. (2017). A critique of Kirkpatrick’s evaluation model. New Horizons in Adult Education and Human Resource Development, 29(2), 35–53. https://doi.org/10.1002/nha3.20178
Rodriguez de Céspedes, B. (2020). Beyond the margins of academic education: Identifying translation industry training practices through action research. The International Journal of Translation and Interpreting Research, 12(1), 115–126. https://doi.org/10.12807/ti.112201.2020.a07
Rodríguez-Castro, M. (2018). An integrated curricular design for computer-assisted translation tools: Developing technical expertise. The Interpreter and Translator Trainer, 12(4), 355–374. https://doi.org/10.1080/1750399x.2018.1502007
Rossi, C., & Chevrot, J. (2019). Uses and perceptions of machine translation at the European Commission. Journal of Specialised Translation, 31, 177–200. https://doi.org/10.26034/cm.jostrans.2019.182
Rothwell, A., Moorkens, J., Fernández-Parra, M., Drugan, J., & Austermuehl, F. (2023). Translation tools and technologies. Routledge. https://doi.org/10.4324/9781003160793
Samman, H. M. (2022). Evaluating machine translation post-editing training in undergraduate translation programs: An exploratory study in Saudi Arabia [Doctoral thesis]. University of Southampton. https://eprints.soton.ac.uk/469163/
Sánchez-Castany, R. (2022). Teaching translation technologies: An analysis of a corpus of syllabi for translation and interpreting undergraduate degrees in Spain. In G. Massey, E. Huertas-Barros & D. Katan (Eds.), The human translator in the 2020s (pp. 27–43). Routledge. https://doi.org/10.4324/9781003223344-3
Sánchez-Castany, R. (2025). The challenges of teaching translation technologies in the AI era. Cadernos de Tradução, 45, 1–23. https://doi.org/10.5007/2175-7968.2025.e105121
Sánchez Ramos, M. D. M. (2021). Integrating collaborative localization into professional translator training. The International Journal of Translation and Interpreting Research, 13(1), 38–50. https://doi.org/10.12807/ti.113201.2021.a03
Sánchez Ramos, M. D. M. (2022). Public service interpreting and translation training: A path towards digital adaptation to machine translation and post-editing. The Interpreter and Translator Trainer, 16(3), 294–308. https://doi.org/10.1080/1750399x.2022.2092829
Shewchuk, S., Wallace, J., & Seibold, M. (2023). Evaluations of training programs to improve capacity in K*: A systematic scoping review of methods applied and outcomes assessed. Humanities and Social Sciences Communications, 10(1), 1–14. https://doi.org/10.1057/s41599-023-02403-5
Steele, L. M., Mulhearn, T. J., Medeiros, K. E., Watts, L. L., Connelly, S., & Mumford, M. D. (2016). How do we know what works? A review and critique of current practices in ethics training evaluation. Accountability in Research, 23(6), 319–350. https://doi.org/10.1080/08989621.2016.1186547
Su, W., & Li, D. (2023). The effectiveness of translation technology training: A mixed methods study. Humanities and Social Sciences Communications, 10, 1–12. https://doi.org/10.1057/s41599-023-02066-2
Taghizadeh, M., & Azizi, M. (2017). Exploring computer-aided translation competences of some Iranian translators. International Journal of English Language and Translation Studies, 5(1), 78–87.
Venkatesan, H. (2023). Technology preparedness and translator training: Implications for curricula. Babel, 69(5), 666–703. https://doi.org/10.1075/babel.00335.ven
Vitalaru, B. (2024). Public Service interpreting and translation and employment in Spain. Hikma, 23(1), 253–288. https://doi.org/10.21071/hikma.v23i1.16136
Wang, P., & Sawyer, D. B. (2023). Machine learning in translation. Routledge. https://doi.org/10.4324/9781003321538
Yan, D., & Wang, J. (2022). Teaching data science to undergraduate translation trainees: Pilot evaluation of a task-based course. Frontiers in Psychology, 13, 1–18. https://doi.org/10.3389/fpsyg.2022.939689
Downloads
Veröffentlicht
Zitationsvorschlag
Ausgabe
Rubrik
Lizenz
Copyright (c) 2025 Cadernos de Tradução
Dieses Werk steht unter der Lizenz Creative Commons Namensnennung 4.0 International.
Autores têm autorização para assumir contratos adicionais separadamente, para distribuição não exclusiva da versão do trabalho publicada nesta revista (ex.: publicar em repositório institucional ou como capítulo de livro, com reconhecimento de autoria e publicação inicial nesta revista).
