Quality of Post-Edited Interlingual Subtitling: FAR Model, Translator’s Assessment and Audience Reception





Subtitling Quality Assessment, Reception, Machine Translation, Post-Editing, FAR Model


This paper analyzes the quality of machine translated interlingual subtitles, which were post-edited in the language pair EN/PT-BR. Our analyses applied the FAR model, a Translation Quality Assessment Model, to the PT-BR subtitles of The Red Sea Diving Resort movie trailer, correlating it to empirical data collected with translators (quality assessment) and audience (reception). Reception data was collected with undergraduate students, which were divided into two groups: the control group that watched the subtitled trailer available on Netflix; and the experimental group that watched the trailer with post-edited subtitles. Quality data was collected with translators and they watched the trailer with post-edited subtitles. We used a 5-point Likert-type scale, a questionnaire and a guided think-aloud protocol to collect our data. Data collected with both translators and students were correlated with the FAR model error scores (Functional Equivalence, Acceptability and Readability). Our results indicate that the post-edited subtitles had good quality in terms of meaning and target language norms; however, the technical parameters had lower quality, which affected the trailer appreciation as reported by most of the audience. Due to the small sample size, further empirical studies are required to obtain solid standards for assessing the quality of post-edited subtitles.


Abdelaal, Noureldin Mohamed. “Subtitling of Culture-Bound Terms: Strategies and Quality Assessment”. Heliyon, 5(4), p. 1-27, 2019. DOI: https://doi.org/10.1016/j.heliyon.2019.e01411

Adão, Carlos Manuel Cunha de Jesus. Tecnologias de Streaming em Contextos de Aprendizagem. Master Thesis (Master in Information Systems). Engineering School, University of Minho, Guimarães, 2006. Repositorium UMinho. http://repositorium.sdum.uminho.pt/handle/1822/6400

Alfaro de Carvalho, Carolina. “Quality Standards or Censorship? Language Control Policies in Cable TV Subtitles in Brazil”. Meta: Journal des Traducteurs, 57(2), p. 464-477, 2012. DOI: https://doi.org/10.7202/1013956ar

Athanasiadi, Rafaella. “Exploring the Potential of Machine Translation and Other Language Assistive Tools in Subtitling: A New Era?”. In: Deckert, Mikołaj (Ed.). Audiovisual Translation: Research and Use. Bern: Peter Lang, 2017. p. 29-49.

Bittner, Hansjörg. “The Quality of Translation in Subtitling”. Trans-Kom, 4(1), p. 76-87, 2011. Available at: http://www.trans-kom.eu/bd04nr01/trans-kom_04_01_04_Bittner_Quality.20110614.pdf. Accessed on: May 31, 2021.

Campos, Giovana Cordeiro & Azevedo, Thais de Assis. “Subtitling for Streaming Platforms: New Technologies, Old Issues”. Cadernos de Tradução, 40(3), p. 222-243, 2020. DOI: https://doi.org/10.5007/2175-7968.2020v40n3p222

Dias, Murilo & Navarro, Rodrigo. “Is Netflix Dominating Brazil?”. International Journal of Business and Management Review, 6(1), p. 19-32, 2018. Available at: http://www.eajournals.org/wp-content/uploads/Is-Netflix-Dominating-Brazil.pdf. Accessed on: Feb. 2, 2021.

Díaz Cintas, Jorge. “Subtitling”. In: Millán, Carmen & Bartrina, Francesca (Eds.). The Routledge Handbook of Translation Studies. London & New York: Routledge, 2012. p. 273-287.

Doherty, Stephen; Gaspari, Federico; Groves, Declan; van Genabith, Josef; Specia, Lucia; Burchardt, Aljoscha; Lommel, Arle & Uszkoreit, Hans. “Mapping the Industry I: Findings on Translation Technologies and Quality Assessment”. QTLaunchPad, p. 1-12, 2013. Available at: https://core.ac.uk/download/pdf/147606442.pdf. Accessed on: Feb. 17, 2021.

Doherty, Stephen. “Issues in Human and Automatic Translation Quality Assessment”. In: Kenny, Dorothy (Ed.). Human Issues in Translation Technology. London & New York: Routledge, 2017. p. 131-148.

Gaspari, Federico; Almaghout, Hala & Doherty, Stephen. “A Survey of Machine Translation Competences: Insights for Translation Technology Educators and Practitioners”. Perspectives, 23(3), p. 333-358, 2014. DOI: https://doi.org/10.1080/0907676X.2014.979842

Gottlieb, Henrik. “Subtitling”. In: Baker, Mona (Ed.). Routledge Encyclopedia of Translation Studies. London & New York: Routledge, 2005. p. 244-248.

Gutt, Ernst-August. Translation and Relevance: Cognition and Context. London & New York: Routledge, 2014.

House, Juliane. “Translation Quality Assessment: Linguistic Description versus Social Evaluation”. Meta: Journal des Traducteurs. 46(2), p. 243-257, 2001. DOI: https://doi.org/10.7202/003141ar

House, Juliane. “Quality of Translation”. Baker, Mona (Ed.). Routledge Encyclopedia of Translation Studies. London & New York: Routledge, 2005. p. 197-200.

IMDB. Missão no Mar Vermelho (2019). Available at: https://www.imdb.com/title/tt4995776/. Accessed on: June 2, 2021.

Netflix. Brazilian Portuguese Timed Text Style Guide. 2021. Available at: https://partnerhelp.netflixstudios.com/hc/en-us/articles/215600497-Brazilian-Portuguese-Timed-Text-Style-Guide. Accessed on: Apr. 18, 2021.

Nida, Eugene. Towards a Science of Translating. Leiden: E. J. Brill, 1964.

Nikolić, Kristijan. “Reception Studies in Audiovisual Translation – Interlingual Subtitling”. In: Di Giovanni, Elena & Gambier, Yves. Reception Studies and Audiovisual Translation. Amsterdam & Philadelphia: John Benjamins, 2018. p. 179-197.

O’Brien, Sharon. “Towards a Dynamic Quality Evaluation Model for Translation”. The Journal of Specialized Translation, 17, p. 55-77, 2012. Available at: https://www.jostrans.org/issue17/art_obrien.php. Accessed on: Feb. 7, 2021.

Pedersen, Jan. Scandinavian Subtitles: A Comparative Study of Subtitling Norms in Sweden and Denmark with a Focus on Extralinguistic Cultural References. Doctoral Thesis (Ph.D.). Faculty of Humanities, Department of English, Engelska Institutionen, Stockholm University, Stockholm, 2007.

Pedersen, Jan. “The FAR Model: Assessing Quality in Interlingual Subtitling”. The Journal of Specialized Translation, 28, p. 210-229, 2017. Available at: https://www.jostrans.org/issue28/art_pedersen.php. Accessed on: June 2, 2021.

Pym, Anthony. “Quality”. O’Hagan, Minako. The Routledge Handbook of Translation and Technology. London & New York: Routledge, 2020. p. 437-452.

Rabêlo, Melissa Silva Moreira; Garcia-Murillo, Martha & Couto, Carlos Agostinho Almeida de Macedo. “Public Broadcasting Services in the United States and Brazil: History, Funding and New Technologies”. Revista de Políticas Públicas, 21(1), p. 469-494, 2017. DOI: http://dx.doi.org/10.18764/2178-2865.v21n1p469-494

Reiss, Katharina & Vermeer, Hans Josef. Groundwork for a General Theory of Translation. Translated by Christiane Nord. Tubingen: Niemeyer, 1984.

Robert, Isabelle & Remael, Aline. “Quality Control in the Subtitling Industry: An Exploratory Survey Study”. Meta: Journal des Traducteurs, 61(3), p. 578-605, 2016. DOI: https://doi.org/10.7202/1039220ar

Romero-Fresco, Pablo & Martínez Pérez, Juan. “Accuracy Rate in Live Subtitling: The NER Model”. Díaz Cintas, Jorge & Baños Piñero, Rocío (Eds.). Audiovisual Translation in a Global Context – Mapping an Ever-Changing Landscape. London: Palgrave Macmillan, 2015. p. 28-50.

Szarkowska, Agnieszka; Díaz Cintas, Jorge & Gerber-Morón, Olivia. “Quality is in the Eye of the Stakeholders: What do Professional Subtitlers and Viewers Think about Subtitling?”. Universal Access in the Information Society, p. 1-15, 2020. DOI: https://doi.org/10.1007/s10209-020-00739-2

Toury, Gideon. Descriptive Translation Studies and Beyond. Amsterdam & Philadelphia: John Benjamins, 1995.



Artigos mais lidos pelo mesmo(s) autor(es)