Comparative analysis between artificial and human intelligence in the teaching of higher education journalism studies

Authors

DOI:

https://doi.org/10.5007/1518-2924.2025.e103490

Keywords:

Generative artificial inteligence, Journalism, Teaching experience, Journalism Students, ChatGPT

Abstract

Objectives: In order to carry out this research, two objectives have been set: O1) To compare the skills of journalism students with AI in writing report headlines. O2) To recognise the capabilities of AI as a producer of journalistic content.

Methods: This research compares the journalistic writing of journalism students and the IAG. Fourth-year students were asked to produce two entries for a news report: one written by them and one using the IAG through Editmaker, a software developed by Cibeles Group with OpenAI's GPT-3.5 TURBO technology. The analysis included 72 entries, half from students and half from the IAG. Variables such as number of words, use of the 5Ws of journalism, coherence, sentence types, syntactic complexity and voice were evaluated.

Results: The analysis shows differences in the entries between students and Generative Artificial Intelligence (GAI). GAI uses, on average, 7.25 words more than students, with averages of 91.94 and 84.69 words, respectively. The dispersion is greater among the students, with the entries varying between 27 and 171 words, while the GIIs range between 44 and 159. Regarding the use of the 5Ws of journalism, the GIIs outperform the students, with an average of 3.67 vs. 3.08. The biggest difference is found in the question "where?", with 22.22% in favour of the IAG. Who?" and "When?" also stand out, with a difference of 11.11%. The IAG answers all 5Ws in at least 50% of the cases, except "when". In contrast, students only exceed 50% for "what?" (97.22%) and "how?" (55.56%).

Conclusions: The study shows that, although the differences between students and Generative Artificial Intelligence (GAI) in journalistic headline writing are not large, GAI performs better in all the variables analysed. GAI uses at least 50% of the 5Ws in most of its headlines, while students only reach that frequency in two of the 5Ws. In addition, the IAG is more effective in answering more questions and generating more entertaining texts, with greater variety in tone.

Downloads

Author Biographies

Juan Pablo Mateos-Abarca, Complutense University of Madrid

Juan Pablo Mateos Abarca holds a degree in Information Sciences from the Complutense University of Madrid, a Master's degree in Digital Journalism from the Recoletos Group and a Master's degree in European Community Law from the European University. He also holds a PhD Cum Laude in Information Business from the Complutense University of Madrid. He is also an official member of the MEDIACOM Research Group (UCM) and a member of the National Committee of Communication Professionals (PROCOM). He has published various articles and book chapters in renowned scientific journals and publishers (Icono14, Revista Mediterránea, Gedisa, Fragua, Dykinson, etc.). He is a professor at the Faculty of Information Sciences of the Complutense University of Madrid, in the Department of Journalism and New Media, in the area of ​​Technology.

Jorge Miranda-Galbe, Complutense University of Madrid

Jorge Miranda Galbe is a professor and researcher in the Department of Journalism and New Media at the Complutense University of Madrid. He has a degree in ‘Audiovisual Communication’ from the University of Burgos, and a master’s degree in ‘Directing Fiction Series for Television’ (TRACOR Institute), a master’s degree in ‘Audiovisual Communication Arts’ from the CEU San Pablo University of Madrid, and a CUM Laude doctorate with international mention in ‘Social Communication’ from the same university.
His doctoral thesis, “Configuration of transmedia projects for television fiction in Spain: the case of ‘El Ministerio del Tiempo’”, obtained the highest grade and the extraordinary award of the doctoral program in Social Communication. He is an academic expert in transmedia narrative and audiovisual technology. He is currently working on a new line of research called “virtual society”.
He has also worked on the direction team of some television series such as “Bandolera” and “Amar es para siempre”.

References

BODEN, Margaret. Inteligencia artificial. Madrid: Turner, 2017.

CANAVILHAS, João. Inteligencia artificial aplicada al periodismo: traducción automática y recomendación de contenidos en el proyecto “A European Perspective” (UER). Revista Latina de Comunicación Social, Madrid, n. 80, p.1-13, 2022. Disponible en: https://www.doi.org/10.4185/RLCS-2022-1534. Acceso en: 25 sept. 2024.

CARLSON, Matt. The robotic reporter: Automated journalism and the redefinition of labor, compo-sitional forms, and journalistic authority. Digital Journalism, [S.l.], v. 3 n. 3, p.416–431, 2015. Disponible en: https://doi.org/10.1080/21670811.2014.976412. Acceso en: 25 sept. 2024.

CARRIÓN, Jorge. Los campos electromagnéticos. Buenos Aires: Editorial Caja Negra, 2023.

DEMPERE, Juan; MODUGU, Kennedy; HESHAM, Allam; RAMASAMY, Lakshmana. The impact of ChatGPT on higher education. Frontiers in Education, [S.l.], v. 8, p. 1-13, 2023. Disponible en: https://doi:10.3389/feduc.2023.1206936. Acceso en: 20 sept. 2024.

DU SAUTOY, Marcus. The Creativity Code: Art and innovation in the age of AI. Cambridge, Masachussets: The Belknap Press of Harvard University Press. 2019. Disponible en: https://www.hup.harvard.edu/file/feeds/PDF/9780674240407_sample.pdf . Acceso en: 5 sept. 2024.

EDITMAKER. [SOFTWARE]. En Cibeles Group L.L.C (7.0). Cibeles Group L.L.C., 2024. Disponible en: https://www.cibeles.net . Acceso en: 25 sept. 2024.

FLORES VIVAR, Jesús Miguel. Algoritmos, aplicaciones y big data, nuevos paradigmas en el proceso de comunicación y de enseñanza-aprendizaje del periodismo de datos. Revista de Comunicación, Piura, v. 17, n. 2, p. 268-291, 2018. Disponible en: http://www.doi.org/10.26441/RC17.2-2018-A12. Acceso en: 20 jul. 2024.

HERRERA-ORTIZ, Jéssica Jasmín; PEÑA-AVILÉS, Jéssica María; HERRERA-VALDIVIESO, María Verónica; MORENO-MORÁN, Douglas Xavier. La inteligencia artificial y su impacto en la comunicación: recorrido y perspectivas. Telos: Revista de Estudios Interdisciplinarios en Ciencias Sociales, Maracaibo v. 26, n. 1, p. 278-296, 2024. Disponible en: https://doi.org/10.36390/telos261.18. Acceso en: 20 agosto 2024.

LOHR, Steve. In case you wondered, a real human wrote this column. New York, 10 sept. 2011. The New York Times: nyti.ms. Disponible en: https://nyti.ms/3tG1RgK . Acceso en: 20 jul. 2024.

MATEOS ABARCA, Juan Pablo; GAMONAL ARROYO, Roberto. Metodologías de investigación y usos de la inteligencia artificial aplicada al periodismo. Comunicación & Métodos, Madrid, v. 6, n. 1, p. 90-107, 2024. Disponible en: https://doi.org/10.35951/v6i1.220 . Acceso en: 14 agosto 2024.

MATEOS ABARCA, Juan Pablo. La inteligencia artificial como tecnología educativa. En: MIGUEL FLORES, J. M. (Ed.). Comprender la Inteligencia Artificial: Hermenéutica, herramientas y experimentalidad de la IA en la Educación y Comunicación. Madrid: Editorial Fragua, 2024. p.165-191.

MENA MUÑOZ, Sergio; MATEOS ABARCA, Juan Pablo. Herramientas de inteligencia artificial generativas aplicadas a la edición audiovisual. Tipologías y disyuntivas. RAE-IC, Revista de la Asociación Española de Investigación, Santiago de Compostela, v. 11, n. Especial, p. 1-24, 2024. Disponible en: https://doi.org/10.24137/raeic.11.e.4. Acceso en: 2 sept. 2024.

MIRANDA GALBE, Jorge; DE ARANCHA ROMÁN, María Begoña; ESTEBAN RAMOS, José María. El Impacto de la Inteligencia Artificial en la Investigación Académica y Científica. En: MUÑOZ DE LA LUNA, Ángel Bartolomé; MARTÍN GÓMEZ, Sonia; CABEZUELO-LORENZO, Francisco (Eds.). Los retos de la inteligencia artificial en contextos educativos. Madrid: CEU Publicaciones, 2024, p.97-108.

O’BRIAN, Matt; BOAK, Josh. Biden y Harris presiden junta sobre inteligencia artificial. Los Angeles, 5 de mayo de 2023. Los Angeles Times: latimes.com. Disponible en: https://www.latimes.com/espanol/eeuu/articulo/2023-05-05/biden-y-harris-presiden-junta-sobre-inteligencia-artificial. Acceso en: 24 agosto 2024.

ORIHUELA, José Luis. Entrevista a José Luis Orihuela: innovación tecnológica, medios y formación profesional. InMediaciones de la Comunicación, Montevideo, v. 18, n. 2, p. 323-327, 2023. Disponible en: https://doi.org/10.18861/ic.2023.18.2.3495. Acceso en: 28 agosto 2024.

UFARTE RUIZ, María José; CALVO RUBIO, Luis Mauricio; MURCIA VERDÚ, Francisco José. Los desafíos éticos del periodismo en la era de la inteligencia artificial. Estudios sobre el Mensaje Periodístico, Madrid, v. 27, n. 2, p. 673-684, 2021. Disponible en: https://doi.org/10.5209/esmp.69708. Acceso en: 10 jul. 2024.

WALSH, Toby. Machines that think: the future of artificial intelligence. Búfalo, Nueva York: Prometheus Books, 2018.

WILL ROBOTS TAKE MY JOB?. Analistas de Noticias, Reporteros y Periodistas. [S.l.], 2024. Will Robots Take My Job?: willrobotstakemyjob.com. Disponible en: https://willrobotstakemyjob.com/es/. Acceso en: 14 sept. 2024.

ZIZEK, Slavoj. Sobre la Inteligencia Artificial. Argentina, 12 de mayo de 2023. Bloghemia: bloghemia.com. Disponible en: https://www.bloghemia.com/2023/05/sobre-la-inteligencia-artificial-por.html. Acceso en: 2 de sept. 2024.

Published

2025-03-17

How to Cite

MATEOS-ABARCA, Juan Pablo; MIRANDA-GALBE, Jorge. Comparative analysis between artificial and human intelligence in the teaching of higher education journalism studies. Encontros Bibli: revista eletrônica de biblioteconomia e ciência da informação, [S. l.], v. 30, p. 1–20, 2025. DOI: 10.5007/1518-2924.2025.e103490. Disponível em: https://periodicos.ufsc.br/index.php/eb/article/view/103490. Acesso em: 26 mar. 2025.

Issue

Section

Dossier: News scenarios of the Digital Society and the challenges of Generative Artificial Intelligence