Academic literacies and artificial intelligence: analyzing the simulation of scientific article comprehension through ChatGPT
DOI:
https://doi.org/10.5007/1518-2924.2025.e103500Keywords:
Academic literacies, Academic article, Artificial Intelligence, ChatGPTAbstract
Objective: Artificial intelligence (AI) has permeated various contexts, including academia, sparking debates about its potential and limitations in this context. This study aims to analyze the main characteristics of responses generated by the ChatGPT tool when prompted with questions about the composition of academic articles.
Methods: Adopting a descriptive and exploratory approach, this study focuses on interactions with ChatGPT. Five sequential prompts, presented in both Brazilian Portuguese and English, were designed to progressively increase in linguistic complexity.
Results: The analysis revealed that ChatGPT exhibits proficiency in synthesizing information and producing responses that align with academic conventions, highlighting its utility as a research support tool. However, the responses predominantly reflected a skills-based model, emphasizing technical aspects and the formal structure of academic writing—such as organizational clarity and methodological rigor—while neglecting the social and identity dimensions of academic authorship.
Conclusions: While the guidance provided by ChatGPT is valuable for understanding the technical aspects of academic article composition, it is essential for users to cultivate a critical awareness of writing practices. Recognizing the role of academic literacies is crucial for interpreting and constructing knowledge within the academic landscape.
Downloads
References
ALJANABI, M. ChatGPT: open possibilities. Mesopotamian J. CyberSecur., Baghdad, v. 2023, 2023. p. 16–17. Disponível em: https://doi.org/10.58496/MJCS/2023/003 . Acesso em: 10 set. 2024.
ALJANABI, M.; GHAZI, M.; ALI, A. H.; ABED, S. A. ChatGPT: open possibilities. Iraqi J. Comput. Sci. Math., Baghdad, v. 4, n. 1, 2023. p. 62–64. Disponível em: 10.52866/ijcsm.2023.01.01.0018 . Acesso em: 10 set. 2024.
ALTMAN, S. ChatGPT Launched on Wednesday. Today it Crossed 1 Million Users!. [@sama], Sam Altman Twitter, 2022.
AYDIN, Ö.; KARAARSLAN, E. Is ChatGPT leading generative AI? What is beyond expectations? Academic Platform Journal of Engineering and Smart Systems, v. 11, n. 3, p. 118-134, 2023. Disponível em: https://doi.org/10.2139/ssrn.4341500 . Acesso em: 10 set. 2024.
BARDIN, L. Análise de conteúdo. Lisboa: edições, 70, 1977. 225 p.
BARDIN, L. Análise de conteúdo. Traduzido por Luís Antero Reto, Augusto Pinheiro. São Paulo: Edições 70, 2009.
BECKETT, C. New powers, new responsibilities: a global survey of journalism and artificial intelligence. London: The London School of Economics, 2019.
BORJI, A. A categorical archive of ChatGPT failures. arXiv Preprint, arXiv:2302.03494, 2023. Disponível em: https://doi.org/10.48550/arXiv.2302.03494. Acesso em: 10 set. 2024.
BROWN, T. B., MANN, B., RYDER, N., SUBBIAH, M., KAPLAN, J., DHARIWAL, P., NEELAKANTAN, A., SHYAM, P., SASTRY, G., ASKELL, A., AGARWAL, S., HERBERT-VOSS, A., KRUEGER, G., HENIGHAN, T., CHILD, R., RAMESH, A., ZIEGLER, D. M., WU, J., WINTER, C., HESSE, C., CHEN, M., SIGLER, E., LITWIN, M., GRAY, S., CHESS, B., CLARK, J., BERNER, C., MCCANDLISH, S., RADFORD, A., SUTSKEVER, I., AMODEI, D.. Language models are few-shot learners.arXiv Preprint ,arXiv:2005.14165, 2020. Disponível em: https://doi.org/10.48550/arXiv.200514165. Acesso em: 10 set. 2024.
CASTILLO-GONZALEZ, W. ChatGPT y el futuro de la comunicación científica. Metaverse Basic Appl. Res, Buenos Aires, v. 1, 2022. p. 1–8. Disponível em: https://doi.org/10.56294/mr20228 . Acesso em: 10 set. 2024.
FARIAS, S. A. Pânico na academia! Inteligência artificial na construção de textos científicos com o uso do ChatGPT. Rev. Interdiscip. Market. Maringá, v. 13, n. 1, 2023. p. 79–83. Disponível em: https://doi.org/10.4025/rimar.v13i1.66865 . Acesso em: 10 set. 2024.
FRIEDMAN, A. AI chatbot predicted to replace Google in a couple of years. [S.l.], 06 dez. 2022. Phone Arena: phonearena.com. Disponível em: https://www.phonearena.com/news/ai-chatbot-could-replace-google-soon_id144120. Acesso em: 07 dez. 2024.
HAMMAD, M. The Impact of Artificial Intelligence (AI) Programs on Writing Scientific Research. Ann Biomed Eng. v. 51, n. 3, 2023. Disponível em: https://pubmed.ncbi.nlm.nih.gov/36637603/. Acesso em: 3 abr. 2024.
HEAVEN, W. D. OpenAI’s new language generator GPT-3 is shockingly good—and completely mindless. Massachusetts, 20 jul. 2020.MIT Technology Review: technologyreview.com. Disponível em: https://www.technologyreview.com/2020/07/20/1005454/openai-machine-learning-language-generator-gpt-3-nlp/. Acesso em: 05 dez. 2024.
HILSDON, John; MALONE, Cathy; SYSKA, Alicja. Academic literacies twenty years on: a community-sourced literature review. Journal of Learning Development in Higher Education, [S. l.], n. 15, 2019. Disponível em: https://journal.aldinhe.ac.uk/index.php/jldhe/article/view/567. Acesso em: 17 dez. 2024.
LE, T. T. A preliminary example of utilizing AI text generation to support academic writing: “Humans befriending their creations some notes on the human-AI relationship”. OSF Preprints, 10.31219, 2023. Disponível em: https://osf.io/bsxey. Acesso em: 3 abr. 2024.
LEA, M.R.; STREET, B.V. Student writing in higher education: an academic literacies approach. Studies in Higher Education, [S.l.]. v. 6, n. 23, p. 157-172, ago. 1998. Disponível em: https://www.tandfonline.com/doi/abs/10.1080/03075079812331380364. Acesso em: 10 jan. 2022.
LIMA, J. M. T. S. Inteligência artificial na competição: os limites da responsabilidade de um agente econômico em função de atos de concentração operados por programas sofisticados de computador no comércio eletrônico brasileiro. RDC, v. 5, n. 2, 2017, pp. 5-29. Disponível em: https://revista.cade.gov.br/index.php/revistadedefesadaconcorrencia/article/view/328/166. Acesso em: 3 abr. 2024.
LIU, Y., ESAN, O. C.; PAN, Z.; AN, L.. Machine Learning for Advanced Energy Materials. Energy and AI, v. 3, n. 100049. 2021. Disponível em: https://doi.org/10.1016/j.egyai.2021.100049. Acesso em: 17 dez. 2024.
LILLIS, T.; TUCK, J. ‘Academic Literacies: a critical lens on writing and reading in the academy’. In: HYLAND, K.; SHAW, P. (orgs) The Routledge Handbook of English for Academic Purposes. London/New York: Routledge, p.30-43. 2015.
LOCK, S. What is the AI chatbot phenomenon ChatGPT and could it replace humans?. Manchester, 05 dez. 2022.The Guardian: theguardian.com. Disponível em: https://www.theguardian.com/technology/2022/dec/05/what-is-ai-chatbot-phenomenon-chatgpt-and-could-it-replace-humans. Acesso em: 05 dez. 2024.
MANJOO, Farhad. "How Do You Know a Human Wrote This?" International New York Times, v. 31, 2020. Disponível em: link.gale.com/apps/doc/A631061734/AONE?u=anon~7f5921a4&sid=googleScholar&xid=21dc03cc. Acesso em: 3 abr. 2024.
MIJWIL, M. M., ALJANABI, M.; ALI, A. H. “ChatGPT: Exploring the Role of Cybersecurity in the Protection of Medical Information,” Mesopotamian journal of cybersecurity, v. 2, n. 1, 2023, pp:18-21. Disponível em: https://doi.org/10.58496/MJCS/2023/004. Acesso em: 3 abr. 2024.
MIJWIL, M.; ALJANABI, M. ChatGPT: towards artificial intelligence-based cybersecurity: the practices and ChatGPT generated ways to combat cybercrime. Iraqi J. Comput. Sci. Math., Baghdad, v. 4, n. 1, 2023. p. 65–70. Disponível em: https://doi.org/10.52866/ijcsm.2023.01.01.0019. Acesso em: 10 set. 2024.
NOAIN-SÁNCHEZ, A. Addressing the impact of artificial intelligence on journalism: the perception of experts, journalists and academics. Commun. Soc., Pamplona, v. 35, n. 3, 2022. p. 105–121. Disponível em: https://doi.org/10.15581/003.35.3.105-121. Acesso em: 10 set. 2024.
NGUYEN, A.; NGO, H. N.; HONG, Y.; DANG, B.; NGUYEN, B-P. T. Ethical principles for artificial intelligence in education. Educ Inf Technol, v. 28, n; 64221–4241, 2023. Disponível em: https://doi.org/10.1007/s10639-022-11316-w. Acesso em: 3 abr. 2024.
OPENAI. ChatGPT. [S.l.], 2022. CHATGPT: chat.openai. Disponível em: https://chat.openai.com. Acesso em: 10 set. 2024.
O'CONNOR, S. ChatGPT, open artificial intelligence platforms in nursing education: tools for academic progress or abuse? Nurse Educ. Pract., [S.l.] v. 66, 2022. p. 103537. Disponível em: https://doi.org/10.1016/j.nepr.2022.103537. Acesso em: 10 set. 2024.
PAVLIK, J. V. Collaborating with ChatGPT: considering the implications of generative artificial intelligence for journalism and media education. J. Mass Commun. Educat., [S.l.], v. 78, n. 1, 2023. p. 84–93. Disponível em: https://doi.org/10.1177/10776958221149577. Acesso em: 10 set. 2024.
ROOSE, K. The brilliance and weirdness of ChatGPT. New York, 12 maio 2022.The New York Times: nytimes.com. Disponível em: https://www.nytimes.com/2022/12/05/technology/chatgpt-ai-twitter.html. Acesso em: 07 dez. 2024.
RODRIGUES, G. S.; BRANDÃO, V. R. A.; TRIVELATO, R. M. S. ChatGPT uma ferramenta para a pesquisa científica?. Código 31: revista de informação, comunicação e interface, Belo Horizonte, v. 2, n. 1, 2024. Disponível em: https://revista.fumec.br/index.php/codigo31/article/view/9916. Acesso em: 07 dez. 2024.
RUDOLPH, J.; TAN, S.; TAN, S. ChatGPT: bullshit spewer or the end of traditional assessments in higher education? J. Appl. Learn. Teach., Singapore, v. 6, n. 1, p. 1-22. 2022. Disponível em: https://journals.sfu.ca/jalt/index.php/jalt/article/view/689. Acesso em: 07 dez. 2024.
SANTOS, S. M. A. V. GUIMARÃES, C. D.; DEMUNER, J. A.; ORTIZ, L.; MEROTO, M. B. das N.; DE ALENCAR, M. S.; DA SILVA, R. G.; NARCISO, R. Inteligência artificial: uma nova fronteira na educação básica. Contribuciones a las Ciencias Sociales, v. 17, n. 1, p. 4499-4512, 2024. DOI: 10.55905/revconv.17n.1-268. Disponível em: https://doi.org/10.55905/revconv.17n.1-268. Acesso em: 21 set. 2024.
SILVA, D.T.F. Artigo acadêmico como prática de letramento na formação de professores de língua portuguesa. 2022. 137f. Dissertação (Mestrado em Linguagem e Ensino) - Pós-graduação em Linguagem e Ensino, Centro de Humanidades, Universidade Federal de Campina Grande, Campina Grande, 2022. Disponível em: https://bdtd.ibict.br/vufind/Record/UFCG_c6679f62651c891eb816451cdd0cbabd. Acesso em: 07 dez. 2024.
SILVA, V. L. Ética e responsabilidade na era da inteligência artificial: aprendizagem digital no chat GPT. 2023. 27 p. Monografia (Especialização em Mídia e Educação) - Pós-graduação Lato Sensu em Mídia e Educação, Universidade Federal do Pampa/ Universidade Aberta do Brasil, Campus São Borja, São Borja, 2023. Disponível em: https://dspace.unipampa.edu.br/handle/riu/8334. Acesso em: 07 dez. 2024.
SOUZA, M. N. M. de.; LIMA, P. V. P. de .; SANTOS, K. V. G. dos; LOPES, C. Do GPT 3 ao CHATGPT: potencialidades e alertas no enfoque da produção acadêmica brasileira: . Boletim de Conjuntura (BOCA), Boa Vista, v. 16, n. 47, p. 599–620, 2023. DOI: 10.5281/zenodo.10222348. Disponível em: https://revista.ioles.com.br/boca/index.php/revista/article/view/2732. Acesso em: 21 nov. 2024.
STREET, B. Dimensões “escondidas” na escrita de artigos acadêmicos. Perspectiva, [S. l.], v. 28, n. 2, p. 541–567, 2010. DOI: 10.5007/2175-795X.2010v28n2p541. Disponível em: https://periodicos.ufsc.br/index.php/perspectiva/article/view/2175-795X.2010v28n2p541. Acesso em: 17 dez. 2024.
THORP, H. H. ChatGPT is fun, but not an author. Science. v. 27, n. 379, 2023. Disponível em: https://www.science.org/doi/10.1126/science.adg7879. Acesso em: 17 dez. 2024.
TÚÑEZ-LÓPEZ, J. M.; TOURAL-BRAN, C.; CACHEIRO-REQUENJO, S. Uso de bots y algoritmos para automatizar la redacción de notícias: percepción y actitudes de los periodistas en España. El Prof. Inf., Barcelona, v. 27, n. 4, 2018. P. 750–758. Disponível em: https://doi.org/10.3145/epi.2018.jul.04. Acesso em: 10 set. 2024.
ZAVALA, V. Quem está dizendo isso? Letramentos acadêmicos, identidade e poder no ensino superior. In: VÓVIO, C.; SITO, L.; DE GRANDE, P. Letramentos: rupturas, deslocamentos e repercussões de pesquisas em linguística aplicada. Mercado de Letras : Campinas, 2010. p. 71-79.
ZHAI, X. ChatGPT user experience: implications for education.Social Science Research Network, [S.l.], 2023. Disponível em: https://doi.org/10.2139/ssrn.4312418. Acesso em: 10 set. 2024.
ZHAI, X. ChatGPT for next generation science learning. Social Science Research Network, [S.l.], 2023. Disponível em: https://doi.org/10.1145/3589649. Acesso em: 10 set. 2024.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Danielly Thaynara da Fonseca Silva
This work is licensed under a Creative Commons Attribution 4.0 International License.
The author must guarantee that:
- there is full consensus among all the coauthors in approving the final version of the document and its submission for publication.
- the work is original, and when the work and/or words from other people were used, they were properly acknowledged.
Plagiarism in all of its forms constitutes an unethical publication behavior and is unacceptable. Encontros Bibli has the right to use software or any other method of plagiarism detection.
All manuscripts submitted to Encontros Bibli go through plagiarism and self-plagiarism identification. Plagiarism identified during the evaluation process will result in the filing of the submission. In case plagiarism is identified in a manuscript published in the journal, the Editor-in-Chief will conduct a preliminary investigation and, if necessary, will make a retraction.
This journal, following the recommendations of the Open Source movement, provides full open access to its content. By doing this, the authors keep all of their rights allowing Encontros Bibli to publish and make its articles available to the whole community.
Encontros Bibli content is licensed under a Creative Commons Attribution 4.0 International License.
Any user has the right to:
- Share - copy, download, print or redistribute the material in any medium or format.
- Adapt - remix, transform and build upon the material for any purpose, even commercially.
According to the following terms:
- Attribution - You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions - You may not apply legal terms or technological measures that legally restrict others from doing anything that the license permits.
As obras deste periódico estão licenciadas com 