Data-driven editorial management: an indicator model applied to peer review

Authors

DOI:

https://doi.org/10.5007/1518-2924.2026.e107950

Keywords:

Editorial management, Peer review, Editorial indicators, Business Intelligence, Open Journal Systems

Abstract

Objective: To characterize the peer review process of the journal Cadernos Ibero-Americanos de Direito Sanitário (CIADS) between 2015 and 2025 through the construction and application of an analytical indicator model derived from Open Journal Systems (OJS) metadata and integrated with Business Intelligence tools.

Method: A documentary, descriptive, and quantitative study with a retrospective longitudinal design. Metadata from the Review Report module were extracted in CSV format, subjected to cleaning, standardization, and modeling procedures, and transformed into editorial indicators related to reviewer assignments, geographic participation, temporal distribution of completed reviews, recommendation categories, and editorial interventions. Analyses were operationalized through analytical measures and the visualization of results in Power BI dashboards.

Results: A total of 1,119 reviewer assignments involving 235 reviewers were identified, resulting in 898 completed reviews. The review process was characterized by the recurrent concentration of invitations among a restricted group of reviewers, international participation with a complementary role to the national base, and the occurrence of three distinct temporal phases over the historical series. The predominant recommendations were “Accept” (40.91%) and “Mandatory revisions” (37.9%). Editorial follow-up included 344 reminders and 44 cancellations.

Conclusions: The integration of OJS metadata with Business Intelligence tools enabled the transformation of operational records into descriptive analytical evidence, making visible structural patterns, asymmetries, and dynamics of the peer review process. The proposed indicator model proved to be low-cost and applicable to scientific journals with different profiles, within the limits of the available data and the adopted methodological scope.

Downloads

Download data is not yet available.

Author Biographies

Danilo Silva Santos Rocha, Fundação Oswaldo Cruz

He holds a degree in Internet Systems from the Federal Institute of Education, Science, and Technology of Brasília (2023) and in Public Health from the University of Brasília (2019). He is currently a collaborator in the Health Law Program at the Oswaldo Cruz Foundation in Brasília. He has experience in public health, with an emphasis on research projects, scientific investigations, data analysis, business intelligence (BI), and social network analysis (SNA), as well as the development and application of qualitative and quantitative research methodologies. He also works in information science, focusing on scientific journal publishing, including editorial management on electronic platforms, digital curation of scientific data, and technical review of content, in addition to the application of interoperability standards for scientific information.

Gabriel Teles, Universidade de Brasília

Postdoctoral fellow in Sociology from PPGSOL/UnB, PhD in Sociology from PPGS/USP, Master in Sociology from PPGS/UFG, and Bachelor's degree in Social Sciences/UFG. He was a substitute professor at UFRN, UEMA, and IFGO. He is the executive editor of the journal Cadernos Ibero-Americanos de Direito Sanitário (CIADS), affiliated with FioCruz. He is a member of the executive secretariat of Revista Plural (USP). He is a researcher at the Research and Study Group on Theories of Authoritarianism (USP), the Research Group on the World of Work and Social Theory (UnB), the Research Group on Dialectics and Society (UFG), and the Center for Studies and Research on Social Movements (UFG). He has experience in Sociology, working primarily on the following topics: sociology of intellectuals, historical materialism, digital sociology, social movements, and sociology of work.

References

BEECHER, Kate; WANG, Joshua. Peer reviewer fatigue, or peer reviewer refusal? Accountability in Research, [s. l.], v. 32, n. 5, p. 838-844, 2025. Disponível em: https://doi.org/10.1080/08989621.2025.2463977. Acesso em: 3 jul. 2025. DOI: https://doi.org/10.1080/08989621.2025.2463977

CLARIVATE. Web of Science core collection: journal evaluation process and selection criteria. [S. l.]: Clarivate Analytics, 2023. Disponível em: https://www.hec.gov.pk/english/services/faculty/journals/Documents/WoS.pdf. Acesso em: 4 nov. 2025.

COPE Council. Guidelines: ethical guidelines for peer reviewers. Eastleigh, UK: Committee on Publication Ethics, 2017. Disponível em: https://publicationethics.org/guidance/guideline/ethical-guidelines-peer-reviewers. Acesso em: 5 jul. 2025.

DELDUQUE, Maria Célia; ALVES, Sandra Mara Campos. Por que publicar nos Cadernos Ibero-Americanos de Direito Sanitário? Cadernos Ibero-Americanos de Direito Sanitário, Brasília, v. 10, p. 7–10, dez. 2021.Supl. 1. Disponível em: https://doi.org/10.17566/ciads.v10iSuplemento.864. Acesso em: 3 maio 2025. DOI: https://doi.org/10.17566/ciads.v10iSuplemento.864

ELSEVIER. Scopus content coverage guide. [S. l.]: Elsevier, 2023. Disponível em: https://assets.ctfassets.net/o78em1y1w4i4/EX1iy8VxBeQKf8aN2XzOp/c36f79db25484cb38a5972ad9a5472ec/Scopus_ContentCoverage_Guide_WEB.pdf. Acesso em: 4 nov. 2025.

FARIAS, Maria Giovanna Guedes; SANTOS, Gildenir Carolino. Avaliações de produções científicas: desafios e motivações de editores e avaliadores. Encontros Bibli: revista eletrônica de biblioteconomia e ciência da informação, Florianópolis, v. 28, e92858, 2023. Disponível em: https://doi.org/10.5007/1518-2924.2023.e92858. Acesso em: 1 jul. 2025. DOI: https://doi.org/10.5007/1518-2924.2023.e92858

GASPARYAN, Armen Yuri; YESSIRKEPOV, Marlen; DIYANOVA, Svetlana N.; KITAS, George D. Publishing ethics and predatory practices: a dilemma for all stakeholders of science communication. Journal of Korean Medical Science, [s. l.], v. 30, n. 8, p. 1010–1016, aug. 2015. Disponível em: https://doi.org/10.3346/jkms.2015.30.8.1010. Acesso em: 2 jun. 2025. DOI: https://doi.org/10.3346/jkms.2015.30.8.1010

GONÇALVES, Andréa; ALVES, Larissa de Araújo; ALBAGLI, Sarita. Implicações da internacionalização sobre as práticas editoriais de periódicos das ciências humanas no Brasil e na Argentina. Encontros Bibli: revista eletrônica de biblioteconomia e ciência da informação, Florianópolis, v. 30, e103453, 2025. Disponível em: https://doi.org/10.5007/1518-2924.2025.e103453. Acesso em: 11 nov. 2025. DOI: https://doi.org/10.5007/1518-2924.2025.e103453

HORTA, Hugo; JUNG, Jisun. The crisis of peer review: part of the evolution of science. Higher Education Quarterly, [s. l.], v. 78, n. 4, e12511, oct. 2024. Disponível em: https://doi.org/10.1111/hequ.12511. Acesso em: 28 maio 2025. DOI: https://doi.org/10.1111/hequ.12511

MARCHIORI, Patrícia Zeni; BETTONI, Eduardo Michelotti; CARVALHO, Marcelo Batista; APPEL, Andre Luiz. Geração de indicadores para periódicos científicos abertos. Transinformação, Campinas, v. 30, n. 3, p. 324–335, set./dez. 2018. Disponível em: https://doi.org/10.1590/2318-08892018000300005. Acesso em: 24 maio 2025. DOI: https://doi.org/10.1590/2318-08892018000300005

PEDRI, Patrícia; ARAÚJO, Ronaldo Ferreira. Vantagens e desvantagens da revisão por pares aberta: consensos e dissensos na literatura. Encontros Bibli: revista eletrônica de biblioteconomia e ciência da informação, Florianópolis, v. 26, n. esp., p. 1–18, 2021. Disponível em: https://doi.org/10.5007/1518-2924.2021.78583. Acesso em: 30 out. 2025. DOI: https://doi.org/10.5007/1518-2924.2021.78583

PUBLONS. Global state of peer review 2018. [Wellington, NZ]: Clarivate Analytics, 2018. Disponível em: https://publons.com/static/Publons-Global-State-Of-Peer-Review-2018.pdf. Acesso em: 7 nov. 2025.

ROSS-HELLAUER, Tony. What is open peer review? A systematic review. F1000Research, [s. l.], v. 6, n. 588, 2017. Disponível em: https://doi.org/10.12688/f1000research.11369.2. Acesso em: 30 out. 2025. DOI: https://doi.org/10.12688/f1000research.11369.2

SCIELO. Critérios, política e procedimentos para a admissão e a permanência de periódicos na Coleção SciELO Brasil. São Paulo: SciELO, set. 2024. Disponível em: https://www.scielo.br/media/files/20240900-Criterios-SciELO-Brasil.pdf. Acesso em: 4 nov. 2025.

SPUDEIT, Daniela; WERLANG, Elisabete; PRESSER, Nadi Helena. Indicadores de gestão do fluxo editorial dos periódicos científicos: uma reflexão teórico-metodológica. Encontros Bibli: revista eletrônica de biblioteconomia e ciência da informação, Florianópolis, v. 17, n. esp. 2, p. 102–117, 2012. Disponível em: https://doi.org/10.5007/1518-2924.2012v17nesp2p102. Acesso em: 20 maio 2025. DOI: https://doi.org/10.5007/1518-2924.2012v17nesp2p102

TENNANT, Jonathan P.; DUGAN, Jonathan M.; GRAZIOTIN, Daniel; JACQUES, Damien C.; WALDNER, François; MIETCHEN, Daniel; ELKHATIB, Yehia; COLLISTIER, Lauren B.; PIKAS, Christina K.; CRICK, Tom; MASUZZO, Paola; CARAVAGGI, Anthony; BERG, Devin R.; NIEMEYER, Kyle E.; ROSS-HELLAUER, Tony; MANNHEIMER, Sara; RIGLING, Lillian; KATZ, Daniel S.; TZOVARAS, Bastian Greshake; PACHECO-MENDOZA, Josmel; FATIMA, Nazeefa; POBLET, Marta; ISAAKIDIS, Marios; IRAWAN, Dasapta Erwin; RENAUT, Sébastien; MADAN, Christopher R.; MATTHIAS, Lisa; NØRGAARD KJÆR, Jesper; O’DONNELL, Daniel Paul; NEYLON, Cameron; KEARNS, Sarah; SELVARAJU, Manojkumar; COLOMB, Julien. A multi-disciplinary perspective on emergent and future innovations in peer review. F1000Research, [s. l.], v. 6, n. 1151, 2017. Disponível em: https://doi.org/10.12688/f1000research.12037.2. Acesso em: 30 out. 2025. DOI: https://doi.org/10.12688/f1000research.12037.1

TRZESNIAK, Piotr. Indicadores quantitativos: como obter, avaliar, criticar e aperfeiçoar. Navus: revista de gestão e tecnologia, Florianópolis, v. 4, n. 2, p. 5–18, jul./dez. 2014. Disponível em: https://doi.org/10.22279/navus.2014.v4n2.p5-18.223. Acesso em: 23 maio 2025. DOI: https://doi.org/10.22279/navus.2014.v4n2.p5-18.223

TURBAN, Efraim; SHARDA, Ramesh; DELEN, Dursun; KING, David. Business Intelligence: a managerial approach. 2. ed. Boston: Prentice Hall, 2011.

VANZ, Samile Andréa de Souza; SILVEIRA, Lúcia da. Publicação continuada: algumas reflexões. Em Questão, Porto Alegre, v. 26, n. 1, p. 12-16, jan./abr. 2020. Disponível em: https://seer.ufrgs.br/index.php/EmQuestao/article/view/98781/55109. Acesso em: 22 maio 2025. DOI: https://doi.org/10.19132/1808-5245261.12-16

VECHI, Bernardo Dionízio; SHINTAKU, Milton. Publicação contínua em periódicos científicos: convite à reflexão editorial. Brasília, DF: Editora IBICT, 2025. E-book. Disponível em: https://labcotec.ibict.br/omp/index.php/edcotec/catalog/book/396. Acesso em: 22 maio 2025.

Published

2026-04-30

How to Cite

ROCHA, Danilo Silva Santos; TELES, Gabriel. Data-driven editorial management: an indicator model applied to peer review. Encontros Bibli: electronic journal of library science, archival science and information science, Florianópolis/SC, Brasil, v. 31, p. 1–25, 2026. DOI: 10.5007/1518-2924.2026.e107950. Disponível em: https://periodicos.ufsc.br/index.php/eb/article/view/107950. Acesso em: 17 jun. 2026.