Altmetric data aggregators: analyzing altmetric.com and webometric analyst

Authors

DOI:

https://doi.org/10.5007/1518-2924.2021.78797

Keywords:

Altmetric, Altmetric data aggregators, Altmetric.com API, Webometric Analyst

Abstract

Objective: reports the experience of using altmetric data aggregators Altmetric.com and Webometric Analyst, in a study on the presence of articles from Brazilian scientific journals on Information Science on social media platforms.

Methods: the study was characterized as descriptive, of qualitative and quantitative nature, which analyzed the aggregators Altmetric.com and Webometric Analyst. The corpus used to test them consisted of 13 Brazilian journals in Information Science, encompassing 2,724 scientific articles published in the period from 2011 to 2018.

Result: from the use of the two aggregators to collect altmetric data about articles from Brazilian journals in Information Science, it was primarily verified that different methodologies and tools generate different results, with discrepancies and specific similarities. It was also noticed that the DOI numbers of some articles were incorrect, that is, the link of these DOIs pointed to an error page in CrossRef, assuming that was the reason for the small number of positive results in the Altmetric.com via API. Although the Webometric Analyst has shown greater coverage of altmetric data for articles from Brazilian journals in Information Science, possibly due to the search strategy used, in this case author, title and year, some inconsistencies were noticed in Mendeley, such as an article with different versions or with different publication dates, showing divergent counts of readers for the same article.

Conclusions: it is considered that the tools used for generating altmetric data should be understood as facilitators of data collection on social media platforms, however one must be aware of the scope and limitations of each of these tools, as well as of the collection chosen for testing and capture. As the nature of the platforms is uneven, they can be employed as to complement one another.

Downloads

Download data is not yet available.

Author Biographies

Vildeane da Rocha Borba, Universidade Federal de Pernambuco

Professora do Departamento de Ciência da Informação da Universidade Federal de Pernambuco (DCI/UFPE) e pesquisadora do Laboratório de Tecnologia do Conhecimento (LIBER/UFPE). Doutora em Comunicação e Informação pela Universidade Federal do Rio Grande do Sul (2019), Mestre em Ciência da Informação pela Universidade Federal da Paraíba (2009), Graduada em Biblioteconomia pela Universidade Federal de Pernambuco (2006). 

Sônia Elisa Caregnato, Universidade Federal do Rio Grande do Sul, Faculdade de Biblioteconomia e Comunicação, Porto Alegre, Brasil

Professora Associada do Programa de Pós-Graduação em Comunicação e Informação.

Universidade Federal do Rio Grande do Sul, Faculdade de Biblioteconomia e Comunicação, Porto Alegre, Brasil.

References

ADIE, E.; ROE; W. Altmetric: enriching scholarly content with article-level discussion and metrics. Learned Publishing, Bristol, v. 26, n. 1, p. 11-17, 2013.

ARAÚJO, R. F. Mídias sociais e comunicação científica: análise altmétrica em artigos de periódicos da ciência da informação. Em Questão, Porto Alegre, v. 21, n. 1, p. 96-109, jan./abr. 2015.

BAR-ILAN, J.; HALEVI, G.; MILOJEVIĆ, S. Differences between Altmetric Data Sources - A Case Study. Journal of Altmetrics, United Kingdom, v. 2, n. 1, p. 1-8, 2019.

BARTLING, S.; FRIESIKE, S. Towards Another Scientific Revolution. In: BATLING, S.; FRIESIKE, S. (ed.). Opening Science: the evolving guide on how the Internet is Changing Research, Collaboration and Scholarly Publishing. Heidelberg: Springer Open, 2014. p. 3-15.

CABRERA, D.; ROY, D; CHISOLM, M. S. Social Media Scholarship and Alternative Metrics for Academic Promotion and Tenure. American College of Radiology, Reston, v. 15, n. 1, p. 135-141, jan. 2018.

DIGITAL SCIENCE. Altmetric: Who’s talking about your research? Altmetric, [s. l.], c2018. Disponível em: https://www.altmetric.com. Acesso em: 10 jun. 2021.

ERDT, M. et al. Altmetrics: an analysis of the state-of-the-art in measuring research impact on social media. Scientometrics, New York, v. 109, n. 2, p. 1117-1166, 2016.

HAUSTEIN, S.; BOWMAN, T. D.; COSTAS, R. Interpreting ‘altmetrics’: Viewing acts on social media through the lens of citation and social theories. In: SUGIMOTO, C. R. (ed.). Theories of Informetrics and scholarly communication. Frankfurt: De Gruyter, 2016. p. 372-406.

KARMAKAR, M.; BANSHAL, S. K.; SINGH, V. K. A large‐scale comparison of coverage and mentions captured by the two altmetric aggregators: Altmetric.com and PlumX. Scientometric, New York, v. 126, p. 4465-4489, 2021.

MANHIQUE, I. L. E. et al. Indicadores altmétricos em periódicos brasileiros da Ciência da Informação no Brasil. Revista Ibero-Americana de Ciência da Informação, Brasília, DF, v. 12, n. 2, p. 515-532, maio/ago. 2019.

MESCHEDE, C.; SIEBENLIST, T. Cross-metric compatibility and inconsistencies of altmetrics. Scientometrics, New York, v. 115, n. 1, p. 283-297, 2018.

MUKHERJEE, B.; SUBOTIC, S.; CHAUBEY, A. K. And now for something completely different: the congruence of the Altmetric Attention Score’s structure between different article groups. Scientometrics, New York, v. 114, n. 1, p. 253-275, 2018.

NASCIMENTO, A. G.; ODDONE, N. E. Uso de altmetrics para avaliação de periódicos científicos brasileiros em Ciência da Informação. Ciência da Informação em Revista, Maceió, v. 2, n. 1, p. 3-12, jan./abr. 2015.

NASCIMENTO, A. G. do; ODDONE, N. E. Uso de indicadores altmetrics na avaliação de periódicos científicos brasileiros em Ciência da Informação. In: ENCONTRO BRASILEIRO DE BIBLIOMETRIA E CIENTOMETRIA, 4., 2014, Recife. Anais [...]. Recife: UFPE, 2014. p. 1-2.

NATIONAL INFORMATION STANDARDS ORGANIZATION. NISO RP-25-2016: Outputs of the NISO Alternative Assessment Metrics Project. Baltimore: NISO, 2016. Disponível em: https://www.niso.org/publications/rp-25-2016-altmetrics. Acesso em: 10 jun. 2020.

ORTEGA, J.-L. Altmetrics data providers: A meta-analysis review of the coverage of metrics and publications. El profesional de la información, León, v. 29, n. 1, p. 1-23, 2020.

ORTEGA, J.-L. Reliability and accuracy of altmetric providers: a comparison among Altmetric.com, PlumX and Crossref Event Data. Scientometrics, New York, v. 116, p. 2123-2138, 2018.

PRIEM, J. et al. Altmetrics: A manifesto. Altmetrics, [s. l.], 2010. Disponível em: http://altmetrics.org/manifesto. Acesso em: 30 jul. 2017.

SANKAR, P.; KAVITHA, E. S. Altmetrics: new research tool in the growth social media. E-Journal of Library and Information Science, Madison, v. 3, n. 1, p. 80-91, Feb. 2016.

STATISTICAL CYBERMETRICS RESEARCH GROUP. Webometric Analyst. [2019]. Disponível em: http://lexiurl.wlv.ac.uk/index.html. Acesso em: 10 jun. 2020.

SUGIMOTO, C. R. et al. Scholarly use of social media and altmetrics: a review of the literature. Journal of the Association for Information Science and Technology, New York, v. 68, n. 9, p. 2037-2062, 2017.

THELWALL, M. Introduction to Webometrics: quantitative Web Research for the Social Sciences. San Rafael: Morgan & Claypool, 2009.

ZAHEDI, Z.; COSTAS, R. General discussion of data quality challenges in social media metrics: Extensive comparison of four major altmetric data aggregators. Plos One, São Francisco, v. 13, n. 5, May 2018.

ZAHEDI, Z.; FENNER, M.; COSTAS, R. Consistency among altmetrics data provider/aggregators: What are the challenges? In: ALTMETRICS WORKSHOP, 9., 2015, Amsterdam. Proceedings […]. Amsterdam: Amsterdam Science Park, 2015. Disponível em: https://scholarlypublications.universiteitleiden.nl/handle/1887/48265. Acesso em: 10 jun. 2021.

Published

2021-10-08

How to Cite

BORBA, Vildeane da Rocha; CAREGNATO, Sônia Elisa. Altmetric data aggregators: analyzing altmetric.com and webometric analyst. Encontros Bibli: revista eletrônica de biblioteconomia e ciência da informação, [S. l.], v. 26, n. Especial, p. 1–19, 2021. DOI: 10.5007/1518-2924.2021.78797. Disponível em: https://periodicos.ufsc.br/index.php/eb/article/view/78797. Acesso em: 17 may. 2024.

Similar Articles

<< < 1 2 3 4 5 6 7 8 9 10 > >> 

You may also start an advanced similarity search for this article.

Most read articles by the same author(s)