Altmetric data aggregators: analyzing altmetric.com and webometric analyst
DOI:
https://doi.org/10.5007/1518-2924.2021.78797Keywords:
Altmetric, Altmetric data aggregators, Altmetric.com API, Webometric AnalystAbstract
Objective: reports the experience of using altmetric data aggregators Altmetric.com and Webometric Analyst, in a study on the presence of articles from Brazilian scientific journals on Information Science on social media platforms.
Methods: the study was characterized as descriptive, of qualitative and quantitative nature, which analyzed the aggregators Altmetric.com and Webometric Analyst. The corpus used to test them consisted of 13 Brazilian journals in Information Science, encompassing 2,724 scientific articles published in the period from 2011 to 2018.
Result: from the use of the two aggregators to collect altmetric data about articles from Brazilian journals in Information Science, it was primarily verified that different methodologies and tools generate different results, with discrepancies and specific similarities. It was also noticed that the DOI numbers of some articles were incorrect, that is, the link of these DOIs pointed to an error page in CrossRef, assuming that was the reason for the small number of positive results in the Altmetric.com via API. Although the Webometric Analyst has shown greater coverage of altmetric data for articles from Brazilian journals in Information Science, possibly due to the search strategy used, in this case author, title and year, some inconsistencies were noticed in Mendeley, such as an article with different versions or with different publication dates, showing divergent counts of readers for the same article.
Conclusions: it is considered that the tools used for generating altmetric data should be understood as facilitators of data collection on social media platforms, however one must be aware of the scope and limitations of each of these tools, as well as of the collection chosen for testing and capture. As the nature of the platforms is uneven, they can be employed as to complement one another.
Downloads
References
ADIE, E.; ROE; W. Altmetric: enriching scholarly content with article-level discussion and metrics. Learned Publishing, Bristol, v. 26, n. 1, p. 11-17, 2013.
ARAÚJO, R. F. Mídias sociais e comunicação científica: análise altmétrica em artigos de periódicos da ciência da informação. Em Questão, Porto Alegre, v. 21, n. 1, p. 96-109, jan./abr. 2015.
BAR-ILAN, J.; HALEVI, G.; MILOJEVIĆ, S. Differences between Altmetric Data Sources - A Case Study. Journal of Altmetrics, United Kingdom, v. 2, n. 1, p. 1-8, 2019.
BARTLING, S.; FRIESIKE, S. Towards Another Scientific Revolution. In: BATLING, S.; FRIESIKE, S. (ed.). Opening Science: the evolving guide on how the Internet is Changing Research, Collaboration and Scholarly Publishing. Heidelberg: Springer Open, 2014. p. 3-15.
CABRERA, D.; ROY, D; CHISOLM, M. S. Social Media Scholarship and Alternative Metrics for Academic Promotion and Tenure. American College of Radiology, Reston, v. 15, n. 1, p. 135-141, jan. 2018.
DIGITAL SCIENCE. Altmetric: Who’s talking about your research? Altmetric, [s. l.], c2018. Disponível em: https://www.altmetric.com. Acesso em: 10 jun. 2021.
ERDT, M. et al. Altmetrics: an analysis of the state-of-the-art in measuring research impact on social media. Scientometrics, New York, v. 109, n. 2, p. 1117-1166, 2016.
HAUSTEIN, S.; BOWMAN, T. D.; COSTAS, R. Interpreting ‘altmetrics’: Viewing acts on social media through the lens of citation and social theories. In: SUGIMOTO, C. R. (ed.). Theories of Informetrics and scholarly communication. Frankfurt: De Gruyter, 2016. p. 372-406.
KARMAKAR, M.; BANSHAL, S. K.; SINGH, V. K. A large‐scale comparison of coverage and mentions captured by the two altmetric aggregators: Altmetric.com and PlumX. Scientometric, New York, v. 126, p. 4465-4489, 2021.
MANHIQUE, I. L. E. et al. Indicadores altmétricos em periódicos brasileiros da Ciência da Informação no Brasil. Revista Ibero-Americana de Ciência da Informação, Brasília, DF, v. 12, n. 2, p. 515-532, maio/ago. 2019.
MESCHEDE, C.; SIEBENLIST, T. Cross-metric compatibility and inconsistencies of altmetrics. Scientometrics, New York, v. 115, n. 1, p. 283-297, 2018.
MUKHERJEE, B.; SUBOTIC, S.; CHAUBEY, A. K. And now for something completely different: the congruence of the Altmetric Attention Score’s structure between different article groups. Scientometrics, New York, v. 114, n. 1, p. 253-275, 2018.
NASCIMENTO, A. G.; ODDONE, N. E. Uso de altmetrics para avaliação de periódicos científicos brasileiros em Ciência da Informação. Ciência da Informação em Revista, Maceió, v. 2, n. 1, p. 3-12, jan./abr. 2015.
NASCIMENTO, A. G. do; ODDONE, N. E. Uso de indicadores altmetrics na avaliação de periódicos científicos brasileiros em Ciência da Informação. In: ENCONTRO BRASILEIRO DE BIBLIOMETRIA E CIENTOMETRIA, 4., 2014, Recife. Anais [...]. Recife: UFPE, 2014. p. 1-2.
NATIONAL INFORMATION STANDARDS ORGANIZATION. NISO RP-25-2016: Outputs of the NISO Alternative Assessment Metrics Project. Baltimore: NISO, 2016. Disponível em: https://www.niso.org/publications/rp-25-2016-altmetrics. Acesso em: 10 jun. 2020.
ORTEGA, J.-L. Altmetrics data providers: A meta-analysis review of the coverage of metrics and publications. El profesional de la información, León, v. 29, n. 1, p. 1-23, 2020.
ORTEGA, J.-L. Reliability and accuracy of altmetric providers: a comparison among Altmetric.com, PlumX and Crossref Event Data. Scientometrics, New York, v. 116, p. 2123-2138, 2018.
PRIEM, J. et al. Altmetrics: A manifesto. Altmetrics, [s. l.], 2010. Disponível em: http://altmetrics.org/manifesto. Acesso em: 30 jul. 2017.
SANKAR, P.; KAVITHA, E. S. Altmetrics: new research tool in the growth social media. E-Journal of Library and Information Science, Madison, v. 3, n. 1, p. 80-91, Feb. 2016.
STATISTICAL CYBERMETRICS RESEARCH GROUP. Webometric Analyst. [2019]. Disponível em: http://lexiurl.wlv.ac.uk/index.html. Acesso em: 10 jun. 2020.
SUGIMOTO, C. R. et al. Scholarly use of social media and altmetrics: a review of the literature. Journal of the Association for Information Science and Technology, New York, v. 68, n. 9, p. 2037-2062, 2017.
THELWALL, M. Introduction to Webometrics: quantitative Web Research for the Social Sciences. San Rafael: Morgan & Claypool, 2009.
ZAHEDI, Z.; COSTAS, R. General discussion of data quality challenges in social media metrics: Extensive comparison of four major altmetric data aggregators. Plos One, São Francisco, v. 13, n. 5, May 2018.
ZAHEDI, Z.; FENNER, M.; COSTAS, R. Consistency among altmetrics data provider/aggregators: What are the challenges? In: ALTMETRICS WORKSHOP, 9., 2015, Amsterdam. Proceedings […]. Amsterdam: Amsterdam Science Park, 2015. Disponível em: https://scholarlypublications.universiteitleiden.nl/handle/1887/48265. Acesso em: 10 jun. 2021.
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Vildeane da Rocha Borba, Sônia Elisa Caregnato
This work is licensed under a Creative Commons Attribution 4.0 International License.
The author must guarantee that:
- there is full consensus among all the coauthors in approving the final version of the document and its submission for publication.
- the work is original, and when the work and/or words from other people were used, they were properly acknowledged.
Plagiarism in all of its forms constitutes an unethical publication behavior and is unacceptable. Encontros Bibli has the right to use software or any other method of plagiarism detection.
All manuscripts submitted to Encontros Bibli go through plagiarism and self-plagiarism identification. Plagiarism identified during the evaluation process will result in the filing of the submission. In case plagiarism is identified in a manuscript published in the journal, the Editor-in-Chief will conduct a preliminary investigation and, if necessary, will make a retraction.
This journal, following the recommendations of the Open Source movement, provides full open access to its content. By doing this, the authors keep all of their rights allowing Encontros Bibli to publish and make its articles available to the whole community.
Encontros Bibli content is licensed under a Creative Commons Attribution 4.0 International License.
Any user has the right to:
- Share - copy, download, print or redistribute the material in any medium or format.
- Adapt - remix, transform and build upon the material for any purpose, even commercially.
According to the following terms:
- Attribution - You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions - You may not apply legal terms or technological measures that legally restrict others from doing anything that the license permits.