New Working Paper: A Meta-Analysis of Research Into Three Altmetrics (Twitter, Reference Managers, and Blogs)
Here’s a new working paper that will likely be of interest to many of you. It was posted to arXiv yesterday.
Dr. Lutz Bornmann
Division for Science and Innovation Studies, Max Planck Society
Posted July 30, 2014
Alternative metrics are currently one of the most popular research topics in scientometric research.
This paper provides an overview of research into three of the most important altmetrics: microblogging (Twitter), online reference managers (Mendeley and CiteULike) and blogging.
The literature is discussed in relation to the possible use of altmetrics in research evaluation.
Since the research was particularly interested in the correlation between altmetrics counts and citation counts, this overview focuses particularly on this correlation.
For each altmetric, a meta-analysis is calculated for its correlation with traditional citation counts. As the results of the meta-analyses show, the correlation with traditional citations for micro-blogging counts is negligible (pooled r=0.003), for blog counts it is small (pooled r=0.12) and for bookmark counts from online reference managers, medium to large (CiteULike pooled r=0.23; Mendeley pooled r=0.51). Since the added value of an alternative metric, as an additional metric compared with traditional citation counts, is greater the less it correlates with traditional citation counts, the greatest added value – according to the meta-analysis – is associated with Twitter citations.
About Gary Price
Gary Price (firstname.lastname@example.org) is a librarian, writer, consultant, and frequent conference speaker based in the Washington D.C. metro area. He earned his MLIS degree from Wayne State University in Detroit. Price has won several awards including the SLA Innovations in Technology Award and Alumnus of the Year from the Wayne St. University Library and Information Science Program. From 2006-2009 he was Director of Online Information Services at Ask.com. Gary is also the co-founder of infoDJ an innovation research consultancy supporting corporate product and business model teams with just-in-time fact and insight finding.