Aliakbar Akbaritabar Max Planck Institute for Demographic Research
Dimity Stephen German Centre for Higher Education Research and Science Studies
Source
via arXiv
DOI
Abstract
This paper provides insight into the changes manuscripts undergo during peer review, the potential reasons for these changes, and the differences between scientific fields. A growing body of literature is assessing the effect of peer review on manuscripts, however much of this research currently focuses on the social and medical sciences. We matched more than 6,000 preprint-publication pairs across multiple fields and quantified the changes in their reference lists.
We also quantified the change in references per full-text section for 565 pairs from PLOS journals. In addition, we conducted manual checks of a randomly chosen sample of 98 pairs to validate our results, and undertook a qualitative analysis based on the context of the reference to investigate the potential reasons for reference changes.
We found 10 disciplines, mostly in the natural sciences with high levels of removed references. Methods sections undergo the most relative change in the natural sciences, while in the medical and health sciences, the results and discussion sections underwent the most changes. Our qualitative analysis identified issues with our results due to incomplete preprint reference lists.
In addition, we deduced 10 themes for changing references during peer review. This analysis suggested that manuscripts in the natural and medical sciences undergo more extensive reframing of the literature used to situate and interpret the results of studies than the social and agricultural sciences, which are further embedded in the existing literature through peer review. Peer review in engineering tends to focus on methodological details. Our results are useful to the body of literature examining the effectiveness of peer review in fulfilling its intended purposes.
Gary Price (gprice@gmail.com) is a librarian, writer, consultant, and frequent conference speaker based in the Washington D.C. metro area.
He earned his MLIS degree from Wayne State University in Detroit.
Price has won several awards including the SLA Innovations in Technology Award and Alumnus of the Year from the Wayne St. University Library and Information Science Program. From 2006-2009 he was Director of Online Information Services at Ask.com. Gary is also the co-founder of infoDJ an innovation research consultancy supporting corporate product and business model teams with just-in-time fact and insight finding.
From SPN (via Email): The Software Preservation Network is proud to announce that the 2nd Edition of our Preservationist’s Guide to the DMCA Exemption for Software Preservation has been published! Prepared for ...
From a Library of Congress Blog Post by Eileen J. Manchester: LC Labs is pleased to announce the release of three new sets of digitized materials packaged as data. Located ...
Apple Introduces Apple Music Sing CJR: Archiving Official Documents as an Act of Radical Journalism (via Columbia Journalism Review (via Columbia Journalism Review) Event Report: First Workshop on Global Equity ...
From the City of New York Office of Technology and Innovation: The NYC Office of Technology and Innovation, NYC’s three library systems, and Metropolitan New York Library Council today announced ...
The article linked below was recently published by SAGE Open. Title A Landscape of Open Science Policies Research Author Alejandra Manco Claude Bernard University, France Source SAGE Open, 12(4) DOI: 10.1177/21582440221140358 ...
Building Digital Research Tools for Open Access to Canada’s Historical Topographic Maps and Data (via University of Toronto Libraries) Newark Black Newspapers Collection Now Available Online (via Rutgers University Libraries)
The journal article linked below was recently published by the Journal of Librarianship and Scholarly Communication. Title Free and Open-Source Automated Open Access Preprint Harvesting Authors Jack E. Peplinski Western ...
From a Creative Commons Blog Post: Exciting news — an initiative of the MHz Foundation, Curationist.org, a free-to-use platform that connects users to over 4.4 million digital artworks and cultural objects, ...
From The Guardian: The morning that Russian bombs started falling on Kyiv, Oksana Bruy woke up worried about her laptop. Bruy is president of the Ukrainian Library Association and, the ...
Mapping Social Media Archiving Initiatives: State of the Art, Trends, and Future Perspective (via IIPC: International Internet Preservation Consortium) Stanford Libraries: Born-digital Collections Opened for Research in 2022 The 2022 ...
From the Associated Press: A roundup of some of the most popular but completely untrue stories and visuals of the week. None of these are legit, even though they were ...
