May 16, 2022

Research Preprint: “To ArXiv or Not to ArXiv: A Study Quantifying Pros and Cons of Posting Preprints Online”

The following article (preprint) was recently shared on arXiv.


To ArXiv or Not to ArXiv: A Study Quantifying Pros and Cons of Posting Preprints Online


Charvi Rastogi
Carnegie Mellon University

Ivan Stelmakh
Carnegie Mellon University

Xinwei Shen
Hong Kong University of Science and Technology

Marina Meila
University of Washington

Federico Echenique
California Institute of Technology

Shuchi Chawla
University of Texas at Austin

Nihar B. Shah
Carnegie Mellon University


via arXiv
March 31, 2022


Double-blind conferences have engaged in debates over whether to allow authors to post their papers online on arXiv or elsewhere during the review process. Independently, some authors of research papers face the dilemma of whether to put their papers on arXiv due to its pros and cons. We conduct a study to substantiate this debate and dilemma via quantitative measurements. Specifically, we conducted surveys of reviewers in two top-tier double-blind computer science conferences — ICML 2021 (5361 submissions and 4699 reviewers) and EC 2021 (498 submissions and 190 reviewers). Our two main findings are as follows. First, more than a third of the reviewers self-report searching online for a paper they are assigned to review. Second, outside the review process, we find that preprints from better-ranked affiliations see a weakly higher visibility, with a correlation of 0.06 in ICML and 0.05 in EC. In particular, papers associated with the top-10-ranked affiliations had a visibility of approximately 11% in ICML and 22% in EC, whereas the remaining papers had a visibility of 7% and 18% respectively.

Direct to Access Article

About Gary Price

Gary Price ( is a librarian, writer, consultant, and frequent conference speaker based in the Washington D.C. metro area. Before launching INFOdocket, Price and Shirl Kennedy were the founders and senior editors at ResourceShelf and DocuTicker for 10 years. From 2006-2009 he was Director of Online Information Services at, and is currently a contributing editor at Search Engine Land.