January 19, 2022

New Article: “Helping Journals to Improve their Publishing Standards: A Data Analysis Of DOAJ New Criteria Effects”


Helping Journals to Improve their Publishing Standards: A Data Analysis Of DOAJ New Criteria Effects


Andrea Marchitelli

Paola Galimberti
University of Milan

Andrea Bollini

Dominic Mitchell
Directory of Open Access Journals (DOAJ)


JLIS.it (Italian Journal of Library, Archives and Information Science
Vol. 8, No. 1 (2017)


In 2013, Directory of Open Access Journals (DOAJ) expanded and updated its inclusion criteria and its journal evaluation process, ultimately removing a large number of journals that failed to submit an updated application. The present study examined the results of the new process and its capability to improve the quality of the directory and the reliability of the information contained in it. A dataset of 12.595 journals included in DOAJ, since its launch in 2003 until May 15th 2016, was examined and compared to other data. The number of journals deleted from DOAJ during this period is 3776; the majority of them (2851 journals) were excluded because publishers failed to complete the reapplication on time; 490 had ceased publication or were otherwise inactive; 375 were excluded for ethical issues; 53 because they were no longer open access or the content was embargoed, the final 7 were removed for other reasons. The top five countries in terms of the percentage of journals removed are: Japan (74% of journals removed); Pakistan (60%); Canada (51%); United States (50%); and Mexico (49%). Our study has shown that 158 of the removed journals are included in Beall’s lists; 1130 journals indexed in DOAJ are included in Scopus and/or JCR. Our analysis demonstrates that, thanks to the new acceptance criteria, to the improved screening process performed by national groups under the direction of the new management, there is a noticeable quality improvement of the journals indexed in DOAJ.

Direct to Full Text Article (21 pages; PDF)

Direct to Supplementary Data

About Gary Price

Gary Price (gprice@mediasourceinc.com) is a librarian, writer, consultant, and frequent conference speaker based in the Washington D.C. metro area. Before launching INFOdocket, Price and Shirl Kennedy were the founders and senior editors at ResourceShelf and DocuTicker for 10 years. From 2006-2009 he was Director of Online Information Services at Ask.com, and is currently a contributing editor at Search Engine Land.