May 17, 2022

Video: “Perpetual Access Machines: Archiving Web-Published Scholarship at Scale” (A FORCE2019 Conference Presentation)

The video embedded below was recorded at the FORCE2019 conference in Edinburgh, Scotland on October 16, 2019. Presentation slides are also available and linked below.


Perpetual Access Machines: Archiving Web-Published Scholarship at Scale


Jefferson Bailey
Director, Web Archiving & Data Services, Internet Archive

Bryan Newbold
Open Data Engineer, Web Archiving & Data Services, Internet Archive

Slides from the presentation are also available.

From the Conference Website

In 2018, the Internet Archive undertook a large-scale project to build as complete a collection as possible of scholarly outputs published on the web, as well as to improve the discoverability and accessibility of scholarly works archived as part of these global web harvests. This project involved a number of areas of work: targeted archiving of known OA publications (especially at-risk “long tail” publications); extraction and augmentation of bibliographic metadata and full text; integration and preservation of related identifier, registry, and aggregation services and datastores; partnerships with affiliated initiatives and joint service developments; and creation of new tools and machine learning approaches for identifying archived scholarly work in existing born-digital and web collections. The project also identified and archived associated research outputs such as blogs, datasets, code repositories and other secondary research objects. The beta API and public interface – code-named “fatcat” – can be found at

Project leads will talk about the project’s current status and upcoming work, focusing on content acquisition, indexing, discoverability, the role of machine learning, service provisioning, and their collaborative work with libraries, publishers, and non-profits. Conceptually, the project demonstrates that the scalability and technologies of “archiving the web” can facilitate automated ingest, enrichment, and dissemination strategies for a variety of web-published primary and secondary scholarly record types that have traditionally been collected via more custom and manual workflows. The project strategic goal is to provide open infrastructure for the perpetual discoverability of and access to archived scholarship.

See Also: Video Playlist: All FORCE2019 Presentations

See Also: 2019 FORCE2019 Presentation Slides

See Also: FORCE2019 Conference Program

About Gary Price

Gary Price ( is a librarian, writer, consultant, and frequent conference speaker based in the Washington D.C. metro area. Before launching INFOdocket, Price and Shirl Kennedy were the founders and senior editors at ResourceShelf and DocuTicker for 10 years. From 2006-2009 he was Director of Online Information Services at, and is currently a contributing editor at Search Engine Land.