Authors Alliance: “Developing a Public-Interest Training Commons of Books”

From the Authors Alliance:

Authors Alliance is pleased to announce a new project, supported by the Mellon Foundation, to develop an actionable p lan for a public-interest book training commons for artificial intelligence. Northeastern University Library will be supporting this project and helping to coordinate its progress.

Access to books will play an essential role in how artificial intelligence develops. AI’s Large Language Models (LLMs) have a voracious appetite for text, and there are good reasons to think that these data sets should include books and lots of them. Over the last 500 years, human authors have written over 129 million books.

[Clip]

Currently, AI development is dominated by a handful of companies that, in their rush to beat other competitors, have paid insufficient attention to the diversity of their inputs, questions of truth and bias in their outputs, and questions about social good and access. Authors Alliance, Northeastern University Library, and our partners seek to correct this tilt through the swift development of a counterbalancing project that will focus on AI development that builds upon the wealth of knowledge in nonprofit libraries and that will be structured to consider the views of all stakeholders, including authors, publishers, researchers, technologists, and stewards of collections.

[Clip]

The main goal of this project is to develop a plan for either establishing a new organization or identifying the relevant criteria for an existing organization (or partnership of organizations) to take on the work of creating and stewarding a large-scale public interest training commons of books.

We seek to answer several key questions, such as:

• What are the right goals and mission for such an effort, taking into account both the long and short-term;
• What are the technical and logistical challenges that might differ from existing library-led efforts to provide access to collections as data;
• How to develop a sufficiently large and diverse corpus to offer a reasonable alternative to existing sources;
• What a public-interest governance structure should look like that takes into account the particular challenges of AI development;
• How do we, as a collective of stakeholders from authors and publishers to students, scholars, and libraries, sustainably fund such a commons, including a model for long-term sustainability for maintenance, transformation, and growth of the corpus over time;
• Which combination of legal pathways is acceptable to ensure books are lawfully acquired in a way that minimizes legal challenges;
• How to respect the interests of authors and rightsholders by accounting for concerns about consent, credit, and compensation; and
• How to distinguish between the different needs and responsibilities of nonprofit researchers, small market entrants, and large commercial actors.

Learn More, Read the Complete Post

Filed under: Academic Libraries, Associations and Organizations, Companies (Publishers/Vendors), Data Files, Libraries, News