Preprint: “Project Alexandria: Towards Freeing Scientific Knowledge from Copyright Burdens via LLMs”

The preprint linked below was recently shared on arXiv.

Title

Project Alexandria: Towards Freeing Scientific Knowledge from Copyright Burdens via LLMs

Authors

Christoph Schuhmann (LAION) et al.

Source

via arXiv

DOI: 10.48550/arXiv.2502.19413

Abstract

Paywalls, licenses and copyright rules often restrict the broad dissemination and reuse of scientific knowledge. We take the position that it is both legally and technically feasible to extract the scientific knowledge in scholarly texts. Current methods, like text embeddings, fail to reliably preserve factual content, and simple paraphrasing may not be legally sound. We urge the community to adopt a new idea: convert scholarly documents into Knowledge Units using LLMs. These units use structured data capturing entities, attributes and relationships without stylistic content. We provide evidence that Knowledge Units: (1) form a legally defensible framework for sharing knowledge from copyrighted research texts, based on legal analyses of German copyright law and U.S. Fair Use doctrine, and (2) preserve most (~95%) factual knowledge from original text, measured by MCQ performance on facts from the original copyrighted text across four research domains. Freeing scientific knowledge from copyright promises transformative benefits for scientific research and education by allowing language models to reuse important facts from copyrighted text. To support this, we share open-source tools for converting research documents into Knowledge Units. Overall, our work posits the feasibility of democratizing access to scientific knowledge while respecting copyright.

Direct to Full Text Article (Feb. 26, 2025 version)
29 pages; PDF.

Filed under: Data Files, News