Project Results From COMET: “Unlocking Author-Affiliation Metadata For All of arXiv”

From a COMET Blog Post:

The COMET team is pleased to share results from an exciting line of work we have recently completed, focused on unlocking author-affiliation metadata from preprints. Specifically, we have trained a small, open-weight large language model (LLM) that achieves state-of-the-art performance on author-affiliation extraction for arXiv works. With this approach, we have for the first time produced open author-affiliation metadata for the full arXiv corpus as of December 2025, enabling community use and allowing for direct improvements to persistent identifier metadata. The trained model and dataset are openly available and free to use. 

[Clip]

Looking ahead, we are applying similar methods to train models for extracting additional metadata, such as references, dataset citations, and similar fields. We are also building workflows for reconciling our author and affiliation extractions and ROR ID assignments against parallel community assertions, recognizing that no single method is perfect or can address all edge cases. Because our models and methods are open, they can also be adapted for use in other preprint servers. We welcome collaborators who want to build on or contribute to this work!

Learn More, Read the Complete Post (about 1500 words!)

Filed under: Data Files, News