The article linked below was published online today by JLIS.it: Italian Journal of Library, Archives and Information Science.
Title
Quality Assessment of Research Comparisons in the Open Research Knowledge Graph: A Case Study
Authors
Jennifer D’Souza TIB Leibniz Information Centre for Science and Technology
Julia Evans TIB Leibniz Information Centre for Science and Technology
Lars Vogt TIB Leibniz Information Centre for Science and Technology
Oliver Karras TIB Leibniz Information Centre for Science and Technology
Vinodh Ilangovan TIB Leibniz Information Centre for Science and Technology
Anna-Lena Lorenz TIB Leibniz Information Centre for Science and Technology
Sören Auer TIB Leibniz Information Centre for Science and Technology
Source
JLIS.it: Italian Journal of Library, Archives and Information Sciencel, 15 (1)
DOI: 10.36253/jlis.it-547
Abstract
The Open Research Knowledge Graph (ORKG) is a digital library for machine-actionable scholarly knowledge, with a focus on structured research comparisons obtained through expert crowdsourcing. While the ORKG has attracted a community of more than 1,000 users, the curated data has not been subject to an in-depth quality assessment so far. Here, proposed as a first exemplary step, within a team of domain experts, we evaluate the quality of six selected ORKG Comparisons based on three criteria, namely: 1) the quality of semantic modelling, 2) the maturity of the Comparisons in terms of their completeness, syntactic representation, identifier stability, and their linkability mechanisms ensuring the interoperability and discoverability. Finally, 3) the informative usefulness of the Comparisons to expert and lay users. We have found that each criterion addresses a unique and independent aspect of quality. Backed by the observations of our quality evaluations presented in this paper, a fitting model of knowledge graph quality appears one that is indeed multidimensional as ours.
Gary Price (gprice@gmail.com) is a librarian, writer, consultant, and frequent conference speaker based in the Washington D.C. metro area.
He earned his MLIS degree from Wayne State University in Detroit.
Price has won several awards including the SLA Innovations in Technology Award and Alumnus of the Year from the Wayne St. University Library and Information Science Program. From 2006-2009 he was Director of Online Information Services at Ask.com.
