Journal Article: “Identifying Benchmark Units for Research Management and Evaluation”
The article linked below was recently published by Scientometrics.
Title
Identifying Benchmark Units for Research Management and Evaluation
Authors
Qi Wang
KTH-Royal Institute of Technology, KTH Library & Division of History of Science, Stockholm, Sweden
Tobias Jeppsson
KTH-Royal Institute of Technology, KTH Library & Division of History of Science, Stockholm, Sweden
Source
Scientometrics (2022)
DOI: 10.1007/s11192-022-04413-7
Abstract
While normalized bibliometric indicators are expected to resolve the subject-field differences between organizations in research evaluations, the identification of reference organizations working on similar research topics is still of importance. Research organizations, policymakers and research funders tend to use benchmark units as points of comparison for a certain research unit in order to understand and monitor its development and performance. In addition, benchmark organizations can also be used to pinpoint potential collaboration partners or competitors. Therefore, methods for identifying benchmark research units are of practical significance. Even so, few studies have further explored this problem. This study aims to propose a bibliometric approach for the identification of benchmark units. We define an appropriate benchmark as a well-connected research environment, in which researchers investigate similar topics and publish a similar number of publications compared to a given research organization during the same period. Four essential attributes for the evaluation of benchmarks are research topics, output, connectedness, and scientific impact. We apply this strategy to two research organizations in Sweden and examine the effectiveness of the proposed method. Identified benchmark units are evaluated by examining the research similarity and the robustness of various measures of connectivity.
Direct to Full Text Article
Filed under: Associations and Organizations, Libraries, Management and Leadership, News
About Gary Price
Gary Price (gprice@gmail.com) is a librarian, writer, consultant, and frequent conference speaker based in the Washington D.C. metro area. He earned his MLIS degree from Wayne State University in Detroit. Price has won several awards including the SLA Innovations in Technology Award and Alumnus of the Year from the Wayne St. University Library and Information Science Program. From 2006-2009 he was Director of Online Information Services at Ask.com.