May 23, 2022

National Academies Release COVID-19 Data Guide for Decision-Makers, Interactive Web-Based Resource Also Available

From the National Academies of Sciences, Engineering, and Medicine:

The recently formed National Academies of Sciences, Engineering, and Medicine Societal Experts Action Network (SEAN), which connects social and behavioral science researchers with decision-makers leading the response to COVID-19, today released a rapid expert consultation to guide leaders using COVID-19 measurements like hospitalizations and reported confirmed cases to understand the spread of the disease in their communities.

The rapid expert consultation says that decision-makers should consider five criteria when evaluating COVID-19 data: representativeness, potential for systematic under- or over-estimation, uncertainty, time range, and geographical area.

The rapid expert consultation summarizes the benefits and drawbacks of seven specific COVID-19 measurements that decision-makers can consider as they use these measurements to respond to the outbreak:

  • Number of confirmed cases: This measure is readily available, but is likely to substantially underestimate the prevalence of COVID-19 in the population. As testing expands to include populations with less severe symptoms and asymptomatic individuals, this measure will become increasingly useful.
  • Hospitalizations: Hospitalization data are typically available in real time, though there may be uneven volume of reporting on certain days. This measurement reflects only the most severe cases of infection, but as the proportion of hospitalizations to confirmed cases declines, it likely reflects a decline in the total number of infections in a community.
  • Emergency department visits: In some places, emergency department visits are available at the local level in close to real time. These data are most useful in the early stages of an outbreak, or to assess resurgence, though it should be noted that patients with symptoms were exposed up to two weeks earlier.
  • Reported confirmed COVID-19 deaths: Reported COVID-19 deaths reflect the state of the outbreak several weeks prior, due to the long course of COVID-19 infection.
  • Excess deaths: Compared with the other measurements reviewed, excess deaths are the best indicator of mortality impacts of the pandemic. However, because of the potential for death misclassification, excess deaths represents a mix of confirmed COVID-19 deaths and deaths from other causes.
  • Fraction of viral tests that are positive: While widely used, this may not be a good indication of the prevalence of the disease, and may tend to be an overestimate, as the people tested are often not representative of the population. Understanding of the utility of antibody testing is still evolving.
  • Representative prevalence surveys: Representative prevalence surveys, in which a representative sample of people are selected and tested, are the best strategy for understanding the prevalence of the disease in any given population. Such surveys can be undertaken for specific populations, such as in a workplace, nursing home, or prison. However, gathering this data requires undertaking a special study and is not available from routinely collected data. Many public health agencies have the capacity to undertake such surveys.

A new interactive web tool, also released today is designed to help decision-makers dive further in to the strengths and weaknesses of these seven data types.

Learn More, Read the Complete Publication Announcement

Full Text Report: Evaluating Data Types: A Guide for Decision Makers Using Data to Understand the Extent and Spread of COVID-19

Direct to Interactive Data Tool

About Gary Price

Gary Price ( is a librarian, writer, consultant, and frequent conference speaker based in the Washington D.C. metro area. Before launching INFOdocket, Price and Shirl Kennedy were the founders and senior editors at ResourceShelf and DocuTicker for 10 years. From 2006-2009 he was Director of Online Information Services at, and is currently a contributing editor at Search Engine Land.