SUBSCRIBE
SUBSCRIBE
EXPLORE +
  • About infoDOCKET
  • Academic Libraries on LJ
  • Research on LJ
  • News on LJ
  • Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Libraries
    • Academic Libraries
    • Government Libraries
    • National Libraries
    • Public Libraries
  • Companies (Publishers/Vendors)
    • EBSCO
    • Elsevier
    • Ex Libris
    • Frontiers
    • Gale
    • PLOS
    • Scholastic
  • New Resources
    • Dashboards
    • Data Files
    • Digital Collections
    • Digital Preservation
    • Interactive Tools
    • Maps
    • Other
    • Podcasts
    • Productivity
  • New Research
    • Conference Presentations
    • Journal Articles
    • Lecture
    • New Issue
    • Reports
  • Topics
    • Archives & Special Collections
    • Associations & Organizations
    • Awards
    • Funding
    • Interviews
    • Jobs
    • Management & Leadership
    • News
    • Patrons & Users
    • Preservation
    • Profiles
    • Publishing
    • Roundup
    • Scholarly Communications
      • Open Access

October 4, 2018 by Gary Price

Research Article: “An Evidence-Based Method for Assessing the Value of a Search Tool: A Pilot Study”

October 4, 2018 by Gary Price

The following article appears in the new issue of the Journal of the Medical Library Association (JMLA).
Title
An Evidence-Based Method for Assessing the Value of a Search Tool: A Pilot Study
Authors
Donald Stanley Pearson
The Ohio State University Comprehensive Cancer Center
Stevo Roksandic
Mount Carmel Health System
Jill Kilanowski
Mount Carmel College of Nursing
Source
Journal of the Medical Library Association (JMLA)
Vol 106, No 4 (2018)
DOI: 10.5195/jmla.2018.287

Abstract

Objective
The objective of this study was to develop an evidence-based method with a set of metrics that could be used to assess an information search tool.
Methods
This pilot study analyzed a two-group convenience sample of graduate nursing students and resident physicians. The intervention group received ten minutes of instruction on a familiar search tool (eSearcher). Each group was provided one prompt to search for clinical guidelines on a given topic within their scope of practice and asked to find the best result using only eSearcher (intervention group) or specifically excluding eSearcher (comparison group). Three measurements of search results were employed: time elapsed to complete the search, an accuracy score, and a participant-reported score of confidence in the result.
Results
Forty-two students participated in this study (23 graduate nursing students and 19 resident physicians). The intervention group consisted of 22 participants (12 graduate nursing students and 10 resident physicians), and the comparison group consisted of 20 participants (11 graduate nursing students and 9 resident physicians). The intervention group had lower mean ranks in both accuracy and confidence compared to the comparison (not eSearcher) group, although these differences were not significant. However, the intervention (eSearcher) group had significantly longer search times compared to the comparison (not eSearcher) group.
Discussion
These findings provided new insights into the performance of the search tool and how users felt about their search experience. The quantitative evidence gained from this study led directly to an informed decision to explore other options for search tools. The evidence-based methods and process developed in this pilot study will enable similar studies to test other student groups and other search tools, leading to better informed purchasing and instructional decisions.

Direct to Full Text ||| PDF Version (6 pages; PDF)

Filed under: Libraries, New Issue, News, Patrons and Users

SHARE:

About Gary Price

Gary Price (gprice@mediasourceinc.com) is a librarian, writer, consultant, and frequent conference speaker based in the Washington D.C. metro area. Before launching INFOdocket, Price and Shirl Kennedy were the founders and senior editors at ResourceShelf and DocuTicker for 10 years. From 2006-2009 he was Director of Online Information Services at Ask.com, and is currently a contributing editor at Search Engine Land.

ADVERTISEMENT

Archives

Job Zone

ADVERTISEMENT

Recent Articles on LJ

Texas A&M Restructures Library Roles, Rescinds Librarian Tenure

After the MLIS

How Ted Lasso Changed My Librarianship | Backtalk

Dartmouth Repatriates Samson Occom Papers to Mohegan Tribe

Prince George’s County Memorial Library System Targeted by Anti-LGBTQIA+ Vandalism

ADVERTISEMENT

Related Infodocket Posts

Educopia Partnering with Curtin University and OAPEN to Create a Community Governed OA Book Analytics Service for Publishers

From an Educopia Announcement: With more than AUD $1M in support from the Mellon Foundation, we at Educopia are excited to be working with collaborative partners at Curtin University  and ...

Just Released: U.S. Copyright Office Publishes Report on Copyright Protections For Press Publishers

From the U.S. Copyright Office: On June 30, 2022, the U.S. Copyright Office published a report titled Copyright Protections for Press Publishers. At the request of Senators Leahy, Tillis, Cornyn, ...

U.S. Census Releases 2021 Population Estimates: Nation Continues to Age as It Becomes More Diverse

From the U.S. Census: The last two decades have seen the country grow continuously older. Since 2000, the national median age – the point at which one-half the population is ...

Vision 2030: Library and Archives Canada Releases New Strategic Plan

From the LAC Website: Following two years of consultations, reflection and work, Library and Archives Canada (LAC) has unveiled its strategic plan, Vision 2030, defining the institution’s goals until 2030 ...

Journal Article: "The Financial Maintenance of Social Science Data Archives: Four Case Studies of Long-Term Infrastructure Work"

The article linked below was recently published by the Journal of the Association for Information Science and Technology (JASIST). Title The Financial Maintenance of Social Science Data Archives: Four Case ...

Library Futures Releases Policy Statement and Draft eBook Legislative Language: Mitigating the Library eBook Conundrum Through Legislative Action...

From a Library Futures Post by Kyle Courtney and Juliya Ziskina: Library Futures is excited to announce that we are launching our policy statement on eBooks. Current eBook licensing practices ...

How Can Data Librarians Support Data Communities? An Interview with Jordan Wrigley

From the Ithaka S+R Interview by Dylan Ruediger and Ruby MacDougall: Data communities provide social and practical incentives for scientists to voluntarily share and reuse data with colleagues. In order ...

Roundup (June 30, 2022)

ALPSP Awards for Innovation in Publishing 2022: Shortlist Announced (via ALPSP) Library Publishing Coalition Welcomes University of Kansas  and University of Delaware as New Members (via LPC) NLM Responds to ...

ACLU: "It’s 2022 and Two Books Are on Trial for 'Obscenity'"

From the ACLU: …last month, a Virginia resident initiated obscenity proceedings against two acclaimed books: Gender Queer, a Memoir, by Maia Kobabe, an autobiographical graphic novel that depicts the author’s ...

U.S. Patent Research: USPTO Announces Patent Center to Fully Replace Legacy Public PAIR System This Summer

From the U.S. Patent and Trademark Office: Beginning August 1, 2022, the U.S. Patent and Trademark Office’s (USPTO) Patent Center system—available to the public since 2017—will fully replace the legacy ...

Roundup (June 29, 2022)

CORE: Our Commitment to The Principles of Open Scholarly Infrastructure Elsevier’s Acquisition of Interfolio: Risks and Responses GPO to Discontinue Assigning Library of Congress Classification Numbers in Records for Hearings ...

Nat Geo Report: "The Great Hunt for the World's First LGBTQ Archive"

From National Geographic: In the early 1990s, a Canadian student named Adam Smith opened a dumpster in the basement of his apartment building in Vancouver, Canada, and discovered a stack ...

ADVERTISEMENT

FOLLOW INFODOCKET ON TWITTER

Tweets by @infodocket

ADVERTISEMENT

This coverage is free for all visitors. Your support makes this possible.

This coverage is free for all visitors. Your support makes this possible.

Primary Sidebar

  • News
  • Reviews+
  • Technology
  • Programs+
  • Design
  • Leadership
  • People
  • COVID-19
  • Advocacy
  • Opinion
  • INFOdocket
  • Job Zone

Reviews+

  • Booklists
  • Prepub Alert
  • Book Pulse
  • Media
  • Readers' Advisory
  • Self-Published Books
  • Review Submissions
  • Review for LJ

Awards

  • Library of the Year
  • Librarian of the Year
  • Movers & Shakers 2022
  • Paralibrarian of the Year
  • Best Small Library
  • Marketer of the Year
  • All Awards Guidelines
  • Community Impact Prize

Resources

  • LJ Index/Star Libraries
  • Research
  • White Papers / Case Studies

Events & PD

  • Online Courses
  • In-Person Events
  • Virtual Events
  • Webcasts
  • About Us
  • Contact Us
  • Advertise
  • Subscribe
  • Media Inquiries
  • Newsletter Sign Up
  • Submit Features/News
  • Data Privacy
  • Terms of Use
  • Terms of Sale
  • FAQs
  • Careers at MSI


© 2022 Library Journal. All rights reserved.


© 2022 Library Journal. All rights reserved.