Research Paper: Toward Integrating AI Chat and Search: A User-Centered Perspective Across Age Groups

The article linked below was recently made available (full text) by the ACM Digital Library.

Title

Toward Integrating AI Chat and Search: A User-Centered Perspective Across Age Groups

Authors

Chen He
University of Helsinki

Michiel Spape
University of Macau

Khadijatul Kobra
University of Helsinki

Robin Welsch
University of Helsinki

Giulio Jacucci
University of Helsinki

Source

ACM Transactions on Interactive Intelligent Systems

DOI: 10.1145/3777486

Abstract

People face challenges with complex search tasks daily; chat-based large language models have the potential to assist search by helping with query formulation and content navigation, for instance. However, there is a lack of user research on integrating AI chat and traditional search to enhance Information Retrieval (IR) for the general public. This study explores how younger (25 participants) and older (22 participants) adults utilize these two platforms to retrieve information. Through two IR tasks, quality- and quantity-oriented tasks, focused on gathering evidence related to various countries’ CO2 emissions, younger users spent more time, issued more queries, and explored more external web pages than older adults in both tasks. In contrast, despite reporting less familiarity with AI chat, older adults relied more on chat to complete their tasks. They submitted longer queries for the quality task and reached the first query faster for the quantity task than their younger counterparts, reflecting a top-down IR strategy. In the end, task outcomes were similar for the two groups, indicating AI chat’s capability to support IR. Drawing from our study results and relevant literature, we propose five design requirements to harness the synergic value of search and AI chat in supporting IR.

Direct to Abstract + Link to Full Text

Filed under: Digital Collections, Interactive Tools, Journal Articles, Libraries, News, Patrons and Users