Artificial intelligence (AI) can help people shop, plan, and write — but not cook. It turns out humans aren’t the only ones who have a hard time following step-by-step recipes in the correct order, but new research from the Georgia Institute of Technology’s College of Computing could change that.
Researchers created a dataset called ChattyChef, which uses natural language processing models that can help a user cook a recipe. Using the open-source large language model GPT-J, ChattyChef’s dataset of cooking dialogues follows recipes with the user.
Although other researchers have theorized about the possibility of an AI chef, Georgia Tech’s work pushes the field forward. “We are one of the first research teams to analyze the challenges of using large language models for building an AI chef,” said Duong Le, a Ph.D. student in the School of Interactive Computing.
Most attempts at using language models for cooking fail because GPT-J doesn’t understand what the user wants to do next, or user intent, and has difficultly tracking how far the user is in the recipe — what the researchers call the “state of the conversation.” It also can’t easily answer clarification questions, like about ingredient amounts or cooking times.
For example, maybe someone is trying to cook hashbrowns. The AI tells them to melt butter in the pan and add the potatoes. The user then asks about the next step. A bad bot might jumble the order and tell them to serve the hashbrown even though they haven’t finished cooking it yet. Or a user asks a follow-up question about how long to cook the hashbrown, and AI won’t be precise enough, instead giving a general time and not specifying the cooking time for each side.
With this in mind, the researchers ensured their model had two key features:
User intent detection to determine the user’s current intent within a fixed set of possibilities, such as “Ask for next instruction” or “Ask for details about ingredients.”
Instruction state tracking to identify which recipe step the user is on, which works with 80% accuracy.
[Clip]
The ChattyChef dataset is built off WikiHow recipes with positive ratings and fewer than eight steps. The researchers crowdsourced people to role play how they might use ChattyChef to determine what instructions would be best to include in the dataset.
[Clip]
This research is supported in part by the National Science Foundation awards IIS-2112633 and IIS-2052498.
Gary Price (gprice@gmail.com) is a librarian, writer, consultant, and frequent conference speaker based in the Washington D.C. metro area.
He earned his MLIS degree from Wayne State University in Detroit.
Price has won several awards including the SLA Innovations in Technology Award and Alumnus of the Year from the Wayne St. University Library and Information Science Program. From 2006-2009 he was Director of Online Information Services at Ask.com.
