Human-guided Collaborative Problem Solving: A Natural Language based Framework
Authors:
Harsha Kokel,
Mayukh Das,
Rakibul Islam,
Julia Bonn,
Jon Cai,
Soham Dan,
Anjali Narayan-Chen,
Prashant Jayannavar,
Janardhan Rao Doppa,
Julia Hockenmaier,
Sriraam Natarajan,
Martha Palmer,
Dan Roth
Abstract:
We consider the problem of human-machine collaborative problem solving as a planning task coupled with natural language communication. Our framework consists of three components -- a natural language engine that parses the language utterances to a formal representation and vice-versa, a concept learner that induces generalized concepts for plans based on limited interactions with the user, and an…
▽ More
We consider the problem of human-machine collaborative problem solving as a planning task coupled with natural language communication. Our framework consists of three components -- a natural language engine that parses the language utterances to a formal representation and vice-versa, a concept learner that induces generalized concepts for plans based on limited interactions with the user, and an HTN planner that solves the task based on human interaction. We illustrate the ability of this framework to address the key challenges of collaborative problem solving by demonstrating it on a collaborative building task in a Minecraft-based blocksworld domain. The accompanied demo video is available at https://youtu.be/q1pWe4aahF0.
△ Less
Submitted 19 July, 2022;
originally announced July 2022.
