Task Specification with LLMs

For the Talking to Robots course I’m currently taking, our project is on Uncertainty Reduction for Task Specification with Active Querying. The idea is to have an LLM agent that can ask questions and interact with a human to specify a task when given an instruction, then generate a plan to complete the task.

In this project we utilize current state-of-the-art LLMs, VLMs, and are deploying on a Kinova robot arm. Final demo coming in December!