Chao Wang, "Large Language Models for Multi-Modal Human-Robot Interaction", LMU Winterschool , 2024.

I will report our latest achievement based on the CHI LBW paper we submitted: https://arxiv.org/abs/2401.15174 A paper website is also created for better spreading (please see the "Supplementary Material"). Besides, I will show a real time demo of our system with camera, microphone and object with marker. The robot's behavior will be shown in RCS simulator and "inner thought" GUI. Student can also send me system prompt, then we can tune the robot's behavior a bit.