Towards an Extensible Benchmark for Spoken Dialogue with Social Robots
We propose a benchmark for the community to use as a way to explore common spoken dialogue artifacts between robots and humans, including requests for clarification, interruptions, embodied signals (e.g., head nods or facial cues), and time constraints.
ProofPaper ↗
Key points
- Language models provide a plug-and-play interface between humans and robots, but important challenges remain when speech, dialogue, fast interaction, and collaboration are required.
- We also explain our vision to extend the benchmark for other aspects of human-robot interaction that are important to the larger research community.
- To facilitate the benchmark, we further propose using Retico, a real-time communication framework that fulfills important technical requirements to enable robots to have spoken dialogue capabilities.
Sources (1)
- [1]Towards an Extensible Benchmark for Spoken Dialogue with Social RobotsarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 6, 05:36 PM
We propose a benchmark for the community to use as a way to explore common spoken dialogue artifacts between robots and humans, including requests for clarification, interruptions, embodied signals (e.g., head nods or facial cues), and time constraints.
Language models provide a plug-and-play interface between humans and robots, but important challenges remain when speech, dialogue, fast interaction, and collaboration are required.
Extractive summary: sentences quoted from the sources.