AnalysisTutorial / explainerSpeech & Audio · Agents & Tool Use1 source · Oct 11, 2026

Can Your Agent Hear You Now? Building Live Voice Agents with Gemini — Thor Schaeff

An agent that hears you, sees you, and answers in your language, in real time.

Proof1 independent outlet

Key points

  • Here's how to build one with Gemini.
  • Thor Schaeff, who works on developer experience at Google DeepMind, runs a set of live demos of Gemini's real-time and media models.
  • He explains how the Live API works: a stateful WebSocket session that takes in text, audio and video and streams back audio plus a transcript, using a native audio model rather than a speech-to-text and text-to-speech pipeline.
  • • Near real-time speech translation with Gemini 3.5 Live Translate

Sources (1)

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 8, 2026Microsoft Joins the Local AI Push
  2. Oct 8, 2026Understanding Jev, the new model everyone is talking about
  3. Oct 8, 2026Text is so 2023
  4. Oct 8, 2026Google brings agentic AI to Gemini, starting with businesses
  5. Oct 7, 2026[AINews] Claude Haiku 5.5 — better than GPT-6 Luna at the same pricing
  6. Oct 7, 2026Google rolls out improved SynthID AI content detector, now available globally

Related