AnalysisOpinion / analysisAgents & Tool Use · Robotics & Embodied AI · Applications1 source · Oct 11, 2026

Build with Perception Agents — Emile Baizel & Shruti Arora, Amazon AGI Lab

A coding agent says it added a duck icon to a podcast page; a browser verification pass checks whether the change actually appeared.

Proof1 independent outlet

Key points

  • That audience demo captures the loop Emile Baizel and Shruti Arora build around two perception agent primitives.
  • Visual annotation lets a person select an element, draw on the page or drop a pin, then export structured feedback for a coding agent.
  • Visual verification checks the rendered site against design expectations and user flows.
  • The annotation step is deterministic and produces JSON; the verification step gives the agent a way to inspect the result of its work.

Sources (1)

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 11, 2026Agent Speedrun — Elizabeth Fuentes Leone & Sandhya Subramani, AWS
  2. Oct 9, 2026Introducing Clef-omni with full multimodality, plus a faster Clef and a cheaper Clef-flash
  3. Oct 8, 2026Understanding Jev, the new model everyone is talking about
  4. Oct 7, 2026[AINews] Claude Haiku 5.5 — better than GPT-6 Luna at the same pricing
  5. Oct 7, 2026Building AI builders: Playbook for closing the AI knowledge-capability gap
  6. Oct 7, 2026How Cornerstone OnDemand cut database diagnosis by 78% with Amazon Bedrock

Related