Skip to content

AI Engineer Summit 2026

Oct 12–13, 2026Moscone West, San Francisco

Two days for the people building AI systems that have to work on Monday morning. Practitioner talks on evaluation, agents, retrieval, inference infrastructure and the product decisions in between — no keynote fluff, no vendor pitches.

Back to all sessions
AI EngineeringTalk

Building reliable agents: a practitioner's playbook

When
Monday, October 1210:00 AM - 11:00 AM PDT
Where
Main StageSeats 300
Format
Talk
Track
AI Engineering
Level
Intermediate
Language
English
agentsreliability

About this session

Agents fail in ways that traditional services do not: partially, plausibly, and expensively. This talk is the playbook we wish we had — bounded tool surfaces, idempotent actions, replayable traces, checkpointing, and the escalation paths that keep a human in the loop without keeping them in the way.

Speakers

SM

Sofia Marchetti

Founding Engineer

Vantage Labs

Sofia was the first engineer at Vantage Labs and now leads their agent runtime. She is unreasonably interested in what happens when a tool call fails halfway through.

AN

Ava Nakamura

Staff ML Engineer

Lumen AI

Ava leads the evaluation platform at Lumen AI, where she is responsible for making sure model changes ship without quietly regressing customer-facing quality. She spent six years in search relevance before moving to LLM systems.