Skip to content

AI Engineer Summit 2026

Oct 12–13, 2026Moscone West, San Francisco

Two days for the people building AI systems that have to work on Monday morning. Practitioner talks on evaluation, agents, retrieval, inference infrastructure and the product decisions in between — no keynote fluff, no vendor pitches.

Back to speakers
TB

Tom Beaumont

Developer Advocate

Ridgeline

Their session1

Monday, October 12, 2026

AI EngineeringTalk

Evaluation harnesses for production LLMs

A working tour of a real evaluation harness: dataset curation, judge prompts you can defend, statistical significance on small samples, and wiring the whole thing into CI so a regression blocks a deploy rather than surprising a customer.

10:00 AM - 10:45 AMWorkshop Room

Speakers