Inference is the New Training Loop: Architecting High-Reliability Agents and Continuous AI Systems
SessionLeadership trackconfirmed
Inference is the New Training Loop: Architecting High-Reliability Agents and Continuous AI Systems
- Day
- Day 3 — Session Day 2
- Time
- 3:20pm-3:40pm
- Room
- Leadership 2
- Track
- Posttraining & Midtraining
Accessible with the Leadership (All-Access) pass and above.
About this session
For agentic AI and complex, multi-step workloads, the inference environment is the engine for continuous improvement, not a final deployment step. This talk focuses on engineering the full AI loop: tightly integrating inference with reinforcement learning (RL) and evaluation. Learn how to leverage native observability, serverless RL, and optimized inference stacks to continuously refine model behavior based on production traces, delivering agents that are reliable, auditable, and constantly evolving.
Topics
RL + Reasoning
