Scaling AI systems: where theory meets constraint
SessionLeadership trackconfirmed
Scaling AI systems: where theory meets constraint
- Day
- Day 4 — Session Day 3
- Time
- 2:25pm-2:45pm
- Room
- Leadership 2
- Track
- Inference
Accessible with the Leadership (All-Access) pass and above.
About this session
As demand for large scale AI systems grows, the limiting factor is no longer model capability, but compute availability, efficiency, and system design. Lambda cofounder/CEO Stephen Balaban and Gradient General Partner Zach Bratun-Glennon will examine how modern workloads interact with real-world compute constraints and the software investment and developments taking place to get the most out of cutting edge GPUs. They’ll unpack where training and inference workloads diverge in their infrastructure requirements, the practical limits of GPU utilization and what drives underperformance, and what we can expect to see next in AI infrastructure as constraints continue to evolve.
Topics
LLM Production Infra
