KV Cache-Aware Routing and P/D Disaggregation on Kubernetes: The Parts Public Benchmarks Don't Show
SessionEngineering trackconfirmed
KV Cache-Aware Routing and P/D Disaggregation on Kubernetes: The Parts Public Benchmarks Don't Show
- Day
- Day 4 — Session Day 3
- Time
- 2:25pm-2:45pm
- Room
- Track 9
- Track
- Inference
Accessible with the Engineering pass and above.
Topics
RL + ReasoningEvals & Observability
