Alex Shaw

Alex Shaw co-created Harbor and Terminal-Bench — agent-evaluation infrastructure that has been widely adopted across the research community — and his session offers a firsthand account of what it takes to design benchmarks that resist gaming, scale to many parallel containers, and stay correlated with real-world agent capability. If you're building or optimizing agents, he can show you the scaffolding the field is benchmarking against.