Hands-on AutoResearch: Cracking OpenAI's Parameter Golf
SessionWorkshop trackconfirmed
Hands-on AutoResearch: Cracking OpenAI's Parameter Golf
- Day
- Day 1 — Workshop Day
- Time
- 2:20pm-4:20pm
- Room
- Track 9
- Track
- Workshops Day 1
Accessible with the Engineering + Workshops pass and above.
About this session
Heard about autoresearch, or tried it a few times in playground settings? This hands-on tutorial teaches you how to use autoresearch on one of the most serious challenges in ML this year: OpenAI's Parameter Golf. The challenge: train the best language model that fits in just 16MB. We entered our autoresearch agent this past spring, and it outperformed the field of over 1,000 participants. You'll learn how we approached it, then get to do it yourself: kick off an autoresearch agent, watch it improve a tiny language model's training script, steer it when progress stalls, and visualize your results. You'll leave with a working autoresearch setup you can point at your own code.
