SessionEngineering trackconfirmed

Training Frontier Models to Out-Think Hackers

Day
Day 3 — Session Day 2 · Wed, Jul 1
Time
11:40am-12:00pm
Room
Track 9 · Room 2016
Track
Data Quality
Share
Track theme
Post-Training & Mid-Training (RL)

Post- and mid-training — what's next after RLHF, decentralized RL training at scale, and the infrastructure behind frontier models.

Accessible with the Engineering pass and above.

About this session

We will give a surprisingly optimistic talk about AI and cyber, and why we believe it is not the end of cybersecurity as we know it, but an opportunity to empower defenders and build a lasting edge over attackers.

Cyber is a battle of skill and speed, and the rising tide of frontier models is allowing human attackers to move faster and cheaper. That combination of skilled hackers and breakthrough LLMs is a real threat, while defensive systems are still expected to operate at scale with limited human intervention, constrained by what models can do out of the box. But the answer is not fear or despair. Just as high-quality data transformed software engineering, the right cyber training data can teach models to turn from weapons being used against us into tools that protect us.

Speakers