LivetechWestern cycleAnchors pending
A publicly released AI model passes 50% on FrontierMath by end of 2027?
As of 1 Oct · 16:00 UTCResolves 31 Dec 20273 movers2 pressure moments
The read
Reality still leans toward Threshold Hit.
Reality favors Threshold Hit — the pressures holding that outcome in place are stronger than the counter-pull. The main thing that could shift this is compute spending by the top three or four AI labs.
Where reality is heading
A, 80% bandCrowd today
Reality crosses toward A in early 2028. Today’s crowd number sits at the top of A’s band, possible but optimistic. View as table
The movers, ranked by leverage
What would change our mind
Signals toward A
- Compute spending by the top three or four AI labs trajectory bending toward Threshold Hit
- Breakthroughs in reasoning techniques that let models think longer at inference time without proportional cost per answer moving in support of Threshold Hit
- Whether labs integrate formal math tools (like Lean) into training shifting in the direction that supports Threshold Hit
- Export controls on advanced chips crossing the threshold toward Threshold Hit
- A voluntary or regulatory pause on frontier model releases readings confirming the Threshold Hit direction
Signals toward B
- Compute spending by the top three or four AI labs trajectory bending toward Still Short
- Breakthroughs in reasoning techniques that let models think longer at inference time without proportional cost per answer moving in support of Still Short
- Whether labs integrate formal math tools (like Lean) into training shifting in the direction that supports Still Short
- Export controls on advanced chips holding against the shift toward Still Short
- A voluntary or regulatory pause on frontier model releases readings confirming the Still Short direction
Pressure moments
Evidence
Epoch AI · Epoch AI FrontierMath benchmark and public leaderboard (epoch.ai/frontiermath) — benchmark launched November 2024 with problems designed to resist short-term solving
- Metaculus community forecasts on FrontierMath milestones — the aggregator for expert and crowd probability on multi-year AI capability betsNo source URL yet
OpenAI · OpenAI o-series reasoning model release materials 2024-2025 — showed step-change gains on hard reasoning benchmarks via test-time compute scaling, the technique most likely to push FrontierMath past 50%