LiveAI safety economicsWestern cycleAnchors pending
By end of 2028, major labs publish measured 'alignment-tax' (capability-per-dollar cost of safety training) for frontier model releases?
As of 6 Oct · 22:19 UTCResolves 31 Dec 20284 movers0 pressure moments
The read
The underlying structure favors Alignment-Tax Stays Hidden (70%) over Alignment-Tax Measured (30%) — the signal is early.
Two trajectories through ai safety economics: Alignment-Tax Measured and Alignment-Tax Stays Hidden. The Signals below describe what would be visible if each trajectory is landing; the Levers list what could bend it. The third timeline — the one neither Alignment-Tax Measured nor Alignment-Tax Stays Hidden captures — is where the honest scope-limit sits.
Where reality is heading
A, 80% bandCrowd today
Reality crosses toward A in early 2028. Today’s crowd number sits at the top of A’s band, possible but optimistic. View as table
The movers, ranked by leverage
What would change our mind
Signals toward A
- Major labs (Anthropic, OpenAI, Google DeepMind) publish measured alignment-tax numbers for frontier releases — e.g., 'this release spent 15% of training compute on safety-tuning
- the capability-per-dollar penalty vs no safety-tuning is X%'
- The field has an economic model for alignment overhead
Signals toward B
- Labs disclose that safety training happened but not what it cost in capability terms
- The policy debate (how much alignment should labs do, how much should regulators mandate) continues without hard numbers
- Lab competitive dynamics: movement in the direction that supports Alignment-Tax Stays Hidden
Evidence
OpenAI · OpenAI o-series system cards (2024-2026) — early disclosures of safety-training compute allocation
Anthropic · Anthropic Constitutional AI paper (2022) + follow-up on scaling
Stanford University / NeurIPS 2023 · Academic work on RLHF vs RLAIF cost-benefit (Rafailov et al., Casper et al.)
- Policy-paper requests from OMB, Treasury, EU AI Office for safety-training cost disclosureNo source URL yet
MIT CSAIL · Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback