LiveAutonomous AI deploymentWestern cycleAnchors pending
Before end 2028, at least one autonomous AI system is involved in a real-world incident causing more than $100M damage or human harm requiring attributable response?
As of 6 Oct · 22:19 UTCResolves 31 Dec 20282 movers0 pressure moments
The read
The underlying structure favors First Major Autonomous Incident (60%) over No Major Autonomous Incident (40%) — the signal is real but noisy.
Two trajectories through autonomous ai deployment: No Major Autonomous Incident and First Major Autonomous Incident. The Signals below describe what would be visible if each trajectory is landing; the Levers list what could bend it. The third timeline — the one neither No Major Autonomous Incident nor First Major Autonomous Incident captures — is where the honest scope-limit sits.
Where reality is heading
A, 80% bandCrowd today
Reality crosses toward A in early 2028. Today’s crowd number sits at the top of A’s band, possible but optimistic. View as table
The movers, ranked by leverage
What would change our mind
Signals toward A
- Through 2028, no autonomous AI system is involved in a real-world incident meeting a $100M+ or human-harm bar
- Narrow-task agents (customer support, code execution, trading) deploy at scale with incidents staying bounded
- Governance frameworks catch up before the first big event
Signals toward B
- A documented incident occurs — an agentic AI (long-horizon planner, autonomous trader, code-execution agent) causes measurable harm meeting the $100M+ or human-harm bar
- The incident triggers regulatory response, possibly a mandatory capability-reporting regime
- Agentic-deployment rate: movement in the direction that supports First Major Autonomous Incident
Evidence
Responsible AI Collaborative (founded by Partnership on AI) · AI Incident Database (Partnership on AI, ongoing)
MIT FutureTech / MIT CSAIL · MIT AI Risk Repository (2024)
Princeton NLP Group · Agentic AI evaluations: SWE-Bench, GAIA, OSWorld, OpenAgentX benchmarks tracking real-world task completion
CFTC and SEC Joint Report · Historical analog: autonomous trading incidents (Knight Capital 2012, 2010 Flash Crash) + autonomous vehicle incidents (Uber 2018, Tesla Autopilot cases)
Meta AI Research / Hugging Face · GAIA: a benchmark for General AI Assistants
Multiple universities (UW, CMU, Stanford) · OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
AI Incident Database · Incident 4: Uber AV Killed Pedestrian in Arizona