The “AI 2027” Scenario: How realistic is it?
We recorded 29 claims from this post. 8 were checked against evidence. 21 can’t be checked. 4 more are held. Read the post at its source.
Claims from this post (29)
In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.
Assessment: UnresolvedSaid
Observation
“The US has done almost nothing legislatively about the risks of AI (aside from deepfake porn).”
Our reading: The US has passed almost no legislation addressing AI risks, apart from deepfake porn.
No horizon Evidence as of
Limitation: The evidence items do not provide a complete inventory of federal protections enacted through May 22, 2025.
Assessment: Can’t be checkedSaid
Causal claim
“And, as I will argue at the end, stoking fear, uncertainty and doubt may actually ultimately be harming the (noble!) cause of AI safety, rather than helping it.”
Our reading: Stoking fear, uncertainty and doubt about AI may be harming, rather than helping, the cause of AI safety.
No horizon
Assessment: UnresolvedSaid
Observation
“And so far, anyway, the impact on the labor market of Generative AI has been modest; ditto for productivity in any measurable statistics.”
Our reading: So far, generative AI's impact on the labor market and on measurable productivity has been modest.
No horizon Evidence as of
Limitation: Geographic and occupational coverage is limited.
Assessment: UnresolvedSaid
Observation
“Cell phones and the internet were pretty big, but it’s not obvious their impact was greater than the industrial revolution, and so far AI’s impact has (despite all the PR) been far less than either cell phones or the internet.”
Our reading: So far, AI's impact has been far less than that of cell phones or the internet.
No horizon Evidence as of
Limitation: The evidence provides no common measure of accumulated impact or threshold for 'far less'.
Assessment: Can’t be checkedSaid
Forecast
“But there is a vastly higher probability that the future won’t transpire as described; it might not go anything at all like what they describe.”
Our reading: The future of AI is far more likely not to unfold as the AI 2027 scenario describes than to unfold that way.
No horizon
Assessment: Can’t be checkedSaid
Observation
“We kinda sorta have stumbling agents now, (though I don’t think there is a single agent yet that any reader here would trust to actually act on their behalf without monitoring).”
Our reading: We kinda sorta have stumbling AI agents now, and Marcus does not think there is yet a single agent that any of his readers would trust to act on their behalf without monitoring.
No horizon Evidence as of
Limitation: The product documentation does not measure reader trust.
Assessment: SupportedSaid
Observation
“Remember how we were told in 2023 that hallucinations would be solved in a matter of months? They are still here.”
Our reading: Despite 2023 promises that hallucinations would soon be solved, they persist as of May 2025.
No horizon Evidence as of
Limitation: Relies mainly on one developer's internal benchmarks.
Assessment: Can’t be checkedSaid
Forecast
“In reality, the chance that we will have reliable AI agents that truly advance AI research by the end of the year is small.”
Our reading: There is only a small chance that reliable AI agents that truly advance AI research will exist by the end of 2025.
No horizon
Assessment: Can’t be checkedSaid
Forecast
“And some of what they describe (like AI’s going rogue, completely beyond human control) might never happen.”
Our reading: AI going rogue and completely beyond human control might never happen.
No horizon
Assessment: Can’t be checkedSaid
Forecast
“In all likelihood the hallucinations and boneheaded errors that have bedeviled LLMs since their introduction will plague agents (which are after all built on LLMs), too.”
Our reading: AI agents, being built on LLMs, will likely be plagued by the same hallucinations and boneheaded errors as LLMs.
No horizon
Qualifier: because agents are built on LLMs
Assessment: Can’t be checkedSaid
Forecast
“Far more likely is that Agent-1 type systems will be in a kind of “just a demo, still being debugged” phase for years.”
Our reading: Agent-1-type AI agents will likely remain in a 'just a demo, still being debugged' phase for years.
No horizon
Assessment: Can’t be checkedSaid
Observation
“First of all, LLMs like GPT-4 have been getting smarter every day since OpenAI first showed GPT-4 to Bill Gates in the summer of 2022, but we still don’t have GPT-5 level intelligence, let alone Agent-2-level.”
Our reading: Despite incremental daily improvement since 2022, LLMs still have not reached GPT-5-level intelligence.
No horizon
Assessment: Can’t be checkedSaid
Rhetoric
“Breakthroughs in “neuralese recurrence” (whatever that is) and memory (which real-world people have been working on for decades, with relatively little success) and “iterated distillation and amplification” comes straight from the kind of writing that gave us Star Trek’s “positronic brain”.”
Our reading: The scenario's breakthroughs in neuralese recurrence, memory (which people have worked on for decades with relatively little success), and iterated distillation and amplification come straight from the kind of writing that gave us Star Trek's positronic brain.
No horizon
Assessment: Can’t be checkedSaid
Observation
“Another unsatisfying move is the jump from having agents that predict internet text (which is basically what all current text-based LLMs do) to agents that have basic personalities and drives – which is entirely speculative and something that no actual LLM has.”
Our reading: No actual LLM has basic personalities and drives; current LLMs basically predict internet text.
No horizon
Assessment: Can’t be checkedSaid
Recommendation or value judgment
“The fictional force is strong in this team, but taken as an actual piece of forecasting, the scenario is unconvincing.”
Our reading: Taken as an actual piece of forecasting, the AI 2027 scenario is unconvincing.
No horizon
Scope: taken as an actual piece of forecasting
Assessment: Can’t be checkedSaid
Forecast
“such as those coding machines taking on human personalities and drives (which might happen never or not soon), and choosing to enslave us (which some thinkers like Steve Pinker argue is deeply unlikely, ever, and which I think is possible but very far from certain).”
Our reading: AI taking on human-like drives might never happen or not soon, and AI choosing to enslave humans is possible but very far from certain.
No horizon
Assessment: Can’t be checkedSaid
Forecast
“All of which is to say the central scenario in the story is a worst-case scenario that is unlikely to happen soon - if ever —even based on the data presented in the author’s own appendix.”
Our reading: The AI 2027 worst-case scenario is unlikely to happen soon, if ever.
No horizon
Assessment: Can’t be checkedSaid
Conditional forecast
“And you could worry about that even if you don’t expect machines to go rogue, since bad human actors could certainly use further advances in intelligence to cause mayhem, if those advances are left unchecked.”
Our reading: If advances in AI are left unchecked, bad human actors could use them to cause mayhem.
No horizon
Only if: if those advances are left unchecked
Assessment: Can’t be checkedSaid
Observation
“The authors are trying to call attention to a real problem: we are not sufficiently prepared for what happens when and if “superhuman intelligence” arrives, especially not if it is misaligned with humans.”
Our reading: We are not sufficiently prepared for the arrival of superhuman intelligence, especially if it is misaligned.
No horizon
Qualifier: when and if superhuman intelligence arrives
Assessment: Can’t be checkedSaid
Conditional forecast
“We certainly aren’t prepared now, and if we don’t get moving, we won’t be prepared in 10, either.”
Our reading: We are not prepared for AGI now, and unless we act, we will not be prepared in ten years either.
No horizon
Only if: if we don't get moving
Assessment: Can’t be checkedSaid
Causal claim
“But here’s the thing - projects like AI 2027 are probably having a paradoxical effect. They are written with the intention of slowing down an arms race to build a technology that we can’t control, but what they are actually doing is speeding up that very arms race, in two different ways.”
Our reading: Projects like AI 2027 are probably speeding up the AI arms race they intend to slow.
No horizon
Assessment: UnresolvedSaid
Causal claim
“Their stories about this are, in my view, greatly flawed, but having outside groups with science fiction chops writing stuff like this distracts away from those flaws, and gives more power to the very companies trying hardest to race towards AGI.”
Our reading: OpenAI's and Anthropic's AGI-imminence stories are greatly flawed, and outside scenarios like AI 2027 distract from those flaws and empower those companies.
No horizon Evidence as of
Limitation: The criticism of the company stories is underspecified and partly evaluative.
Assessment: UnresolvedSaid
Causal claim
“AI 2027 isn’t slowing them down; it’s putting wind (and money, and political power) in their sails.”
Our reading: AI 2027 is giving AI companies like OpenAI and Anthropic more money and political power rather than slowing them.
No horizon Evidence as of
Limitation: Investor motives and private political discussions may be unavailable.
Assessment: UnresolvedSaid
Forecast
“It’s also encouraging the world to make short-term choices about AI (e.g., making plans around export controls when China will inevitably catch up) rather than longer-term choices (investing in research to develop safer, more alignable approaches to AI).”
Our reading: China will inevitably catch up in AI despite export controls.
No deadline stated Evidence as of
Limitation: The interpretation of catch up materially affects the result.
Assessment: UnresolvedSaid
Causal claim
“Tall tales about the imminence of AGI aren’t slowing down the AI race dynamic that the authors of AI-2027 want to mitigate; they are speeding that very dynamic up.”
Our reading: Stories claiming AGI is imminent are speeding up, not slowing, the AI race dynamic.
No horizon Evidence as of
Limitation: The accessible experimental evidence measures attention, not development decisions.
Assessment: Can’t be checkedSaid
Rhetoric
“Sam Altman is laughing his way all the way to the bank.”
Our reading: Sam Altman is laughing all the way to the bank.
No horizon
Assessment: Can’t be checkedSaid
Causal claim
“But international collaboration, such as a massive global effort, ala CERN for AI, such as I suggested in 2017, focused on AI safety, might be one way to avoid the very perils they describe.”
Our reading: International collaboration, such as a massive global CERN-like effort for AI focused on AI safety, might be one way to avoid the perils AI 2027 describes.
No horizon
Qualifier: focused on AI safety
Assessment: Can’t be checkedSaid
Conditional forecast
“Such an effort might be particularly likely to succeed it were focused on developing altogether new, more transparent approaches to AI, in contrast to the current fad of trying to pull alignment out of black box LLMs, which has thus far yielded little fruit.”
Our reading: An international AI safety effort might be especially likely to succeed if it focused on new, more transparent approaches to AI rather than on aligning black-box LLMs.
No horizon
Only if: if focused on new, more transparent approaches to AI
Assessment: Can’t be checkedSaid
Conditional forecast
“If “great” AI research agents don’t arrive by the end of 2025, everything in the rest of the essay gets moved back.”
Our reading: If 'great' AI research agents do not arrive by the end of 2025, everything later in the AI 2027 scenario's timeline is pushed back.
Deadline passed Evidence as of
Only if: 'great' AI research agents do not arrive by the end of 2025
Held from this post (4)
These records did not pass every check, so nothing about them is published. Held is not a finding.
- The two reviews read the claim differently
- The two reviews read the claim differently
- The two reviews read the claim differently
- The two reviews reached different assessments. Our reading, not assessed: Companies churning out synthetic math problems, especially since last fall, have produced considerable improvements on math and coding, but those gains have been far from universal.