“But not this year (or next, or the one after that, and probably not this decade, except in narrow use cases).”
Our reading:
AI agents will not do a huge fraction of human knowledge work in 2025, 2026, or 2027, except in narrow use cases.
Assessment: Unresolved Not yet due
What happened
Did the forecast come true?
Outcome: Unresolved
We checked, and the evidence so far doesn’t settle it.
Judged on a plain reading. They named no measure, so we used the reading a typical informed reader would take. It is spelled out under “How we judged it”.
Evidence up to . Checked .
Why
Marcus forecast that AI agents would not do a huge fraction of human knowledge work in 2025, 2026 or 2027, except in narrow use cases. The window ends on 31 December 2027, after the evaluation date. Under the contract, the forecast cannot be supported before then. A preprint posted on 30 October 2025 reported that the highest-performing agent reached an automation rate of 2.5% on its Remote Labor Index, a benchmark of real-world projects (e1). That is a benchmark result. It does not measure the share of knowledge work agents actually did across the economy. The packet has no such economy-wide measure. So the early-contradiction rule is not met. That rule needs credible measurement showing agents doing a large share of knowledge work broadly.
Caveats
- The packet has no economy-wide measure of the share of knowledge work done by agents.
- Benchmark results are not the same as real-world deployment data.
- 'Huge fraction' and 'narrow use cases' have no defined thresholds.
- A McKinsey survey on agent adoption could not be loaded and was not used.
Evidence (1 item)
Context only: arXiv (Scale AI / Center for AI Safety),
AI agents perform near the floor on RLI, with the highest-performing agent achieving an automation rate of 2.5%.
Why it matters: In late 2025, agents automated very little end-to-end remote work. That fits the forecast so far, but the window runs to the end of 2027.
- Where
- Abstract
- Publisher
- arXiv (Scale AI / Center for AI Safety)
- Kind of source
- Preprint, not peer reviewed
- About events on
- Published
How we judged it
- Kind of claim
- Forecast
- Deadline
- “this year (or next, or the one after that”
- As of 2026-11-01
- Not yet due
Conditions
- except in narrow use cases (their words)
Where we had to interpret
- Read as: in 2025, 2026 and 2027, AI agents will not do a huge fraction of human knowledge work, except in narrow use cases.
- The firm deadline is the end of 2027. 'Probably not this decade' is hedged, so it is not scored.
- 'Huge fraction' is read as a large share of knowledge work across the economy, well beyond a few narrow tasks.
Right if: Through the end of 2027, labor and adoption data show that agents do only a small share of knowledge work overall, beyond narrow uses such as coding or customer service.
Wrong if: Credible data show that, at some point in 2025–2027, agents did a large share of knowledge work broadly, not just in narrow niches.
We wrote this test before the deadline, while the outcome was unknown.
What would settle it
Official statistics, independent measurement or large representative surveys through the end of 2027 showing whether agents did a large share of knowledge work beyond narrow uses.
We found 9 claims in this post. See them all.
Full record
Source and dates
Marcus on AI, AI Agents: Hype versus Reality, redux, paragraph 5.
- Said
- We read the source
- live page, full text, public
- Evidence up to
- Checked
We read this wording on 2026-10-28. The post may have been edited after 2025-01-15.
Where it was said (1)
Said once in the posts we read.
: Marcus on AI, AI Agents: Hype versus Reality, redux
But not this year (or next, or the one after that, and probably not this decade, except in narrow use cases).
- Where
- paragraph 5
- Published
- 2025-01-15
- We read it
- , live page
- Access
- full text, public
History
Versions
- Current: Unresolved. Evidence up to 2026-10-28.
What happened to this record
PublishedBy us
Published after both AI reviews and the final check passed.
Held backBy us
The final check of the write-up failed.