Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

“But not this year (or next, or the one after that, and probably not this decade, except in narrow use cases).”

AI Agents: Hype versus Reality, redux, paragraph 5.

Our reading:

AI agents will not do a huge fraction of human knowledge work in 2025, 2026, or 2027, except in narrow use cases.

Assessment: Unresolved Not yet due

What happened

Did the forecast come true?

Outcome: Unresolved

We checked, and the evidence so far doesn’t settle it.

Judged on a plain reading. They named no measure, so we used the reading a typical informed reader would take. It is spelled out under “How we judged it”.

Evidence up to . Checked .

Why

Marcus forecast that AI agents would not do a huge fraction of human knowledge work in 2025, 2026 or 2027, except in narrow use cases. The window ends on 31 December 2027, after the evaluation date. Under the contract, the forecast cannot be supported before then. A preprint posted on 30 October 2025 reported that the highest-performing agent reached an automation rate of 2.5% on its Remote Labor Index, a benchmark of real-world projects (e1). That is a benchmark result. It does not measure the share of knowledge work agents actually did across the economy. The packet has no such economy-wide measure. So the early-contradiction rule is not met. That rule needs credible measurement showing agents doing a large share of knowledge work broadly.

Caveats

  • The packet has no economy-wide measure of the share of knowledge work done by agents.
  • Benchmark results are not the same as real-world deployment data.
  • 'Huge fraction' and 'narrow use cases' have no defined thresholds.
  • A McKinsey survey on agent adoption could not be loaded and was not used.

Evidence (1 item)

  • Context only: arXiv (Scale AI / Center for AI Safety),

    AI agents perform near the floor on RLI, with the highest-performing agent achieving an automation rate of 2.5%.

    Why it matters: In late 2025, agents automated very little end-to-end remote work. That fits the forecast so far, but the window runs to the end of 2027.

    Publisher
    arXiv (Scale AI / Center for AI Safety)
    Kind of source
    Preprint, not peer reviewed
    About events on
    Published

How we judged it

Kind of claim
Forecast
Deadline
“this year (or next, or the one after that”
As of 2026-11-01
Not yet due

Conditions

  • except in narrow use cases (their words)

Where we had to interpret

  • Read as: in 2025, 2026 and 2027, AI agents will not do a huge fraction of human knowledge work, except in narrow use cases.
  • The firm deadline is the end of 2027. 'Probably not this decade' is hedged, so it is not scored.
  • 'Huge fraction' is read as a large share of knowledge work across the economy, well beyond a few narrow tasks.

Right if: Through the end of 2027, labor and adoption data show that agents do only a small share of knowledge work overall, beyond narrow uses such as coding or customer service.

Wrong if: Credible data show that, at some point in 2025–2027, agents did a large share of knowledge work broadly, not just in narrow niches.

We wrote this test before the deadline, while the outcome was unknown.

What would settle it

Official statistics, independent measurement or large representative surveys through the end of 2027 showing whether agents did a large share of knowledge work beyond narrow uses.

We found 9 claims in this post. See them all.

Full record

Source and dates

Marcus on AI, AI Agents: Hype versus Reality, redux, paragraph 5.

Said
We read the source
live page, full text, public
Evidence up to
Checked

We read this wording on 2026-10-28. The post may have been edited after 2025-01-15.

Where it was said (1)

Said once in the posts we read.

  • : Marcus on AI, AI Agents: Hype versus Reality, redux

    But not this year (or next, or the one after that, and probably not this decade, except in narrow use cases).

    Published
    2025-01-15
    We read it
    , live page
    Access
    full text, public

History

Versions

  • Current: Unresolved. Evidence up to 2026-10-28.

What happened to this record

  1. PublishedBy us

    Published after both AI reviews and the final check passed.

  2. Held backBy us

    The final check of the write-up failed.