“What that means is that a quarter century has passed without a principled solution to even one of those problems.”
Our reading, the sentence that was checked:
In the quarter century since 2001, none of the listed AGI prerequisites (generalization, abstract reasoning, tracking individuals, understanding structure) has received a principled solution.
Assessment: Unresolved Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Ezra Klein’s new take on AGI – and why I think it’s probably wrong, paragraph 24.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-ezra-kleins-new-take-on-agi-and-why-302371-a1
We recorded 29 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2025-03-05. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
From the speaker
- a quarter century has passed
- without a principled solution
- to even one of those problems
- published in 2001
- written the year before
Our interpretation
- The four problems are generalization to new instances, abstract reasoning, tracking individuals and properties without hallucination, and understanding complex syntax and semantics.
- The plain contextual reading of a principled solution is a reliable general method for at least one capability, not a narrow task-specific algorithm or benchmark improvement.
- Treat quarter century as approximate. The stated history runs from the book’s writing in 2000 through March 5, 2025.
- Evidence of failures in selected models cannot by itself establish that the entire field lacks a solution.
Counts as supported if: A sufficiently broad research record establishes that all four capabilities still lack reliable general solutions by the post date.
Counts as contradicted if: A reproducible, established method provides a reliable general solution to at least one of the four capabilities by the post date.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
Primary evaluations document remaining reasoning failures, but also substantial gains in novel-task adaptation. Neither finding establishes whether the field had a reliable general solution to any entire prerequisite. The field-wide negative is broader than the retrieved evidence, and its undefined standard materially affects the result.
Limitations
- A narrow successful algorithm would not refute the contextual claim about general capabilities.
- A benchmark failure would not rule out other methods.
- The ARC result concerns the tested December preview, not later released versions of o3.
Evidence (2 items)
Context only: arXiv,
performance of all models
Why it matters here: The tested models show fragility under controlled changes to mathematical questions. This supports concern about reliable reasoning in those models, but does not establish a field-wide absence of solutions to all four capabilities.
- Publisher
- arXiv
- Kind of source
- Preprint, not peer reviewed
- Describes events of
- Public from
Context only: ARC Prize,
some very easy tasks
Why it matters here: ARC Prize reports 75.7% and 87.5% on its semi-private evaluation for two compute settings of the tested o3 preview, describing substantial progress in novel-task adaptation. It also documents remaining easy-task failures, so the result neither proves a general solution nor supports an absence of progress.
- Publisher
- ARC Prize
- Kind of source
- Benchmark result
- Describes events of
- Public from
What would settle it
An explicit capability-level standard and a comprehensive assessment of proposed methods through March 5, 2025, or a reproducible general solution meeting that standard for one listed capability.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Ezra Klein’s new take on AGI – and why I think it’s probably wrong
What that means is that a quarter century has passed without a principled solution to even one of those problems.
- Where
- paragraph 24
- Published
- 2025-03-05
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-ezra-kleins-new-take-on-agi-and-why-302371-a1: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-ezra-kleins-new-take-on-agi-and-why-302371-a1.