“Nothing in the o3 presentation yesterday suggested to me that this decades-old core problem has been remotely solved.”
Our reading, the sentence that was checked:
Nothing in the o3 presentation suggested to Marcus that the decades-old core problem of neural networks generalizing better within distribution than outside it has been remotely solved.
Assessment: Can’t be checked Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, o3, AGI, the art of the demo, and what you can expect in 2025, paragraph 39.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-o3-agi-the-art-of-the-demo-and-what-f650e9-a1
We recorded 15 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2024-12-21. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
Conditions
- suggested to me (qualifier, stated by the speaker)
- in the o3 presentation (scope, stated by the speaker)
From the speaker
- Nothing in the o3 presentation yesterday
- suggested to me
- this decades-old core problem
- has been remotely solved
Our interpretation
- 'Yesterday' identifies the December 20, 2024 presentation.
- The core problem refers to the preceding discussion of within-distribution versus outside-distribution generalization.
- The sentence reports Marcus's personal impression. Treating it as an objective assertion that the presentation contained no relevant evidence would remove 'suggested to me' and strengthen his commitment.
This claim is not graded on evidence. The record checks that the words are quoted correctly and attributed to the right person, and that the claim is classified correctly.
Current assessment
Not graded on evidence
Outcome: Can’t be checked
The statement is a recommendation, a value judgment, or too open to test. It is recorded, not scored.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
The exact wording reports a personal impression. Public evaluations can test whether o3 demonstrated progress or retained limitations, but cannot test what those results suggested to Marcus. Scoring an objective substitute would change the claim.
Limitations
- This outcome makes no judgment about whether the presentation established a general solution to distribution shift.
Evidence (0 items)
No outcome evidence: a claim of this kind is recorded and attributed, not scored.
What would settle it
An independently assessable claim would need an objective statement about the demonstrated capabilities and a stated criterion for solving the problem.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, o3, AGI, the art of the demo, and what you can expect in 2025
Nothing in the o3 presentation yesterday suggested to me that this decades-old core problem has been remotely solved.
- Where
- paragraph 39
- Published
- 2024-12-21
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-o3-agi-the-art-of-the-demo-and-what-f650e9-a1: Current. Outcome: Can’t be checked. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-o3-agi-the-art-of-the-demo-and-what-f650e9-a1.