“All that said, much more fundamental problems remain and, until those problems are addressed, the ability of AI to apply mathematics to real world situation will remain limited.”
Our reading, the sentence that was checked:
Until fundamental problems are addressed, AI's ability to apply mathematics to real-world situations will remain limited.
Assessment: Can’t be checked Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Getting GPT to work with external tools is harder than you think, paragraph 19.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-getting-gpt-to-work-with-external-903974-a1
We recorded 14 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-29. The source may have been edited after 2023-10-23. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Conditional forecast
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
Conditions
- until fundamental problems are addressed (antecedent, stated by the speaker)
From the speaker
- much more fundamental problems remain
- until those problems are addressed
- the ability of AI to apply mathematics to real world situation
- will remain limited
Our interpretation
- The sentence proposes a necessary condition for future improvement, without specifying an observable test for satisfying that condition.
- The surrounding discussion identifies reasoning and mathematical understanding as concerns, but does not define when they count as addressed.
- No ordinary, sufficiently definite threshold separates limited capability from the forecast's failure.
This claim is not graded on evidence. The record checks that the words are quoted correctly and attributed to the right person, and that the claim is classified correctly.
Current assessment
Not graded on evidence
Outcome: Can’t be checked
The statement is a recommendation, a value judgment, or too open to test. It is recorded, not scored.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
On reflection, this conditional forecast cannot be scored fairly as written. Fundamental problems, addressed and limited lack observable boundaries. A successful system could be described either as contradicting the prediction or as having addressed the problems. Choosing between those readings would add a commitment the speaker did not make.
Limitations
- This is a finding about the claim's testability, not a finding that its concern is false.
- No outcome search can supply the missing commitments without changing the claim.
Evidence (0 items)
No outcome evidence: a claim of this kind is recorded and attributed, not scored.
What would settle it
Define the relevant fundamental problems, an independent test for their being addressed, and the real-world task and reliability threshold that would count as escaping the stated limitation.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Getting GPT to work with external tools is harder than you think
All that said, much more fundamental problems remain and, until those problems are addressed, the ability of AI to apply mathematics to real world situation will remain limited.
- Where
- paragraph 19
- Published
- 2023-10-23
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-getting-gpt-to-work-with-external-903974-a1: Current. Outcome: Can’t be checked. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-getting-gpt-to-work-with-external-903974-a1.