“And, reality check, we have no concrete reason, other than sheer technoptimism, for thinking that solutions to any of these problems is imminent.”
Our reading, the sentence that was checked:
There is no concrete reason, other than sheer techno-optimism, for thinking that solutions to any of generative AI's core problems (such as hallucination, unreliable tool use and month-to-month instability) are imminent.
Assessment: Unresolved Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, What if Generative AI turned out to be a Dud?, paragraph 19.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-what-if-generative-ai-turned-out-ca7169-a1
We recorded 23 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2023-08-13. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
Conditions
- other than sheer techno-optimism (qualifier, stated by the speaker)
From the speaker
- no concrete reason
- other than sheer technoptimism
- solutions to any of these problems
- imminent
Our interpretation
- This concerns the evidence available when Marcus wrote, not whether later systems improved.
- The plain reading requires an empirically grounded reason to expect a dependable near-term solution to at least one listed problem.
- A measured improvement is relevant counterevidence, but does not automatically establish that a solution is imminent.
- No numerical deadline or acceptable residual error rate is supplied; neither is invented.
- The present-tense research landscape is assessed over calendar 2023 through publication because it has no common reporting cycle.
- Other than sheer technoptimism is an exclusion from what counts as a reason, not a conditional forecast antecedent.
Counts as supported if: The contemporary record establishes that no empirically grounded case existed for a dependable near-term solution to any listed problem.
Counts as contradicted if: At least one contemporary result or deployed method provides a concrete basis for expecting a dependable near-term solution to a listed problem, beyond an unsupported promise.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
There were concrete research results and engineering remedies, so the record cannot fairly be described as optimism alone. But progress does not establish an imminent general solution. Marcus supplies neither a timeframe nor a standard for a solution. Version pinning could contradict a narrow reading about deployment stability, while leaving a broader concern about changing model behavior intact. The available evidence does not settle the full statement without choosing those meanings for him.
Limitations
- This is an assessment of contemporary grounds for expectation, not a forecast scored against later events.
- A literature search cannot prove that no relevant reason existed.
Evidence (2 items)
Context only: Yujia Qin and colleagues, arXiv,
enhances the planning and reasoning capabilities
Why it matters here: ToolLLM supplied empirical progress rather than optimism alone. Its results do not establish when general tool-use reliability would be achieved.
- Publisher
- Yujia Qin and colleagues, arXiv
- Kind of source
- Preprint, not peer reviewed
- Describes events of
- Public from
Context only: OpenAI,
research questions
Why it matters here: The announcement and its July update describe improved function calling and stable pinned versions, alongside unresolved tool-safety problems. Pinning is a concrete remedy for upgrade-induced changes, but does not resolve behavior differences between successive versions.
- Publisher
- OpenAI
- Kind of source
- Company disclosure: the company describing itself, not an independent finding
- Describes events of
- Public from
What would settle it
A specified meaning of imminent and solution, together with contemporary evidence showing whether a method met that standard or supported reaching it soon.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, What if Generative AI turned out to be a Dud?
And, reality check, we have no concrete reason, other than sheer technoptimism, for thinking that solutions to any of these problems is imminent.
- Where
- paragraph 19
- Published
- 2023-08-13
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-what-if-generative-ai-turned-out-ca7169-a1: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-what-if-generative-ai-turned-out-ca7169-a1.