“Core problems like hallucinations aren’t going way.”
Our reading, the sentence that was checked:
Core generative AI problems like hallucinations are not going away.
Assessment: Unresolved No deadline stated on 2026-10-29 Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, When Will the GenAI Bubble Burst?, paragraph 11.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-when-will-the-genai-bubble-burst-99c8c9-a1
We recorded 19 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2024-03-31. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Forecast
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No deadline stated
- Deadline state on 2026-10-29
- No deadline stated (the release’s reference date)
Conditions
- like hallucinations (scope, stated by the speaker)
From the speaker
- Core problems
- like hallucinations
- aren’t going way
Our interpretation
- The ordinary reading is that hallucinations will remain a material problem in general-purpose generative AI.
- The apparent typo 'going way' is read as 'going away'.
- Like hallucinations supplies an example, not a conditional antecedent.
- The sentence supplies no deadline. The nearby statement about astonishment at human-expert levels by the end of 2024 is not imported as this claim's deadline.
- Effective elimination must preserve useful factual answering; refusing every question would not establish that the problem has been solved.
Counts as supported if: A conclusive result establishes persistence throughout the forecast's scope. Continued errors over a finite observation period are supporting observations but cannot settle this open-ended forecast.
Counts as contradicted if: Independent, replicated evaluations establish durable effective elimination of hallucinations across representative general-purpose factual tasks and practical deployments.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Did the forecast come true?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No deadline stated
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
Later research documents continuing hallucinations, which is consistent with Marcus's prediction. But he gave this sentence no deadline. Continued failures cannot conclusively establish indefinite persistence, and the search did not establish a decisive elimination event. The forecast remains open.
Limitations
- The cited persistence observation is from September 2025, not a complete audit of every system available at the evaluation date.
- Improvement or success on a narrow benchmark would not meet the stated early-resolution rule.
Evidence (1 item)
Supports the claim: arXiv; Adam Tauman Kalai, Ofir Nachum, Santosh S. Vempala and Edwin Zhang,
persist even in state-of-the-art systems
Why it matters here: This documents persistence after the forecast and examines training and evaluation incentives that sustain errors. It does not establish persistence indefinitely or rule out a later solution.
- Publisher
- arXiv; Adam Tauman Kalai, Ofir Nachum, Santosh S. Vempala and Edwin Zhang
- Kind of source
- Preprint, not peer reviewed
- Describes events of
- Public from
What would settle it
A dated, independently replicated demonstration that general-purpose systems have durably overcome hallucinations across broad factual uses while retaining useful answer coverage.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, When Will the GenAI Bubble Burst?
Core problems like hallucinations aren’t going way.
- Where
- paragraph 11
- Published
- 2024-03-31
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-when-will-the-genai-bubble-burst-99c8c9-a1: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-when-will-the-genai-bubble-burst-99c8c9-a1.