“Such errors clearly aren’t disappearing any time soon.”
Our reading, the sentence that was checked:
Errors of discomprehension in neural-network-based systems will not disappear any time soon.
Assessment: Unresolved No deadline stated on 2026-10-29 Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Where’s Waldo? The Elephant in the Room, paragraph 9.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-wheres-waldo-the-elephant-in-the-3e5dae-a1
We recorded 9 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-29. The source may have been edited after 2024-01-25. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Forecast
- Deadline, as the speaker wrote it
- “any time soon”
- Deadline state when assessed
- No deadline stated
- Deadline state on 2026-10-29
- No deadline stated (the release’s reference date)
From the speaker
- Such errors
- clearly aren’t disappearing
- any time soon
Our interpretation
- Such errors refers to basic failures to follow visual requirements or correctly interpret depicted objects and relationships.
- Disappearing means elimination of this class of errors, not merely a lower error rate.
- Any time soon supplies no calendar deadline. The suggested 2024–2026 screening window is not a deadline supplied by Marcus.
- Later examples can establish persistence at particular times without conclusively settling the unspecified duration.
Counts as supported if: Documented comparable failures persist through a near-term interval whose endpoint is established from the speaker's meaning.
Counts as contradicted if: Evidence establishes that these failures disappeared within the near-term interval intended by the speaker.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Did the forecast come true?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No deadline stated
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
Later experiments document the kind of basic visual mistakes Marcus described. They are consistent with his forecast. But scoring the statement supported would require assigning an endpoint to “any time soon” that he did not supply. No decisive event settles the forecast under the stated rule.
Limitations
- Unresolved does not mean the later evidence runs against the forecast.
- The successful controls show that the failures depend on the task and presentation.
Evidence (2 items)
Context only: arXiv; Rahmanzadehgervi and colleagues,
77.33%
Why it matters here: The reported line-intersection experiment documents basic visual errors after the post. It supports persistence in 2024 but cannot supply Marcus's missing deadline.
- Where
- Section 4.1, Results
- Publisher
- arXiv; Rahmanzadehgervi and colleagues
- Kind of source
- Preprint, not peer reviewed
- Describes events of
- Public from
Context only: arXiv; Rahmanzadehgervi and colleagues,
separately
Why it matters here: The same research includes successful visual controls. These qualify any suggestion of universal visual incapacity, while remaining compatible with the persistence of some errors.
- Publisher
- arXiv; Rahmanzadehgervi and colleagues
- Kind of source
- Preprint, not peer reviewed
- Describes events of
- Public from
What would settle it
A contemporaneous clarification establishing the intended duration would permit comparison with dated evaluations. Without that clarification, individual later failures cannot close the open horizon.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Where’s Waldo? The Elephant in the Room
Such errors clearly aren’t disappearing any time soon.
- Where
- paragraph 9
- Published
- 2024-01-25
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-wheres-waldo-the-elephant-in-the-3e5dae-a1: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-wheres-waldo-the-elephant-in-the-3e5dae-a1.