“Pure LLMs are inevitably stuck in the past, tied to when they are trained, and deeply limited in their inherent abilities to reason, search the web, “think” critically etc.”
Our reading, the sentence that was checked:
Pure LLMs are inevitably stuck in the past of their training and deeply limited in inherent abilities to reason, search the web, and think critically.
Assessment: Can’t be checked Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Why ChatGPT can’t be trusted with breaking news, paragraph 9.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-why-chatgpt-cant-be-trusted-with-e72c97-a2
We recorded 7 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2026-01-03. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
Conditions
- pure LLMs (qualifier, stated by the speaker)
From the speaker
- Pure LLMs
- inevitably stuck in the past
- tied to when they are trained
- deeply limited
- inherent abilities to reason, search the web, “think” critically etc.
Our interpretation
- The statement combines a concrete limitation on access to fresh information with a broad assessment of reasoning and critical thinking.
- Pure LLMs ordinarily excludes external retrieval and execution tools, but does not clearly exclude information supplied in a prompt.
- There is no sufficiently definite ordinary threshold for deeply limited across reasoning, critical thinking, and the open-ended etc.
- Scoring only the training cutoff or browsing component would silently narrow the submitted proposition.
This claim is not graded on evidence. The record checks that the words are quoted correctly and attributed to the right person, and that the claim is classified correctly.
Current assessment
Not graded on evidence
Outcome: Can’t be checked
The statement is a recommendation, a value judgment, or too open to test. It is recorded, not scored.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
The July 22, 2020 version of the GPT-3 paper reports both successes and difficulties on specific tasks, using text instructions and examples without parameter updates [e1]. Those results do not settle the broader claim: Marcus's statement supplies no model set, task standard, or threshold for judging reasoning and critical thinking as 'deeply limited' [e1; marcus-why-chatgpt-cant-be-trusted-with-e72c97-o1]. Assessing only information access would leave that undefined reasoning assessment unaddressed, so the whole statement cannot be fairly scored as written [marcus-why-chatgpt-cant-be-trusted-with-e72c97-o1].
Limitations
- The cited study concerns GPT-3 in 2020, not the capabilities of LLMs generally in January 2026 [e1].
- Its task-specific successes and difficulties establish neither an inevitable general capability ceiling nor an absence of substantial limitations [e1].
- The statement does not specify how information newly supplied in a prompt should be treated [marcus-why-chatgpt-cant-be-trusted-with-e72c97-o1].
Evidence (1 item)
No outcome evidence: a claim of this kind is recorded and attributed, not scored.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Why ChatGPT can’t be trusted with breaking news
Pure LLMs are inevitably stuck in the past, tied to when they are trained, and deeply limited in their inherent abilities to reason, search the web, “think” critically etc.
- Where
- paragraph 9
- Published
- 2026-01-03
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-why-chatgpt-cant-be-trusted-with-e72c97-a2: Current. Outcome: Can’t be checked. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-why-chatgpt-cant-be-trusted-with-e72c97-a2.