“The second summary, deeply parallel with the first, outlines the process by which an unthinking LLM (without meaning to do so) cons many of its users.”
Our reading, the sentence that was checked:
An unthinking LLM, without meaning to do so, cons many of its users through a process that closely parallels a psychic's con.
Assessment: Can’t be checked Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, LLMs aren’t very bright. Why are so many people fooled?, paragraph 5.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-llms-arent-very-bright-why-are-so-f9c798-a2
We recorded 3 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-29. The source may have been edited after 2024-04-14. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
Conditions
- without meaning to do so (qualifier, stated by the speaker)
- many of its users (scope, stated by the speaker)
From the speaker
- "an unthinking LLM"
- "without meaning to do so"
- "cons many of its users"
- "deeply parallel with the first" (the psychic's con)
Our interpretation
- Part of the sentence just describes Bjarnason's essay. The essay does set out a six-step 'LLMentalist Effect' that mirrors its six-step 'psychic's con'. That description is accurate, but it is not a claim about the world.
- The substantive part is that LLMs 'con many of its users' through a mechanism like cold reading. That is an interpretive theory with no stated measure: what counts as being 'conned', how many is 'many', and how the mechanism would be shown. 'Unthinking' is also a contested philosophical label.
- Related research on sycophancy (models telling users what they want to hear) is relevant context. It does not test the cold-reading 'con' theory or how many users are misled.
This claim is not graded on evidence. The record checks that the words are quoted correctly and attributed to the right person, and that the claim is classified correctly.
Current assessment
Not graded on evidence
Outcome: Can’t be checked
The statement is a recommendation, a value judgment, or too open to test. It is recorded, not scored.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
The sentence describes Bjarnason's essay and endorses its theory. The essay does set out a six-step 'LLMentalist Effect' that it compares with a psychic's con. One step, for example, says chatbot answers sound specific to the context but are statistically generic (e1). The endorsed theory says an 'unthinking' LLM 'cons many of its users' without meaning to. The claim gives no measure of being 'conned' and no threshold for 'many', and 'unthinking' is a contested label. A sycophancy study reports that five AI assistants consistently gave answers matching user beliefs across four text-generation tasks (e2). That is related to the essay's idea of validation. But it does not measure how many users are misled about LLM abilities, or whether a cold-reading-like process is the cause. The claim cannot be scored as true or false.
Limitations
- The essay page shows no publication date. Its date is recorded as 2023 based on Marcus's note ('from last year'), and its available_at is the post date.
- e1 is an opinion essay. It shows what the essay argues, not that users are actually misled.
- The cited version of e2 is dated 10 May 2025, after the post. The study's first version is dated 20 October 2023.
- No source in the packet measures what share of users are misled about LLM abilities.
- The description of the essay's content was not graded separately.
Evidence (2 items)
No outcome evidence: a claim of this kind is recorded and attributed, not scored.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, LLMs aren’t very bright. Why are so many people fooled?
The second summary, deeply parallel with the first, outlines the process by which an unthinking LLM (without meaning to do so) cons many of its users.
- Where
- paragraph 5
- Published
- 2024-04-14
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-llms-arent-very-bright-why-are-so-f9c798-a2: Current. Outcome: Can’t be checked. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-llms-arent-very-bright-why-are-so-f9c798-a2.