“ChatGPT is (at least in many ways) a far inferior intelligence, that, despite having some undeniable talents, cannot at all be trusted.”
Our reading, the sentence that was checked:
ChatGPT is in many ways a far inferior intelligence and cannot be trusted.
Assessment: Supported Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, AGI will not happen in your lifetime. Or will it?, paragraph 53.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-agi-will-not-happen-in-your-lifetime-2b78a1-a2
We recorded 28 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-29. The source may have been edited after 2023-01-22. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
From the speaker
- ChatGPT
- at least in many ways
- a far inferior intelligence
- some undeniable talents
- cannot at all be trusted
Our interpretation
- Plain reading: ChatGPT as it existed at the time of the post was far less capable than human intelligence in many respects, and its answers were too unreliable to trust without checking.
- The testable core is reliability: did ChatGPT often give confident but wrong answers in the period from its launch on 2022-11-30 to the post on 2023-01-22?
- 'Cannot at all be trusted' is read as 'cannot be relied on', not as 'never says anything true'. The speaker himself grants it has talents.
Counts as supported if: Credible sources from that period, including OpenAI itself or independent evaluators, document that ChatGPT often produced plausible but incorrect answers, so its output could not be relied on.
Counts as contradicted if: Evaluations from that period show ChatGPT's answers were reliably accurate, so users could reasonably trust them without checking.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Supported
The dated evidence matches what the claim committed to, under the criteria frozen before grading.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
The contract reads the claim as saying that ChatGPT was far less capable than human intelligence in many ways, and that its answers could not be relied on without checking. It scores the reliability part. OpenAI's launch post of 2022-11-30 said ChatGPT 'sometimes writes plausible-sounding but incorrect or nonsensical answers' (e1). On 2022-12-05, The Register reported that Stack Overflow had banned ChatGPT answers. Stack Overflow said 'the average rate of getting correct answers from ChatGPT is too low' and that the answers often needed a detailed read by someone with subject knowledge (e2). Both sources fall within the target period of 2022-11-30 to 2023-01-22. Both meet the support condition that ChatGPT's output could not be relied on without checking. The packet lists no counterevidence. The 'far inferior intelligence' part is hedged with 'in many ways' and has no set measure, so this verdict does not rest on it.
Limitations
- The evidence does not measure the 'far inferior intelligence' part. Neither source compares ChatGPT's overall intelligence with human intelligence.
- 'Cannot at all be trusted' is read as 'cannot be relied on'. The evidence does not test a literal reading that none of ChatGPT's answers could be trusted.
- Neither source gives a measured error rate. OpenAI says 'sometimes', and Stack Overflow says the rate of correct answers is 'too low'.
- Stack Overflow's statement covers answers posted to its site, which were mostly about programming. It is quoted through a news report because the primary policy page could not be read.
Evidence (2 items)
Supports the claim: OpenAI,
ChatGPT sometimes writes plausible-sounding but incorrect or nonsensical answers.
Why it matters here: The developer itself said, at launch, that ChatGPT gives plausible but wrong answers. This supports the claim that its output could not be trusted without checking.
- Publisher
- OpenAI
- Kind of source
- Company disclosure: the company describing itself, not an independent finding
- Describes events of
- Public from
Supports the claim: The Register,
"The average rate of getting correct answers from ChatGPT is too low," Stack Overflow said in a policy statement entitled "ChatGPT is banned."
Why it matters here: A major programming Q&A site banned ChatGPT answers within a week of launch because they were wrong too often. This is independent evidence that its answers were unreliable in the period described.
- Where
- Paragraph 3
- Publisher
- The Register
- Kind of source
- News report
- Describes events of
- Public from
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, AGI will not happen in your lifetime. Or will it?
ChatGPT is (at least in many ways) a far inferior intelligence, that, despite having some undeniable talents, cannot at all be trusted.
- Where
- paragraph 53
- Published
- 2023-01-22
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-agi-will-not-happen-in-your-lifetime-2b78a1-a2: Current. Outcome: Supported. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-agi-will-not-happen-in-your-lifetime-2b78a1-a2.