Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

Gary Marcus Observation First said

“Once again, the result was fluent prose, and once again, hallucination ruled:”

Is ChatGPT Really a “Code Red” for Google Search?, paragraph 34. The full statement is at the source.

Our reading, the sentence that was checked:

YouChat, though tailored for search, produced fluent but hallucinated answers to his friend's queries.

Assessment: Unresolved Evidence as of

Where and when Gary Marcus wrote it

Marcus on AI, Is ChatGPT Really a “Code Red” for Google Search?, paragraph 34.

Said
Source observed
live page, full text, public
Evidence as of
the cutoff for this assessment
Assessment recorded
assessment marcus-is-chatgpt-really-a-code-red-for-85eab8-a1

We recorded 13 claims from this post. See every claim from this post.

The wording above is the version this site observed on 2026-10-29. The source may have been edited after 2022-12-30. This page does not claim the wording was captured then.

What the claim commits to

Kind
Observation
Deadline, as the speaker wrote it
None stated. This site does not add one.
Deadline state when assessed
No horizon
Deadline state on 2026-10-29
No horizon (the release’s reference date)

From the speaker

  • the result was fluent prose
  • hallucination ruled
  • I tried submitting them to YouChat
  • A Mighty Wind
  • they didn’t run one in 2019 on this particular topic

Our interpretation

  • Assess the two particular YouChat exchanges described in the post, not YouChat's overall error rate.
  • Read 'hallucination' as factual inventions or incorrect factual associations presented as answers.
  • Use December 1–30, 2022 because the post describes current December experiments but does not date the individual exchanges.
  • The film's actual contents and the polling record can establish errors only after the corresponding YouChat answers have been independently established.

Counts as supported if: An independently preserved record of the exchanges shows fluent responses falsely identifying the film and inventing or misattributing the polling study or its findings.

Counts as contradicted if: Authenticated records show that the described exchanges contained accurate, appropriately qualified answers or materially differed from the outputs Marcus attributed to YouChat.

Retrospective: these criteria were written after the outcome was public.

Current assessment

Was it true for the period described?

Outcome: Unresolved

The record was checked, and the evidence available by the cutoff does not settle it.

Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.

Evidence as of
Deadline state when assessed
No horizon
Assessment recorded
Policy version
2026-10-28.7

Rationale

Contemporary reporting confirms that YouChat could return wrong information, but that does not verify these particular exchanges. Searches did not locate an independent record of the film answer or the purported NORC/AP survey answer. The claim remains unresolved under the requirement not to use Marcus's own writing as evidence that he was right.

Limitations

  • Unresolved does not mean the reported exchanges were false.
  • A modern rerun could not establish what the December 2022 system actually returned.

Evidence (1 item)

  • Context only: The Indian Express,

    youChat often outputs wrong information to very basic questions.

    Why it matters here: Contemporary reporting makes the described failure plausible, but it does not authenticate Marcus's film or polling exchanges. It therefore cannot settle this specific observation.

    Publisher
    The Indian Express
    Kind of source
    News report
    Describes events of
    Public from

What would settle it

An independently preserved December 2022 transcript or platform log of both exchanges, followed by comparison with the film record and the exact survey attribution and figures.

Where it was said (1)

Said once in the sources this register covers.

  • : Marcus on AI, Is ChatGPT Really a “Code Red” for Google Search?

    Once again, the result was fluent prose, and once again, hallucination ruled:

    Published
    2022-12-30
    Source observed
    , live page
    Access
    full text, public

History

Assessment versions

Recorded events

  1. Assessment publishedBy this site

    First assessment published after both reviews and the final-text check passed.

    About assessment marcus-is-chatgpt-really-a-code-red-for-85eab8-a1.