Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

April fools bring May hallucinations

We recorded 2 claims from this post. 2 were checked against evidence. 1 more is held. Read the post at its source.

Claims from this post (2)

In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.

  1. Assessment: UnresolvedSaid

    Observation

    “An LLM just spits back (sometimes in transmogrified form) what it has read.”

    Our reading: An LLM just spits back what it has read, sometimes in transmogrified form.

    No horizon Evidence as of

    Limitation: Unresolved does not mean that the evidence favors the claim.

  2. Assessment: UnresolvedSaid

    Observation

    “Humans are (usually, if well-motivated) smart enough to sort things like jokes and fiction from reality, but current AI doesn’t have a clue.”

    Our reading: Current AI systems cannot tell jokes and fiction apart from reality, while well-motivated humans usually can.

    No horizon Evidence as of

    Limitation: The cited studies do not establish either representative failures or a usable ability on the specified fiction-versus-fact task during the assessment period.

Held from this post (1)

These records did not pass every check, so nothing about them is published. Held is not a finding.

  • The criteria are ambiguous. Our reading, not assessed: Current AI only absorbs and mimics data and never reflects critically on it.