Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

Death of a Chatbot, body blow to an industry

We recorded 4 claims from this post. 1 was checked against evidence. 3 can’t be checked. 1 more is held. Read the post at its source.

Claims from this post (4)

In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.

  1. Assessment: Can’t be checkedSaid

    Recommendation or value judgment

    “In the tech industry, this should be the top story.”

    Our reading: The Air Canada chatbot ruling should be the top story in the tech industry.

    No horizon

    Qualifier: in the tech industry

  2. Assessment: SupportedSaid

    Observation

    “In brief, an Air Canada chatbot confabulated (“hallucinated”) an answer – telling a customer that bereavement trips would be refunded.”

    Our reading: An Air Canada chatbot hallucinated an answer telling a customer that bereavement trips would be refunded.

    No horizon Evidence as of

    Limitation: Support depends on reading refunded as including a partial refund and hallucinated as a description of incorrect policy information.

  3. Assessment: Can’t be checkedSaid

  4. Assessment: Can’t be checkedSaid

    Conditional forecast

    “If other judges rule the same way, and hold companies responsible for the nonsense their chatbots say, one of the biggest alleged use cases for large language models could dry up, fast.”

    Our reading: If other judges rule the same way and hold companies responsible for the nonsense their chatbots say, one of the biggest alleged use cases for large language models could dry up fast.

    No horizon

    Only if: other judges rule the same way

Held from this post (1)

These records did not pass every check, so nothing about them is published. Held is not a finding.