Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

“These are not things that you can train in a dataset, because they're derived from experiences inside and outside of the creative process.”

Pop Culture, paragraph 29. The full statement is at the source.

Our reading, the sentence that was checked:

The adaptability, judgment and responsibility of human creative workers cannot be trained into AI via datasets.

Assessment: Can’t be checked Evidence as of

Where and when Ed Zitron wrote it

Where's Your Ed At, Pop Culture, paragraph 29.

Said
Source observed
live page, full text, public
Evidence as of
the cutoff for this assessment
Assessment recorded
assessment wyea-pop-culture-65bdc5-a2

We recorded 27 claims from this post. See every claim from this post.

The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2024-07-08. This page does not claim the wording was captured then.

What the claim commits to

Kind
Observation
Deadline, as the speaker wrote it
None stated. This site does not add one.
Deadline state when assessed
No horizon
Deadline state on 2026-10-29
No horizon (the release’s reference date)

From the speaker

  • not things that you can train in a dataset
  • derived from experiences inside and outside of the creative process
  • outsourcing the risk and responsibility
  • adapt to circumstances that I might not have thought of

Our interpretation

  • The referent combines observable creative behavior, human experience, and responsibility for production.
  • A narrower claim about responding to feedback could be tested. Treating that narrower capability as equivalent to the entire statement would omit its central responsibility and experience components.
  • The wording also leaves unresolved whether it describes current limitations or an inherent impossibility of dataset training.

This claim is not graded on evidence. The record checks that the words are quoted correctly and attributed to the right person, and that the claim is classified correctly.

Current assessment

Not graded on evidence

Outcome: Can’t be checked

The statement is a recommendation, a value judgment, or too open to test. It is recorded, not scored.

Evidence as of
Deadline state when assessed
No horizon
Assessment recorded
Policy version
2026-10-28.7

Rationale

The preprint submitted March 4, 2024 evaluates ChatGPT-assisted game design through prototypes and participant feedback [e1]. It examines creative behavior, but does not test whether dataset training confers lived experience or responsibility for production [e1]. Its results cannot settle the combined assertion about creative ability, experience and responsibility [e1].

Limitations

  • The statement does not distinguish observable adaptation and judgment from responsibility and lived experience, or define a measurable standard for the combined claim.
  • The wording does not distinguish current limitations from an inherent impossibility.
  • Benefits or shortcomings in the game-design study establish neither acquisition of all these qualities nor their untrainability [e1].

Evidence (1 item)

No outcome evidence: a claim of this kind is recorded and attributed, not scored.

Where it was said (1)

Said once in the sources this register covers.

  • : Where's Your Ed At, Pop Culture

    These are not things that you can train in a dataset, because they're derived from experiences inside and outside of the creative process.

    Published
    2024-07-08
    Source observed
    , live page
    Access
    full text, public

History

Assessment versions

Recorded events

  1. Assessment publishedBy this site

    First assessment published after both reviews and the final-text check passed.

    About assessment wyea-pop-culture-65bdc5-a2.

  2. HeldBy this site

    The final-text check failed: rationale_supported_by_evidence; overclaims: Despite the earlier screen, the combined claim lacks a sufficiently clear empirical test..

    About assessment wyea-pop-culture-65bdc5-a1, which was not published.