Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

“Coding LLMs are popular only because of their massive subsidies and corporate encouragement, and in the end will be seen as a useful-yet-incremental and way too expensive way to make the easy things easier and the harder things harder, all while filling codebases full of masses of unintentional, bloated code.”

AI Is Really Weird, paragraph 242. The full statement is at the source.

Our reading, the sentence that was checked:

Coding LLMs are popular only because of massive subsidies and corporate encouragement, and in the end will be seen as a useful-yet-incremental and far too expensive way to make easy things easier and hard things harder, while filling codebases with bloated, unintentional code.

Assessment: Unresolved No deadline stated on 2026-10-29 Evidence as of

Where and when Ed Zitron wrote it

Where's Your Ed At, AI Is Really Weird, paragraph 242.

Said
Source observed
live page, full text, public
Evidence as of
the cutoff for this assessment
Assessment recorded
assessment wyea-ai-is-really-weird-620dd6-a1

We recorded 42 claims from this post. See every claim from this post.

The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2026-04-08. This page does not claim the wording was captured then.

What the claim commits to

Kind
Forecast
Deadline, as the speaker wrote it
“in the end”
Deadline state when assessed
No deadline stated
Deadline state on 2026-10-29
No deadline stated (the release’s reference date)

From the speaker

  • popular only because of their massive subsidies and corporate encouragement
  • in the end
  • useful-yet-incremental
  • way too expensive
  • make the easy things easier and the harder things harder
  • unintentional, bloated code

Our interpretation

  • This is a compound forecast about the eventual value and reputation of coding LLMs, accompanied by a present causal assertion about adoption.
  • The ordinary reading requires broad evidence about developers and maintained codebases, not one successful or unsuccessful coding exercise.
  • Costs should include service provision, developer time, review, correction, and maintenance. Higher code volume alone is not proof of unwanted bloat.
  • The full-cost hypothetical in the surrounding text is explanatory context, not a condition attached to the forecast.

Counts as supported if: Broad, sustained evidence shows that adoption depends exclusively on subsidies and corporate encouragement, benefits remain modest after full costs, difficult work becomes harder, and unwanted code materially increases.

Counts as contradicted if: Broad evidence establishes substantial lasting net benefits on difficult work, sustainable voluntary adoption at full cost, or another independently established cause of popularity inconsistent with 'only'.

Retrospective: these criteria were written after the outcome was public.

Current assessment

Did the forecast come true?

Outcome: Unresolved

The record was checked, and the evidence available by the cutoff does not settle it.

Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.

Evidence as of
Deadline state when assessed
No deadline stated
Assessment recorded
Policy version
2026-10-28.7

Rationale

The studies show differing effects across developers, tasks, and tool generations. They do not establish the exclusive causes of adoption or the eventual balance of benefits, costs, difficult work, and unwanted code. No decisive event settles this open-ended forecast.

Limitations

  • The research tests narrower settings than the claim.
  • The corporate field experiments involve researchers affiliated with a tool provider.
  • Productivity measurements do not by themselves measure long-term code quality or sustainable pricing.

Evidence (3 items)

  • Context only: METR,

    19% longer

    Why it matters here: This supports the possibility that coding assistance can slow experienced developers working in familiar repositories. It does not establish future industry-wide effects, full costs, or the causes of adoption.

    Publisher
    METR
    Kind of source
    Independent measurement
    Describes events of
    Public from
  • Context only: METR,

    very weak evidence

    Why it matters here: METR considered improved productivity plausible but found substantial selection and measurement problems in its newer experiment. This limits using the earlier slowdown as evidence for the eventual forecast.

    Publisher
    METR
    Kind of source
    Independent measurement
    Describes events of
    Public from
  • Context only: Microsoft Research,

    greater productivity gains

    Why it matters here: The research reports productivity gains in corporate field experiments, showing that effects differ across settings. The page dates the publication only to June 2025; June 30 conservatively represents availability by that month's end, not the experiment date.

    Publisher
    Microsoft Research
    Kind of source
    Preprint, not peer reviewed
    Describes events of
    Public from

What would settle it

Broad longitudinal evidence connecting voluntary adoption at sustainable prices to net productivity and maintenance outcomes, with task difficulty measured consistently and adoption causes separately identified.

Where it was said (1)

Said once in the sources this register covers.

  • : Where's Your Ed At, AI Is Really Weird

    Coding LLMs are popular only because of their massive subsidies and corporate encouragement, and in the end will be seen as a useful-yet-incremental and way too expensive way to make the easy things easier and the harder things harder, all while filling codebases full of masses of unintentional, bloated code.

    Published
    2026-04-08
    Source observed
    , live page
    Access
    full text, public

History

Assessment versions

Recorded events

  1. Assessment publishedBy this site

    First assessment published after both reviews and the final-text check passed.

    About assessment wyea-ai-is-really-weird-620dd6-a1.