“AI does not do what you have been promised it does, and those who are excited about it are excited because they believe it will replace you.”
Our reading, the sentence that was checked:
AI does not deliver what it has been promised to tech workers.
Assessment: Unresolved Evidence as of
Where and when Ed Zitron wrote it
Where's Your Ed At, The AI Industry Is Losing, paragraph 105.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment wyea-the-ai-industry-is-losing-029306-a2
We recorded 31 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2026-06-30. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
From the speaker
- AI does not do what you have been promised it does
Our interpretation
- Assess the normalized proposition about capability delivery. The separate assertion about enthusiasts' motives is outside this listed proposition.
- In context, the ordinary reading concerns agents doing useful tech work reliably with substantially less continuous prompting and supervision.
- This is not interpreted as claiming that AI performs no useful tasks.
- Use May 2026, the latest completed month before the June 30 post, for the ongoing capability observation. Earlier promises may provide context, but performance evidence must describe this period.
- No particular product, promise, task distribution, or acceptable failure rate is supplied.
Counts as supported if: A representative comparison of public promises with reproducible May 2026 performance shows a material failure to deliver the advertised autonomy and reduction in human effort.
Counts as contradicted if: Comparable evidence shows that the advertised autonomy and reduction in human effort were generally delivered under the promised conditions.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
Anthropic's April 9, 2026 description presents agents as useful while acknowledging mistakes and the need for human input [e1]. Its September 18 disclosure reports a 76% success rate on its most open-ended internal engineering tasks in May 2026 [e2]. These reports do not compare a representative set of public promises with matching May performance, supervision requirements and net human time, so they establish neither general delivery nor material failure to deliver [e1][e2].
Limitations
- The April description is context, not a May performance evaluation [e1].
- The May success figure is company-reported internal performance, without independent replication supplied here [e2].
- The evidence does not establish whether advertised autonomy reduced total human effort under the promised conditions [e1][e2].
Evidence (2 items)
Context only: Anthropic,
But the autonomy that makes agents useful also introduces a range of new risks.
Why it matters here: Anthropic presents useful agent autonomy while explicitly acknowledging mistakes and human control. A promise-versus-performance test must preserve those qualifications rather than assume a promise of unattended perfection.
- Publisher
- Anthropic
- Kind of source
- Company disclosure: the company describing itself, not an independent finding
- Describes events of
- Public from
Context only: Anthropic,
Claude’s success rate reached 76% in May 2026
Why it matters here: The page reports substantial success alongside incomplete reliability in the target month. Its internally selected tasks and company-defined success measure do not settle delivery against the broader, unspecified promises; the read version carries a September 18 update.
- Publisher
- Anthropic
- Kind of source
- Company disclosure: the company describing itself, not an independent finding
- Describes events of
- Public from
What would settle it
A representative, reproducible comparison of specific public promises with May 2026 performance, matching product versions, tasks and operating conditions. It must measure success, human intervention and net human time to establish whether the promised autonomy and effort reductions were generally delivered or materially fell short.
Where it was said (1)
Said once in the sources this register covers.
: Where's Your Ed At, The AI Industry Is Losing
AI does not do what you have been promised it does, and those who are excited about it are excited because they believe it will replace you.
- Where
- paragraph 105
- Published
- 2026-06-30
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment wyea-the-ai-industry-is-losing-029306-a2: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
HeldBy this site
The final-text check failed: citations_correct.
About assessment wyea-the-ai-industry-is-losing-029306-a1, which was not published.