“To reach level 3 (whatever “Agents, systems that can take actions” means) you’d need a level of sentience dependent on entirely new forms of mathematics.”
Our reading, the sentence that was checked:
Reaching OpenAI's level 3 (agents) would require sentience dependent on entirely new forms of mathematics.
Assessment: Contradicted Evidence as of
Where and when Ed Zitron wrote it
Where's Your Ed At, Put Up Or Shut Up, paragraph 16.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment wyea-put-up-or-shut-up-f48454-a2
We recorded 19 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2024-07-16. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Causal claim
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
From the speaker
- To reach level 3
- Agents, systems that can take actions
- you’d need a level of sentience
- dependent on entirely new forms of mathematics
Our interpretation
- This asserts a necessary technical prerequisite, not a forecast with a deadline.
- I read level 3 operationally as a system taking actions on a user's behalf over several days.
- Entirely new forms of mathematics means new mathematical foundations beyond established LLM computation and ordinary software orchestration, not every new algorithm or engineering improvement.
- A documented counterexample to the mathematics requirement can contradict the combined necessity claim without proving that a system lacks subjective experience.
Counts as supported if: A sound technical argument establishes that the specified agent capability requires sentience and that this sentience requires mathematical foundations unavailable when the claim was made.
Counts as contradicted if: A documented system performs the specified multi-day action-taking role using established LLM and software methods, without requiring the asserted new mathematical foundations.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Does the evidence support the cause?
Outcome: Contradicted
The dated evidence goes against what the claim committed to, under the criteria frozen before grading.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
July 2024 reporting describes level 3 as agents working autonomously on tasks for days [e1]. Anthropic's June 27, 2025 account reports Claude Sonnet 3.7 managing a store for about a month using software tools, with failures and human physical assistance [e2]. Its December 19, 2024 engineering account describes agents as LLMs using tools and environmental feedback in a loop [e3]. Under the contract's operational reading, the reported duration and implementation support treating Project Vend as a counterexample to the claimed need for entirely new mathematical foundations [e1] [e2] [e3]. That conclusion is an inference from the implementation accounts; it does not establish whether the system had subjective experience [e2] [e3].
Limitations
- Project Vend is a company-reported experiment with failures and human physical assistance [e2].
- The evidence provides no formal determination that Project Vend met every capability OpenAI might intend by level 3 [e1] [e2].
- The implementation accounts do not comprehensively examine the model's mathematical foundations or settle sentience [e2] [e3].
Evidence (3 items)
Goes against the claim: Anthropic,
for about a month.
Why it matters here: The account describes Claude Sonnet 3.7 using search, notes, Slack, and price-setting tools over a month, with humans providing physical services. I infer from this documented implementation that sustained action-taking did not require the asserted new mathematical foundations.
- Publisher
- Anthropic
- Kind of source
- Demonstration
- Describes events of
- Public from
Context only: Ars Technica,
work autonomously on tasks for days.
Why it matters here: This establishes the reported duration requirement. It prevents treating a brief tool-use demonstration as a sufficient counterexample.
- Publisher
- Ars Technica
- Kind of source
- News report
- Describes events of
- Public from
Context only: Anthropic,
environmental feedback in a loop.
Why it matters here: The engineering description explains how ordinary model calls and feedback can produce agent behavior. It corroborates the implementation reading but does not independently demonstrate multi-day performance.
- Where
- Section 'Agents'
- Publisher
- Anthropic
- Kind of source
- Company disclosure: the company describing itself, not an independent finding
- Describes events of
- Public from
Where it was said (1)
Said once in the sources this register covers.
: Where's Your Ed At, Put Up Or Shut Up
To reach level 3 (whatever “Agents, systems that can take actions” means) you’d need a level of sentience dependent on entirely new forms of mathematics.
- Where
- paragraph 16
- Published
- 2024-07-16
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment wyea-put-up-or-shut-up-f48454-a2: Current. Outcome: Contradicted. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
HeldBy this site
The final-text check failed: rationale_supported_by_evidence; overclaims: Its implementation does not require the proposed mathematical revolution..
About assessment wyea-put-up-or-shut-up-f48454-a1, which was not published.