“OpenAI has historically, based on reporting, failed to make its models more efficient, failing to deliver their more efficient "Arrakis" model to Microsoft in late 2023.”
Our reading, the sentence that was checked:
OpenAI has failed to make its models more efficient, including failing to deliver the Arrakis model to Microsoft in late 2023.
Assessment: Mixed Evidence as of
Where and when Ed Zitron wrote it
Where's Your Ed At, How Does OpenAI Survive?, paragraph 53.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment wyea-to-serve-altman-0566e4-a1
We recorded 38 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2024-07-29. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
Conditions
- based on reporting (qualifier, stated by the speaker)
From the speaker
- has historically
- based on reporting
- failed to make its models more efficient
- failing to deliver their more efficient "Arrakis" model to Microsoft
- in late 2023
Our interpretation
- Assess the historical record through publication; the statement names no beginning, so leave the period's start unspecified.
- Read efficiency as reduced resources or operating cost for comparable model work, including serving improvements.
- Treat the broad efficiency claim and the specific Arrakis setback as distinct components of the same claim.
- Lower customer prices alone do not prove lower operating costs.
- Based on reporting describes the evidentiary basis, not a conditional forecast.
Counts as supported if: Reporting establishes the Arrakis delivery failure, and evidence supports the broader claim that OpenAI had failed to achieve efficiency improvements through July 2024.
Counts as contradicted if: Credible evidence documents achieved operating efficiencies before publication, or establishes that Arrakis was successfully delivered as described. Support for the setback alongside contrary evidence on the broader record warrants mixed.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Mixed
Part of the claim holds and part does not, and the record says which part is which.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
Reporting supports the Arrakis setback: the project was canceled after inadequate performance, disappointing hopes for a cheaper model. It does not establish the precise late-2023 delivery timing. The broader efficiency claim is contradicted under the ordinary operating-efficiency reading: in June 2023 OpenAI explicitly reported efficiency savings that it was passing to developers. That is stronger evidence than a price cut alone, although it remains a company disclosure without independent cost measurements.
Limitations
- The Arrakis evidence is a secondary account of inaccessible original reporting.
- The efficiency finding concerns operating systems, including serving models; it does not establish improved training efficiency or isolate model architecture.
- A narrower reading limited to architecture-level efficiency would remain unresolved.
Evidence (2 items)
Supports the claim: The Decoder,
For a month, the team worked on tweaks, then the leadership team killed the project, the sources said.
Why it matters here: The report describes cancellation of Arrakis after inadequate performance and says Microsoft had hoped it would reduce costs. It supports the specific setback, but does not establish a late-2023 delivery deadline.
- Publisher
- The Decoder
- Kind of source
- Secondary summary
- Describes events of
- Public from
Goes against the claim: OpenAI,
We continue to make our systems more efficient and are passing those savings on to developers, effective today.
Why it matters here: OpenAI explicitly reported achieved efficiency savings before the post. This contradicts a broad claim of failure to improve operating efficiency without inferring savings merely from lower API prices.
- Publisher
- OpenAI
- Kind of source
- Company disclosure: the company describing itself, not an independent finding
- Describes events of
- Public from
What would settle it
Primary Arrakis records would settle the delivery timing. Comparable compute or operating-cost measurements would settle the extent and source of efficiency gains.
Where it was said (1)
Said once in the sources this register covers.
: Where's Your Ed At, How Does OpenAI Survive?
OpenAI has historically, based on reporting, failed to make its models more efficient, failing to deliver their more efficient "Arrakis" model to Microsoft in late 2023.
- Where
- paragraph 53
- Published
- 2024-07-29
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment wyea-to-serve-altman-0566e4-a1: Current. Outcome: Mixed. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.