OpenAI’s Waterloo? [with corrections]
We recorded 8 claims from this post. 3 were checked against evidence. 5 can’t be checked. 8 more are held. Read the post at its source.
Claims from this post (8)
In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.
Assessment: Can’t be checkedSaid
Rhetoric
“But media coverage is not science, and braggadacio alone cannot yield AGI.”
Our reading: Hype and bragging alone cannot produce AGI.
No horizon
Assessment: Can’t be checkedSaid
Rhetoric
“There is a real sense in which GPT-5 is starting to look Altman’s Waterloo.”
Our reading: GPT-5 is starting to look like Altman's decisive defeat.
No horizon
Assessment: MixedSaid
Observation
“Some customers even wanted the old models back. Almost nobody felt satisfied.”
Our reading: Almost no one was satisfied with GPT-5, and some customers wanted the old models back.
No horizon Evidence as of
Limitation: No representative satisfaction survey of GPT-5 users from the launch week was found, so the share of satisfied users is not known.
Assessment: Can’t be checkedSaid
Observation
“Two years ago, many treated Altman like an oracle; in the eyes of many, Altman now looks more like a snake oil salesman.”
Our reading: Two years ago many people treated Altman like an oracle, and now, in the eyes of many, he looks more like a snake oil salesman.
No horizon Evidence as of
Limitation: No poll or systematic measure of views of Altman in 2023 or in August 2025 was found.
Assessment: Can’t be checkedSaid
Causal claim
“And you can’t make AI better if you drown out the critics and keep pouring good money after bad.”
Our reading: AI cannot be made better if you drown out the critics and keep pouring good money after bad.
No horizon
Only if: if you drown out the critics and keep pouring good money after bad
Assessment: UnresolvedSaid
Forecast
“But between the disappointments of GPT-5 and a new study from METR that shows that LLMs do markedly better on coding benchmarks than in real-word practice, I think it is safe to say that LLMs won’t lead the way.”
Our reading: LLMs will not be the approach that leads the way to AGI.
No deadline stated Evidence as of
Limitation: The first accepted AGI is an interpretation of 'lead the way', not a criterion Marcus explicitly supplied.
Assessment: SupportedSaid
Observation
“But between the disappointments of GPT-5 and a new study from METR that shows that LLMs do markedly better on coding benchmarks than in real-word practice, I think it is safe to say that LLMs won’t lead the way.”
Our reading: LLMs do markedly better on coding benchmarks than in real-world coding practice.
No horizon Evidence as of
Limitation: The study does not establish the same mismatch across all developers, tasks or LLMs; it allows for substantial productivity gains in other coding settings [e2].
Assessment: Can’t be checkedSaid
Conditional forecast
“As people begin to recognize that truth (the bitter lesson about limits of Sutton’s The Bitter Lesson), scientists will start to charts new paths. One of the new paths may even give rise to what we so desperately need: AI that we can trust.”
Our reading: As the limits of scaling become recognized, scientists will pursue new approaches, one of which may produce trustworthy AI.
No horizon
Only if: as people recognize the limits of scaling LLMs
Held from this post (8)
These records did not pass every check, so nothing about them is published. Held is not a finding.
- The two reviews read the claim differently
- The criteria are ambiguous. Our reading, not assessed: Science is self-correcting, and new approaches will rise again from the ashes.
- The two reviews read the claim differently
- The criteria are ambiguous. Our reading, not assessed: Altman failed to deliver what he promised with GPT-5, and GPT-5 is in no way AGI.
- The record does not meet the current rules. Our reading, not assessed: AGI will eventually come, possibly within the next decade.
- The two reviews reached different assessments. Our reading, not assessed: No lab has yet delivered AGI, and models like Grok-4 and Llama-4 have also underwhelmed.
- The two reviews read the claim differently
- The two reviews reached different assessments. Our reading, not assessed: ChatGPT has not, so far, ushered in a new era in science and medicine or radically increased GDP and productivity.