“LLMs, once novel, are largely a commodity.”
Our reading, the sentence that was checked:
LLMs have largely become a commodity.
Assessment: Unresolved Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Five ways in which the last 3 months — and especially the DeepSeek era — have vindicated “Deep learning is hitting a wall", paragraph 8.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-five-ways-in-which-the-last-3-months-30958f-a2
We recorded 8 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2025-02-09. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
Conditions
- largely (qualifier, stated by the speaker)
From the speaker
- LLMs
- once novel
- largely a commodity
Our interpretation
- The ordinary reading is that suppliers' models are broadly substitutable for common uses and price is a principal basis of competition.
- Largely permits specialized models and remaining differences; one feature difference cannot refute the whole claim.
- The assertion concerns the model layer, not whether finished applications or cloud services are commodities.
- The post's last-three-months framing supplies the observation window. No standard reporting period exists for this market state.
Counts as supported if: Representative evidence shows that buyers can substitute among suppliers for common workloads without substantial quality losses or switching costs, with price a principal basis of competition.
Counts as contradicted if: Representative evidence shows material differentiation or switching barriers across common workloads, such that supplier choice predominantly depends on factors other than price.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
Menlo Ventures’ report, published November 20, 2024, describes task-dependent model use and both price and non-price reasons for switching, but its findings cover a broad 2024 period [e1]. OpenAI’s January 31, 2025 disclosure says o3-mini lacks vision capabilities, limiting substitution for visual reasoning tasks [e2]. These findings neither establish nor refute broad substitutability with price as a principal basis of competition during November 9, 2024–February 9, 2025 [e1, e2].
Limitations
- The survey’s 2024 findings cannot be isolated to the target window [e1].
- The evidence does not provide representative target-period substitution tests, switching costs, or the relative importance of price in supplier selection [e1, e2].
- One model’s lack of vision capabilities does not establish differentiation across most common workloads [e2].
Evidence (2 items)
Context only: Menlo Ventures,
enterprises have adopted a pragmatic, multi-model approach
Why it matters here: The survey describes task-dependent use of multiple models and both price and non-price switching motivations. It supports the availability of alternatives, but neither multi-model use nor this broadly dated survey establishes target-period commoditization.
- Publisher
- Menlo Ventures
- Kind of source
- Independent measurement
- Describes events of
- Public from
Context only: OpenAI,
does not support vision capabilities
Why it matters here: A concrete feature difference limits substitution for visual workloads. It cautions against inferring interchangeability from reasoning scores, but cannot refute a claim about most text workloads.
- Publisher
- OpenAI
- Kind of source
- Company disclosure: the company describing itself, not an independent finding
- Describes events of
- Public from
What would settle it
Representative evidence from November 9, 2024–February 9, 2025 showing whether buyers could substitute suppliers across common workloads without substantial quality losses or switching costs, alongside comparable prices and buyers’ supplier-selection criteria.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Five ways in which the last 3 months — and especially the DeepSeek era — have vindicated “Deep learning is hitting a wall"
LLMs, once novel, are largely a commodity.
- Where
- paragraph 8
- Published
- 2025-02-09
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-five-ways-in-which-the-last-3-months-30958f-a2: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-five-ways-in-which-the-last-3-months-30958f-a2.