“People have been adding data and compute left and right since August 2022 when OpenAI demo’d GPT-4 to Bill Gates, but despite literally hundreds of billions of investment, pure LLM scaling has not produced the fruit some people imagined.”
Our reading, the sentence that was checked:
Despite hundreds of billions invested since August 2022, pure LLM scaling has not delivered what some expected.
Assessment: Can’t be checked Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Five ways in which the last 3 months — and especially the DeepSeek era — have vindicated “Deep learning is hitting a wall", paragraph 6.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-five-ways-in-which-the-last-3-months-25cc7d-a1
We recorded 8 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2025-02-09. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
From the speaker
- since August 2022
- hundreds of billions of investment
- pure LLM scaling
- has not produced the fruit some people imagined
- one more giant-across-the-board leap and no more
Our interpretation
- The described interval runs from August 2022 through publication on February 9, 2025; August 1 is used only as the inclusive boundary of the named month.
- The surrounding paragraph suggests disappointment about a further broad capability leap after GPT-4.
- Neither the sentence nor its context identifies whose expectations, which capabilities, or what magnitude of improvement would count.
- Investment has no identified company set, accounting basis, or boundary between financing, infrastructure expenditure, and model-training expenditure.
- No sufficiently determinate ordinary reading supports a fair binary score without supplying material criteria absent from the claim.
This claim is not graded on evidence. The record checks that the words are quoted correctly and attributed to the right person, and that the claim is classified correctly.
Current assessment
Not graded on evidence
Outcome: Can’t be checked
The statement is a recommendation, a value judgment, or too open to test. It is recorded, not scored.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
The sentence expresses disappointment relative to unnamed expectations. Its context narrows that disappointment to a further broad capability leap, but never defines the leap or identifies a forecast to test. Selecting benchmarks and a threshold would supply the central claim ourselves. The investment clause also lacks the scope and accounting basis required for a financial assessment. Neither available model comparisons nor broad investment totals can fairly settle this wording.
Limitations
- This is not a finding that scaling met expectations or that the investment amount was false.
- A more specific claim about a named forecast, capability threshold, or expenditure category could be assessed.
Evidence (1 item)
No outcome evidence: a claim of this kind is recorded and attributed, not scored.
What would settle it
Identify the contemporaneous expectation and measurable capability threshold, plus the companies, currency, accounting basis, and investment category intended.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Five ways in which the last 3 months — and especially the DeepSeek era — have vindicated “Deep learning is hitting a wall"
People have been adding data and compute left and right since August 2022 when OpenAI demo’d GPT-4 to Bill Gates, but despite literally hundreds of billions of investment, pure LLM scaling has not produced the fruit some people imagined.
- Where
- paragraph 6
- Published
- 2025-02-09
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-five-ways-in-which-the-last-3-months-25cc7d-a1: Current. Outcome: Can’t be checked. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-five-ways-in-which-the-last-3-months-25cc7d-a1.