“This is why driverless cars are still just demos, and why LLMs will never be reliable.”
Our reading, the sentence that was checked:
Poor generalization beyond training data is why driverless cars are still just demos.
Assessment: Contradicted Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Breaking news: Scaling will never get us to AGI, paragraph 1.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-breaking-news-scaling-will-never-739ace-a1
We recorded 6 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-29. The source may have been edited after 2024-04-08. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Causal claim
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
From the speaker
- This is why
- driverless cars are still just demos
Our interpretation
- This assessment concerns the supplied driverless-car proposition, not the separate prediction about LLM reliability.
- I read 'just demos' as demonstration or trial activity without routine public passenger service.
- For the ongoing state described immediately before publication, I use the latest completed calendar quarter, January through March 2024.
- An operating public driverless service would contradict the necessary premise of this causal claim, without proving that generalization difficulties are unimportant.
Counts as supported if: Driverless passenger operations remained demonstration-only, and technical evidence identifies poor generalization as the reason they had not become routine services.
Counts as contradicted if: A routine public passenger service was operating without a human driver during the target period.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Does the evidence support the cause?
Outcome: Contradicted
The dated evidence goes against what the claim committed to, under the criteria frozen before grading.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
Waymo's January 2024 regulatory filing describes thousands of daily driverless passenger rides and ordinary travel uses. That contradicts the premise that driverless cars were still only demonstrations. Some extensions, including freeway service, remained in testing. The evidence does not determine how much poor generalization constrained wider deployment.
Limitations
- The decisive operational account is the company's regulatory filing.
- This finding does not establish unrestricted autonomous driving or refute generalization as a deployment challenge.
Evidence (2 items)
Goes against the claim: Waymo LLC; filed with the California Public Utilities Commission,
no human
Why it matters here: The filing describes daily public driverless rides for work, school, errands and airport travel, and identifies Waymo One as a deployed commercial service. Those operations contradict the demonstration-only premise.
- Publisher
- Waymo LLC; filed with the California Public Utilities Commission
- Kind of source
- Regulatory filing
- Describes events of
- Public from
Context only: Waymo,
freeway trips
Why it matters here: Freeway expansion still involved employee testing. This supports the narrower point that deployment had limits, but does not make existing public surface-street services mere demonstrations.
- Publisher
- Waymo
- Kind of source
- Company disclosure: the company describing itself, not an independent finding
- Describes events of
- Public from
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Breaking news: Scaling will never get us to AGI
This is why driverless cars are still just demos, and why LLMs will never be reliable.
- Where
- paragraph 1
- Published
- 2024-04-08
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-breaking-news-scaling-will-never-739ace-a1: Current. Outcome: Contradicted. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-breaking-news-scaling-will-never-739ace-a1.