“I don’t doubt this, when stated so vaguely, but you can’t improve the engineering if you can’t identify the problems and weak points, such that you can address them.”
Our reading, the sentence that was checked:
You can't improve the engineering if you can't identify its problems and weak points so that you can address them.
Assessment: Can’t be checked Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Casey (Newton) Strikes Out, paragraph 51.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-casey-newton-strikes-out-0b84a4-a1
We recorded 10 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2024-12-11. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Causal claim
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
From the speaker
- you can’t improve the engineering
- if you can’t identify the problems and weak points
- such that you can address them
Our interpretation
- In context, this is a general methodological maxim about recognizing shortcomings.
- Identifying a weak point could mean noticing an unsatisfactory result, selecting a performance metric, or diagnosing a specific failure mechanism.
- The text does not establish which meaning is required. Choosing one would determine whether ordinary optimization counts as a counterexample.
This claim is not graded on evidence. The record checks that the words are quoted correctly and attributed to the right person, and that the claim is classified correctly.
Current assessment
Not graded on evidence
Outcome: Can’t be checked
The statement is a recommendation, a value judgment, or too open to test. It is recorded, not scored.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
The sentence offers methodological advice in the form of an absolute causal claim. Its key term is too elastic for a fair test. If noticing poor performance counts as identifying a problem, ordinary optimization may satisfy it. If identifying the mechanism is required, the claim is much stronger. The text does not choose between those readings. Scoring it would require adding a decisive condition Marcus did not supply.
Limitations
- This does not establish that the maxim is true or false.
- Evidence that diagnosis is useful cannot establish that it is always necessary.
Evidence (1 item)
No outcome evidence: a claim of this kind is recorded and attributed, not scored.
What would settle it
A definition of identification and improvement, followed by a documented case that tests the resulting necessary-condition claim.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Casey (Newton) Strikes Out
I don’t doubt this, when stated so vaguely, but you can’t improve the engineering if you can’t identify the problems and weak points, such that you can address them.
- Where
- paragraph 51
- Published
- 2024-12-11
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-casey-newton-strikes-out-0b84a4-a1: Current. Outcome: Can’t be checked. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.