“We have apparently just entered a new and different and frightening era, in which debugging involves not only fixing our own mistakes but coming to terms with machines that may or may not uphold their end of the bargain.”
Our reading:
We have apparently just entered a new, different and frightening era in which debugging involves not only fixing our own mistakes but also coming to terms with machines that may or may not uphold their end of the bargain.
Assessment: Can’t be checked
What happened
Not graded on evidence
Outcome: Can’t be checked
An opinion, a recommendation, or too vague to test. Listed, not scored.
Evidence up to . Checked .
Why
Marcus qualifies the claim with “apparently” and describes the era as “frightening,” a subjective judgment (statement marcus-the-hottest-new-programming-language-8231fa-o1). He gives no test for entering a new era or for machines upholding “their end of the bargain,” so the full characterization cannot be adjudicated as stated (statement marcus-the-hottest-new-programming-language-8231fa-o1).
Caveats
- The evidence packet contains no external evidence assessing LLM programming reliability.
- This assessment does not establish whether the underlying reliability concern is correct; examples of failures alone would not settle the full characterization.
Evidence (0 items)
Claims like this aren’t scored, so there is no evidence to show.
How we judged it
- Kind of claim
- Observation
- Deadline
- None given. We don’t add one.
Conditions
- apparently (their words)
Where we had to interpret
- The statement tentatively characterizes a change in programming and debugging as of the post date.
- “Apparently” expresses uncertainty, rather than a condition whose occurrence can be checked.
- The full statement supplies no test for entering a new era or for describing it as frightening. Treating it solely as a claim that LLMs sometimes fail to follow correct instructions would narrow what the speaker said.
We don’t grade claims like this. We only check the quote and who said it.
We found 5 claims in this post. See them all.
Full record
Source and dates
Marcus on AI, The hottest new programming language is English! Or maybe not., paragraph 18.
- Said
- We read the source
- live page, full text, public
- Evidence up to
- Checked
We read this wording on 2026-10-29. The post may have been edited after 2024-02-15.
Where it was said (1)
Said once in the posts we read.
: Marcus on AI, The hottest new programming language is English! Or maybe not.
We have apparently just entered a new and different and frightening era, in which debugging involves not only fixing our own mistakes but coming to terms with machines that may or may not uphold their end of the bargain.
- Where
- paragraph 18
- Published
- 2024-02-15
- We read it
- , live page
- Access
- full text, public
History
Versions
- Current: Can’t be checked. Evidence up to 2026-10-28.
What happened to this record
PublishedBy us
Published after both AI reviews and the final check passed.
Held backBy us
A reviewer said our test wasn’t fair to what was actually said.