“General intelligence would presumably entail strong benchmark performance, but available real-world evidence suggests that the core properties of general intelligence – flexibility, generality, and reliability – remain elusive.”
Our reading:
Real-world evidence suggests flexibility, generality, and reliability remain elusive for current AI.
Assessment: Can’t be checked
What happened
Not graded on evidence
Outcome: Can’t be checked
An opinion, a recommendation, or too vague to test. Listed, not scored.
Evidence up to . Checked .
Why
The speaker says the evidence 'suggests' that several properties 'remain elusive.' This is a qualified assessment without a defined level of capability or reliability. Scoring it would require replacing that wording with a stronger claim. Relevant evaluations can inform the debate, but cannot make this sentence a determinate pass/fail proposition.
Caveats
- This does not establish that the assessment is unreasonable.
- Specific empirical statements in the surrounding passage could be assessed separately.
Evidence (0 items)
Claims like this aren’t scored, so there is no evidence to show.
How we judged it
- Kind of claim
- Observation
- Deadline
- None given. We don’t add one.
Where we had to interpret
- This is a qualified synthesis of evidence, not a firm assertion that systems fail a specified capability test.
- Remain elusive does not specify a population, level of competence, acceptable failure rate, or success threshold.
- Presumably qualifies the proposed relationship between general intelligence and benchmark performance.
- The plain-reading provision cannot remove these qualifications or supply a firm operational claim.
We don’t grade claims like this. We only check the quote and who said it.
What would settle it
A firmer statement naming the systems, tasks, conditions, and level of performance that would demonstrate flexibility, generality, and reliability.
We found 22 claims in this post. See them all.
Full record
Source and dates
Marcus on AI, Rumors of AGI’s arrival have been greatly exaggerated, paragraph 22.
- Said
- We read the source
- live page, full text, public
- Evidence up to
- Checked
We read this wording on 2026-10-28. The post may have been edited after 2026-02-17.
Where it was said (1)
Said once in the posts we read.
: Marcus on AI, Rumors of AGI’s arrival have been greatly exaggerated
General intelligence would presumably entail strong benchmark performance, but available real-world evidence suggests that the core properties of general intelligence – flexibility, generality, and reliability – remain elusive.
- Where
- paragraph 22
- Published
- 2026-02-17
- We read it
- , live page
- Access
- full text, public
History
Versions
- Current: Can’t be checked. Evidence up to 2026-10-28.
What happened to this record
PublishedBy us
Published after both AI reviews and the final check passed.
Held backBy us
A reviewer said our test wasn’t fair to what was actually said.