Further Trouble in Hinton City
We recorded 4 claims from this post. 4 were checked against evidence. 6 more are held. Read the post at its source.
Claims from this post (4)
In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.
Assessment: SupportedSaid
Observation
“More evidence against his claims just keeps piling up.”
Our reading: Evidence against Hinton's claims that GenAI understands and doesn't store things keeps accumulating.
No horizon Evidence as of
Limitation: The result depends on reading the statement as an evidentiary observation rather than a conclusive theory of understanding.
Assessment: UnresolvedSaid
Observation
“GenAI systems do effectively store things. (In this case, canonical video game controller images.)”
Our reading: GenAI systems effectively store things such as canonical video game controller images.
No horizon Evidence as of
Limitation: If the controller parenthetical is treated only as an illustration, the general storage proposition is supported.
Assessment: UnresolvedSaid
Observation
“They (often) don’t come up with a novel independent design that would meet the requirements.”
Our reading: GenAI systems often don't come up with a novel independent design that would meet the requirements.
No horizon Evidence as of
Limitation: The packet lacks representative evaluations jointly measuring novelty and functional compliance.
Assessment: UnresolvedSaid
Causal claim
“Noncanonical situations continue to remain difficult for generative AI systems, precisely because frequent statistics are a mediocre substitute for deep understanding.”
Our reading: Generative AI systems still struggle with noncanonical situations because frequency statistics are a poor substitute for deep understanding.
No horizon Evidence as of
Limitation: Both studies predate the target period and cover narrower image-generation settings.
Held from this post (6)
These records did not pass every check, so nothing about them is published. Held is not a finding.
- The two reviews read the claim differently
- The two reviews read the claim differently
- The two reviews read the claim differently
- The criteria are ambiguous. Our reading, not assessed: GenAI systems fail to understand simple concepts such as designing for one-handed use.
- The two reviews read the claim differently
- The criteria are ambiguous. Our reading, not assessed: There are other ways to break free from the attractors ('let's think this through step by step' is rumored to have some success), but what GenAI systems produce by default often seems to be what has been highly trained.