What scaling does and doesn’t buy you: peeling back the hype surrounding Google‘s trendy Nano Banana
We recorded 8 claims from this post. 5 were checked against evidence. 3 can’t be checked. 5 more are held. Read the post at its source.
Claims from this post (8)
In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.
Assessment: Can’t be checkedSaid
Causal claim
“Thanks to scaling (and some other tricks), the graphics are terrific, and the ability to have it edit photos that you upload is genuinely cool.”
Our reading: Thanks to scaling (and some other tricks), Google's Nano Banana has terrific graphics, and its ability to edit uploaded photos is genuinely cool.
No horizon
Qualifier: and some other tricks
Assessment: UnresolvedSaid
Observation
“And guess what, surprise, surprise, even the latest models still struggle with compositionality”
Our reading: Even the latest image generation models, Nano Banana among them, still struggle with compositionality.
No horizon Evidence as of
Limitation: The independent test is small and selected, and its outputs were not independently rescored.
Assessment: UnresolvedSaid
Observation
“Over the last few years, graphics have gotten better and better. World models and comprehension less so.”
Our reading: Over the last few years, graphics in image generation systems have gotten better and better, while world models and comprehension have improved less.
No horizon Evidence as of
Limitation: The starting year and operational meanings of the capabilities are evaluator interpretations.
Assessment: UnresolvedSaid
Observation
“Suffice to say that I was able to break nano banana literally on my first try:”
Our reading: Marcus got Nano Banana to fail on his very first attempt.
No horizon Evidence as of
Limitation: The missing record does not show that Marcus's account was false.
Assessment: UnresolvedSaid
Observation
“For all the hype, Nano Banana is not all that much better at this sort of thing than ChatGPT-5:”
Our reading: Despite the hype, Nano Banana is not much better than ChatGPT-5 at drawing part-whole structures such as bicycles.
No horizon Evidence as of
Limitation: Selected failures from both systems would not establish comparable failure rates.
Assessment: UnresolvedSaid
Observation
“ChatGPT, by the way, also continues to struggle with the basic facts of life:”
Our reading: ChatGPT still struggles with basic facts of life in image generation.
No horizon Evidence as of
Limitation: The admitted evidence contains no tests from August 1–27, 2025.
Assessment: Can’t be checkedSaid
Observation
“But it’s all still just an extended form of mimicry, not something deeper, as the persistent failures with parts and wholes keep showing us.”
Our reading: Image and video generation systems like these are still just an extended form of mimicry, not something deeper, as their persistent failures with parts and wholes keep showing.
No horizon
Scope: these systems (image and video generators discussed)
Assessment: Can’t be checkedSaid
Rhetoric
“Beauty is only skin deep.”
Our reading: The visual polish of generative image systems is superficial and hides a lack of understanding.
No horizon
Held from this post (5)
These records did not pass every check, so nothing about them is published. Held is not a finding.