Changes, page 61 of 62
Everything we published, changed, or held back, newest first.
All changes (12,371)
Changes 12,001 to 12,200 of 12,371, newest first. Page 61 of 62.
Held backBy usGary Marcus
The two reviewers reached different verdicts.
PublishedBy usGary Marcus
Anyone claiming AGI has been achieved is either confused or hyping something.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A reviewer didn’t accept one of the pieces of evidence.
PublishedBy usGary Marcus
It is quite possible that no model worthy of the GPT-5 name will appear in 2025.
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
AGI isn’t coming in 2025, and GPT-5 probably isn’t either.
One of the AIs read the claim differently from our summary.
PublishedBy usGary Marcus
Musk's promise of 500,000 humanoid robots in three years seems very unlikely to be fulfilled.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
GPT-5 may well not be released in 2025, owing to data bottlenecks and inherent limits of LLMs.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
The media should hold those who make unrealistic AI promises to account.
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
GPT-5, when it arrives, will not meet the AGI criteria Marcus has previously laid out.
It didn’t pass every check.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
AGI will not be achieved in 2025.
The two reviewers reached different verdicts.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
OpenAI is struggling to build a model worthy of the GPT-5 name.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
The data points in Aschenbrenner's AGI projection graph are imaginary rather than real measurements.
A reviewer didn’t accept one of the pieces of evidence.
PublishedBy usGary Marcus
It is imperative that we do better at reining in Silicon Valley than we have so far.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A reviewer said our test wasn’t fair to what was actually said.
Held backBy usGary Marcus
GPT-4 is not equivalent in capability to a smart high schooler.
A reviewer didn’t accept one of the pieces of evidence.
PublishedBy usGary Marcus
The double Y-axis on Aschenbrenner's graph makes no sense and presupposes its own conclusion.
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A reviewer said our test wasn’t fair to what was actually said.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
We should be worried about AGI preparedness regardless of how long until AGI arrives.
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
One AI thought this could be checked, so it needs a full check first.
Held backBy usGary Marcus
A reviewer said our test wasn’t fair to what was actually said.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A reviewer didn’t accept one of the pieces of evidence.
Held backBy usGary Marcus
Accenture's large bet on AI does not appear to have paid off.
A reviewer said our test wasn’t fair to what was actually said.
PublishedBy usGary Marcus
Claude Code will increase coders' productivity, unless technical debt cancels out the gains.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
Claude Code is a special-purpose neurosymbolic system, not a generic chatbot.
A reviewer said our test wasn’t fair to what was actually said.
Held backBy usGary Marcus
The check used the wrong kind of test for this claim.
PublishedBy usGary Marcus
Tokenmaxxing (maximizing AI token use) is in decline.
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
Absolutely amazing ant video augurs intellectual mayhem
The two reviewers read the claim differently.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
More people besides the one already fooled will be fooled by fake Sora-generated videos.
The final check failed: the write-up said more than the evidence showed.
PublishedBy usGary Marcus
Society faces turbulent times from AI-generated video.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
A Sora-generated ant video got the ants' anatomy wrong: it did not show the six legs real ants have.
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A reviewer said our test wasn’t fair to what was actually said.
PublishedBy usGary Marcus
Open-source counterparts to Sora will emerge.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
The two reviewers reached different verdicts.
Held backBy usGary Marcus
The two reviewers reached different verdicts.
PublishedBy usGary Marcus
Marcus is pretty skeptical about OpenAI's reported Q* breakthrough.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
At least so far, OpenAI's Q* is not among the problems Marcus is worried about.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Marcus does not think Bing is already powered by OpenAI's alleged Q* breakthrough.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
It is possible that OpenAI has a breakthrough that fundamentally changes the world.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
True level 5 driverless cars are probably still many breakthroughs away.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
The two reviewers reached different verdicts.
PublishedBy usGary Marcus
The picture Shumer presents isn't realistic, however much people might wish it were true.
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
Recent AI coding systems have changed: you can let them run more on their own than before.
The final check failed: the write-up said more than the evidence showed.
PublishedBy usGary Marcus
People should not have taken Shumer's viral post about AI seriously.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
About that Matt Shumer post that has nearly 50 million views
One of the AIs read the claim differently from our summary.
Held backBy usGary Marcus
The two reviewers reached different verdicts.
Held backBy usGary Marcus
The two reviewers reached different verdicts.
Held backBy usGary Marcus
LLMs are writing more code, but it is unclear whether that code is secure or trustworthy.
The final check failed: the write-up said more than the evidence showed.
PublishedBy usGary Marcus
The security of AI-generated code is seriously in doubt.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Building ever larger LLMs has never succeeded in reaching AGI.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A trillion dollars is a terrible thing to waste
One of the AIs read the claim differently from our summary.
Held backBy usGary Marcus
A reviewer said our test wasn’t fair to what was actually said.
PublishedBy usGary Marcus
The AI investment-driven economy looks incredibly fragile.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Trillion-dollar investments in ever larger experiments aimed at AGI may be delusional.
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
Larger LLMs give measurable but apparently diminishing improvements.
A reviewer said our test wasn’t fair to what was actually said.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
The final check failed: a cited source didn’t say what the write-up said.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
The AI boom just might end up taking down the economy.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Venture capitalists may continue to support LLM mania, at least for a while.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
If the fallout spreads wider, the cost of the LLM bet could be much more than a trillion dollars.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
In the worst case, the impact of a deflated AI bubble could be immense.
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A trillion dollars is a terrible thing to waste
One of the AIs read the claim differently from our summary.
Held backBy usGary Marcus
The two reviewers reached different verdicts.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
LLMs have undermined college education, given as an example of collateral damage to society.
The two reviewers reached different verdicts.
Held backBy usGary Marcus
A trillion dollars is a terrible thing to waste
One of the AIs read the claim differently from our summary.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A temporary pause on training extra large language models
One of the AIs read the claim differently from our summary.
Held backBy usGary Marcus
No details of GPT-4's architecture or training set have been published.
A reviewer didn’t accept one of the pieces of evidence.
PublishedBy usGary Marcus
AI development should proceed with caution until the risks and benefits are better understood.
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
GPT has a truthiness problem that is not deliberate but arises because it doesn't know any better.
A reviewer didn’t accept one of the pieces of evidence.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
GPT produces many falsehoods, but they are not really lies because GPT has no intent to deceive.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
The check used the wrong kind of test for this claim.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
If OpenAI fails, Google could readily take its place, so no government bailout would be required.
The two reviewers reached different verdicts.
Held backBy usGary Marcus
The two reviewers reached different verdicts.
Held backBy usGary Marcus
“A spate of outages, including incidents tied to the use of AI coding tools”, right on schedule
The two reviewers read the claim differently.
PublishedBy usGary Marcus
AI may well come to write most code.
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
“A spate of outages, including incidents tied to the use of AI coding tools”, right on schedule
The final check failed: the write-up said more than the evidence showed.
Held backBy usGary Marcus
The final check failed: the write-up said more than the evidence showed.
Held backBy usGary Marcus
The claim is hedged, so it isn’t scored.
Held backBy usGary Marcus
The US now has essentially zero AI regulation.
The two reviewers reached different verdicts.
Held backBy usGary Marcus
One of the AIs read the claim differently from our summary.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
President Trump has trampled over states' rights and left US citizens in the lurch.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Scaling alone has limited ability to advance AI.
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
The new scaling laws, like the original, are empirical generalizations rather than physical laws.
A reviewer didn’t accept one of the pieces of evidence.
PublishedBy usGary Marcus
The new scaling laws (post-training and inference-time) will eventually stop holding.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
People should be financially wary of the new claims about multiple AI scaling laws.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
OpenAI's own o1 research shows that scaling test-time compute helps on some problems but not others.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
The AI field must move beyond scaling and pursue genuinely new ideas.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A piece of evidence came from the wrong dates.
PublishedBy usGary Marcus
Scaling performance by training models longer is no longer really holding.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
In some cases o1 does not perform better than GPT-4.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
As of November 2024, a major retreat from scaling claims in the AI field has already begun.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
GPT-4 was better than GPT-3 in almost every way, whereas o1 is a far less uniform improvement.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A piece of evidence came from the wrong dates.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A reviewer said our test wasn’t fair to what was actually said.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Coders, especially inexperienced vibe coders, should be wary of the robustness of AI-generated code.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Models like o3 hallucinate much more than attentive humans and struggle with reliable diagrams.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
LLMs writing Python code to supplement their weaknesses is not reliable.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
LLMs cannot reliably solve the Tower of Hanoi.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Other forms of deep learning, especially those that work well with symbols, may eventually thrive.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
The LLM approach has limits that are becoming clearer every day.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Claude gets under 80% accuracy on 7-disc Tower of Hanoi and essentially cannot solve 8 discs.
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
One of the AIs read the claim differently from our summary.
PublishedBy usGary Marcus
o3 or Claude cannot simply be dropped into complex problems and expected to work reliably.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
LLMs are no substitute for good well-specified conventional algorithms.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
One of the AIs read the claim differently from our summary.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
Meta's Galactica language model frequently produces false or fabricated content.
The final check failed: a cited source didn’t say what the write-up said.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A few dark words about chatbots and death
One of the AIs read the claim differently from our summary.
Held backBy usGary Marcus
OpenAI faces at least eight wrongful death lawsuits related to ChatGPT users.
A reviewer said our test wasn’t fair to what was actually said.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Chatbots apparently inducing delusions in humans is a growing problem.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Society should especially worry about chatbots influencing children, as teen deaths have shown.
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A reviewer said our test wasn’t fair to what was actually said.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A reviewer said our test wasn’t fair to what was actually said.
PublishedBy usGary Marcus
The problem of chatbot-associated deaths is getting worse.
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
By April 2023 a chatbot-related death had occurred, though causality was hard to prove.
The final check failed: the write-up said more than the evidence showed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
Among American AI companies, no lead lasts more than a few months.
The final check of the write-up failed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
The US is not far ahead of China in the generative AI race.
A piece of evidence came from the wrong dates.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
The core misconception that is driving American AI policy
The final check failed: the write-up said more than the evidence showed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Generative AI models are commodities.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
China is currently at most a few months behind the US in generative AI.
A piece of evidence came from the wrong dates.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A CERN for AI and the Global Governance of AI
One of the AIs read the claim differently from our summary.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
It is likely that at least one of the 60+ elections worldwide in 2024 will be swayed by deepfakes.
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A piece of evidence came from the wrong dates.
PublishedBy usGary Marcus
Current AI cannot reliably anticipate the consequences or harms of actions it recommends.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
There is no way to guarantee that large language models reliably stick to facts.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
AI need not be superintelligent to create serious problems; the real issue is control.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
We need to consider both current AI risk and AGI risk.
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.
Held backBy usGary Marcus
A CERN for AI and the Global Governance of AI
The final check failed: a cited source didn’t say what the write-up said, and our summary didn’t match their words.
PublishedBy usGary Marcus
Published after both AI reviews and the final check passed.