Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

Changes, page 61 of 62

Everything we published, changed, or held back, newest first.

All changes (12,371)

Changes 12,001 to 12,200 of 12,371, newest first. Page 61 of 62.

  1. PublishedBy usGary Marcus

    Anyone claiming AGI has been achieved is either confused or hyping something.

    Published after both AI reviews and the final check passed.

  2. PublishedBy usGary Marcus

    AI systems should solve problems by reasoning over concepts, not by surface analogy to text scraped from the internet.

    Published after both AI reviews and the final check passed.

  3. Held backBy usGary Marcus

    LLMs do not meet his AGI definition: they are unreliable and cannot reliably generalize to novel circumstances.

    A reviewer didn’t accept one of the pieces of evidence.

  4. PublishedBy usGary Marcus

    It is quite possible that no model worthy of the GPT-5 name will appear in 2025.

    Published after both AI reviews and the final check passed.

  5. Held backBy usGary Marcus

    AGI isn’t coming in 2025, and GPT-5 probably isn’t either.

    One of the AIs read the claim differently from our summary.

  6. PublishedBy usGary Marcus

    Musk's promise of 500,000 humanoid robots in three years seems very unlikely to be fulfilled.

    Published after both AI reviews and the final check passed.

  7. PublishedBy usGary Marcus

    GPT-5 may well not be released in 2025, owing to data bottlenecks and inherent limits of LLMs.

    Published after both AI reviews and the final check passed.

  8. PublishedBy usGary Marcus

    The media should hold those who make unrealistic AI promises to account.

    Published after both AI reviews and the final check passed.

  9. Held backBy usGary Marcus

    AGI will not be achieved in 2025.

    The two reviewers reached different verdicts.

  10. PublishedBy usGary Marcus

    OpenAI is struggling to build a model worthy of the GPT-5 name.

    Published after both AI reviews and the final check passed.

  11. PublishedBy usGary Marcus

    As of January 2025, GPT-5 has not been released despite nearly two years of claims of exponential progress.

    Published after both AI reviews and the final check passed.

  12. Held backBy usGary Marcus

    The data points in Aschenbrenner's AGI projection graph are imaginary rather than real measurements.

    A reviewer didn’t accept one of the pieces of evidence.

  13. PublishedBy usGary Marcus

    It is imperative that we do better at reining in Silicon Valley than we have so far.

    Published after both AI reviews and the final check passed.

  14. Held backBy usGary Marcus

    AGI by 2027?

    One of the AIs read the claim differently from our summary.

  15. Held backBy usGary Marcus

    GPT-4 is not equivalent in capability to a smart high schooler.

    A reviewer didn’t accept one of the pieces of evidence.

  16. PublishedBy usGary Marcus

    The double Y-axis on Aschenbrenner's graph makes no sense and presupposes its own conclusion.

    Published after both AI reviews and the final check passed.

  17. Held backBy usGary Marcus

    As far as Marcus knows, GPT-4 on its own does not produce original work such as science-fair ideas or original computer systems.

    A reviewer said our test wasn’t fair to what was actually said.

  18. PublishedBy usGary Marcus

    We are woefully underprepared for AGI, whenever it comes, as Eliezer Yudkowsky has rightly argued for years.

    Published after both AI reviews and the final check passed.

  19. PublishedBy usGary Marcus

    We should be worried about AGI preparedness regardless of how long until AGI arrives.

    Published after both AI reviews and the final check passed.

  20. Held backBy usGary Marcus

    An MIT study and six or seven later studies have shown that generative AI has not delivered real ROI for most businesses.

    One AI thought this could be checked, so it needs a full check first.

  21. Held backBy usGary Marcus

    So far, AI agents appear to have lots of hype but little return on investment, as with generative AI generally.

    A reviewer said our test wasn’t fair to what was actually said.

  22. Held backBy usGary Marcus

    Accenture's large bet on AI does not appear to have paid off.

    A reviewer said our test wasn’t fair to what was actually said.

  23. PublishedBy usGary Marcus

    Claude Code will increase coders' productivity, unless technical debt cancels out the gains.

    Published after both AI reviews and the final check passed.

  24. PublishedBy usGary Marcus

    Overall, generative AI has not been delivering large gains, as many studies (MIT, McKinsey, Bain) show.

    Published after both AI reviews and the final check passed.

  25. Held backBy usGary Marcus

    Claude Code is a special-purpose neurosymbolic system, not a generic chatbot.

    A reviewer said our test wasn’t fair to what was actually said.

  26. PublishedBy usGary Marcus

    Tokenmaxxing (maximizing AI token use) is in decline.

    Published after both AI reviews and the final check passed.

  27. Held backBy usGary Marcus

    Absolutely amazing ant video augurs intellectual mayhem

    The two reviewers read the claim differently.

  28. PublishedBy usGary Marcus

    YouTube is likely to be ruined as a major educational resource almost overnight by AI-generated fake videos.

    Published after both AI reviews and the final check passed.

  29. Held backBy usGary Marcus

    More people besides the one already fooled will be fooled by fake Sora-generated videos.

    The final check failed: the write-up said more than the evidence showed.

  30. PublishedBy usGary Marcus

    Society faces turbulent times from AI-generated video.

    Published after both AI reviews and the final check passed.

  31. PublishedBy usGary Marcus

    A Sora-generated ant video got the ants' anatomy wrong: it did not show the six legs real ants have.

    Published after both AI reviews and the final check passed.

  32. Held backBy usGary Marcus

    Soon, scammers will use Sora or open-source counterparts to make photorealistic fake videos just to sell ads.

    A reviewer said our test wasn’t fair to what was actually said.

  33. PublishedBy usGary Marcus

    Open-source counterparts to Sora will emerge.

    Published after both AI reviews and the final check passed.

  34. PublishedBy usGary Marcus

    Marcus is pretty skeptical about OpenAI's reported Q* breakthrough.

    Published after both AI reviews and the final check passed.

  35. PublishedBy usGary Marcus

    At least so far, OpenAI's Q* is not among the problems Marcus is worried about.

    Published after both AI reviews and the final check passed.

  36. PublishedBy usGary Marcus

    Marcus does not think Bing is already powered by OpenAI's alleged Q* breakthrough.

    Published after both AI reviews and the final check passed.

  37. PublishedBy usGary Marcus

    It is possible that OpenAI has a breakthrough that fundamentally changes the world.

    Published after both AI reviews and the final check passed.

  38. PublishedBy usGary Marcus

    It is not realistic that OpenAI's Q* technique has already entirely changed the world within a few months.

    Published after both AI reviews and the final check passed.

  39. PublishedBy usGary Marcus

    True level 5 driverless cars are probably still many breakthroughs away.

    Published after both AI reviews and the final check passed.

  40. PublishedBy usGary Marcus

    Claimed AI breakthroughs rarely prove general enough to live up to initial expectations, often working only in some contexts.

    Published after both AI reviews and the final check passed.

  41. PublishedBy usGary Marcus

    The picture Shumer presents isn't realistic, however much people might wish it were true.

    Published after both AI reviews and the final check passed.

  42. Held backBy usGary Marcus

    Recent AI coding systems have changed: you can let them run more on their own than before.

    The final check failed: the write-up said more than the evidence showed.

  43. PublishedBy usGary Marcus

    People should not have taken Shumer's viral post about AI seriously.

    Published after both AI reviews and the final check passed.

  44. PublishedBy usGary Marcus

    LLMs write code very fast, but some coders report burnout and only modest gains compared with that burnout.

    Published after both AI reviews and the final check passed.

  45. Held backBy usGary Marcus

    About that Matt Shumer post that has nearly 50 million views

    One of the AIs read the claim differently from our summary.

  46. Held backBy usGary Marcus

    Shumer offers no data showing that the latest coding systems can write whole complex apps without errors.

    The two reviewers reached different verdicts.

  47. Held backBy usGary Marcus

    LLMs are writing more code, but it is unclear whether that code is secure or trustworthy.

    The final check failed: the write-up said more than the evidence showed.

  48. PublishedBy usGary Marcus

    The security of AI-generated code is seriously in doubt.

    Published after both AI reviews and the final check passed.

  49. PublishedBy usGary Marcus

    Building ever larger LLMs has never succeeded in reaching AGI.

    Published after both AI reviews and the final check passed.

  50. Held backBy usGary Marcus

    A trillion dollars is a terrible thing to waste

    One of the AIs read the claim differently from our summary.

  51. PublishedBy usGary Marcus

    The AI investment-driven economy looks incredibly fragile.

    Published after both AI reviews and the final check passed.

  52. PublishedBy usGary Marcus

    Trillion-dollar investments in ever larger experiments aimed at AGI may be delusional.

    Published after both AI reviews and the final check passed.

  53. Held backBy usGary Marcus

    Larger LLMs give measurable but apparently diminishing improvements.

    A reviewer said our test wasn’t fair to what was actually said.

  54. PublishedBy usGary Marcus

    No LLM scaling experiment has solved the core problems of hallucination, generalization, planning and reasoning.

    Published after both AI reviews and the final check passed.

  55. Held backBy usGary Marcus

    If LLMs have the limits Marcus and Sutskever claim, Big Tech can reach $2T in AI revenue by 2030 only by inventing new ideas.

    The final check failed: a cited source didn’t say what the write-up said.

  56. PublishedBy usGary Marcus

    The AI boom just might end up taking down the economy.

    Published after both AI reviews and the final check passed.

  57. PublishedBy usGary Marcus

    The AI industry may have wasted a trillion dollars and several years rediscovering what cognitive science already knew.

    Published after both AI reviews and the final check passed.

  58. PublishedBy usGary Marcus

    Venture capitalists may continue to support LLM mania, at least for a while.

    Published after both AI reviews and the final check passed.

  59. PublishedBy usGary Marcus

    If the fallout spreads wider, the cost of the LLM bet could be much more than a trillion dollars.

    Published after both AI reviews and the final check passed.

  60. PublishedBy usGary Marcus

    In the worst case, the impact of a deflated AI bubble could be immense.

    Published after both AI reviews and the final check passed.

  61. Held backBy usGary Marcus

    A trillion dollars is a terrible thing to waste

    One of the AIs read the claim differently from our summary.

  62. PublishedBy usGary Marcus

    A trillion dollars or more of LLM investment might be lost, with considerable economic and other collateral damage to society.

    Published after both AI reviews and the final check passed.

  63. Held backBy usGary Marcus

    LLMs have undermined college education, given as an example of collateral damage to society.

    The two reviewers reached different verdicts.

  64. Held backBy usGary Marcus

    A trillion dollars is a terrible thing to waste

    One of the AIs read the claim differently from our summary.

  65. Held backBy usGary Marcus

    A temporary pause on training extra large language models

    One of the AIs read the claim differently from our summary.

  66. Held backBy usGary Marcus

    No details of GPT-4's architecture or training set have been published.

    A reviewer didn’t accept one of the pieces of evidence.

  67. PublishedBy usGary Marcus

    AI development should proceed with caution until the risks and benefits are better understood.

    Published after both AI reviews and the final check passed.

  68. Held backBy usGary Marcus

    GPT has a truthiness problem that is not deliberate but arises because it doesn't know any better.

    A reviewer didn’t accept one of the pieces of evidence.

  69. PublishedBy usGary Marcus

    GPT cannot be trusted.

    Published after both AI reviews and the final check passed.

  70. PublishedBy usGary Marcus

    GPT produces many falsehoods, but they are not really lies because GPT has no intent to deceive.

    Published after both AI reviews and the final check passed.

  71. Held backBy usGary Marcus

    If OpenAI fails, Google could readily take its place, so no government bailout would be required.

    The two reviewers reached different verdicts.

  72. Held backBy usGary Marcus

    “A spate of outages, including incidents tied to the use of AI coding tools”, right on schedule

    The two reviewers read the claim differently.

  73. PublishedBy usGary Marcus

    AI may well come to write most code.

    Published after both AI reviews and the final check passed.

  74. Held backBy usGary Marcus

    “A spate of outages, including incidents tied to the use of AI coding tools”, right on schedule

    The final check failed: the write-up said more than the evidence showed.

  75. Held backBy usGary Marcus

    The US now has essentially zero AI regulation.

    The two reviewers reached different verdicts.

  76. Held backBy usGary Marcus

    A sad day for America

    One of the AIs read the claim differently from our summary.

  77. PublishedBy usGary Marcus

    The US should adopt AI regulation between over- and under-regulation that fosters innovation while protecting citizens.

    Published after both AI reviews and the final check passed.

  78. Held backBy usGary Marcus

    A sad day for America

    The two reviewers read the claim differently.

  79. PublishedBy usGary Marcus

    President Trump has trampled over states' rights and left US citizens in the lurch.

    Published after both AI reviews and the final check passed.

  80. PublishedBy usGary Marcus

    Marcus's hunch is that the AI preemption executive order will badly backfire politically on Trump, or at least on J.D. Vance.

    Published after both AI reviews and the final check passed.

  81. Held backBy usGary Marcus

    The new AI scaling law shell game

    The final check of the write-up failed.

  82. PublishedBy usGary Marcus

    Scaling alone has limited ability to advance AI.

    Published after both AI reviews and the final check passed.

  83. Held backBy usGary Marcus

    The new scaling laws, like the original, are empirical generalizations rather than physical laws.

    A reviewer didn’t accept one of the pieces of evidence.

  84. PublishedBy usGary Marcus

    The new scaling laws (post-training and inference-time) will eventually stop holding.

    Published after both AI reviews and the final check passed.

  85. PublishedBy usGary Marcus

    People should be financially wary of the new claims about multiple AI scaling laws.

    Published after both AI reviews and the final check passed.

  86. PublishedBy usGary Marcus

    OpenAI's own o1 research shows that scaling test-time compute helps on some problems but not others.

    Published after both AI reviews and the final check passed.

  87. PublishedBy usGary Marcus

    The AI field must move beyond scaling and pursue genuinely new ideas.

    Published after both AI reviews and the final check passed.

  88. PublishedBy usGary Marcus

    Making LLMs, which are inherently blind to factuality, run longer rather than better is a futile way to rescue them.

    Published after both AI reviews and the final check passed.

  89. PublishedBy usGary Marcus

    Scaling performance by training models longer is no longer really holding.

    Published after both AI reviews and the final check passed.

  90. PublishedBy usGary Marcus

    In some cases o1 does not perform better than GPT-4.

    Published after both AI reviews and the final check passed.

  91. PublishedBy usGary Marcus

    As of November 2024, a major retreat from scaling claims in the AI field has already begun.

    Published after both AI reviews and the final check passed.

  92. PublishedBy usGary Marcus

    GPT-4 was better than GPT-3 in almost every way, whereas o1 is a far less uniform improvement.

    Published after both AI reviews and the final check passed.

  93. PublishedBy usGary Marcus

    Scaling laws aren't really laws anymore, if they ever were, and the meaning of the word 'scaling' has been greatly devalued.

    Published after both AI reviews and the final check passed.

  94. PublishedBy usGary Marcus

    Next-word prediction gets us a surprisingly long way in writing code, but less far in making sure that code is robust.

    Published after both AI reviews and the final check passed.

  95. PublishedBy usGary Marcus

    Coders, especially inexperienced vibe coders, should be wary of the robustness of AI-generated code.

    Published after both AI reviews and the final check passed.

  96. PublishedBy usGary Marcus

    LLMs may succeed on easy test sets and mislead users into thinking they have a generalizable solution when they do not.

    Published after both AI reviews and the final check passed.

  97. PublishedBy usGary Marcus

    Models like o3 hallucinate much more than attentive humans and struggle with reliable diagrams.

    Published after both AI reviews and the final check passed.

  98. PublishedBy usGary Marcus

    Marcus sarcastically suggests that getting to 'alignment' or 'safety' without reliability is a long shot.

    Published after both AI reviews and the final check passed.

  99. PublishedBy usGary Marcus

    LLMs writing Python code to supplement their weaknesses is not reliable.

    Published after both AI reviews and the final check passed.

  100. PublishedBy usGary Marcus

    LLMs cannot reliably solve the Tower of Hanoi.

    Published after both AI reviews and the final check passed.

  101. PublishedBy usGary Marcus

    Apple's new paper is pretty devastating to LLMs and is a powerful followup to a paper from many of the same authors last year.

    Published after both AI reviews and the final check passed.

  102. PublishedBy usGary Marcus

    Other forms of deep learning, especially those that work well with symbols, may eventually thrive.

    Published after both AI reviews and the final check passed.

  103. PublishedBy usGary Marcus

    LLMs can't play chess, fold proteins, or run databases as well as conventional or special-purpose systems.

    Published after both AI reviews and the final check passed.

  104. PublishedBy usGary Marcus

    The LLM approach has limits that are becoming clearer every day.

    Published after both AI reviews and the final check passed.

  105. PublishedBy usGary Marcus

    Claude gets under 80% accuracy on 7-disc Tower of Hanoi and essentially cannot solve 8 discs.

    Published after both AI reviews and the final check passed.

  106. Held backBy usGary Marcus

    A knockout blow for LLMs?

    One of the AIs read the claim differently from our summary.

  107. PublishedBy usGary Marcus

    o3 or Claude cannot simply be dropped into complex problems and expected to work reliably.

    Published after both AI reviews and the final check passed.

  108. PublishedBy usGary Marcus

    For at least the next decade LLMs will continue to have uses, especially for coding, brainstorming and writing.

    Published after both AI reviews and the final check passed.

  109. PublishedBy usGary Marcus

    LLMs are no substitute for good well-specified conventional algorithms.

    Published after both AI reviews and the final check passed.

  110. PublishedBy usGary Marcus

    High school students will love Galactica and will use it to fool and intimidate some of their teachers.

    Published after both AI reviews and the final check passed.

  111. Held backBy usGary Marcus

    A Few Words About Bullshit

    One of the AIs read the claim differently from our summary.

  112. Held backBy usGary Marcus

    A Few Words About Bullshit

    One AI wasn’t sure who said it.

  113. Held backBy usGary Marcus

    Meta's Galactica language model frequently produces false or fabricated content.

    The final check failed: a cited source didn’t say what the write-up said.

  114. PublishedBy usGary Marcus

    Like Galactica, every other large language model the author has seen prevaricates (fabricates content) a lot.

    Published after both AI reviews and the final check passed.

  115. Held backBy usGary Marcus

    A few dark words about chatbots and death

    One of the AIs read the claim differently from our summary.

  116. Held backBy usGary Marcus

    OpenAI faces at least eight wrongful death lawsuits related to ChatGPT users.

    A reviewer said our test wasn’t fair to what was actually said.

  117. PublishedBy usGary Marcus

    Chatbots apparently inducing delusions in humans is a growing problem.

    Published after both AI reviews and the final check passed.

  118. PublishedBy usGary Marcus

    Society should especially worry about chatbots influencing children, as teen deaths have shown.

    Published after both AI reviews and the final check passed.

  119. Held backBy usGary Marcus

    The harms Marcus warned about years ago (enshittification of the web, mass misinformation, more cyberscams) are now all happening.

    A reviewer said our test wasn’t fair to what was actually said.

  120. PublishedBy usGary Marcus

    Marcus is increasingly convinced that, although generative AI has its uses, on balance it is not a step forward for humanity.

    Published after both AI reviews and the final check passed.

  121. Held backBy usGary Marcus

    Marcus's December 2022 prediction that the first chatbot-related death would occur in 2023 proved correct.

    A reviewer said our test wasn’t fair to what was actually said.

  122. PublishedBy usGary Marcus

    The problem of chatbot-associated deaths is getting worse.

    Published after both AI reviews and the final check passed.

  123. Held backBy usGary Marcus

    By April 2023 a chatbot-related death had occurred, though causality was hard to prove.

    The final check failed: the write-up said more than the evidence showed.

  124. Held backBy usGary Marcus

    Among American AI companies, no lead lasts more than a few months.

    The final check of the write-up failed.

  125. Held backBy usGary Marcus

    The US is not far ahead of China in the generative AI race.

    A piece of evidence came from the wrong dates.

  126. Held backBy usGary Marcus

    The core misconception that is driving American AI policy

    The final check failed: the write-up said more than the evidence showed.

  127. PublishedBy usGary Marcus

    Generative AI models are commodities.

    Published after both AI reviews and the final check passed.

  128. Held backBy usGary Marcus

    China is currently at most a few months behind the US in generative AI.

    A piece of evidence came from the wrong dates.

  129. PublishedBy usGary Marcus

    The US-China lead in generative AI will be slight and flip back and forth, with neither retaining a sizeable lead for long.

    Published after both AI reviews and the final check passed.

  130. Held backBy usGary Marcus

    A CERN for AI and the Global Governance of AI

    One of the AIs read the claim differently from our summary.

  131. PublishedBy usGary Marcus

    There is no way to guarantee LLMs won't be jailbroken, and current LLMs can be jailbroken quickly and automatically.

    Published after both AI reviews and the final check passed.

  132. PublishedBy usGary Marcus

    It is likely that at least one of the 60+ elections worldwide in 2024 will be swayed by deepfakes.

    Published after both AI reviews and the final check passed.

  133. PublishedBy usGary Marcus

    Current AI cannot reliably anticipate the consequences or harms of actions it recommends.

    Published after both AI reviews and the final check passed.

  134. PublishedBy usGary Marcus

    A CERN for AI safety and global AI safety governance should be created, provided they address a balanced range of risks.

    Published after both AI reviews and the final check passed.

  135. PublishedBy usGary Marcus

    There is no way to guarantee that large language models reliably stick to facts.

    Published after both AI reviews and the final check passed.

  136. PublishedBy usGary Marcus

    AI risk discussion should focus much more on misuse of LLMs by criminals and terrorists, not just on AI takeover scenarios.

    Published after both AI reviews and the final check passed.

  137. PublishedBy usGary Marcus

    AI need not be superintelligent to create serious problems; the real issue is control.

    Published after both AI reviews and the final check passed.

  138. PublishedBy usGary Marcus

    We need to consider both current AI risk and AGI risk.

    Published after both AI reviews and the final check passed.

  139. PublishedBy usGary Marcus

    People should not listen to those who deny there is any AI risk, such as Marc Andreessen, because enormous money is at stake.

    Published after both AI reviews and the final check passed.

  140. Held backBy usGary Marcus

    A CERN for AI and the Global Governance of AI

    The final check failed: a cited source didn’t say what the write-up said, and our summary didn’t match their words.