Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

Changes, page 59 of 60

Everything we published, changed, or held back, newest first.

All changes (11,844)

Changes 11,601 to 11,800 of 11,844, newest first. Page 59 of 60.

  1. PublishedBy usGary Marcus

    Scaling laws aren't really laws anymore, if they ever were, and the meaning of the word 'scaling' has been greatly devalued.

    Published after both AI reviews and the final check passed.

  2. PublishedBy usGary Marcus

    Next-word prediction gets us a surprisingly long way in writing code, but less far in making sure that code is robust.

    Published after both AI reviews and the final check passed.

  3. PublishedBy usGary Marcus

    Coders, especially inexperienced vibe coders, should be wary of the robustness of AI-generated code.

    Published after both AI reviews and the final check passed.

  4. PublishedBy usGary Marcus

    LLMs may succeed on easy test sets and mislead users into thinking they have a generalizable solution when they do not.

    Published after both AI reviews and the final check passed.

  5. PublishedBy usGary Marcus

    Models like o3 hallucinate much more than attentive humans and struggle with reliable diagrams.

    Published after both AI reviews and the final check passed.

  6. PublishedBy usGary Marcus

    Marcus sarcastically suggests that getting to 'alignment' or 'safety' without reliability is a long shot.

    Published after both AI reviews and the final check passed.

  7. PublishedBy usGary Marcus

    LLMs writing Python code to supplement their weaknesses is not reliable.

    Published after both AI reviews and the final check passed.

  8. PublishedBy usGary Marcus

    LLMs cannot reliably solve the Tower of Hanoi.

    Published after both AI reviews and the final check passed.

  9. PublishedBy usGary Marcus

    Apple's new paper is pretty devastating to LLMs and is a powerful followup to a paper from many of the same authors last year.

    Published after both AI reviews and the final check passed.

  10. PublishedBy usGary Marcus

    Other forms of deep learning, especially those that work well with symbols, may eventually thrive.

    Published after both AI reviews and the final check passed.

  11. PublishedBy usGary Marcus

    LLMs can't play chess, fold proteins, or run databases as well as conventional or special-purpose systems.

    Published after both AI reviews and the final check passed.

  12. PublishedBy usGary Marcus

    The LLM approach has limits that are becoming clearer every day.

    Published after both AI reviews and the final check passed.

  13. PublishedBy usGary Marcus

    Claude gets under 80% accuracy on 7-disc Tower of Hanoi and essentially cannot solve 8 discs.

    Published after both AI reviews and the final check passed.

  14. Held backBy usGary Marcus

    A knockout blow for LLMs?

    One of the AIs read the claim differently from our summary.

  15. PublishedBy usGary Marcus

    o3 or Claude cannot simply be dropped into complex problems and expected to work reliably.

    Published after both AI reviews and the final check passed.

  16. PublishedBy usGary Marcus

    For at least the next decade LLMs will continue to have uses, especially for coding, brainstorming and writing.

    Published after both AI reviews and the final check passed.

  17. PublishedBy usGary Marcus

    LLMs are no substitute for good well-specified conventional algorithms.

    Published after both AI reviews and the final check passed.

  18. PublishedBy usGary Marcus

    High school students will love Galactica and will use it to fool and intimidate some of their teachers.

    Published after both AI reviews and the final check passed.

  19. Held backBy usGary Marcus

    A Few Words About Bullshit

    One of the AIs read the claim differently from our summary.

  20. Held backBy usGary Marcus

    A Few Words About Bullshit

    One AI wasn’t sure who said it.

  21. Held backBy usGary Marcus

    A Few Words About Bullshit

    The final check failed: a cited source didn’t say what the write-up said.

  22. PublishedBy usGary Marcus

    Like Galactica, every other large language model the author has seen prevaricates (fabricates content) a lot.

    Published after both AI reviews and the final check passed.

  23. Held backBy usGary Marcus

    A few dark words about chatbots and death

    One of the AIs read the claim differently from our summary.

  24. Held backBy usGary Marcus

    OpenAI faces at least eight wrongful death lawsuits related to ChatGPT users.

    A reviewer said our test wasn’t fair to what was actually said.

  25. PublishedBy usGary Marcus

    Chatbots apparently inducing delusions in humans is a growing problem.

    Published after both AI reviews and the final check passed.

  26. PublishedBy usGary Marcus

    Society should especially worry about chatbots influencing children, as teen deaths have shown.

    Published after both AI reviews and the final check passed.

  27. Held backBy usGary Marcus

    The harms Marcus warned about years ago (enshittification of the web, mass misinformation, more cyberscams) are now all happening.

    A reviewer said our test wasn’t fair to what was actually said.

  28. PublishedBy usGary Marcus

    Marcus is increasingly convinced that, although generative AI has its uses, on balance it is not a step forward for humanity.

    Published after both AI reviews and the final check passed.

  29. Held backBy usGary Marcus

    Marcus's December 2022 prediction that the first chatbot-related death would occur in 2023 proved correct.

    A reviewer said our test wasn’t fair to what was actually said.

  30. PublishedBy usGary Marcus

    The problem of chatbot-associated deaths is getting worse.

    Published after both AI reviews and the final check passed.

  31. Held backBy usGary Marcus

    By April 2023 a chatbot-related death had occurred, though causality was hard to prove.

    The final check failed: the write-up said more than the evidence showed.

  32. Held backBy usGary Marcus

    The core misconception that is driving American AI policy

    The final check of the write-up failed.

  33. Held backBy usGary Marcus

    The US is not far ahead of China in the generative AI race.

    A piece of evidence came from the wrong dates.

  34. Held backBy usGary Marcus

    The core misconception that is driving American AI policy

    The final check failed: the write-up said more than the evidence showed.

  35. PublishedBy usGary Marcus

    Generative AI models are commodities.

    Published after both AI reviews and the final check passed.

  36. Held backBy usGary Marcus

    China is currently at most a few months behind the US in generative AI.

    A piece of evidence came from the wrong dates.

  37. PublishedBy usGary Marcus

    The US-China lead in generative AI will be slight and flip back and forth, with neither retaining a sizeable lead for long.

    Published after both AI reviews and the final check passed.

  38. Held backBy usGary Marcus

    A CERN for AI and the Global Governance of AI

    One of the AIs read the claim differently from our summary.

  39. PublishedBy usGary Marcus

    There is no way to guarantee LLMs won't be jailbroken, and current LLMs can be jailbroken quickly and automatically.

    Published after both AI reviews and the final check passed.

  40. PublishedBy usGary Marcus

    It is likely that at least one of the 60+ elections worldwide in 2024 will be swayed by deepfakes.

    Published after both AI reviews and the final check passed.

  41. PublishedBy usGary Marcus

    Current AI cannot reliably anticipate the consequences or harms of actions it recommends.

    Published after both AI reviews and the final check passed.

  42. PublishedBy usGary Marcus

    A CERN for AI safety and global AI safety governance should be created, provided they address a balanced range of risks.

    Published after both AI reviews and the final check passed.

  43. PublishedBy usGary Marcus

    There is no way to guarantee that large language models reliably stick to facts.

    Published after both AI reviews and the final check passed.

  44. PublishedBy usGary Marcus

    AI risk discussion should focus much more on misuse of LLMs by criminals and terrorists, not just on AI takeover scenarios.

    Published after both AI reviews and the final check passed.

  45. PublishedBy usGary Marcus

    AI need not be superintelligent to create serious problems; the real issue is control.

    Published after both AI reviews and the final check passed.

  46. PublishedBy usGary Marcus

    We need to consider both current AI risk and AGI risk.

    Published after both AI reviews and the final check passed.

  47. PublishedBy usGary Marcus

    People should not listen to those who deny there is any AI risk, such as Marc Andreessen, because enormous money is at stake.

    Published after both AI reviews and the final check passed.

  48. Held backBy usGary Marcus

    A CERN for AI and the Global Governance of AI

    The final check failed: a cited source didn’t say what the write-up said, and our summary didn’t match their words.

  49. PublishedBy usGary Marcus

    The combined AI safety efforts of large tech companies have not yielded much.

    Published after both AI reviews and the final check passed.

  50. PublishedBy usGary Marcus

    SoftBank has sold its entire Nvidia position, which is an ominous sign for generative AI.

    Published after both AI reviews and the final check passed.

  51. PublishedBy usGary Marcus

    Meta's financing games have been revealed, presented as one of five recent ominous signs for generative AI.

    Published after both AI reviews and the final check passed.

  52. Held backBy usGary Marcus

    5 recent, ominous signs for Generative AI

    One of the AIs read the claim differently from our summary.

  53. PublishedBy usGary Marcus

    CoreWeave's stock fell 20% in one week, which is an ominous sign for generative AI.

    Published after both AI reviews and the final check passed.

  54. PublishedBy usGary Marcus

    Oracle's debt has been downgraded, which is an ominous sign for generative AI.

    Published after both AI reviews and the final check passed.

  55. PublishedBy usGary Marcus

    What Marcus said to Joscha Bach 26 months earlier still holds, 100%.

    Published after both AI reviews and the final check passed.

  56. Held backBy usGary Marcus

    The lords of deep learning have failed to resolve what ails their AI.

    The final check failed: the write-up said more than the evidence showed, and a condition they stated was left out.

  57. PublishedBy usGary Marcus

    There has been no progress toward solving the AI alignment problem between 2022 and mid-2024.

    Published after both AI reviews and the final check passed.

  58. PublishedBy usGary Marcus

    Current AI technology, which Musk is now wildly overhyping, remains exactly as incorrigible as it ever was.

    Published after both AI reviews and the final check passed.

  59. Held backBy usGary Marcus

    25 AI Predictions for 2025, from Marcus on AI

    The final check of the write-up failed.

  60. Held backBy usGary Marcus

    No single AI system will solve more than 4 of the Marcus-Brundage AI 2027 tasks by end of 2025.

    The two reviewers reached different verdicts.

  61. PublishedBy usGary Marcus

    AI will presumably eventually solve compositionality, factuality and reasoning, but current techniques have not been adequate.

    Published after both AI reviews and the final check passed.

  62. PublishedBy usGary Marcus

    There could be no GPT-5 level model, meaning a huge across-the-board leap by community consensus, throughout 2025.

    Published after both AI reviews and the final check passed.

  63. PublishedBy usGary Marcus

    Possibly none of the Marcus-Brundage tasks will be reliably solved by end of 2025.

    Published after both AI reviews and the final check passed.

  64. PublishedBy usGary Marcus

    Commercial artists and voiceover actors have perhaps been hardest hit by AI so far.

    Published after both AI reviews and the final check passed.

  65. Held backBy usGary Marcus

    Through 2025, profits from AI models will remain modest or nonexistent while chipmakers continue to do well.

    A piece of evidence didn’t measure what the claim was about.

  66. PublishedBy usGary Marcus

    In 2025 there may be a large-scale cyberattack in which generative AI plays an important causal role.

    Published after both AI reviews and the final check passed.

  67. Held backBy usGary Marcus

    25 AI Predictions for 2025, from Marcus on AI

    One of the AIs read the claim differently from our summary.

  68. PublishedBy usGary Marcus

    OpenAI's o3 will likely be quite expensive when released.

    Published after both AI reviews and the final check passed.

  69. PublishedBy usGary Marcus

    With medium confidence, by the end of 2025 neurosymbolic AI will become much more prominent.

    Published after both AI reviews and the final check passed.

  70. Held backBy usGary Marcus

    Most AI model companies have lost money, and at least three have been quasi-acquired with little profit for investors.

    A piece of evidence didn’t measure what the claim was about.

  71. Held backBy usGary Marcus

    LLMs did not markedly improve commercial assistants like Amazon Alexa during 2024.

    The two reviewers reached different verdicts.

  72. Held backBy usGary Marcus

    In 2025 much of the world will increasingly look to Europe for AI regulatory guidance.

    The two reviewers reached different verdicts.

  73. Held backBy usGary Marcus

    25 AI Predictions for 2025, from Marcus on AI

    The final check of the write-up failed.

  74. PublishedBy usGary Marcus

    AI agents will be heavily hyped in 2025 but far from reliable except possibly in very narrow use cases.

    Published after both AI reviews and the final check passed.

  75. PublishedBy usGary Marcus

    There are many GPT-4 level models, a price war, and very little moat among LLM providers.

    Published after both AI reviews and the final check passed.

  76. Held backBy usGary Marcus

    In 2025 the US will continue to have very little regulation protecting consumers from generative AI risks.

    A reviewer didn’t accept one of the pieces of evidence.

  77. PublishedBy usGary Marcus

    Through 2025 hallucinations will continue to plague generative AI.

    Published after both AI reviews and the final check passed.

  78. Held backBy usGary Marcus

    AGI will not be achieved in 2025.

    The two reviewers reached different verdicts.

  79. PublishedBy usGary Marcus

    There is still no robust solution to LLM hallucinations.

    Published after both AI reviews and the final check passed.

  80. PublishedBy usGary Marcus

    OpenAI has no profits, does not expect any until at least 2029, burns billions, and lacks a clear technical moat.

    Published after both AI reviews and the final check passed.

  81. PublishedBy usGary Marcus

    OpenAI's long-term security, especially at high valuations, is far from assured.

    Published after both AI reviews and the final check passed.

  82. PublishedBy usGary Marcus

    By end of 2025 less than 10%, probably less than 5%, of the workforce will be replaced by AI.

    Published after both AI reviews and the final check passed.

  83. PublishedBy usGary Marcus

    2024 was a year of AI disillusionment for some but not all; his prediction was overstated.

    Published after both AI reviews and the final check passed.

  84. PublishedBy usGary Marcus

    With medium confidence, by the end of 2025 Sora will continue to have trouble with physics.

    Published after both AI reviews and the final check passed.

  85. Held backBy usGary Marcus

    25 AI Predictions for 2025, from Marcus on AI

    A reviewer said our test wasn’t fair to what was actually said.

  86. Held backBy usGary Marcus

    GPT-5 was not released in 2024 despite repeated predictions.

    The two reviewers reached different verdicts.

  87. PublishedBy usGary Marcus

    By end of 2025 few if any radiologists will be replaced by AI.

    Published after both AI reviews and the final check passed.

  88. PublishedBy usGary Marcus

    Sora's troubles with physics have not gone away since its February 2024 announcement.

    Published after both AI reviews and the final check passed.

  89. PublishedBy usGary Marcus

    In 2025 we may see o1-like models good at synthetic-data-friendly tasks but only incrementally better than GPT-4 elsewhere.

    Published after both AI reviews and the final check passed.

  90. PublishedBy usGary Marcus

    Through 2025 reasoning errors will continue to plague generative AI.

    Published after both AI reviews and the final check passed.

  91. Held backBy usGary Marcus

    Marcus's 2024 AI predictions have largely held, with some caveats.

    The two reviewers reached different verdicts.

  92. PublishedBy usGary Marcus

    Valuations of major AI companies could start to fall in 2025.

    Published after both AI reviews and the final check passed.

  93. PublishedBy usGary Marcus

    Copyright lawsuits over generative AI will continue throughout 2025.

    Published after both AI reviews and the final check passed.

  94. PublishedBy usGary Marcus

    AI sweatshops result from substituting shallow data for deep understanding in AI design.

    Published after both AI reviews and the final check passed.

  95. PublishedBy usGary Marcus

    Genuine AI would not require vast amounts of training data.

    Published after both AI reviews and the final check passed.

  96. PublishedBy usGary Marcus

    CNET was the first casualty of putting too much faith in ChatGPT, publishing AI-written stories with many mistakes.

    Published after both AI reviews and the final check passed.

  97. Held backBy usGary Marcus

    24 Seriously Embarrassing Hours for AI

    A reviewer said our test wasn’t fair to what was actually said.

  98. PublishedBy usGary Marcus

    In choosing what kind of AI to build, sometimes the slower road is the better road.

    Published after both AI reviews and the final check passed.

  99. PublishedBy usGary Marcus

    Anthropic's Claude, despite its alignment focus, still quickly hallucinates like ChatGPT.

    Published after both AI reviews and the final check passed.

  100. Held backBy usGary Marcus

    24 Seriously Embarrassing Hours for AI

    A reviewer said our test wasn’t fair to what was actually said.

  101. PublishedBy usGary Marcus

    Genuine AI would not require sweatshop labor.

    Published after both AI reviews and the final check passed.

  102. Held backBy usGary Marcus

    As of January 2023, no car has completed an intervention-free autonomous drive from LA to NYC.

    The two reviewers reached different verdicts.

  103. Held backBy usGary Marcus

    OpenAI used sweatshop labor behind the scenes.

    A reviewer didn’t accept one of the pieces of evidence.

  104. Held backBy usGary Marcus

    24 Seriously Embarrassing Hours for AI

    The two reviewers read the claim differently.

  105. PublishedBy usGary Marcus

    Tesla FSD is getting better, and he raises the question of whether it is getting enough better.

    Published after both AI reviews and the final check passed.

  106. PublishedBy usGary Marcus

    The generative AI investment bubble may not last forever, as signalled by some late-stage VC firms sitting out.

    Published after both AI reviews and the final check passed.

  107. PublishedBy usGary Marcus

    Generative AI is starting to get a tiny bit of a 'Scarlet Letter' feel, which he presents as possible foreshadowing.

    Published after both AI reviews and the final check passed.

  108. Held backBy usGary Marcus

    You could argue that almost every LLM, Grok included, has a slight liberal bias.

    The claim is hedged, so it isn’t scored.

  109. Held backBy usGary Marcus

    1984, but with LLM’s

    The final check of the write-up failed.

  110. Held backBy usGary Marcus

    After failing to make Grok match his personal beliefs, Musk will rewrite Grok's training data (history) so that it matches his views.

    A reviewer said our test wasn’t fair to what was actually said.

  111. Held backBy usGary Marcus

    1984, but with LLM’s

    A reviewer said our test wasn’t fair to what was actually said.

  112. Held backBy usGary Marcus

    1984, but with LLM’s

    The final check of the write-up failed.

  113. PublishedBy usGary Marcus

    Even if LLMs are not AGI, they could easily become the most powerful form of mind control ever invented.

    Published after both AI reviews and the final check passed.

  114. Held backBy usGary Marcus

    1984, but with LLM’s

    The final check failed: the write-up said more than the evidence showed.

  115. Held backBy usGary Marcus

    Bad Actors are Grooming LLMs to Produce Falsehoods

    One of the AIs read the claim differently from our summary.

  116. Held backBy usGary Marcus

    Bad Actors are Grooming LLMs to Produce Falsehoods

    One of the AIs read the claim differently from our summary.

  117. Held backBy usGary Marcus

    Bad Actors are Grooming LLMs to Produce Falsehoods

    One of the AIs read the claim differently from our summary.

  118. PublishedBy usGary Marcus

    Current AIs, being naive mimicry systems, degrade their own futures and training data whenever they repeat propaganda.

    Published after both AI reviews and the final check passed.

  119. PublishedBy usGary Marcus

    If an LLM's training data or search-accessible data is tainted, the model may well regurgitate the tainted information.

    Published after both AI reviews and the final check passed.

  120. Held backBy usGary Marcus

    Bad Actors are Grooming LLMs to Produce Falsehoods

    One of the AIs read the claim differently from our summary.

  121. CorrectionBy usGary Marcus

    Filed under 'Medium confidence': at the end of 2025, OpenAI's Sora will still have trouble with physics.

    A new assessment with the same outcome replaced the previous one.

  122. CorrectionBy usGary Marcus

    The current generation of AI agents should be removed from the market until they can be fixed.

    A new assessment with the same outcome replaced the previous one.

  123. Held backBy usGary Marcus

    By about February 2025, one year after the post, there will be no perfectly reliable, hallucination-free chatbots.

    A reviewer said our test wasn’t fair to what was actually said.

  124. CorrectionBy usGary Marcus

    By the end of 2024, hallucinations by large language models will not have been reduced to the level of human experts.

    A new assessment with the same outcome replaced the previous one.

  125. CorrectionBy usGary Marcus

    OpenAI will not release GPT-5 in 2024.

    A new assessment with the same outcome replaced the previous one.

  126. CorrectionBy usGary Marcus

    During 2024 and 2025, leading AI figures will further revise and lower their public expectations for AI, such as AGI timelines.

    A new assessment with the same outcome replaced the previous one.

  127. CorrectionBy usGary Marcus

    Marcus suspects that OpenAI's GPT-6 Astra will show loads of problems with open-ended real-world tasks, despite its success on ARC-AGI.

    A new assessment with the same outcome replaced the previous one.

  128. CorrectionBy usGary Marcus

    If 'great' AI research agents do not arrive by the end of 2025, everything later in the AI 2027 scenario's timeline is pushed back.

    A new assessment with the same outcome replaced the previous one.

  129. CorrectionBy usGary Marcus

    Throughout 2025, AI agents will be endlessly hyped but far from reliable, except possibly in very narrow use cases.

    A new assessment with the same outcome replaced the previous one.

  130. Held backBy usEd Zitron

    If Oracle loses OpenAI's revenue, Oracle will collapse.

    A reviewer said our test wasn’t fair to what was actually said.

  131. CorrectionBy usEd Zitron

    If OpenAI does not convert to a for-profit structure by the end of 2025, it will be effectively dead.

    A new assessment with the same outcome replaced the previous one.

  132. Held backBy usEd Zitron

    OpenAI and Broadcom will not build their custom AI chip (ASIC) in 2026.

    The two reviewers reached different verdicts.

  133. Held backBy usEd Zitron

    What Happens If OpenAI Dies?

    The final check of the write-up failed.

  134. CorrectionBy usEd Zitron

    By the end of 2025, Microsoft will have spent over $200 billion in capital expenditures since 2023.

    A new assessment with the same outcome replaced the previous one.