Claims checked against evidence, page 22 of 31
Claims by Gary Marcus and Ed Zitron. Deadlines are judged as of 2026-10-29.
Claims checked against evidence (3100)
Each of these claims was checked against dated evidence.
Page 22 of 31: claims 2101 to 2200 of 3100, ordered by the date first said, newest first. To find a claim by its words, use search.
Assessment: ContradictedSaid
“Along with $3.5 billion from Saudi Arabia’s Public Investment fund and over $8 billion from Softbank, the latter a secondary market sale, it also raised (equity and debt financing respectively) from Goldman Sachs and Morgan Stanley — two parties I do not believe are going to be willing to subsidize generative AI.”
What happened: Both named banks participated in OpenAI's executed credit facility, demonstrating willingness to finance the business. The report's commercial interest terms do not establish a concessionary subsidy. (CNBC, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Pre-AGI in this case refers to anything OpenAI has ever developed, as it has yet to develop AGI and has yet to get past the initial "chatbot" stage of its own 5-level system of evaluating artificial intelligence.”
What happened: The report places OpenAI just below level 2. Approaching that level does not establish that it had passed the initial chatbot stage. (The Decoder, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“And OpenAI must grow, because $3.5 billion to $4.5 billion a year in revenue is simply not enough to keep this company going.”
What happened: The article reports estimated 2024 operating costs of $8.5 billion against estimated revenue of $3.5–4.5 billion. Both ends of the revenue range fall below the estimated costs, supporting the operating-coverage reading. (The Decoder, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Consequently, any “reasoning” or “planning” in LLMs is hit or miss, viable if the particulars of a given situation are close enough to what is in the training set, but highly vulnerable if they are not.”
What happened: Reasoning accuracy falls substantially and consistently on unfamiliar variants of the same tasks. Performance is still nontrivial, which fits 'hit or miss' rather than total failure. (Wu et al., MIT/Boston University (arXiv; NAACL 2024), )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Much as I admire the new pair of systems, they do have a serious shortcoming and one that is not unfamiliar. The systems both rely on a kind of cheat on the input: trained human coders translate all the Olympiad's input sentences into mathematical form.”
What happened: The primary paper explicitly confirms expert manual formalization of AlphaProof's competition inputs. Its publication is later, but the reported event is the July 2024 evaluation. (Nature, )
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“I fully expect that the generative AI bubble will begin to burst within the next 12 months, for many reasons:”
What happened: EY reports $49.2 billion of first-half generative AI VC investment versus $44.2 billion for all of 2024. It also reports nearly 25% fewer transactions than in the preceding half-year, a material sign of concentration that qualifies the expansion. (EY Ireland, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Nonetheless, GDM's new work is powerful proof of concept (pun intended!). Neural networks and symbol systems can be profitably combined, contra Hinton and LeCun.”
What happened: The developer's account connects the actual IMO proofs to a transformer that proposes Lean tactics, search over proof states and automatic formal verification. It explicitly identifies the described work as ending in July 2024. (Julian Schrittwieser, AlphaProof coauthor, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Hallucinations and boneheaded errors of reasoning and what I like to call discomprehensions are, as far as I can tell, an inevitable byproduct of LLMs; certainly they have yet to disappear, despite many promises to the contrary.”
What happened: In mid-2024, LLM products whose providers claimed they 'avoid' hallucinations still hallucinated on 17% to 34% or more of test queries. (Stanford HAI / RegLab, )
Assessment: ContradictedSaid
“The current approach has reached a plateau”
What happened: User comparisons collected June 10–25 show newer frontier models outperforming preceding models on image-containing conversations. Preference measurements are imperfect, but this is independent evidence of improvement within the target quarter. (LMSYS Org, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Long-term adoption (vs mere experimentation) has been modest, there is no significantly better tech now than there was in January; GPT-5 is still a no show.”
What happened: The official July release history records GPT-4o mini, not GPT-5. This supports the chronology alongside explicit reporting that GPT-5 remained forthcoming; this entry alone would not prove nonrelease. (OpenAI, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“Even though it doesn't really automate anything.”
What happened: Intercom reported that deployed Fin systems resolved customer questions directly. The existence of successful bounded tasks contradicts 'anything', although the reported percentage requires qualification. (Intercom, )
Assessment: ContradictedSaid
“Here's the thing, I get that that might be what they're pushing toward, but generative AI isn't even automation at this point.”
What happened: Intercom reported actual customer deployments resolving queries directly through Fin. This supports the existence of bounded task automation, although the reported percentage is not an independently verified success rate. (Intercom, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“As Ernie Davis and I pointed out in Rebooting AI, five years ago, part of the reason we are struggling with AI in complex AI systems is that we still lack adequate techniques for engineering complex systems. That hasn’t really changed.”
What happened: The researchers explain that model scale and structure make established software testing and verification methods difficult to apply. They connect that methodological limitation to the difficulty of ensuring deployment robustness. (DeepMind, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“To reach level 3 (whatever “Agents, systems that can take actions” means) you’d need a level of sentience dependent on entirely new forms of mathematics.”
What happened: The account describes Claude Sonnet 3.7 using search, notes, Slack, and price-setting tools over a month, with humans providing physical services. I infer from this documented implementation that sustained action-taking did not require the asserted new mathematical foundations. (Anthropic, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“And yes, that sound you hear is the slow deflation of the bubble I've been warning you about since March.”
What happened: Their account of PitchBook data reports record generative-AI investment in Q2. The same article describes weaker US seed activity and cooler enthusiasm, so the contradiction concerns broad financial contraction. (Aspiring for Intelligence — Sabrina Albert and Vivek Ramaswami, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“It cannot do much more than it is currently doing, other than doing more of it faster with some new inputs.”
What happened: The public evaluation reported 97.8% success on basic Blocksworld and 52.8% on its obfuscated version, where earlier tested LLMs remained below 5%. These are substantive planning gains; the event date denotes publication of the demonstration, since exact test-run dates are not supplied. (Valmeekam, Stechly, Gundawar and Kambhampati / arXiv, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“For Goldman to suddenly turn on the AI movement suggests that it’s extremely anxious about the future of generative AI, with almost everybody agreeing on one core point: that the longer this tech takes to make people money, the more money it's going to need to make.”
What happened: The investor's model illustrates the recurring recovery burden from continued AI infrastructure spending. Its numerical estimate is not treated as audited industry profit or as a figure claimed by Zitron. (Sequoia Capital — David Cahn, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“It isn’t getting much more efficient.”
What happened: The paper reports stronger model performance with 93.3% less attention-cache memory than DeepSeek 67B. Its deployment tests report 5.76 times the generation throughput on an eight-H800 node using the earlier service's workload distribution, demonstrating substantial resource-efficiency gains. (DeepSeek-AI / arXiv, )
Assessment: UnresolvedSaid
Assessment: MixedSaid
“Behind the scenes, generative AI isn’t moving the needle”
What held: Named executives described inaccurate answers and substantial preparation work, with Juniper not ready for production deployment. This supports the narrower contention that some enterprises were struggling to obtain useful results. (The Wall Street Journal, reproduced by AI Incident Database, )
What did not: Klarna reported a material reduction in repeat inquiries from an operating generative AI assistant. This is a realized operational benefit, although company-reported and not a measure of net financial return. (Klarna, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“Generative AI is hitting a wall, and any future improvements will be marginal, and cost billions to achieve.”
What happened: ARC Prize reports 75.7% and 87.5% for the o3 preview configurations and contrasts these with GPT-4o's 5% performance in 2024. The evaluator describes a substantial advance, while disclosing benchmark-specific training and increased inference computation. (ARC Prize, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“As of today, I am more confident than ever that GPT-5 won’t land this year.”
What happened: OpenAI introduced GPT-5 on August 7, 2025. A model first introduced in August 2025 was not released in 2024. (OpenAI, )
Assessment: SupportedSaid
“As of today, I am more confident than ever that GPT-5 won’t land this year.”
What happened: OpenAI's initial GPT-5 announcement is dated August 7, 2025, and describes rollout beginning that day. This places its public arrival after the forecast's 2024 deadline. (OpenAI, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“While Google has desperately tried (and failed) to convince Wall Street that it’s building and selling the future”
What happened: Goldman Sachs's reported assessment after I/O is direct evidence that a prominent Wall Street institution accepted Google's AI leadership and product-integration pitch. The original analyst note was not accessible, so this assessment relies on reporting. (Yahoo Finance, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Exhibit A: OpenAI’s CTO Mira Murati just publicly acknowledged what I long suspected: there is no mind blowing GPT-5 behind the scenes as of yet.”
What happened: The contemporaneous report attributes a modest internal capability lead to OpenAI's CTO. This supports the ordinary qualitative reading, although it does not independently measure private models or identify one as GPT-5. (The Decoder, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“As things get desperate, Altman will use the only approach he knows: sheer force of will. He will push OpenAI to grow and sell into as many industries as possible, a specious hype-man selling to other specious hype-men desperate to connect their company to an AI bubble inflated by Altman himself.”
What happened: The article reports that Altman declared a code red to avoid falling behind competitors and redirected work. This meets the stated reading of serious business pressure, though it does not establish insolvency. (MacRumors, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“In many ways, it is much weaker than what Altman and I talked about at the Senate last year.”
What happened: Marcus proposed FDA-like review before deployment. The same transcript records Altman's proposed licensing agency, license revocation, safety standards, and independent audits; it establishes the comparison rather than proving Marcus's later assessment by repetition. (U.S. Senate / Government Publishing Office, )
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“He doesn’t specify which actual restrictions in the proposal bill would “stifle AI models”.”
What happened: Ng explicitly names safety assessments and shutdown capabilities. In the next paragraph, he focuses on the hazardous-capability designation and potential downstream liability, then connects that burden to inhibited model development, especially open source. (DeepLearning.AI, )
Assessment: SupportedSaid
“Two weeks later, it has already come out that the database that indexes the whole thing is in plain text (except on systems that are explicitly set to encrypt everything). That’s bananas. Keystone Kops level security.”
What happened: The preserved June documentation describes the unencrypted database and demonstrates extracting and searching its screenshot-derived text. Its June 6 example falls within the target period; June 8 is the documentation's stated FAQ update date. (Alexander Hagenah, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: MixedSaid
“The graph assumes that all continued progress will be same — ignoring qualitatively unsolved problems (hallucinations, planning, reasoning etc), the fact that synthetic data may not be as useful as natural data, limits on then-possible energy distribution and compute, etc.”
What held: Supports the trend-continuation component, not the alleged omission of obstacles. (Leopold Aschenbrenner, Situational Awareness, )
What did not: The surrounding discussion explicitly allows data constraints to halt progress without new methods. (Leopold Aschenbrenner, Situational Awareness, )
Assessment: SupportedSaid
“For one thing, the bad press about Sam Altman and OpenAI, who once seemingly could do no wrong, just keeps coming.”
What happened: This critical newsletter discusses the voice dispute, safety-team departures, and restrictive employee agreements. The event being assessed is publication of critical coverage; available_at conservatively uses the displayed modification date. (The Guardian, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Despite being an inherently AI-powered feature, it can’t distinguish between ordinary computer usage and genuinely sensitive information — like passwords, health information, or trade secrets that must be protected at all costs.”
What happened: The contemporary reproduction of Microsoft's own FAQ explicitly says that the preview did not hide sensitive information. The surrounding FAQ lists manual and application-based exclusions, which do not amount to automatic sensitivity recognition. (Gibson Research Corporation, Security Now!, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid