Claims that can’t be checked, page 22 of 37
Claims by Gary Marcus and Ed Zitron. Deadlines are judged as of 2026-10-29.
Claims that can’t be checked (3643)
Public evidence cannot settle these claims, so they are recorded and attributed, not scored. Most were screened out: both AI providers read the claim on its own and found it a value judgment, rhetoric, hedged, too vague to test, or about something no public evidence could show. The rest were found to be recommendations or too open to test in a full review.
Page 22 of 37: claims 2101 to 2200 of 3643, ordered by the date first said, newest first. To find a claim by its words, use search.
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“As AI comes to have more power in society, AI skepticism becomes an increasingly important counterweight, and we should all want AI skepticism to be done right.”
Our reading: As AI gains power, AI skepticism becomes an increasingly important counterweight and should be done well.
No horizon
Qualifier: as AI gains more power in society
Source: Hard-forked! Casey Newton’s distorted portrait of Gary Marcus and AI skepticism
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“We ought to prepare – now – for AI to get a lot more dangerous than it already is.”
Our reading: Society should prepare now for AI becoming much more dangerous than it already is.
No horizon
Source: Hard-forked! Casey Newton’s distorted portrait of Gary Marcus and AI skepticism
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“Newton is of course right that we need to prepare for AGI, whenever it comes.”
Our reading: Society needs to prepare for AGI, whenever it arrives.
No horizon
Qualifier: whenever AGI comes
Source: Hard-forked! Casey Newton’s distorted portrait of Gary Marcus and AI skepticism
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“If there is even a 5% chance I am wrong about diminishing returns, we still ought to be moving immediately to prepare.”
Our reading: Even a 5% chance that LLM returns are not diminishing means society should move immediately to prepare for advanced AI.
No horizon
Qualifier: if there is even a 5% chance he is wrong about diminishing returns
Source: Hard-forked! Casey Newton’s distorted portrait of Gary Marcus and AI skepticism
Assessment: Can’t be checkedSaid
Gary Marcus Forecast
“Likewise, an AI with a known tendency to hallucinate things can be used to target weapon (this as may happen soon, given the recent announcement that OpenAI will collaborate with Anduril).”
Our reading: Hallucination-prone AI may soon be used to target weapons, given OpenAI's collaboration with Anduril.
No horizon
Qualifier: given OpenAI's collaboration with Anduril
Source: Hard-forked! Casey Newton’s distorted portrait of Gary Marcus and AI skepticism
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“We need, for example, a global treaty, and those tend to take a decade. Let’s get moving, people.”
Our reading: A global treaty is needed, as one example of preparation for more dangerous AI, and work on it should start now because such treaties tend to take a decade.
No horizon
Qualifier: for example
Source: Hard-forked! Casey Newton’s distorted portrait of Gary Marcus and AI skepticism
Assessment: Can’t be checkedSaid
Gary Marcus Conditional forecast
“If AGI dropped tomorrow, given the almost total lack of regulation with real teeth, I seriously doubt we as a society would be ready for it.”
Our reading: If AGI arrived immediately, society would very likely not be ready for it, given the near-absence of regulation with real teeth.
No horizon
Only if: if AGI arrived tomorrow
Source: Hard-forked! Casey Newton’s distorted portrait of Gary Marcus and AI skepticism
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“LLM’s in particular are wildly overrated.”
Our reading: LLMs in particular are wildly overrated.
No horizon
Scope: LLMs in particular, as distinct from AI generally
Source: Hard-forked! Casey Newton’s distorted portrait of Gary Marcus and AI skepticism
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“I also always say we need hybrid systems that include LLMs as one tool among many, never that that LLMs will altogether disappear, even if they become a commodity and valuations fall.”
Our reading: AI needs hybrid systems that include LLMs as one tool among many.
No horizon
Source: Hard-forked! Casey Newton’s distorted portrait of Gary Marcus and AI skepticism
Assessment: Can’t be checkedSaid
Gary Marcus Conditional forecast
“But, left unregulated, it probably will.”
Our reading: If AI is left unregulated, it will probably lead to dystopia.
No horizon
Only if: if AI is left unregulated
Source: Two visions of AI’s future
Assessment: Can’t be checkedSaid
Gary Marcus Observation
“And it’s not just United; one of the biggest applications of AI seems to be ripping off customers.”
Our reading: It is not just United: one of the biggest applications of AI seems to be ripping off customers.
No horizon
Qualifier: hedged: 'seems to be'
Source: Two visions of AI’s future
Assessment: Can’t be checkedSaid
Ed Zitron Forecast
“Microsoft is cherry-picking a number based on non-specific criteria and claiming it's a big deal, when it's actually pretty pathetic considering its capital expenditures will likely hit over $60 billion in 2024.”
Our reading: Microsoft's capital expenditures will likely exceed $60 billion in 2024, making its $10B AI revenue run-rate pathetic.
No horizon
Source: Godot Isn't Making it
Assessment: Can’t be checkedSaid
Ed Zitron Conditional forecast
“While one can dazzle investors with buzzwords and charts, the laws of physics are a far harsher mistress, and if NVIDIA is struggling mere months before the first installations are to begin, it's unclear how it practically launches this generation of chips, let alone continues its yearly cadence.”
Our reading: Given its cooling struggles, it is unclear NVIDIA can practically launch Blackwell, let alone maintain a yearly chip cadence.
No horizon
Only if: NVIDIA struggling with cooling months before installations
Source: Godot Isn't Making it
Assessment: Can’t be checkedSaid
Ed Zitron Forecast
“While NVIDIA might be able to fix this problem in isolation within its racks, it remains to be seen how this works at scale as they ship and integrate hundreds of thousands of Blackwell GPUs starting in the front half of 2025.”
Our reading: Even if NVIDIA fixes cooling within its racks, it is uncertain the fix will work at scale as hundreds of thousands of Blackwell GPUs ship from H1 2025.
No horizon
Qualifier: at scale deployment
Source: Godot Isn't Making it
Assessment: Can’t be checkedSaid
Ed Zitron Forecast
“While some have claimed that "agents are the next frontier," the reality is that agents may be the last generative AI product — multiple Large Language Models and integrations bouncing off of each other in an attempt to simulate what a human might do at a cost that won't be sustainable for the majority of businesses.”
Our reading: Agents may be the last generative AI product, and their cost won't be sustainable for most businesses.
No horizon
Source: Godot Isn't Making it
Assessment: Can’t be checkedSaid
Ed Zitron Rhetoric
“Generative AI isn’t a revolution, it’s an evolution of a tech industry overtaken by growth-hungry management consultant types that neither know the problems that real people face nor how to fix them.”
Our reading: Generative AI is not a revolution but a product of a growth-obsessed tech industry.
No horizon
Source: Godot Isn't Making it
Assessment: Can’t be checkedSaid
Ed Zitron Recommendation or value judgment
“The fact that NVIDIA is having such significant difficulties with thermal performance is very, very bad.”
Our reading: It is very, very bad that NVIDIA is having such significant difficulties with thermal performance on its Blackwell racks.
No horizon
Source: Godot Isn't Making it
Assessment: Can’t be checkedSaid
Ed Zitron Rhetoric
“And worse still, nothing has really come out of this movement.”
Our reading: Nothing has really come out of the generative AI movement.
No horizon
Source: Godot Isn't Making it
Assessment: Can’t be checkedSaid
Ed Zitron Observation
“Sam Altman has grown rich and powerful lying about how GPT will somehow lead to AGI, but at this point, what exactly is OpenAI meant to do?”
Our reading: Sam Altman's claims that GPT will lead to AGI are lies.
No horizon
Source: Godot Isn't Making it
Assessment: Can’t be checkedSaid
Ed Zitron Conditional forecast
“Even if he ultimately fails, should Musk manage to drag the process out, or delay it temporarily, it could strike a terminal blow for OpenAI.”
Our reading: If Musk delays OpenAI's for-profit conversion, it could be a terminal blow for OpenAI.
No horizon
Only if: if Musk delays OpenAI's for-profit conversion
Source: Godot Isn't Making it
Assessment: Can’t be checkedSaid
Ed Zitron Forecast
“Outside of a miracle, we are about to enter an era of desperation in the generative AI space.”
Our reading: Barring a miracle, the generative AI industry is about to enter an era of desperation.
No horizon
Qualifier: outside of a miracle
Source: Godot Isn't Making it
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“At the end of the Ezra Klein interview, I called for a massive investment in new approaches to AI. I still think that is the way to go.”
Our reading: He still thinks a massive investment in new approaches to AI, as he called for at the end of the Ezra Klein interview, is the way to go.
No horizon
Source: ChatGPT, at Age Two
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“If you have anything at all private or sensitive in Office documents, you might want to do the same.”
Our reading: Office users who have anything at all private or sensitive in their Office documents might want to switch off the 'optional connected experiences' setting, as Marcus did.
No horizon
Scope: if you have anything at all private or sensitive in Office documents
Source: PSA: Microsoft may be training on your private data without your knowledge
Assessment: Can’t be checkedSaid
Gary Marcus Observation
“Every big tech company is desperate for training data, and we can expect more companies following the same sly opt-out playbook, hiding what is going in obscure settings and Terms of Service nobody reads.”
Our reading: Every big tech company is desperate for AI training data.
No horizon
Source: PSA: Microsoft may be training on your private data without your knowledge
Assessment: Can’t be checkedSaid
Gary Marcus Rhetoric
“The key point of my recent book Taming Silicon Valley is directly relevant here: none of us stand any chance against big tech unless we stand together.”
Our reading: None of us stand any chance against big tech unless we stand together.
No horizon
Qualifier: unless we stand together
Source: PSA: Microsoft may be training on your private data without your knowledge
Assessment: Can’t be checkedSaid
Gary Marcus Rhetoric
“If we don’t, they will walk all over all of us.”
Our reading: If we don't stand together, big tech will walk all over all of us.
No horizon
Qualifier: if we don't stand together
Source: PSA: Microsoft may be training on your private data without your knowledge
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“I would appreciate further, on-the-record clarification from a named member of the company, resolving the appearance of possible contradiction.”
Our reading: Marcus says he would appreciate further on-the-record clarification from a named Microsoft employee, resolving the appearance of possible contradiction between the spokesperson's denial that Microsoft 365 customer data trains large language models and Microsoft's documentation about connected experiences analysing data.
No horizon
Qualifier: on-the-record, from a named member of the company
Assessment: Can’t be checkedSaid
Gary Marcus Observation
“Absent a clear statement in the Terms of Service, I personally remain uncertain.”
Our reading: Without a clear statement in Microsoft's Terms of Service, Marcus says he personally remains uncertain whether Microsoft uses customer data from Microsoft 365 to train large language models.
No horizon
Qualifier: absent a clear statement in the Terms of Service
Assessment: Can’t be checkedSaid
Gary Marcus Observation
“Third, scaling laws aren’t really laws anymore (if they ever were). The meaning of the word scaling has been greatly devalued.”
Our reading: Scaling laws aren't really laws anymore, if they ever were, and the meaning of the word 'scaling' has been greatly devalued.
No horizon
Qualifier: if they ever were
Assessment: Can’t be checkedSaid
Gary Marcus Rhetoric
“Trying to rescue LLMs by making a system that is inherently blind to factuality run longer — rather than better—is like smearing water around wet plates.”
Our reading: Making LLMs, which are inherently blind to factuality, run longer rather than better is a futile way to rescue them.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“We can and must do better. Scaling can only take us so far; the time has come for fresh invention.”
Our reading: The AI field must move beyond scaling and pursue genuinely new ideas.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Observation
“My guess is o1’s test time scaling works best in closed domains where you can create a lot of reliable synthetic data (such as math problems), and not so well in open-ended domains.”
Our reading: Marcus guesses that o1's test-time scaling works best in closed domains where a lot of reliable synthetic data can be created, such as math problems, and not so well in open-ended domains.
No horizon
Qualifier: my guess
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“I suggest you keep your hands on your wallets here.”
Our reading: People should be financially wary of the new claims about multiple AI scaling laws.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Observation
“Scaling can only take us so far; the time has come for fresh invention.”
Our reading: Scaling alone has limited ability to advance AI.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Observation
“In recent weeks, the third stage has finally arrived.”
Our reading: In recent weeks, as of November 2024, Marcus's 2022 conjecture has reached the stage of being regarded as self-evident, with Microsoft CEO Satya Nadella's remarks as an example. The conjecture is that LLM scaling laws are empirical observations that may not hold and that new approaches would be needed.
No horizon
Scope: in recent weeks
Source: Satya Nadella and the three stages of scientific truth
Assessment: Can’t be checkedSaid
Gary Marcus Causal claim
“Almost a half decade lost, when we could have been seriously investing in other approaches and might have made genuine progress towards robust, trustworthy artificial intelligence.”
Our reading: Focusing on LLMs cost AI research almost half a decade. Investing in alternatives might have produced real progress toward robust, trustworthy AI.
No horizon
Qualifier: if other approaches had been seriously funded
Source: Satya Nadella and the three stages of scientific truth
Assessment: Can’t be checkedSaid
Gary Marcus Causal claim
“What’s at stake? Science gets delayed.”
Our reading: Resistance to criticism of scaling slowed scientific progress in AI.
No horizon Evidence as of
Limitation: Causal counterfactual claims of this kind cannot be scored from public records.
Source: Satya Nadella and the three stages of scientific truth
Assessment: Can’t be checkedSaid
Gary Marcus Forecast
“The point was that we probably needed new architectures.”
Our reading: Marcus restates the point of his 2022 essay: AI probably needed new architectures beyond scaling LLMs.
No horizon
Qualifier: probably
Source: Satya Nadella and the three stages of scientific truth
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“Gary Marcus hopes he has taught you by now to never trust the hype.”
Our reading: Readers should never trust AI hype, such as claims that ChatGPT writes poetry indistinguishable from Shakespeare.
No horizon
Source: On hype, and the unbearable banality of ChatGPT’s poetry
Assessment: Can’t be checkedSaid
Ed Zitron Recommendation or value judgment
“OpenAI being "worth" $157 billion for a company that burns $5 billion or more a year to make a product that destroys our environment for a product yet to find any real meaning isn't a sign that it should get more coverage or be taken more seriously.”
Our reading: OpenAI's $157 billion valuation is not a reason for it to receive more coverage or be taken more seriously.
No horizon
Source: Lost In The Future
Assessment: Can’t be checkedSaid
Ed Zitron Recommendation or value judgment
“And yet so much of the tech industry — consumer software like Google, Facebook, Twitter, and even ChatGPT, and business software from companies like Microsoft and Slack — outright sucks, yet gets covered as if that's just "how things are."”
Our reading: So much of the tech industry, including consumer software like Google, Facebook, Twitter and even ChatGPT and business software from companies like Microsoft and Slack, outright sucks, yet is covered as if that is just how things are.
No horizon
Scope: so much of the tech industry
Source: Lost In The Future
Assessment: Can’t be checkedSaid
Ed Zitron Causal claim
“Whatever you may feel about ChatGPT, the coverage it receives is outsized compared to its actual utility and the things built on top of it, and that's a direct result of a media industry that seems incapable of holding the powerful accountable.”
Our reading: ChatGPT's media coverage is outsized compared to its actual utility and the things built on top of it, and this is a direct result of a media industry that seems incapable of holding the powerful accountable.
No horizon
Qualifier: seems incapable
Source: Lost In The Future
Assessment: Can’t be checkedSaid
Ed Zitron Recommendation or value judgment
“Covering Meta, Twitter, Google, OpenAI and other huge tech companies as if the products they make are remarkable and perfect is disrespectful to readers and a disgusting abdication of responsibility, as their products are, even when they're functional, significantly worse, more annoying, more frustrating and more convoluted than ever”
Our reading: Media should not cover OpenAI and other big tech companies' products as remarkable and perfect, because those products are worse and more frustrating than ever.
No horizon
Source: Lost In The Future
Assessment: Can’t be checkedSaid
Gary Marcus Observation
“As I wrote yesterday (and first noted back in April), I strongly suspect that, contra Altman, we have in fact reached a point of diminishing returns for pure scaling.”
Our reading: Marcus strongly suspects that pure scaling of AI models has reached a point of diminishing returns, as of November 2024.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Conditional forecast
“If the rumor is verified, there could be the AI equivalent of a bank run.”
Our reading: If the rumor that a second major AI company is seeing diminishing returns from scaling is verified, the AI industry could see the equivalent of a bank run.
No horizon
Only if: if the rumor that a second major company hit diminishing scaling returns is verified
Assessment: Can’t be checkedSaid
Gary Marcus Observation
“Just adding data and compute and training longer worked miracles for a while, but those days may well be over.”
Our reading: The era when simply adding data and compute produced large gains may well be over.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Forecast
“Reliable, trustworthy AI is surely achievable, but we may need to go back to the drawing board to get there.”
Our reading: Reliable, trustworthy AI is achievable, but getting there may require new approaches beyond current LLMs.
No horizon
Source: CONFIRMED: LLMs have indeed reached a point of diminishing returns
Assessment: Can’t be checkedSaid
Gary Marcus Conditional forecast
“When everyone realizes this, the financial bubble may burst quickly; even NVidia might take a hit, when people realize the extent to which its valuation was based on a false premise.”
Our reading: Once people realize LLM economics don't work, the AI financial bubble may burst quickly and even Nvidia might take a hit.
No horizon
Only if: when everyone realizes LLM economics don't work
Source: CONFIRMED: LLMs have indeed reached a point of diminishing returns
Assessment: Can’t be checkedSaid
Gary Marcus Conditional forecast
“If LLMs won’t get the US to trustworthy AI, and our adversaries invest in alternative approaches, we could easily be outfoxed.”
Our reading: If LLMs don't lead to trustworthy AI and adversaries invest in alternatives, the US could easily be outfoxed.
No horizon
Only if: LLMs won't lead to trustworthy AI
Source: CONFIRMED: LLMs have indeed reached a point of diminishing returns
Assessment: Can’t be checkedSaid
Gary Marcus Forecast
“The economics are likely to be grim.”
Our reading: The economics of LLMs are likely to be grim.
No horizon
Source: CONFIRMED: LLMs have indeed reached a point of diminishing returns
Assessment: Can’t be checkedSaid
Gary Marcus Forecast
“But that place may be smaller; it is entirely possible that LLMs on their own will never live up to last year’s wild expectations.”
Our reading: LLMs' role may be smaller than hoped, and LLMs on their own may never live up to the wild expectations of 2023.
No horizon
Qualifier: LLMs on their own
Source: CONFIRMED: LLMs have indeed reached a point of diminishing returns
Assessment: Can’t be checkedSaid
Gary Marcus Forecast
“LLMs will not disappear, even if improvements diminish, but the economics will likely never make sense: additional training is expensive, the more scaling, the more costly.”
Our reading: LLMs will not disappear even if improvements diminish, but their economics will likely never make sense because additional training is expensive and more scaling is more costly.
No horizon
Qualifier: even if improvements diminish
Source: CONFIRMED: LLMs have indeed reached a point of diminishing returns
Assessment: Can’t be checkedSaid
Gary Marcus Forecast
“The US has been putting all its AI eggs in the LLM basket, and that may well prove to be an epic, massive mistake.”
Our reading: The US has been putting all its AI eggs in the LLM basket, and that may well prove to be an epic, massive mistake.
No horizon
Qualifier: may well
Source: CONFIRMED: LLMs have indeed reached a point of diminishing returns
Assessment: Can’t be checkedSaid
Ed Zitron Recommendation or value judgment
“Third, lines of code is an absolute dogshit metric.”
Our reading: Lines of code is an extremely bad metric for judging software work.
No horizon
Source: The Cult of Microsoft
Assessment: Can’t be checkedSaid
Ed Zitron Recommendation or value judgment
“Yet to actively encourage the company-wide dilution of performance reviews — and by extension the lives of Microsoft employees — by introducing generative AI is reprehensible.”
Our reading: Actively encouraging the company-wide dilution of performance reviews, and by extension Microsoft employees' lives, by introducing generative AI is reprehensible.
No horizon
Source: The Cult of Microsoft
Assessment: Can’t be checkedSaid
Gary Marcus Observation
“Any serious scientist or engineer knows you can’t possibly predict the future with that kind of precision, especially when there are so many unknowns.”
Our reading: Nobody can predict AI's future power, chip, and capital needs with the precision Son claimed.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Causal claim
“To sweeten it all, they get free press for all these outlandish claims, and that drives up the whole thing.”
Our reading: Those making these outlandish claims get free press for them, and that drives up the whole thing, at least for a while.
No horizon
Qualifier: at least for a while
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“Nor should they take anything that he or Son said yesterday seriously.”
Our reading: People should not take Musk's or Son's AI predictions from the Riyadh forum seriously.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Rhetoric
“It’s a made up round number, with no real meaning; pure hype.”
Our reading: Masayoshi Son's figure that artificial superintelligence will be 10,000 times smarter than humans is a made-up round number with no real meaning; pure hype.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Causal claim
“That’s why so many investors working with other people’s money love plausible stories with big numbers.”
Our reading: Because investors working with other people's money get paid large fees even when investments do not pan out, so many of them love plausible stories with big numbers.
No horizon
Scope: so many investors working with other people's money
Assessment: Can’t be checkedSaid
Gary Marcus Observation
“There is just no way that we can predict all this out to 2040 with any certainty.”
Our reading: Even if one believed scaling was infinite and that useful data would not run out, there is just no way to predict all this, including how efficient future models would be in energy and chips, out to 2040 with any certainty.
No horizon
Qualifier: even if you believed scaling was infinite and useful data would not run out
Assessment: Can’t be checkedSaid
Gary Marcus Rhetoric
“As I put it on X last night, quantitative vibes are still just vibes.”
Our reading: Quantitative vibes, meaning gut feelings expressed as numbers, are still just vibes.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Observation
“In my opinion the audience of investors at the forum was being lied to: they were being assured that everything in the field of AI is under control and well plotted out when in fact science is hard and the field is in its infancy.”
Our reading: In Marcus's opinion, the investor audience at the forum was being lied to: they were being assured that everything in AI is under control and well plotted out, when in fact science is hard and the field is in its infancy.
No horizon
Qualifier: in my opinion
Assessment: Can’t be checkedSaid
Gary Marcus Causal claim
“The mere belief in this narrative with respect to AGI could motivate profoundly destabilizing actions, like a nuclear first-strike.”
Our reading: Believing in a clash-of-civilizations race for AGI could motivate profoundly destabilizing actions such as a nuclear first strike.
No horizon
Qualifier: belief in an existential clash-of-civilizations narrative about AGI
Source: “End of an Era”: OpenAI’s AGI Readiness Chief Resigns and Team is Disbanded
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“For now, I’ll just say that we should be very wary of letting science guys with toy models of the world dictate international relations.”
Our reading: We should be very wary of letting AI technologists with simplistic world models dictate international relations.
No horizon
Source: “End of an Era”: OpenAI’s AGI Readiness Chief Resigns and Team is Disbanded
Assessment: Can’t be checkedSaid
Gary Marcus Rhetoric
“His departure is yet another sign that OpenAI, as we knew it, is dead.”
Our reading: Brundage's departure is another sign that the original OpenAI no longer exists.
No horizon
Source: “End of an Era”: OpenAI’s AGI Readiness Chief Resigns and Team is Disbanded
Assessment: Can’t be checkedSaid
Gary Marcus Causal claim
“However, it’s hard not to think that the timing of his exit might have something to do with the recent reports that OpenAI is trying to restructure as a for-profit public benefit corporation (PBC) as a condition of keeping the $6.6 billion it just raised in its latest funding round.”
Our reading: The timing of Brundage's exit may be connected to OpenAI's attempt to restructure as a for-profit PBC.
No horizon
Source: “End of an Era”: OpenAI’s AGI Readiness Chief Resigns and Team is Disbanded
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“We can and should instead approach the challenge of safely building AGI as one of global, rather than national security.”
Our reading: Safely building AGI should be treated as a matter of global security, not national security.
No horizon
Source: “End of an Era”: OpenAI’s AGI Readiness Chief Resigns and Team is Disbanded
Assessment: Can’t be checkedSaid
Gary Marcus Forecast
“Especially since there aren’t many regulations on frontier AI systems and that may not change any time soon.”
Our reading: There are few regulations on frontier AI systems, and this may not change soon.
No horizon
Source: “End of an Era”: OpenAI’s AGI Readiness Chief Resigns and Team is Disbanded
Assessment: Can’t be checkedSaid
Ed Zitron Rhetoric
“There is a compelling case to be made that we are watching the slow, painful collapse of Google — a company best known for a transformational and beloved product it chose to ruin, helmed by a management consultant that has, for the most part, overseen the decay of its brand.”
Our reading: There is a compelling case that Google is in a slow, painful collapse.
No horizon
Source: Requiem for Raghavan
Assessment: Can’t be checkedSaid
Ed Zitron Observation
“It’s more than likely that Google sees AI as fundamental to its future growth and relevance.”
Our reading: Google very likely views AI as fundamental to its future growth and relevance.
No horizon
Source: Requiem for Raghavan
Assessment: Can’t be checkedSaid
Ed Zitron Forecast
“The medium-to-long-term prognosis is likely even worse.”
Our reading: Google's medium-to-long-term business prognosis is likely worse than its near-term outlook.
No horizon
Source: Requiem for Raghavan
Assessment: Can’t be checkedSaid
Ed Zitron Forecast
“As part of the Raghavan reorganization, Google is also moving the Gemini App team (the one handling Google's competitor to ChatGPT) under AI research group DeepMind, a move that might be kind of smart in the "hand the AI stuff to the AI people" kind of way, but also suggests that there is a degree of disarray at the company that isn't going to get better in a hurry.”
Our reading: Moving the Gemini App team under DeepMind might be kind of smart, but it also suggests there is a degree of disarray at Google that is not going to get better in a hurry.
No horizon
Qualifier: suggests
Source: Requiem for Raghavan
Assessment: Can’t be checkedSaid
Ed Zitron Forecast
“I am hypothesizing here, but I think that Google is desperate, and that its earnings on October 30th are likely to make the street a little worried.”
Our reading: Google's October 30, 2024 earnings will likely make Wall Street a little worried.
No horizon
Qualifier: author says he is hypothesizing
Source: Requiem for Raghavan
Assessment: Can’t be checkedSaid
Gary Marcus Conditional forecast
“Without Microsoft’s unwavering support, they could find themselves in deep trouble.”
Our reading: If OpenAI loses Microsoft's unwavering support, it could end up in deep trouble.
No horizon
Only if: without Microsoft's unwavering support
Assessment: Can’t be checkedSaid
Gary Marcus Conditional forecast
“If the answer isn’t bigger LLMs, we may have wasted half a decade.”
Our reading: If bigger LLMs are not the answer, the field may have wasted half a decade.
No horizon
Only if: if bigger LLMs are not the answer
Assessment: Can’t be checkedSaid
Gary Marcus Conditional forecast
“When I think of OpenAI, I often think of WeWork: charismatic founder, immense valuation, questionable business plan, and the possibility of similar immense deflation in their valuation, if confidence wavers.”
Our reading: Like WeWork, OpenAI has a questionable business plan and its valuation could deflate immensely if confidence wavers.
No horizon
Only if: if confidence wavers
Assessment: Can’t be checkedSaid
Gary Marcus Observation
“OpenAI might be screaming success - but its success is hardly assured.”
Our reading: OpenAI's success is far from assured.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Conditional forecast
“If things do fall apart, it is not just investors who stand to lose, but society. Immense resources may end up being wasted in vain, because of hype.”
Our reading: If things with OpenAI do fall apart, society as well as investors stands to lose, and immense resources may end up being wasted in vain because of hype.
No horizon
Only if: if things do fall apart
Assessment: Can’t be checkedSaid
Gary Marcus Forecast
“Living up to OpenAI’s $150B valuation won’t be easy.”
Our reading: OpenAI will find it hard to live up to its $150B valuation.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“AI ought to be looking itself in the mirror, too, right about now.”
Our reading: The AI industry should take a hard look at its own hype, as biomedicine had to after Theranos.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Observation
“Nothing that has happened since changes that view.”
Our reading: Marcus says nothing since his February 2023 essay has changed his view that ChatGPT may come to be seen as the greatest publicity stunt in AI history, a glimpse of a future that may take years to realize, with ethical guardrails that will take years to perfect.
No horizon
Scope: since the February 2023 essay
Source: When it comes to security, LLMs are like Swiss cheese — and that’s going to cause huge problems
Assessment: Can’t be checkedSaid
Gary Marcus Rhetoric
“It’s a disaster in the making.”
Our reading: The state of LLM chatbot safety is a disaster in the making.
No horizon
Source: When it comes to security, LLMs are like Swiss cheese — and that’s going to cause huge problems
Assessment: Can’t be checkedSaid
Gary Marcus Causal claim
“The possibilities are now endless for propaganda, troll farms, and rings of fake websites that degrade trust across the internet.”
Our reading: LLM chatbots open wide possibilities for propaganda, troll farms and fake websites that erode trust online.
No horizon
Qualifier: reaffirmed as "Still true"
Source: When it comes to security, LLMs are like Swiss cheese — and that’s going to cause huge problems
Assessment: Can’t be checkedSaid
Gary Marcus Forecast
“In hindsight, ChatGPT may come to be seen as the greatest publicity stunt in AI history, an intoxicating glimpse at a future that may actually take years to realize—kind of like a 2012-vintage driverless car demo, but this time with a foretaste of an ethical guardrail that will take years to perfect.”
Our reading: ChatGPT may come to be seen as AI's greatest publicity stunt, and its ethical guardrails will take years to perfect.
No horizon
Qualifier: reaffirmed from February 2023 essay
Source: When it comes to security, LLMs are like Swiss cheese — and that’s going to cause huge problems
Assessment: Can’t be checkedSaid
Ed Zitron Rhetoric
“or that Meta's AI product's only differentiating feature is that its 500 million monthly active users are helping kill our planet by generating meaningless slop.”
Our reading: Meta's AI product's only differentiating feature is that its 500 million monthly active users are helping kill the planet by generating meaningless slop.
No horizon
Assessment: Can’t be checkedSaid
Ed Zitron Recommendation or value judgment
“Every single article about OpenAI should include something about the brittleness of its business, and about the many, many half-truths of Sam Altman — yet more often than not these pieces feel like they simply accept that whatever he’s saying is both reasonable and accurate.”
Our reading: Every article about OpenAI should mention the brittleness of its business and Sam Altman's half-truths.
No horizon
Assessment: Can’t be checkedSaid
Ed Zitron Causal claim
“Had Sam Altman not been mythologized, there is far less of a chance that people — both investors and the media — would've taken OpenAI this seriously, and questions around profitability and sustainability would've been immediate problems to address versus "issues" to be "mitigated."”
Our reading: Had Sam Altman not been mythologized, there would have been far less of a chance that investors and the media took OpenAI this seriously, and questions about profitability and sustainability would have been immediate problems to address rather than 'issues' to be 'mitigated'.
No horizon
Only if: had Sam Altman not been mythologized
Assessment: Can’t be checkedSaid
Gary Marcus Causal claim
“What I argued in 2001, in The Algebraic Mind, still holds: symbol manipulation, in which some knowledge is represented truly abstractly in terms of variables and operations over those variables, much as we see in algebra and traditional computer programming, must be part of the mix.”
Our reading: As Marcus argued in The Algebraic Mind in 2001, symbol manipulation, in which some knowledge is represented truly abstractly in terms of variables and operations over them as in algebra and traditional programming, must be part of the mix.
No horizon Evidence as of
Limitation: The packet cites no evidence about whether current AI systems use symbolic components, or how well systems without them perform.
Source: LLMs don’t do formal reasoning - and that is a HUGE problem
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“Everyone actively working with AI should read it”
Our reading: Everyone actively working with AI should read the new Apple researchers' article on LLMs, or at least senior author Mehrdad Farajtabar's X thread summarizing it.
No horizon
Scope: everyone actively working with AI
Source: LLMs don’t do formal reasoning - and that is a HUGE problem
Assessment: Can’t be checkedSaid
Gary Marcus Causal claim
“Neurosymbolic AI — combining such machinery with neural networks – is likely a necessary condition for going forward.”
Our reading: Neurosymbolic AI, which combines symbol manipulation with neural networks, is likely a necessary condition for going forward.
No horizon
Qualifier: likely
Source: LLMs don’t do formal reasoning - and that is a HUGE problem
Assessment: Can’t be checkedSaid
Gary Marcus Forecast
“(We are, however, unlikely ever to get systematic data on this, since the company isn’t transparent about what it has done or what the results are.)”
Our reading: The public is unlikely ever to get systematic data on robotaxi reasoning failures, because Tesla is not transparent.
No horizon
Qualifier: because Tesla is not transparent
Source: LLMs don’t do formal reasoning - and that is a HUGE problem
Assessment: Can’t be checkedSaid
Gary Marcus Forecast
“Elon Musk’s putative robotaxis are likely to suffer from a similar affliction: they may well work safely for the most common situations, but are also likely struggle to reason abstractly enough in some circumstances.”
Our reading: Tesla's planned robotaxis will likely fail to reason abstractly enough in some circumstances, although they may work safely in the most common situations.
No horizon
Qualifier: in some circumstances
Source: LLMs don’t do formal reasoning - and that is a HUGE problem
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“Hassabis’s win (shared with DeepMind researcher John Jumper), in contrast, is a slam dunk.”
Our reading: Unlike Hinton's prize, the chemistry Nobel won by Hassabis and shared with John Jumper is a slam dunk, meaning clearly deserved.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Observation
“Hinton has certainly had a profound influence on machine learning, but it’s still not entirely clear what he specifically won the prize for, or how that has advanced physics.”
Our reading: Hinton has certainly had a profound influence on machine learning, but it is still not entirely clear what he specifically won the physics Nobel Prize for, or how that work has advanced physics.
No horizon
Qualifier: not entirely clear
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“It’s time for a new approach, and Hassabis sees that.”
Our reading: The AI field should move to a new approach beyond pure end-to-end neural networks, as Hassabis recognises.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Forecast
“His open-mindedness will serve the field well.”
Our reading: Hassabis's open-mindedness will serve the AI field well.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“AlphaFold is a huge contribution to both chemistry and biology. It arguably still hasn’t lived up to the extreme hype that I have sometimes seen, but it’s a fantastic contribution, used widely by biologists, and in my mind one of the two biggest contributions of AI to date, if not the biggest.”
Our reading: AlphaFold is a huge, fantastic contribution to both chemistry and biology and is used widely by biologists. It arguably still has not lived up to the extreme hype Marcus has sometimes seen. In his mind it is one of the two biggest contributions of AI to date, if not the biggest.
No horizon
Qualifier: in my mind
Assessment: Can’t be checkedSaid
Gary Marcus Forecast
“People will probably be asking questions about this particular award for a long time.”
Our reading: People will probably keep questioning Hinton's Nobel award for a long time.
No horizon
Assessment: Can’t be checkedSaid
Gary Marcus Recommendation or value judgment
“Diverting funding from them to more focused efforts around special-purpose AI addressing climate change might make more sense.”
Our reading: It might make more sense to divert funding from chatbots and video synthesis to special-purpose AI addressing climate change.
No horizon