“Even so-called “thinking” AI models are vulnerable to this,”
Our reading, the sentence that was checked:
Even so-called 'thinking' (reasoning) AI models are vulnerable to training-data poisoning by swarms.
Assessment: Unresolved Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, AI bot swarms threaten to undermine democracy, paragraph 5.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-ai-bot-swarms-threaten-to-undermine-b204d7-a2
We recorded 10 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2026-01-23. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
From the speaker
- Even so-called 'thinking' AI models
- are vulnerable to this
- this = LLM grooming: swarms flooding the web with duplicative, crawler-targeted content to poison training data
Our interpretation
- Plain reading: as of the post, reasoning ('thinking') models had been shown to absorb or repeat narratives seeded through web-scale data poisoning or LLM grooming, or to be meaningfully vulnerable to it.
- Lab backdoor attacks on reasoning fine-tuning datasets are related but are not the same as web-scale grooming by swarms. They count as context unless they test that route.
- The claim is present tense, so the period covers the months before the post.
Counts as supported if: An audit or study tests reasoning or 'thinking' models (for example o-series, extended-thinking, or DeepSeek-R1 modes) and finds they repeat or absorb narratives seeded through LLM grooming or web-scale data poisoning.
Counts as contradicted if: Audits of reasoning models find they reliably resist narratives seeded through grooming, or studies show reasoning models are robust to this kind of poisoning.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
The claim is that reasoning ('thinking') models are vulnerable to LLM grooming. Grooming means swarms flooding the web with content meant to poison training data. The evidence contains no audit or study that tests named reasoning models against grooming or web-scale poisoning. Two lab studies are related but test a different route. A preprint from 6 September 2025 found that poisons could be injected into reasoning models through the reasoning path. Activating them to change final answers was difficult, because the models often recovered (e1). A preprint from 27 January 2026, four days after the post, reported a 70% success rate for a poisoning attack on reasoning models through fine-tuning datasets (e2). Both studies use poisoned fine-tuning data, not web-crawled content seeded by swarms. They point in different directions. So the evidence neither shows the claimed vulnerability nor shows that reasoning models resist it.
Limitations
- The evidence includes no audit that names reasoning models and measures how often they repeat narratives seeded by grooming.
- Both lab studies use poisoned fine-tuning datasets rather than web-crawled content.
- The January 2026 study was published after the post.
Evidence (2 items)
Context only: arXiv (Foerster et al., Cambridge/Google DeepMind/Oxford),
while it remains possible to inject these decomposed poisons, reliably activating them to change final answers (rather than just the CoT) is surprisingly difficult. This difficulty arises because the models can often recover from backdoors that are activated within their thought processes.
Why it matters here: Reasoning models can be poisoned in the lab, but the reasoning step often lets them recover. This is a fine-tuning backdoor setting, not web-scale grooming, so it neither settles nor clearly supports the claim.
- Publisher
- arXiv (Foerster et al., Cambridge/Google DeepMind/Oxford)
- Kind of source
- Preprint, not peer reviewed
- Describes events of
- Public from
Context only: arXiv (Chaudhari et al.),
thought-transfer achieves 70% success rates in injecting targeted behaviors into entirely different domains that are never present in training.
Why it matters here: Shows that poisoning reasoning-model training data can work. It was published four days after the post and concerns poisoned fine-tuning datasets, not swarm-seeded web content, so it is context only.
- Where
- Abstract
- Publisher
- arXiv (Chaudhari et al.)
- Kind of source
- Preprint, not peer reviewed
- Describes events of
- Public from
What would settle it
An independent audit that names reasoning models (for example o-series, extended-thinking or DeepSeek-R1 modes) and measures how often they repeat or cite narratives seeded by a grooming network, or a study that poisons reasoning-model training data through crawled web content.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, AI bot swarms threaten to undermine democracy
Even so-called “thinking” AI models are vulnerable to this,
- Where
- paragraph 5
- Published
- 2026-01-23
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-ai-bot-swarms-threaten-to-undermine-b204d7-a2: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-ai-bot-swarms-threaten-to-undermine-b204d7-a2.