“Unfortunately, virtually everything that Deep Research produces will pass a LGTM test ( “it ‘looks good to me’”); people will assume it’s legit, even when it is isn’t.”
Our reading, the sentence that was checked:
Virtually all Deep Research output will superficially look good and people will assume it is legitimate even when it is not.
Assessment: Unresolved No deadline stated on 2026-10-29 Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Deep Research, Deep Bullshit, and the potential (model) collapse of science, paragraph 27.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-deep-research-deep-bullshit-and-the-245106-a1
We recorded 13 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2025-02-03. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Forecast
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No deadline stated
- Deadline state on 2026-10-29
- No deadline stated (the release’s reference date)
From the speaker
- virtually everything that Deep Research produces
- will pass a LGTM test
- people will assume it’s legit
- even when it is isn’t
Our interpretation
- The prediction concerns OpenAI Deep Research reports across ordinary uses and readers.
- “Virtually everything” means nearly all reports, not merely some persuasive examples. No arbitrary numerical cutoff is added.
- Passing the test means appearing credible on initial inspection, including inaccurate reports that readers mistakenly accept as legitimate.
Counts as supported if: Representative studies pairing initial reader judgments with independent accuracy checks establish near-universal apparent credibility, including mistaken acceptance of inaccurate reports.
Counts as contradicted if: Representative studies establish that a substantial share of ordinary reports fail initial credibility judgments, or that readers commonly distinguish inaccurate reports at first inspection.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Did the forecast come true?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No deadline stated
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
The searches did not locate evidence meeting the early-resolution rule. Selected impressive or misleading reports cannot establish a claim about virtually all output and ordinary readers. Conversely, selected skeptical readers cannot disprove it. With no deadline and no representative measurement of the predicted pattern, the forecast remains open.
Limitations
- The absence of a located study is an evidence gap, not proof that the predicted behavior does not occur.
- Borderline results would require a disclosed interpretation of “virtually everything.”
Evidence (0 items)
No evidence item settled this claim by the cutoff.
What would settle it
A representative study measuring initial credibility judgments and mistaken acceptance across independently checked OpenAI Deep Research reports, with results clearly supporting or rejecting the near-universal pattern.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Deep Research, Deep Bullshit, and the potential (model) collapse of science
Unfortunately, virtually everything that Deep Research produces will pass a LGTM test ( “it ‘looks good to me’”); people will assume it’s legit, even when it is isn’t.
- Where
- paragraph 27
- Published
- 2025-02-03
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-deep-research-deep-bullshit-and-the-245106-a1: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-deep-research-deep-bullshit-and-the-245106-a1.