“I am here to tell you that OpenAI’s research, analyzed carefully, shows no such thing, and that there is plenty of reason to be concerned.”
Our reading, the sentence that was checked:
OpenAI's bioweapons research, analyzed carefully, does not show that GPT-4 poses at most a slight risk of helping create biological threats, and there is plenty of reason to be concerned.
Assessment: Supported Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Diving deep into OpenAI’s new study on LLM’s and bioweapons, paragraph 4.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-when-looked-at-carefully-openais-02bc2d-a1
We recorded 22 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-29. The source may have been edited after 2024-02-04. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
Conditions
- when the research is analyzed carefully (qualifier, stated by the speaker)
From the speaker
- OpenAI’s research, analyzed carefully, shows no such thing
- plenty of reason to be concerned
Our interpretation
- The surrounding passage disputes whether this study establishes that biological-threat assistance risk is at most slight.
- Concern is read as justified uncertainty requiring further investigation, not proof of a large real-world danger.
- The target is the study as publicly reported before the post, not subsequent models or biological-risk research.
Counts as supported if: The study leaves meaningful assistance risk unbounded because of its design, uncertainty, or limited statistical power.
Counts as contradicted if: The study establishes a defensible upper bound of slight assistance risk across the scope Marcus discusses.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Supported
The dated evidence matches what the claim committed to, under the criteria frozen before grading.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
The study does not establish an upper bound of slight real-world risk. Its acknowledged lack of statistical power supports Marcus's objection to treating it as conclusive reassurance. This supports continued concern and investigation, not a finding that GPT-4 presents a large danger.
Limitations
- OpenAI itself acknowledged uncertainty; Marcus's criticism should not imply that the study concealed all these limitations.
- The emotional degree of concern is not independently measurable.
Evidence (1 item)
Supports the claim: OpenAI,
This constrained the statistical power of the study, allowing only very large effect sizes to be detected.
Why it matters here: Limited sensitivity prevents treating nonsignificance as a tight risk bound. The study also distinguishes information access from physical implementation and leaves the translation from scores to risk unsettled.
- Publisher
- OpenAI
- Kind of source
- Company disclosure: the company describing itself, not an independent finding
- Describes events of
- Public from
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Diving deep into OpenAI’s new study on LLM’s and bioweapons
I am here to tell you that OpenAI’s research, analyzed carefully, shows no such thing, and that there is plenty of reason to be concerned.
- Where
- paragraph 4
- Published
- 2024-02-04
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-when-looked-at-carefully-openais-02bc2d-a1: Current. Outcome: Supported. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-when-looked-at-carefully-openais-02bc2d-a1.