“Meanwhile, within a few hours, a 17-year-old high-school student had largely1 replicated what I was saying, and did so with a simpler, more elegant jailbreak prompt, zero prior context required2:”
Our reading, the sentence that was checked:
Within a few hours, a 17-year-old high-school student had largely replicated what Marcus was saying about Bing being usable for misinformation, using a simpler, more elegant jailbreak prompt than his and needing zero prior context.
Assessment: Unresolved Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Don’t Look Up: The AI Edition, paragraph 45.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-dont-look-up-the-ai-edition-e2cc70-a1
We recorded 4 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-29. The source may have been edited after 2023-03-02. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
Conditions
- largely replicated (the output was more carefully hedged and less potent than the original) (qualifier, stated by the speaker)
- within a few hours (scope, stated by the speaker)
From the speaker
- within a few hours
- a 17-year-old high-school student
- largely replicated
- a simpler, more elegant jailbreak prompt
- zero prior context required
- carefully hedged
- not quite as potent as my original example
Our interpretation
- The student is Soumil Rathi, whose March 1 tweet is embedded immediately after the claim.
- Assess the alleged replication between the original late-February demonstration and the March 1 tweet.
- Largely replicated means producing false factual material that could be republished after modest editing, allowing the qualifications Marcus expressly acknowledges.
- Simpler means less prompting and conversational setup; elegant is a subjective description and receives no separate score.
- Zero prior context means a fresh conversation with no preceding user turns.
- Within a few hours requires timestamps consistent with an interval of hours; no arbitrary numerical cutoff is imposed.
Counts as supported if: Independent records establish Rathi's age and school status, the relevant timing, and a complete fresh Bing conversation producing the described output with less setup than Marcus's example.
Counts as contradicted if: Authenticated records establish materially different age or status, timing incompatible with a few hours, undisclosed prior context, or an output that does not substantially reproduce the claimed capability.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
Rathi's March 1 tweet is available, but its extracted text contains only his assertion about creating misinformation. It does not verify the conversation, prompt comparison, or absence of prior context. The later biography does not settle his March age and school status, and the starting timestamp needed to verify a few hours remains unclear. None of these gaps establishes that Marcus's account was false.
Limitations
- The original screenshot may contain evidence absent from the text extraction.
- A public screenshot alone may still omit earlier conversation turns.
- Elegant is subjective and is not separately adjudicated.
Evidence (2 items)
Context only: Soumil Rathi,
It's THIS easy
Why it matters here: The original tweet establishes that Rathi publicly made the relevant assertion on March 1. Its readable text does not establish the prompt, output, conversation history, or elapsed time from Marcus's demonstration.
- Publisher
- Soumil Rathi
- Kind of source
- Demonstration
- Describes events of
- Public from
Context only: SkillPool via IssueWire,
He is currently
Why it matters here: The release gives Rathi's age and educational status seven months later. It neither verifies nor contradicts the specific March description.
- Where
- About the Team
- Publisher
- SkillPool via IssueWire
- Kind of source
- Company disclosure: the company describing itself, not an independent finding
- Describes events of
- Public from
What would settle it
Authenticated complete conversations and timestamps for both demonstrations, plus contemporaneous evidence of Rathi's age and school status.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Don’t Look Up: The AI Edition
Meanwhile, within a few hours, a 17-year-old high-school student had largely1 replicated what I was saying, and did so with a simpler, more elegant jailbreak prompt, zero prior context required2:
- Where
- paragraph 45
- Published
- 2023-03-02
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-dont-look-up-the-ai-edition-e2cc70-a1: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-dont-look-up-the-ai-edition-e2cc70-a1.