“In 2029, AI will not be able to read a novel and reliably answer questions about plot, character, conflicts, motivations, etc.”
Our reading, the sentence that was checked:
In 2029, AI will not be able to read a novel and reliably answer questions about plot, character, conflicts, motivations, etc., where the key is going beyond the literal text.
Assessment: Unresolved Not yet due on 2026-10-29 Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Dear Elon Musk, here are five things you might want to consider about AGI, prediction 2 of 5.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-dear-elon-musk-here-are-five-things-31b9db-a2
We recorded 21 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2022-05-31. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Forecast
- Deadline, as the speaker wrote it
- “In 2029”
- Deadline state when assessed
- Not yet due
- Deadline state on 2026-10-29
- Not yet due (the release’s reference date)
Conditions
- key will be going beyond the literal text (qualifier, stated by the speaker)
From the speaker
- In 2029
- read a novel
- reliably answer questions about plot, character, conflicts, motivations, etc.
- going beyond the literal text
Our interpretation
- The ordinary reading is dependable comprehension of whole novels, including reasonable inferences about motives, relationships and conflicts.
- Going beyond the literal text defines the task. It is not an external antecedent whose occurrence must be established separately.
- Test varied novels and questions with controls for memorized summaries. Reliability does not require agreement on every debatable literary interpretation.
- Use 2029-12-31 as the latest deadline, allowing an earlier reproducible demonstration of the complete capability to refute the forecast.
- Assess this individual forecast independently of the surrounding multi-challenge wager.
Counts as supported if: Evidence covering the end of 2029 shows that leading available systems still fail to answer questions dependably about whole novels, including questions requiring inference about plot, characters, conflicts and motivations.
Counts as contradicted if: At least one AI system reliably answers questions across varied whole novels, including nonliteral questions, under a credible evaluation with human-validated answers.
Prospective: these criteria were frozen before the deadline, while the outcome was not yet public.
Current assessment
Did the forecast come true?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- Not yet due
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
The August 2025 PRELUDE study reports that tested systems lagged behind humans when judging whether character backstories fit a novel [e1]. The September 2026 detective-novel study tests one local 9B model on multiple-choice questions and reports limited accuracy [e2]. Neither establishes the complete, independently assessed and reproducible whole-novel capability required for early contradiction, and these earlier results cannot establish failure in 2029 [e1; e2].
Limitations
- The studies do not establish current frontier performance across the complete task or what systems will achieve in 2029.
- The packet contains no verified Fiction.LiveBench results; their relevance to early resolution remains unassessed.
- The claim supplies no numerical reliability threshold, and literary questions can admit multiple defensible answers.
Evidence (2 items)
Context only: arXiv; Mo Yu and collaborators,
room for improvement
Why it matters here: PRELUDE tests whether proposed character backstories fit a novel, requiring indirect evidence and inference. Its reported human-model gaps concern a demanding related task and do not settle the broader 2029 forecast.
- Publisher
- arXiv; Mo Yu and collaborators
- Kind of source
- Preprint, not peer reviewed
- Describes events of
- Public from
Context only: arXiv; Wenji Fu,
the graph route reaches 42.86%.
Why it matters here: This study evaluates a fixed local model on detective-novel questions and reports limited performance. It neither establishes general reliable comprehension nor measures the strongest available systems.
- Publisher
- arXiv; Wenji Fu
- Kind of source
- Preprint, not peer reviewed
- Describes events of
- Public from
What would settle it
A dated, independently assessed and reproducible evaluation demonstrating reliable answers across varied whole novels, including nonliteral questions, would contradict the forecast early. It must supply the novels, disclose outputs and grading, use human-validated answers, accept text-supported alternative interpretations, and control for prior familiarity and answer leakage. Otherwise, evidence covering leading systems through December 31, 2029 would be needed to assess whether dependable comprehension remains beyond them.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Dear Elon Musk, here are five things you might want to consider about AGI
In 2029, AI will not be able to read a novel and reliably answer questions about plot, character, conflicts, motivations, etc.
- Where
- prediction 2 of 5
- Published
- 2022-05-31
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-dear-elon-musk-here-are-five-things-31b9db-a2: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-dear-elon-musk-here-are-five-things-31b9db-a2.