Gary Marcus Causal claim First said 2023-03-15

“and (b) it puts all of us in an extremely poor position to predict what GPT-4 consequences will be for society, if we have no idea of what is in the training set and no way of anticipating which problems it will work on and which it will not.”

GPT-4’s successes, and GPT-4’s failures, paragraph 24. The full statement is at the source.

Our reading, the sentence that was checked:

If we have no idea what is in GPT-4's training set and no way of anticipating which problems it will work on and which it will not, all of us are in an extremely poor position to predict what GPT-4's consequences will be for society.

Assessment: Can’t be checked Not checked against evidence

Where and when Gary Marcus wrote it

Marcus on AI, GPT-4’s successes, and GPT-4’s failures, paragraph 24.

Said: 2023-03-15
Source observed: 2026-10-29live page, full text, public
Evidence: Not checkedboth screens found it cannot be checked
Assessment recorded: 2026-10-29assessment marcus-gpt-4s-successes-and-gpt-4s-failures-ebe24a-a1

We recorded 13 claims from this post. See every claim from this post.

The wording above is the version this site observed on 2026-10-29. The source may have been edited after 2023-03-15. This page does not claim the wording was captured then.

What the claim commits to

Kind: Causal claim
Deadline, as the speaker wrote it: None stated. This site does not add one.
Deadline state when assessed: No horizon
Deadline state on 2026-10-29: No horizon (the release’s reference date)

Conditions

if we have no idea of what is in the training set (antecedent, stated by the speaker)
no way of anticipating which problems it will work on and which it will not (antecedent, stated by the speaker)

From the speaker

if we have no idea of what is in the training set
no way of anticipating which problems it will work on and which it will not

Our interpretation

None added.

This claim is not graded on evidence. The record checks that the words are quoted correctly and attributed to the right person, and that the claim is classified correctly.

Current assessment

Not graded on evidence

Outcome: Can’t be checked

Both AI providers screened this claim on their own and found that public evidence could not settle it. It is recorded and attributed, not scored.

Why it can’t be checked

Both screens gave the same reason:

Too vague to test: informed readers would test it in different ways and reach different answers.

Evidence: Not checked
Deadline state when assessed: No horizon
Assessment recorded: 2026-10-29
Policy version: 2026-10-28.7

Rationale

Not checked against evidence. Two independent screens, one from each provider, both found this too vague to test: informed readers would test it in different ways and reach different answers.

Limitations

None recorded.

Evidence (0 items)

No evidence was searched for. Both screens found that public evidence could not settle this claim.

This claim is about OpenAI, and models from OpenAI worked on this record: gpt-6-astra screened it. Agreement between models is a check, not proof.

This claim was not checked against evidence. claude-opus-5-5 (Anthropic) extracted it from the post and wrote the sentence at the top, our reading of the claim. claude-opus-5-5 (Anthropic) and gpt-6-astra (OpenAI) then screened it independently, without seeing each other’s answers. Both confirmed that the sentence says what the author said, and both found that public evidence could not settle the claim. No model wrote the assessment: code composed its text from the two screens, so there was no separate check of the final text. Code, not a model, decided whether it could be published.

Agreement between models is a check on the record, not proof that the assessment is right. Anthropic and OpenAI make these models, and some claims on this site are about those companies. How the method works.

Where it was said (1)

Said once in the sources this register covers.

2023-03-15: Marcus on AI, GPT-4’s successes, and GPT-4’s failures
and (b) it puts all of us in an extremely poor position to predict what GPT-4 consequences will be for society, if we have no idea of what is in the training set and no way of anticipating which problems it will work on and which it will not.
Where
paragraph 24
Published
2023-03-15
Source observed
2026-10-29, live page
Access
full text, public

History

Assessment versions

Assessment marcus-gpt-4s-successes-and-gpt-4s-failures-ebe24a-a1: Current. Outcome: Can’t be checked. Not checked against evidence. Public date not recorded.

Recorded events

2026-10-29
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-gpt-4s-successes-and-gpt-4s-failures-ebe24a-a1.