“There has been a ton of experimentation, but relatively few well-documented success stories, and some fairly negative stories like a recent one at Business Insider on GPT-powered CoPilot,”
Our reading, the sentence that was checked:
There has been much experimentation with ChatGPT-style AI but relatively few well-documented success stories.
Assessment: Unresolved Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, ChatGPT, at Age Two, paragraph 3.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-chatgpt-at-age-two-608f86-a1
We recorded 6 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2024-11-28. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
From the speaker
- a ton of experimentation
- relatively few well-documented success stories
- some fairly negative stories
Our interpretation
- The plain reading is that experimentation with ChatGPT-style generative AI was widespread, while publicly documented deployments with measurable benefits were comparatively scarce.
- The context sets a cumulative period from ChatGPT's launch through the post date.
- Well-documented success requires an identified application, an operational result, and enough detail to assess the claimed benefit. It does not necessarily require a randomized trial.
- The relevant comparison is documented successes against experimentation, not successes against an expectation of no failures.
- Individual success stories do not by themselves disprove relative scarcity.
Counts as supported if: Systematic evidence shows widespread experimentation and a comparatively small documented set or share of successful deployments by the post date.
Counts as contradicted if: A broad, transparent inventory or representative study shows documented successful deployments were common relative to experimentation by the post date.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
Deloitte documents substantial experimentation, limited conversion into production, and measurement difficulties. Klarna provides a concrete published success claim. These records are consistent with a gap between experimentation and documented benefits, but they do not measure the relative scarcity Marcus asserts. A selected success cannot disprove scarcity, and incomplete rollout cannot prove it.
Limitations
- The survey measures deployment and measurement practices, not the number of public success stories.
- The company example is self-reported and covers an initial deployment period.
- Neither isolated positive nor isolated negative stories establishes prevalence.
Evidence (2 items)
Context only: Deloitte,
tempering leadership enthusiasm
Why it matters here: The May–June survey reports that 68% of respondents' organizations had moved no more than 30% of experiments fully into production, and 41% struggled to measure their impacts. This supports an experimentation-to-deployment gap but does not count publicly documented successes.
- Publisher
- Deloitte
- Kind of source
- Independent measurement
- Describes events of
- Public from
Context only: Klarna, distributed by PR Newswire,
less than 2 mins
Why it matters here: Klarna published a specific operational improvement for its OpenAI-powered customer-service assistant. This is a company-reported success story, not independent verification or evidence that such stories were common.
- Publisher
- Klarna, distributed by PR Newswire
- Kind of source
- Company disclosure: the company describing itself, not an independent finding
- Describes events of
- Public from
What would settle it
A systematic inventory available by the post date that compares generative AI experiments with documented deployments meeting a consistent operational-success standard.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, ChatGPT, at Age Two
There has been a ton of experimentation, but relatively few well-documented success stories, and some fairly negative stories like a recent one at Business Insider on GPT-powered CoPilot,
- Where
- paragraph 3
- Published
- 2024-11-28
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-chatgpt-at-age-two-608f86-a1: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.