“Not sure how much has changed in that regard, either, except that the hacks that were once written by graduate students are now farmed out to sweatshops, for a new form of handcrafting:”
Our reading, the sentence that was checked:
Marcus is not sure how much AI's reliance on handcrafted hacks has changed since the late 1990s, except that hacks once written by graduate students are now farmed out to sweatshops as a new form of handcrafting.
Assessment: Unresolved Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Happy Groundhog Day, The AI Edition, paragraph 11.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-happy-groundhog-day-the-ai-edition-ea217a-a2
We recorded 8 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-29. The source may have been edited after 2023-02-03. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
Conditions
- not sure how much has changed in that regard (qualifier, stated by the speaker)
From the speaker
- Not sure how much has changed
- hacks that were once written by graduate students
- now farmed out to sweatshops
- a new form of handcrafting
Our interpretation
- The uncertainty concerns how much AI has changed. The outsourcing assertion is affirmative, not a conditional forecast.
- The plain reading is that AI companies increasingly use outsourced workers under poor conditions to supply corrective human input formerly supplied by academic programmers. It does not require every contractor to work under such conditions.
- Handcrafting includes human-written training examples and corrective labels; this is an analogy, not an assertion that labeling and programming are technically identical.
- For the ongoing state described as now, use January 2023, the latest complete month before publication. Earlier employment and academic work provide historical context.
Counts as supported if: Evidence establishes contemporary outsourcing of corrective AI work under poor working conditions and documents the asserted shift from academic programming to this workforce.
Counts as contradicted if: Comparable historical and contemporary evidence shows that the asserted shift did not occur, or that the supposedly exploitative corrective outsourcing was materially misdescribed.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
Semafor's January 27, 2023 report documents outsourced programmers creating training material for OpenAI, supporting the outsourcing component [e1]. It does not establish poor working conditions for that workforce [e1]. The Guardian's August 2, 2023 report describes workers' allegations about employment in 2021–2022, which cannot establish conditions in January 2023 [e2]. Neither item establishes the asserted historical shift from graduate-student programming to outsourced corrective work [e1, e2].
Limitations
- The contemporary contractor report does not establish working conditions, while the retrospective allegations concern an earlier employment period [e1, e2].
- The evidence provides no matched historical comparison showing the extent of the asserted workforce transition [e1, e2].
Evidence (2 items)
Supports the claim: Semafor,
creating data
Why it matters here: Original reporting supports contemporary outsourcing of human-written model-training material. It establishes neither exploitative conditions for these programmers nor replacement of academic programmers.
- Publisher
- Semafor
- Kind of source
- News report
- Describes events of
- Public from
Context only: The Guardian,
damaged my mental health
Why it matters here: Retrospective allegation; employer disputed support deficiencies. Outside January 2023.
- Publisher
- The Guardian
- Kind of source
- News report
- Describes events of
- Public from
What would settle it
Historical staffing and task records, compared with January 2023 contracts, task descriptions and working-condition evidence, establishing or refuting both the asserted workforce transition and poor conditions in contemporary corrective work.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Happy Groundhog Day, The AI Edition
Not sure how much has changed in that regard, either, except that the hacks that were once written by graduate students are now farmed out to sweatshops, for a new form of handcrafting:
- Where
- paragraph 11
- Published
- 2023-02-03
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-happy-groundhog-day-the-ai-edition-ea217a-a2: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-happy-groundhog-day-the-ai-edition-ea217a-a2.