“Lastly, asking for standards is not unique to AI; it's common across many industries to ask that companies evaluate the safety of their products according to set standards: just look at the pharmaceutical industry, or aviation, automobiles, etc.”
Our reading, the sentence that was checked:
Asking for standards is not unique to AI: in many industries, such as pharmaceuticals, aviation and automobiles, it is common to ask companies to evaluate the safety of their products against set standards.
Assessment: Supported Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, An open letter to Fei-Fei Li concerning California’s proposed AI regulation, SB-1047, paragraph 10.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-an-open-letter-to-fei-fei-li-concerning-cee48a-a1
We recorded 4 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2024-08-10. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
Conditions
- many industries (scope, stated by the speaker)
From the speaker
- asking for standards is not unique to AI
- common across many industries
- companies evaluate the safety of their products according to set standards
- the pharmaceutical industry, or aviation, automobiles
Our interpretation
- Read this as an observation that established safety-evaluation requirements exist across the three named industries.
- Use United States regulatory practice, consistent with the California policy discussion and the named examples.
- Safety evaluation includes testing, documented analysis and demonstrating compliance. It does not require identical approval procedures across industries.
- Because this describes an ongoing institutional practice, assess the regulatory state as of August 10, 2024. Earlier official documents establish standing requirements; their publication dates are recorded separately from the date those requirements held.
Counts as supported if: Official records establish routine product-safety evaluation against defined requirements in pharmaceuticals, aviation and automobiles by the post date.
Counts as contradicted if: Reliable regulatory records show that safety evaluation against defined requirements was generally absent in the named industries, making the asserted cross-industry practice materially inaccurate.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Supported
The dated evidence matches what the claim committed to, under the criteria frozen before grading.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
All three named industries had established safety-evaluation requirements. FDA requires drug companies to test products and submit safety-and-effectiveness evidence. FAA requires applicants to demonstrate compliance with airworthiness standards. Vehicle manufacturers certify compliance with federal safety standards using a reasonable evidentiary basis. These systems differ, but they support Marcus's limited observation that evaluating products against safety requirements is common outside AI.
Limitations
- The evidence establishes the three named U.S. examples, not a numerical survey of every industry or jurisdiction.
- Automobile certification does not require manufacturers to reproduce every government test procedure.
- The existence of these systems does not establish that SB-1047's particular requirements were effective or proportionate.
- Outcome dates represent standing regulatory practices at publication; the cited documents were issued earlier.
Evidence (3 items)
Supports the claim: U.S. Food and Drug Administration,
Drug companies seeking to sell a drug in the United States must first test it. The company then sends CDER the evidence from these tests to prove the drug is safe and effective for its intended use.
Why it matters here: FDA describes manufacturers testing drugs and submitting evidence against a defined safety-and-effectiveness requirement. The event date denotes this standing regulatory practice at the post date, not the document's publication.
- Publisher
- U.S. Food and Drug Administration
- Kind of source
- Secondary summary
- Describes events of
- Public from
Supports the claim: Federal Aviation Administration,
The certification basis identifies the specific 14 CFR parts and amendment levels with which the applicant must show compliance before the issuance of the TC. The certification basis includes the applicable airworthiness standards for the category of the TC to be issued.
Why it matters here: The FAA order requires applicants to demonstrate compliance with specified airworthiness standards before type certification. This documents the standing aviation certification framework at the post date.
- Publisher
- Federal Aviation Administration
- Kind of source
- Regulatory filing
- Describes events of
- Public from
Supports the claim: National Highway Traffic Safety Administration,
A manufacturer may base its certification on, for example, simulations or engineering analyses if it exercised reasonable care in certifying that the vehicle would meet the standard when tested by NHTSA using the standard’s test conditions and procedures.
Why it matters here: NHTSA explains how manufacturers evaluate vehicles against federal safety standards when certifying compliance. It also limits the analogy: manufacturers may use simulations or analysis instead of reproducing NHTSA's exact tests.
- Publisher
- National Highway Traffic Safety Administration
- Kind of source
- Regulatory filing
- Describes events of
- Public from
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, An open letter to Fei-Fei Li concerning California’s proposed AI regulation, SB-1047
Lastly, asking for standards is not unique to AI; it's common across many industries to ask that companies evaluate the safety of their products according to set standards: just look at the pharmaceutical industry, or aviation, automobiles, etc.
- Where
- paragraph 10
- Published
- 2024-08-10
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-an-open-letter-to-fei-fei-li-concerning-cee48a-a1: Current. Outcome: Supported. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-an-open-letter-to-fei-fei-li-concerning-cee48a-a1.