The hottest new programming language is English! Or maybe not.
We recorded 4 claims from this post. 3 were checked against evidence. 1 can’t be checked. 2 more are held. Read the post at its source.
Claims from this post (4)
In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.
Assessment: SupportedSaid
Observation
“But the truth is it doesn’t work that well yet.”
Our reading: Programming in English with LLMs does not yet work very well.
No horizon Evidence as of
Limitation: The competitive-programming evaluation does not establish a representative success rate for everyday programming or direct control through English prompts [e1].
Assessment: UnresolvedSaid
Observation
“If the system really is being “programmed in English” it is not always doing what is being asked to do:”
Our reading: If ChatGPT/GPT-4 really is being "programmed in English" through its allegedly leaked system prompt, it is not always doing what it is asked to do.
No horizon Evidence as of
Limitation: An absent authentication record does not show that the alleged prompt was fabricated.
Assessment: UnresolvedSaid
Observation
“Much of what Reid Southen, Katie Conrad, and I recently described is in flagrant violation of those directives.”
Our reading: Much of what Marcus, Reid Southen and Katie Conrad recently described is in flagrant violation of the directives in ChatGPT's allegedly leaked system prompt.
No horizon Evidence as of
Limitation: This assessment concerns compliance with instructions, not whether an image legally infringes copyright.
Assessment: Can’t be checkedSaid
Recommendation or value judgment
“In the new regime, caveat emptor.”
Our reading: People programming via LLMs in English should beware of the risks.
No horizon
Held from this post (2)
These records did not pass every check, so nothing about them is published. Held is not a finding.