Happy 1st Birthday, GPT-4
We recorded 4 claims from this post. 2 were checked against evidence. 2 can’t be checked. 2 more are held. Read the post at its source.
Claims from this post (4)
In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.
Assessment: Can’t be checkedSaid
Observation
“We might be reaching a plateau in terms of sheer capability.”
Our reading: LLM capability may be reaching a plateau around GPT-4 level.
No horizon
Assessment: SupportedSaid
Observation
“Some core problems have lingered, particularly hallucinations, instability and occasional nonsensical errors.”
Our reading: Hallucinations, instability and occasional nonsensical errors remain unsolved in GPT-4 class LLMs.
No horizon Evidence as of
Limitation: The research tests selected tasks rather than representative everyday usage.
Assessment: SupportedSaid
Forecast
“We can expect price wars.”
Our reading: There will be price wars among LLM providers.
Settled before its deadline Evidence as of
Limitation: The decisive episode occurred in China; the claim supplied no geographic restriction.
Assessment: Can’t be checkedSaid
Recommendation or value judgment
“Climate impact needs to be considered, especially as models continue to grow.”
Our reading: The climate impact of AI models should be considered, especially as they grow.
No horizon
Qualifier: especially as models continue to grow
Held from this post (2)
These records did not pass every check, so nothing about them is published. Held is not a finding.
- The record does not meet the current rules. Our reading, not assessed: Bad actors appear to be using LLMs for cybercrime and disinformation.
- The two reviews read the claim differently