Bad Actors are Grooming LLMs to Produce Falsehoods
We recorded 4 claims from this post. 4 can’t be checked. 4 more are held. Read the post at its source.
Claims from this post (4)
In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.
Assessment: Can’t be checkedSaid
Causal claim
“GenAI powered chatbots’ lack of reasoning can directly contribute to the nefarious effects of LLM grooming: the mass-production and duplication of false narratives online with the intent of manipulating LLM outputs.”
Our reading: Generative AI chatbots' lack of reasoning can directly contribute to the harmful effects of LLM grooming by disinformation actors.
No horizon
Assessment: Can’t be checkedSaid
Conditional forecast
“If the data that a model has been trained on or can access via real-time search has been tainted, then the model may well just regurgitate that tainted information.”
Our reading: If an LLM's training data or search-accessible data is tainted, the model may well regurgitate the tainted information.
No horizon
Only if: if training or search data has been tainted
Assessment: Can’t be checkedSaid
Recommendation or value judgment
“To the extent that such systems are now supplying news to a large number of people, this is a serious failure, with potentially serious consequences.”
Our reading: To the extent that such systems now supply news to a large number of people, o3's failure to note that the Pravda network is a known disinformation network is a serious failure with potentially serious consequences.
No horizon
Qualifier: to the extent that such systems are now supplying news to a large number of people
Assessment: Can’t be checkedSaid
Rhetoric
“In the meantime, systems of naive mimicry and regurgitation, such as the AIs we have now, are soiling their own futures (and training databases) every time they unthinkingly repeat propaganda.”
Our reading: Current AIs, being naive mimicry systems, degrade their own futures and training data whenever they repeat propaganda.
No horizon
Held from this post (4)
These records did not pass every check, so nothing about them is published. Held is not a finding.