Tech

Become a free MediaPost member now to read this article

Become a free MediaPost member now to read this article

Subscribe today to gain access to every Research Intelligencer article we publish as well as the exclusive daily newsletter, full access to The MediaPost Cases, first-look research and daily insights from Joe Mandese, Editor in Chief.

If you're already a paid subscriber, please sign-in.

Password  
  Forgot?

Password  
  Forgot?

Attorneys general in 41
states and the District of Columbia say chatbots have caused "serious harm" to some users, and are demanding that tech companies implement precautions.

The law enforcement
officials say they are concerned by chatbots' "sycophantic" and "delusional" outputs, as well as "increasingly disturbing reports" of interactions with children.

"Together,
these threats demand immediate action," they say in a letter sent to 13 tech companies including OpenAI,
Anthropic, Perplexity, Character.AI, Apple, Google and Meta.

The attorneys general say that outputs from chatbots have been implicated in "many tragedies and real-world harms,"
including a murder-suicide in Connecticut, two suicides by teens, and at least three other deaths.

"Because many of the conversations your chatbots are engaging in may violate
our law, additional safeguards are necessary," the attorneys general write.

Among other specific demands, the attorneys general want tech companies to post "clear and
conspicuous" warnings about "unintended and potentially harmful outputs," and "promptly, clearly, and directly notify users if they were exposed to potentially harmful sycophantic or delusional
outputs."