Claude private chat triggers manual review, Florida woman arrested after writing shooting threat.

动察 Beating AI News Flash: A woman in Florida, USA, was flagged by Anthropic's safety system after writing a shooting threat in a private Claude chat. The conversation then went to human review, and the review team handed the content to police. The woman has been arrested and currently faces felony charges. Local police said she later explained that she used the AI as a "diary."

The police arrest report shows that she first wrote about attacking the Lee County Sheriff's Office, and the next day said she had just obtained a new gun. This was not Claude deciding on its own to call the police. The system first identifies potential threats, then passes serious content to Anthropic's human team, which decides whether to contact law enforcement.

Anthropic's consumer terms already state that the company may, at its own discretion, report users' inputs, outputs, or actions to law enforcement. The official privacy policy also allows the company to share personal data with police when it believes it is necessary to prevent serious harm to people or property. Even if users turn off model training, conversations flagged for safety issues may still enter safety review.

The case itself also has legal controversy. Florida law requires that such written or electronic threats be sent or transmitted in a way that can be viewed by others. Local lawyers believe that applying this law to private chats written to an AI is not simple. At present, the woman has only been accused and has not yet been convicted.

This is not an isolated case either. According to Tom's Hardware, since August, at least 3 instances of Anthropic chat content have come to police attention. Previously, a Claude user threatened Anthropic CEO Dario Amodei in a conversation, and Anthropic then proactively contacted the San Francisco police.