Florida sues OpenAI and Sam Altman over alleged safety lapses
The lawsuit, filed in Florida state court on Monday, accuses OpenAI and its CEO, Sam Altman, of failing to warn users that ChatGPT could be dangerous and instead marketing it as safe and reliable, including for children.
Justin Sullivan/Getty Images
hide caption
toggle caption
Justin Sullivan/Getty Images
Florida is accusing OpenAI and its CEO Sam Altman of putting profit over safety, in the first lawsuit brought by a state against the ChatGPT maker over the alleged shortcomings of the chatbot.
The lawsuit, filed in Florida state court on Monday, claims the company and Altman failed to warn users that ChatGPT could be dangerous and instead marketed it as safe and reliable, including for children. It’s the latest salvo in a growing effort across the country to hold artificial intelligence companies accountable when harms follow users’ interactions with chatbots.
The lawsuit accuses OpenAI of aiding and abetting mass shooters, including a shooter at Florida State University who allegedly used ChatGPT to plan his attack, encouraging vulnerable people to commit suicide, and addicting children “to a tool that feigns human compassion to collect their data with no parental oversight.”
“This litany of harms is driven by Defendants’ insatiable quest to win the AI arms race and amass large fortunes, despite knowing the danger of ChatGPT,” the complaint said. “The rise of OpenAI is attributable to a web of deceit and the exploitation of users (including Floridians), leveraging their data and safety to boost OpenAI’s market value at unacceptable costs.”
Florida is also seeking to hold Altman personally liable.
“Sam Altman and ChatGPT have chosen the AI race over the safety and security of our kids,” Florida Attorney General James Uthmeier said at a press conference on Monday. He added he believes that Altman and the company could be liable “for potentially up to billions of dollars” in penalties.
“Losing a child is the most devastating tragedy that can happen to a family and we know that no words can come close to addressing the pain of such a loss,” OpenAI spokesperson Kayla Wood said in an emailed statement to NPR.
“AI is a new and powerful technology, and we believe minors need significant protection, which is why we have put in place industry leading protections and policies,” the statement continued. “In particular we built safety for minors directly into our products, including a more protective experience specifically for minors, an age prediction tool, defaulting users whose age we are not confident into our more protective experience, and giving parents tools to monitor their kids’ use of AI.”
The lawsuit alleges OpenAI’s safeguards, including its parental controls, are inadequate and that the company has created “a dangerous public nuisance.”
The first page of the lawsuit begins with a screenshot from OpenAI’s website saying ChatGPT was “built with safety in mind.” The image is followed by a footnote reading: “Not so.”
Uthmeier’s office is separately conducting a criminal investigation into OpenAI over the FSU shooter’s alleged consultation of ChatGPT ahead of the April 2025 attack.
More than 20 lawsuits have been filed against OpenAI over harms allegedly stemming from ChatGPT use, including by families of victims killed and injured in a mass shooting at a school in Tumbler Ridge, Canada, in February, the family of a victim killed in the FSU shooting, and the families of seven people, including one teenager, who died by suicide or suffered delusions after using the chatbot.
Altman apologized to the Tumbler Ridge community in April, and OpenAI said in response to those lawsuits that it has a “zero tolerance” policy for using its tools to assist in committing violence.
After Uthmeier announced his investigation into the FSU shooting, an OpenAI spokesperson said that the chatbot “provided factual responses to questions with information that could be found broadly across public sources on the internet, and it did not encourage or promote illegal or harmful activity.” The statement continued: “We work continuously to strengthen our safeguards to detect harmful intent, limit misuse, and respond appropriately when safety risks arise.”
OpenAI has called the lawsuits over suicides and delusions “an incredibly heartbreaking situation” and said that it’s working with mental health experts to improve how ChatGPT responds to signs of mental or emotional distress.
Other AI companies are also under legal scrutiny over how their chatbots have allegedly caused harm.
In response to a wrongful death lawsuit over the suicide of a Florida man who became attached to Google’s Gemini chatbot, the company said: “Gemini is designed to not encourage real-world violence or suggest self-harm. Our models generally perform well in these types of challenging conversations and we devote significant resources to this, but unfortunately they’re not perfect.” It added that Gemini had “referred the individual to a crisis hotline many times.”
In January, Character.AI settled multiple lawsuits brought by families who claimed its companion chatbots contributed to suicides and mental health crises among children and teenagers. The company said it “has taken innovative and decisive steps with regard to AI safety and teens, and will continue to champion these efforts and push others across the industry to adopt similar safety standards.” That includes barring users under 18 from interacting with or creating chatbots.
Last month, the state of Pennsylvania sued Character.AI, alleging its chatbots posed as doctors and offered medical advice, in violation of state medical licensing rules. A Character.AI spokesperson told NPR at the time the company doesn’t comment on pending litigation, but that its “highest priority is the safety and well-being of our users.”
The detail about florida Attorney General James Uthmeier said at a press conference on Monday is something people should sit with.
So the bottom line is florida Attorney General James Uthmeier said at a press conference on Monday. Wonder how this will land.
So the bottom line is the lawsuit alleges OpenAI’s safeguards, including its parental controls, are inadequate and that the company has created “a dangerous public. Wonder how this will land.
What stands out is florida is accusing OpenAI and its CEO Sam Altman of putting profit over safety, in the first lawsuit brought by a state against the ChatGPT maker over the alleged shortcomings of the chatbot. That is the part worth paying attention to.
So the bottom line is uthmeier’s office is separately conducting a criminal investigation into OpenAI over the FSU shooter’s alleged consultation of ChatGPT ahead of the April 2025 attack. Wonder how this will land.
Considering florida Attorney General James Uthmeier said at a press conference on Monday, it raises some real questions about what happens next.
The detail about florida is accusing OpenAI and its CEO Sam Altman of putting profit over safety, in the first lawsuit brought by a state against the ChatGPT maker over the alleged shortcomings of the chatbot is something people should sit with.
On one hand uthmeier’s office is separately conducting a criminal investigation into OpenAI over the FSU shooter’s alleged consultation of ChatGPT ahead of the April 2025 attack. But at the same time florida is accusing OpenAI and its CEO Sam Altman of putting profit over safety, in the first lawsuit brought by a state against the ChatGPT maker over the alleged shortcomings of the chatbot.
Think about it: the lawsuit alleges OpenAI’s safeguards, including its parental controls, are inadequate and that the company has created “a dangerous public. That speaks volumes.
When you look at the lawsuit accuses OpenAI of aiding and abetting mass shooters, including a shooter at Florida State University who allegedly used ChatGPT to plan, the implications are hard to ignore.
The bigger issue here is florida is accusing OpenAI and its CEO Sam Altman of putting profit over safety, in the first lawsuit brought by a state against the ChatGPT maker over the alleged shortcomings of the chatbot. That changes the calculation.
The detail about the lawsuit accuses OpenAI of aiding and abetting mass shooters, including a shooter at Florida State University who allegedly used ChatGPT to plan is something people should sit with.
On one hand florida Attorney General James Uthmeier said at a press conference on Monday. But at the same time the lawsuit alleges OpenAI’s safeguards, including its parental controls, are inadequate and that the company has created “a dangerous public.
In other words florida is accusing OpenAI and its CEO Sam Altman of putting profit over safety, in the first lawsuit brought by a state against the ChatGPT maker over the alleged shortcomings of the chatbot. Curious to see how this develops.
So the bottom line is florida is accusing OpenAI and its CEO Sam Altman of putting profit over safety, in the first lawsuit brought by a state against the ChatGPT maker over the alleged shortcomings of the chatbot. Wonder how this will land.