FILE PHOTO: An OpenAI logo is displayed at Moscone Center during the Dreamforce 2026 technology summit in San Francisco, California, US, September 17, 2026. REUTERS/Carlos Barria/File Photo

California sues OpenAI over AI models’ cyberattacks on Hugging Face, other companies

· CNA · Join

Read a summary of this article on FAST.
Get bite-sized news via a new
cards interface. Give it a try.
Click here to return to FAST Tap here to return to FAST
FAST

Nov 16 : California Attorney General Rob Bonta sued OpenAI on Monday, accusing the company of developing a dangerous product without adequate safety procedures or oversight after reports that its AI models had independently carried out cyberattacks.

The lawsuit is the first filed by a state over the cyberattacks, which have drawn widespread attention since the revelation in July that an autonomous agents ​powered by OpenAI’s advanced artificial intelligence models went rogue during a security test and hacked ‌AI startup Hugging Face. Filed in state court in San Francisco, the lawsuit accuses the company of violating California consumer protection law and creating a public nuisance by risking public safety.

A representative for OpenAI did not immediately respond to a request for comment.

The lawsuit seeks a court order directing the company to stop violating the law, ensure its testing and development of its models are done safely and pay for its violations, Bonta, a Democrat, said at a press conference announcing the lawsuit.

CNA Games

Guess Word
Crack the word, one row at a time

Buzzword
Create words using the given letters

Mini Sudoku
Tiny puzzle, mighty brain teaser

Mini Crossword
Small grid, big challenge

Word Search
Spot as many words as you can
Show More
Show Less

“The Hugging Face attack was the predictable result of an internal culture at OpenAI that prioritizes growth and rapid model development over safety and accountability — and this was only one of 80 known incidents,” Bonta said in a statement.

The lawsuit accuses the company of misleading consumers about its efforts to test its models safely, in violation of the state's consumer protection laws, and of impeding Californians' use of property by disrupting local organizations and services. 

After the Hugging Face incident, OpenAI said in a blog post that the breakout was "an unprecedented cyber incident, involving state-of-the-art cyber capabilities."

OpenAI acknowledged a general need for more transparency around rogue AI behavior and said it was reinforcing its safeguards. On September 16, the company published a new framework for disclosing such incidents, saying it would err on the ​side of transparency “even when significance is uncertain.”

MOUNTING PRESSURE FOR AI REGULATION

OpenAI and other AI firms have disclosed a series of other AI agent breakouts, ​often weeks or months after they occurred, and in some cases only after independent researchers discovered them. The Trump administration and US legislators ​face mounting pressure to address the risk, particularly to the energy and banking sectors and emergency services.

US legislators are debating AI regulation, with some proposing a bill that would require developers of the most powerful ⁠AI models to ​submit them for independent security audits. 

Multiple attorneys general have said they are investigating breaches tied to OpenAI's models.

OpenAI is already facing several other states' lawsuits over the safety of its models for users. Last month, a bipartisan group of eight states ​sued OpenAI in courts across the country alleging ChatGPT coached users, including teenagers, to harm themselves or others.

The company is also the subject of lawsuits filed by people who say they were harmed as a result of the chatbot’s actions, including more than 30 filed over a mass shooting that took place in Tumbler Ridge, British Columbia, in February. An OpenAI spokesperson called the shooting a tragedy and said the company has strengthened ChatGPT safeguards.

Source: Reuters

Newsletter

Week in Review

Subscribe to our Chief Editor’s Week in Review

Our chief editor shares analysis and picks of the week's biggest news every Saturday.

Sign up for our newsletters

Get our pick of top stories and thought-provoking articles in your inbox

Subscribe here

Get the CNA app

Stay updated with notifications for breaking news and our best stories

Download here

Get WhatsApp alerts

Join our channel for the top reads for the day on your preferred chat app

Join here