California demands Elon Musk's xAI stop producing sexual deepfake content
· CNA · JoinRead a summary of this article on FAST.
Get bite-sized news via a new
cards interface. Give it a try.
Click here to return to FAST Tap here to return to FAST
FAST
Jan 16 : California Attorney General Robert Bonta on Friday sent a cease-and-desist letter to xAI demanding the company stop the creation and distribution of artificial intelligence-generated nonconsensual sexualized imagery by its Grok chatbot.
"The avalanche of reports detailing this material — at times depicting women and children engaged in sexual activity — is shocking and, as my office has determined, potentially illegal,” said Bonta.
xAI, which is owned by billionaire Republican megadonor Elon Musk, has come under global scrutiny over the past couple of weeks after Grok began flooding the social media site X with nonconsensual images of women and some minors in revealing clothes and degrading poses.
Although xAI has since rolled back Grok's public posting of hyper-realistic sexualized imagery, sometimes called deepfakes, the chatbot privately generates such imagery on demand as of midday Friday U.S. Eastern Time, according to Reuters tests.
Subscribe to our Chief Editor’s Week in Review
Our chief editor shares analysis and picks of the week's biggest news every Saturday.
This service is not intended for persons residing in the E.U. By clicking subscribe, I agree to receive news updates and promotional material from Mediacorp and Mediacorp’s partners.
Loading
X and xAI did not immediately address questions about the cease-and-desist letter.
California's move adds to the global pressure on Musk's social media-and-AI empire, which is already under scrutiny in Britain, the European Union, and other jurisdictions, including India, Indonesia, Malaysia and the Philippines. Earlier Friday, Japanese authorities said they too were probing X over Grok, saying all options were under consideration to prevent the generation of inappropriate images.
Economic Security Minister Kimi Onoda said officials had requested that X implement immediate improvements but they have yet to receive a response from the company.
Newsletter
Week in Review
Subscribe to our Chief Editor’s Week in Review
Our chief editor shares analysis and picks of the week's biggest news every Saturday.
Sign up for our newsletters
Get our pick of top stories and thought-provoking articles in your inbox
Get the CNA app
Stay updated with notifications for breaking news and our best stories
Get WhatsApp alerts
Join our channel for the top reads for the day on your preferred chat app