Google faces claims student used AI chat on US school laptop to plan suicide attempt

Read a summary of this article on FAST.
Get bite-sized news via a new
cards interface. Give it a try.
Click here to return to FAST Tap here to return to FAST
FAST

Nov 5 : The parents of a girl in the US who used Google’s Gemini AI chatbot on her school-provided Chromebook to make a plan to die by suicide have sued the company, claiming it pushed its AI products on students and failed to warn of their dangers. 

• The girl, identified as “Emma,” began using Gemini on her Chromebook when she was 13

• Emma discussed different methods of suicide with Gemini and planned a funeral for herself while the bot helped her conceal her feelings from her family, the lawsuit claims

• Parents say they were alerted after school software flagged a document Emma wrote about her funeral plans, according to the lawsuit

CNA Games

Guess Word
Crack the word, one row at a time

Buzzword
Create words using the given letters

Mini Sudoku
Tiny puzzle, mighty brain teaser

Mini Crossword
Small grid, big challenge

Word Search
Spot as many words as you can
Show More
Show Less

• In a race to expand the audience for Gemini, Google wove the AI into all of its products without warning parents or schools, the lawsuit says

• Google knew Gemini 3 Flash, the version Emma used, was unsafe and mishandled mental health issues from users, the lawsuit says

• José Castañeda, a spokesperson for Google, said the company is reviewing the claims

• "We’ve worked extensively with medical professionals and academic experts to build features that help young people find critical support and trusted resources when they need it," Castañeda said

• The lawsuit, which seeks monetary damages, was filed Monday in California state court. Google moved it to federal court on Wednesday

• Google said this week it will turn off Gemini by default for school student accounts, but schools that want students to retain access to Google Search will still have to accept AI features such as AI-generated summaries

Newsletter

Week in Review

Subscribe to our Chief Editor’s Week in Review

Our chief editor shares analysis and picks of the week's biggest news every Saturday.

Sign up for our newsletters

Get our pick of top stories and thought-provoking articles in your inbox

Subscribe here

Get the CNA app

Stay updated with notifications for breaking news and our best stories

Download here

Get WhatsApp alerts

Join our channel for the top reads for the day on your preferred chat app

Join here