OpenAI to limit weapons information for teens on ChatGPT in violence-prevention push

Read a summary of this article on FAST.
Get bite-sized news via a new
cards interface. Give it a try.
Click here to return to FAST Tap here to return to FAST
FAST

Oct 30 : OpenAI said on Friday it is tightening limits on the weapons-related information ChatGPT provides to teens, even when a question appears harmless, as part of new safeguards aimed at preventing real-world violence.

The move comes as AI companies face growing scrutiny over the risks chatbots pose to young users and the companies' role in detecting threats of harm.

Here are more details:

• OpenAI will restrict practical information on weapons and security systems that could be misused, with the limits applying to teens even when there is no sign of violent intent

CNA Games

Guess Word
Crack the word, one row at a time

Buzzword
Create words using the given letters

Mini Sudoku
Tiny puzzle, mighty brain teaser

Mini Crossword
Small grid, big challenge

Word Search
Spot as many words as you can
Show More
Show Less

• For all users, ChatGPT will be able to automatically end chats where someone appears to be fixating on violence, and OpenAI may temporarily pause accounts after multiple such chats

• The company also said it strengthened its age prediction system to move users it estimates are under 18 into the teen experience, and it plans to notify parents if their teen's account is paused for repeatedly discussing violence

• For all users, OpenAI is limiting detail on past mass attacks, including the weapons used and how they were obtained

• The company said the new safeguards will begin rolling out in the next few weeks, and it will continue to refine them

• OpenAI said earlier this month that teens spend under 15 minutes a day on average on ChatGPT, in its first report on teen use

• A report by non-profit Common Sense Media earlier this month found that ChatGPT's teen version often alerted parents late or not at all when teen accounts held conversations about suicide, self-harm or eating disorders

Newsletter

Week in Review

Subscribe to our Chief Editor’s Week in Review

Our chief editor shares analysis and picks of the week's biggest news every Saturday.

Sign up for our newsletters

Get our pick of top stories and thought-provoking articles in your inbox

Subscribe here

Get the CNA app

Stay updated with notifications for breaking news and our best stories

Download here

Get WhatsApp alerts

Join our channel for the top reads for the day on your preferred chat app

Join here