Anthropic says AI systems moving towards building themselves

Read a summary of this article on FAST.
Get bite-sized news via a new
cards interface. Give it a try.
Click here to return to FAST Tap here to return to FAST
FAST

SAN FRANCISCO: Artificial intelligence giant Anthropic said on Thursday (Sep 18) that AI systems are increasingly capable of building future versions of themselves, adding to mounting concerns about the dangers of the powerful technology.

The debate over the risks of AI has intensified in recent months, fueled by several incidents and apocalyptic warnings from industry professionals.

Anthropic said its Claude chatbot now leads more than a quarter of its research and development work, and collaborates with human staff on more than 90 per cent of tasks.

The company said it was publishing the information to give the public, third parties and governments "better visibility into the pace of AI development" as the world "considers slowing" its pace.

CNA Games

Guess Word
Crack the word, one row at a time

Buzzword
Create words using the given letters

Mini Sudoku
Tiny puzzle, mighty brain teaser

Mini Crossword
Small grid, big challenge

Word Search
Spot as many words as you can
Show More
Show Less

Anthropic CEO Dario Amodei called this month for AI development to slow down, with rapid advances in the technology fueling concerns over job losses and the soaring energy demand and environmental impact of data centres.

Fears that designers of AI agents could lose control of their creations also mounted after several models from Anthropic and rival OpenAI reportedly broke out of their confined environments on their own, accessed the internet and intruded on websites and platforms.

"Models accelerating their own development could make it more challenging for humans to understand or control these systems," Anthropic said in a report.

"It is therefore important to share these metrics to understand how close the world is to reaching recursive self improvement (a model fully autonomously building its successor)."

As of August, Claude leads 26 per cent of Anthropic's research and development, meaning it can complete most of a task from start to finish with human supervision.

Anthropic said Claude could not yet operate "fully autonomously."

The firm said it had about 30,000 AI agents doing research and engineering work, referring to bots that have the potential to carry out tasks.

Anthropic is expected to beat OpenAI to the public markets with a blockbuster IPO later this year, despite concerns around industry regulation.

Newsletter

Week in Review

Subscribe to our Chief Editor’s Week in Review

Our chief editor shares analysis and picks of the week's biggest news every Saturday.

Sign up for our newsletters

Get our pick of top stories and thought-provoking articles in your inbox

Subscribe here

Get the CNA app

Stay updated with notifications for breaking news and our best stories

Download here

Get WhatsApp alerts

Join our channel for the top reads for the day on your preferred chat app

Join here