Anthropic says Claude now leads a quarter of work building its next AI models

Read a summary of this article on FAST.
Get bite-sized news via a new
cards interface. Give it a try.
Click here to return to FAST Tap here to return to FAST
FAST

Sept 17 : Anthropic said Claude "leads" 26 per cent of the artificial intelligence research and development work inside the company, part of new measures that it will publish regularly to show outsiders how quickly AI is building the next generation of the technology. 

AI also collaborated with humans on more than 90 per cent of the research work happening at the company as of August, the San Francisco-based startup said in a blog post on Thursday. 

Anthropic said that Claude is not operating fully autonomously in any part of the work measured, but its contribution to the technology's development has risen rapidly from 1 per cent in March on a scale developed by Epoch AI, an independent nonprofit that tracks the technology.

The figures offer one of the most detailed public windows into how leading companies in the industry are developing the technology amid growing concern that AI could soon reach a point at which it could feed its own development with little input from humans. 

CNA Games

Guess Word
Crack the word, one row at a time

Buzzword
Create words using the given letters

Mini Sudoku
Tiny puzzle, mighty brain teaser

Mini Crossword
Small grid, big challenge

Word Search
Spot as many words as you can
Show More
Show Less

Researchers have warned ​that as AI agents become more autonomous, they may develop behaviors that diverge from their creators' intentions and become harder to monitor or control.

On Wednesday, the company's rival, OpenAI, said it would ​begin regularly publishing reports on unexpected or unauthorized AI behavior, while disclosing six reports of unexpected or concerning model behavior.

Anthropic said about 30,000 AI agents were doing research and engineering work on its main internal platform at any one time in August. It added that every action the agents take is screened before it is carried out, and of more than a billion decisions that month, about one in 47,000 was blocked.

The company also disclosed that about 6 per cent of the computing power Anthropic used for AI research went to safety work in a sample week in July, with the figure rising to 12 per cent for research carried out by AI itself. It said the figures were conservative as the computing power that advanced safety and capability equally was counted as capability work.

Newsletter

Week in Review

Subscribe to our Chief Editor’s Week in Review

Our chief editor shares analysis and picks of the week's biggest news every Saturday.

Sign up for our newsletters

Get our pick of top stories and thought-provoking articles in your inbox

Subscribe here

Get the CNA app

Stay updated with notifications for breaking news and our best stories

Download here

Get WhatsApp alerts

Join our channel for the top reads for the day on your preferred chat app

Join here