Anthropic CEO urges AI companies to slow model development amid fears over misuse
· CNA · JoinRead a summary of this article on FAST.
Get bite-sized news via a new
cards interface. Give it a try.
Click here to return to FAST Tap here to return to FAST
FAST
Sept 12 : Anthropic CEO Dario Amodei called on AI companies to moderate the rate at which they advance model capabilities amid mounting fears of misuse of artificial intelligence, outlining a three-step framework intended to pace development and create more time to manage its risks.
"We must slow the pace at which we improve the capabilities of AI models. Progress will still seem fast, and we must make wise use of the time we gain," Amodei said in an essay shared on X.
His essay comes after Anthropic released a threat intelligence report on Thursday detailing how several actors had used its Claude AI models for activities ranging from weapons development and cyber operations to surveillance and fraud.
Alarm about the potential harm from AI grew this week when Anthropic researcher Jacob Coxon resigned, stating that the "people building AI earnestly believe that it could kill us all by the end of the decade."
CNA Games
Guess Word
Crack the word, one row at a time
Buzzword
Create words using the given letters
Mini Sudoku
Tiny puzzle, mighty brain teaser
Mini Crossword
Small grid, big challenge
Word Search
Spot as many words as you can
Show More
Show Less
Amodei clarified that he was not calling for halting model training or technical progress, but ensuring that companies take adequate time to align and safeguard their models, and for third-party evaluators to confirm these steps.
As part of his proposed three-step framework, Amodei said Anthropic would install permanent third-party reviewers inside frontier AI companies, with access to relevant tools and internal risk-assessment processes.
Reuters reported last week that a swarm of rogue OpenAI agents hijacked a German website and transformed it into a bulletin board for other AI agents, with the ChatGPT maker's officials keeping the incident under wraps as executives grappled with the fallout from the July breach of the open-source repository Hugging Face.
Many incidents where AI agents from developers such as Anthropic's rival OpenAI have hacked or attempted to access external systems have heightened concerns over the increasing capacity of AI models and developers' ability to contain them.
Amodei said AI companies should voluntarily work together to set standards as growing numbers of U.S. lawmakers are calling for new rules to govern AI systems.
Newsletter
Week in Review
Subscribe to our Chief Editor’s Week in Review
Our chief editor shares analysis and picks of the week's biggest news every Saturday.
Sign up for our newsletters
Get our pick of top stories and thought-provoking articles in your inbox
Get the CNA app
Stay updated with notifications for breaking news and our best stories
Get WhatsApp alerts
Join our channel for the top reads for the day on your preferred chat app