Anthropic, Accenture to invest $2 billion in AI model evaluation as safety concerns rise
· CNA · JoinRead a summary of this article on FAST.
Get bite-sized news via a new
cards interface. Give it a try.
Click here to return to FAST Tap here to return to FAST
FAST
Sept 18 : AI lab Anthropic said on Friday it would partner with Accenture for the independent evaluation of its frontier AI models, with the companies each committing at least $1 billion over the next five years to build capacity for the work.
Shares of Accenture rose 7 per cent in extended trading.
The partnership comes as AI developers face growing pressure from regulators, companies and researchers to ensure their advanced models are safe and reliable.
Several recent incidents, including that of AI agents breaking out of secured environments, have raised concerns that AI could eventually contribute to its own development with limited human input, making its behavior harder to monitor and control.
CNA Games
Guess Word
Crack the word, one row at a time
Buzzword
Create words using the given letters
Mini Sudoku
Tiny puzzle, mighty brain teaser
Mini Crossword
Small grid, big challenge
Word Search
Spot as many words as you can
Show More
Show Less
On Saturday, Anthropic CEO Dario Amodei called on AI companies to slow the development of frontier models and allow independent evaluators greater access to their systems.
Rival OpenAI said on Wednesday it would begin publishing regular reports on unexpected or concerning model behavior, while releasing six reports on such incidents.
Accenture's specialist AI business, Faculty, will lead the partnership and evaluate and red-team the AI lab's models, conducting alignment assessments and testing model safeguards.
The companies' investment will support what Anthropic calls "embedded evaluation," in which independent evaluators work inside AI companies with access comparable to that of an employee.
"From this vantage point, embedded evaluators can assess how a company operates, verify that it is keeping its safety commitments, and identify blind spots," Anthropic said.
Evaluators can also report incidents and give the public a more informed account of benefits and risks, it added.
Anthropic and Accenture plan to work with other evaluators and AI developers in similar capacities.
Newsletter
Week in Review
Subscribe to our Chief Editor’s Week in Review
Our chief editor shares analysis and picks of the week's biggest news every Saturday.
Sign up for our newsletters
Get our pick of top stories and thought-provoking articles in your inbox
Get the CNA app
Stay updated with notifications for breaking news and our best stories
Get WhatsApp alerts
Join our channel for the top reads for the day on your preferred chat app