Anthropic grants AI evaluator METR employee-level access to its models

Read a summary of this article on FAST.
Get bite-sized news via a new
cards interface. Give it a try.
Click here to return to FAST Tap here to return to FAST
FAST

Oct 15 : Anthropic said on Thursday it has granted a team from nonprofit AI evaluator METR employee-level access to its systems, allowing the group to independently assess its advanced models, safety practices and risk management.

The announcement follows concerns among researchers and evaluators that leading AI labs could wield too much influence over independent reviews through publication restrictions and control over access to sensitive information.

Six METR employees have been provided company hardware, office space and access to internal tools and systems broadly comparable to those available to Anthropic's own risk assessment teams, the company said.

Anthropic added that METR will be able to publish independent assessments of risks, incidents and safety practices in the AI lab without prior approval, subject only to limited redactions covering areas such as customer data, privileged information and certain model architecture details.

Newsletter

Week in Review

Subscribe to our Chief Editor’s Week in Review

Our chief editor shares analysis and picks of the week's biggest news every Saturday.

Sign up for our newsletters

Get our pick of top stories and thought-provoking articles in your inbox

Subscribe here

Get the CNA app

Stay updated with notifications for breaking news and our best stories

Download here

Get WhatsApp alerts

Join our channel for the top reads for the day on your preferred chat app

Join here