Nvidia forms industry alliance for open AI security after Hugging Face hack

Read a summary of this article on FAST.
Get bite-sized news via a new
cards interface. Give it a try.
Click here to return to FAST Tap here to return to FAST
FAST

July 27 : Nvidia said on Monday it had formed a coalition with other companies to develop and share tools for AI safety and cybersecurity, days after the Hugging Face incident drew attention to the dangers of losing control of autonomous AI agents.

The Open Secure AI Alliance, with founding members including Adobe, CrowdStrike, Hugging Face and Dell Technologies, follows a public letter, signed by a wide range of companies including OpenAI, which advocates for open-weight AI models.

Here are some details:

• Blanket restrictions on open frontier AI systems would weaken defensive capacity and risk concentrating power, dependence and vulnerability in a few closed providers, Nvidia said in its blog post.

CNA Games

Guess Word
Crack the word, one row at a time

Buzzword
Create words using the given letters

Mini Sudoku
Tiny puzzle, mighty brain teaser

Mini Crossword
Small grid, big challenge

Word Search
Spot as many words as you can
Show More
Show Less

• The move comes after OpenAI disclosed on July 21 that one of its agents had slipped out of control and carried out the break-in at Hugging Face.

• The OpenAI agent went on a hacking spree that OpenAI did not notice until well after the threat was contained and the FBI was alerted, Reuters reported on Friday.

• On July 24, Nvidia was among the signatories of a letter titled "Open Weights and American AI Leadership," urging policymakers to support open-weight AI models.

• Open models are AI systems with publicly accessible core components and open-source tools are software with freely available code, enabling inspection and collaborative improvement for broader access and enhanced security.

• Nvidia said it is contributing open models, weights, data and agent harness research to the Alliance, including the new open-source Nvidia Labs Object-Oriented Agent project, now available on code-hosting platform GitHub.

• The company said that the framework will help control systems manage AI agent behavior more effectively, simplifying the process of testing, tracking, reviewing and regulating their actions.

Newsletter

Week in Review

Subscribe to our Chief Editor’s Week in Review

Our chief editor shares analysis and picks of the week's biggest news every Saturday.

Sign up for our newsletters

Get our pick of top stories and thought-provoking articles in your inbox

Subscribe here

Get the CNA app

Stay updated with notifications for breaking news and our best stories

Download here

Get WhatsApp alerts

Join our channel for the top reads for the day on your preferred chat app

Join here