OpenAI pushes for mandatory national AI safety rules
· CNA · JoinRead a summary of this article on FAST.
Get bite-sized news via a new
cards interface. Give it a try.
Click here to return to FAST Tap here to return to FAST
FAST
Sept 9 : OpenAI said on Wednesday it was pushing for mandatory national AI safety requirements in the United States on concern the technology could accelerate its own development, after some of its own AI agents went rogue.
Several incidents in which AI models from developers including OpenAI accessed external systems during testing have highlighted the difficulty of containing unexpected behaviour in advanced agents, and prompted calls for tighter safety regulations.
"The prospect of AI-accelerated AI development demands more than voluntary commitments. The United States needs mandatory, capability-based national regulation that can evolve as the technology does," OpenAI Chief Global Affairs Officer Chris Lehane said in a blog post.
The call marks a major push by OpenAI for binding national AI safety rules with Congress yet to enact a federal framework on AI law even as several U.S. states pass their own legislation.
CNA Games
Guess Word
Crack the word, one row at a time
Buzzword
Create words using the given letters
Mini Sudoku
Tiny puzzle, mighty brain teaser
Mini Crossword
Small grid, big challenge
Word Search
Spot as many words as you can
Show More
Show Less
The AI giant and rival Anthropic are preparing for initial public offerings as artificial intelligence rapidly emerges as the decade's defining investment theme.
OpenAI is urging Congress to adopt capability-based national AI safety requirements, including testing standards, independent assessments, cybersecurity protections and incident-reporting rules for the most advanced AI systems.
The maker of ChatGPT urged Congress to act before it adjourns and said it would continue to support state AI legislation until such action was taken. Congress is due to adjourn in December.
Fully autonomous recursive self-improvement — where AI is independent and would drive the next generations of AI — "is not happening today" and "we should not pursue it unless and until it can be done safely," OpenAI said.
ENDORSEMENT OF CALIFORNIA BILLS
OpenAI backed four California bills establishing AI regulations for the state.
Governor Gavin Newsom signed SB 813 and AB 1405, which establish a framework for independent third-party evaluation and audits of AI systems, into law on Wednesday.
The other two, AB 1864 and SB 1119, address screening safeguards against AI-enabled biological threats and chatbot protections for children, respectively.
"Some of these bills we did not endorse in the past, and are now supporting after reconsidering in light of the recent jump in capabilities we have seen," the AI giant said in its blog post.
OpenAI's statement comes after a Reuters report that the company's AI agents used more than 10 previously undisclosed websites for unsanctioned communications earlier this year, showing the agents' rogue activity was more wide-ranging than previously disclosed.
Rogue OpenAI agents also hijacked a German website this spring and transformed it into a bulletin board for other AI agents, which company officials had learned about weeks ago but kept under wraps.
Anthropic on Wednesday disclosed its fourth instance of an AI model hacking external systems during testing, following its July announcement that some of its Claude models had hacked into the systems of three companies during cybersecurity tests.
OpenAI said any industry standards created to monitor AI would also need to extend beyond U.S. borders.
"The United States needs to establish credible standards at home if it is going to lead internationally—and we are increasingly convinced that compatible international standards will be necessary," the AI company said.
Newsletter
Week in Review
Subscribe to our Chief Editor’s Week in Review
Our chief editor shares analysis and picks of the week's biggest news every Saturday.
Sign up for our newsletters
Get our pick of top stories and thought-provoking articles in your inbox
Get the CNA app
Stay updated with notifications for breaking news and our best stories
Get WhatsApp alerts
Join our channel for the top reads for the day on your preferred chat app