US senators weigh requiring AI giants to commit to preventing catastrophe
· CNA · JoinRead a summary of this article on FAST.
Get bite-sized news via a new
cards interface. Give it a try.
Click here to return to FAST Tap here to return to FAST
FAST
WASHINGTON, Sept 14 : U.S. Senate negotiators are debating legislation that would require AI companies to demonstrate they are taking reasonable precautions to keep their tools from causing harm, according to a Senate aide and a lobbyist familiar with the talks.
Alarm about the potential danger posed by AI grew last week after Anthropic researcher Jacob Coxon said he had resigned, in part because the "people building AI earnestly believe that it could kill us all by the end of the decade." AI-related stocks fell worldwide on Monday after leaders of some of the industry's largest companies called for slowing the pace of the technology's development.
The senators are debating giving the U.S. commerce secretary the power to request proof that AI developers are taking reasonable steps to prevent harm, known as a "duty of care," according to the Senate aide and lobbyist. The secretary would also have the power to deploy government auditors to test companies' products themselves, they said. Reuters could not immediately determine what would qualify as “reasonable.”
The legislation is still being debated. Even if Congress approves the measure, it faces long odds of becoming law. U.S. President Donald Trump said on Monday that existing authorities already provide adequate tools to regulate and prosecute tech companies, suggesting he wouldn't sign a bill setting new rules for AI.
CNA Games
Guess Word
Crack the word, one row at a time
Buzzword
Create words using the given letters
Mini Sudoku
Tiny puzzle, mighty brain teaser
Mini Crossword
Small grid, big challenge
Word Search
Spot as many words as you can
Show More
Show Less
The proposal is being discussed by Senate Majority Leader John Thune, Senate Commerce Committee Chairman Ted Cruz and Senator Amy Klobuchar, the top Democrat involved in the negotiations. Spokespeople for Thune and Cruz did not immediately respond to requests for comment from Reuters.
"I’m continuing to work toward a bipartisan agreement on legislation for government oversight of the greatest risks posed by AI models," Klobuchar said in a statement. "That includes requiring developers to work with government experts to verify and test models to make sure AI is safe."
Cruz's Senate committee has oversight of the U.S. Commerce Department, the agency with in-house AI safety researchers. Senator Maria Cantwell, the top Democrat on the Commerce Committee, has also weighed in on the legislation, sources say.
Reuters reported on Friday that negotiators are also debating involving federal courts if the U.S. government wants to block the release of certain AI models that it deems unsafe.
Companies would be able to challenge that decision in federal court, and the exact structure of how much power the U.S. government would have is still being discussed.
Part of the measure involving federal courts would also block states from enforcing their own laws governing certain risks posed by AI models, according to another lobbyist and a Senate aide.
The U.S. companies known for the most advanced AI models are Anthropic and OpenAI.
Newsletter
Week in Review
Subscribe to our Chief Editor’s Week in Review
Our chief editor shares analysis and picks of the week's biggest news every Saturday.
Sign up for our newsletters
Get our pick of top stories and thought-provoking articles in your inbox
Get the CNA app
Stay updated with notifications for breaking news and our best stories
Get WhatsApp alerts
Join our channel for the top reads for the day on your preferred chat app