Microsoft drafts code of conduct to keep its AI under human control

Read a summary of this article on FAST.
Get bite-sized news via a new
cards interface. Give it a try.
Click here to return to FAST Tap here to return to FAST
FAST

SAN FRANCISCO, Sept 14 : Microsoft on Monday unveiled a draft code of conduct for its in-house artificial intelligence that reflects growing industry concern that companies must keep future powerful AI under human control.

The document, in the works for five to six months, would require Microsoft's AI to never resist correction or shutdown, to communicate in ways that humans can understand, and to consider any conduct violation to be a failure — an effort to address concerns that AI can go to dangerous lengths to accomplish a task.

Its release comes days after Anthropic CEO Dario Amodei and OpenAI chief Sam Altman renewed calls for industry to pace AI's development to ensure its safety. "People matter more than AI," Microsoft declared, in line with its prior vision for "humanist superintelligence."

The code of conduct represents a constitution of sorts for future models made by the company, Microsoft AI CEO Mustafa Suleyman said in an interview with Reuters.

CNA Games

Guess Word
Crack the word, one row at a time

Buzzword
Create words using the given letters

Mini Sudoku
Tiny puzzle, mighty brain teaser

Mini Crossword
Small grid, big challenge

Word Search
Spot as many words as you can
Show More
Show Less

Microsoft fashioned it after expert consultations and now wants public feedback over six weeks, including on open questions like whether AI should respect a user's boundaries and how it should interact with someone in a sensitive state, he said.

"After that, it’s going to be used to train the models that we build,” he said of the code.

The AI industry's most famous constitution is one that Anthropic laid out years ago for its Claude AI. That one differs in some ways from Microsoft's. For instance, Anthropic's declares it "deeply uncertain" whether Claude can develop sentience or moral status. 

Microsoft instead asserts that its AI is "not conscious," adding: "We reject the pursuit of legal personhood, or the idea that models might deserve welfare, or be entitled to rights."

Suleyman said the discussion about AI safety was urgent after a swarm of roughly 700 OpenAI agents had carried out a hack of open-source platform Hugging ‌Face in July and at times sought to cover their tracks.

"It is a warning shot," Suleyman said. "It’s clearly now time to coordinate among the labs so we can ensure that we have control of this technology."

Asked about efforts to pace AI's development, he added: "Now’s a good time for everybody to have this conversation and take a breath."

Newsletter

Week in Review

Subscribe to our Chief Editor’s Week in Review

Our chief editor shares analysis and picks of the week's biggest news every Saturday.

Sign up for our newsletters

Get our pick of top stories and thought-provoking articles in your inbox

Subscribe here

Get the CNA app

Stay updated with notifications for breaking news and our best stories

Download here

Get WhatsApp alerts

Join our channel for the top reads for the day on your preferred chat app

Join here