4 of Google’s Top AI Brains Are Leaving—and Launching Their Own AI Startup

Comment
LoaderSave StorySave this story
Comment
LoaderSave StorySave this story

On July 25, Jeff Dean spoke to 6,000 would-be founders at Y Combinator’s Startup School at San Francisco’s Chase Center. Dean is a legendary engineer at Google. He is cofounder of Google Brain, chief scientist of Google DeepMind and Google Research, and technical colead on the company’s flagship AI model Gemini. With his frequent collaborator Sanjay Ghemawat, he’s written significant parts of the company’s computing and search infrastructure. A running joke in geekdom is a list of surreal “facts” about his technical prowess: Jeff Dean’s resume lists the things he hasn’t done; it’s shorter that way. At Chase Center, the interviewer asked him what areas startup founders should think about tackling.

Dean said that the most important thing would be to pick something you’re excited about and would be useful in the world. He then shared his own interest: an automated version of the scientific method. “You propose an experiment, you implement what you need to run the experiment, you evaluate the experiment, and then you get results from that,” he said. Dean said that running thousands of those automated loops could unlock groundbreaking advances in multiple domains like science, biology, chip design, and even making improved AI models.

Unbeknownst to the crowd, Dean was talking about his own secret startup, which he had just organized. Today it’s official: After almost 27 years, Dean is leaving Google, along with Ghemawat and two other top-tier AI scientists, to found a company called Discovery Loop.

Even though Google will take a stake in the new company, it’s a devastating blow to the search giant as it attempts to keep pace in the frantic AI model competition. It’s bad enough that Dean and Ghemawat, who were among the company’s first hires, are leaving—that’s like Mick Jagger and Keith Richards ditching the Rolling Stones to start a new band. Worse, the other cofounders are also supernovas in the AI firmament: Oriol Vinyals, VP of research at DeepMind and a technical lead for Gemini, and Quoc Le, a cofounder of Google Brain and the key scientist behind Google’s AutoML-Zero, a project that uses machine learning algorithms to autonomously build AI products.

In an interview I did with the cofounders just before launch, Dean tells me the idea came up only a few weeks ago. He was quickly joined by the other three, who are not only long-time colleagues but friends who vacation together. “We were working on different things, but we were all starting to see the possibility of AI being able to automate scientific and engineering loops,” he says.

The quartet worked up a road map wherein Discovery Loop would be its own first customer. The autonomous experiment loops they create initially will be directed towards improving the company’s advanced machine learning algorithms. That improved software will then become the core of an AI system that can tackle problems in subsequent domains. “I’m very excited about automating machine learning,” says Le. “It might be that we will discover a different transformer architecture.”

From there, Discovery Loop will set out to make superhuman advances in a variety of fields, including chip design, biology, drug discovery, and material design. “As we create the core intelligence and the discovery loop fundamentals, we'll be able to quickly generalize to other domains,” says Vinyals. “One of the things that we'll be obviously very focused on is how these models come up with new ideas to try. That's not something that currently they're super strong at.”

At first, the team envisions that those ideas will be codeveloped with humans, but their goal is deeply automating the process. If it works out, they contend, it’s possible that a few dedicated individuals may use Discovery Loop to out-invent the world’s largest research organizations. Presumably those small teams will be customers of Discovery Loop. (The startup also may make its own loops to seek and monetize breakthroughs.)

They put together a simple pitch deck and set out to talk to VCs about funding their company, which they set up as a public benefit corporation. “We just put a few slides with our backgrounds and a rough sketch of how we think our approach will be successful in a bunch of different ways,” says Dean. (They didn’t use AI to create it.) But their presence spoke louder than any PowerPoint could.

“With this team, I wouldn’t need to know what they were doing before I backed them,” says venture capitalist Vinod Khosla, who met with them in his Sand Hill Road office on a Saturday, so no one would get a hint of Google’s upcoming loss. “It’s the ultimate superstar team.” Khosla also loved their idea: “Humans have been using AI to do research, not using AI to be a researcher,” he says. “The fundamental thing [in Discovery Loop] is that AI is the researcher.”

Other meetings took place at Dean’s house. Ultimately Khosla Ventures and an AI-oriented VC firm called Radical Ventures bought in, along with a handful of other firms. (The founders aren’t sharing how much the funding was and at what valuation–but consider that some companies are paying tens or even hundreds of millions for a single AI superstar, and these guys are GOATs.) “Building something to solve all those problems is a powerful idea,” says Radical managing partner Jordan Jacobs, who will join the startup’s board. “These people have been doing this kind of work in the past so they know what they’re doing.”

Negotiating the exit from Google was more painful. Dean says that Alphabet CEO Sundar Pichai tried over multiple meetings to get them to keep their badges. Ultimately the team decided that they wanted the fun–and the freedom–of doing a startup.

“In a large organization there is always a lot of inertia you have to overcome to make any radical changes,” says Vinyals. “We want to build something different.” Google ultimately gave the departing engineers its blessing, along with an investment and an arrangement to provide compute power for the first year.

“Over 27 years, Jeff and Sanjay helped to drive some of the most significant technology transitions, from our early search infrastructure to the neural networks that helped create the modern AI era,” Pichai said in a statement. “We’ll continue to work with Discovery Loop as a founding investor and Cloud partner, and collaborate on a research framework for ML systems and related infrastructure advances.”

In part because of the impact this mini-exodus will have on Google. Dean and his cofounders have taken pains to maintain stealth. To date, they haven’t yet begun to hire a team (which may mean even more defections from Google) or even to rent office space. When I ask who the CEO is, there is a brief pause. “I think I’m the CEO,” says Dean, sheepishly. “Everyone pointed at me.”

Discovery Loop’s mission is not novel. Just about every major figure in AI—Dario, Sam, Jenson—has claimed at one point or another that AI will become an engine of scientific discovery, solving problems that humans could never crack on their own. This team is betting that their knowledge and skills will prevail in building a system that actually makes such breakthroughs. Short of that, Discovery Loop faces a narrower mark for success: Will the work they do as a startup be as significant as the talent gap they’re creating by leaving Google?