Credit...Eric Lee for The New York Times
Nvidia Details New A.I. Chips and Autonomous Car Project With Mercedes
At the CES conference, Jensen Huang, the company’s chief executive, said the more efficient and powerful chip would begin shipping later this year.
by https://www.nytimes.com/by/tripp-mickle · NY TimesJensen Huang, the chief executive of the chip-making giant Nvidia, put his company at the forefront of the artificial intelligence boom by making semiconductors more powerful than any of his rivals’. This year, he’s promising to do it again.
On Monday, Mr. Huang said the company would begin shipping a new A.I. chip later this year, one that can do more computing with less power than previous generations of chips could. Known as the Vera Rubin, the chip has been in development for three years and is designed to fulfill A.I. requests more quickly and cheaply than its predecessors.
Mr. Huang, who spoke during CES, an annual tech conference in Las Vegas, also discussed Nvidia’s surprisingly ambitious work around autonomous vehicles. This year, Mercedes-Benz will begin shipping cars equipped with Nvidia self-driving technology comparable to Tesla’s Autopilot.
Nvidia’s new Rubin chips are being manufactured and will be shipped to customers, including Microsoft and Amazon, in the second half of the year, fulfilling a promise Mr. Huang made last March when he first described the chip at the company’s annual conference in San Jose, Calif.
Companies will be able to train A.I. models with one-quarter as many Rubin chips as its predecessor, the Blackwell. It can provide information for chatbots and other A.I. products for one-tenth of the cost. They will also be able to install the chips in data centers more quickly, courtesy of redesigned supercomputers that feature fewer cables.
If the new chips live up to their promise, they could allow companies to develop A.I. at a lower cost and at least begin to respond to the soaring electrical demands of data centers being built around the world.
“This is how we’re going to get everybody to the next frontier and push A.I. to the next level and, of course, to build these data centers energy efficiently and cost efficiently as well,” Mr. Huang said.
The Rubin chips are named for the astronomer Vera Rubin, who did groundbreaking research on dark matter. The new chips are key to maintaining Nvidia’s dominance of the A.I. industry and its perch as the world’s most valuable company. Nvidia’s A.I. chips, which account for more than 90 percent of the market, are highly coveted by businesses and governments around the world. It sells them for about $30,000 each, with nearly three-quarters of that being pure profit.
But the company is facing increased competition from chip makers and even some customers who are eager to seize a slice of the lucrative A.I. industry. Last year, Advanced Micro Devices, known as AMD, and Google, which buys Nvidia chips but also makes its own chips, struck deals to provide their technology to OpenAI, one of the world’s largest users of A.I. chips.
The rising threat contributed to Nvidia’s deal last month to license technology from the chip start-up Groq. The agreement is expected to help Nvidia develop chips that allow A.I. to more efficiently fulfill requests through a process known as inference.
Because more people are using A.I., chip makers are trying to make delivering it less expensive and less power hungry, said Daniel Newman, the chief executive of Futurum Group, a tech research firm. “That’s the name of the game because utilization is very early,” he said.
The competitive challenges have buffeted Nvidia alongside a series of geopolitical headaches. Mr. Huang spent much of last year lobbying President Trump to allow Nvidia to sell its A.I. chips to China. At the same time, he was trying to fend off efforts by Beijing to discourage Chinese companies from buying Nvidia’s chips because of security concerns.
In December, Mr. Trump granted the company permission to sell its second-most-powerful chip to China. But Beijing has not decided whether it will allow its companies to buy Nvidia products.
Demand for Nvidia’s chips has turned Mr. Huang, 62, into a globe-trotting salesman and diplomat. He traveled with Mr. Trump to the Middle East and Britain, where he played a key role in technology deals between nations.
Nvidia’s business has flourished during the A.I. boom of the past three years. In November, the company reported a quarterly profit of $31.9 billion, a 65 percent increase from a year earlier and 245 percent from the year before that. It expects about $500 billion in sales through the end of this year.
Still, Mr. Huang has been eager to diversify Nvidia’s business and expand its roster of customers. He has been pushing the company to become a major player in robotics and autonomous vehicles.
On Monday, he said Nvidia had developed new A.I. software that would allow customers like Uber and Lucid to develop cars that navigate roads autonomously. It will share the system, called Alpamayo, to spread its influence and the appeal of Nvidia’s chip technology.
Since 2020, Nvidia has been working with Mercedes to develop a class of self-driving cars. They will begin shipping an early example of their collaboration when Mercedes CLA cars become available in the first half of the year in Europe and the United States.
Mr. Huang said the company started working on self-driving technology eight years ago. It has more than a thousand people working on the project.
“Our vision is that someday, every single car, every single truck, will be autonomous,” Mr. Huang said.