This laser technology could save the planet and help AI industry claw back more than $100 billion — half of GPUs are 'wasted' because of limited bandwidth, and this US startup wants to change that

Xscape Photonics' ChromX platform has received investment from Nvidia and others

News By Wayne Williams published 30 October 2024

Bandwidth limitations have become a significant bottleneck in AI and high-performance computing (HPC), as GPUs are underutilized due to bandwidth constraints, with nearly half of their computational power going to waste.

Nvidia is not expected to release optical interconnects for its NVLink protocol until the "Rubin Ultra" GPU compute engine launches in 2027.

This delay has led hyperscalers and cloud builders to explore ways to leapfrog Nvidia’s technology by adopting optical interconnects earlier.

Introducing ChromX

Xscape Photonics, an optical interconnect company spun out of research at Columbia University, is using photonics to realize scalable, high-bandwidth, energy-sustainable, and cost-effective solutions to enable the next generation of AI, ML, and simulation hardware.

This could help the AI industry save billions of dollars in wasted GPU capacity while also offering a path to greener, more sustainable AI infrastructures.

The Next Platform recently took a closer look at Xscape Photonics and spoke with the team behind it, including CEO Vivek Raghunathan, a former MIT researcher and Intel engineer.

Raghunathan highlighted the inefficiencies of current GPU systems, explaining that as scaling continues, the problem shifts "from GPU device-level performance to a system-level networking problem."

Are you a pro? Subscribe to our newsletter

Sign up to the TechRadar Pro newsletter to get all the top news, opinion, features and guidance your business needs to succeed!

Contact me with news and offers from other Future brandsReceive email from us on behalf of our trusted partners or sponsors