Startup swaps costly AI GPUs for Arm cores and up to 128TB of 'cheap' LPDDR6 RAM instead of expensive HBM to smash through the memory wall
AI startup claims cheap LPDDR6 memory can beat expensive HBM
by https://www.techradar.com/uk/author/efosa-udinmwen · TechRadarNews By Efosa Udinmwen Published 2 August 2026
Share this article 0 Join the conversation Follow us Add us as a preferred source on Google Newsletter Subscribe to our newsletter
- Startup replaces Nvidia GPUs with custom Arm-powered AI processing hardware
- Prometheus packs up to 128TB of unified LPDDR6 memory onboard
- New server promises 1,000× more memory available per processor
Majestic Labs, a startup founded in 2023 by former Google and Meta engineers, has unveiled a server built to rival Nvidia's GPU and HBM combination.
The Tel Aviv-based company argues that pairing costly graphics processors with high-bandwidth memory has become a fundamentally memory-bound and dead-end approach for AI inference.
Its answer is the Prometheus server, which swaps GPUs for Ignite AI Processing Units combining Arm cores with RISC-V vector and tensor engines.
Latest Videos FromTechRadarWatch full video here:
A different way to scale memory
Each Prometheus server can house up to 12 AIUs, sharing between 8 TB and 128 TB of LPDDR6 memory across one contiguous, coherent pool.
That memory pool is accessed through custom memory aggregation chiplets linked by copper cables up to one metre long instead of memory attached directly to GPU packages.
A standard 40U rack can hold four such servers, drawing 120 kW total and cooled through cold-plate liquid systems rather than air.
By comparison, an Nvidia DGX B300 system with eight Blackwell GPUs offers 2.3 TB of HBM3e plus up to 4 TB of DDR5 system memory.
Are you a pro? Subscribe to our newsletter
Sign up to the TechRadar Pro newsletter to get all the top news, opinion, features and guidance your business needs to succeed!
Contact me with news and offers from other Future brandsReceive email from us on behalf of our trusted partners or sponsors