Nvidia expands advantage to data-center orchestration beyond GPUs
Just the facts

Nvidia expands advantage to data-center orchestration beyond GPUs

Summary

Nvidia is promoting integrated systems that combine its new Rubin GPU with specialized CPUs and accelerators to improve data-center efficiency, shifting competition from GPUs to overall system orchestration.

Nvidia said its latest Vera Rubin architecture pairs the Rubin GPU with a Vera CPU, Groq 3 LPX inference accelerator and dedicated storage and networking modules. The company argues that the Vera CPU is designed to manage data movement within large-scale servers, where memory limits and latency can constrain GPU performance.

"Vera is important because there’s only so much memory that you can put in a single server or any sort of compute platform," said Jason Hardy, Nvidia’s vice president of storage technology. Hardy added that the Vera CPU can deliver up to three times faster data-orchestration, allowing flash storage to operate at full capacity without creating bottlenecks. The approach mirrors efforts by other firms, such as OpenAI’s Jalapeño chip, which aims to keep workloads within a single integrated system to reduce data movement. Analysts note that as AI workloads scale to gigawatt levels, efficient traffic control becomes as critical as raw processing power. While Nvidia’s integrated solution positions it ahead in the emerging market for data-center orchestration, the company will still face competition from other chipmakers and hyperscalers that are developing alternative architectures.

Keep reading — for free

Create a free account to follow the news. No card required.