Nvidia Kyber Rack Costs: LPDDR5X Spending Overtakes HBM4E, Unit Price Reaches $41.6 Million

Nvidia's upcoming Vera Rubin Ultra architecture Kyber rack system marks a significant shift in hardware costs and memory configuration. Driven by rising memory chip prices and architectural adjustments, procurement spending on conventional LPDDR5X memory in the rack has surpassed high-bandwidth memory (HBM4E) for the first time. HBM4E memory on Rubin-architecture GPUs is priced at approximately $19.76 per GB. A complete Kyber rack equipped with 144 GPUs carries 124.4TB of HBM4E memory, valued at roughly $2.5 million, while the 216TB of LPDDR5X memory (using SOCAMM2 modules) for Vera CPUs costs as much as $2.8 million. Including other components and packaging expenses, a single Kyber rack carries a total price tag of $41.6 million.

On a per-chip cost basis, a Rubin GPU with HBM4 memory, substrate, and peripheral components costs $9,247, while a Vera CPU with SOCAMM2 LPDDR5X memory costs $20,059. After excluding memory costs, the Vera CPU's bare die and other hardware components amount to only $704, underscoring that DRAM memory has become the core of overall system cost.

Compared with the previous-generation Blackwell rack architecture, the Vera Rubin system's aggregate memory pool has expanded markedly, rising from 74.7TB in the Blackwell Ultra era to 340.4TB in the Kyber rack. LPDDR5X memory now accounts for a larger share of total rack value than before, reflecting a clear shift in the rack's overall resource allocation structure.