Huawei’s CloudMatrix 384 Hits the Market at $8M, Outperforms Nvidia GB200 in Raw Power
Huawei has begun shipping its flagship AI server, the CloudMatrix 384 (CM384), priced at $8 million (~¥58 million) per unit—roughly three times the cost of Nvidia’s competing GB200 NVL72 system. The move underscores Huawei’s strategy to build a high-performance, self-reliant AI infrastructure for China, free from Western export restrictions.
Unmatched Hardware, at a Power Cost
At the heart of the CM384 are 384 Ascend 910C chips, interconnected via an all-to-all topology. According to SemiAnalysis, the system delivers 1.7x the BF16 compute performance and 3.6x the memory capacity of Nvidia’s GB200 NVL72. However, this brute-force approach comes with trade-offs:
- Power consumption is 3.9x higher than the GB200.
- Single-chip performance still lags behind Nvidia’s, but the scaled-up design makes the CM384 the most powerful AI server currently available.
Industry analysts note that China’s abundant energy supply mitigates concerns over power inefficiency. “Electricity isn’t a bottleneck here,” one report observed.
Targeting China’s Sovereign AI Ecosystem
Huawei has already secured ten major Chinese clients, though their identities remain undisclosed. Sources suggest they include state-backed cloud providers, telecom giants, and research institutes—all long-term Huawei partners. The CM384 is designed to integrate seamlessly into existing data centers, reinforcing China’s push for tech independence.
Software: The Lingering Challenge
While Huawei’s hardware competes on raw specs, its AI software stack remains a work in progress. Unlike Nvidia’s mature CUDA ecosystem, Huawei’s platform requires clients to adapt to its proprietary frameworks—a hurdle for broader adoption. “There’s no easy fix,” admits one insider. “But as homegrown GPU ecosystems mature, reliance on Nvidia will shrink.”
Pricing and Market Positioning
At $8M per unit, the CM384 isn’t a budget alternative. Instead, Huawei is betting on performance and sovereignty to attract deep-pocketed clients prioritizing localized AI infrastructure. Meanwhile, Nvidia’s GB200 remains the global benchmark for efficiency and software support.
Bottom Line: Huawei’s CM384 is a muscle-flexing showcase of China’s AI ambitions—power-hungry, expensive, but undeniably potent. The real test? Whether its software can catch up to its hardware.

Leave a comment