AI Data Center Power Crisis: What It Is and the Fix

AI Datacenter Power Crisis: What It Is and the Fix

BACK TO RESOURCES

Blog

Solving the AI Datacenter Power Crisis Without New Construction

By

SambaNova

--> July 13, 2026

Delivering on the promise of AI is no longer constrained by the technology that enables it, but by the ability of modern datacenters to power the systems it runs on. The result is a growing gap between what the most advanced AI systems demand and what today's facilities can actually deliver.

TL;DR:

The AI datacenter power crisis is the growing mismatch between the power next-generation AI systems require and what existing data centers can supply.

Existing datacenters hold more than 80% of AI capacity but support only 30 kW or less per air-cooled rack, while the latest GPU-based racks draw 120 kW and future generations may reach 1 MW per rack.

A new 1 GW AI datacenter costs an estimated $47 billion to build and takes roughly three years to stand up. 1 Power shortages are projected to delay or cancel 30% to 50% of AI datacenters planned for 2026. 5

Fewer than 8% of enterprise datacenters will meet next-generation power and cooling requirements when NVIDIA Rubin Ultra ships, according to Teradata.

SambaNova's RDU platform runs air-cooled at about 10 kW per rack (SambaRack™ SN40-16) and 20 kW per rack (SambaRack SN50), so it drops into existing datacenters, on its own or alongside GPUs.

Existing datacenters make up more than 80% of the available capacity for AI systems, yet most cannot run next-generation systems like the NVIDIA VR200 NVL72 because of power limitations. Instead, running these powerful systems requires the construction of entirely new facilities, a costly process that can take years to complete.

Foxconn estimates that a 1GW datacenter built to power NVIDIA VR200 NVL72 systems would cost $47 billion to construct, with an annual electric bill of approximately $1.3 billion. 1 NVIDIA CEO Jensen Huang has confirmed, “If you want to build a datacenter here in the United States from breaking ground to standing up an AI supercomputer is probably about three years”. 2

Three forces are driving this crisis: a widening gap between the power available in existing datacenters and what next-generation systems require, growing public and regulatory pushback against datacenter expansion, and the need for sovereign AI in regions with limited resources. The sections below examine each of these challenges and how SambaNova’s 20kW air-cooled RDU platform is uniquely positioned to solve them.

The Power Crisis

“AI infrastructure powered by advanced GPUs challenges the power and cooling capacities of current enterprise data centers. To address this, organizations must adopt design and operational practices to deploy AI infrastructure effectively within existing spaces, ensuring performance, scalability, and energy efficiency.”

Gartner, AI Infrastructure Guide for Power-Constrained Data 27 June 2026 - ID G00850629

Rising Power Demands Per Rack

The latest GPU-based systems are voracious consumers of power and water. Each new generation of GPUs has driven power demands higher. The DGX H100 and H200 systems, each with eight GPUs, only consume 10.2 kW of power, making them easily compatible with most existing datacenters.

However, the 72 GPU Blackwell DGX GB200 NVL72 draws up to 120 kW per rack, a more than 10X increase that puts it out of reach for most existing data centers. Power requirements for the latest Vera Rubin NVL72 racks operate at 120-130 kW, while the Rubin Ultra NVL576 power consumption skyrockets to as much as 600 kW per rack, which is enough to power 400 homes.

Feynman, the system expected to follow Rubin, will have configurations that may require as much as 1 MW per rack. The core problem is that most current datacenters can only support 30 kW or less, per air-cooled rack. These datacenters need systems that can operate within that range.

AI's Grid-Level Power Gap

Gartner estimates that meeting the incremental power needs of AI datacenters in 2027 will be 500 terawatt-hours (TWh) per year. This is a 2.6X increase of the power requirements in 2023 and nearly as much as Germany’s entire power consumption in 2022.

Emerging Tech: Generative AI Power Challenges Cannot Be Solved by Semiconductors Alone, ID G00809650

Datacenter Readiness

Delivering the power required to operate the latest GPU-based systems is a significant challenge for existing datacenters. Most enterprise datacenters were built to support rack-level power requirements of 5 kW-8 kW and typically only offer air cooling – a far cry from the 600 kW some Vera Rubin systems demand.

Power is only part of the problem. Any system consuming that much electricity generates a proportional amount of heat, which is why these systems require sophisticated liquid cooling rarely found in existing datacenters.

Given the significant power and cooling demands, most traditional datacenters are ill-equipped to support the latest GPU-based platforms. Teradata estimates that by the time Vera Rubin systems ship, fewer than 8% of enterprise datacenters will meet the power and cooling requirements needed to run them.

Enterprise readiness for Rubin deployment. AI training clusters approach universal liquid cooling, but overall data center penetration and 800V DC adoption lag far behind. Fewer than 8% of enterprise facilities will have both capabilities when Rubin Ultra ships in H2 2027.

Source: Teradata

The Great Datacenter Build Out

The exploding demand for faster AI services, combined with the need for datacenters that can support next-generation GPU systems, has triggered a massive wave of proposed new datacenter construction. Pew Research counts more than 1,500 new datacenters currently in various stages of development in the U.S. alone. 3

Much of the construction is shifting to rural areas. While 87% of existing datacenters are located in urban areas, 67% of those being built are in rural areas, and 39% are in areas with no datacenters today.

Construction alone won’t solve the problem. These new facilities also need access to sufficient power., and many rural sites lack grid connections capable of meeting their needs.

According to Gartner: “Datacenters that demand huge amounts of power can be built far faster than power utilities can expand their capacity. Delivering increased power to datacenter locations often requires new transmission lines from existing generation facilities (which can take years for permits), but can even...