Coolant Distribution Units (CDUs) for Data Center Liquid Cooling: Complete Guide

Coolant distribution unit with pipes and heat exchangers in a data center liquid cooling system

As data center rack densities climb past 40 kW and approach the 100+ kW levels demanded by NVIDIA GB200 NVL72 platforms and other dense AI compute configurations, traditional air cooling reaches its physical limits. The coolant distribution unit (CDU) sits at the center of every liquid cooling deployment, serving as the critical interface between facility-level water systems and the precision cooling requirements of IT equipment.

This guide covers what CDUs are, how they work, how to size them for different deployment scales, the key integration considerations for direct-to-chip and immersion cooling architectures, and the operational practices that ensure reliable performance in production data center environments.

What Is a Coolant Distribution Unit?

A coolant distribution unit is a self-contained mechanical system that manages the secondary (IT-side) liquid cooling loop in a data center. The CDU performs four essential functions: it receives warm coolant returning from servers, immersion tanks, or rear-door heat exchangers; it transfers the absorbed heat to the facility water system through a heat exchanger; it pumps temperature-controlled coolant back to the IT equipment at the required pressure and flow rate; and it monitors and maintains the coolant quality, pressure, and temperature within specified operating parameters.

The CDU creates a physical and thermal boundary between the facility water loop (which may use treated municipal water, glycol mixtures, or chilled water from a central plant) and the IT cooling loop (which uses a different coolant -- typically deionized water, propylene glycol solution, or a dielectric fluid in the case of immersion systems). This separation protects IT equipment from contamination in the facility water and allows each loop to operate at its optimal temperature, pressure, and flow regime.

Primary Components

A typical CDU contains the following major components:

  • Heat exchanger: Usually a brazed plate or shell-and-tube type, the heat exchanger transfers thermal energy from the IT coolant loop to the facility water loop without mixing the two fluids. Brazed plate heat exchangers dominate in CDU applications due to their compact form factor and high heat transfer efficiency per unit volume.
  • Pumps (redundant): Variable-speed pumps circulate coolant through the IT equipment at the required flow rate. CDUs typically include N+1 pump redundancy, with automatic failover if the primary pump fails. Variable-frequency drives (VFDs) allow pump speed adjustment to match real-time heat load, reducing energy consumption during partial load conditions.
  • Coolant reservoir: A tank that provides a buffer volume of coolant, compensating for thermal expansion and contraction, accommodating system fill and drain operations, and providing a pressure reference point for the IT loop.
  • Filtration system: In-line filters remove particulates from the coolant to prevent fouling of cold plates, micro-channels, and heat exchangers. Filter mesh size varies by application: 25-50 microns for direct-to-chip systems, 100-200 microns for immersion cooling.
  • Pressure regulation: Maintains the IT loop at the required pressure, typically 1.5-3.0 bar gauge, preventing both over-pressurization (which could burst connections or cold plates) and under-pressurization (which could cause cavitation in pumps or boiling in micro-channels).
  • Sensors and controls: Temperature sensors (supply and return), flow meters, pressure transducers, leak detection sensors, and a programmable logic controller (PLC) or building management system (BMS) integration module that manages all operating parameters and alarm conditions.

Types of CDUs by Deployment Scale

Rack-Mounted CDUs (30-100 kW)

Rack-mounted or in-rack CDUs occupy 6U-12U of rack space and serve a single rack or a small cluster of 2-4 racks. These units are designed for retrofit installations where liquid cooling is being introduced to an existing air-cooled facility, or for isolated high-density deployments within an otherwise air-cooled environment.

Rack-mounted CDUs are limited by their physical size, which constrains heat exchanger surface area and pump capacity. They are practical for deployments up to approximately 100 kW per rack but become space-inefficient and maintenance-intensive at larger scales because each rack requires its own CDU with its own set of pumps, filters, and controls.

Row-Level CDUs (200 kW - 1 MW)

Row-level CDUs are floor-standing units positioned at the end of a row of racks, serving 4-16 racks through a manifold distribution system. This is the most common deployment architecture for new liquid-cooled installations because it balances cooling capacity, redundancy, and maintenance accessibility.

A row-level CDU serving eight 60 kW GPU racks (480 kW total IT load) would typically be sized at 550-600 kW to provide adequate headroom. The manifold system distributes coolant to each rack through individual supply and return lines with isolation valves, allowing any single rack to be disconnected for maintenance without affecting the others.

Centralized CDU Systems (1 MW+)

Large-scale deployments -- particularly purpose-built AI compute facilities and mining farms -- often use centralized CDU plants that serve an entire data hall or building. Centralized systems provide the highest efficiency through large-format heat exchangers and high-capacity pumps, but require more complex piping infrastructure and introduce a single point of failure if redundancy is not properly engineered.

Centralized CDU plants are typically designed with N+1 or 2N pump redundancy, dual heat exchangers, and automatic bypass valves that allow any single component to be isolated for maintenance without interrupting cooling to the IT load. The piping distribution system uses headers and branch connections with balancing valves to ensure uniform coolant flow to all served racks.

CDU Sizing: Getting the Numbers Right

Under-sizing a CDU means insufficient cooling capacity, leading to thermal throttling or shutdown of IT equipment. Over-sizing wastes capital and floor space, and causes pumps to operate at low efficiency points. Proper sizing requires understanding three parameters: heat load, flow rate, and temperature differential.

Heat Load Calculation

The CDU heat rejection capacity must exceed the total IT heat load it serves. For liquid-cooled equipment, the heat load transferred to the liquid loop is typically 70-85% of the total server TDP, with the remaining 15-30% dissipated as radiated and convected heat from non-liquid-cooled components (memory, storage, VRMs, fans). In immersion cooling systems, the liquid captures 95-100% of the IT heat load.

A practical sizing formula:

  • Direct-to-chip CDU capacity = (Total rack IT power) x 0.80 x 1.20 safety factor
  • Immersion CDU capacity = (Total rack IT power) x 0.98 x 1.15 safety factor

For example, a row of eight racks each drawing 70 kW with direct-to-chip cooling: CDU capacity = 8 x 70 x 0.80 x 1.20 = 538 kW. A 550 kW CDU would be the minimum specification.

Flow Rate Requirements

The required coolant flow rate depends on the heat load and the allowable temperature rise (delta-T) across the IT equipment. A common design target is a 10-15 degrees C delta-T, which balances pump energy (higher flow = more pump power) against coolant temperature (lower delta-T = lower return temperature = less efficient heat rejection).

Flow rate (liters per minute) = Heat load (kW) / (specific heat x density x delta-T). For water at 35 degrees C: approximately 1.44 LPM per kW at a 10 degree C delta-T. A 550 kW CDU therefore requires approximately 790 LPM of coolant flow -- a significant volume that dictates pipe sizing, pump selection, and manifold design.

Temperature Differential and Facility Water Interface

The CDU heat exchanger requires a temperature differential between the IT return coolant and the facility water supply to drive heat transfer. The approach temperature (difference between the IT return temperature and the facility water supply temperature) typically ranges from 3-8 degrees C depending on heat exchanger size and type.

In hot climate deployments like the UAE, where ambient temperatures can exceed 45 degrees C, the facility water loop temperature may be elevated compared to temperate climates. This narrows the available delta-T and either requires larger heat exchangers (more surface area to compensate for reduced driving temperature difference) or higher coolant supply temperatures to the IT equipment. Modern GPU servers typically tolerate coolant inlet temperatures up to 40-45 degrees C, which provides adequate margin for hot-climate operation.

CDU Integration with Cooling Architectures

Direct-to-Chip (Cold Plate) Systems

In direct-to-chip cooling, a cold plate is mounted directly on each processor (CPU, GPU, or ASIC), and coolant flows through micro-channels within the cold plate to absorb heat. The CDU supplies coolant at a controlled temperature (typically 25-40 degrees C) and pressure (typically 2.0-2.5 bar) to the manifold, which distributes to individual server quick-disconnect fittings.

CDUs for direct-to-chip applications must provide precisely controlled flow and pressure because the micro-channels in cold plates have specific flow requirements. Too little flow results in inadequate heat removal and hot spots; too much flow wastes pump energy and can create excessive pressure drop across the cold plate. Variable-speed pumps with flow feedback control are essential for matching cooling capacity to real-time IT load.

The coolant quality requirements for direct-to-chip systems are stringent. Micro-channels with dimensions of 200-500 microns can be clogged by particulates, biological growth, or mineral deposits. CDUs serving direct-to-chip installations typically include deionization (DI) filtration, UV sterilization, and conductivity monitoring to maintain coolant purity below 1 microsiemens per centimeter.

Immersion Cooling Systems

In single-phase immersion cooling, IT equipment is submerged in a tank of dielectric fluid, and the CDU circulates this fluid through an external heat exchanger to reject heat. In two-phase immersion, the dielectric fluid boils at the chip surface, and the vapor is condensed on cooling coils within the tank, with the CDU managing the condenser water loop.

CDUs for immersion cooling systems handle different operational parameters than direct-to-chip CDUs. The coolant volumes are much larger (a single immersion tank may contain 500-2000 liters of dielectric fluid), flow rates are typically lower (because the entire component surface is in contact with coolant, not just the cold plate interface), and temperature differentials are wider. The dielectric fluids used in immersion cooling (mineral oil variants, engineered fluorocarbons, or synthetic esters) have different thermal properties than water, requiring the CDU's heat exchanger and pump to be specifically rated for the fluid type.

Rear-Door Heat Exchangers

Rear-door heat exchangers (RDHx) mount on the back of a server rack and use liquid-cooled coils to capture exhaust air heat before it enters the room. While not true liquid cooling at the component level, RDHx systems use CDUs to manage the coolant loop. This approach can handle rack densities up to 30-40 kW without modifying the servers themselves, making it the least disruptive liquid cooling retrofit option for existing facilities.

CDU requirements for RDHx applications are the simplest: moderate flow rates, standard water or glycol coolant, and relatively relaxed filtration requirements since the coolant never contacts electronic components. RDHx CDUs are often integrated into the rear-door unit itself, eliminating the need for a separate floor-standing CDU.

Operational Considerations

Redundancy and Failover

CDU failure means loss of cooling to IT equipment, which triggers thermal shutdown within minutes for high-density GPU workloads. Redundancy design must consider:

  • Pump redundancy (N+1 minimum): The most common failure mode. Automatic pump switchover should complete within seconds, with the standby pump pre-heated to avoid thermal shock to the coolant circuit.
  • CDU-level redundancy (2N for critical loads): For mission-critical AI training workloads where even brief cooling interruptions can corrupt multi-day training runs, dual CDUs with independent piping paths provide the highest availability. Each CDU is sized for the full load, and crossover valves allow either CDU to serve the entire row.
  • Facility water redundancy: The CDU depends on facility water supply for heat rejection. Dual facility water feeds from independent headers ensure cooling continuity during facility-side maintenance.

Leak Detection and Containment

Liquid near electronic equipment demands rigorous leak management. CDUs incorporate multiple leak detection mechanisms:

  • Drip tray sensors: Beneath the CDU enclosure, moisture-sensing cables or point sensors detect any liquid accumulation.
  • Pressure decay monitoring: Continuous pressure monitoring on the IT loop detects slow leaks by identifying gradual pressure loss over time, even when no liquid is visible at the CDU location.
  • Flow balance monitoring: Comparing supply and return flow rates identifies leaks within the distribution piping. A discrepancy exceeding 2-3% triggers an investigation alarm.
  • Automatic isolation: On confirmed leak detection, the CDU controller can close isolation valves to contain the leak to the smallest possible pipe segment, minimizing coolant loss and potential equipment exposure.

Coolant Maintenance

Coolant quality degrades over time due to corrosion products, biological growth, and dissolved gases. CDU maintenance schedules should include:

  • Monthly: Check coolant conductivity (for DI water systems), pH level, and visual clarity. Replace inline filters if differential pressure exceeds the specified threshold.
  • Quarterly: Laboratory analysis of coolant sample for metals content (copper, aluminum, iron), microbial count, and inhibitor concentration. Top up biocide and corrosion inhibitors as needed.
  • Annually: Full coolant exchange if analytical results indicate degradation beyond recovery. Inspect heat exchanger surfaces for fouling and clean or replace as needed. Verify pump impeller wear and bearing condition.

CDU Selection for UAE Data Centers

Data center operators in the UAE face specific considerations when selecting and deploying CDUs:

  • High ambient temperatures: With outdoor design temperatures exceeding 45 degrees C, the facility water supply to the CDU may be warmer than in temperate climates. CDUs must be selected with heat exchangers sized for the reduced temperature differential. This typically means specifying 20-30% additional heat exchanger surface area compared to a temperate climate installation.
  • Water scarcity: The UAE's limited freshwater resources make closed-loop CDU systems (where facility water is recirculated, not consumed) strongly preferred over open-loop or evaporative systems. CDUs that operate at elevated coolant temperatures (38-45 degrees C supply) enable dry cooler heat rejection for a larger portion of the year, reducing dependence on water-consuming cooling towers.
  • Dust and humidity: CDUs installed in environments with high airborne particulate levels (common in Gulf region outdoor installations) require enhanced filtration on facility water inlets and IP55 or higher enclosure ratings for outdoor-mounted components.
  • Regulatory compliance: Dubai Municipality and TDRA guidelines for data center cooling infrastructure may specify requirements for coolant types (food-grade glycol in some jurisdictions), secondary containment around CDU installations, and monitoring/reporting for water consumption.

CDU Manufacturers and Specifications

The CDU market has expanded significantly as liquid cooling adoption accelerates. Key manufacturers and their positioning include:

  • Vertiv (Liebert XDU): Established data center infrastructure provider offering CDUs from 50 kW to 1.4 MW. Strong integration with Vertiv's BMS and monitoring platforms. Well-suited for enterprise and colocation deployments with existing Vertiv infrastructure.
  • CoolIT Systems: Pioneer in direct-to-chip liquid cooling with integrated CDU solutions. Particularly strong in HPC and AI GPU deployments with compatibility across NVIDIA, AMD, and Intel server platforms. Row-level CDUs from 100 kW to 500 kW.
  • GRC (Green Revolution Cooling): Specialist in single-phase immersion cooling with CDUs designed specifically for dielectric fluid management. Strong presence in Bitcoin mining and emerging AI immersion deployments.
  • Motivair: Row and rack-level CDUs from 30 kW to 600 kW with a focus on ease of integration in retrofit scenarios. Compatible with multiple cold plate vendors and quick-connect manifold systems.
  • Asetek: Data center CDUs built on their liquid cooling heritage from consumer and workstation markets. Strong focus on GPU server compatibility with NVIDIA and AMD platforms.

When evaluating CDU vendors, the key specifications to compare include: heat rejection capacity at the expected operating temperatures, pump flow rate and head pressure, heat exchanger approach temperature, physical dimensions and weight (for floor loading calculations), noise emissions (critical for colocation environments with multiple tenants), and the monitoring and management interface (SNMP, Modbus, REST API for DCIM integration).

Integration with Facility Infrastructure

Piping Design

CDU piping infrastructure must be designed for the specific coolant type, flow rate, and pressure requirements. Key design principles include:

  • Material compatibility: Stainless steel or copper piping for DI water systems (carbon steel promotes corrosion). HDPE or fluoropolymer-lined piping for certain dielectric fluids. Quick-disconnect fittings at the rack interface should be non-spill, dry-break type to prevent coolant loss during server hot-swap operations.
  • Pipe sizing: Target fluid velocity of 1.5-3.0 m/s to maintain turbulent flow (good heat transfer) without excessive pressure drop or erosion. For the 790 LPM example above, this translates to approximately 75 mm (3 inch) main headers with 32 mm (1.25 inch) branch connections to individual racks.
  • Isolation and drain provisions: Every rack connection should have individual isolation valves (supply and return) and a low-point drain valve. This allows any rack to be disconnected for maintenance without draining the entire loop.

Electrical and Controls Integration

CDUs require clean, conditioned power for their pumps and control systems. A 500 kW CDU typically draws 5-15 kW of electrical power for pumps, controls, and sensors -- roughly 1-3% of the IT load it serves. This parasitic power consumption should be included in the facility's PUE calculations.

The CDU control system should integrate with the facility BMS to enable coordinated control of facility water supply temperature, pump speed modulation based on IT load, and alarm escalation through the facility's monitoring infrastructure. Modern CDUs provide network connectivity (Ethernet, RS-485) with support for BACnet, Modbus, and SNMP protocols.

Total Cost of Ownership

CDU economics should be evaluated on a total cost of ownership (TCO) basis across a 5-7 year lifecycle:

  • Capital cost: CDU hardware ($150-400 per kW of cooling capacity, depending on scale and features), piping installation ($50-150 per kW), controls integration ($20-50 per kW), and commissioning ($10-30 per kW). Total installed cost: $230-630 per kW.
  • Operating cost: Pump electricity (typically 1-3% of IT load), coolant replenishment and treatment ($5,000-15,000 per year per CDU), filter replacement ($1,000-3,000 per year), and preventive maintenance labor ($3,000-8,000 per year).
  • Avoided cost: CDU-based liquid cooling eliminates or reduces the need for CRAH/CRAC units, raised floor infrastructure, and high-airflow containment systems. For new builds above 30 kW per rack, liquid cooling with CDUs typically delivers 15-25% lower total cooling infrastructure cost compared to air cooling at equivalent densities.

The economic inflection point varies by climate and rack density, but for deployments above 40 kW per rack in the UAE and other hot-climate regions, CDU-based liquid cooling is almost universally more cost-effective than air cooling when evaluated on a 5-year TCO basis. The combination of reduced PUE (1.05-1.10 versus 1.20-1.30 for air-cooled), higher achievable rack densities, and the ability to use economizer cooling at elevated coolant temperatures drives the economic advantage.

Deploy Liquid-Cooled Infrastructure with Rax

Rax designs and operates liquid-cooled data center infrastructure for AI GPU workloads, Bitcoin mining, and high-performance computing. Our facilities feature precision CDU systems, direct-to-chip and immersion cooling options, and the engineering expertise to support rack densities from 30 kW to over 100 kW.

Discuss Your Cooling Requirements