slides: the top 3 north america data center trends for cooling

The Top 3 North America Data

Center Trends for Cooling

• Graybar PowerSmart® is the best choice for facility

managers and building owners seeking lower costs and

increased productivity

• Our experience and vast resources enable us to provide

energy efficient and intelligent strategies and products

designed to deliver value for each of our customers.

Joe Capes Business Development Director for Schneider

Electric's Cooling Line of Business

Speaker

Trending the North American

Application of Data Center Cooling

January 16, 2014

Joe Capes

Director – Cooling Business Development, Americas

[email protected]

Schneider Electric 5

Agenda Top 3 NAM trends for Data Center Cooling today

Economizers – types & options

High Performance Cooling – Where is the industry heading?

Selecting the right Cooling solution for your Data Center

Summary






Summary


Data center segmentation has changed from business size to

business purpose

PAM: $15.1B (1)

3% - 4% Growth

PAM: $4.9B (1)

15% - 20% Growth

PAM: $2.0B (1)

7% - 9% Growth

Enterprise Data Center as an

Enabler

Cloud & Colo Data Center as a

Business

HPC Data Center as an

Investment

Server deployments

in Cloud & Colo will

increase by 2.5x by

2020

Cloud & Colo server deployments will represent 43% by 2020; up from 18% in 2011

IDC

(2)

(2)

(1) PAM for Current YoY. Source Tier1 & ITB internal estimates


Cooling represents ~half of the total energy consumed in the Data Center

33% of the total energy consumption is related to the

chillers

Datacenter energy impact: OPEX


Market Trends

Standards

Regulations

Consolidation

F-Gas

Restriction

ASHRAE TC9.9 Broadening operating ranges

ASHRAE SPC90.1 requires economizers and minimum PUE

- ASHRAE SPC90.4 coming 20XX

AHRI Datacom section

US Department of Energy efficiency mandates

EU code of conduct compliance, MEPS, CCC & others

Segment forecasted to grow at 15-20% YOY

Best served by large capacity units (CRACs and Air Handlers)

Server deployments to increase by 2.5x by 2020

Application needs better performance, low installed cost and faster deployment

SMDC opportunities declining as compute is outsourced or moved off-site

Eff

icie

nc

y /

Ec

on

om

ize

rs

Clo

ud

/

Co

lo

WW

Ma

rke

t

Fluorinated Greenhouse Gas restrictions are requiring phase-out of all

of the F-Gas refrigerants by 2020

Modules Modular datacenter design becoming more mainstream with a lot of

focus on quick deployment


ASHRAE 90.1 Climate Zone Economizer Requirement Map

No requirement

Data Centers >19kW

Data Centers >40kW

Basically, if you’re blue, economizer use is mandated!


Paradigm Shift: Economizer to Become

PRIMARY Mode of Operation

OLD: Use economizer as a supplemental mode

NEW: Use economizer as the primary mode

Reduce/eliminate the use of a compressor system

and move toward a highly efficient Data Center

Cooling system






Summary


An Overview of the Economizer Mode

Operating in

economizer

mode saves

energy

It is often a

requirement to

meet efficiency

targets

“Economizer is a mode of operation,

not an object”


Purpose and Function of Economizer

Modes

The system must do less work to cool the data center

• Cooling systems’ efficiency have improved

For greater efficiency gains

• The development of economizer modes

Bypass compressor


Factors that Impact Economizer Mode

Operation

Geographic location

Cooling system set

points

Separation of hot

and cold air streams


Impact of Geography / Ambient


Impact of Cooling Set Points

● ASHRAE (Technical Committee)9.9 sets the

recommended operating limits within the data center.

● In 2008, the limits were widened to allow for raised rack

inlets temperatures.

● This widened envelope allows for efficiency and energy

savings through more hours of economization

ASHRAE TC9.9

2004 Limits

Temp Range: 68-77°F

Humidity Range: 40-55%

2008 Limits

Temp Range: 64.4-80.6°F

Humidity Range: (DP 42°F) –

(60% RH & DP 59°F)


Impact of Containment

Facilitates higher supply & return air temperatures

COLD-aisle containment HOT-aisle containment

The key benefit of both methods comes from SEPARATION of

cold supply air from hot return air

COLD air free in the room

HOT air free in the room

Cold aisle

Hot aisle


Let’s focus in on ‘the top 3’

Comparison of Economizer Modes

15 Economizer Types or Modes!!


Good - A/C bypass using Direct Fresh Air

Key Components

Fans and Louvers

o Draw cold outside air through

filters into the data center

Louvers and Dampers

o Control the hot exhaust air

released to the outdoors and

back into the data center air

supply

Filters

o Filter the supply air

Evaporative assist can be used in this type of economizer mode

Warning: Mixing of outside & inside air can result in particulate contamination


Better - A/C Bypass via Heat Wheel

Key Components

Fans

o Blows cold outside air through a

rotating heat exchanger

o Separate fans blow heated exhaust

air across the same heat exchanger

Heat Wheel

o Rotating heat exchanger

o Isolates outside air from data center

air

o 100% sensible cooling



Best - A/C Bypass using Air Heat Exchanger

a.k.a. Indirect Evaporative Cooling

Key Components

Fans

o Blows cold outside air over a heat

exchanger

o Separate fans blow heated exhaust

air across the same heat exchanger

Air-to-air Heat Exchanger

o Cools hot data center air and

isolates the air from the outside air

o Eliminates the need for pre-

treatment & filtration

o 100% sensible cooling



Competitive Analysis

1 MW Design Data Center @ 60% Load

System Architecture Partial PUE kW-Hr/Yr Relative Power

Indirect Evaporative Heat Exchange 1.09 466,518 45%

Air Econ w/ Heat Wheel & Evap Assist 1.10 503,999 48%

Fresh Air Econ 1.14 718,159 69%

Water Cooled Chiller w/ Econ 1.14 728,195 70%

Air-Cooled Chiller w/ Econ 1.16 846,039 81%

DX Fluid Cooled CRAC w/ Econ 1.20 1,044,073 100%1) Hot Air Containment 101.5°F Return to A/C

2) Supply Air / Cold Aisle 77°F

3) BIN Weather Data St. Louis, MO

4) Does not reflect humidification losses

5) All systems have fan control proportional to IT load % of design


Conclusion

In the past, cooling system

economizer modes have not been

seriously considered in most data

centers.

Many economizer options exist with

indirect air heat exchange (w/

evaporative assist) showing best

overall performance and return on

investment.






Summary


New Challenge:

Dynamic Power Variation

Past Future

IT load power varies less than 5% with computational load

IT load varies +5% in proportion to computational load

Power and cooling accommodation of IT load changes is manual

Power and cooling automatically adapt based on IT load changes

Both total and individual IT airflow requirements are constant

Total IT airflow changes over time and moves around the data center

Problems like hot spots and overloads are static and can be measured and

modeled with CFD

There is no single state to be modeled. Performance must be

predictable.

To deal with dynamic power variation, use of past design

approaches requires gross over provisioning

Foundational BUSINESS OVERVIEW Rev 1


Is Liquid Cooling the Answer?

Promise:

• Widespread use of liquid-air & liquid-

liquid HX in gaming PCs, consoles, etc.

• Entry cost is decreasing

• New refrigerants are opening gateways

to the re-application of submersion

technologies

Challenge:

• Implementation is OEM-driven or

requires modification of IT gear that is

substantial

• Entry cost is still far higher than air-

cooling

• ROI is too long for widespread adoption

beyond niche HPC applications

• Some technologies not ‘market ready’


‘New’ Cooling Technologies:

Technology Summary of our view

Fresh air cooling

Extremely high efficiency in some climates. Climate-

limited application due to humidity issues, and with

danger of particulate contamination to IT gear.

Indirect Air-Air heat

exchanger cooling

Very high efficiency. Can be used in almost any climate.

A general replacement for traditional cooling systems

Thermal storage (water

tanks, phase change)

Cost effective for cases with high swings in time of day

pricing or where value of demand management is high.

Increase in effectiveness of economizers will make

this a niche application

Liquid cooled IT

Becomes practical as cabinet power passes 20kW.

Suitable only for highly homogeneous IT installations.

May become even more common for HPC installations.

Cooling remains an opportunity for significant energy and

water reductions

Foundational BUSINESS OVERVIEW Rev 1


Update: Established Technologies

Technology Summary of my view

Perimeter Cooling –

CRAH/CRAC (evolving)

In use for decades, but technology languished. Now

updated through use of high efficiency EC fans, EEVs,

higher efficiency compressors and high SHR designs.

Less use of energy-hogging humidification & reheat.

InRow Cooling (evolving)

Now available in multiple forms of heat rejection. Proven

for use in mid to high density applications. New

economizer solutions. ROI of 3 years or less is common

(vs. legacy CRAC/CRAH)

Containment (adoption)

Rapid expansion in the market. A necessity where

optimized use of Economizers is desired. CACS gaining

popularity in existing Data Centers. HACS popular in

new-build, hybrid and Row-based Cooling applications.

Modular Data Centers

(acceptance)

Effective for all applications – now evolving beyond “IT

Containers”. Expect widespread use in the future.

Combinations of these approaches are how data centers

will improve in the future






Summary


Schneider Electric Cooling Portfolio

Room

•Uniflair CRAH/CRAC

• InRow Self-Contained

•Room Air Distribution

•Air Removal Units

•Rack Air Distribution

• InRow Chilled Water

• InRow DX

•Pumped Refrigerant

•Thermal Containment

•EcoBreeze

•Chillers

•Heat Rejection

http://empire.apc.com/products/moreimages.cfm?partnum=ACRD100&type=Front Left&loc=79D30B4C-5056-AE36-FE42E0BAA20EAACF_pr.jpg


Financial Comparison (made by =S=)

Data Center Sizes – 60, 120, 480, 1200 kW

Rack Density – 3, 6, 12, 20 kW per Rack (120 CFM/kW)

Raised Floor Air Distribution for Room Cooling – 100 Euro/ m2 ($8/ft2)

o Raised Floor Pricing range from 30 Euro / m2 to 400 Euro / m2($50/ft2)

o Does not consider fire suppression under floor ($4-$10/ft2)

Drop Ceiling for Room Cooling Hot Aisle Containment – 36 Euro / m2

($4/ft2)

o Based on RSMeans Cost Works Data Base – Typical Drop Ceiling

o Does not consider fire suppression in drop ceiling range ($4-$10/ft2)

Active Floor for Room Cooling with CAC and raised floor for high density (12

and 20 kW per rack)

Piping costs based on RSMeans Cost Works Data Base – Steel Piping

Cost of Energy = 0.1 Euro / kWh

EcoStream Analysis Tool used to determine airflow required for each

scenario


Cooling Product Positioning

Performance & Form Factor

o Capacity, Airflow (cfm), Efficiency, Size, Type, etc.

Financial

o First Cost

o Operating Cost

o 3 Year TCO (Operating + First Cost)

o Day one budget vs. Pay as you grow

Facility Constraints (Existing Data Centers)

o Out of Capacity

o Stranded Capacity

o Out of Space

Qualitative Criteria

o Reliability / Availability

o Flexibility

Regional considerations and tweaks are always expected


Selection Chart

>25






Summary


A Final Word –

Economizers are here to stay – and if you don’t believe it, the U.S.

government is going to make you believe it

Lots of economizer modes to choose from

o Indirect air-to-air heat exchange has distinct advantages vs. other approaches

Selecting the right solution isn’t always easy

o Understand the application

o Know your metrics and your ‘bulls-eye’

o Go beyond first cost – or you will pay the price later

o Focus on efficiency, performance, flexibility, space consumption and total

return on investment


Resources List

The Different Types of Air Conditioning Equipment for IT Environments Data Center Science Center White Paper 59

Hot-Aisle vs. Cold-Aisle Containment for Data Centers Data Center Science Center White Paper 135

Ultra High-Efficiency Cooling Modules for Large Data Centers Data Center Science Center White Paper 136

http://www.apc.com/wp?wp=130

http://www.apc.com/wp?wp=130

Questions?

To watch this presentation again and

view more G2 talks on-demand visit

graybar.com/G2archive

slides: the top 3 north america data center trends for cooling

Technology

data center segmentation

opex cooling

data center33

adata center

right cooling solution

growthcloud colohpcdata

economizer use

use economizer