© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Green Standards &data center design and operations

John PetersonPE, PMP, CEM, LEED AP BD+C

HP Critical Facilities Services

Agenda

• Data Center Green Standards

• Government Efforts– Energy Star, Dept of Energy

• Building Rating Systems– LEED

• Industry – ASHRAE, ISO

• Hallmarks of a “Green” data center

2

Data Center Green Standards

EPA ENERGY STARRatings/Certifications

LEED for Data Centers

Rating/Certification

Federal Energy Management

ProgramEO 13514-2009

Industry Consortium Industrial technologies Program e.g.,

Energy Base-liningDCEP program

EU Code of Conduct

for Data Centres

15+ codes, programs

and directives

3

90.1-2010-Appendix G2011 Environmental classes

90.4 Established

Singapore Standard for green data centres-energy and environmental monitoring

systems

© 2013 Hewlett-Packard Development Company, L.P.The information contained herein is subject to change without notice.

Key attributes of EO 13514

Leadership in Environmental, Energy, and Economic Performance

4

Builds upon past policy & regulatory framework:Energy Independence & Security Act, EO 13423, and Energy Policy Act 2005

Defined Green House Gas (GHG) Emissions (e):

•Scope 1 – direct GHG-e from sources owned or

controlled by a Federal agency.

•Scope 2 – direct GHG-e resulting from

generation of electricity, heat, or steam

purchased by a Federal agency.

•Scope 3 – GHG-e from sources not owned or

directly controlled by a Federal agency but

related to agency activities such as vendor

supply chains, delivery services, employee

travel and commuting.

Enterprise Greenhouse Gas Programs

Carbon Disclosure Project (CDP)

The Climate Registry(TCR)

Climate Action Reserve(CAR)

Global reporting Initiative

(GRI)

EPA Climate Leaders

VOLUNTARY

Regional Greenhouse Gas Initiative (RGGI)Reduce GHG by 10% from

power sector by 2018

EPA Mandatory Reporting GHG Rule (2010)

Facilities > 25000 MT GHG submit annual

report

REGULATORY

2010 California AB-32

Reduce GHG by 2020 to 1990 levels

EU Emission Trading Scheme (EU ETS)

UK Carbon reduction Commitment (UK CRC)

Reduce GHG by 80% in 2050Vs 1990

National Greenhouse and Energy Reporting

Streamlining protocol

International Regulatory & Policy Gaining Momentum

• Based on actual as-billed energy data

• Serves as a whole building indicator

• Peer group comparison of data center’s energy performance

• Mix of fuels

• ENERGY STAR label to data centers with a rating of 75 or higher (scale of 0-100)

• 39 data centers certified to date (June 2013)

ENERGY STAR certification for data centers

6

ENERGY STAR - Portfolio Manager

7

• New version coming out July 10, 2013

8 HP Confidential

ENERGY STAR rating/certification

Data Submission for Potential certification

Step-4

Initiation

4 weeks

Step-1

Rating Initiation:• Send proposal to client• Decision to apply for Energy

Star rating. • Define Energy Star rating

objectives• Define Energy Star rating

scope• Determine key client

information: name, site, location

• Determine key technical information: building area, data center area, other spaces area

• Client approval• Select certification team• Notify the team to perform

the facility survey and data collection

Rating Preparation:• Verify eligibility• Read service data sheet

and service delivery guide• Define Survey date and

duration.• Request facility Electrical

& Mechanical documents • Utility bills –current/past 12

months or next 12 months• Conduct preliminary data

analysis• Understand preliminary

elect. & mechanical subsystems

• Understand metering requirements

Execution:• Site Visit and kick-off

meeting/presentation • Educate the client about the

process & interview• Conduct initial walk-through

& ensure as-built condition • Define building total energy • Define data center total IT

loads/UPS output• Determine mechanical loads

power panels or if any is on UPS

• Determine/Verify energy metering for total building and data center

• Install energy meters in designated locations if necessary

Data submission:• Create an account in

portfolio manager• Submit all required monthly

energy data for the building and the data center

• If rating is >75%; apply for Energy Star

• Generate energy use statement

• Populate all data in the report template

• Certify, Stamp and Finalize and submit to Energy Star

• Handover portfolio manager account after training to client for future management

• If rating is <75%; implement ECMs and re-apply.

Preparation

Step-2

Execution

Step-3

6 WEEKS-1 year +

DoE On-line Profiling Tool: Data Center Pro

9

INPUTS

• Description

• Utility bill data

• System information

• IT

• Cooling

• Power

• On-site gen

OUTPUTS

•Overall picture of energy use and efficiency

•End-use breakout

•Potential areas for energy efficiency improvement

•Overall energy use reduction potential

DC Profiler Tool

To download the DC Profiler tool: http://ecenter.ee.doe.gov/EM/tools/Documents/DCPro_Downloadable_InstallInstructions.pdf10

DoE- Air Management Energy Assessment Tool

• Air management recommendations (actions)• Potential for reducing the supply airflow rate• Potential for increasing the supply air

temperature • Estimates of the % energy reduction for

supply fans and chillers

The AM-Tool is a free Excel tool for assessing the data center air-management status and providing actions and energy savings.

11

To download tool and documentation http://www1.eere.energy.gov/industry/saveenergynow/dc_pro.html

Unit Program Step

AHU Airflow cfm Step 1 AHU

AHU Supply Air Temperature F Step 1 AHUAHU Return Air Temperature F Step 1 AHU

Equipment Temperature Rise F Step 2 Equip

Equipment Airflow cfm Step 2 Equip

Number of Equipment Units - Step 2 EquipEquipment Power W Step 2 Equip

IT-Equipment Intake Temperature F Step 3 RCI

Typical Max IT-Equipment Intake Temperature

F Step 4 Main Input

Typical Min IT-Equipment Intake Temperature

F Step 4 Main Input

Recommended IT-Equipment Intake Temperature Range

F Step 4 Main Input

Allowable IT-Equipment Intake Temperature Range

F Step 4 Main Input

OUTPUTS• Provide air-

management recommendations

• Estimate the potential for reducing supply airflow rate and increasing supply air temperature

• Estimate the percentage of energy reduction for fans and chillers

DoE AM Tool-Required Inputs

12

INPUTS• Air-handler unit data

for calculating Return Temperature Index (RTI) (energy metric)

• IT-equipment data for calculating the RTI metric

• IT-equipment intake temperatures for calculating Rack Cooling Index (RCI) (equipment cooling metric)

• Main input with questions for determining energy savings and recommendations

DoE Electrical Assessment Tool

To download the tool and user manualhttp://www1.eere.energy.gov/industry/datacenters/docs/dcpro_eat.xls

Designed to help assess the potential savings from efficiency actions in the electrical power chain of a data center

INPUTS

• Basic configuration and efficiency information on electrical system components such as transformers, generators, uninterruptible power supply (UPS), power distribution unit (PDU) devices, and lighting

• Energy use of electrical systems

OUTPUTS

• Estimate potential savings for various electrical system efficiency actions.

• UPS efficiency comparison / benchmarking

• Energy efficiency metrics

13

DoE Assessment Process

14

Process StepCurrent

Tools/Resources1. Use DC Pro Profiling tool for preliminary assessment. Complete on-line survey of

profiling tool. Profiling Tool

2. Hold kickoff conference call to review goals and scope; Identify needed information and documents

Use report from Profiling tool as a discussion

prompter

3. Compile existing information from drawings, trend logs, etc. Enter available information into tools/worksheets

Assessment Tools or Worksheets

4. On-site meeting with all stakeholders: Site tour (if needed) / Overview presentation (if needed) / Review, confirm and document efficiency actions to be studied, metrics to be analyzed, and measurement plan (assign roles and responsibilities)

Assessment Tools or Worksheets

5. Conduct on-site measurements as needed to complete inputs for assessment tools.

Assessment Tools or Worksheets

6. Estimate savings for actions in each assessment area: Electrical power chain / IT equipment and software / Air Management / HVAC / On-site generation (Can be done off-site)

Assessment Tools

7. Estimate costs for each action in conjunction with site personnel (can be done off-site)

8. Compile assessment report and present to site Report Template

9. Provide report to DOE (sanitized if necessary, and if site approves) and provide feedback on overall assessment process

1w

k2w

k1w

k3w

k

14

DoE Master List of Actions

To download the master list of actions “energy conservation measures” http://www1.eere.energy.gov/manufacturing/datacenters/pdfs/data_center_actions_list.pdf

15

Building Rating SystemsSustainable Building Rating Systems Development Basis BREEAM (Building Research Establishment’s Environmental Assessment Method)

Original

BREEAM Canada BREEAM BREEAM Green Leaf BREEAM, Green Leaf™ Calabasas LEED LEED® CASBEE (Comprehensive Assessment System for Building Environmental Efficiency)

Original

CEPAS (Comprehensive Environmental Performance Assessment Scheme)

LEED®, BREEAM, HK-BEAM, IBI

Earth Advantage Commercial Buildings (Oregon) Undisclosed EkoProfile (Norway) Undisclosed ESCALE Undisclosed GBTool Original EPC for Data Centers (developed by California Energy Commission and LBNL)* GEM (Global Environmental Method) For Existing Buildings (Green Globes) –

LEED®

UK Green Globes Canada GOBAS (Green Olympic Building Assessment System) CASBEE, LEED® Green Building Rating System – Korea BREEAM, LEED®, BEPAC Green Globes Canada BREEAM Green Leaf Green Globes™ US Green Globes Canada Green Leaf Eco-Rating Program Original Green Star Australia BREEAM, LEED® HK BEAM (Hong Kong Building Environmental Assessment Method)

BREEAM

HQE (High Environmental Quality) Undisclosed

Sustainable Building Rating Systems Development Basis BREEAM (Building Research Establishment’s Environmental Assessment Method)

Original

BREEAM Canada BREEAM BREEAM Green Leaf BREEAM, Green Leaf™ Calabasas LEED LEED® CASBEE (Comprehensive Assessment System for Building Environmental Efficiency)

Original

CEPAS (Comprehensive Environmental Performance Assessment Scheme)

LEED®, BREEAM, HK-BEAM, IBI

Earth Advantage Commercial Buildings (Oregon) Undisclosed EkoProfile (Norway) Undisclosed ESCALE Undisclosed GBTool Original EPC for Data Centers (developed by California Energy Commission and LBNL)* GEM (Global Environmental Method) For Existing Buildings (Green Globes) –

LEED®

UK Green Globes Canada GOBAS (Green Olympic Building Assessment System) CASBEE, LEED® Green Building Rating System – Korea BREEAM, LEED®, BEPAC Green Globes Canada BREEAM Green Leaf Green Globes™ US Green Globes Canada Green Leaf Eco-Rating Program Original Green Star Australia BREEAM, LEED® HK BEAM (Hong Kong Building Environmental Assessment Method)

BREEAM

HQE (High Environmental Quality) Undisclosed

iDP (Integrated Design Process) Original Labs21 Original LEED® (Leadership in Energy and Environmental Design) Original LEED Canada LEED® LEED India LEED® LEED Mexico LEED® MSBG (The State of Minnesota Sustainable Building Guidelines) '98, and BREEAM

LEED®, Green Building Challenge

NABERS (National Australian Built Environment Rating System) Undisclosed PromisE Undisclosed Protocol ITACA GBTool SBAT (Sustainable Buildings Assessment Tool) Original Scottsdale's Green Building Program Undisclosed SPiRiT (Sustainable Project Rating Tool) LEED® TERI Green Rating for Integrated Habitat Assessment Original TQ Building Assessment System (Total Quality Building Assessment System)

Original

* The only rating system specifically developed for data center projects

iDP (Integrated Design Process) Original Labs21 Original LEED® (Leadership in Energy and Environmental Design) Original LEED Canada LEED® LEED India LEED® LEED Mexico LEED® MSBG (The State of Minnesota Sustainable Building Guidelines) '98, and BREEAM

LEED®, Green Building Challenge

NABERS (National Australian Built Environment Rating System) Undisclosed PromisE Undisclosed Protocol ITACA GBTool SBAT (Sustainable Buildings Assessment Tool) Original Scottsdale's Green Building Program Undisclosed SPiRiT (Sustainable Project Rating Tool) LEED® TERI Green Rating for Integrated Habitat Assessment Original TQ Building Assessment System (Total Quality Building Assessment System)

Original

* The only rating system specifically developed for data center projects

Most common rating systems are LEED, BREEAM and Green Globes

16

U.S. GBC LEED Introduction

17

• Leadership in Energy and Environmental Design (LEED) - recognized as the most prominent third-party green building certification system in the US and derivations are widely used abroad.

• LEED basics:• concise framework for measurable green building performance,

including: energy savings, water efficiency, construction methods, building materials, and more.

• can be applied to any building type, from residential homes to office buildings to hospitals to data centers.

• 4 levels of certification: Certified, Silver, Gold and Platinum.• The latest release, Version 3, was released on April 27, 2009. • Future versions are consensus based, transparent, ongoing

development cycle.• LEED certification leads to:

• Lower operating costs Increased asset value Reduce landfill waste• Conserve energy and water Healthier and safer environments for

occupants• Reduce harmful greenhouse gas emissions• Qualify for tax rebates, zoning allowances and other incentives in hundreds

of cities.• Demonstrates a commitment by the owner toward a more efficient,

environmentally-friendly future.

LEED Adaptations for Data Centers

New Construction Energy and Atmosphere •EA prerequisite 1: Fundamental Commissioning of Building Energy Systems (NC) •EA prerequisite 2: Minimum Energy Performance (NC) •EA credit 1: Optimize Energy Performance (NC) •EA credit 3: Enhanced Commissioning (NC) •EA credit 5: Measurement and Verification (NC)

Existing Buildings Energy and Atmosphere •EA prerequisite 1: Energy Efficiency Best Management Practices – Planning, Documentation and Opportunity Assessment (EB) •EA credit 2.1: Existing Building Commissioning – Investigation and Analysis (EB) •EA credit 3.1: Performance Measurement – Building Automation System (EB)

 

New Construction Water Efficiency (NEW CREDIT)•EA credit #: Cooling Tower Water Management (NC)

18

Final Modified / Added Credits

Certified: 40 – 49 ptsSilver: 50 – 59 ptsGold: 60 – 79 ptsPlatinum: 80+ ptsTotal Possible Points=110

LEED Changes – 2013

23 credits have substantive changes upcoming

19

Version 4

LEED Changes – 2013

Energy performance: Determine PUE5% improvement in design; 2% of the 5% is to be from infrastructureASHRAE 90.1-2010

20

Version 4

PUE Usage and public reporting guidelines

Guidance on topics:•Data Collection and Metrics Calculations

•Reporting Result Timescale and Data Collection Details

•Reporting Results to The Green Grid

•Common Issues with Reporting or Interpreting PUE

• Infrastructure vs. IT

• Power vs. Energy

• “Better-than-Perfect” PUE Measurements

• Comparing Results Calculated over Different Timeframes at Different Granularity Levels

• Comparing PUE Results Between Data Centers21

22

Plus CUE, WUE, ERE, ERF….and Data Center Maturity Model “DCMM”

PUE (Power Usage Effectiveness)

Emergency generator

Utility transformer

PUETotal data center energy from all fuels

(kWh)Total IT energy (kWh)

Total data center energy

House energy

=

Data center

Main service

PP-Gen service

Lighting panel

Generator block Heaters

& lighting

Lighting, Exit

lights, BMS,

EPMS & security

House panels

UPS

STS

PDUs

RPPs

Mech. Swgear

Data centerCRAC units,

AHUs, Chillers &

Dry coolers

Fuel

Misc. support Mech. supportPow

er

To

IT

IT-critical load

District chilled water

District steam

Natural gas

CO2

NOx

Total Direct Water Consumption

Fuel

ERF

ERE

Total data center energy

Total data center energy

CUE

WUE

23

ENERGY STAR Rating Vs. PUE

≤ 1.5

Monitoring/Measurement Requirements

• 1–49: Low cost operational changes + improving IT efficiency + lowering the heat load +reductions to the cooling load

• 50–74: Simple, low-cost changes + equipment upgrades

• 75–100: ENERGY STAR certification

•100,000 square foot, tier 4 data center

•10 MW IT load

• LEED Silver

•Detailed energy modeling

•Base case and proposed energy end uses (demand and annual)

LEED Example: Global Bank – New Data Center

25

LEED Example: Global Bank continuedPage 6

Performance Rating TableBaseline Building Energy Summary by End Use

Energy Peak Energy Peak Energy

KWHx000,000 kW x000 106 Btu 106 Btuh 106 Btu 106 Btuh %Interior Lighting Electricity 0.78 1.38 2662.14 4.71 2% 4163.86 8.16 2% 36.07%Interior Lighting (Process) Electricity 0 0 0.00 0.00 0% 0.00 0.00 0% 0.00%Exterior Lighting Electricity 0.08 0.04 273.04 0.14 0% 477.82 0.00 0% 42.86%Space Heating (fuel 1) Natural Gas 0 0 0.00 0.00 0% 0.00 0.00 0% 0.00%Space Heating (fuel 2) Electricity 2.13 1.55 7269.69 5.29 2% 6757.74 5.87 2% -7.58%Space Cooling Electricity 10.26 13.73 35017.38 46.85 20% 102253.48 203.01 60% 65.75%Pumps Electricity 8.36 37.67 28532.68 128.53 55% 443.69 0.00 0% -6330.77%Heat Rejection Electricity 0 0 0.00 0.00 0% 0.00 0.00 0% 0.00%Fans - Interior Electricity 7.82 10.96 26689.66 37.40 16% 79147.47 108.50 32% 66.28%Fans - Parking Garage Electricity 0 0 0.00 0.00 0% 0.00 0.00 0% 0.00%Service Water Heating (fuel 1) Natural Gas 0 0 0.00 0.00 0% 0.00 0.00 0% 0.00%Service Water Heating (fuel 2) Electricity 2.37 3.25 8088.81 11.09 5% 8088.81 11.06 3% 0.00%Receptacle Equipment Electricity 0 0 0.00 0.00 0% 0.00 0.00 0% 0.00%Refrigeration (food, etc.) Electricity 0 0 0.00 0.00 0% 0.00 0.00 0% 0.00%Cooking (commercial, fuel 1) Electricity 0 0 0.00 0.00 0% 0.00 0.00 0% 0.00%Cooking (commercial, fuel 2) Electricity 0 0 0.00 0.00 0% 0.00 0.00 0% 0.00%Elevators and Escalators Electricity 0 0 0.00 0.00 0% 0.00 0.00 0% 0.00%

31.8 68.58 108533.4 233.99496 100% 201332.87 336.59006 100% 46.09%Note: Energy Consumption is listed in units ofsite energy106 Btu = kWh x 3.413 x 1000 103 Btu = therms / 100

Performance Rating Method Compliance Report

Total Building Consumption

Baseline BuildingProposed Building

Energy Type

Pro

cess

End Use

• 46% reduction in annual energy use for infrastructure systems (as compared to ashrae energy standard 90.1)

• 41% annual water savings (as compared to the Energy Policy Act of 1992 )

• Improved ventilation rates by 32% (compared to ASHRAE Std. 62.1)

ASHRAE Standard 90.1: Compliance options

Energy code compliance options• Prescriptive option• Trade-off option• Energy cost budget

Most compliant options are Trade-off option

Select approved addenda• Demand control ventilation requirements• Fan power limitations• Alternative compliance path for water-cooled

chillers with VFD/efficient part load performance

28 addenda identified as energy-related

Mandatory Provisions• Minimum HVAC equipment efficiency• Load calculations• Controls• Construction & insulation

Overall impact: higher efficiencies, thermal performance, and documentation

30% Energy progress• 6 prototypes in 17 climate zones, based on 2004• More prototypes to be examined• Envelope R-values increase

Results are preliminary

26 HP Confidential

ASHRAE Standard 90.1: Appendix G ImpactsClarifying existing items• Ventilation cfm of proposed = baseline

• Exception – EQc2 increased ventilation doesn’t change baseline

• Purchased CHW now covered

Summary: Eliminating confusion for calcs

Data Center economizer exceptions• 3 MMBtuh with or without central plant• 0.6 MMBtuh or less being added to existing

building• 0.6 MMBtuh or less with central plant• Local authority prohibits cooling towers

Summary: Only small data centers meet exemption criteria

Water-side items• VFD required on pump motors >10 HP• Maximum flows per pipe sizes• Heat exchanger test procedure• Pump head calcs required

Summary: More stringent requirements to increase efficiency

Air-side items• Exhaust air energy recover exception:

flammable • Two new baseline systems 10 & 11• Supply resets• Demand control ventilation

Summary: Greater efficiency on most air systems

27

28 HP Confidential

TC 9.09 recommendations at computer equipment air intakes

ASHRAE: Indoor Temperature and Moisture Levels

MAXIMUM80°F dry-bulb67°F wet-bulb60°F dew point

MAXIMUM80°F dry-bulb67°F wet-bulb60°F dew point

MINIMUM65°F dry-bulb53°F wet-bulb43°F dew point

MINIMUM65°F dry-bulb53°F wet-bulb43°F dew point

Alternate Description Dry Bulb (°F)Relative

Humidity (%)Wet Bulb (°F) Dew Point (°F)

Chilled Water

Supply Temp

Condenser

Water

Supply Temp

(for WSE)

Maximum

Outdoor Wet

Bulb Temp (for

WSE)

70F SA Conditions - Low Humidity 70.0 37.6 54.9 43.0

70F SA Conditions - High Humidity 70.0 58.9 60.6 55.0

72F SA Conditions - Low Humidity 72.0 35.1 55.7 43.0

72F SA Conditions - High Humidity 72.0 61.4 63.0 58.0

75F SA Conditions - Low Humidity 75.0 31.8 56.9 43.0

75F SA Conditions - High Humidity 75.0 59.6 65.1 60.0

80F SA Conditions - Low Humidity 80.0 26.9 58.8 43.0

80F SA Conditions - High Humidity 80.0 50.5 66.7 60.0

#1

#2

#3

#4

58.0

60.0

63.0

68.0

56.0

58.0

61.0

66.0

42.0

44.0

47.0

52.0

Alternate Description Dry Bulb (°F)Relative

Humidity (%)Wet Bulb (°F) Dew Point (°F)

Chilled Water

Supply Temp

Condenser

Water

Supply Temp

(for WSE)

Maximum

Outdoor Wet

Bulb Temp (for

WSE)

70F SA Conditions - Low Humidity 70.0 37.6 54.9 43.0

70F SA Conditions - High Humidity 70.0 58.9 60.6 55.0

72F SA Conditions - Low Humidity 72.0 35.1 55.7 43.0

72F SA Conditions - High Humidity 72.0 61.4 63.0 58.0

75F SA Conditions - Low Humidity 75.0 31.8 56.9 43.0

75F SA Conditions - High Humidity 75.0 59.6 65.1 60.0

80F SA Conditions - Low Humidity 80.0 26.9 58.8 43.0

80F SA Conditions - High Humidity 80.0 50.5 66.7 60.0

#1

#2

#3

#4

58.0

60.0

63.0

68.0

56.0

58.0

61.0

66.0

42.0

44.0

47.0

52.0

50001 – Energy Management System

• Designed to be used independently, yet can be aligned or integrated with other management systems (e.g., ISO 9001) and environmental (ISO 14001). Applicable to all organizations.

• Requires an organization to establish, implement, maintain, and improve an energy management system, enabling systematic achievement of continual improvement in energy performance, energy efficiency, and energy conservation.

• Imposes requirements on energy supply and consumption:− Measurement

− Documentation and reporting

− Design and procurement practices for energy-using equipment and systems

− Processes and personnel

• Applies to all factors that can be monitored and influenced by the organization to affect energy use.

• Does not prescribe specific performance criteria with respect to energy.

International Organization for Standardization ISO

29 HP Confidential

Hallmarks of a “Green” data center• Standards/Metrics for whole building performance• Demand for high temperature server operation will continue,

changing the way data centers are designed• Advances in using outdoor air for cooling will dramatically reduce

energy use • Based on industry design criteria and best practices, Climate and

geography leveraged to minimize GHG emissions• Facility responds to site constraints and advantages• Designed using rigorous whole-building energy modeling• Optimization of energy and water use• Life cycle approach used in decision making• Thorough and transparent reporting of energy use – Energy &

Sustainability Management (ESM)

30