dc2013_day1-03-jack-mcardle-efficiency-in-the-datacentre_opt by saad alshammari

Efficiency in the Data Centre Jack McArdle Managing Director Kirlaur Ltd

Introduction • Jack McArdle • Kirlaur Ltd – Independent Data Centre Consultancy – Design and Build Management – Efficiency Engineering – ROI Engineering – UPS Management – SMART Metering – Data Center Project Management

• Partnerships • Levant UPS Ltd – UPS Design and Maintenance

• Trendpoint Inc – European Distributor – SMART Metering

• Clients – – – –

Axcess Financial Ltd Gamma Telecom Ltd ScoLocate Scotland Online

Some Statistics • •

If all the Data Centres in the world were a country they would rank somewhere between Spain and Italy in power consumption (DCD Intelligence 2013) Approximately 38Gw of power used by Data Centers worldwide –

63% increase in the last 12 months (Data Centre Dynamics)

Efficiency What actually is Efficiency? Will it save money? Yes it will help reduce Operating Costs! Will it save the planet? It wonâ&#x20AC;&#x2122;t do any harm! Will it save resources? It will help! Is it working smarter? Best practice always helps! Good discipline in the industry

It is all of these things! How do you quantify it? Jack McArdle ÂŠ2013

Metrics If you don’t know what the Data Center is doing you can’t make value decisions for change! There are many metrics available for Data Center reporting. The trick is to find the one that suits you, that you will continually manage and report on, and is not too onerous to carry out. • • • • • •

PUE/DCiE: Power Usage Effectiveness/Data Centre Infrastructure Efficiency pPUE : partial Usage Effectiveness WUE: Water Usage Effectiveness DCcE: Data Center Compute Efficiency ERE: Energy Re-Use Efficiency CUE: Carbon Usage Efficiency

PUE, DCiE and pPUE • Developed by The Green Grid and has received a lot of attention. • “The Green Grid notes that many published PUE or DCiE numbers are not measurements but are estimated by engineers for hypothetical conditions, such as for Data Centers under construction, or for IT loads other than the actual IT load” • Now a ‘marketing term’ • Typically addresses the facilities side of the equation. • Is a continual process, not a goal. • There is an assumption that ‘lower PUE’s are better’. Jack McArdle ©2013

Metrics PUE

DCiE

PUE is defined as the ratio DCiE is defined as the reciprocal of of Total Facility Energy to PUE x100 (expressed as a IT Equipment Energy percentage) PUE = Total Facility Energy IT Equipment Energy

DCiE = IT Equipment Energy Total Facility Energy x 100

800kW

500 800 X 100 = DCiE = 62.5%

500Kw

Jack McArdle ÂŠ2013

= PUE =1.6

Power Consumption with PUE = 1.6

5 kW 15 kW

1MVA

240 kW

Ventilation – Fresh Air

Lighting & small power

Cooling fans, pumps & compressors

IT 500 kW

35 kW

IT terminal load Distribution & conversion losses

3 kW Security, BMS 2 kW Communications

Total 800 kW

Three Tier Approach to PUE Level 1 (L1) Basic

Level 2 (L2) Intermediate

Level 3 (L3) Advanced

IT Equipment Energy

UPS Outputs

PDU Outputs

IT Equipment Input

Total Facility energy

Utility Inputs

Measurement interval

Monthly/Weekly

Daily/Hourly

Continuous <15 minutes

Jack McArdle ÂŠ2013

PUE Levels (Green Grid) Level 1 Basic

Level 2 Intermediate

The IT load is measured at the output of the UPS equipment and can be read from the UPS front panel, through a meter on the UPS output, or, in cases of multiple UPS modules, through a single meter on the common UPS output bus. The incoming energy is measured from the utility service entrance that feeds all of the electrical and mechanical equipment used to power, cool, and condition the data center

The IT load is measured at the output of the PDUs and can b typically be read from the PDU front panel or through a meter on the secondary of the PDU transformer. Individual branch circuit measurement is also acceptable for Level 2. Intermediate monitoring requires, at a minimum, the collection of power measurements once a day.

Level 3 Advanced The IT load is measured at each individual piece of IT equipment within the data center, either by metered rack PDUs (i.e., plug strips) that monitor at the strip or receptacle level or by the IT device itself. Note that non-IT loads must be excluded from these measurements. Advanced monitoring requires, at a minimum, the collection of power measurements once every 15 minutes or less; for energy measurements, that frequency is recommended. Level 3 measurements should not require human activity to gather and record data. Jack McArdle ÂŠ2013

Efficiency Planning Initial Steps Ghost Servers

–Switch them off

HVAC

–Set-Points!!

•1degC saves 3 – 4%

Air-Flow

–Clear and Free

Filters

–Keep them Clean

Monitor

–Temperatures –Humidity

Next Steps Metering What Where When Data Collecting Reporting Plan of Action Carry it Out Review improvements Quantify Savings Speculate

Speculate to Accumulate Install Metering Branch Metering in PDUâ&#x20AC;&#x2122;s Automatic Collection of data

Install Vari-Control Fans Consider Adiabatic Cooling PiR Controlled Lighting Containment Systems

Jack McArdle ÂŠ2013

Containment Systems Hot Aisle Containment •Works well in racks with <5kW density •Captures hot-air from the back of racks and returns to CRAC unit, or extract •Uses plenum as Cold Air intake •Requires blanking plate management

Cold Aisle Containment •Works well in racks with >5KW •Focuses cold air to front of rack. •Data Centre surrounds become hot •Requires blanking plate management

Containment Systems Do Pick the right system Perimeter Cooling Raised Floor Cold Aisle CRAC/In Rack Hot Aisle Use Blanking Plates Monitor Temperatures

Donâ&#x20AC;&#x2122;t Leave doors open Leave floor tiles up Mount kit the wrong way Remove blanking plates

Be Aware Fire Suppression Working in area Visitors

Achieving a Low PUE Cooling efficiency • Site selection, latitude and local climate (water-usage a limiting factor?) • Rigorous air-management in the room (limited by delta=T?) • High server inlet temperature (avoiding fan ramp-up, 27°C) • Minimum humidification and de-hum (if any?) • Free-cooling coils for when the external ambient is cool • If possible avoid compressor operation altogether Power efficiency • Avoid high levels of redundancy and low partial loads in general • Design redundancy to always run at >60% load • Adopt high-efficiency transformer-less UPS where efficiency is c96% at • 60% load • Adopt eco-mode UPS where efficiency is 99% for >95% of the year • Apply high efficiency lighting • Best practice gets us to a PUE of 1.2

Lower PUE is good, isn’t it? On Average a typical DC has a PUE of2.0 High range > 2.75 Low range < 1.5 Q: What happens to PUE if we raise the temperature?

A: Cooling load goes down R: PUE goes down

Q: What happens to PUE if we shut 10% of servers that are deemed ghost servers? A: IT load goes down R:: PUE goes up Q: What happens if we also throttle the cooling to meet the new lower IT loads? A: IT load goes down, Cooling load goes down, R: PUE could remain the same

PUE is useful but may not be the ‘end all’. Ultimately you want to minimize waste and save money

PUE Varies by Month, and Load PUE by Month and Load 12.00 11.00 10.00

100%

9.00

90%

8.00

80%

7.00

70%

6.00

60%

5.00

50%

40%

4.00

30%

3.00

20%

2.00

10%

1.00 Jan

Jack McArdle ÂŠ2013

Feb

Mar

Apr

May

Jun

Jul

Aug

Sep

Oct

Nov

Dec

Can Data Centers be ‘Sustainable’, or Green? Not on their own! •Data Centers are the factories of the digital revolution •They convert power into digital services •Impossible to quantify efficiency as there is no ‘work done’ •Energy is treated as waste, and usually dumped into the environment

They won’t be green unless: •The load is a low-carbon solution •Energy consumption is minimised by best of breed hardware •PUE is reduced to the minimum •Power is sourced from 100% renewable sources •Waste heat is re-used extensively

Efficiency Planning

Monitor

Improve

• Investigate

Record

• Speculate

Monitor

Change

• Plan

Monitor

Record

Review

Change • Savings

Thank You Questions?