TCO Scoring Model for Effective Data Center Solutions Presented by Ron Budicky and Debra Vieira
Team BIOs
Debra Vieira has more than 20 years of experience in design of electrical systems for data centers and industrial facilities. As a data center specialist, she has developed recommendations for innovative data center upgrades and improvements and leveraged those innovations facility-wide through her active involvement in the planning, design and commissioning activities required for implementation of advanced mechanical and electrical infrastructures around the world. Ronald Budicky has 28 years of experience in electrical engineering. He has served as a lead electrical engineer on many mission critical advanced technology facilities including data centers considered among the most advanced in the world. His vast knowledge of facility optimization is the product of his extensive experience in all aspects of facility design including programming, concept development, schematic design, design development, and construction documents.
CH2M HILL/IDC Architects Confidential and Proprietary
2
AGENDA
• Key factors that impact the TCO Scoring Model • Review of TCO Scoring Model Process • TCO Scoring Form • Conclusion • Questions
CH2M HILL/IDC Architects Confidential and Proprietary
3
TCO Overview and Key Factors
What is the TCO Scoring Model
SCALABLE
Significant number of decisions Many times analysis is based on cost alone, ignoring other important subjective factors, which all too often can lead to a facility that does not perform as expected.
CH2M HILL/IDC Architects Confidential and Proprietary
TECHNOLOGY
MODULAR
TOPOLOGY COST
TIER? NEXT STEP
5
TCO Scoring Model Factors
Construction Costs: ~Tier 3 – M$/MW IT
Establishing overall cost is the first and most basic component of the model development.
M$ / MW IT (USD)
25.0
20.0
15.0
10.0
5.0
0.0 0
5
10
15
MW IT Capacity
CH2M HILL/IDC Architects Confidential and Proprietary
6
What is the TCO Scoring Model
What is your decision process? – Install Cost – Energy Usage – Reliability – Scalability – Total Cost of Ownership This is an incomplete decision-making approach. There is a need for a more rigorous analysis of the many design and operational component options than a simple TCO model can provide.
CH2M HILL/IDC Architects Confidential and Proprietary
7
Additional Components of TCO Analysis
What about: – Simplicity of Scalability – Construction Impacts & Lead Times – Flexibility for future technologies & increased densities – Sustainability beyond energy – Vendor support through the life cycle of the facility or product We will evaluate these decisions within a collaborative, constructive, inclusive and interactive framework that clients often find quite effective.
CH2M HILL/IDC Architects Confidential and Proprietary
8
What is the TCO Scoring Model
The TCO scoring model is a tool that allows you to take into account all parts of a design to give you a probable cost of construction to enable clients to make a decision on how to move forward. This includes capital and operating costs of systems selected.
CH2M HILL/IDC Architects Confidential and Proprietary
9
Factors Considered in the TCO Scoring Model Facility’s Unique Functional Technology and Enhancing Reliability
– Scale (MW/Cost) – Electrical Topology Choices (Complexity vs. Cost) – Flexibility and Expandability – Cooling Approaches – Location (Construction Labor, Land Cost) – Buyout Approaches (GC@Risk, Cost) •
Equipment & Contractors
•
Cost + Open Book
– Technology Choices – Eliminate Single Points of Failure – Fail Small Approach – Commissioning
CH2M HILL/IDC Architects Confidential and Proprietary
10
Factors Considered in the TCO Scoring Model Rapid Prototyping
CH2M HILL/IDC Architects Confidential and Proprietary
11
Factors Considered in the TCO Scoring Model Rapid Prototyping
CH2M HILL/IDC Architects Confidential and Proprietary
12
PUE Approach for TCO Scoring Model 1.7
1.6
PUE (Approximate)
1.5
1.4
1.3
1.2
1.1
1 DX
Chiller (no econ)
CH2M HILL/IDC Architects Confidential and Proprietary
Waterside
Indirect Airside
Direct Airside
plus HE Elec
plus Elevated Temps
plus chillerless
13
TCO Analysis
SL-01 2N SINGLE LINE Utility A
Utility B
2N Key: Green-Phase 1 Gray-Phase 2 LB
1.1 MW N
UPS
STS
1 .1MW N
UPS
LB
1.1 MW N
Mech Loads STS
Mech Loads
UPS
1.1 MW N
STS
UPS
STS
UPS LB
LB
FA/LSS/SEC
v PDU PDU
CH2M HILL/IDC Architects Confidential and Proprietary
PDU PDU
PDU
v PDU
PDU
PDU
PDU PDU
15
SL-02 N+1 SINGLE LINE Utility A
Utility B
N+1 Key: Green-Phase 1 Gray-Phase 2
Mech Loads
1.1 MW Typical UPS UPS UPS N N N+1
STS
Mech Loads
STS
STS
STS
PDU
PDU
PDU
PDU
PDU
PDU
PDU
PDU
PDU
PDU
PDU
PDU
PDU
PDU
PDU
PDU
CH2M HILL/IDC Architects Confidential and Proprietary
STS
16
SL-03 ISO/STS SINGLE LINE Utility A
Utility B
ISO Key: Green-Phase 1 Gray-Phase 2
To B Side STS/PDU Mech Loads
1.1 MW N
UPS
STS
1.1 MW N+1
To A Side STS/PDU UPS
STS
1.1 MW N
UPS
STS
UPS
Mech Loads
FA/LSS/SEC
To “B” Bus
To “B” Bus
STS
STS
PDU
PDU
CH2M HILL/IDC Architects Confidential and Proprietary
To Phase 3 UPS STS
To ”A” Bus
To “A” Bus
STS
STS
PDU
PDU
17
UPS Technology Efficiency Comparison
CH2M HILL/IDC Architects Confidential and Proprietary
18
UPS TCO Scoring Factors
Load
Part Load (1100 kW)
Normal Mode Efficiency (1100 kW)
Energy Cost
UPS Maintenance
Battery maintenance (1100 kW)
Total (1100 kW)
1
257
23%
89.5%
0.076
$2,500
$11,000
$13,500
2
679
62%
92.1%
0.079
$2,575.00
$11,330.00
$13,905
3
834
76%
92.1%
0.081
$2,652.25
$11,669.90
$14,322
4
920
84%
91.9%
0.083
$2,731.82
$12,020.00
$14,752
5
1007
92%
91.7%
0.086
$2,813.77
$12,380.60
$15,194
6
1104
50%
91.9%
0.088
$2,898.19
$12,752.01
$15,650
7
1216
55%
92.0%
0.091
$2,985.13
$13,134.58
$16,120
8
1350
61%
92.1%
0.094
$3,074.68
$13,528.61
$16,603
9
1517
69%
92.1%
0.097
$3,166.93
$13,934.47
$17,101
10
1735
79%
92.0%
0.099
$3,261.93
$14,352.51
$17,614
11
2027
92%
91.7%
0.102
$3,359.79
$14,783.08
$18,143
12
2171
99%
91.5%
0.106
$3,460.58
$15,226.57
$18,687
13
2371
72%
92.1%
0.109
$3,564.40
$15,683.37
$19,248
14
2572
78%
92.0%
0.112
$3,671.33
$16,153.87
$19,825
15
2772
84%
91.9%
0.115
$3,781.47
$16,638.49
$20,420
Year 0
Notes: 2014 Energy Rate: $0.074/kW-hr Total load extended linearly past year 11
CH2M HILL/IDC Architects Confidential and Proprietary
19
Summary of Electrical UPS Power Options
Breakdown
SL-01
SL-02
SL-03
Tier 4
Tier 3
Tier 3
0.8HRS/YR (99.99%)
1.6HRS/YR (99.98%)
1.6HRS/YR (99.98%)
2N UPS
N+1 (SCC)
ISO RED /STS
(M$)
(M$/MW)
(M$)
(M$/MW)
(M$)
(M$/MW)
1 MW IT
3.0
3.0
3.4
3.4
3.3
3.3
2 MW IT
5.2
2.6
4.7
2.4
4.7
2.4
4 MW IT
10.4
2.6
9.4
2.4
9.4
2.4
Note: Costs are based on use of 20 year VRLA at 15 min EOL Note: Costs are based on system from Substation level down to panel/PDU for distribution Note: Tiers and reliability numbers above (unplanned failures-downtime/yr. & % availability) are based on Uptime Institute
CH2M HILL/IDC Architects Confidential and Proprietary
20
UPS Options – Initial Capital Outlay UPS Options - Initial Capital Outlay 10.0
9.0
8.0
M$
7.0 2N UPS 6.0
N+1 (SCC) ISO RED /STS
5.0
4.0
3.0
2.0 1 MW IT
CH2M HILL/IDC Architects Confidential and Proprietary
2 MW IT
4 MW IT
21
Energy & Cost Analysis by UPS/Battery Option (1100 kW) Given: 2 MW Critical Load @ Full Build Out @15 Min VRLA @20 years 1100 kW Modules Load Quantity kW (ea.) IT Load 1 257 1 Normal Mode Efficiency (1100 kW) 1 27 UPS Subtotal IT Load 1 679 2 Normal Mode Efficiency (1100 kW) 1 54 UPS Subtotal IT Load 1 834 3 Normal Mode Efficiency (1100 kW) 1 66 UPS Subtotal IT Load 1 920 4 Normal Mode Efficiency (1100 kW) 1 75 UPS Subtotal 12
13
14
15
IT Load Normal Mode Efficiency (1100 kW) UPS Subtotal IT Load Normal Mode Efficiency (1100 kW) UPS Subtotal IT Load Normal Mode Efficiency (1100 kW) UPS Subtotal IT Load Normal Mode Efficiency (1100 kW) UPS Subtotal
CH2M HILL/IDC Architects Confidential and Proprietary
Total 257 27
Running Hours Full 8,760 8,760
679 54
8,760 8,760
834 66
8,760 8,760
920 75
8,760 8,760
1 1
2,171 184
2,171 184
8,760 8,760
1 1
2,371 187
2,371 187
8,760 8,760
1 1
2,572 206
2,572 206
8,760 8,760
1 1
2,772 225
2,772 225
8,760 8,760
Annual Energy Cost $171,759 $18,035 $189,793 $467,041 $36,896 $503,937 $590,879 $46,679 $637,559 $671,510 $54,392 $725,902
Peak Energy $171,759 $18,035 $189,793 $467,041 $36,896 $503,937 $590,879 $46,679 $637,559 $671,510 $54,392 $725,902
$2,006,108 $170,519 $2,176,627 $2,257,198 $178,319 $2,435,516 $2,521,547 $201,724 $2,723,271 $2,799,727 $226,778 $3,026,504
$2,006,108 $170,519 $2,176,627 $2,257,198 $178,319 $2,435,516 $2,521,547 $201,724 $2,723,271 $2,799,727 $226,778 $3,026,504 22
Battery TCO Scoring Factors
Assumptions: 1. Prices below are based on single 1100kW UPS module. 2. Building Cost per sqft: $ 150.00 3. Inflation rate for annual maintenance: 3% 4. Annual discount rate: 5.0% 5. Additional costs for 10 yr VRLA technology include battery monitoring (factory wired). 6. Additional costs for 20 yr VRLA technology include battery monitoring field wired. No rack or cabinet for "stackable" jars. 7. Additional costs for Wet cell technology include disconnect, and spill containment (at $150/SF of rack footprint per vendor quote). 8. Install costs for 20 yr VRLA and 20 yr. Wet cell = 20% of battery cost+additional cost, 10 yr VRLA install costs = 15% due to cabinet vs. rack and factory installed battery monitoring. Budgetary information from vendors Battery Type Time VRLA 10yr 10 min. VRLA 10yr 15 min. VRLA 10yr 20 min.
Full Name 10 min. VRLA 10yr 15 min. VRLA 10yr 20 min. VRLA 10yr
# cabinets Rack/Cabinet Rack/Cabinet or racks Cost Area (FT²) 60.4 $0 4 90.7 $0 6 90.7 $0 6
VRLA 20yr VRLA 20yr VRLA 20yr
10 min. 15 min. 20 min.
10 min. VRLA 20yr 15 min. VRLA 20yr 20 min. VRLA 20yr
4 5 6
60.4
Wet Cell Wet Cell Wet Cell
10 min. 15 min. 20 min.
10 min. Wet Cell 15 min. Wet Cell 20 min. Wet Cell
5 5 5
202.5
CH2M HILL/IDC Architects Confidential and Proprietary
75.6 90.7
202.5 202.5
Room Area
Building Cost
384 576 768
$0 $0 $0
480
$15,000 $30,000 $30,000
600
720 960
900 1200
$57,600 $86,400 $115,200
Install Cost $27,000 $31,500 $41,400
Additional Cost $35,000 $50,000 $70,000
Total Install $119,600 $167,900 $226,600
$72,000 $108,000 $144,000
$64,200 $71,000 $97,420
$70,000 $70,000 $70,000
$90,000 $135,000 $180,000
$37,400 $43,000 $50,000
$163,875 $163,875 $163,875
Quote $180,000 $210,000 $276,000
Replacement Cost $108,000 $126,000 $165,600
Replacement Time 3-5 years 3-5 years 3-5 years
$206,200 $249,000 $311,420
$321,000 $355,000 $487,100
$192,600 $213,000 $292,260
12-15 years 12-15 years 12-15 years
$ $ $
$291,275 $341,875 $393,875
$187,000 $215,000 $250,000
$112,200 $129,000 $150,000
12-15 years 12-15 years 12-15 years
$ $ $
Number of Strings 5 6 8
Initial Annual $ 17,550.00 $ 21,060.00 $ 28,080.00
5,500.00 5,500.00 5,500.00
2 2 2
$ 11,000.00 $ 11,000.00 $ 11,000.00
8,500.00 8,500.00 8,500.00
1 1 2
$ 8,500.00 $ 8,500.00 $ 17,000.00
PM Service per string $ 3,510.00 $ 3,510.00 $ 3,510.00
23
Maintenance Cost Analysis by Option
UPS
Install Cost
Battery Cost
Number of Units
Battery Replacement
2N UPS
$5,200,000
$355,000
4
$852,000
N+1 (SCC)
$4,700,000
$355,000
3
$639,000
ISO RED/STS
$4,700,000
$355,000
3
$639,000
CH2M HILL/IDC Architects Confidential and Proprietary
24
Battery Options (Pros & Cons) Pros
Cons
Less Maintenance
Shorter Life, 3-5 Yr. Replacement
Less Gassing
10 Year Design Life
Safer to handle, electrolytes are contained, do not corrode.
Fails Open
No Spill Containment Needed
Less Heat Tolerant
Less Space Required
Battery Monitoring System
Lowest First Cost
Thermal Runaway
10 yr. VRLA
Higher Power Density Less Maintenance
Fails Open
Less Gassing
Less Heat Tolerant
Safer to handle, electrolytes are contained, do not corrode.
Higher First Cost
No Spill Containment Needed
Battery Monitoring System
Less Space Required
Thermal Runaway
20 yr. VRLA
Longer Life, 12 to 15 Yr. Replacement Higher Power Density
Wet Cells
Longer Life, 12 to 15 Yr. Replacement
Requires H2 gas monitoring and ventilation to exhaust H2 gas emitted during charge
Warning Before Failure
Higher Maintenance Required
Middle Cost
More hazardous to handle due to acid electrolyte
More Heat Tolerant
Spill Containment Required
No Battery Monitoring Required
More Space Required Lower Power Density
CH2M HILL/IDC Architects Confidential and Proprietary
25
Battery TCO @ 1100kW Inflation: 3% Annual Discount Rate: 5.0%
15 min. Wet Cell YEA R
DESCRIPTION Annual Discount Rate
CH2M HILL/IDC Architects Confidential and Proprietary
Cost
Running Total
5.0%
Initial cost of investment
$215,000
$215,000
Racks
$30,000
$245,000
0
Total Install Cost
$341,875
$586,875
1
Annual Maintenance - yr. 1
$8,500
$594,970
2
Annual Maintenance - yr. 2
$8,755
$602,911
3
Annual Maintenance - yr. 3
$9,018
$610,701
4
Annual Maintenance - yr. 4
$9,288
$618,342
5
Annual Maintenance - yr. 5
$9,567
$625,838
6
Annual Maintenance - yr. 6
$9,854
$633,191
7
Annual Maintenance - yr. 7
$10,149
$640,404
8
Annual Maintenance - yr. 8
$10,454
$647,480
9
Annual Maintenance - yr. 9
$10,768
$654,421
10
Annual Maintenance - yr. 10
$11,091
$661,230
11
Annual Maintenance - yr. 11
$11,423
$667,909
12
Annual Maintenance - yr. 12 plus Total String Replacement cost
$140,766
$746,292
13
Annual Maintenance - yr. 13
$12,119
$752,719
14
Annual Maintenance - yr. 14
$12,483
15
Annual Maintenance - yr. 15
$12,857
15 min. Wet Cell
$765,208
$759,024
15 min. VRLA 20
$860,431
$765,208
15 min. VRLA 10
$900,876
26
Battery 15 Year Total Cost of Ownership - 1100kW
Battery 15 Year Total Cost of Ownership - 1100kW $1,000,000 15 min. Wet Cell
$900,000
15 min. VRLA 10yr
$800,000
15 min. VRLA 20yr
$700,000 $600,000 $500,000 $400,000 $300,000 $200,000 $100,000 $0 0
1
2
CH2M HILL/IDC Architects Confidential and Proprietary
3
4
5
6
7
8
9
10
11
12
13
14
15
27
Total Cost of Ownership (TCO) Analysis by UPS/Battery Option 2: Option 1: 2N UPS
Notes: 1) Battery replacement at Year 12 Given: 2MW Critical Load @ Full Build Out @15 Min VRLA @20 years
CH2M HILL/IDC Architects Confidential and Proprietary
Running Total $5,200,000 $5,393,613
Option 1
DESCRIPTION
5.0% $5,200,000
Annual Discount Rate Initial Cost: UPS & Battery
$203,293
Annual Operating Cost Year 1
$5,862,943
$517,437
Annual Operating Cost Year 2
$6,425,353
$651,059
Annual Operating Cost Year 3
$7,033,661
$739,402
Annual Operating Cost Year 4
$7,686,678
$833,434
Annual Operating Cost Year 5
$8,386,322
$937,590
Annual Operating Cost Year 6
$9,140,106
$1,060,649
Annual Operating Cost Year 7
$9,958,909
$1,209,746
Annual Operating Cost Year 8
$10,860,242
$1,398,263
Annual Operating Cost Year 9
$11,870,421
$1,645,476
Annual Operating Cost Year 10
$13,029,826
$1,982,976
Annual Operating Cost Year 11
$14,723,797
$3,042,127
Annual Operating Cost Year 12
$16,022,562
$2,449,016
Annual Operating Cost Year 13
$17,404,818
$2,736,771
Annual Operating Cost Year 14
$18,867,112
$3,040,004
Annual Operating Cost Year 15
$13,667,112
Total Cost of Operation
$5,200,000
Estimated Initial Capital Cost
$18,867,112
Total Cost of Ownership (TCO)
28
TCO Summary
Option
UPS
Total Cost of Operation
Estimated Initial Capital Cost
Total Cost of Ownership (TCO)
1
2N UPS
$13,667,112
$5,200,000
$18,867,112
2
N+1 (SCC)
$13,548,506
$4,700,000
$18,248,506
3
ISO RED/STS
$13,548,506
$4,700,000
$18,248,506
CH2M HILL/IDC Architects Confidential and Proprietary
29
UPS System Annual TCO Comparison (15 Year Period) UPS System Annual TCO Comparison (15 Year Period) $20,000,000
$18,000,000
$16,000,000
TCO in NPV
$14,000,000 2N UPS $12,000,000
N+1 (SCC) ISO RED/STS
$10,000,000
$8,000,000
$6,000,000
$4,000,000 0
CH2M HILL/IDC Architects Confidential and Proprietary
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
30
TCO Scoring Form Option Evaluation Document - Data Centers Project Key Decision Number: Key Decision Description:
KD-014A KD-014A Parallel Redundant Iso-Redundant w/STS N+1 (SL-03) (SL-02) Key Decision Sub-Option Number: 1 2 3 Option Scoring Score Score Score 1 Fatal Flaw? No No No 2 Safety: 10 10 10 3a TCO NPV: (Based on 2MW IT load) 18,867,112 18,248,506 18,248,506 3b TCO Score: 7 8 8 4 Cost Containable within Established Budget? Yes Yes Yes 5 Enables Competitive Bidding 9 9 9 6 Provides a Concurrently Maintainable Solution 10 10 10 7 No single points of failure 10 10 10 8 Meets desired resiliency level (i.e. Tier) 10 10 10 9A Risk Avoidance: Technology (extent proven for application) 9 8 8 9B Risk Avoidance: Data Center Reliability 9 8 8 9C Risk Avoidance: Construction Schedule Delay from Baseline 8 8 8 10 Sustainability (other than energy) 8 8 8 11 Scalable in Appropriate Increments in a Non-Intrusive / Low-Risk Fashion 10 9 9 12 Flexibility for Future Changes 10 10 10 13 Supportive of High Density Needs 9 9 9 14A Vendor support capability throughout facility lifecycle (consider long term viability of vendor) N/A N/A N/A 14B Vendor is acceptable to Client N/A N/A N/A 15 Supportive of Client IT Operations 10 9 8 - Supportive of Legacy IT equipment voltages 10 10 10 - Supportive of Future IT equipment voltages 10 10 10 - Supportive of IT additions/changes without Electrically Energized Work (EEW) 9 9 9 16 Positive Effect on Site Environment (aesthetically pleasing, mitigated acoustics) 8 8 8 9 8 8 Client has a combination of 2N and Parallel redundant UPS systems. The idea of executing a 2N system is very intriguing Decision Made/Basis for Decision: to client based on their present operation and familiarity with this type of system. Option 1 favors clients present operational conditions and minimizes the impact of human error. The cost of the initial system is also in line with clients budget. See pro's & con's matrix below. Recommendation from Workgroup:
Proceed with This Option Proceed with Option 1 (2N)
CH2M HILL/IDC Architects Confidential and Proprietary
KD-014A 2N (SL-01)
175
171
should be no difference Based Lower to Higher score based on cost
Scored 2N highest based on clients past use Scored 2N highest based on clients past use
N/A N/A Scored 2N highest based on clients past use
Adjustments made based on Pro's/Con's listed below
170
31
Conclusion A true TCO is a thorough analysis taking into account all the factors affecting design, construction, maintenance and support throughout the life cycle of the facility.
– Site – Facility Architecture – Technology – Electrical Topology – Mechanical Cooling – Install Cost – Energy Usage – Sustainability – Reliability – Scalability – Maintenance – Vendor Support
CH2M HILL/IDC Architects Confidential and Proprietary
Total Cost of Ownership
32
Questions
CH2M HILL/IDC Architects Confidential and Proprietary
33
Thank You Debra Vieira Debra.Vieira@ch2m.com 503.736.4051
CH2M HILL/IDC Architects Confidential and Proprietary
Ronald Budicky Ronald.Budicky@ch2m.com 412.249.6527
34