1. NERSC Data Center By Iwona Sakrejda NERSC is supported by the Office of Advanced Scientific Computing Research in the Department of Energy Office of Science under contract number DE-AC02-05CH11231.

2. Outline • DC power test at LBL • CRT “Green Data Center” NERSC’s new home

3. What the demonstration included • Side-by-side comparison of traditional AC system with new DC system • Facility level distribution • Rack level distribution • Power measurements at conversion points • Servers modified to accept 380 V. DC • Artificial loads to more fully simulate data center

4. Power Consumption: 100 W System Load Load 100W Total 275W VR 20W PSU 50W Server fans 15W UPS +PDU 20W Room cooling system 70W source: Intel Corporation 4

5. Details • Safety was reviewed by a committee of the partners. No significant issues were identified. Only concern was whether fault currents would be large enough to trip protective devices. • All distribution equipment is UL rated for DC applications • No commercially available DC connector exists in a size convenient for use with servers • Reliability should be improved – fewer potential points of failure. Eliminating heat sources should help. • Final report will address safety and applicable codes and standards

6. Additional items included • Racks distributing 48 volts to illustrate that other DC solutions are available, however no energy monitoring was provided for this configuration • DC lighting was included!

7. The layout you will see

8. Typical AC Distribution Today

9. Facility-Level DC Distribution 380V.DC

10. Rack-Level DC Distribution

11. AC system loss compared to DC 9% measured improvement 2-5% measured improvement

12. Measured Results • Facility level overall efficiency improvement: 10 to 20% • Smaller rack level overall efficiency improvement but other benefits include: • Thermal benefits • Smaller power supply in server • Transition strategy for existing centers

13. Implications could be even better for a typical data center • Redundant UPS and server power supplies operate at reduced efficiency • Cooling loads would be reduced. • The UPS system used in the AC base case system performed better than benchmarked systems – efficiency gains could be higher. • Further optimization of conversion devices/voltages is possible

14. Outline • DC power test at LBL • CRT “Green Data Center” NERSC’s new home

15. Goal • LEED Silver • Certified - 40-50% of non-innovation points • Silver - 50-60% • Gold - 60-80% • Platinum - over 80% • Why not higher? Power.

16. Leed standards • Define "green building" by establishing a common standard of measurement • Promote integrated, whole-building design practices • Recognize environmental leadership in the building industry • Stimulate green competition • Raise consumer awareness of green building benefits • Transform the building market

17. Concept CRT

18. Looking to the bay

20. Reduced windows cut solar heating

21. Columnless machine room. Except where offices are.

22. Majority of temp allow natural cooling

23. Optional Heating

24. Optional Mechanical Separation

25. Study of 25 data centers Metric 1.2 for this Project Average of Facilities Measured-1.8

26. Concept of layout

27. Time Line NERSC is supported by the Office of Advanced Scientific Computing Research in the Department of Energy Office of Science under contract number DE-AC02-05CH11231.

28. Project Budget

29. Construction Cost Increases • Labor Escalation 1.5 X in a 2 year period • Total Material Cost up 23% since 2004 • Structural Steel Shapes – up 25% • Rebar – up 45% • Lumber Spot Prices – up 95% • Gypboard – up 20% • Copper pipe – up 20% • Crude Oil – up 97% • Electrical Copper • Code Escalation