[Reference Design Management Use Case] 1

Data Center Management Use Case

DESIGN OVERVIEW

-Integrated Data Center, Facility

Power and Cooling Management
Systems with the Schneider
Electric StruxureWare for Data
Centers Suite.

ABOUT THIS DESIGN

-The design is constructed as the

combination of 3 spaces, with the
Facility Cooling Space supporting
the IT Space and the Facility Power
Space powering the remaining two

-The Data Center Load is 1000kW,

which will be supported by a 2N
UPS configuration. INTRODUCTION

-The heat rejection method will be

Where Reference Designs showcase the use of Schneider Electric products and
chilled water, supported by a 2N equipment in the data center building, providing the functions of power and
chiller configuration and cooling to and in the IT space, this management case will explain how software
economizers. products from Schneider Electric’s portfolio can be combined to provide a
management solution for the operation and monitoring of a specific reference
-The design is intended to design. A detailed management solution for Reference Design 9 (2N UPS, 2N
represent a stand-alone data Chiller, N+1 InRow Cooling) of our Reference Design suite will be presented in
center, so there are no allowances this case.
for office space or support
personnel. The solution explanation will include justifications for specific selection and
placement of meters, sensors, actuators and networked equipment within the
-The electrical design for the data center. This equipment is used for control, monitoring, and metering in the
complete Data Center is 2500kVA three main spaces of the design: the IT Space, Facility Cooling Space and
to accommodate the maximum Facility Power Space. First, the space architectures will be presented. This will
potential load including be followed by explanations of how management software is integrated into
those designs to provide a fully integrated management solution.
redundancy, system losses and
cooling.
[Reference Design Management Use Case] 2

IT Space Architecture
FACILITY POWER BLOCK DIAGRAM
The IT space is supported by 2N power distribution to the rows and dual
rack power distribution in the racks. These A and B power feeds have
independent UPS systems in the Facility Power Space. The IT space was
constructed of independent power and cooling blocks. The primary type of
block consists of (16) 8kW Netshelter SX racks, (2) 1.5kW Networking racks,
4 Chilled Water Air handlers (InRow RC 500 series), and power distribution
units.
At the room level, we introduce additional systems for humidification control
and supplying water to the RCs. The rows are configured in a hot aisle/cold
aisle fashion with containment. The separation of cool supply air and hot
return air increases cooling efficiency in the data center. The redundant
coolers within the rows produce greater availability and eliminate the need
for perimeter units,

IT SPACE DESIGN
IT Space Specifications
- The IT Space is designed in blocks
containing 2 rows of IT racks around a
common hot aisle Name Value Unit
- InRow RC cooling units are placed within
Data Center Load 1000 kW
the rows in order to provide N+1 cooling to
Density per Rack (IT) 8 kW
the IT racks
Density per Rack (Networking) 1.5 kW
- Each block of 2 rows has chilled water
supplied by the Mechanical Space Square footage of IT Space 5070 Sq ft

- In Row RC Cooling is suppled by A and B Row Power Configuration 2N

© 2013 Schneider Electric. All rights reserved.

feeds directly from Row PDUs. Row Cooling Configuration N+1

- Since each block contains the ability to Heat Rejection Medium Chilled Water
provide A and B feed power, each rack has 2
independent Rack PDUs supplying 2N power
to IT equipment.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 3

Facility Power
FACILITY POWER BLOCK DIAGRAM

The electrical space showcased in this design supports a 1MW data

center designed to be a high value architecture, offering dual medium-
voltage transformers along with a dedicated set of redundant generators
and modular components along the power train. The end result is a data
center that has a very high level of availability with 2N redundancy
throughout the electrical distribution paths. For some data center sites
that do not have access to dual utility sources, this architecture will
provide redundant A&B power paths from the medium voltage
transformers to the UPS systems and on to the power distribution units on
the IT Space floor.
The electrical architecture has been dictated based on UPS and
distribution characteristics. The UPS choices for this design include the
world’s largest and most efficient Symmetra® MW modular scalable UPS.
This UPS provides reliable and conditioned power to downstream APC
InfraStruxure power distribution units that in turn power the IT load.
The switchgear and distribution boards have been designed primarily
around achieving high availability. In addition, the application of
switchboards in this design allows for easy scaling to the designed
maximum capacity.

ELECTRICAL DESIGN

- In order to support 1000kW of IT Space

load, there are 2 Symmetra MW 1200kW
UPSs supplying uninterruptible power
through Schneider Electric switchboards.
- Specific pumps meant to operate with
thermal storage tanks are supplied with
uninterruptible power.
-Low Voltage generators are included in the
FACILITY POWER ATTRIBUTES
design and are switched to with PLCs in the
Schneider Electric Switchgear in the event of
Name Value Unit
a utility failure.
Data Center Load 1000 kW
- Both switchgear units are fed power with an
IT UPS Symmetra MW 1200 kW
© 2013 Schneider Electric. All rights reserved.
independent cast coil medium voltage
transformer UPS Configuration 2N
Generator Configuration N+1
Utility Configuration N

MV Transformers 2N

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 4

Facility Cooling
The mechanical space supports cooling for a 1MW data center design.
This design affords optimal availability levels with a double-ended chilled
FACILITY COOLING BLOCK DIAGRAM
water loop. Most downstream components are configured for a 2N level of
redundancy.
The design has a highly efficient heat rejection methodology by utilizing
two 340 ton water cooled chillers in a 2N configuration, and each chiller is
paired with redundant cooling towers. The chillers are sized to run at
Tower
partial loads and have variable speed compressors allowing the chillers to
operate at peak efficiency to provide more energy savings throughout the
life of the data center. A pair of plate frame heat exchangers is provided
Tower
with three way valves between the chillers and cooling towers for improved
efficiency. This type of economization creates two loops, one for the IT
space and one for heat rejection. Economizers reduce energy
consumption and thereby operation cost, providing significant energy
savings over the life of the data center, relative to geographic location and
number of available free cooling days.
Multiple pairs of chilled water and condenser water pumps in a 2(N+1)
redundant configuration are implemented to provide better control, fault
tolerance and efficiency. The secondary chilled water pumps operate at
variable speed thereby allowing for adjustments in flow rate based upon
peak and off peak cooling demands. VFD control of pumps in the design
allows for more precise control of the pump thereby maintaining desired
pressure and rate of flow.
MECHANICAL DESIGN
This reference design can be modified as
- With Efficiency and criticality in mind,
redundant chilled water plants with cooling
towers and economizers are present in the FACILITY COOLING ATTRIBUTES
design.
- Chilled water from Chiller A and B are
Name Value
joined into one loop to supply the IT Space. Chiller configuration 2N

The coolers (InRow RCs) are N+1 redundant Chiller Size 340 tons
to be failure resistant and concurrently N+1 Primary and
Chilled Water Pumps
Secondary
maintainable.
- Chilled Water pumps between Thermal Economizer 2N

Storage Tanks and the cooling units are Storage Tank Configuration 2N © 2013 Schneider Electric. All rights reserved.
supported by the Symmetra MW UPS to Cooling Tower Configuration 2N
provide back up chilled water in the event of
interruption of power to the Chillers.
-Cooling units include InRow RCs fed from
headers

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 5

StruxureWare for Data Centers Suite

The StruxureWare for Data Centers suite overview The various elements in the StruxureWare for Data
demonstrates Schneider Electric’s vision of a Center suite address the different needs of the array
complete Data Center Infrastructure Management of data center users including the Facilities teams, IT
(DCIM) system. The suite, as depicted in the above and Data Center Management, and other “C-Level”
figure, delineates functionality that is needed in a executives. Numerous portals allow the users to
typical datacenter and historically has been navigate through important data center operational
addressed through multiple disconnected and performance information through a preferred
applications. With the Schneider Electric interface, e.g. a facilities engineer through a building
StruxureWare for Data Centers suite, the integrated monitoring interface, an IT systems operator though
and holistic system is capable of managing data an IT room monitoring interface, and IT and facilities
centers across multiple domains to accommodate managers through an enterprise portal interface. In © 2013 Schneider Electric. All rights reserved.

the needs of each expert user within an environment addition DCIM is increasingly seen as C-level
that promotes collaboration. information tool, providing high-level management
information summaries, energy benchmarks and
other Data Center productivity related key
performance indicators (KPIs).). This perspective
emphasizes the need to deliver the right information
to the right users in real-time.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 6

Structural View

The structural perspective, as illustrated below, This information can be used to assess the health and
represents the physical elements of the data center efficiency of power systems throughout the design.
architecture management. This view shows that the StruxureWare Data Center Expert collects information
devices in the IT, Mechanical and Electrical spaces from Data Center equipment and controllers as well as
are accessible to any of the StruxureWare for Data from meters located in the power systems. Cooling
Centers management software applications – Power Monitoring Expert gathers information from network
Monitoring Expert (ION Enterprise), Cooling controllers which monitor and control devices in the
© 2013 Schneider Electric. All rights reserved.

Monitoring Expert (Andover Continuum or TAC Heating Ventilation and Air Conditioning (HVAC)
Vista), StruxureWare Data Center Expert, system. Since all of the equipment and intelligent
StruxureWare Data Center Operation and devices are connected to the same TCP/IP network,
StruxureWare Resource Advisor. In addition, this data from any device is available to each of the
architecture highlights the freedom of management systems where relevant. Each server can
communication between the enterprise software then enable data viewing and manipulation through
systems for more efficient information exchange. their associated client applications, and data from all of
the systems can be aggregated into a site-level or
hosted dashboard perspective.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 7

Schneider Electric’s 3 core monitoring and contol This information can be used to assess the health and
applications: Power Monitoring Expert (ION efficiency of power systems throughout the design.
Enterprise), Cooling Monitoring Expert (Andover StruxureWare Data Center Expert collects information
Continuum/TAC Vista), and StruxureWare Data from Data Center equipment and controllers as well as
Center Expert manage the data collection, from meters located in the power systems. Cooling
monitoring and automation type functions, while Monitoring Expert gathers information from network
StruxureWare Data Center Operation assists with controllers which monitor and control devices in the
the business process type functions like data center Heating Ventilation and Air Conditioning (HVAC)
asset management, operational analysis and capital system. Since all of the equipment and intelligent
© 2013 Schneider Electric. All rights reserved.

costs. These applications are hosted on servers, devices are connected to the same TCP/IP network,
with access to both the corporate network and the data from any device is available to each of the
DCIM network. The DCIM network is a generic management systems where relevant. Each server can
TCP/IP network with the sole focus of facilitating then enable data viewing and manipulation through
status and control communications between devices their associated client applications, and data from all of
and applications. This network is isolated from the the systems can be aggregated into a site-level or
corporate network to increase security and partition hosted dashboard perspective.
network traffic. Power Monitoring Expert primarily
communicates with meters and gateways in the
electrical space.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 8

StruxureWare Portal in a Network Operations Center

From the perspective of the individual users of these

- Site specific – where a single view will summarize
systems, a high level summary overview of the sub-
performance data from each of the sub-systems to
system or full system performance can be a useful
provide a holistic perspective of the overall Data
addition to the more typical client software
Center performance specific to one site, and
interfaces, and this can be achieved through the
consolidated into one view for a quick view into the
StruxureWare Portal. Given the above Network
health and status of one site.
Architecture, each of the 5 management applications
- Global view – another StruxureWare Portal option
can provide their own user interfaces, including
includes an opportunity to leverage a global view,
reporting, system alerts and graphical
providing an overview of an entire facility or multiple
representations of the physical systems. In addition,
building and Data Center sites.
any number of StruxureWare Portal views can be
created through flexible portlets to highlight the most
Pulling all these systems together as a unified Data
relevant and timely information - . The various types
Center Network Operations Center (NOC) enables a
may include:
workspace where a user or team of users can
- Sub-system specific – for example, the Power
monitor the Data Center operating conditions in real-
Monitoring sub-system can summarize electrical
time and provides opportunities to understand the
power and energy performance details such as total
relationships between each of the sub-systems as
consumption, peak load, estimates for cost and
conditions change.
carbon emissions, and calculations like Power
Usage Effectiveness (PUE) to indicate the efficient
conversion of energy from the Data Center facility
through to the IT assets.

© 2013 Schneider Electric. All rights reserved.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 9

StruxureWare For Data Centers NOC Configuration

In the example provided of a StruxureWare for Data The large screens provide a view into the overall
Centers NOC, a NOC Client Virtual Machine Server status and key indicators of the data center
is configured to host the multiple sub-system client infrastructure. The dashboards allow the user to
application interfaces using multiple Virtual Machine follow the paths of cooling and power through the
images. Multiple displays are leveraged to enable data center rooms and understand the operating
interaction with each of the management software status of the equipment. In addition, the user would
systems from the central console. It should also be be able to “zoom” to look at quality, cost, and
noted that the management software client capacity information at the global, site, room, and
applications can simultaneously be accessed rack level.
through the network on alternate workstations and
laptops, or through the variety of mobile device Along the bottom row, moving from left to right, © 2013 Schneider Electric. All rights reserved.

applications that are available as extensions to the StruxureWare Cooling Monitoring Expert and Power
sub-system client tools. Monitoring Expert provide the details related to the
operation of the Electrical and Mechanical Space,
While the sequence of the actual displays is variable with StruxureWare Data Center Expert and
and depends on the preference of the users, in the StruxureWare Data Center Operation representing
example provided the screens have been arranged the specifics of the IT Space.
such that the large screens at the top display the
high level Global and Site -level dashboards with the
smaller screens at the bottom being leveraged for
the four sub-systems.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 10

Detailed IT Space Management

StruxureWare Data Center Expert provides an

efficient way for organizations to monitor their
company-wide multi-vendor physical infrastructure:
power, cooling, security, and environment. Automatic
device discovery, real-time monitoring, user-defined
reports and graphs, and instant fault notification and
escalation enable quick assessment and resolution
of critical infrastructure events. This centralized
repository of critical information can be accessed by
multiple users from anywhere on the network.
Integrations to BMS, NMS, EMS and Power
Management systems exist “out of the box” for
infrastructure data and events to users who need it.

StruxureWare Data Center Expert can discover any

SNMP or Modbus device on the network. The user
can specify an IP address range that will be scanned
on the network for the presence of supported
devices. Scans can be user-initiated or can be
performed automatically according to a user-
specified schedule. Once this information is
provided, StruxureWare Data Center Expert
performs an SNMP or HTTP query to each IP
address in the specified range. The StruxureWare
Data Center Expert server can monitor and manage
Schneider, and third-party devices on both Public
and Private LAN’s.

All APC and NetBotz devices are centrally

configurable within StruxureWare Data Center
Expert for single, multiple, entire groups or all Surveillance events contain picture data that can be
monitored devices. Providing a comprehensive mass viewed as movie-like clips, enabling the user to see
configuration capability, allowing the user to create, the surveillance event that triggered the clip.
save, and push configurations or specific device Surveillance in StruxureWare Data Center Expert
settings to similar APC devices with a Network allows the use of Camera Pods and CCTV Adapter
Management Card. Pods attached to NetBotz appliances.
StruxureWare Data Center Expert allows the user to In order to gain better visibility across the entire
create alert threshold settings for any sensor value network, use of an Enterprise Management System
reported for any device. The StruxureWare Data (EMS) such as IBM Tivoli or Microsoft System
Center Expert server will immediately notify you or Center Operations Manager, is necessary. These
others in the organization when the StruxureWare management systems help coordinate the different
Data Center Expert server’s alert thresholds are types of server devices and provide a broad view of
© 2013 Schneider Electric. All rights reserved.

violated for its monitored devices. The monitored everything occurring on the network.
NetBotz Appliances each generate their own alert
notifications in response to alert threshold violations The integrations from StruxureWare Data Center
that occur at the devices they monitor. Expert to Microsoft System Center Operations
Manager and IBM Tivoli provide a tight integration
The Surveillance feature within StruxureWare Data between the IT systems and the physical
Center Expert is used to configure and view infrastructure that supports those systems. Events
surveillance data available to the StruxureWare Data from the physical infrastructure can be viewed side-
Center Expert server from the APC NetBotz line of by-side with the system events to which they may be
cameras. The user can filter and view a summary of related,
all captured surveillance event images from a
specified day or range of days.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 11

Monitoring of Networked Equipment

Each Row block contains several pieces of data

center equipment that are able to be managed by
StruxureWare Data Center Expert. Each rack
contains two Metered Rack PDUS capable of circuit
monitoring. In addition, InfraStruxure PDUs with
isolation transformers allow users to monitoring
branch current to racks and coolers. Individual
alarms can be set on each Rack PDU, Cooler, and
InfraStruxure PDU.

MONITORED EQUIPMENT

InRow RC InfraStruxure Metered Rack

Chilled Water Power Distribution PDU- provide
Cooling unit- Unit can be advanced warning
closely couples deployed to protect against
the cooling with modularly in unplanned power
the IT heat load. environments overloads. User-
This design without raised defined alarm
prevents hot air floors for reduced thresholds mitigate
recirculation, installation costs risk with real-time
while improving and increased local and remote
cooling agility. In addition, alerts of potential
predictability and the ability to add unexpected circuit
allowing for a modules to an overloads to your
mission critical
© 2013 Schneider Electric. All rights reserved.
pay as you grow InfraStruxure PDU
environment. to meet your equipment
needs increases
the speed of
deployment and
reliability, while
lowering the total
cost of ownership.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 12

Group Control of InRow RCs

In an IT block with twelve 8kW density (IT) racks and In this specific design, the RC units have been
two 1.5kW density (Networking), there are 8 InRow grouped together within the block. This achieved by
RC cooling units to provide N+1 cooling within the using a serial connection daisy-chained from one
block. Each of these units are able to operate RC to the next. When in this operating mode, the
independently, in an closed aisle mode such as this RCs gather all of the data from the temperature
one, by setting goal temperature set points for the sensors in the group and adjust all of the cooling
rack next to it. Each RC unit has a single external units based on the highest rack inlet temperature.
temperature sensor that is place in the rack adjacent Each RC will have the same control commands to
to it. Based on the temperature of the adjacent rack, increase decrease fan speed and chilled water flow
the RC adjusts its fan speed and chilled water flow. with their own internal valves.

Security and Environmental Monitoring

For each block in our IT Space there is a monitoring Each block also includes security equipment for the
scheme to ensure the proper environment is proper monitoring of the IT rows. Each rack has a
maintained for the computing equipment. This front and rear door magnetic sensor along with the
involves temperature or temperature and humidity racks keyed entry locks. Also available is a camera
sensors at every rack in the design, as well as pod for each hot or cold aisle, which is able to record
sensors to detect chilled water system leaks. continuously or based on movement.

© 2013 Schneider Electric. All rights reserved.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 13

MONITORED EQUIPMENT

Netbotz Sensor Pod SP 150- Sensor

Pod optimized for rack mounting that
supports 6 Universal Sensors.
Deployment flexibility allows sensor
Netbotz Rack Appliance 570- The Netbotz 570 offers pods to be up to 100 meters from a
premium security and environmental monitoring over compatible appliance
the network. The Netbotz 570 is capable of video
surveillance and monitoring to record human activity.
It provides temperature, humidity, door contact, dry
contact, vibration, smoke, 2 way audio monitoring,
spot leak and rope leak monitoring. The Netbotz
570’s additional features include integration with Netbotz Security Camera- USB
StruxureWare Data Center Expert and user-defined Camera enhances surveillance
alerts making the Netbotz 570 the perfect unit to capability in Rack Monitor
protect your IT assets from security and appliances. The surveillance
environmental threats. Netbotz is an active management application enables
monitoring solution designed to protect against rapid search and retrieval of video,
physical threats, environmental or human, that can plus tagging of important video clips.
cause disruption or downtime to IT infrastructure.
This scalable suite of networked appliances, sensors,
access controls and cameras is designed to
safeguard environments ranging in size from network
closets to data centers.

Alarm Beacon- quickly notifies

personnel of critical situations with a
visible alarm signal.

Temperature Sensor- Universal

sensor that monitors temperature in
your Data Center or Network Closet.

Door and Smoke sensors provide

valuable input on the status of your
IT space physical environment © 2013 Schneider Electric. All rights reserved.

Leak Sensor- Provides early

detection of fluid in your data center
or network closet along the entire
length.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 14

Detailed Building Management

Management Application: StruxureWare Cooling Monitoring Expert

Given the physical system architectures as

represented in Design #27, the elements that make
up the complete Data Center could be a separate,
stand-alone facility or may be part of a larger, mixed-
use facility. In either case, this Use Case assumes
that the physical infrastructure power and cooling
systems that supply the Data Center are fully
segmented and operated independently from the rest
of the facility.

For the mechanical cooling monitoring and

automation applications, StruxureWare Cooling
Monitoring Expert currently offers the option to
leverage either the Continuum Cyberstation or Vista
Building Management Systems (BMS) software
platforms. These systems integrate manual and
automated control and device monitoring data to
provide system level information to the Data Center
facility operator. These BMS options have the ability
to support multiple protocols such as Modbus, LON,
and BacNet. This allows the system to communicate
to a wide variety of devices through a variety of
controllers, including the Continuum NetController
and BacNet series or the Vista Xenta series
products. The associated software client applications
present data acquired from the devices and
controllers to generate a visual representation of the
mechanical cooling system equipment. These
systems can also gather data from the power
monitoring and IT room sub-systems and display this Historical data is logged over user specified
information in a single client application. While the intervals. The BMS system can also monitor and
BMS system does not replace the need for the alarm the user with UPS, generator, Power
specialized engineering, analysis and reporting tools Distribution Unit, RPP, Switchgear, ATS and other
required by the users of the other software system, metering data as a compliment to similar functions
there is often a benefit in having one system act to provided by StruxureWare Power Monitoring Expert
consolidate this information in a single view. Users (ION Enterprise) and StruxureWare Data Center
can get live data, detailed energy reporting, or Expert.
historical trending of energy use.
Otherwise, the primary function of the BMS in the The configuration recommended here includes the
Data Center application is to provide Heating BMS server to collect data from the intelligent
Ventilation and Air Conditioning (HVAC) monitoring devices and controllers, a separate server to store
and control, essentially to deliver cold air to the IT historical data in an SQL database, and any number
room to cool the IT equipment and to remove the of client workstations to act as the remote interface
© 2013 Schneider Electric. All rights reserved.

heat created by the servers. into the real-time and historical data contained in the
servers.
IT equipment and to remove the heat created by the
servers. The client software can display the complete Due to the capabilities of customizable user
HVAC System monitoring including overall status of interfaces and wide data collection, the BMS can
individual coolers, chillers, towers and the associated also be configured to host the overall data center
pumps, fans, valves and other related devices. In status portals. From this view, the operators are able
addition, the BMS displays the physical plant status to aggregate data from the IT, Electrical and
and performance as well as real-time data through Mechanical Space and present it in raw or
open communication protocols such as BACNet, processed form in custom screens viewed in the
LonWorks and Modbus. workstation or on remote clients.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 15

Mechanical Systems: Sequence of Operations

The following text depicts high level sequence of The following subsystems will also operate with
operations for the mechanical plant servicing the controllers:
1MW IT load. It is assumed that all cooling system
components on the IT floor will have autonomous Primary Chilled Water Loop
control over the respective environment and will not
rely upon the BMS in any manner for control Each chiller plant shall have a redundant set of
functionality. primary chilled water pumps operated at constant
speed. The pumps shall have lead/lag rotation
The BMS control architecture shall be a distributed between the pump pairs. To comply with the
system using NetController, BacNet, or Xenta redundant design each primary chilled water pump
controllers communicating over the TCP/IP network will be assigned to a separate controller and have
to the BMS servers. All essential control aspects will independent control points.
be managed by dedicated digital or analog input
channels and logic programmed into the controllers Secondary Chilled Water Loop

The central plant shall have the following distinct The secondary chilled water loop pump speed shall
operating modes: off, operate –with lead/lag plants, be regulated by a BMS PID loop using the secondary
operate- with concurrent plants, emergency cool chilled water loop pressure differential as the
(loss of chillers). process variable. To comply with the redundant
design each secondary chilled water pump will be
Off: assigned to a separate controller and will each have
The chillers, pumps and towers are off with all independent control points.
applicable valves closed. The cooling tower heaters
remain powered under separate thermostatic control. Plate Frame Heat Exchanger Economizer
Dry coolers remain monitored for freeze condition.
Note: At least one Chiller, heat exchanger and Each chilled water plant shall have an integrated
drycooler and associated pumps will always be water side economizer plat frame heat exchanger.
operational. The heat exchanger shall have a 3-way mixing valve
under proportion control of a BMS PID loop. During
Operate- Lead/Lag Plants: periods of active use the mixing valve shall be
Chilled water is being actively produced by one of modulated as needed to maintain desired setpoint of
the two plants. Rotation of lead plant is cycled at a the chilled water. To comply with the redundant
prescribed interval. Failure switch over is provided design each heat exchanger will be assigned to a
between plants in the event of a critical failure occurs separate controller and will each have independent
on the primary plant. control points.

Operate- Parallel Plants: Chiller

Chilled water is being concurrently produced by both
plants at partial load on each. Each plant would Each chiller plant shall have a variable capacity
support about 50% of active thermal load. Should chiller that may be operated either lead/lag with the
either of the two plants fail the remaining plant would alternate chiller plant or concurrently with the
take on the balance of the load. alternate chiller plant. To comply with the redundant
design each chiller will be assigned to a separate
Emergency Cool- Loss of Chillers: controller and will each have independent control
The towers, pumps and plat frame heat exchangers points.
shall function at maximal performance so long as
© 2013 Schneider Electric. All rights reserved.

chilled water temperature is above setpoint and all

chillers are not available for service.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 16

Mechanical Systems: Sequence of Operations (continued)

Chilled Water Storage
Controller Capabilities
Each chilled water plant shall have an integrated The i2920 system controller is an excellent fit for the
chilled water storage system for thermal stability and most demanding control and monitoring applications
fault tolerance. The storage tanks circuits shall have with its versatile input/output mix and its ability to add
a 3-way mixing valve under proportional control of a additional points using expansion modules. This
BMS PID loop. Flow of water during tank recovery controller also features a 32-bit processor and plenty
(pull down after restoration of chiller operation) shall of dynamic memory for application programs as well
be partially bypassed around the tanks allowing as expanded local data logging of critical data.
quicker recovery of supply chilled water temperature Override switches are also included for each of the
to the IT space. The PID loop shall use the Chilled outputs.
Water Tank Supply Temperature as the process
variable and the active Chiller Supply Water Additional Schneider Electric controllers such as the
Temperature plus offset (adjustable). Xenta 200/300/400, NetController II, BACnet bCX1
and Infinet bCX1 series devices could also be
configured similarly. In addition, for fast and efficient
Secondary Condenser Water Loop installation and easier maintenance, the control
panels have dedicated terminals for each
The secondary condenser water loop shall have VFD input/output.
regulated pump(s) operated as needed by the
chillers to maintain optimal operation of the vapor Versatile communication protocols
compression cycle. The pump speed commands In order to meet the demands for monitoring, the
shall be generated by an analog output at the chiller following controllers are recommended options given
monitored by the BMS and repeated to the their ability to support the required I/O, control
appropriate pump VFD. The pump sets for both the programming and wide range of communication
A side and B side chiller plants shall have lead lag protocol options:
rotation between the pairs. To comply with the - NetController II
redundant design each secondary condenser pump - Xenta 200/300/400 series
will be assigned to a separate controller and will - BACnet bCX1
each have independent control points. - Infinet bCX1

Primary Condenser Water Loop Data Center Overview Screens

As a result of the integration options, data acquisition
Each chiller plant shall have a redundant set of from both Electrical & Mechanical systems allows the
primary condenser water pumps operated at building management system to provide overview
constant speed. The pumps shall have lead lag screens. Custom screens can be developed to
rotation between the pump pairs. To comply with the provide specific users with key information.
redundant design each primary condenser pump will
be assigned to a separate controller and will each Consistent metrics for control and monitoring
have independent control points. To ensure consistency and synchronization within
the monitoring and control function of our design we
DESIGN CONSIDERATIONS will use consistent metrics to measure both power
and heat load demands. This provides the user with
instantaneous information related to power versus
System Architecture Configuration
cooling.
Within each of the BMS designs, a dedicated control
© 2013 Schneider Electric. All rights reserved.
The BMS will calculate tonnage for the Secondary
panel, transformer, power supplies, relays, sensors, Chilled Water output. The BMS will then convert the
and the system controller are dedicated to each tonnage into kW by formula
major component within the CHW Plant
configuration.

Dedicated Control Panels to meet redundancy

In the case of this design, the systems have been
broken down by Chiller, Heat Exchanger and
associated pumps as one component and the
cooling tower as a separate component.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 17

Detailed Power Management

Management Application: Power Monitoring Expert
Customer is data centers need a management system Client Hosted
in order to maintain the availability and reliability of the Applications Dashboard
electrical supply. The availability and timeliness of
information about the electrical supply is very
important as the implications of downtime are severe, TCP/IP - Web Services API (Local or Internet Connections)
either in rapid financial loss or risk to operation
continuity.

A power management application like Power StruxureWare

Monitoring Expert can help facility operators to Power Monitoring Expert
understand current operating conditions from the Utility
Feed to the building, to the server room, to the row, to
Integrated TCP/IP Network
the rack and to the plug. If an event happens, facility
operators want to know about it right away, and they Modbus TCP
want to quickly see what impact the event has had on
operations so that they can take appropriate action to Meters Gateways Trip Units
respond.

Facility operators also want to be alerted to conditions Modbus RTU

that may lead to downtime so that the condition can be

Relays Sensors Meters
corrected immediately in order to avoid downtime. With
Power Monitoring Expert, the operator can indentify
equipment vulnerabilities and very reliable operation of
power distribution and mitigation equipment.

Facility managers need to be able to analyze any Facilities want to know that they are being charged
event that resulted in downtime so that the root cause fairly by their utility and that meter-reading or
can be determined to prevent a similar event in the accounting errors are not made in the favor of the
future. By utilizing logs with time-stamped incidents, utility. Even small errors on a percentage basis can
the user can view the root causes of current and past mean a large cost to a facility because of the large
events. amount of electricity that is consumed.
It is important for facility managers to have information Facilities also want to know what they can do to
about the electrical system to understand what role the reduce the costs of the electrical bill. A power
electrical supply had in any event. Sometimes monitoring system is expected to provide information
reliability problems are blamed on the electrical supply that facility managers can use to help reduce these
when actually there were other causes involved. costs (eg. PUE trends). For example, facility
Conversely, reliability problems can sometimes be mangers need to be able to justify replacement of
blamed on equipment, operator error or from an equipment for more energy efficient models. They
unexplained source, when the source of the problem is need to be able to identify waste of energy, including
actually a disturbance in the electrical supply. incorrectly operated equipment or equipment that
needs maintenance. They may need to know
Data Center operators also want to be able to prove whether it is worth the investment ot install
when a disturbance has been caused by the electrical equipment to mitigate the conditions that result in
utility, so that the utility can be held accountable for Power Factor or other penalties, or just to justify an
© 2013 Schneider Electric. All rights reserved.

any damages. With Power monitoring Expert analysis investment in local generation equipment in order to
tools, the users can proactive assess current power reduce utility demand during peak billing rates or to
quality conditions and trends. avoid setting a new peak demand.
Energy cost is a smaller but increasingly important The power monitoring expert system allows
concern to data centers. Facility operators want to operators to report on environmental metrics. Usage
know more about the elements of their electrical bill data can be collected, aggregated, normalized and
and how those drive their electricity cost, and they summarized in to user created reports. The
want actionable information to be able to reduce those architecture described in this use case enables the
costs. applications as discussed above.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 18

Detailed Power Management

Management Application: Power Monitoring Expert

The power management offer is designed to Power Quality can be tracked in the Utility feeds,
uncover opportunities for safety, reliability, energy UPS input, Critical power distribution, and in Critical
performance and balanced power infrastructure Mechanical power distribution. Metering can be
utilization. It utilizes intelligent sensors, meters, data valuable at the generator output, UPS input, Critical
collection hardware and software to: provide the Mechanical power distribution, Mechanical
information required to monitor infrastructure in real- distribution, and for other building loads in order to
time; to understand and manage operations and measure usage and calculate PUE. In addition, the
risk; and provide the analytic tools necessary to plan ability to test with load banks connected to the UPS
for constant change and dynamic growth. output and generator switchgear will be important for
ongoing reliability.
With these devices in place we can conduct EPSS
tests, calculate PUE as well as show an online
dynamic display of circuit breaker status and
measurements, show power quality reports including
harmonics, power factor, maintenance reports,
energy dashboards, and alarming.

© 2013 Schneider Electric. All rights reserved.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 19

IT UPS Input and Output Mechanical UPS Panel

Under normal circumstances, this system connects The minimum requirement for this location is a
to the utility feed while the PM800 series meter on PM800 to the power consumed by the mechanical
the low voltage electrical bus captures advanced PQ load (for PUE calculations). It would be even more
data. Having a PQ meter like the PM 800 at the beneficial to have a basic PQ meter such as PM800
entrance of the UPS allows the operator to analyze to monitor any harmonics produced by the VFDs
events that may be specific to the UPS. It is also and Soft Starters in the event they malfunction.
useful if the utility breaker is open and the system is
fed off the generators.

In addition, the UPS Input Board Breaker and the

UPS breakers on the Input and Output boards have
built-in MicroLogic Trip Units to provide operational
data. PM5350 meters are located at each output
board position to ensure each PDU is being fed
properly conditioned power.

© 2013 Schneider Electric. All rights reserved.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 20

Mechanical Load

The minimum requirement for this location is a

PM800. However, given that we are monitoring
VFDs, a meter that also measures harmonics would
be beneficial. In this case, we supplement the
PM800 with PM9C meters, trip units, and
communicate with an ECPR.

Building Loads

Measuring the power allocated to the building loads

enables the operator to calculate PUE. It may also
be used for cost allocation (if applicable). In this
case a basic power meter will suffice. In this
Reference Design, Micrologic Trip Units are
deployed within the Auxiliaries Supplies Board in
order to monitor the feeds to building loads as well
as A and B feeds from the main switchgear.

Generator Switchgear

It is advisable to have an ION7650 on the Generator

Switchgear. Individual sensors are present at each
of the breaker positions, as well as a controller to
ensure proper coordination. Meters will deliver data
for EPSS tests and real-time data for crisis
management.
© 2013 Schneider Electric. All rights reserved.

Load Bank

Although it is not necessary, it is advisable to have a

PM820 on the Load Bank. Having an accurate
reading on the load bank is key for testing UPSs or
generators under full load.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 21

Smart Power Devices

Compact NSX Circuit Breaker
PowerLogic PM800 Series Meter
NSX is designed to use an
PowerLogic PM800 series power electronic trip system to signal
meters combine accurate, 3- the circuit breaker to open
phase energy and power automatically to help protect
measurement with data logging, electrical systems from
power quality analysis, alarm damage caused by overloads
and I/O capabilities not typically and short circuits. Providing
available in a compact meter. unparalleled performance and
control, this generation of
Compact NSX circuit breakers
features exclusive Micrologic
Trip Units, which allow for a
range of sophisticaled
applications for metering and
PowerLogic ION 7650 Series monitoring.
Meter

Ideal for both energy suppliers MasterPact NW Circuit Breaker

and consumers, and loaded
with advanced functionality for The latest generation of
monitoring key distribution Masterpact NW breakers
points and sensitive loads, the provides more options and
PowerLogic Ion7650 power and flexibility to help you meet
energy meter offers a feature greater needs for circuit
set including advanced power protection reliability.
quality analysis coupled with Masterpact uses the latest in
revenue accuracy, multiple technology to provide higher
communications options, web interrupting ratings, smaller
compatibility, and control footprint and more accessories
capabilities. than any other insulated case
breaker.
PowerLogic PM5350 Series
Meter SEPAM MV protection relay
The PowerLogic PM5350 With Sepam, you get intuitive
provides a comprehensive access to all system
measurement package information in your language so
including: Energy and Demand that you can manage your
Monitoring, THD/TDD and electrical installation effectively.
Min/Max reading, pre- If a problem occurs, clear and
configured alarm functions complete information puts you
in a postion to make the right
decisions immediately. The © 2013 Schneider Electric. All rights reserved.

electrical supply is restored

Electrical Crisis Prevention and without delay.
Recovery

ECPR incorporates real-time

coordination verification
capability, continuous
montitoring of the health status
of switchboard devices, and
power restoration assistance in
case of loss of power detected
at the switchboard level.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 22

Management Network Diagrams

© 2013 Schneider Electric. All rights reserved.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 23

IT Space Physical Infrastructure Management

Format for Multiple Row Blocks

Key
A-link
Format for Additional T Temperature Sensor

T/H Temperature/ Humidity Sensor

Equipment outside Whitespace
USB Door Door Sensor

Hub Sensor Pod Sensor Pod Sensor Pod Sensor Pod Camera
Electrical Space SP150 SP150 SP150 SP150
UPS
T/H Door Door T Door Door T/H Door Door T Door Door T/H Door Door T Door Door T/H Door Door T Door Door
USB
Mechanical Electrical
Space AHUs Space AHUs
Sensor Pod Sensor Pod
SP150 SP150
Beacon
T/H Door Door T Door Door T/H Door Door T Door Door
NetBotz Leak

A-link
T Door Door T/H Door Door

InRow RC

InRow RC

InRow RC
Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU
InRow RC
CRAH

CRAH

CRAH

CRAH

PDU
Corporate
Network

Ethernet
Switch
Core
Ethernet Switch
(Private Network)
Struxureware Ethernet
Central
© 2013 Schneider Electric. All rights reserved.
Switch
InRow RC

InRow RC

InRow RC
Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU

Rack PDU
InRow RC
CRAH

CRAH

CRAH

CRAH
PDU

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 24

Facility Power Infrastructure Management

Meter Meter Meter

PM800 PM800 PM800
Key
Generator
O/C O/C O/C Controller EGX100
ulogic ulogic ulogic ulogic

ulogic MicroLogic Trip unit

O/C O/C O/C
EGX100
Meter PowerLogic EGX100 ulogic ulogic ulogic ulogic ulogic
ulogic ulogic Main Switchgear B
PM9C Power Meter 800
Generator Switchgear
Relay
SEPAM Protective Relay
SEPAM Meter Meter Meter
PM800 PM800 PM800
Meter PowerLogic
O/C O/C O/C O/C O/C O/C O/C O/C
PM800 Power Meter 800 EGX100
ulogic ulogic ulogic ulogic
Meter PowerLogic Meter Meter Meter ECPR
ulogic ulogic ulogic ulogic
PM5350 Power Meter 5350 PM9C PM9C PM9C
EGX100
Digital Meter PowerLogic Meter Meter Meter Meter Meter Meter Meter Meter ulogic ulogic ulogic ulogic ulogic
PM9C PM9C PM9C PM9C PM9C PM9C PM9C PM9C EGX100
ION7650 Ion Series Power Meter Main Switchgear A
Meter
PowerLogic
Mechanical A Loads PM800
EGX100 EGX100 Ethernet
Gateway

Electrical Crisis
ECPR Prevention and Recovery
Communication Unit
O/C O/C O/C O/C O/C O/C O/C O/C
EGX100 Meter Meter Meter Meter Meter
PM5350 PM5350 PM5350 PM5350 PM5350
RS485: Modbus RTU
Ethernet: Modbus TCP ECPR
Meter Meter Meter ulogic ulogic ulogic ulogic
PM9C PM9C PM9C

Meter Meter Meter Meter Meter Meter Meter Meter ECPR

EGX100 ulogic ulogic ulogic ulogic
PM9C PM9C PM9C PM9C PM9C PM9C PM9C PM9C

Meter
Mechanical B Loads PM800
Corporate ulogic ulogic ulogic ulogic
Network
UPS B Output Board

ulogic ulogic ulogic ulogic ulogic ulogic

Building Loads Auxiliaries

StruxureWare

© 2013 Schneider Electric. All rights reserved.

EGX100 Meter Meter Meter Meter Meter
Power Meter PM5350 PM5350 PM5350 PM5350 PM5350
ION7650
Monitoring
Relay
SEPAM ECPR
MV Switchgear ulogic ulogic ulogic ulogic

ulogic ulogic ulogic ulogic

Data Center Infrastructure Network
UPS A Output Board

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013
[Reference Design Management Use Case] 25

Facility Cooling Infrastructure Management

Corporate
Network

StruxureWare
Cooling Monitoring

© 2013 Schneider Electric. All rights reserved.

Expert

Notes:
1. Bus Communications are continuous daisy
chain as shown, order of unit may change with
Infrastructure approval of Schneider Electric and redline
documentation must follow installation.
Network 2. Schneider Electric Panels and 12
Controllers.

Schneider Electric www.schneider-electric.com

Document: Data Center Management Use Case Revision 0 / June 2013