ESG_Lab_Validation_Fujitsu_ETERNUS_DX8000_Sep09
ESG_Lab_Validation_Fujitsu_ETERNUS_DX8000_Sep09
Report
Fujitsu ETERNUS DX8000
September 2009
Contents
Introduction.............................................................................................................................................3
Background......................................................................................................................................................... 3
Fujitsu ETERNUS DX ............................................................................................................................................ 4
ESG Lab Validation ...................................................................................................................................5
Ease of Deployment and Flexible Management ................................................................................................... 5
Eco-mode ......................................................................................................................................................... 10
Fujitsu ETERNUS DX Data Encryption................................................................................................................. 13
Performance and Scalability .............................................................................................................................. 16
SPC-1 Results .................................................................................................................................................... 18
Availability and Business Continuity .................................................................................................................. 20
VMware Site Recovery Manager ....................................................................................................................... 21
ESG Lab Validation Highlights................................................................................................................. 25
Issues to Consider ..................................................................................................................................25
The Bigger Truth ....................................................................................................................................26
Appendix ...............................................................................................................................................27
All trademark names are property of their respective companies. Information contained in this publication has been obtained by sources The Enterprise
Strategy Group (ESG) considers to be reliable but is not warranted by ESG. This publication may contain opinions of ESG, whic h are subject to change from
time to time. This publication is copyrighted by The Enterprise Strategy Group, Inc. Any reproduction or redistribution of this publication, in whole or in
part, whether in hard-copy format, electronically, or otherwise to persons not authorized to receive it, without the express consent of the Enterprise
Strategy Group, Inc., is in violation of U.S. Copyright law and will be subject to an action for civil damages and, if applic able, criminal prosecution. Should
you have any questions, please contact ESG Client Relations at (508) 482.0188.
Introduction
The Fujitsu ETERNUS DX8000 storage system is an extremely scalable enterprise-class storage platform that
combines massive scalability (up to 2.7 petabytes) with data availability, security, and operational efficiency. This
ESG Lab Report documents the results of hands-on testing of the DX8000 with a focus on performance and capacity
scalability, availability, data mobility, power efficiency, and security.
Background
Organizations of all sizes are struggling to meet the conflicting challenges associated with macroeconomic global
financial uncertainty and micro-level information storage growth and complexity. As users continue to struggle to
manage increasing volumes of data, they are also tasked to do so with constrained—or even reduced—resources.
Consequently, users are more willing than ever—even compelled, in certain cases—to look for new ways to address
their needs.
Figure 1. Top Storage Challenges
In general, what are your organization’s greatest challenges with respect to its
storage environment? (Percent of respondents, N=504, multiple responses accepted)
1
Source: ESG Research Report, 2008 Enterprise Storage Systems Survey, November 2008.
Fujitsu ETERNUS DX
Fujitsu has focused on these customer trends and priorities with its ETERNUS DX family of disk storage systems.
ETERNUS DX is designed to address the most crucial challenges faced by storage and IT managers.
Figure 2. The Fujitsu ETERNUS DX Family
The ETERNUS DX8000 is a massively scalable enterprise storage consolidation platform supporting both open
systems and mainframe connectivity. In addition to massive scalability, the DX8000 offers advanced storage
attributes and functionality that, though derived from Fujitsu’s mainframe roots, is attuned to the needs of today’s
enterprise:
Capacity and Performance Scalability – ETERNUS boasts the industry’s largest storage capacity (over 2.7
petabytes) and 2.83GHz quad core processors to significantly increase performance over previous
generations.
Data Integrity – ETERNUS DX offers data block checking and RAID6 (double parity) support.
Enhanced Security - Integrated hardware-based data encryption, both ‘on the fly’ for remote copy
functions and ‘at rest’ to secure data on drives removed from service, secures users’ data.
Data Protection and Availability - A variety of high-speed internal and external volume copy functions
provide high availability and business continuance.
Flexible Management and TCO Reduction - Capacity on Demand (CoD), online data migration, and thin
provisioning capacity virtualization enable better utilization of resources with no disruption to operations.
Green IT – Power and cooling requirements are reduced with Eco-mode using MAID technology and low-
power, high performance Enterprise SSD support.
The balance of this report presents the results of hands on testing of the Fujitsu ETERNUS DX disk storage systems
with an eye toward validating the performance, scalability, and reliability of the platform while examining its
advanced availability, environmental, and security features.
2
Configuration details can be found in the Appendix.
The RAIDGroup Operation screen, seen in Figure 5, shows all disks in the system and is color-coded for clarity.
Drives in RAID groups are identified by color, white designates hot spares, and dark gray indicates drives available
for assignment. ESG Lab selected eight available drives and created a RAID6 group.
Figure 5. Creating a RAID Group
Next, a 10 GB logical volume was created from the available capacity in the newly created RAID group. ESG Lab then
created an ‘affinity group,’ which is a key part of Fujitsu’s volume masking technology and assigned a pair of
ETERNUS DX fibre channel ports to it. 3 The 10 GB volume was added to the new affinity group and presented to an
attached server by assigning the host WWNs to the affinity group. The last step was to perform a rescan in
Windows disk administrator and format the new 10 GB volume. Start to finish, the entire volume creation and
assignment process took about 10 minutes. The Resource Coordinator Tool (not tested by ESG) enables access path
configuration, which gives the ability to configure end-to-end connectivity from ETERNUS DX fibre channel port to a
host HBA in one operation.
ESG Lab tested the ETERNUS DX platform’s ability to migrate volumes online, with a system actively reading and
writing to the volume. ESG Lab simulated an active application using the industry standard Iometer benchmarking
utility.4 First, Iometer was started on a server attached to the ETERNUS DX under test. A continuous OLTP database
workload was then run against a 10 GB volume mounted from the DX. While this simulated application workload
was reading and writing to the 10 GB volume, ESG lab used ETERNUS Manager to select the volume for migration,
seen in Figure 6.
Figure 6. Online RAID group Migration Setup: Select Source
3
Affinity groups contain unique host identifiers (Fibre Channel WWNs or iSCSI initiator IQN), WWNs of the ETERNUS fibre channel ports and
the volumes to be assigned to a host or group of hosts.
4
Iometer is an open-source I/O measurement and characterization utility, available for download at: http://www.iometer.org/
Next, the destination RAID group was selected and available space was allocated, as shown in Figure 7. Finally, ESG
Lab clicked ‘Set’ to execute the migration. ETERNUS Manager requested confirmation, displaying the source and
destination RAID groups. Upon clicking ‘OK,’ the volume migration began. A quick look at the server confirmed that
Iometer was still running with no disruption as the migration took place.
Figure 7. Online RAID group Migration Setup: Configure Target
Within a few minutes, the volume migration completed and ESG Lab then expanded the volume using Microsoft
Disk Administrator (see Figure 8). A final examination of Iometer showed that the application was still reading and
writing to the drive with no errors.
Eco-mode
Eco-mode is Fujitsu’s term for power consumption reduction using MAID technology. MAID, an acronym for
"Massive Array of Idle Disks," reduces power consumption by spinning down less frequently accessed disk drives
when not in use. Eco-mode can be set for any type of disk or RAID group in the array. After 30 minutes idle time,
drives are spun down, reducing power consumption. Read or write access to any volume on any drive in a spun
down RAID group will re-activate the drives. Re-activation can take anywhere from seconds to up to three minutes,
depending on the drive type and configuration.
Figure 9 shows the timeline of a use case for Eco-mode. In this instance, the customer uses a pool of large capacity
SATA disks as backup to disk targets. The drives are scheduled to spin up just before midnight, when nightly backup
jobs kick off. Thirty minutes after the last backup job completes, the drives spin down. The drives remain idle until
the next scheduled spin up or, in this case, a user requests a restore. At 9:01AM, the backup administrator initiates
the restore from the backup application. The drives spin up automatically and the restore runs. Thirty minutes after
the restore job completes, the drives spin down again.
Figure 9. Fujitsu ETERNUS DX Eco-mode
In this scenario, the backup to disk pool remains spun down for about 80% of the time, representing significant
power savings.
There is a drop down menu to select a schedule for disk active times if one is required. As seen in Figure 10, RAID
group 0x005 was active at the time Eco-mode was enabled. ESG Lab waited 30 minutes after setting Eco-mode and
checked back in using ETERNUS Manager. Figure 11 shows that the RAID group was reported as idle at this point.
Next, ESG Lab issued the ‘dd’ command on the Windows server. As shown in Figure 12, the response time after the
first command was issued was 11,078 ms, or just over 11 seconds. The second command to the volume returned a
response in 16ms, exactly as expected as the volume was spun back up. To help put this into context, the Fujitsu
design minimizes the power footprint by staging the spin-up of drives. This reduces the maximum power demand
that would result from powering up all drives simultaneously. While simultaneous spin-up would result in faster
initial response times, it would also require higher peak power demands on the customer’s environment.
Figure 12. Eco-mode in Action
Fujitsu is conservative in its estimates and states that drives can take between one and three minutes to re-activate
after spinning down. This depends heavily on the drive and RAID configuration; it will certainly take longer for a
RAID6 group made up of a large number of SATA drives to re-activate than a RAID-1 Fibre Channel drive pair.
5
Source: ESG Research Report, Global Green IT Priorities: Beyond Data Center Power and Cooling, November 2008.
After selecting volume 0x0030, a volume visible to a test server containing a group of copied files, ESG Lab began
the encryption process. Encryption status was visible directly from ETERNUS Manager. Once encryption was
complete, ESG Lab confirmed that the files on the drive were still visible from the test server. Next, Fujitsu removed
all the drives in the RAID group containing volume 0x0030 from the DX440 system and physically installed them in
another DX440.
As seen in Figure 15, the second DX440 was unable to read any of the encrypted volumes, returning errors for each
encrypted volume on the drives. The implementation of encryption in the ETERNUS DX400 and DX8000 is identical,
so testing with the DX440 provides a user experience and result exactly the same as would be achieved with an
DX8000.
6
Source: ESG Research Report, Protecting Confidential Data, March 2006.
40,000
35,000
30,000
Exchange Mailboxes
25,000
20,000
15,000
10,000
5,000
0
14 28 42 56 70 84 98 112
Number of Drives
ESG Lab Projected ESG Lab Tested
Source: Enterprise Strategy Group, 2009.
ESG lab observed a scaling factor of approximately 92% running the Exchange workloads on successively larger
groups of drives. Figure 17 shows the projected scalability of the ETERNUS DX platform’s support for Exchange
mailboxes using Microsoft’s Very Heavy user profile of .5 IOPs per mailbox. Scaling was nearly linear and response
7
http://www.fujitsu.com/downloads/STRSYS/system/eternus2000-esrpv.pdf
8
http://technet.microsoft.com/en-us/exchange/bb412164.aspx
times were about 15 ms for all tests. Table 1 shows the results of Iometer testing and estimated supportable
Exchange mailboxes using Microsoft’s Very Heavy user profile.
Table 1: Iometer Test Results and Projection
SPC-1 Results
ESG Lab audited Fujitsu’s published results of the SPC-1 application-level industry standard benchmark suite
maintained by the Storage Performance Council. SPC-1 testing generates a single workload designed to emulate
the typical functions of transaction-oriented, real-world database applications. Transaction-oriented applications
are generally characterized by random IO and generate both queries (reads) and updates (writes). Examples of
those types of applications include OLTP, database operations, and mail server implementations.
Figure 18. Fujitsu DX8400 SPC-1 Results
30
100%
25
Response Time (ms)
20
15
As seen in Figure 18, Fujitsu has published an excellent result of 109,246 SPC-1 IO requests per second at 95% load
with an average response time of less than 3.84 milliseconds. Response time is an extremely important component
of SPC results, as this is the delay that an application will experience (and pass on to users) when a storage system
is stressed to its limits. A system servicing 109,246 SPC-1 IO requests per second with a response time of 3.84 ms is
exceptional.
The SPC-1 benchmark synthesizes a community of users running against storage that is organized logically as would
be encountered in a real-world application. SPC is one of the few benchmarks in the industry that helps to deliver
value in the area of real world performance characterization. SPC results can be roughly mapped by users into
easily understood metrics. For a credit card database system, for instance, it might be the number of credit card
authorizations that can be executed per second.
It should be noted that the numbers published in these reports are for the previous generation Fujitsu ETERNUS DX
subsystems. As of this writing, Fujitsu is working toward the release of updated benchmarks which should present
higher performance numbers than currently published.
SPC-1 results are audited by the Storage Performance Council and peer reviewed to ensure consistency. Executive
Summary and Full Disclosure Reports (FDRs) for each SPC benchmark result are publicly available for download and
review.9 While this can be useful for comparison between vendors, it is important to note that not all vendors
participate and publish results. ESG Lab applauds Fujitsu’s participation in this peer-reviewed program and hopes
that it will encourage other vendors of enterprise class storage systems to participate.
9
http://www.storageperformance.org/results/benchmark_results_spc1
10
Source: ESG Research Report, The Impact of Server Virtualization on Storage, December 2007.
It’s important to note that the procedure for replacing the drive is clearly presented by ETERNUS Manager, giving
customer service personnel unambiguous indication of the drive to be replaced and the methodology for non-
disruptively doing so.
Next, ESG Lab pulled a power cable, removed two of the four Fibre Channel connections to the ESX server, and
disabled one of the two main controller modules in the system, pausing to examine ETERNUS Manager between
each event. After each event, the administrator received an e-mail detailing the fault and a call was placed to
Fujitsu support. Iometer continued to run through every event, with no errors and only a momentary pause in IO
when the controller module was forced down.
VMware ESXi version 3.5, update 4, was used to deploy virtual machines in each of the data centers. All of the
virtual machines ran the Windows 2003 Enterprise x64, SP1 operating system. The DX8400 system ran firmware
version V11L71 and the DX440 ran firmware version V20L15. ETERNUS SF Advanced Copy Manager was used to
replicate data volumes between systems.
11
See the Appendix for more configuration details.
The fully automated recovery completed in less than five minutes. Three minutes after the failover had completed,
the virtual machine was booted and running, as seen in Figure 22.
Figure 23 shows the website up and running on a virtual machine in the secondary system.
Figure 23. Applications Recovered and Running at Secondary Site
Once ESG Lab confirmed that the web server was up and that all documents and pages from the primary system
were online and complete, the systems and applications were failed back to the primary data center. The VMware
infrastructure manager console at the primary site was used to define a new recovery plan using the wizard-driven
process described earlier in this report (see page 22). Except for the swapping of IP addresses for the VMware and
storage resources at the secondary data center, the process was exactly the same.
Less than thirty minutes after getting started with the definition of a failback plan, the website was back up and
running at the primary data center.
Issues to Consider
While ESG Lab found management of the ETERNUS DX platform to be robust and stable, there are multiple
management interfaces: a client server application and a web interface to manage each system. There is
some overlap, but in some areas, these apps provide a unique subset of functionality. Ideally, ESG would
like to see these management apps consolidated or at least merged, such that all functionality is available
on whichever app an administrator chooses to utilize.
Appendix
Table 2. Test Configuration