SlideShare a Scribd company logo
Independent Analysis of Storage and Data Protection
Why is Virtualization creating
Storage Sprawl?
by George Crump, Lead Analyst
Desktop and server virtualization have brought many benefits to the data center. These two initiatives have
allowed IT to respond quickly to the needs of the organization while driving down IT costs, physical footprint
requirements and energy demands. But there is one area of the data center that has actually increased in cost
since virtualization started to make its way into production… storage. Because of virtualization, more data centers
need flash to meet the random I/O nature of the virtualized environment, which of course is more expensive, on
a dollar per GB basis, than hard disk drives. The single biggest problem however is the significant increase in the
number of discrete storage systems that service the environment. This “storage sprawl” threatens the return on
investment (ROI) of virtualization projects and makes storage more complex to manage.
Why is Storage Sprawl Worse in Virtual Environments?
Storage sprawl has become worse in organizations that have made a significant investment in virtualization
technologies. For example most virtual desktop infrastructures (VDI) have an allflash array to handle desktop
images, preventing boot storms, logout storms and maintaining acceptable performance throughout the day.
But most VDI environments also need a file store for user home directories. There is little to be gained if this data
is placed on the all-flash array, but certainly data centers need to provide storage to their users to support user
created data. As a result most organizations end up buying a separate Network Attached Storage (NAS) device
to support user home directories and other types of unstructured data.
The virtual server environment will also see multiple storage systems implemented to support its operation.
This includes a high performance system, typically an all-flash array, to make sure that critical applications
experience a performance profile similar to their bare metal days. There is also a workhorse type of system
that today is often a mix of flash and hard disk drives, a hybrid system. The role of this system is to support
the mid-tier applications and services.
Finally there is a third type of storage often used for old VMs and sometimes old user data, as well as data being
collected from big data sources like sensors. This system is often capacity focused using high capacity hard
drives to create an affordable storage area for this “at rest” data.
Does Storage Sprawl Matter?
Some vendors will claim that storage sprawl no longer matters in virtualized environments, that the hypervisor
can manage the movement of virtual machine data between types of storage, just like it moves virtual machines
between different types of compute servers. This line of thinking encourages the purchase of the above purpose
specific storage systems; an all-flash array for performance sensitive VMs, a hybrid array for more modest VMs
www.storageswiss.com ©2015, Storage Switzerland, All rights reserved
and a hard disk based system for VMs that have no use for the performance that a flash based system could
provide.
What is not explained is that these separate silos of storage still need to be managed. They often use their own
unique snapshot, replication and other data services per system. That means that an IT administrator needs to
learn each storage system interface and scripting language. It also means that when data is transferred between
these systems, that the application may see a performance slow down, and may cause an outage, while this
migration occurs. The transfer needs to copy or move data from the primary storage system to the alternative
storage system and that means, at a minimum, transferring data across the storage network and potentially
the general purpose network. Finally, there is an optimization issue. Similar to direct attached storage, silos
of shared storage can’t be used optimally because there is rarely a balance between performance focused
applications and capacity based ones.
Storage sprawl results in three issues for IT managers. First is wasted IT administrator time even though some-
thing like an all-flash or even a hybrid array was purchased to reduce time spent tuning storage performance.
The second factor is unpredictable performance deliverables, even though these systems were implemented
to resolve that issue. The need to transfer data across a network will alter performance characteristics. And
third the imbalance of performance and capacity resources among the storage silos.
Can Sprawl Be Stopped?
The solution, a high-performance mixed workload storage system that supports a wide variety of workloads and
a wide variety of storage protocols while delivering the performance and storage economics that the various
workloads need. The key to full return on storage consolidation investment is a single system that can be fully
utilized while still delivering on the specific demands required by each workload it supports.
Why Stop Virtualization’s Storage Sprawl
For a storage system to stop storage sprawl there are several key requirements which it must deliver, and if it
can successfully deliver these requirements, then the benefits of a single system are numerous. First a single
unit is simply easier to manage. No matter how much software is layered over the management of multiple
storage systems, it can’t hide the fact that there are indeed multiple storage systems there that require more
time to manage.
The second benefit is that a single storage system can be used more efficiently. A data center with a single
storage system never has to worry about storage system B running out of storage capacity while storage
system A is running out of storage performance.
The third benefit is economics. Even if the independent storage systems are priced aggressively, the
organization is still paying for multiple storage controllers, storage capacity and storage software features.
And of course, each will have its own service agreement that has to be maintained.
The Requirements for Consolidated Storage
The first requirement is for mixed media. While flash has become less expensive, it is still not as competitive as
capacity disk pricing. And a storage system that is trying to consolidate ALL storage will be required to support
data types that simply don’t belong on flash. At the same time, performance demands need to be addressed
www.storageswiss.com ©2015, Storage Switzerland, All rights reserved
by the consolidated storage system. These systems will also have to leverage flash storage to meet those
demands. Further they should than what flash can provide it is able to deliver that too.
The second requirement is for a high performance HDD tier. Too many hybrid storage systems leverage flash
and then only high capacity HDDs as their second tier. The problem is that high capacity hard drives are slower,
and because fewer of them are required to meet the capacity demands of the environment there are less of the
drives to dedicate to performance.
The consolidated system needs to leverage faster performing drives of more moderate capacity. This also
means that more drives will be used. This combination will deliver respectable HDD performance without
increasing cost. More importantly, there will be less of a drop off between flash and HDD performance in
the case of a cache miss.
The third requirement is that the consolidated storage system also support multiple protocols. This means going
beyond the classic SAN/NAS support and providing both Object and even Mainframe access. For storage
consolidation to make sense it needs to move beyond the virtualized use case and be able to provide capacity
for analytics and other workload types.
The fourth requirement is that the consolidated system be able to keep up with performance and capacity
demands as they continue to increase over time. This means that the system should have the ability to scale-out
instead of scale up. A scale-out system allows the organization to avoid costly fork-lift upgrades to their storage
systems. This is even more critical as workloads are consolidated since the used capacity of the system will be
so much higher. High capacity means longer migrations; longer migrations mean more downtime. Scale-out
eliminates the need for migration.
Finally, and most important, is the need for a highly reliable system with multiple points of redundancy. If the
storage system is truly going to be the only storage system in the environment, then it can’t fail or experience
any outages. This reliability should be adjustable by application or workload so that mission critical workloads
could survive multiple outages.
Conclusion
A single consolidated storage system should bring many benefits to the organization, but those benefits
come at a risk of variable application performance and also a greater risk of failure. To mitigate these risks the
consolidating storage system needs to leverage multiple types of storage media and have multiple points of
redundancy built into the system. If this combination can be delivered, the virtual environment should become
simpler to administrate while also being less expensive to run.
Sponsored by INFINIDAT
Storage Switzerland is the leading storage analyst firm focused on the emerging storage categories of memory
based storage (Flash), big data, virtualization, cloud computing and data protection. The firm is widely recognized
for its blogs, white papers, and videos on such current technologies like all-flash arrays, deduplication, software-
defined storage, backup appliances, and storage networking. The “Switzerland” in the firm’s name indicates our
pledge to provide neutral analysis of the storage marketplace, rather than focusing on a single vendor or approach.
INFINIDAT has brought to market InfiniBox, a new generation of highly reliable, scalable and efficient storage
systems designed specifically to support a wide variety of workload types, including those in virtual architectures.
InfiniBox allows an organization to consolidate down to a single solution that has the performance, capacity
and affordability to support most of an organization’s workloads.

More Related Content

What's hot (20)

Sample_Blueprint-Fault_Tolerant_NAS
Sample_Blueprint-Fault_Tolerant_NASSample_Blueprint-Fault_Tolerant_NAS
Sample_Blueprint-Fault_Tolerant_NAS
Mike Alvarado
 
Insiders Guide- Managing Storage Performance
Insiders Guide- Managing Storage PerformanceInsiders Guide- Managing Storage Performance
Insiders Guide- Managing Storage Performance
DataCore Software
 
Sun Open Storage
Sun Open StorageSun Open Storage
Sun Open Storage
Victor Castro
 
Configuration and Deployment Guide For Memcached on Intel® Architecture
Configuration and Deployment Guide For Memcached on Intel® ArchitectureConfiguration and Deployment Guide For Memcached on Intel® Architecture
Configuration and Deployment Guide For Memcached on Intel® Architecture
Odinot Stanislas
 
Windows server 2012 R2 private cloud virtualization and storage
Windows server 2012 R2 private cloud virtualization and storageWindows server 2012 R2 private cloud virtualization and storage
Windows server 2012 R2 private cloud virtualization and storage
Sathishkumar A
 
Vmware virtualization in data centers
Vmware virtualization in data centersVmware virtualization in data centers
Vmware virtualization in data centers
HarshitTaneja13
 
New Features For Your Software Defined Storage
New Features For Your Software Defined StorageNew Features For Your Software Defined Storage
New Features For Your Software Defined Storage
DataCore Software
 
IBM Storwize V7000 and Storwize V7000 Unified Disk Systems
IBM Storwize V7000 and Storwize V7000 Unified Disk SystemsIBM Storwize V7000 and Storwize V7000 Unified Disk Systems
IBM Storwize V7000 and Storwize V7000 Unified Disk Systems
IBM India Smarter Computing
 
twp-oracledatabasebackupservice-2183633
twp-oracledatabasebackupservice-2183633twp-oracledatabasebackupservice-2183633
twp-oracledatabasebackupservice-2183633
Arush Jain
 
Flashelastic
FlashelasticFlashelastic
Flashelastic
Bruce Lethaby
 
Data Warehouse Scalability Using Cisco Unified Computing System and Oracle Re...
Data Warehouse Scalability Using Cisco Unified Computing System and Oracle Re...Data Warehouse Scalability Using Cisco Unified Computing System and Oracle Re...
Data Warehouse Scalability Using Cisco Unified Computing System and Oracle Re...
EMC
 
Information Storage and Management notes ssmeena
Information Storage and Management notes ssmeena Information Storage and Management notes ssmeena
Information Storage and Management notes ssmeena
ssmeena7
 
Data Domain Architecture
Data Domain ArchitectureData Domain Architecture
Data Domain Architecture
koesteruk22
 
[IJET-V1I6P11] Authors: A.Stenila, M. Kavitha, S.Alonshia
[IJET-V1I6P11] Authors: A.Stenila, M. Kavitha, S.Alonshia[IJET-V1I6P11] Authors: A.Stenila, M. Kavitha, S.Alonshia
[IJET-V1I6P11] Authors: A.Stenila, M. Kavitha, S.Alonshia
IJET - International Journal of Engineering and Techniques
 
Connect July-Aug 2014
Connect July-Aug 2014Connect July-Aug 2014
Connect July-Aug 2014
Glenn Garrahan
 
White Paper: Optimizing Primary Storage Through File Archiving with EMC Cloud...
White Paper: Optimizing Primary Storage Through File Archiving with EMC Cloud...White Paper: Optimizing Primary Storage Through File Archiving with EMC Cloud...
White Paper: Optimizing Primary Storage Through File Archiving with EMC Cloud...
EMC
 
Positioning IBM Flex System 16 Gb Fibre Channel Fabric for Storage-Intensive ...
Positioning IBM Flex System 16 Gb Fibre Channel Fabric for Storage-Intensive ...Positioning IBM Flex System 16 Gb Fibre Channel Fabric for Storage-Intensive ...
Positioning IBM Flex System 16 Gb Fibre Channel Fabric for Storage-Intensive ...
IBM India Smarter Computing
 
8 Strategies For Building A Modern DataCenter
8 Strategies For Building A Modern DataCenter8 Strategies For Building A Modern DataCenter
8 Strategies For Building A Modern DataCenter
Envision Technology Advisors
 
Dmg emc-avamar-optimized-backup-recovery-dedupe[1]
Dmg emc-avamar-optimized-backup-recovery-dedupe[1]Dmg emc-avamar-optimized-backup-recovery-dedupe[1]
Dmg emc-avamar-optimized-backup-recovery-dedupe[1]
Nitesh Bhat
 
Generic RLM White Paper
Generic RLM White PaperGeneric RLM White Paper
Generic RLM White Paper
Mike Mendola ([email protected])
 
Sample_Blueprint-Fault_Tolerant_NAS
Sample_Blueprint-Fault_Tolerant_NASSample_Blueprint-Fault_Tolerant_NAS
Sample_Blueprint-Fault_Tolerant_NAS
Mike Alvarado
 
Insiders Guide- Managing Storage Performance
Insiders Guide- Managing Storage PerformanceInsiders Guide- Managing Storage Performance
Insiders Guide- Managing Storage Performance
DataCore Software
 
Configuration and Deployment Guide For Memcached on Intel® Architecture
Configuration and Deployment Guide For Memcached on Intel® ArchitectureConfiguration and Deployment Guide For Memcached on Intel® Architecture
Configuration and Deployment Guide For Memcached on Intel® Architecture
Odinot Stanislas
 
Windows server 2012 R2 private cloud virtualization and storage
Windows server 2012 R2 private cloud virtualization and storageWindows server 2012 R2 private cloud virtualization and storage
Windows server 2012 R2 private cloud virtualization and storage
Sathishkumar A
 
Vmware virtualization in data centers
Vmware virtualization in data centersVmware virtualization in data centers
Vmware virtualization in data centers
HarshitTaneja13
 
New Features For Your Software Defined Storage
New Features For Your Software Defined StorageNew Features For Your Software Defined Storage
New Features For Your Software Defined Storage
DataCore Software
 
IBM Storwize V7000 and Storwize V7000 Unified Disk Systems
IBM Storwize V7000 and Storwize V7000 Unified Disk SystemsIBM Storwize V7000 and Storwize V7000 Unified Disk Systems
IBM Storwize V7000 and Storwize V7000 Unified Disk Systems
IBM India Smarter Computing
 
twp-oracledatabasebackupservice-2183633
twp-oracledatabasebackupservice-2183633twp-oracledatabasebackupservice-2183633
twp-oracledatabasebackupservice-2183633
Arush Jain
 
Data Warehouse Scalability Using Cisco Unified Computing System and Oracle Re...
Data Warehouse Scalability Using Cisco Unified Computing System and Oracle Re...Data Warehouse Scalability Using Cisco Unified Computing System and Oracle Re...
Data Warehouse Scalability Using Cisco Unified Computing System and Oracle Re...
EMC
 
Information Storage and Management notes ssmeena
Information Storage and Management notes ssmeena Information Storage and Management notes ssmeena
Information Storage and Management notes ssmeena
ssmeena7
 
Data Domain Architecture
Data Domain ArchitectureData Domain Architecture
Data Domain Architecture
koesteruk22
 
White Paper: Optimizing Primary Storage Through File Archiving with EMC Cloud...
White Paper: Optimizing Primary Storage Through File Archiving with EMC Cloud...White Paper: Optimizing Primary Storage Through File Archiving with EMC Cloud...
White Paper: Optimizing Primary Storage Through File Archiving with EMC Cloud...
EMC
 
Positioning IBM Flex System 16 Gb Fibre Channel Fabric for Storage-Intensive ...
Positioning IBM Flex System 16 Gb Fibre Channel Fabric for Storage-Intensive ...Positioning IBM Flex System 16 Gb Fibre Channel Fabric for Storage-Intensive ...
Positioning IBM Flex System 16 Gb Fibre Channel Fabric for Storage-Intensive ...
IBM India Smarter Computing
 
Dmg emc-avamar-optimized-backup-recovery-dedupe[1]
Dmg emc-avamar-optimized-backup-recovery-dedupe[1]Dmg emc-avamar-optimized-backup-recovery-dedupe[1]
Dmg emc-avamar-optimized-backup-recovery-dedupe[1]
Nitesh Bhat
 

Similar to Why is Virtualization Creating Storage Sprawl? By Storage Switzerland (20)

Workload Centric Scale-Out Storage for Next Generation Datacenter
Workload Centric Scale-Out Storage for Next Generation DatacenterWorkload Centric Scale-Out Storage for Next Generation Datacenter
Workload Centric Scale-Out Storage for Next Generation Datacenter
Cloudian
 
Net App Unified Storage Architecture
Net App Unified Storage ArchitectureNet App Unified Storage Architecture
Net App Unified Storage Architecture
Samantha_Roehl
 
Netmagic the-storage-matrix
Netmagic the-storage-matrixNetmagic the-storage-matrix
Netmagic the-storage-matrix
Netmagic Solutions Pvt. Ltd.
 
The storage matrix netmagic
The storage matrix   netmagicThe storage matrix   netmagic
The storage matrix netmagic
Netmagic Solutions Pvt. Ltd.
 
Streamlining Backup: Enhancing Data Protection with Backup Appliances
Streamlining Backup: Enhancing Data Protection with Backup AppliancesStreamlining Backup: Enhancing Data Protection with Backup Appliances
Streamlining Backup: Enhancing Data Protection with Backup Appliances
MaryJWilliams2
 
Storage Area Networks Unit 1 Notes
Storage Area Networks Unit 1 NotesStorage Area Networks Unit 1 Notes
Storage Area Networks Unit 1 Notes
Sudarshan Dhondaley
 
Breaking Boundaries: Overcoming Traditional Backup Limitations with Innovativ...
Breaking Boundaries: Overcoming Traditional Backup Limitations with Innovativ...Breaking Boundaries: Overcoming Traditional Backup Limitations with Innovativ...
Breaking Boundaries: Overcoming Traditional Backup Limitations with Innovativ...
MaryJWilliams2
 
[IC Manage] Workspace Acceleration & Network Storage Reduction
[IC Manage] Workspace Acceleration & Network Storage Reduction[IC Manage] Workspace Acceleration & Network Storage Reduction
[IC Manage] Workspace Acceleration & Network Storage Reduction
Perforce
 
Today's Need To Manage The Storage Polymorphism
Today's Need To Manage The Storage PolymorphismToday's Need To Manage The Storage Polymorphism
Today's Need To Manage The Storage Polymorphism
Netmagic Solutions Pvt. Ltd.
 
Storage Strategies Now- Virtualizaing Busines Critical applications
Storage Strategies Now- Virtualizaing Busines Critical applicationsStorage Strategies Now- Virtualizaing Busines Critical applications
Storage Strategies Now- Virtualizaing Busines Critical applications
DataCore Software
 
Conspectus data warehousing appliances – fad or future
Conspectus   data warehousing appliances – fad or futureConspectus   data warehousing appliances – fad or future
Conspectus data warehousing appliances – fad or future
David Walker
 
Veritas Failover3
Veritas Failover3Veritas Failover3
Veritas Failover3
grogers1124
 
TSS03135-USEN-00_HR
TSS03135-USEN-00_HRTSS03135-USEN-00_HR
TSS03135-USEN-00_HR
Ed Ahl
 
Waters Grid & HPC Course
Waters Grid & HPC CourseWaters Grid & HPC Course
Waters Grid & HPC Course
jimliddle
 
In the Age of Unstructured Data, Enterprise-Class Unified Storage Gives IT a ...
In the Age of Unstructured Data, Enterprise-Class Unified Storage Gives IT a ...In the Age of Unstructured Data, Enterprise-Class Unified Storage Gives IT a ...
In the Age of Unstructured Data, Enterprise-Class Unified Storage Gives IT a ...
Hitachi Vantara
 
EOUG95 - Client Server Very Large Databases - Paper
EOUG95 - Client Server Very Large Databases - PaperEOUG95 - Client Server Very Large Databases - Paper
EOUG95 - Client Server Very Large Databases - Paper
David Walker
 
Hyperconvergence Facts and FAQs
Hyperconvergence Facts and FAQsHyperconvergence Facts and FAQs
Hyperconvergence Facts and FAQs
Springpath
 
A FILE STORAGE SERVICE ON A CLOUD COMPUTING ENVIRONMENT FOR DIGITAL.pdf
A FILE STORAGE SERVICE ON A CLOUD COMPUTING ENVIRONMENT FOR DIGITAL.pdfA FILE STORAGE SERVICE ON A CLOUD COMPUTING ENVIRONMENT FOR DIGITAL.pdf
A FILE STORAGE SERVICE ON A CLOUD COMPUTING ENVIRONMENT FOR DIGITAL.pdf
hoangdinhhanh88
 
Backing Up Mountains of Data to Disk
Backing Up Mountains of Data to DiskBacking Up Mountains of Data to Disk
Backing Up Mountains of Data to Disk
IT Brand Pulse
 
2020 Cloud Data Lake Platforms Buyers Guide - White paper | Qubole
2020 Cloud Data Lake Platforms Buyers Guide - White paper | Qubole2020 Cloud Data Lake Platforms Buyers Guide - White paper | Qubole
2020 Cloud Data Lake Platforms Buyers Guide - White paper | Qubole
Vasu S
 
Workload Centric Scale-Out Storage for Next Generation Datacenter
Workload Centric Scale-Out Storage for Next Generation DatacenterWorkload Centric Scale-Out Storage for Next Generation Datacenter
Workload Centric Scale-Out Storage for Next Generation Datacenter
Cloudian
 
Net App Unified Storage Architecture
Net App Unified Storage ArchitectureNet App Unified Storage Architecture
Net App Unified Storage Architecture
Samantha_Roehl
 
Streamlining Backup: Enhancing Data Protection with Backup Appliances
Streamlining Backup: Enhancing Data Protection with Backup AppliancesStreamlining Backup: Enhancing Data Protection with Backup Appliances
Streamlining Backup: Enhancing Data Protection with Backup Appliances
MaryJWilliams2
 
Storage Area Networks Unit 1 Notes
Storage Area Networks Unit 1 NotesStorage Area Networks Unit 1 Notes
Storage Area Networks Unit 1 Notes
Sudarshan Dhondaley
 
Breaking Boundaries: Overcoming Traditional Backup Limitations with Innovativ...
Breaking Boundaries: Overcoming Traditional Backup Limitations with Innovativ...Breaking Boundaries: Overcoming Traditional Backup Limitations with Innovativ...
Breaking Boundaries: Overcoming Traditional Backup Limitations with Innovativ...
MaryJWilliams2
 
[IC Manage] Workspace Acceleration & Network Storage Reduction
[IC Manage] Workspace Acceleration & Network Storage Reduction[IC Manage] Workspace Acceleration & Network Storage Reduction
[IC Manage] Workspace Acceleration & Network Storage Reduction
Perforce
 
Storage Strategies Now- Virtualizaing Busines Critical applications
Storage Strategies Now- Virtualizaing Busines Critical applicationsStorage Strategies Now- Virtualizaing Busines Critical applications
Storage Strategies Now- Virtualizaing Busines Critical applications
DataCore Software
 
Conspectus data warehousing appliances – fad or future
Conspectus   data warehousing appliances – fad or futureConspectus   data warehousing appliances – fad or future
Conspectus data warehousing appliances – fad or future
David Walker
 
Veritas Failover3
Veritas Failover3Veritas Failover3
Veritas Failover3
grogers1124
 
TSS03135-USEN-00_HR
TSS03135-USEN-00_HRTSS03135-USEN-00_HR
TSS03135-USEN-00_HR
Ed Ahl
 
Waters Grid & HPC Course
Waters Grid & HPC CourseWaters Grid & HPC Course
Waters Grid & HPC Course
jimliddle
 
In the Age of Unstructured Data, Enterprise-Class Unified Storage Gives IT a ...
In the Age of Unstructured Data, Enterprise-Class Unified Storage Gives IT a ...In the Age of Unstructured Data, Enterprise-Class Unified Storage Gives IT a ...
In the Age of Unstructured Data, Enterprise-Class Unified Storage Gives IT a ...
Hitachi Vantara
 
EOUG95 - Client Server Very Large Databases - Paper
EOUG95 - Client Server Very Large Databases - PaperEOUG95 - Client Server Very Large Databases - Paper
EOUG95 - Client Server Very Large Databases - Paper
David Walker
 
Hyperconvergence Facts and FAQs
Hyperconvergence Facts and FAQsHyperconvergence Facts and FAQs
Hyperconvergence Facts and FAQs
Springpath
 
A FILE STORAGE SERVICE ON A CLOUD COMPUTING ENVIRONMENT FOR DIGITAL.pdf
A FILE STORAGE SERVICE ON A CLOUD COMPUTING ENVIRONMENT FOR DIGITAL.pdfA FILE STORAGE SERVICE ON A CLOUD COMPUTING ENVIRONMENT FOR DIGITAL.pdf
A FILE STORAGE SERVICE ON A CLOUD COMPUTING ENVIRONMENT FOR DIGITAL.pdf
hoangdinhhanh88
 
Backing Up Mountains of Data to Disk
Backing Up Mountains of Data to DiskBacking Up Mountains of Data to Disk
Backing Up Mountains of Data to Disk
IT Brand Pulse
 
2020 Cloud Data Lake Platforms Buyers Guide - White paper | Qubole
2020 Cloud Data Lake Platforms Buyers Guide - White paper | Qubole2020 Cloud Data Lake Platforms Buyers Guide - White paper | Qubole
2020 Cloud Data Lake Platforms Buyers Guide - White paper | Qubole
Vasu S
 

Recently uploaded (20)

TrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business ConsultingTrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business Consulting
Trs Labs
 
Linux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded DevelopersLinux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded Developers
Toradex
 
Rusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond SparkRusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond Spark
carlyakerly1
 
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfThe Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
Abi john
 
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
BookNet Canada
 
Role of Data Annotation Services in AI-Powered Manufacturing
Role of Data Annotation Services in AI-Powered ManufacturingRole of Data Annotation Services in AI-Powered Manufacturing
Role of Data Annotation Services in AI-Powered Manufacturing
Andrew Leo
 
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
organizerofv
 
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfSAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
Precisely
 
Semantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AISemantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AI
artmondano
 
ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes Partner Innovation Updates for May 2025ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes
 
2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptx2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptx
Samuele Fogagnolo
 
Heap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and DeletionHeap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and Deletion
Jaydeep Kale
 
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath MaestroDev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
UiPathCommunity
 
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Impelsys Inc.
 
Linux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdfLinux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdf
RHCSA Guru
 
Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)
Ortus Solutions, Corp
 
tecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdftecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdf
fjgm517
 
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Aqusag Technologies
 
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
BookNet Canada
 
Drupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy ConsumptionDrupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy Consumption
Exove
 
TrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business ConsultingTrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business Consulting
Trs Labs
 
Linux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded DevelopersLinux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded Developers
Toradex
 
Rusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond SparkRusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond Spark
carlyakerly1
 
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfThe Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
Abi john
 
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
BookNet Canada
 
Role of Data Annotation Services in AI-Powered Manufacturing
Role of Data Annotation Services in AI-Powered ManufacturingRole of Data Annotation Services in AI-Powered Manufacturing
Role of Data Annotation Services in AI-Powered Manufacturing
Andrew Leo
 
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
organizerofv
 
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfSAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
Precisely
 
Semantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AISemantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AI
artmondano
 
ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes Partner Innovation Updates for May 2025ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes
 
2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptx2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptx
Samuele Fogagnolo
 
Heap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and DeletionHeap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and Deletion
Jaydeep Kale
 
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath MaestroDev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
UiPathCommunity
 
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Impelsys Inc.
 
Linux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdfLinux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdf
RHCSA Guru
 
Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)
Ortus Solutions, Corp
 
tecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdftecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdf
fjgm517
 
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Aqusag Technologies
 
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
BookNet Canada
 
Drupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy ConsumptionDrupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy Consumption
Exove
 

Why is Virtualization Creating Storage Sprawl? By Storage Switzerland

  • 1. Independent Analysis of Storage and Data Protection Why is Virtualization creating Storage Sprawl? by George Crump, Lead Analyst Desktop and server virtualization have brought many benefits to the data center. These two initiatives have allowed IT to respond quickly to the needs of the organization while driving down IT costs, physical footprint requirements and energy demands. But there is one area of the data center that has actually increased in cost since virtualization started to make its way into production… storage. Because of virtualization, more data centers need flash to meet the random I/O nature of the virtualized environment, which of course is more expensive, on a dollar per GB basis, than hard disk drives. The single biggest problem however is the significant increase in the number of discrete storage systems that service the environment. This “storage sprawl” threatens the return on investment (ROI) of virtualization projects and makes storage more complex to manage. Why is Storage Sprawl Worse in Virtual Environments? Storage sprawl has become worse in organizations that have made a significant investment in virtualization technologies. For example most virtual desktop infrastructures (VDI) have an allflash array to handle desktop images, preventing boot storms, logout storms and maintaining acceptable performance throughout the day. But most VDI environments also need a file store for user home directories. There is little to be gained if this data is placed on the all-flash array, but certainly data centers need to provide storage to their users to support user created data. As a result most organizations end up buying a separate Network Attached Storage (NAS) device to support user home directories and other types of unstructured data. The virtual server environment will also see multiple storage systems implemented to support its operation. This includes a high performance system, typically an all-flash array, to make sure that critical applications experience a performance profile similar to their bare metal days. There is also a workhorse type of system that today is often a mix of flash and hard disk drives, a hybrid system. The role of this system is to support the mid-tier applications and services. Finally there is a third type of storage often used for old VMs and sometimes old user data, as well as data being collected from big data sources like sensors. This system is often capacity focused using high capacity hard drives to create an affordable storage area for this “at rest” data. Does Storage Sprawl Matter? Some vendors will claim that storage sprawl no longer matters in virtualized environments, that the hypervisor can manage the movement of virtual machine data between types of storage, just like it moves virtual machines between different types of compute servers. This line of thinking encourages the purchase of the above purpose specific storage systems; an all-flash array for performance sensitive VMs, a hybrid array for more modest VMs www.storageswiss.com ©2015, Storage Switzerland, All rights reserved
  • 2. and a hard disk based system for VMs that have no use for the performance that a flash based system could provide. What is not explained is that these separate silos of storage still need to be managed. They often use their own unique snapshot, replication and other data services per system. That means that an IT administrator needs to learn each storage system interface and scripting language. It also means that when data is transferred between these systems, that the application may see a performance slow down, and may cause an outage, while this migration occurs. The transfer needs to copy or move data from the primary storage system to the alternative storage system and that means, at a minimum, transferring data across the storage network and potentially the general purpose network. Finally, there is an optimization issue. Similar to direct attached storage, silos of shared storage can’t be used optimally because there is rarely a balance between performance focused applications and capacity based ones. Storage sprawl results in three issues for IT managers. First is wasted IT administrator time even though some- thing like an all-flash or even a hybrid array was purchased to reduce time spent tuning storage performance. The second factor is unpredictable performance deliverables, even though these systems were implemented to resolve that issue. The need to transfer data across a network will alter performance characteristics. And third the imbalance of performance and capacity resources among the storage silos. Can Sprawl Be Stopped? The solution, a high-performance mixed workload storage system that supports a wide variety of workloads and a wide variety of storage protocols while delivering the performance and storage economics that the various workloads need. The key to full return on storage consolidation investment is a single system that can be fully utilized while still delivering on the specific demands required by each workload it supports. Why Stop Virtualization’s Storage Sprawl For a storage system to stop storage sprawl there are several key requirements which it must deliver, and if it can successfully deliver these requirements, then the benefits of a single system are numerous. First a single unit is simply easier to manage. No matter how much software is layered over the management of multiple storage systems, it can’t hide the fact that there are indeed multiple storage systems there that require more time to manage. The second benefit is that a single storage system can be used more efficiently. A data center with a single storage system never has to worry about storage system B running out of storage capacity while storage system A is running out of storage performance. The third benefit is economics. Even if the independent storage systems are priced aggressively, the organization is still paying for multiple storage controllers, storage capacity and storage software features. And of course, each will have its own service agreement that has to be maintained. The Requirements for Consolidated Storage The first requirement is for mixed media. While flash has become less expensive, it is still not as competitive as capacity disk pricing. And a storage system that is trying to consolidate ALL storage will be required to support data types that simply don’t belong on flash. At the same time, performance demands need to be addressed www.storageswiss.com ©2015, Storage Switzerland, All rights reserved
  • 3. by the consolidated storage system. These systems will also have to leverage flash storage to meet those demands. Further they should than what flash can provide it is able to deliver that too. The second requirement is for a high performance HDD tier. Too many hybrid storage systems leverage flash and then only high capacity HDDs as their second tier. The problem is that high capacity hard drives are slower, and because fewer of them are required to meet the capacity demands of the environment there are less of the drives to dedicate to performance. The consolidated system needs to leverage faster performing drives of more moderate capacity. This also means that more drives will be used. This combination will deliver respectable HDD performance without increasing cost. More importantly, there will be less of a drop off between flash and HDD performance in the case of a cache miss. The third requirement is that the consolidated storage system also support multiple protocols. This means going beyond the classic SAN/NAS support and providing both Object and even Mainframe access. For storage consolidation to make sense it needs to move beyond the virtualized use case and be able to provide capacity for analytics and other workload types. The fourth requirement is that the consolidated system be able to keep up with performance and capacity demands as they continue to increase over time. This means that the system should have the ability to scale-out instead of scale up. A scale-out system allows the organization to avoid costly fork-lift upgrades to their storage systems. This is even more critical as workloads are consolidated since the used capacity of the system will be so much higher. High capacity means longer migrations; longer migrations mean more downtime. Scale-out eliminates the need for migration. Finally, and most important, is the need for a highly reliable system with multiple points of redundancy. If the storage system is truly going to be the only storage system in the environment, then it can’t fail or experience any outages. This reliability should be adjustable by application or workload so that mission critical workloads could survive multiple outages. Conclusion A single consolidated storage system should bring many benefits to the organization, but those benefits come at a risk of variable application performance and also a greater risk of failure. To mitigate these risks the consolidating storage system needs to leverage multiple types of storage media and have multiple points of redundancy built into the system. If this combination can be delivered, the virtual environment should become simpler to administrate while also being less expensive to run. Sponsored by INFINIDAT Storage Switzerland is the leading storage analyst firm focused on the emerging storage categories of memory based storage (Flash), big data, virtualization, cloud computing and data protection. The firm is widely recognized for its blogs, white papers, and videos on such current technologies like all-flash arrays, deduplication, software- defined storage, backup appliances, and storage networking. The “Switzerland” in the firm’s name indicates our pledge to provide neutral analysis of the storage marketplace, rather than focusing on a single vendor or approach. INFINIDAT has brought to market InfiniBox, a new generation of highly reliable, scalable and efficient storage systems designed specifically to support a wide variety of workload types, including those in virtual architectures. InfiniBox allows an organization to consolidate down to a single solution that has the performance, capacity and affordability to support most of an organization’s workloads.