Scribd
Upload
20 views26 pages

Lez.d-04-GlusterFS and Clouds

The document discusses scaling out storage with GlusterFS. It provides an overview of GlusterFS including its features like global namespace, self-healing, and replication. It also covers using GlusterFS for OpenStack components like Cinder, Glance, and Manila as well as on public clouds.

Uploaded by

Alvi Rownok
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
20 views26 pages

Lez.d-04-GlusterFS and Clouds

The document discusses scaling out storage with GlusterFS. It provides an overview of GlusterFS including its features like global namespace, self-healing, and replication. It also covers using GlusterFS for OpenStack components like Cinder, Glance, and Manila as well as on public clouds.

Uploaded by

Alvi Rownok
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 26

Building Clouds

That Scale-Out
with
GlusterFS
Agenda
• Why Cloud, Why Now?
• Scaling
• Scale-Up vs Scale-Out
• The Present of Storage
• The Future of Storage
• What is GlusterFS ?
• Features of GlusterFS
• GlusterFS Use Cases
• GlusterFS on Public Cloud
• OpenStack Integrations
• When Not to Use GlusterFS
Why Cloud, Why Now ?
Cloud is evolution of IT
Dealing better with unpredictable demand
Agility, flexibility,elasticity and scalibility
Scaling
Scaling is growing an infrastructure
(compute, storage,networking)
larger so that the applications riding
on that infrastructure can serve
more people at a time.
Scale-Up vs. Scale-Out
Scale-Up
Taking what you’ve got, and
replacing it or adding new
components with something more
powerful.

Scale-Out
Scaling out takes the infrastructure
you’ve got, and replicates it to work
in parallel.
The Present of Storage
Traditional Hardware Approach
• Proprietary
• Higher TCO
• Paying for what you may not
need(performance/capacity)
• Increased risk
Common HW elements can fail
Power supplies
Fans
FW upgrade failures etc...
The Future of Storage
Software-Defined Storage
Storage infrastructure that is managed
and automated by intelligent software
as opposed to by the storage hardware
itself.

Advantages of SDS
•Runs on commodity hardware
Cost Effective
Leverage recent Hardware innovations
•Scale-out approach
•Resilient to node failures
High Availability
•Agility and Flexibility
What is GlusterFS ?
Open Source distributed file system
capable of scaling to several petabytes

Scale-out SDS platform on top of


commodity servers

Runs on top of GNU/Linux

Flexible
Deploy anywhere
Data center/private cloud
Public cloud
Hybrid cloud
Features of GlusterFS
Features of GlusterFS
Global Namespace

No metadata server (No SPoF)

Elastic Hash Algorithm

Unified Object Store + File Access

POSIX-compliant file system


Features of GlusterFS
Automated Tiering (Hot & Cold Data on
SSD/HDD)

ACL Support and Quotas

Volume Snapshots & Clones (writable


snapshots)

Pro-Active Self-Healing

Synchronous/Asynchronous Replication
Features of GlusterFS
Access Mechanisms

•FUSE
•NFS
•SMB
•libgfapi – QEMU can directly access
to disk image files
•ReST – Object storage
•HDFS
Features of GlusterFS
Management Console

Monitoring with Nagios

HA for NFS and CIFS(CTDB)

Compression and Deduplication on


Roadmap for GlusterFS v4.0
Features of GlusterFS
Geo-Replication
•Asynchronous across LAN, WAN, or
Internet

•Master-Slave model
• Cascading possible(Continuous
and incremental)

• Fail-Over and Fail-Back mechanism


GlusterFS Use Cases
Large Scale File Server

Media/Content Distribution Network


(CDN)

Backup/Archive/Disaster Recovery

High Performance Computing

IaaS Storage Layer

File Sync and share with OwnCloud


GlusterFS Use Cases
Virtual Machines storage for oVirt
Virtualization Platform

File System for Big Data/Hadoop (HDFS)

Database Offloads(Backup/Restore)

Persistent storage for Containers

Persistent storage for OpenShift (PaaS)


GlusterFS On Public
Cloud
Amazon Web Services (AWS)
Runs within Amazon Machine Image

GoGrid Cloud
Gluster Server Image for scale-out
NAS on GoGrid

And on other cloud providers; Azure,


DigitalOcean
Unifying Public and Private
Clouds
You can unify the public and private
clouds with GlusterFS by replication
mechanisms on the fly

By using AWS tools, you can migrate S3


data to GlusterFS
OpenStack Integrations
Using GlusterFS as a
backend storage for Cinder
Cinder is a block storage service for
OpenStack

By default uses LVM as its backend

Support raw and qcow2 format cinder


volumes

Cinder volumes can be attached to Nova


instances in 2 ways
FUSE
libgfapi – no FUSE, performance gaining
Using GlusterFS as a Backend
Storage for Glance
Glance is a image service for OpenStack

Just use GlusterFS volume instead of


local storage.

This is actually being used in many


production clusters.
Using GlusterFS as a Backend
Storage for Manila
Manila is a shared file system as a
service for OpenStack

Provision file shares to Nova instances

Instances directly talk with GlusterFS


storage backend
GlusterFS vs Swift ?
If you want to manage your object and
file storage within a single system,
GlusterFS is only solution

If you want to use only object storage,


choose OpenStack Swift
When Not to Use GlusterFS ?
• Is not good solution for zilllion of
files which is under of 16 KB

• GlusterFS does not support


structured data (such as DBs)
The Cloud is Redefined

“If you don't know where you are going,


any road will get you there.”
Lewis Carrol
Thank You
Questions
&
Answers

Mustafa Resul ÇETİNEL


[email protected]

You might also like