SlideShare a Scribd company logo
OPENSTACK
STORAGE ARCHITECTURE

Dan Radez
Sr. Software Engineer, Red Hat
dradez@redhat.com
irc: radez
Red Hat's Community OpenStack

openstack.redhat.com
Storage Components
●

Database

●

Glance

●

Nova

●

Cinder

●

Swift
Component Architecture
Database :: MySQL / MariaDB
Store Options
●

Local Storage (no HA)

●

Shared Storage

●

Replicated Storage
Database :: MySQL / MariaDB
Local Storage

DB Node
Database :: MySQL / MariaDB
Shared Storage

Pacemaker
Active / Passive Failover

FIP: 10.10.10.123

DB Node*

DB Node

Storage
iSCSI or NFS
* MySQL service is running
Database :: MySQL / MariaDB
Shared Storage

Pacemaker
Active / Passive Failover

X

FIP: 10.10.10.123

DB Node

DB Node*

Storage
iSCSI or NFS
* MySQL service is running
Database :: MySQL / MariaDB
Replicated Storage
Pacemaker
Active / Passive Failover
FIP: 10.10.10.123

DB Node*

DB Node*

Master

Slave

Master / Slave Replication

* MySQL service is running
Database :: MySQL / MariaDB
Replicated Storage
Pacemaker
Active / Passive Failover

X

DB Node

FIP: 10.10.10.123

DB Node*
Master

Master / Slave Replication

* MySQL service is running
Database :: MySQL / MariaDB

Pacemaker Disclaimer

3 node minimum
for quorum
Glance: Image Management
Glance: Image Management
Store Backends
●

Local (mounted)

●

Swift

●

Cinder

●

more...

/usr/lib/python2.7/site-packages/glance/store
Glance: Image Management
Use GlusterFS to back Glance
# yum install -y glusterfs-fuse

# mkdir /srv/openstack
# vim /etc/fstab
gluster1:/openstack /srv/openstack glusterfs defaults,_netdev 0 0
# mount -a
# mkdir -p /srv/openstack/glance/images/
# chown -R glance:glance /srv/openstack/glance/
Glance: Image Management
Configure OpenStack
# vim /etc/glance/glance-api.conf
filesystem_store_datadir=/srv/openstack/glance/images/
# vim /etc/glance/glance-cache.conf
filesystem_store_datadir=/srv/openstack/glance/images/

# grep "/var/lib/glance" /etc/glance/*
glance-api.conf:#scrubber_datadir=/var/lib/glance/scrubber
glance-api.conf:#image_cache_dir=/var/lib/glance/image-cache/
glance-cache.conf:#image_cache_dir=/var/lib/glance/image-cache
glance-scrubber.conf:#scrubber_datadir=/var/lib/glance/scrubber
# service openstack-glance-api restart
# service openstack-glance-registry restart
Nova: Instance Management
Nova: Instance Management
Use GlusterFS to back Nova
# yum install -y glusterfs-fuse

# mkdir /srv/openstack
# vim /etc/fstab
gluster1:/openstack /srv/openstack glusterfs defaults,_netdev 0 0
# mount -a
# mkdir -p /srv/openstack/instances
# chown -R nova:nova /srv/openstack/instances
# vim /etc/nova/nova.conf
instances_path=/srv/openstack/instances
# service openstack-nova-compute restart
Cinder: Block Storage
Cinder: Block Storage
Drivers
●

LVM

●

NFS

●

GlusterFS

●

more...

/usr/lib/python2.7/site-packages/cinder/volume/drivers
Cinder: Block Storage

Example: Multiple Storage Types
Dependencies
# yum install -y glusterfs-fuse

Configuration
# vim /etc/cinder/shares.conf
gluster1:openstack
gluster2:openstack
(gluster_host.domain.com:gluster_volume_name)
Cinder: Block Storage
Configuration
#vim /etc/cinder/cinder.conf
enabled_backends=my_lvm,my_glusterfs
[my_lvm]
volume_group = cinder-volumes
volume_driver = cinder.volume.drivers.lvm.LVMISCSIDriver
volume_backend_name = LVM
[my_glusterfs]
volume_driver = cinder.volume.drivers.glusterfs.GlusterfsDriver
glusterfs_shares_config = /etc/cinder/shares.conf
glusterfs_sparsed_volumes = false
volume_backend_name = GLUSTER
Cinder: Block Storage
Restart cinder & verify
# service openstack-cinder-scheduler restart
# service openstack-cinder-volume restart
# mount | grep cinder
gluster1:openstack on /var/lib/cinder/... type fuse.glusterfs
gluster2:openstack on /var/lib/cinder/... type fuse.glusterfs
Cinder: Block Storage
Create cinder volume types
# cinder type-create lvm
# cinder type-key lvm set volume_backend_name=LVM
# cinder type-create glusterfs
# cinder type-key glusterfs set volume_backend_name=GLUSTER

Create cinder volume using type
# cinder create --volume-type glusterfs --display-name test 1
Cinder: Block Storage
Compute configuration (experimental)
# vim /etc/nova/nova.conf
debug=False
qemu_allowed_storage_drivers=gluster
# service openstack-nova-compute restart
Swift: Object Storage
Swift: Object Storage
Storage Backends
●

Swift Storage

●

GlusterFS

●

more...
Review
Resources
●

●

RDO: openstack.redhat.com
https://access.redhat.com/knowledge/docs/enUS/Red_Hat_OpenStack

●

OpenStack.org

●

TryStack.org

●

Puppetlabs.com

●

Djangoproject.com

●

http://radez.fedorapeople.org/TokyoMeetup_slides.pdf

More Related Content

PPTX
OpenStack Storage Overview
Bharat Kumar Kobagana
 
PDF
Deep Dive into Openstack Storage, Sean Cohen, Red Hat
Cloud Native Day Tel Aviv
 
PPTX
OpenStack Cinder
Renuka Apte
 
PPTX
OpenStack Cinder Best Practices - Meet Up
Aaron Delp
 
PPTX
Laying OpenStack Cinder Block Services
Kenneth Hui
 
PPTX
Storage as a service and OpenStack Cinder
openstackindia
 
PDF
OpenStack Cinder, Implementation Today and New Trends for Tomorrow
Ed Balduf
 
PDF
Open stack solidfire-mavenspire-meetup
Gene Dubensky
 
OpenStack Storage Overview
Bharat Kumar Kobagana
 
Deep Dive into Openstack Storage, Sean Cohen, Red Hat
Cloud Native Day Tel Aviv
 
OpenStack Cinder
Renuka Apte
 
OpenStack Cinder Best Practices - Meet Up
Aaron Delp
 
Laying OpenStack Cinder Block Services
Kenneth Hui
 
Storage as a service and OpenStack Cinder
openstackindia
 
OpenStack Cinder, Implementation Today and New Trends for Tomorrow
Ed Balduf
 
Open stack solidfire-mavenspire-meetup
Gene Dubensky
 

What's hot (20)

PDF
OpenStack Cinder Overview - Havana Release
Avishay Traeger
 
PDF
Cinder Status Openstack Shanghai
OpenCity Community
 
PPTX
Introduction to OpenStack Cinder
Sean McGinnis
 
PPTX
Filesystem as a service in OpenStack
openstackindia
 
ODP
GlusterFS and Openstack Storage
Deepak Shetty
 
PDF
Ceph & OpenStack talk given @ OpenStack Meetup @ Bangalore, June 2015
Deepak Shetty
 
PPT
Kubernetes on CloudStack with coreOS
Sebastien Goasguen
 
PDF
Kubernetes dealing with storage and persistence
Janakiram MSV
 
ODP
OpenStack Nova Scheduler
Peeyush Gupta
 
PDF
Storage based on_openstack_mariocho
Mario Cho
 
PPTX
State of Containers in OpenStack
openstackindia
 
PDF
reInvent 2021 Recap and k9s review
Faheem Memon
 
PDF
KubeCon EU 2016: Kubernetes Storage 101
KubeAcademy
 
PDF
Guts & OpenStack migration
openstackindia
 
PDF
AtlasCamp 2015: The age of orchestration: From Docker basics to cluster manag...
Atlassian
 
PDF
Persistent Storage with Containers with Kubernetes & OpenShift
Red Hat Events
 
PDF
Zun presentation (OpenStack Barcelona summit)
hongbin034
 
PPTX
Introducing Docker Swarm - the orchestration tool by Docker
Ramit Surana
 
PDF
OpenStack Best Practices and Considerations - terasky tech day
Arthur Berezin
 
PPTX
OpenStack Contribution Workflow
Sean McGinnis
 
OpenStack Cinder Overview - Havana Release
Avishay Traeger
 
Cinder Status Openstack Shanghai
OpenCity Community
 
Introduction to OpenStack Cinder
Sean McGinnis
 
Filesystem as a service in OpenStack
openstackindia
 
GlusterFS and Openstack Storage
Deepak Shetty
 
Ceph & OpenStack talk given @ OpenStack Meetup @ Bangalore, June 2015
Deepak Shetty
 
Kubernetes on CloudStack with coreOS
Sebastien Goasguen
 
Kubernetes dealing with storage and persistence
Janakiram MSV
 
OpenStack Nova Scheduler
Peeyush Gupta
 
Storage based on_openstack_mariocho
Mario Cho
 
State of Containers in OpenStack
openstackindia
 
reInvent 2021 Recap and k9s review
Faheem Memon
 
KubeCon EU 2016: Kubernetes Storage 101
KubeAcademy
 
Guts & OpenStack migration
openstackindia
 
AtlasCamp 2015: The age of orchestration: From Docker basics to cluster manag...
Atlassian
 
Persistent Storage with Containers with Kubernetes & OpenShift
Red Hat Events
 
Zun presentation (OpenStack Barcelona summit)
hongbin034
 
Introducing Docker Swarm - the orchestration tool by Docker
Ramit Surana
 
OpenStack Best Practices and Considerations - terasky tech day
Arthur Berezin
 
OpenStack Contribution Workflow
Sean McGinnis
 
Ad

Viewers also liked (8)

ODP
Getting started with RDO Havana
Dan Radez
 
PPTX
OCP Engineering Workshop at UNH
호용 류
 
ODP
Triangle OpenStack meetup 09 2013
Dan Radez
 
PDF
Red Hat Forum Tokyo - OpenStack Architecture
Dan Radez
 
PPTX
Getting started with open stack
Dan Radez
 
PDF
Red Hat Forum Tokyo - OpenStack Architecture Design
Dan Radez
 
PPTX
OpenStack Tokyo Talk Application Data Protection Service
Eran Gampel
 
PDF
Study: The Future of VR, AR and Self-Driving Cars
LinkedIn
 
Getting started with RDO Havana
Dan Radez
 
OCP Engineering Workshop at UNH
호용 류
 
Triangle OpenStack meetup 09 2013
Dan Radez
 
Red Hat Forum Tokyo - OpenStack Architecture
Dan Radez
 
Getting started with open stack
Dan Radez
 
Red Hat Forum Tokyo - OpenStack Architecture Design
Dan Radez
 
OpenStack Tokyo Talk Application Data Protection Service
Eran Gampel
 
Study: The Future of VR, AR and Self-Driving Cars
LinkedIn
 
Ad

Similar to OpenStack Tokyo Meeup - Gluster Storage Day (20)

PDF
Percona Live 4/14/15: Leveraging open stack cinder for peak application perfo...
Tesora
 
PPTX
Leveraging OpenStack Cinder for Peak Application Performance
NetApp
 
PDF
Radical Innovations In Storage for Multi-Tenant Infrastructure
NetApp
 
PDF
Using the IBM XIV Storage System in OpenStack Cloud Environments
IBM India Smarter Computing
 
PDF
Deep dive into OpenStack storage, Sean Cohen, Red Hat
Sean Cohen
 
PDF
OpenStack Storage - an Overview
Nilesh Bhosale
 
PPTX
Cinder Live Migration and Replication - OpenStack Summit Austin
Ed Balduf
 
PDF
OpenStack Block Storage 101
NetApp
 
PDF
Latinoware 2013 - OpenStack RDO - A walkthrough by the Open Source Cloud Comp...
Luan Cestari
 
PDF
Getting it Right: OpenStack Private Cloud Storage
NetApp
 
PPT
Open vStorage Meetup - Santa Clara 04/16
wim_provoost
 
PPTX
OpenStack Cinder
Deepti Ramakrishna
 
ODP
GlusterFS Cinder integration presented at GlusterNight Paris event @ Openstac...
Deepak Shetty
 
PPTX
Cloud computing and OpenStack
Edgar Magana
 
PPT
OpenStack Overview for Austin Cloud User Group
Anne Gentle
 
PPTX
Demistifying open stack storage
openstackindia
 
PDF
[OpenStack Days Korea 2016] Track2 - OpenStack 기반 소프트웨어 정의 스토리지 기술
OpenStack Korea Community
 
PPTX
Power of OpenStack & Hadoop
Tuan Yang
 
PPTX
Quick overview of Openstack architecture
Toni Ramirez
 
PDF
MSST-2013 Openstack in the Land of Guilder
Joshua McKenty
 
Percona Live 4/14/15: Leveraging open stack cinder for peak application perfo...
Tesora
 
Leveraging OpenStack Cinder for Peak Application Performance
NetApp
 
Radical Innovations In Storage for Multi-Tenant Infrastructure
NetApp
 
Using the IBM XIV Storage System in OpenStack Cloud Environments
IBM India Smarter Computing
 
Deep dive into OpenStack storage, Sean Cohen, Red Hat
Sean Cohen
 
OpenStack Storage - an Overview
Nilesh Bhosale
 
Cinder Live Migration and Replication - OpenStack Summit Austin
Ed Balduf
 
OpenStack Block Storage 101
NetApp
 
Latinoware 2013 - OpenStack RDO - A walkthrough by the Open Source Cloud Comp...
Luan Cestari
 
Getting it Right: OpenStack Private Cloud Storage
NetApp
 
Open vStorage Meetup - Santa Clara 04/16
wim_provoost
 
OpenStack Cinder
Deepti Ramakrishna
 
GlusterFS Cinder integration presented at GlusterNight Paris event @ Openstac...
Deepak Shetty
 
Cloud computing and OpenStack
Edgar Magana
 
OpenStack Overview for Austin Cloud User Group
Anne Gentle
 
Demistifying open stack storage
openstackindia
 
[OpenStack Days Korea 2016] Track2 - OpenStack 기반 소프트웨어 정의 스토리지 기술
OpenStack Korea Community
 
Power of OpenStack & Hadoop
Tuan Yang
 
Quick overview of Openstack architecture
Toni Ramirez
 
MSST-2013 Openstack in the Land of Guilder
Joshua McKenty
 

Recently uploaded (20)

PPTX
What-is-the-World-Wide-Web -- Introduction
tonifi9488
 
PPTX
Introduction to Flutter by Ayush Desai.pptx
ayushdesai204
 
PDF
Orbitly Pitch Deck|A Mission-Driven Platform for Side Project Collaboration (...
zz41354899
 
PPTX
The Future of AI & Machine Learning.pptx
pritsen4700
 
PDF
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
 
PDF
Google I/O Extended 2025 Baku - all ppts
HusseinMalikMammadli
 
PPTX
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
 
PDF
Structs to JSON: How Go Powers REST APIs
Emily Achieng
 
PPTX
cloud computing vai.pptx for the project
vaibhavdobariyal79
 
PDF
How ETL Control Logic Keeps Your Pipelines Safe and Reliable.pdf
Stryv Solutions Pvt. Ltd.
 
PDF
AI-Cloud-Business-Management-Platforms-The-Key-to-Efficiency-Growth.pdf
Artjoker Software Development Company
 
PDF
Security features in Dell, HP, and Lenovo PC systems: A research-based compar...
Principled Technologies
 
PDF
GDG Cloud Munich - Intro - Luiz Carneiro - #BuildWithAI - July - Abdel.pdf
Luiz Carneiro
 
PDF
The Future of Mobile Is Context-Aware—Are You Ready?
iProgrammer Solutions Private Limited
 
PDF
A Strategic Analysis of the MVNO Wave in Emerging Markets.pdf
IPLOOK Networks
 
PDF
AI Unleashed - Shaping the Future -Starting Today - AIOUG Yatra 2025 - For Co...
Sandesh Rao
 
PDF
SparkLabs Primer on Artificial Intelligence 2025
SparkLabs Group
 
PDF
OFFOFFBOX™ – A New Era for African Film | Startup Presentation
ambaicciwalkerbrian
 
PPTX
Agile Chennai 18-19 July 2025 Ideathon | AI Powered Microfinance Literacy Gui...
AgileNetwork
 
PPTX
Simple and concise overview about Quantum computing..pptx
mughal641
 
What-is-the-World-Wide-Web -- Introduction
tonifi9488
 
Introduction to Flutter by Ayush Desai.pptx
ayushdesai204
 
Orbitly Pitch Deck|A Mission-Driven Platform for Side Project Collaboration (...
zz41354899
 
The Future of AI & Machine Learning.pptx
pritsen4700
 
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
 
Google I/O Extended 2025 Baku - all ppts
HusseinMalikMammadli
 
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
 
Structs to JSON: How Go Powers REST APIs
Emily Achieng
 
cloud computing vai.pptx for the project
vaibhavdobariyal79
 
How ETL Control Logic Keeps Your Pipelines Safe and Reliable.pdf
Stryv Solutions Pvt. Ltd.
 
AI-Cloud-Business-Management-Platforms-The-Key-to-Efficiency-Growth.pdf
Artjoker Software Development Company
 
Security features in Dell, HP, and Lenovo PC systems: A research-based compar...
Principled Technologies
 
GDG Cloud Munich - Intro - Luiz Carneiro - #BuildWithAI - July - Abdel.pdf
Luiz Carneiro
 
The Future of Mobile Is Context-Aware—Are You Ready?
iProgrammer Solutions Private Limited
 
A Strategic Analysis of the MVNO Wave in Emerging Markets.pdf
IPLOOK Networks
 
AI Unleashed - Shaping the Future -Starting Today - AIOUG Yatra 2025 - For Co...
Sandesh Rao
 
SparkLabs Primer on Artificial Intelligence 2025
SparkLabs Group
 
OFFOFFBOX™ – A New Era for African Film | Startup Presentation
ambaicciwalkerbrian
 
Agile Chennai 18-19 July 2025 Ideathon | AI Powered Microfinance Literacy Gui...
AgileNetwork
 
Simple and concise overview about Quantum computing..pptx
mughal641
 

OpenStack Tokyo Meeup - Gluster Storage Day