VNG/IRD - Cloud computing & Openstack discussion 3/5/2014

Cloud Computing
OpenStack
VNG – Infrastructure platform
Tran Anh Nhan – IRD department head
Pham Tran Kim Chi – Lead System Engineer
May 2014

Cloud Computing - OpenStack - VNG - IRD
Agenda
• VNG - IRD
• What is Cloud Computing?
• OpenStack Architecture
• OpenStack Networking
• Deployment Model
• Ceilometer

New Section
VNG Corp introduction

VNG Corporation
• Game publisher/developer (VLTK, VLCM,
Gunny, Boom, Khu vuon tren may,
ZingPlay …)
• Online music/media (ZingMP3, ZingTV)
• Social network (Zing Me, Zalo)
• E-commerce (123mua.vn, 123pay.vn)

IRD Department
Research and build the infrastructure platform for
VNG to enhance business, optimize quality and cost,
meet the new technology.
• Content Delivery Network (CDN) system is used
by all VNG products that want to optimize static
bandwidth.
• Live-streaming system is a streaming platform for
Zing events, Talk TV.
• OpenStack provides servers and networks for
some products with a small scale (in pilot phase.
Project Team is receiving feedback for further
enhancement).
• Object storage (in POC phase).

New Section
What is Cloud Computing?

References
• Gartner
• Synergy research
• The National Institute of Standards and
Technology (NIST)
• Cloud computing today
• 451 Research

Number & trend

What is Cloud computing?

Cloud Services

Cloud Services
• AWS #1 of cloud services provider - What services
AWS provide?
– Amazon Web Services (AWS) continues to dominate
the IaaS and PaaS space in terms of revenue. AWS:
3.8$B revenue (2013)
– Compute & Networking (Amazon EC2, Auto Scaling,
Elastic Load Balancing, Route 53 ,..)
– Storage & CDN (Amazon S3, Amazon Glacier a low
cost storage for backup, Amazon EBS, Cloud
Front/CDN)
– DB – Cache: RDS (MySQL, Oracle, SQL Server, and
PostgreSQL), DynamoDB (NoSQL data store),
ElastiCache (In-Memory Caching Service), Redshift
(Data Warehouse Service)
– Application services: Elastic Transcoder,..

Cloud Orchestration Framework

New Section
OpenStack Architecture

History
• OpenStack is an open source IaaS
initiative for managing and creating huge
groups of virtual private servers in a cloud
computing environment. It was initially
developed by Rackspace and NASA.

Nowadays

Servers Storage
Network switch Network switch Network switch
Virtualization Solution (VMWare VCenter,
Citrix XEN Server, Ovirt, Proxmox….)
Hypervisor (VMWARE, XEN, QEMU, KVM, Hyper-V)

Cloud Infrastructure
• Modular architecture
• Designed to easily scale out
• Based on set of core services

OpenStack Platform
Servers Storage
Network switch Network switch Network switch
Hypervisor (VMWARE, XEN, QEMU, KVM, Hyper-V)

Infrastructure As A Service Overview

Infrastructure As A Service roles
• Cloud Ops: monitor/add/remove physical
compute nodes, storage nodes, controller
nodes, network nodes.
• App Owner: add/remove/upgrade cloud
services, check billing status.
• Dev Ops: launch/ terminate/ scale instances,
storage. Register/ unregister new image.
Backup/ restore instances/ storage. These
tasks can be done via dashboard or API.
• App Devs: call the dev ops tasks inside
application logical flow.

On-Demand Self-Services
Resource
pooling
Broad
Network
Access
Mesearued
services

Hypervisor
Server
Storage Network
Nova compute Cinder Neutron

New Section
OpenStack Networking

Network Node Compute Node
phy-
br-
em2
phy-
br-
em2
em1: 172.16.0.2 em1: 172.16.0.3
em2: no ip address
em2: no ip address
Nova API …
ovs/ br-int
dnsmasq
dchp agent
IP name space
Nova Compute …
tap-xx
qvo-xx
int-br-
em2
tap-xx qvb-xx
Linux bridge
qbr-xxxxx
Instance
eth0
ovs/ br-int
qvo-xx
int-br-
em2
veth
Neutron API
0.0.0.0:9696
management network
dedicated physical VLAN for neutron trafﬁc between nodes
neutron ovs plugin
veth

New Section
Deployment Model

Cinder
API
COROSYNC + HAProxy
Controller 01 Controller 02
Rabbit
MQ
Keyston
e
Glance
API
Nova
API
PACEMAK
ER
Compute node 1
Compute node n
Ceph node 1
Ceph node n
QEMUDriver
Ceph node 2
Compute node 2
RBD Driver

Neutron Server
Switch Interface
Driver
Physical switch
Controller Node
OVS Plugin
OVS Plugin
Openvswitch
Instances
Compute Node
Neutron OVS agent
DHCP
InstancesInstances
OVS Plugin
Openvswitch
Instances
Compute Node
Neutron OVS agent
InstancesInstances
L3 Agent DHCP L3 Agent

Feature
• Launch instance
• Snapshot/ restore instance
• Attach device to instance
• Snapshot/ restore attach device
• Scale up instance
• Internal network for instances
• Provide instances with VLAN as product
requires.
• Instances are stored totally in Ceph Storage.

DEMO

New Section
Ceilometer

Monitoring
• Monitor physical host by cacti, graphite,
zabbix.
• Monitor instances status by ceilometer.
• Monitor OpenStack statistics by
ceilometer.

Ceilometer
• Objectives
• Ceilometer component
• Ceilometer collect data
• Access collected data

Objectives
• Provide a infrastructure to collect
any information in OPS.
• Publish information for other
monitoring.
• Integrate with Heat for trigger auto
scale.
Celiometer - OpenStack - VNG - IRD

Ceilometer collect data
• Bus listener
• Polling agent
• Push agents

Ceilometer

Process meter

Access collected data
• Via API
• Via Ceilometer command

Q & A

VNG/IRD - Cloud computing & Openstack discussion 3/5/2014

Recommended

More Related Content

What's hot (20)

Viewers also liked (20)

Similar to VNG/IRD - Cloud computing & Openstack discussion 3/5/2014 (20)

Recently uploaded (20)

VNG/IRD - Cloud computing & Openstack discussion 3/5/2014