Topic 13: Cloud Stacks
2 likes629 views
The document discusses different cloud computing stacks, including CloudStack and OpenStack. It provides details on the components and features of each stack. CloudStack is presented as a console for managing data center resources like virtual machines, networking, and storage. It enables IaaS capabilities. OpenStack is described as an open source software for building public and private clouds, with components that manage compute, storage, networking, identity, and dashboards. It supports multiple hypervisors and is used by many large companies.
Topic 13: Cloud Stacks
- 1. 13: Cloud Stacks Zubair Nabi [email protected] April 21, 2013 Zubair Nabi 13: Cloud Stacks April 21, 2013 1 / 27
- 2. Outline 1 Server-side Stacks 2 Client-side Libraries Zubair Nabi 13: Cloud Stacks April 21, 2013 2 / 27
- 3. Outline 1 Server-side Stacks 2 Client-side Libraries Zubair Nabi 13: Cloud Stacks April 21, 2013 3 / 27
- 4. Introduction Cloud service creation and offering requires an entire ecosystem Zubair Nabi 13: Cloud Stacks April 21, 2013 4 / 27
- 5. Introduction Cloud service creation and offering requires an entire ecosystem Focusing on just the software side, solutions are needed to manage computation, storage, and networking Zubair Nabi 13: Cloud Stacks April 21, 2013 4 / 27
- 6. Introduction Cloud service creation and offering requires an entire ecosystem Focusing on just the software side, solutions are needed to manage computation, storage, and networking A number of open source solutions with a set of pros and cons Zubair Nabi 13: Cloud Stacks April 21, 2013 4 / 27
- 7. CloudStack1 Console for managing data center resources 1 http://cloudstack.apache.org/ Zubair Nabi 13: Cloud Stacks April 21, 2013 5 / 27
- 8. CloudStack1 Console for managing data center resources Manages virtual machines, networking components, and storage 1 http://cloudstack.apache.org/ Zubair Nabi 13: Cloud Stacks April 21, 2013 5 / 27
- 9. CloudStack1 Console for managing data center resources Manages virtual machines, networking components, and storage Enables IaaS 1 http://cloudstack.apache.org/ Zubair Nabi 13: Cloud Stacks April 21, 2013 5 / 27
- 10. CloudStack1 Console for managing data center resources Manages virtual machines, networking components, and storage Enables IaaS Used by Zynga, Nokia Research, etc. 1 http://cloudstack.apache.org/ Zubair Nabi 13: Cloud Stacks April 21, 2013 5 / 27
- 11. CloudStack1 Console for managing data center resources Manages virtual machines, networking components, and storage Enables IaaS Used by Zynga, Nokia Research, etc. Possible to convert Amazon EC2 API to the CloudStack one 1 http://cloudstack.apache.org/ Zubair Nabi 13: Cloud Stacks April 21, 2013 5 / 27
- 12. What can it do? Can be used by both service providers and enterprises Zubair Nabi 13: Cloud Stacks April 21, 2013 6 / 27
- 13. What can it do? Can be used by both service providers and enterprises Set up an on-demand, elastic cloud computing service Zubair Nabi 13: Cloud Stacks April 21, 2013 6 / 27
- 14. What can it do? Can be used by both service providers and enterprises Set up an on-demand, elastic cloud computing service Virtual machine instances, storage volumes, and networking configurations Zubair Nabi 13: Cloud Stacks April 21, 2013 6 / 27
- 15. What can it do? Can be used by both service providers and enterprises Set up an on-demand, elastic cloud computing service Virtual machine instances, storage volumes, and networking configurations Set up a private cloud for internal usage Zubair Nabi 13: Cloud Stacks April 21, 2013 6 / 27
- 16. Features Multiple Hypervisor Support: Supports Citrix XenServer, VMWare vSphere, KVM, and Xen Zubair Nabi 13: Cloud Stacks April 21, 2013 7 / 27
- 17. Features Multiple Hypervisor Support: Supports Citrix XenServer, VMWare vSphere, KVM, and Xen Massively Scalable Infrastructure Management: Can manage tens of thousands of geographically distributed datacenters Zubair Nabi 13: Cloud Stacks April 21, 2013 7 / 27
- 18. Features Multiple Hypervisor Support: Supports Citrix XenServer, VMWare vSphere, KVM, and Xen Massively Scalable Infrastructure Management: Can manage tens of thousands of geographically distributed datacenters Automatic Configuration Management: Automatic configuration of each guest’s VMs, network, and storage settings Zubair Nabi 13: Cloud Stacks April 21, 2013 7 / 27
- 19. Features (2) Graphical User Interface: Web interfaces both for the administrator as well as the user Zubair Nabi 13: Cloud Stacks April 21, 2013 8 / 27
- 20. Features (2) Graphical User Interface: Web interfaces both for the administrator as well as the user API and Extensibility: Exposes a programmatic interface to all management features Zubair Nabi 13: Cloud Stacks April 21, 2013 8 / 27
- 21. Features (2) Graphical User Interface: Web interfaces both for the administrator as well as the user API and Extensibility: Exposes a programmatic interface to all management features High Availability: Management Server itself can be deployed across multiple nodes, with load balancing Zubair Nabi 13: Cloud Stacks April 21, 2013 8 / 27
- 22. Management Server All resources such as hosts, storage devices, and IP addresses are provided to it for management Zubair Nabi 13: Cloud Stacks April 21, 2013 9 / 27
- 23. Management Server All resources such as hosts, storage devices, and IP addresses are provided to it for management Runs on a dedicated server or VM Zubair Nabi 13: Cloud Stacks April 21, 2013 9 / 27
- 24. Management Server All resources such as hosts, storage devices, and IP addresses are provided to it for management Runs on a dedicated server or VM Controls allocation of VMs to hosts and assignment of storage and IP addresses to the VM instance Zubair Nabi 13: Cloud Stacks April 21, 2013 9 / 27
- 25. Management Server All resources such as hosts, storage devices, and IP addresses are provided to it for management Runs on a dedicated server or VM Controls allocation of VMs to hosts and assignment of storage and IP addresses to the VM instance Runs within a Tomcat container and uses a MySQL DB for persistence Zubair Nabi 13: Cloud Stacks April 21, 2013 9 / 27
- 26. Cloud Infrastructure One or more zones (typically datacenters) consisting of various hosts to run VMs Zubair Nabi 13: Cloud Stacks April 21, 2013 10 / 27
- 27. Cloud Infrastructure One or more zones (typically datacenters) consisting of various hosts to run VMs Zone: Consists of one or more pods Zubair Nabi 13: Cloud Stacks April 21, 2013 10 / 27
- 28. Cloud Infrastructure One or more zones (typically datacenters) consisting of various hosts to run VMs Zone: Consists of one or more pods Pod: L2 switch and one or more clusters Zubair Nabi 13: Cloud Stacks April 21, 2013 10 / 27
- 29. Cloud Infrastructure One or more zones (typically datacenters) consisting of various hosts to run VMs Zone: Consists of one or more pods Pod: L2 switch and one or more clusters Cluster: Consists of one or more hosts and primary storage Zubair Nabi 13: Cloud Stacks April 21, 2013 10 / 27
- 30. Cloud Infrastructure One or more zones (typically datacenters) consisting of various hosts to run VMs Zone: Consists of one or more pods Pod: L2 switch and one or more clusters Cluster: Consists of one or more hosts and primary storage Host: Single compute node within a cluster to run guest VMs Zubair Nabi 13: Cloud Stacks April 21, 2013 10 / 27
- 31. Cloud Infrastructure One or more zones (typically datacenters) consisting of various hosts to run VMs Zone: Consists of one or more pods Pod: L2 switch and one or more clusters Cluster: Consists of one or more hosts and primary storage Host: Single compute node within a cluster to run guest VMs Primary storage: Associated with a cluster and stores disk volumes for all VMs Zubair Nabi 13: Cloud Stacks April 21, 2013 10 / 27
- 32. Cloud Infrastructure One or more zones (typically datacenters) consisting of various hosts to run VMs Zone: Consists of one or more pods Pod: L2 switch and one or more clusters Cluster: Consists of one or more hosts and primary storage Host: Single compute node within a cluster to run guest VMs Primary storage: Associated with a cluster and stores disk volumes for all VMs Secondary storage: Associated with a zone and stores ISO images and disk volume snapshots Zubair Nabi 13: Cloud Stacks April 21, 2013 10 / 27
- 33. Networking Options Basic: Similar to AWS: guest isolation through L3 mechanisms such as IP address source filtering Zubair Nabi 13: Cloud Stacks April 21, 2013 11 / 27
- 34. Networking Options Basic: Similar to AWS: guest isolation through L3 mechanisms such as IP address source filtering Advanced: Flexibility in defining guest networks Zubair Nabi 13: Cloud Stacks April 21, 2013 11 / 27
- 35. OpenStack2 Public and private IaaS cloud management software stack 2 http://www.openstack.org/ Zubair Nabi 13: Cloud Stacks April 21, 2013 12 / 27
- 36. OpenStack2 Public and private IaaS cloud management software stack Used by PayPal, Cisco, Intel, HP, Rackspace, AT&T, etc. 2 http://www.openstack.org/ Zubair Nabi 13: Cloud Stacks April 21, 2013 12 / 27
- 37. OpenStack2 Public and private IaaS cloud management software stack Used by PayPal, Cisco, Intel, HP, Rackspace, AT&T, etc. Divided into a number of services 2 http://www.openstack.org/ Zubair Nabi 13: Cloud Stacks April 21, 2013 12 / 27
- 38. OpenStack2 Public and private IaaS cloud management software stack Used by PayPal, Cisco, Intel, HP, Rackspace, AT&T, etc. Divided into a number of services The Cloud Controller hosts the databases, message queue, dashboard, and API endpoints 2 http://www.openstack.org/ Zubair Nabi 13: Cloud Stacks April 21, 2013 12 / 27
- 39. Compute (Nova) Manages the lifecycle of VM instances Zubair Nabi 13: Cloud Stacks April 21, 2013 13 / 27
- 40. Compute (Nova) Manages the lifecycle of VM instances In charge of scheduling, resource provisioning, live migration, and security Zubair Nabi 13: Cloud Stacks April 21, 2013 13 / 27
- 41. Compute (Nova) Manages the lifecycle of VM instances In charge of scheduling, resource provisioning, live migration, and security Supports multiple hypervisors including KVM and Xen Zubair Nabi 13: Cloud Stacks April 21, 2013 13 / 27
- 42. Storage Provides both block and object storage for use by the VM Zubair Nabi 13: Cloud Stacks April 21, 2013 14 / 27
- 43. Storage Provides both block and object storage for use by the VM Users are allowed to create block storage devices Zubair Nabi 13: Cloud Stacks April 21, 2013 14 / 27
- 44. Storage Provides both block and object storage for use by the VM Users are allowed to create block storage devices These devices can dynamically be attached and removed from VM instances Zubair Nabi 13: Cloud Stacks April 21, 2013 14 / 27
- 45. Storage Provides both block and object storage for use by the VM Users are allowed to create block storage devices These devices can dynamically be attached and removed from VM instances Also provides a distributed object storage, called Swift Zubair Nabi 13: Cloud Stacks April 21, 2013 14 / 27
- 46. Object Storage Users access binary objects through a RESTful API Zubair Nabi 13: Cloud Stacks April 21, 2013 15 / 27
- 47. Object Storage Users access binary objects through a RESTful API Similar to Amazon S3 Zubair Nabi 13: Cloud Stacks April 21, 2013 15 / 27
- 48. Object Storage Users access binary objects through a RESTful API Similar to Amazon S3 Useful for storing and managing large datasets Zubair Nabi 13: Cloud Stacks April 21, 2013 15 / 27
- 49. Object Storage Users access binary objects through a RESTful API Similar to Amazon S3 Useful for storing and managing large datasets Can also be used by the system to store VM images Zubair Nabi 13: Cloud Stacks April 21, 2013 15 / 27
- 50. Block Storage Exposes a block device to the user Zubair Nabi 13: Cloud Stacks April 21, 2013 16 / 27
- 51. Block Storage Exposes a block device to the user Users interact with the storage by mounting volumes within their VM instances Zubair Nabi 13: Cloud Stacks April 21, 2013 16 / 27
- 52. Block Storage Exposes a block device to the user Users interact with the storage by mounting volumes within their VM instances Can be detached from one instance and re-attached to another while remaining persistent Zubair Nabi 13: Cloud Stacks April 21, 2013 16 / 27
- 53. Block Storage Exposes a block device to the user Users interact with the storage by mounting volumes within their VM instances Can be detached from one instance and re-attached to another while remaining persistent Implemented internally through the Cinder project which supports multiple back-ends Zubair Nabi 13: Cloud Stacks April 21, 2013 16 / 27
- 54. Block Storage Exposes a block device to the user Users interact with the storage by mounting volumes within their VM instances Can be detached from one instance and re-attached to another while remaining persistent Implemented internally through the Cinder project which supports multiple back-ends Some drivers allow the instance direct access to the underlying physical block device Zubair Nabi 13: Cloud Stacks April 21, 2013 16 / 27
- 55. Block Storage Exposes a block device to the user Users interact with the storage by mounting volumes within their VM instances Can be detached from one instance and re-attached to another while remaining persistent Implemented internally through the Cinder project which supports multiple back-ends Some drivers allow the instance direct access to the underlying physical block device Improves I/O performance Zubair Nabi 13: Cloud Stacks April 21, 2013 16 / 27
- 56. Networking API-driven network and IP address management Zubair Nabi 13: Cloud Stacks April 21, 2013 17 / 27
- 57. Networking API-driven network and IP address management Users are allowed to create their own networks Zubair Nabi 13: Cloud Stacks April 21, 2013 17 / 27
- 58. Networking API-driven network and IP address management Users are allowed to create their own networks VLANs used to provide each allocation its own subnet and segregation from other allocations Zubair Nabi 13: Cloud Stacks April 21, 2013 17 / 27
- 59. Dashboard (Horizon) Web interface for administrators and users Zubair Nabi 13: Cloud Stacks April 21, 2013 18 / 27
- 60. Dashboard (Horizon) Web interface for administrators and users Gives access to VM image management, VM instance lifecycle management, and storage Zubair Nabi 13: Cloud Stacks April 21, 2013 18 / 27
- 61. Identity (Keystone) Centralized user account service with authentication and access control Zubair Nabi 13: Cloud Stacks April 21, 2013 19 / 27
- 62. Identity (Keystone) Centralized user account service with authentication and access control Registry of OpenStack services Zubair Nabi 13: Cloud Stacks April 21, 2013 19 / 27
- 63. Image (Glance) Various image management capabilities, including registration and delivery Zubair Nabi 13: Cloud Stacks April 21, 2013 20 / 27
- 64. Image (Glance) Various image management capabilities, including registration and delivery Supports multiple image formats Zubair Nabi 13: Cloud Stacks April 21, 2013 20 / 27
- 65. Message Queue Services communicate with each other using the message queue Zubair Nabi 13: Cloud Stacks April 21, 2013 21 / 27
- 66. Message Queue Services communicate with each other using the message queue If the message queue fails, the cluster enters a “read only” state Zubair Nabi 13: Cloud Stacks April 21, 2013 21 / 27
- 67. Application Programming Interface (API) Command line client Zubair Nabi 13: Cloud Stacks April 21, 2013 22 / 27
- 68. Application Programming Interface (API) Command line client Amazon EC2 compatibility APIs Zubair Nabi 13: Cloud Stacks April 21, 2013 22 / 27
- 69. Outline 1 Server-side Stacks 2 Client-side Libraries Zubair Nabi 13: Cloud Stacks April 21, 2013 23 / 27
- 70. Libcloud3 Abstracts away the APIs of different cloud vendors 3 http://libcloud.apache.org/ Zubair Nabi 13: Cloud Stacks April 21, 2013 24 / 27
- 71. Libcloud3 Abstracts away the APIs of different cloud vendors Negates vendor API lock-in 3 http://libcloud.apache.org/ Zubair Nabi 13: Cloud Stacks April 21, 2013 24 / 27
- 72. Libcloud3 Abstracts away the APIs of different cloud vendors Negates vendor API lock-in Computation: Such as Amazon EC2 and Rackspace CloudServers 3 http://libcloud.apache.org/ Zubair Nabi 13: Cloud Stacks April 21, 2013 24 / 27
- 73. Libcloud3 Abstracts away the APIs of different cloud vendors Negates vendor API lock-in Computation: Such as Amazon EC2 and Rackspace CloudServers Storage: Such as Amazon S3 and Rackspace CloudFiles 3 http://libcloud.apache.org/ Zubair Nabi 13: Cloud Stacks April 21, 2013 24 / 27
- 74. Compute Abstraction for more than 20 providers such as Amazon, Rackspace, Nimbus, etc. Zubair Nabi 13: Cloud Stacks April 21, 2013 25 / 27
- 75. Compute Abstraction for more than 20 providers such as Amazon, Rackspace, Nimbus, etc. Ability to run deployment scripts on the newly created servers Zubair Nabi 13: Cloud Stacks April 21, 2013 25 / 27
- 76. Storage Abstraction for more than 10 providers such as Amazon, Rackspace, CloudFiles, etc. Zubair Nabi 13: Cloud Stacks April 21, 2013 26 / 27
- 77. References OpenStack operations guide: http://docs.openstack.org/ trunk/openstack-ops/content/ Zubair Nabi 13: Cloud Stacks April 21, 2013 27 / 27