Orchestrating Stateful Applications with PKS and Portworx
- 1. 1© 2017 PORTWORX | CONFIDENTIAL: DO NOT DISTRIBUTE Stateful Container Orchestration Any Cloud Scheduler Aware DevOps UX
- 2. Experienced Team with Deep Domain Expertise ©2018 Portworx. Confidential. 2 Murli Thirumale Co-founder & CEO Goutham Rao Co-founder & CTO Storage Executive, Dell Co-founder and CEO, Ocarina Group VP and GM, Citrix Co-founder and CEO, Net6; GM, HP Steve Ackley CRO Michael Ferranti VP Marketing Vinod Jayaraman Co-founder & Chief Architect Venkat Ramakrishnan VP Engineering CTO/Executive, Dell Co-founder and CTO, Ocarina CTO, Citrix Co-Founder and CTO, Net6 Architect, Dell Storage Chief Architect, Ocarina Principal Engineer, F5 Eric Han VP Product Management Co-founder, Product Manager, Kubernetes Container Engine at Google Senior Business Development, Google Senior Product Manager, Microsoft VP of Marketing, ClusterHQ Marketing Head, Rackspace- Mailgun Strategy, Wachovia/Wells Fargo Sr. Director, Western Digital Sr. Director, AMD/SeaMicro Sr. Director, Fusion IO VP Engineering, Active Storage VP Sales, SAP Big Data Cloud, VP WW Sales, Altiscale EVP Field Ops, Packet Design VP Sales, Monosphere Vicinity, Satmetrix, Marimba Tivoli-IBM INVESTORS: Company Snapshot: HQ: Los Altos CA Founded: 2014 70 Employees with global support and field teams
- 3. Portworx is the leader across many industries ©2018 Portworx. Confidential. 3 SERVICE PROVIDERS INDUSTRIAL AUTOMOTIVE HEALTHCARE FINANCE/CONSULTING RETAIL/MEDIA GOVERNMENT ML/AI/IOT China Security Bureau Imubit
- 4. 4© 2017 PORTWORX | CONFIDENTIAL: DO NOT DISTRIBUTE Portworx runs on all schedulers and clouds Schedulers Infrastructure HA • Replication • Density • Encryption • Snapshot • Cloning • Data Mobility STORK Compute & Network Orchestration Storage Orchestration
- 5. Portworx is part of the CNCF stack Kubernetes - Cloud Native Scheduling OCI - Cloud Native Execution Runtime CSI CNI Portworx Other Weave Contiv Prometheus Portworx allows you to move this stack across various infrastructure types ...... network compute storage (ebs) AWS network compute storage (MD) AZURE network compute storage (G-PD) GOOGLE network compute storage (v-SAN) BARE METAL VMWARE Your Portable Cloud Stack Runs on any interchangeable infrastructure Multi Cloud
- 6. Why Portworx? Tight Kubernetes Integration and DevOps driven automation ● All operations driven through the scheduler ● Extensive OpenStorage API to use for your “Infrastructure as Code Platform” Very High Application Density Support ● 1000 Nodes per cluster, 100K virtual volumes per cluster, 1000 volumes per host ● No extra cloud provider cost per virtual volume ● High IOPS and bandwidth evenly distributed even to small volumes Multi AZ and Multi Cloud Application Level Availability ● Every Portworx volume is available in any Availability Zone ● Global volume namespace - Available even across different Cloud Providers ● Application level RTO on failover is in seconds Application Aware Volume Provisioning ● Application Aware Group Storage Features (Snaps, Encryption, DR per volume groups) ● Multi Container Volume Provisioning - An application is not just one container Data Workflow Management ● Blue Green deployment support ● Application level migration between clusters and clouds
- 7. 7© 2017 PORTWORX | CONFIDENTIAL: DO NOT DISTRIBUTE Top Use Cases for Stateful Containers + Portworx Databases Enable density and HA: run multiple databases (SQL, NoSQL) on any infrastructure, with containerized volumes that are isolated, backed-up off-site, and encrypted. Data Processing Process faster: create and access TBs of storage in seconds on any compute server in the cluster, enabling flexible and faster data processing. Content Management Scale easily: run multiple containers with files shared on a common volume, in order to scale-out more densely and with less to manage. DevOps Toolchain Integrate workflows: share common libraries as snapshots and backup to off-site s3, allowing for easier workflow integration and always-on data protection. Big Data Share infrastructure: run compute jobs with data converged and stored in containerized volumes, enabling other workloads on the same infrastructure.
- 8. Open Source OpenStorage.org Scheduler Data Layer: OpenStorage is a massively scalable data layer for Containers and Schedulers like Kubernetes and Mesosphere: https://github.com/libopenstorage LCFS Data Path: LCFS provides core data path functionality for Docker images. Check it out on https://github.com/portworx/lcfs PORX Bundled Data Services: Try out the Portworx community edition at https://github.com/portworx/px-dev Torpedo A test suite for validating storage solutions for Linux Container Orchestration tools CSI Container Storage Interface. Standard Storage API between all Schedulers and all Storage Providers STORK Cloud Native storage orchestration runtime scheduler plugin to translate a orchestration decisions into something upon which an external cloud native storage solution can act. Extends Kubernetes with more stateful awareness of the underlying storage provider, it's capabilities and state.
- 9. 9© 2017 PORTWORX | CONFIDENTIAL: DO NOT DISTRIBUTE Architecture
- 10. PX runs as OCI Container under systemd PX Device Store Timestamp Log Write Through cache I/O Dispatch I/O Q U E U E R P C C S I G O S S I P Provisioning/Mgmt Clustering Background tasks PXPX ■ Nodes share state information over gossip protocol ■ Use Key-Value Store for configuration data ■ Data Sent over highly optimized RPC PX gossip gossip gossip rpc Configuration Information PX OCI Container rpc rpc
- 11. PX Control Plane And Data Plane Device Store Timestamp Log Write Through cache I/O Dispatch I/O Q U E U E R P C C S I G O S S I P Provisioning/Mgmt Clustering Background tasks SCHEDULER bind mount: /var/data/mysql /dev/px Create, Mount, Snap, Encrypt, etc.. PX Virtual Block ext4/xfs Linux Kernel Mount R/W/F/T/D SSD HDD Synchronous Replication { I/O, usage, CPU, Mem } Real Time Feed