Docker Orchestration: Welcome to the Jungle! JavaOne 2015
Download as PPTX, PDF13 likes3,076 views
In two years, Docker hit the sweet spot for devs and ops, with tools for building, shipping, and running distributed apps architected as a set of collaborating microservices packaged as Linux containers. One area of the Docker ecosystem that saw a lot of innovation in the past year is container orchestration systems. This session compares and contrasts various Docker orchestration systems (Swarm, Machine, and Compose), the batteries included with Docker itself, Mesos, Kubernetes, CoreOS/Fleet, Deis, Cloud Foundry, and Tutum. It includes a demo of how to deploy a Java 8 app with MongoDB on several of these systems. The goal of the session is to give you a framework to help evaluate how these systems can meet your particular requirements.
Ad
More Related Content
What's hot (20)
Similar to Docker Orchestration: Welcome to the Jungle! JavaOne 2015 (20)
Ad
More from Patrick Chanezon (20)
Ad
Recently uploaded (20)
Docker Orchestration: Welcome to the Jungle! JavaOne 2015
- 1. Patrick Chanezon Docker Inc. @chanezon [email protected] Docker Orchestration Welcome to the Jungle!
- 2. French Polyglot Platforms Software Plumber San Francisco Developer Relations @chanezon
- 3. “Welcome to the jungle we've got fun and games We got everything you want honey, we know the names”
- 4. “We are the people that can find whatever you may need If you got the money honey we got your disease”
- 5. 1995 2015
- 7. “The future is already here — it's just not very evenly distributed” William Gibson, Neuromancer
- 8. Docker’s mission is to build tools of mass innovation
- 9. Internet (hardware layer) Servers Desktop s Phones Cars Houses Drones Network equipment Public transit TVs Industria l facilities Scientific instrument s Financial system Programmers Internet (software layer) App App App App App App App App App App App App App App App App App App App App App App App App App App App App
- 10. Internet (hardware layer) Servers Desktop s Phones Cars Houses Drones Network equipment Public transit TVs Industria l facilities Scientific instrument s Financial system Programmers App App App App App App App App App App App App App App App App App App App App App App App App App App App App a software layer to program the internet
- 11. Cloud Market PublicHybridPrivate IT Pros Devops DevelopersArchitects
- 16. as Boromir would say … http://blogs.gartner.com/richard-watson/ok-get-dockers-great/
- 18. Low MTBIAMSH MTBIAMSH (Mean Time Between Idea And Making Stuff Happen)
- 19. Agility == $$
- 20. Devops
- 21. 25 Mainframe
- 22. Client-Server 26
- 23. 27 Web
- 25. Docker
- 26. Isolation using Linux kernel features namespaces pid mnt net uts ipc user cgroups memory cpu blkio devices
- 27. Image layers
- 28. Docker Mission
- 30. docker-compose: running multiple containers Run your stack with one command: docker-compose up Describe your stack with one file: docker-compose.yml web: build: . command: python app.py ports: - "5000:5000" volumes: - .:/code links: - redis:redis redis: image: redis
- 31. docker-machine docker-machine create -d azure —azure-subscription-id="c4f51be3-784c-xxx-7c50ad9e1b7c" --azure-subscription-cert="/Users/pat/.ssh/docker-azure- cert.pem" --azure-location="East US" --azure-size=Small --azure-username="pat" pat-docker-machine-n
- 33. Kitematic
- 34. Docker Mission
- 35. Docker Hub
- 36. Docker Hub Dev & QA ColleaguesDevelopers QA Build & Ship
- 39. Docker Mission
- 40. Swarm Scheduler plugins Engine Volumes plugins Network plugins Service discovery plugins Engine Volumes plugins Network plugins Service discovery plugins mesos flockerglusterfs weavecalico consuletcdzookeeper midokuraciscoazurenuagenetworks Docker Plugins Batteries included but removable
- 43. Swarm load balancing: interlock https://github.com/ehazlett/interlock/tree/master/plugins/haproxy
- 44. Project Orca Control Interface (GUI, API) Swarm 3rd Party scheduler Docker Engine Dev Self-service Service Catalog Auto-Scale Pluggable Control Plane Compose Machine … Logging Monitoring HA Network Mgmt Volume Mgmt DeveloperOperations Auditing Common Micro Services (Examples) Service Discovery Load Balancer Secrets Mgmt
- 45. +
- 46. Leading Enterprises Worldwide Depend on Docker E-Commerce Media Life Sciences Finance Vertical Search IT SaaS IaaS PaaS
- 47. Open Standards
- 49. Plumbing
- 50. Notary “Let’s stop using curl|sh” Trusted collections for any content Transport-agnostic Reliable updates, proof of origin, resistant to untrusted transport, survivable key compromise Build on industry-leading standards and research
- 51. RunC The universal container runtime https://runc.io
- 53. Engine 1.9 Release • Network management •Top-level docker network command •Out of the box support for multi host overlay networking •Extensibility through plugins • Volume management •Top-level docker volume command •Extensibility through plugins • Built-in nodes discovery •Daemon --cluster-store and --cluster-advertise
- 54. Engine 1.9 Release • Builder •Refactoring toward client-side build support •ARG: build-time arguments (provides support for HTTP_PROXY) •STOPSIGNAL: choose the stop signal for the contained process • Miscellaneous •Quality, stability, performance improvements •awslog logging driver • Experimental •User namespaces phase 1 (daemon-wide root remap)
- 55. Roadmap Engine 1.10 • Runtime •Progress toward runC integration • Distribution •Ongoing effort to rewrite push/pull layer •New manifest design, with content addressability from the grounds-up • Networking •Stabilize all the new features shipped in 1.9.0 •Better support for IPv6 • Security •Stable user namespaces (phase 1)
- 56. Orchestration
- 58. Docker Swarm
- 63. Swarm integrations Fully integrated with Machine and Compose Mesos integration
- 65. Mesos
- 72. Kubernetes
- 74. Kubernetes Master / Scheduler host-1 host-2 host-3 host-n ….. Container Agent Container Agent Container Agent Container Agent Linux Linux Linux Linux
- 75. Kubernetes Scheduler host-1 host-2 host-3 host-n ….. Container Agent Container Agent Container Agent Container Agent Linux Linux Linux Linux Container Container
- 76. Kubernetes host-1 Container host-2 host-3 host-4 host-n … Container Container Container Container ContainerContainer Container Container
- 77. Kubernetes host-1 host-2 host-3 host-4 host-n … Frontend Worker my_app pod MyAppMyApp MyApp Replication Controller 3
- 78. Kubernetes host-1 host-2 host-3 host-4 host-n … Frontend Worker my_app pod MyAppMyApp MyApp Replication Controller 3
- 79. Kubernetes host-1 host-2 host-3 host-4 host-n … MyAppMyApp MyApp Replication Controller Pod Pod Pod Pod PodPod Pod Pod Replication Controller
- 80. Kubernetes host-1 host-2 host-3 host-4 host-n … MyApp staging MyApp staging MyApp staging MyApp prod MyApp prod MyApp prod MyApp prod MyApp prod MyApp Production Service { environment: prod } MyApp Staging Service { environment: staging } Labels and Services
- 81. Cloud Foundry & IBM BlueMix
- 82. Cloud Foundry Diego & Lattice cf docker-push my-app cloudfoundry/lattice-app
- 83. IBM Bluemix The Digital Innovation Platform
- 84. 84 Customer Managed Service Provider Managed IBM SoftLayer Bluemix started as a public PaaS Bluemix started with a major focus on developer productivity in the public cloud. Infrastructure as a Service Code Data Runtime Middleware OS Virtualization Servers Storage Networking Code Data Runtime Middleware OS Virtualization Servers Storage Networking Platform as a Service
- 85. 85 Customer Managed Service Provider Managed IBM SoftLayer We listened. Now we’re evolving to become even more flexible. Capabilities in Bluemix now span PaaS and IaaS and can be delivered as a public, dedicated, or on-premises* implementation. Infrastructure as a Service Code Data Runtime Middleware OS Virtualization Servers Storage Networking Code Data Runtime Middleware OS Virtualization Servers Storage Networking Platform as a Service *Bluemix Local coming Summer 2015 Built on open technologies:
- 86. How does Bluemix work? Bluemix is underlined by three key open compute technologies: Cloud Foundry, Docker, and OpenStack. It extends each of these with a growing number of services, robust DevOps tooling, integration capabilities, and a seamless developer experience. 86 Flexible Compute Options to Run Apps / Services Instant Runtimes Containers Virtual Machines Platform Deployment Options that Meet Your Workload Requirements Bluemix Public Bluemix Dedicated Bluemix Local* DevOps Tooling Your Own Hosted Apps / Services Integration and API Mgmt Powered by IBM SoftLayer In Your Data Center + + + + + + Always focused on what’s next Catalog of Services that Extend Apps’ Functionality Web Data Mobile AnalyticsCognitive IoT Security Yours + *Bluemix Local coming Summer 2015
- 87. Containers in Bluemix Bluemix now comes with a fully integrated, high performance Docker experience, meaning monitoring, logging, elasticity, enterprise images, and VM abstraction are all standard. 87 Docker Value IBM Value-add Customer Value Docker Hub Registry holds a repository of 75000+ Docker images • IBM hosted public registry containing IBM images - linked to Docker Hub • Client unique registry available on and off premises • Enterprise-ready images Access to the images you require to deploy containers that meet your business needs and strategy Open-source, standardized, lightweight, self sufficient LXC container technology • Enhanced performance with bare metal deployment • Run images to local datacenter or cloud • Deployment choice with pSeries & zSeries Flexibility to choose the right hybrid cloud mix for your business Build, ship, and run standardized containers • Integrated monitoring & logging • Elasticity to grow storage & container needs • Life-cycle management of containers and data volumes • No VMs to manage Docker ease of use combined with enterprise- level integrity and confidence Container connections using links and service discovery • Private network communication • External IP address • Subnet Range Extends and connects Docker containers to production-ready enterprise environments
- 89. Big 3 Amazon ECS Google Container Engine Microsoft Azure Container Service
- 90. Tutum
- 91. The Container Platform @tutumcloud tutum.co [email protected]
- 92. Tutum: The Container Platform TUTUM CONTAINER PLATFORM Any application Any infrastructur eManagedSimple Flexible Hybrid/Agnostic Any Operating System Containers + Other Design Principles:
- 93. Tutum: The Container Platform Dev Deploy ManageBuild CI CD Code repo Image repo Monitoring Logging Scaling Networking Storage Service Discovery Composability Security Hosts Public Cloud Private CloudAcross: Environments TUTUM CONTAINER PLATFORM Public Cloud Test Orchestration
- 94. Triton
- 95. Joyent Triton The network is the computer… v2:-)
- 96. Orchestration summary • Docker Swarm: Docker-style, provision with docker- machine,1.0 next week, production readiness • Tutum: SaaS orchestration, bring your own Infrastructure • Mesos: Twitter-style, aligned with Swarm • Fleet: CoreOS-style, simple • Kubernetes: Google-style, heavy-duty, many concepts • Deis: Heroku-style workflow • Cloud Foundry Diego, IBM BlueMix: PaaS -> orchestration • Also: Joyent, Flynn
- 97. Demo
- 98. • Docker Swarm, Compose and networking • docker 1.9 rc1 • swarm 1.0.0-rc2 • compose 1.5.0rc1 --x-networking Spring Boot App using MongoDB https://github.com/joshlong/spring-doge
- 99. • docs coming next week https://github.com/docker/docker/pull/17340 • create a Swarm cluster today https://github.com/dave- tucker/docker-network-demos/blob/master/swarm-local.sh • networking in compose https://github.com/docker/compose/blob/master/docs/netw orking.md Docker networking
- 100. Fire up your first container today! Ride the Whale!
- 101. Learning • http://docs.docker.com/ • http://training.docker.com • http://slideshare.net/chanezon • http://opencontainers.org • https://github.com/dave-tucker/docker-network-demos
- 103. Q&A
Editor's Notes
- #15: Their customer loves the apps they are building so fast for him: George sees $$ glint in his eyes!
- #16: George relishes complexity. Nobody understands how the system works... apart from him.
- #18: QWERTY 3.0 is a disaster, 2 years late
- #36: Docker Hub is Docker’s cloud service for … Publishing and discovering container images through the public registry Team collaboration and automation of application workflows
- #39: … and to make all this easy to configure and manage, Docker Trusted Registry also features a web-based admin GUI … for insights into the state of the DTR host …
- #47: And distributed applications are not just something for aggressive web companies. This is an application architecture that is being adopted by all of the leaders of industry…every major enterprise organization is either already there or going down that path because of the agility it provides them in delivering applications that engage with their customers.
- #80: e