Swarm - A Docker Clustering System
Download as PPTX, PDF3 likes2,808 views
This document discusses Docker Swarm, a native clustering service for Docker that allows scheduling of container workloads across multiple hosts. It describes how to set up a Swarm cluster by labeling multiple machines and joining them to a Swarm manager node. The Swarm manager then uses scheduling options like filters and strategies to distribute containers across hosts based on constraints, affinity, ports, dependencies, health checks, and node labels. While the Swarm API is mostly compatible with Docker's API, it currently has some missing endpoints and differences related to TLS support for secure communication in the cluster.
1 of 7
Downloaded 58 times
Ad
Recommended
Docker Swarm Introduction
Docker Swarm Introductionrajdeep Docker Swarm allows managing Docker clusters remotely. The key components are swarm managers, swarm nodes, and a scheduler. Swarm managers oversee nodes in the cluster using Docker APIs. The scheduler uses strategies and filters to determine where to place containers on nodes. Discovery services help register and discover nodes in the cluster.
Dockercon Swarm Updated
Dockercon Swarm UpdatedDocker, Inc. This document discusses Docker Swarm, a clustering and orchestration tool for Docker. It provides instructions for setting up a Swarm cluster using either a hosted discovery service or your own discovery service like Etcd. It also covers resource management using memory and CPU limits, port mapping, constraints to control where containers run, rescheduling policies, and the two step Swarm scheduler process of filtering nodes and selecting the best placement.
The age of orchestration: from Docker basics to cluster management
The age of orchestration: from Docker basics to cluster managementNicola Paolucci The container abstraction hit the collective developer mind with great force and created a space of innovation for the distribution, configuration and deployment of cloud based applications. Now that this new model has established itself work is moving towards orchestration and coordination of loosely coupled network services. There is an explosion of tools in this arena at different degrees of stability but the momentum is huge.
On the above premise this session we'll delve into a selection of the following topics:
- Two minute Docker intro refresher
- Overview of the orchestration landscape (Kubernetes, Mesos, Helios and Docker tools)
- Introduction to Docker own ecosystem orchestration tools (machine, swarm and compose)
- Live demo of cluster management using a sample application.
A basic understanding of Docker is suggested to fully enjoy the talk.
Docker Swarm 0.2.0
Docker Swarm 0.2.0Docker, Inc. Swarm in a nutshell
• Exposes several Docker Engines as a single virtual Engine
• Serves the standard Docker API
• Extremely easy to get started
• Batteries included but swappable
Clustering with Docker Swarm - Dockerops 2016 @ Cento (FE) Italy
Clustering with Docker Swarm - Dockerops 2016 @ Cento (FE) ItalyGiovanni Toraldo An introduction to Docker native clustering: Swarm.
Deployment and configuration, integration with Consul, for a product-like cluster to serve web-application with multiple containers on multiple hosts. #dockerops
Introduction to docker swarm
Introduction to docker swarmWalid Ashraf This document provides an introduction to Docker Swarm, which allows multiple Docker hosts to be clustered together into a single virtual Docker host. It discusses key components of Docker Swarm including managers, nodes, services, discovery services, and scheduling. It also provides steps for creating a Swarm cluster, deploying services, and considering high availability and security aspects.
Docker Machine & Docker Swarm
Docker Machine & Docker SwarmGuillermo Lucero This document provides an agenda and overview of Docker Machine and Docker Swarm. It discusses how Docker Machine allows managing Docker hosts on various platforms and distributions. It then explains how Docker Swarm exposes multiple Docker engines as a single virtual engine with built-in service discovery and scheduling. The document demonstrates how to set up a Docker Swarm cluster using the hosted discovery service and covers Swarm scheduling strategies, constraints, and container affinities.
Docker swarm introduction
Docker swarm introductionEvan Lin Docker Swarm allows managing multiple Docker hosts as a single virtual Docker engine. The presenter demonstrates setting up a traditional Docker Swarm cluster with an external key-value store and load balancer. SwarmKit provides the core components of Docker Swarm as standalone binaries. Docker Swarm Mode is integrated directly into Docker Engine 1.12 and later, providing built-in orchestration without external components. The presenter then demonstrates a tutorial using Docker Swarm Mode to deploy a multi-container voting application across 3 Docker hosts and scale the service.
Introction to docker swarm
Introction to docker swarmHsi-Kai Wang This document introduces Docker Swarm for clustering Docker hosts into a single virtual host. It discusses using Swarm with Consul and an overlay network. Key points:
- Docker Swarm turns a pool of Docker hosts into a single virtual host with a standard API.
- Consul provides service discovery, key-value storage, and health checking.
- An overlay network allows containers on different hosts to communicate, with networking defined by Docker but implemented by the hosts' kernels.
Docker swarm
Docker swarmAlberto Guimarães Viana This document discusses Microservices and Docker Swarm. It begins by introducing the presenter and their background. It then defines what a microservice is and introduces Docker. Key concepts about Docker Swarm are explained such as swarm features, service discovery without an external database, and the swarm concept of managers, workers, services and tasks. It demonstrates how to build a swarm cluster and add nodes, and discusses security, routing mesh, scaling, reverse proxy, rolling updates and secrets. Finally it briefly mentions logging, metrics and dashboard tools to monitor Docker systems.
Going Production with Docker and Swarm
Going Production with Docker and SwarmC4Media The document is a slide deck presentation by Bret Fisher on going into production with Docker and Swarm. Some key points from the presentation include focusing first on Dockerfiles rather than complex orchestration, avoiding anti-patterns like using the "latest" tag or trapping unique data in containers, and starting with a simple 3 node Swarm cluster for high availability before scaling up further. The presentation also provides examples of full tech stacks using various open source and commercial tools for a Dockerized infrastructure.
Docker Swarm for Beginner
Docker Swarm for BeginnerShahzad Masud This document provides an overview of Docker Swarm and how to set up and use a Docker Swarm cluster. It discusses key Swarm concepts, initializing a cluster, adding nodes, deploying services, rolling updates, draining nodes, failure scenarios, and the Raft consensus algorithm used for leader election in Swarm mode. The document walks through examples of creating a Swarm, adding nodes, deploying a service, inspecting and scaling services, rolling updates, and draining nodes. It also covers failure scenarios for nodes and managers and how the Swarm handles them.
Swarm mode
Swarm modeDharmit Shah This document discusses Docker Swarm Mode, which allows managing a cluster of Docker Engines called a swarm. Key features include integrated cluster management, declarative application deployment across nodes, automatic scaling, service discovery, and encryption between nodes. The document demonstrates initializing a swarm on two VMs, adding a worker node, deploying services in replicated and global modes, attaching services to networks, publishing service ports, updating services, and more swarm commands.
Nebulaworks Docker Overview 09-22-2015
Nebulaworks Docker Overview 09-22-2015Chris Ciborowski In this overview presented to a gathering of directors for a large network equipment manufacturer, Chris discusses Docker, DevOps workflows, considerations for containers in production, and the extended Docker technology ecosystem.
Container Orchestration with Docker Swarm
Container Orchestration with Docker SwarmFrederik Mogensen A deep dive into deploying services and orchestrating containers with Docker’s Swarm Mode.
Swarm Mode provides built-in container orchestration capabilities, including native clustering of Docker hosts and scheduling of container workloads.
The presentation starts out with a discussion of container orchestration. Then dives into a look at how Docker Swarm handles the specifics.
Docker Online Meetup #28: Production-Ready Docker Swarm
Docker Online Meetup #28: Production-Ready Docker SwarmDocker, Inc. presented by Alexandre Beslic (@abronan)
Swarm v1.0 is now ready for running your apps in production!
Swarm is the easiest way to run Docker applications at large scale on a cluster. It turns a pool of Docker Engines into a single, virtual Engine. You don’t have to worry about where to put containers, or how they’re going to talk to each other - it just handles all that for you.
We’ve spent the last few months tirelessly hardening and tuning it, and in combination with multi-host networking and the new volume system in Docker Engine 1.9, we can confidently say that it’s ready for running your apps in production. In our tests, we’ve been running Swarm on EC2 with 1,000 nodes and 30,000 containers and it keeps on scheduling containers in less than half a second. Not even breaking a sweat! Keep an eye for a blog post soon with the full details.
Read more: http://blog.docker.com/2015/11/swarm-1-0/
Docker Swarm 45-min Workshop (Mountain View Docker Meetup 2/24/2016)
Docker Swarm 45-min Workshop (Mountain View Docker Meetup 2/24/2016)Mike Goelzer My talk from the Mountain View Docker Meetup on Feb 24, 2016. It covers what Docker Swarm is, how to create a cluster, and then walks you through a sample app. Embedded links point to the public Github repo containing the sample app, as well as a series of Youtube videos showing how to reproduce the demo on your own.
Docker 1.12 and swarm mode
Docker 1.12 and swarm modeWesley Charles Blake Docker 1.12 is on everyone's lips these day. With built in Swarm mode, we can achieve orchestration out of the box with simplicity, reliability, and effective scalability. I had the pleasure of presenting Docker 1.12 and Swarm at a DevOps meetup held at SA Home Loans.
You can read more info on my blog: http://blog.stratotechnology.com/intro-to-docker-1-12-and-swarm-mode/
Docker Swarm Meetup (15min lightning)
Docker Swarm Meetup (15min lightning)Mike Goelzer Swarm allows multiple Docker hosts to be clustered together into a single virtual Docker host. It provides features like scheduling, rescheduling on failure, high availability with multiple masters, and service discovery. To set up a Swarm cluster, run the Swarm manager container on one host and restart the Docker daemons on the other hosts with arguments to join the cluster. An example voting app microservices demo shows how to deploy an application across a Swarm cluster.
Docker Networking & Swarm Mode Introduction
Docker Networking & Swarm Mode IntroductionPhi Huynh This document introduces Docker networking and Docker Swarm mode. It discusses the different types of Docker networks including bridge, null, and host networks. It also covers multi-host networking using overlay networks. For Docker Swarm mode, it describes the key features including self-healing, self-organizing, blue-print deployment, load balancing using a routing mesh, and not requiring additional components for service discovery or load balancing. The document aims to provide an overview of these topics and includes examples.
Introducing Docker Swarm - the orchestration tool by Docker
Introducing Docker Swarm - the orchestration tool by DockerRamit Surana Docker Swarm allows you to create a cluster of Docker hosts that acts as a single virtual Docker host. It provides native clustering for Docker and allows you to create and access a pool of Docker hosts. The key components of Docker Swarm include the resource manager, scheduler, discovery service, APIs, and store. The resource manager places containers based on available resources, while the scheduler proposes container placement using binpacking or random strategies.
Docker Swarm Is Dead: Long Live Docker Swarm
Docker Swarm Is Dead: Long Live Docker SwarmElton Stoneman From the Docker London MeetUp, presented on 27th June 2016. A walkthrough of Swarm Mode in Docker 1.12, the presentation introduces demos for creating a Docker Swarm using Azure virtual machines, and running a distributed application with a Node REST API, feeding analytics into Elasticsearch via a Redis queue.
What's New in Docker 1.12?
What's New in Docker 1.12?Ajeet Singh Raina Docker Engine 1.12 can be rightly called ” A Next Generation Docker Clustering & Distributed System”. Though Docker Engine 1.12 Final Release is around corner but the recent RC3 brings lots of improvements and exciting features. One of the major highlight of this release is Docker Swarm Mode which provides powerful yet optional ability to create coordinated groups of decentralized Docker Engines. Swarm Mode combines your engine in swarms of any scale. It’s self-organizing and self-healing. It enables infrastructure-agnostic topology.The newer version democratizes orchestration with out-of-box capabilities for multi-container on multi-host app deployments.
Consul and docker swarm cluster
Consul and docker swarm clusterEueung Mulyana The document discusses setting up a Docker Swarm cluster with 3 Raspberry Pi nodes and integrating Consul for service discovery. It begins with an introduction to Consul and its key features like service discovery, health checking, and key-value storage. It then describes deploying Consul and a Swarm master on one node, registering a sample web service, and verifying the cluster. Finally, it explores the Consul UI and adds a Docker UI for visualizing the cluster.
Docker swarm reloaded
Docker swarm reloadedGovinda Fichtner Presentation of the new Docker Swarm Mode in Docker 1.12 at the Bamberg/Germany Docker User Group Meetup (http://www.meetup.com/de-DE/Docker-Bamberg/) in July 2016.
Deploying and Scaling a Rails Application with Docker and Friends
Deploying and Scaling a Rails Application with Docker and FriendsInvisiblelines Scaling a Docker application across multiple nodes requires leveraging additional tools. Here I outline one approach using Docker Compose, Swarm, Consul and Registrator.
Docker swarm-mike-goelzer-mv-meetup-45min-workshop 02242016 (1)
Docker swarm-mike-goelzer-mv-meetup-45min-workshop 02242016 (1)Michelle Antebi Swarm allows multiple Docker hosts to be clustered together into a single virtual Docker host. The document discusses how to set up a Swarm cluster in three steps: 1) Create a key-value store, 2) Run the Swarm manager container, and 3) Configure Docker daemon arguments on hosts. It also provides an example of running a microservices voting application on Swarm and references additional example repositories.
Docker 1.5
Docker 1.5rajdeep The document discusses Docker 1.5 and its new features including IPv6 support, read-only containers, Docker stats, and the Docker image specification. IPv6 can be enabled by running Docker with the --ipv6 flag. Read-only containers restrict writes to containers. Docker stats provides live metrics for containers. The Docker image specification defines the format for layered image files and metadata.
Building Distributed System with Celery on Docker Swarm
Building Distributed System with Celery on Docker SwarmWei Lin This document discusses building distributed systems with Celery on Docker Swarm. It introduces Celery for asynchronous task queueing and message passing. Docker Swarm is used to deploy Celery worker containers across multiple hosts for parallel computing. Tasks can be routed to specific workers by queue or host name. This allows building distributed systems easily by sending tasks to worker containers without worrying about the underlying infrastructure.
Pp docker-swarm-doxlon-28th-march-2017
Pp docker-swarm-doxlon-28th-march-2017Bobby DeVeaux, DevOps Consultant An overview of building a production-ready fully-scalable Docker Swarm using Terraform & Packer on OpenStack.
Ad
More Related Content
What's hot (20)
Introction to docker swarm
Introction to docker swarmHsi-Kai Wang This document introduces Docker Swarm for clustering Docker hosts into a single virtual host. It discusses using Swarm with Consul and an overlay network. Key points:
- Docker Swarm turns a pool of Docker hosts into a single virtual host with a standard API.
- Consul provides service discovery, key-value storage, and health checking.
- An overlay network allows containers on different hosts to communicate, with networking defined by Docker but implemented by the hosts' kernels.
Docker swarm
Docker swarmAlberto Guimarães Viana This document discusses Microservices and Docker Swarm. It begins by introducing the presenter and their background. It then defines what a microservice is and introduces Docker. Key concepts about Docker Swarm are explained such as swarm features, service discovery without an external database, and the swarm concept of managers, workers, services and tasks. It demonstrates how to build a swarm cluster and add nodes, and discusses security, routing mesh, scaling, reverse proxy, rolling updates and secrets. Finally it briefly mentions logging, metrics and dashboard tools to monitor Docker systems.
Going Production with Docker and Swarm
Going Production with Docker and SwarmC4Media The document is a slide deck presentation by Bret Fisher on going into production with Docker and Swarm. Some key points from the presentation include focusing first on Dockerfiles rather than complex orchestration, avoiding anti-patterns like using the "latest" tag or trapping unique data in containers, and starting with a simple 3 node Swarm cluster for high availability before scaling up further. The presentation also provides examples of full tech stacks using various open source and commercial tools for a Dockerized infrastructure.
Docker Swarm for Beginner
Docker Swarm for BeginnerShahzad Masud This document provides an overview of Docker Swarm and how to set up and use a Docker Swarm cluster. It discusses key Swarm concepts, initializing a cluster, adding nodes, deploying services, rolling updates, draining nodes, failure scenarios, and the Raft consensus algorithm used for leader election in Swarm mode. The document walks through examples of creating a Swarm, adding nodes, deploying a service, inspecting and scaling services, rolling updates, and draining nodes. It also covers failure scenarios for nodes and managers and how the Swarm handles them.
Swarm mode
Swarm modeDharmit Shah This document discusses Docker Swarm Mode, which allows managing a cluster of Docker Engines called a swarm. Key features include integrated cluster management, declarative application deployment across nodes, automatic scaling, service discovery, and encryption between nodes. The document demonstrates initializing a swarm on two VMs, adding a worker node, deploying services in replicated and global modes, attaching services to networks, publishing service ports, updating services, and more swarm commands.
Nebulaworks Docker Overview 09-22-2015
Nebulaworks Docker Overview 09-22-2015Chris Ciborowski In this overview presented to a gathering of directors for a large network equipment manufacturer, Chris discusses Docker, DevOps workflows, considerations for containers in production, and the extended Docker technology ecosystem.
Container Orchestration with Docker Swarm
Container Orchestration with Docker SwarmFrederik Mogensen A deep dive into deploying services and orchestrating containers with Docker’s Swarm Mode.
Swarm Mode provides built-in container orchestration capabilities, including native clustering of Docker hosts and scheduling of container workloads.
The presentation starts out with a discussion of container orchestration. Then dives into a look at how Docker Swarm handles the specifics.
Docker Online Meetup #28: Production-Ready Docker Swarm
Docker Online Meetup #28: Production-Ready Docker SwarmDocker, Inc. presented by Alexandre Beslic (@abronan)
Swarm v1.0 is now ready for running your apps in production!
Swarm is the easiest way to run Docker applications at large scale on a cluster. It turns a pool of Docker Engines into a single, virtual Engine. You don’t have to worry about where to put containers, or how they’re going to talk to each other - it just handles all that for you.
We’ve spent the last few months tirelessly hardening and tuning it, and in combination with multi-host networking and the new volume system in Docker Engine 1.9, we can confidently say that it’s ready for running your apps in production. In our tests, we’ve been running Swarm on EC2 with 1,000 nodes and 30,000 containers and it keeps on scheduling containers in less than half a second. Not even breaking a sweat! Keep an eye for a blog post soon with the full details.
Read more: http://blog.docker.com/2015/11/swarm-1-0/
Docker Swarm 45-min Workshop (Mountain View Docker Meetup 2/24/2016)
Docker Swarm 45-min Workshop (Mountain View Docker Meetup 2/24/2016)Mike Goelzer My talk from the Mountain View Docker Meetup on Feb 24, 2016. It covers what Docker Swarm is, how to create a cluster, and then walks you through a sample app. Embedded links point to the public Github repo containing the sample app, as well as a series of Youtube videos showing how to reproduce the demo on your own.
Docker 1.12 and swarm mode
Docker 1.12 and swarm modeWesley Charles Blake Docker 1.12 is on everyone's lips these day. With built in Swarm mode, we can achieve orchestration out of the box with simplicity, reliability, and effective scalability. I had the pleasure of presenting Docker 1.12 and Swarm at a DevOps meetup held at SA Home Loans.
You can read more info on my blog: http://blog.stratotechnology.com/intro-to-docker-1-12-and-swarm-mode/
Docker Swarm Meetup (15min lightning)
Docker Swarm Meetup (15min lightning)Mike Goelzer Swarm allows multiple Docker hosts to be clustered together into a single virtual Docker host. It provides features like scheduling, rescheduling on failure, high availability with multiple masters, and service discovery. To set up a Swarm cluster, run the Swarm manager container on one host and restart the Docker daemons on the other hosts with arguments to join the cluster. An example voting app microservices demo shows how to deploy an application across a Swarm cluster.
Docker Networking & Swarm Mode Introduction
Docker Networking & Swarm Mode IntroductionPhi Huynh This document introduces Docker networking and Docker Swarm mode. It discusses the different types of Docker networks including bridge, null, and host networks. It also covers multi-host networking using overlay networks. For Docker Swarm mode, it describes the key features including self-healing, self-organizing, blue-print deployment, load balancing using a routing mesh, and not requiring additional components for service discovery or load balancing. The document aims to provide an overview of these topics and includes examples.
Introducing Docker Swarm - the orchestration tool by Docker
Introducing Docker Swarm - the orchestration tool by DockerRamit Surana Docker Swarm allows you to create a cluster of Docker hosts that acts as a single virtual Docker host. It provides native clustering for Docker and allows you to create and access a pool of Docker hosts. The key components of Docker Swarm include the resource manager, scheduler, discovery service, APIs, and store. The resource manager places containers based on available resources, while the scheduler proposes container placement using binpacking or random strategies.
Docker Swarm Is Dead: Long Live Docker Swarm
Docker Swarm Is Dead: Long Live Docker SwarmElton Stoneman From the Docker London MeetUp, presented on 27th June 2016. A walkthrough of Swarm Mode in Docker 1.12, the presentation introduces demos for creating a Docker Swarm using Azure virtual machines, and running a distributed application with a Node REST API, feeding analytics into Elasticsearch via a Redis queue.
What's New in Docker 1.12?
What's New in Docker 1.12?Ajeet Singh Raina Docker Engine 1.12 can be rightly called ” A Next Generation Docker Clustering & Distributed System”. Though Docker Engine 1.12 Final Release is around corner but the recent RC3 brings lots of improvements and exciting features. One of the major highlight of this release is Docker Swarm Mode which provides powerful yet optional ability to create coordinated groups of decentralized Docker Engines. Swarm Mode combines your engine in swarms of any scale. It’s self-organizing and self-healing. It enables infrastructure-agnostic topology.The newer version democratizes orchestration with out-of-box capabilities for multi-container on multi-host app deployments.
Consul and docker swarm cluster
Consul and docker swarm clusterEueung Mulyana The document discusses setting up a Docker Swarm cluster with 3 Raspberry Pi nodes and integrating Consul for service discovery. It begins with an introduction to Consul and its key features like service discovery, health checking, and key-value storage. It then describes deploying Consul and a Swarm master on one node, registering a sample web service, and verifying the cluster. Finally, it explores the Consul UI and adds a Docker UI for visualizing the cluster.
Docker swarm reloaded
Docker swarm reloadedGovinda Fichtner Presentation of the new Docker Swarm Mode in Docker 1.12 at the Bamberg/Germany Docker User Group Meetup (http://www.meetup.com/de-DE/Docker-Bamberg/) in July 2016.
Deploying and Scaling a Rails Application with Docker and Friends
Deploying and Scaling a Rails Application with Docker and FriendsInvisiblelines Scaling a Docker application across multiple nodes requires leveraging additional tools. Here I outline one approach using Docker Compose, Swarm, Consul and Registrator.
Docker swarm-mike-goelzer-mv-meetup-45min-workshop 02242016 (1)
Docker swarm-mike-goelzer-mv-meetup-45min-workshop 02242016 (1)Michelle Antebi Swarm allows multiple Docker hosts to be clustered together into a single virtual Docker host. The document discusses how to set up a Swarm cluster in three steps: 1) Create a key-value store, 2) Run the Swarm manager container, and 3) Configure Docker daemon arguments on hosts. It also provides an example of running a microservices voting application on Swarm and references additional example repositories.
Docker 1.5
Docker 1.5rajdeep The document discusses Docker 1.5 and its new features including IPv6 support, read-only containers, Docker stats, and the Docker image specification. IPv6 can be enabled by running Docker with the --ipv6 flag. Read-only containers restrict writes to containers. Docker stats provides live metrics for containers. The Docker image specification defines the format for layered image files and metadata.
Viewers also liked (10)
Building Distributed System with Celery on Docker Swarm
Building Distributed System with Celery on Docker SwarmWei Lin This document discusses building distributed systems with Celery on Docker Swarm. It introduces Celery for asynchronous task queueing and message passing. Docker Swarm is used to deploy Celery worker containers across multiple hosts for parallel computing. Tasks can be routed to specific workers by queue or host name. This allows building distributed systems easily by sending tasks to worker containers without worrying about the underlying infrastructure.
Pp docker-swarm-doxlon-28th-march-2017
Pp docker-swarm-doxlon-28th-march-2017Bobby DeVeaux, DevOps Consultant An overview of building a production-ready fully-scalable Docker Swarm using Terraform & Packer on OpenStack.
Microservices Architectures with Docker Swarm, etcd, Kuryr and Neutron
Microservices Architectures with Docker Swarm, etcd, Kuryr and NeutronFawad Khaliq Microservices architectures are revolutionizing the way software is envisioned and built. OpenStack has started to play a key role in enabling the microservices architectures and focused groups inside OpenStack community are working towards this goal: Magnum, Kuryr etc.
Docker is one of the key components here and combining them all, we get to build microservices architectures using tools like Docker Swarm, Etcd, Kuryr and Neutron. This workshop will provide attendees with the opportunity to gain experience with various Docker features and uses cases integrated with the OpenStack ecosystem. The lab will cover wide range of topics:
Introduction to Docker and OpenStack
Docker Swarm: Architecture and usage
Etcd
Kuryr and Neutron: Architecture and usage with DevStack
Deploying Microservices
Breaking Docker, Kuryr and debugging it!
Attendees simply need to come in (with their laptop). Workshop speaker/organizer will provide instructions and will be available to answer any questions.
Building Distributed System with Celery on Docker Swarm - PyCon JP 2016
Building Distributed System with Celery on Docker Swarm - PyCon JP 2016Wei Lin In this talk, the basic mechanisms of Celery and Docker-Swarm will be explained. With Docker-Swarm , a cluster was built upon two Raspberry Pi machines. Hadoop entry-level "Word Count" program could be re-written in Python and executed parallelly via Celery on the cluster. An example of distributed system modeling neural-network will also be explained.
Docker cluster with swarm, consul, registrator and consul-template
Docker cluster with swarm, consul, registrator and consul-templateJulien Maitrehenry This document discusses using Docker swarm, Consul, Registrator, and Consul-template together to create a clustered Docker environment with service discovery and auto-configuration capabilities. It describes how to create a swarm cluster, register nodes with Consul for service discovery, use Registrator to register Docker services with Consul, and utilize Consul-template to generate configuration files from Consul for services like load balancers.
Scaling Jenkins with Docker: Swarm, Kubernetes or Mesos?
Scaling Jenkins with Docker: Swarm, Kubernetes or Mesos?Carlos Sanchez The Jenkins platform can be dynamically scaled by using several Docker cluster and orchestration platforms, using containers to run slaves and jobs and also isolating job execution. But which cluster technology should be used? Docker Swarm? Apache Mesos? Kubernetes? How do they compare? All of them can be used to dynamically run jobs inside containers. This talk will cover these main container clusters, outlining the pros and cons of each, the current state of the art of the technologies and Jenkins support.
Container Orchestration Wars
Container Orchestration WarsKarl Isenberg Video: https://youtu.be/C_u4_l84ED8
Karl Isenberg reviews the history of distributed computing, clarifies terminology for layers in the container stack, and does a head to head comparison of several tools in the space, including Kubernetes, Marathon, and Docker Swarm. Learn which features and qualities are critical for container orchestration and how you can apply this knowledge when evaluating platforms.
What's New in Docker 1.12 by Mike Goelzer and Andrea Luzzardi
What's New in Docker 1.12 by Mike Goelzer and Andrea LuzzardiDocker, Inc. Mike Goelzer is a developer, hacker, author and the open source product management lead for Docker’s Core Runtime. He currently works on the open source Docker Engine and Docker’s open source container orchestration technologies. Andrea Luzzardi is a Software Engineer at Docker and was part of the original team that built the project. He is currently working on Swarm, a Docker-native clustering system. They discuss what is new in Docker.
Getting Deep on Orchestration: APIs, Actors, and Abstractions in a Distribute...
Getting Deep on Orchestration: APIs, Actors, and Abstractions in a Distribute...Docker, Inc. Orchestration platforms let us work with higher level ideas like services and jobs; but there is more to a platform than scheduling and service discovery. A platform is a collection of actors and APIs that work together and provide those higher level abstractions on a distributed system. In this session we'll go deep on the architecture of open source orchestration platforms, consider scaling pains, reveal extension points, and reflect on an orchestration platform at Amazon. We'll finish with a demo of a homemade abstraction deployed on a live, multi-cloud Swarm cluster.
Load Balancing Apps in Docker Swarm with NGINX
Load Balancing Apps in Docker Swarm with NGINXNGINX, Inc. On-demand webinar recording: http://bit.ly/2mRjk2g
Docker and other container technologies continue to gain in popularity. We recently surveyed the broad community of NGINX and NGINX Plus users and found that two-thirds of organizations are either investigating containers, using them in development, or using them in production. Why? Because abstracting your applications from the underlying infrastructure makes developing, distributing, and running software simpler, faster, and more robust than ever before.
But when you move from running your app in a development environment to deploying containers in production, you face new challenges – such as how to effectively run and scale an application across multiple hosts with the performance and uptime that your customers demand.
The latest Docker release, 1.12, supports multihost container orchestration, which simplifies deployment and management of containers across a cluster of Docker hosts. In a complex environment like this, load balancing plays an essential part in delivering your container-based application with reliability and high performance.
Join us in this webinar to learn:
* The basic built-in load balancing options available in Docker Swarm Mode
* The pros and cons of moving to an advanced load balancer like NGINX
* How to integrate NGINX and NGINX Plus with Swarm Mode to provide an advanced load-balancing solution for a cluster with orchestration
* How to scale your Docker-based application with Swarm Mode and NGINX Plus
Ad
Similar to Swarm - A Docker Clustering System (20)
How we scale DroneCi on demand
How we scale DroneCi on demandPatrick Jahns We are sharing our process of migrating to the container based DroneCI platform and our lessons learned when scaling it up for an active open source project like ownCloud. Our journey started with a static legacy CI system, which was gradually replaced with, at first, a static DroneCI infrastructure. Over the course of half a year, we further more migrated to a cloud provider in order to dynamically scale the CI system based on the build volume. The lessons learned during this journey, were transformed and contributed to the DroneCI project and resulted in the DroneCI autoscaler - which allows for automatic scaling of infrastructure resources with common cloud providers.
Unlocking DevOps Secuirty :Vault & Keylock
Unlocking DevOps Secuirty :Vault & KeylockHusseinMalikMammadli DevOps iş təhlükəsizliyi sizi maraqlandırır? İstər developer, istər təhlükəsizlik mühəndisi, istərsə də DevOps həvəskarı olun, bu tədbir şəbəkələşmək, biliklərinizi bölüşmək və DevSecOps sahəsində ən son təcrübələri öyrənmək üçün mükəmməl fürsətdir!
Bu workshopda DevOps infrastrukturlarının təhlükəsizliyini necə artırmaq barədə danışacayıq. DevOps sistemləri qurularkən avtomatlaşdırılmış, yüksək əlçatan və etibarlı olması ilə yanaşı, həm də təhlükəsizlik məsələləri nəzərə alınmalıdır. Bu səbəbdən, DevOps komandolarının təhlükəsizliyə yönəlmiş praktikalara riayət etməsi vacibdir.
Kubernetes for java developers - Tutorial at Oracle Code One 2018
Kubernetes for java developers - Tutorial at Oracle Code One 2018Anthony Dahanne You’re a Java developer? Already familiar with Docker? Want to know more about Kubernetes and its ecosystem for developers? During this session, you’ll get familiar with core Kubernetes concepts (pods, deployments, services, volumes, and so on) before seeing the most-popular and most-productive Kubernetes tools in action, with a special focus on Java development. By the end of the session, you’ll have a better understanding of how you can leverage Kubernetes to speed up your Java deployments on-premises or to any cloud.
DOD 2016 - Stefan Thies - Monitoring and Log Management for Docker Swarm and...
DOD 2016 - Stefan Thies - Monitoring and Log Management for Docker Swarm and...PROIDEA YouTube: https://www.youtube.com/watch?v=1HBP6LkKwLc&list=PLnKL6-WWWE_VtIMfNLW3N3RGuCUcQkDMl&index=13
The high level of automation for the container and microservice lifecycle makes the monitoring of Kubernetes or Swarm more challenging than in more traditional, more static deployments. Any static setup to monitor specific application containers does not work because orchestration tools like Kubernetes or Swarm make their own decisions according to the defined deployment rules. In this talk you will learn how DevOps can cope with challenges in Monitoring and Log Management on Docker Swarm and Kubernetes. We will start with the basics of container monitoring and logging, including APIs and tools, followed by an overview of the key metrics of both platforms. We will speak about cluster-wide deployments for monitoring and log management solutions and how to discover services for log collection and monitoring, tagging of logs and metrics. Finally, we will share insights derived from monitoring a 4700 node Swarm cluster, as part of the Swarm3k project.
SFBay Area Solr Meetup - June 18th: Benchmarking Solr Performance
SFBay Area Solr Meetup - June 18th: Benchmarking Solr PerformanceLucidworks (Archived) The document discusses benchmarking the performance of SolrCloud clusters. It describes Timothy Potter's experience operating a large SolrCloud cluster at Dachis Group. It outlines an methodology for benchmarking indexing performance by varying the number of servers, shards, and replicas. Results show near-linear scalability as nodes are added. The document also introduces the Solr Scale Toolkit for deploying and managing SolrCloud clusters using Python and AWS. It demonstrates integrating Solr with tools like Logstash and Kibana for log aggregation and dashboards.
Monitoring and Log Management for
Monitoring and Log Management forSematext Group, Inc. This document discusses centralized logging and monitoring for Docker Swarm and Kubernetes orchestration platforms. It covers collecting container logs and metrics through agents, automatically tagging data with metadata, and visualizing logs and metrics alongside events through centralized log management and monitoring systems. An example monitoring setup is described for a Swarm cluster of 3000+ nodes running 60,000 containers.
Tungsten Fabric Overview
Tungsten Fabric OverviewMichelle Holley Tungsten Fabric provides a network fabric connecting all environments and clouds. It aims to be the most ubiquitous, easy-to-use, scalable, secure, and cloud-grade SDN stack. It has over 300 contributors and 100 active developers. Recent improvements include better support for microservices, containers, ingress/egress policies, and load balancing. It can provide consistent security and networking across VMs, containers, and bare metal.
Characterizing and Contrasting Kuhn-tey-ner Awr-kuh-streyt-ors
Characterizing and Contrasting Kuhn-tey-ner Awr-kuh-streyt-orsSonatype Lee Calcote, Solar Winds
Running a few containers? No problem. Running hundreds or thousands? Enter the container orchestrator. Let’s take a look at the characteristics of the four most popular container orchestrators and what makes them alike, yet unique.
Swarm
Nomad
Kubernetes
Mesos+Marathon
We’ll take a structured looked at these container orchestrators, contrasting them across these categories:
Genesis & Purpose
Support & Momentum
Host & Service Discovery
Scheduling
Modularity & Extensibility
Updates & Maintenance
Health Monitoring
Networking & Load-Balancing
High Availability & Scale
The State of Linux Containers
The State of Linux Containersinside-BigData.com Christian Kniep presented this deck at the 2016 HPC Advisory Council Switzerland Conference.
"With Docker v1.9 a new networking system was introduced, which allows multi-host network- ing to work out-of-the-box in any Docker environment. This talk provides an introduction on what Docker networking provides, followed by a demo that spins up a full SLURM cluster across multiple machines. The demo is based on QNIBTerminal, a Consul backed set of Docker Images to spin up a broad set of software stacks."
Watch the video presentation:
http://wp.me/p3RLHQ-f7G
See more talks in the Swiss Conference Video Gallery:
http://insidehpc.com/2016-swiss-hpc-conference/
Sign up for our insideHPC Newsletter:
http://insidehpc.com/newsletter
Developing distributed applications with Akka and Akka Cluster
Developing distributed applications with Akka and Akka ClusterKonstantin Tsykulenko This document outlines a presentation on developing distributed applications with Akka and Akka Cluster. It introduces Akka as a toolkit for building highly concurrent, distributed, and fault tolerant applications. It discusses concurrency paradigms like actors, dataflow, and software transactional memory. Live demos are presented showing actors, Akka remoting and clustering, and consistent replicated data types. The presentation emphasizes building distributed systems with Akka's actor model and using features like routers, deployment, and CRDTs to manage distributed state.
[OpenInfra Days Korea 2018] Day 2 - E6 - OpenInfra monitoring with Prometheus![[OpenInfra Days Korea 2018] Day 2 - E6 - OpenInfra monitoring with Prometheus](https://cdn.slidesharecdn.com/ss_thumbnails/e61520monitoringopeninfrawithprometheusv1-180704062709-thumbnail.jpg?width=560&fit=bounds)
[OpenInfra Days Korea 2018] Day 2 - E6 - OpenInfra monitoring with PrometheusOpenStack Korea Community This document discusses using Prometheus for open infrastructure and cloud monitoring. It introduces Prometheus as a time series database and monitoring tool. Key features covered include metrics collection, service discovery, graphing, and alerting. The architecture of Prometheus is explained, including scrapping metrics directly or via exporters. A demo of Prometheus and Grafana is proposed to monitor Kubernetes clusters and visualize CPU usage. Alerting configuration and routes in Prometheus and Alertmanager are also summarized.
Swarm sec
Swarm secsnrism The goal of swarm-sec is to assess and highlight the security issues in a native swarm cluster setup and faciliate a developer or administrator to deploy a secure cluster environment. swarm-sec is an extension to docker-bench-security.
Currently swarm-sec can:
- Assesses possible issues in swarm daemon configuration
- Details node-specific security issues in the cluster
- Remote connection issues between the node and swarm manager
Continuous Deployment with Akka.Cluster and Kubernetes (Akka.NET)
Continuous Deployment with Akka.Cluster and Kubernetes (Akka.NET)petabridge In this 60 minute long webinar Petabridge and Akka.NET co-founder Aaron Stannard you will learn about how companies ranging from the Fortune 500 to brand new startups are changing the way the build .NET applications to leverage the very latest offerings from Microsoft and the .NET open source community.
You'll learn how and why companies are moving their applications onto .NET Core; rearchitecting them to use Akka.NET for fault tolerance, scalability, and the ability to respond to customers in real-time; containerizing them with Docker; putting everything together using Kubernetes for orchestration on-premise or on the cloud with Azure Container Services.
This session will provide an overview of how all of these technologies fit together and why companies are adopting them.
Docker Multi Host Networking, Rachit Arora, IBM
Docker Multi Host Networking, Rachit Arora, IBMNeependra Khare This document discusses Docker multi-host networking options. It provides an overview of Docker networking and describes goals of making the network a first class object and supporting networks across multiple hosts. It then discusses libnetwork, the updated Docker networking stack, and multi-host networking options like Open vSwitch, Weave, and software defined networks (SDNs). Specific setup instructions are provided for Open vSwitch and Weave. Performance comparisons show Weave and Open vSwitch with optimizations can achieve over 90 MB/s bandwidth while the default Open vSwitch configuration is much lower. An alternative OpenStack Neutron-based design is also briefly outlined.
Docker Devoxx UK - Never mind the bollocks here's the Linux Containers
Docker Devoxx UK - Never mind the bollocks here's the Linux ContainersPatrick Chanezon This document summarizes the history and current state of containerization technologies. It discusses early implementations in mainframes and virtualization in the 1990s. It then covers the rise of Docker in 2013 which enabled "write once, run anywhere" for applications. The document also outlines the Docker platform and tools like Docker Hub, Docker Machine, and Docker Compose. It discusses orchestration technologies like Docker Swarm and Kubernetes. Finally, it briefly mentions other container-focused companies and platforms like Tutum, Flocker, and Weave.
Characterizing and contrasting kuhn tey-ner awr-kuh-streyt-ors
Characterizing and contrasting kuhn tey-ner awr-kuh-streyt-orsLee Calcote The document provides an overview and comparison of several container orchestration platforms: Docker Swarm, Kubernetes, and Mesos/Marathon. It characterizes each based on their origins, support levels, scheduling approaches, modularity, updating processes, networking implementations, and abilities to scale and maintain high availability. While each has strengths for certain use cases, no single orchestrator is argued to be universally superior.
Get you Java application ready for Kubernetes !
Get you Java application ready for Kubernetes !Anthony Dahanne In this demos loaded talk we’ll explore the best practices to create a Docker image for a Java app (it’s 2019 and new comers such as Jib, CNCF buildpacks are interesting alternatives to Docker builds !) - and how to integrate best with the Kubernetes ecosystem : after explaining main Kubernetes objects and notions, we’ll discuss Helm charts and productivity tools such as Skaffold, Draft and Telepresence.
Docker: Behind the API
Docker: Behind the APIKarl Matthias A little bit about what's going on under the covers when you start a Docker container. We build a naive container from scratch.
WebSphere MQ tutorial
WebSphere MQ tutorialJoseph's WebSphere Library WebSphere MQ is a middleware tool that facilitates reliable application-to-application communication by sending and receiving messages via messaging queues. It provides a secure transport layer that moves data unchanged in the form of messages between applications across platforms. WebSphere MQ uses APIs to support programming languages like Java, C, COBOL. It differentiates between persistent and non-persistent messages to ensure reliable delivery. The queue manager maintains objects like queues, channels, and listens to ensure message flow.
2015 05-06-elias weingaertner-docker-intro
2015 05-06-elias weingaertner-docker-introHaufe-Lexware GmbH & Co KG This document provides an introduction to Docker and the need for orchestration tools when deploying multi-container applications. It discusses how Docker solves the problem of portability for software artifacts and defines key Docker concepts like images, containers, and registries. It also introduces orchestration tools like Docker Compose and Docker Swarm that automate deployment of interdependent services across clusters. The document argues for guidelines on Docker use at organizations to address questions around containerization strategies and orchestration platforms.
[OpenInfra Days Korea 2018] Day 2 - E6 - OpenInfra monitoring with Prometheus
[OpenInfra Days Korea 2018] Day 2 - E6 - OpenInfra monitoring with PrometheusOpenStack Korea Community
Ad
Recently uploaded (20)
Process Parameter Optimization for Minimizing Springback in Cold Drawing Proc...
Process Parameter Optimization for Minimizing Springback in Cold Drawing Proc...Journal of Soft Computing in Civil Engineering In tube drawing process, a tube is pulled out through a die and a plug to reduce its diameter and thickness as per the requirement. Dimensional accuracy of cold drawn tubes plays a vital role in the further quality of end products and controlling rejection in manufacturing processes of these end products. Springback phenomenon is the elastic strain recovery after removal of forming loads, causes geometrical inaccuracies in drawn tubes. Further, this leads to difficulty in achieving close dimensional tolerances. In the present work springback of EN 8 D tube material is studied for various cold drawing parameters. The process parameters in this work include die semi-angle, land width and drawing speed. The experimentation is done using Taguchi’s L36 orthogonal array, and then optimization is done in data analysis software Minitab 17. The results of ANOVA shows that 15 degrees die semi-angle,5 mm land width and 6 m/min drawing speed yields least springback. Furthermore, optimization algorithms named Particle Swarm Optimization (PSO), Simulated Annealing (SA) and Genetic Algorithm (GA) are applied which shows that 15 degrees die semi-angle, 10 mm land width and 8 m/min drawing speed results in minimal springback with almost 10.5 % improvement. Finally, the results of experimentation are validated with Finite Element Analysis technique using ANSYS.
Fort night presentation new0903 pdf.pdf.
Fort night presentation new0903 pdf.pdf.anuragmk56 This is the document of fortnight review progress meeting
DT REPORT by Tech titan GROUP to introduce the subject design Thinking
DT REPORT by Tech titan GROUP to introduce the subject design ThinkingDhruvChotaliya2 This a Report of a Design Thinking
The Gaussian Process Modeling Module in UQLab
The Gaussian Process Modeling Module in UQLabJournal of Soft Computing in Civil Engineering We introduce the Gaussian process (GP) modeling module developed within the UQLab software framework. The novel design of the GP-module aims at providing seamless integration of GP modeling into any uncertainty quantification workflow, as well as a standalone surrogate modeling tool. We first briefly present the key mathematical tools on the basis of GP modeling (a.k.a. Kriging), as well as the associated theoretical and computational framework. We then provide an extensive overview of the available features of the software and demonstrate its flexibility and user-friendliness. Finally, we showcase the usage and the performance of the software on several applications borrowed from different fields of engineering. These include a basic surrogate of a well-known analytical benchmark function; a hierarchical Kriging example applied to wind turbine aero-servo-elastic simulations and a more complex geotechnical example that requires a non-stationary, user-defined correlation function. The GP-module, like the rest of the scientific code that is shipped with UQLab, is open source (BSD license).
Avnet Silica's PCIM 2025 Highlights Flyer
Avnet Silica's PCIM 2025 Highlights FlyerWillDavies22 See what you can expect to find on Avnet Silica's stand at PCIM 2025.
Lidar for Autonomous Driving, LiDAR Mapping for Driverless Cars.pptx
Lidar for Autonomous Driving, LiDAR Mapping for Driverless Cars.pptxRishavKumar530754 LiDAR-Based System for Autonomous Cars
Autonomous Driving with LiDAR Tech
LiDAR Integration in Self-Driving Cars
Self-Driving Vehicles Using LiDAR
LiDAR Mapping for Driverless Cars
ADVXAI IN MALWARE ANALYSIS FRAMEWORK: BALANCING EXPLAINABILITY WITH SECURITY
ADVXAI IN MALWARE ANALYSIS FRAMEWORK: BALANCING EXPLAINABILITY WITH SECURITYijscai With the increased use of Artificial Intelligence (AI) in malware analysis there is also an increased need to
understand the decisions models make when identifying malicious artifacts. Explainable AI (XAI) becomes
the answer to interpreting the decision-making process that AI malware analysis models use to determine
malicious benign samples to gain trust that in a production environment, the system is able to catch
malware. With any cyber innovation brings a new set of challenges and literature soon came out about XAI
as a new attack vector. Adversarial XAI (AdvXAI) is a relatively new concept but with AI applications in
many sectors, it is crucial to quickly respond to the attack surface that it creates. This paper seeks to
conceptualize a theoretical framework focused on addressing AdvXAI in malware analysis in an effort to
balance explainability with security. Following this framework, designing a machine with an AI malware
detection and analysis model will ensure that it can effectively analyze malware, explain how it came to its
decision, and be built securely to avoid adversarial attacks and manipulations. The framework focuses on
choosing malware datasets to train the model, choosing the AI model, choosing an XAI technique,
implementing AdvXAI defensive measures, and continually evaluating the model. This framework will
significantly contribute to automated malware detection and XAI efforts allowing for secure systems that
are resilient to adversarial attacks.
theory-slides-for react for beginners.pptx
theory-slides-for react for beginners.pptxsanchezvanessa7896 Everything you need to know about react.
RICS Membership-(The Royal Institution of Chartered Surveyors).pdf
RICS Membership-(The Royal Institution of Chartered Surveyors).pdfMohamedAbdelkader115 Glad to be one of only 14 members inside Kuwait to hold this credential.
Please check the members inside kuwait from this link:
https://www.rics.org/networking/find-a-member.html?firstname=&lastname=&town=&country=Kuwait&member_grade=(AssocRICS)&expert_witness=&accrediation=&page=1
DATA-DRIVEN SHOULDER INVERSE KINEMATICS YoungBeom Kim1 , Byung-Ha Park1 , Kwa...
DATA-DRIVEN SHOULDER INVERSE KINEMATICS YoungBeom Kim1 , Byung-Ha Park1 , Kwa...charlesdick1345 This paper proposes a shoulder inverse kinematics (IK) technique. Shoulder complex is comprised of the sternum, clavicle, ribs, scapula, humerus, and four joints.
Data Structures_Searching and Sorting.pptx
Data Structures_Searching and Sorting.pptxRushaliDeshmukh2 Sorting Order and Stability in Sorting.
Concept of Internal and External Sorting.
Bubble Sort,
Insertion Sort,
Selection Sort,
Quick Sort and
Merge Sort,
Radix Sort, and
Shell Sort,
External Sorting, Time complexity analysis of Sorting Algorithms.
Level 1-Safety.pptx Presentation of Electrical Safety
Level 1-Safety.pptx Presentation of Electrical SafetyJoseAlbertoCariasDel Level 1-Safety.pptx Presentation of Electrical Safety
Value Stream Mapping Worskshops for Intelligent Continuous Security
Value Stream Mapping Worskshops for Intelligent Continuous SecurityMarc Hornbeek This presentation provides detailed guidance and tools for conducting Current State and Future State Value Stream Mapping workshops for Intelligent Continuous Security.
Artificial Intelligence (AI) basics.pptx
Artificial Intelligence (AI) basics.pptxaditichinar its all about Artificial Intelligence(Ai) and Machine Learning and not on advanced level you can study before the exam or can check for some information on Ai for project
AI-assisted Software Testing (3-hours tutorial)
AI-assisted Software Testing (3-hours tutorial)Vəhid Gəruslu Invited tutorial at the Istanbul Software Testing Conference (ISTC) 2025 https://iststc.com/
Process Parameter Optimization for Minimizing Springback in Cold Drawing Proc...
Process Parameter Optimization for Minimizing Springback in Cold Drawing Proc...Journal of Soft Computing in Civil Engineering
Swarm - A Docker Clustering System
- 1. Swarm – Container Cluster System Sriram Natarajan T-Labs
- 2. Docker Platform & Related Tools Machine Host 1 Machine Host 2 Machine Host 3 Swarm / Kubernetes / CoreOS/ Marathon … (Cluster Service) TCP/TLS Channel WEAVEWORKS Flannel etcd / consul / zookeeper (service discovery) Deploying Apps (Compose, fig) Registries (Hub, Quay) Monitoring/Logg ing (seagull, dockerana, logjam) UI (DockerUI, DockerBoard, Kitematic) Security (SELinux, Capabilities)
- 3. Swarm: Introduction • Native clustering service (version: 0.2.0) • Scheduling container workloads • Health check & rescheduling workloads • Supports Docker REST API
- 4. Swarm – Cluster Setup docker –H --label swarm join Host 1 docker –H --label swarm join Host 2 docker –H --label swarm join Host 3 Swarm (Manager Node) TCP/TLS Channel swarm create swarm manage Manager Node • Use discovery service – Hosted (tokens) – Etcd – Consul – Zookeeper • Create a cluster • Setup Swarm Manager to listen for docker hosts Host Nodes • Start docker in n/w interface • Label the nodes (next slide) • Join the cluster • Secure channel (if reqd..)
- 5. Swarm – Clustering System docker –H --label swarm join Host 1 docker –H --label swarm join Host 2 docker –H --label swarm join Host 3 Swarm (Manager Node) TCP/TLS Channel swarm create swarm manage Docker CLI Remote APIs Advanced Container Scheduler Options • Filters • Strategies
- 6. Scheduling Options - Filters Filters • Constraint – storagedriver, executiondriver, kernelversion,operatingsystem – label • Affinity – Containers – Images – Other Expressions • Port – Nodes with available ports • Dependency – Co-scheduler for shared volumes – Links, Shared network stack – Combination of dependencies • Health Strategies • Binpacking • Random • Spread Label -> service=security FW container Snort container Host 1 Label -> service=perf Port 80 Host 2 Label -> service=monitor Host 3 Swarm (Manager Node) TCP/TLS Channel swarm create swarm manage
- 7. Swarm: Remote API Support Not Supported Yet • Compatible with Docker remote API • There are some missing endpoints and few differing from docker api (75 % coverage) API Differences • TLS Support – Setup a CA – Use CA to manage your keys and certificates for your manager and hosts • Setup – Start the docker daemons in hosts with TLS options – Start the Swarm manager with TLS options