Tectonic Summit 2016: Multi-Cluster Kubernetes: Planning for Unknowns

Dec 19, 2016Download as PPTX, PDF1 like539 views

- Concur is a travel and expense management company with 6500+ employees and offices worldwide. They process over 70 million transactions and $50 billion in travel and expense spend annually. - The presenter is a Principal Architect at Concur who has been working with Kubernetes since 2015. He discusses why Concur chose Kubernetes and CoreOS for container orchestration. - Concur runs multiple Kubernetes clusters across different regions for high availability. A custom tool called kube2cnqr manages load balancing between clusters.

Tectonic Summit 2016: Multi-Cluster Kubernetes: Planning for Unknowns

Agenda
• Why k8s?
• Why CoreOS?
• K8s @ Concur
• Q & A

What is Concur?
6500+ employees
Offices:
Australia
China
Czech
Republic
France
Germany
Holland
India
Japan
Philippines
Singapore
Sweden
UK
US
HQ: Bellevue
70m transactions
50b+ USD
T&E spend
annually
€59m
New cloud
bookings
Q3 2015
Cloud DNA
99
Established
1993
> 60%
Fortune 500

2011 2012 2013 2014 2015 2016 20182017
Expense transactions
Bookings growth
2013 2015
55
million
77+
million
Provisioned users
35+
million
2015
Registered mobile users
2013 2015
2.1
million
5+
million
Concur growth

A little about me
Principal Architect
• Concur since 1998 in various roles (DBA, Ops Manager
& Architect, etc.)
• Corking w/ k8s since mid 2015
• contributor to k8s and participant in federation & service
catalog SIGs
• Email danwilson on github, k8s slack & gmail

Why Kubernetes?
• Largest community support
• Gifted to Linux Foundation
• Protection from shifts in container technology
• Pluggable API
• Capable of isolation between namespaces
• Declarative syntax for the complete make up of services
• Built in logging, service discovery, etc.
• Networking design eliminates port conflicts of containers

Why CoreOS?
• Simple updates by channel
• Designed to run as a cluster
• Low overhead
• Best documentation for k8s

High Availability
• All things fail, yes everything!
• K8s HA guide: http://kubernetes.io/docs/admin/high-availability/
• cluster etcd – 3, 5 or 7 nodes
• replicated + load balanced api servers
• many minions

High Availability
If cluster == alwaysOnline {
glog.V(1). Infof(“nothing to do here!”)
}

Location US EUROPE
Zone A B C A B C
Cluster v.1.2 us12a us12b us12c eur12a eur12b eur12c
K8s @ Concur

Elastic
(logging)
Prometheus
(monitoring)
Load Balancers
etcd
Nodes
etcd
Nodes
K8s @ Concur

K8s @ Concur
• kube2cnqr
• Golang docker container
• Watches the k8s API for updates to services and worker nodes
• Calls a Concur internal API to addremove load balancer entries as
needed
• Handles connecting multiple k8s clusters to a single load balancer
endpoint
• Extras
• External-IP set on service objects
• Annotation w/ DNS name set on service objects
• Handles multiple load balancer tiers
• Allow services to specify DNS name

Sample project
• https://github.com/concur/kubegowatcher
• A sample golang program that leverages kubernetes watch endpoints
using the client-go library.
• Designed to run as a container on k8s
• example of setting annotation on the service
• example of checking event delay
• Apache 2.0 license
• Add your own business logic
• Contribute back improvements to make it better

Location US EUROPE
Zone A B C A B C
Cluster v.1.2 us12a us12b us12c eur12a eur12b eur12c
K8s @ Concur – k8s upgrades

Location US EUROPE
Zone A B C A B C
Cluster v.1.2 us12a us12b us12c eur12a eur12b eur12c
Cluster v.1.3 us13a us13b us13c eur13a eur13b eur13c
K8s @ Concur – k8s upgrades

K8s @ Concur
Deployment Challenges
• Stale kubectl scripts
• Stale kubectl config
• Handling credentials for each ci system
• Many commands for each cluster
• Handling proxy

Deployment API
CI
Deploy
petshop:v1
to test
test14a, b & c
K8s API calls for
service &
deployment

Deployment API
CI
Deploy
petshop:v1
to prod
US14a, b &
c
EMEA14a, b & c
APAC14a, b & c
K8s API calls for
service &
deployment

Config API
Add/remove
cluster
EMEA14a, b & c

Setup API
curl /setup
Output kubectl
config
commands for
all cluster zones
requested
| bash

K8s @ Concur
Add features to kubernetes federation
• v1.6 – deploying to clusters based on
label #29887
Other potentials…
• Location specific overrides
• Global overrides
• Feature limitations (for example,
don’t allow pods/rc’s without a
deployment)
Docs: https://github.com/concur/skipper

Q & A
Email danwilson on github, k8s slack & gmail

This document discusses using Kubernetes to build multitenant data architectures. It notes that software development and data science have distinct lifecycles that are well-served by repeatability. Kubernetes allows packaging of different workloads in containers and scheduling them across clusters, bridging data science and development. Some challenges include ensuring collaboration between container types and adapting workloads not designed for Kubernetes. Overall, Kubernetes provides benefits like resource sharing and self-healing that can form the basis of a multitenant data platform.

Tectonic Summit 2016: Brandon Philips, CTO of CoreOS, KeynoteCoreOS

The document discusses CoreOS's expertise across the technology stack for container-based applications. This includes Linux, container engines, container image specifications, clustered databases like etcd, cloud independence, identity federation, and more. CoreOS is focused on open standards through initiatives like the Open Container Initiative and ensuring technologies like Kubernetes, rkt, and etcd can scale to power large production deployments.

Tectonic Summit 2016: CoreOS Tectonic on AWSCoreOS

Kubestr browse2021.pptxLibbySchulze

This document discusses Kubestr, a set of tools to help debug, validate, and evaluate storage in Kubernetes clusters. It allows users to identify available storage options, validate storage configurations, evaluate performance using benchmarks, and browse the contents of persistent volumes. The presentation provides an overview of common storage issues Kubestr aims to address, a demonstration of its features, and a call for users to try the tools and provide feedback.

Openstack days sv building highly available services using kubernetes (preso)Allan Naim

This document discusses Google Cloud Platform's Kubernetes and how it can be used to build highly available services. It provides an overview of Kubernetes concepts like pods, labels, replica sets, volumes, and services. It then describes how Kubernetes Cluster Federation allows deploying applications across multiple Kubernetes clusters for high availability, geographic scaling, and other benefits. It outlines how to create clusters, configure the federated control plane, add clusters to the federation, deploy federated services and backends, and perform cross-cluster service discovery.

Zero-downtime deployment of Micro-services with KubernetesWojciech Barczyński

Managing kubernetes deployment with operatorsCloud Technology Experts

Kubernetes is a fast-paced project and things move really fast. In deploying applications, you have several options like raw YAML files, Helm, or Operator but what are the pros and cons of each? This talk will explore the right ways to manage your production applications through seamless installation, the patch fixes, and upgrades. Several demos will be used on a live cluster to illustrate how things can be done the right way that makes life very easy for the DevOps.

Is your kubernetes negative or positive LibbySchulze

This document summarizes an on-demand webinar about Kubescape, an open-source tool for testing Kubernetes security and compliance. It discusses how Kubescape allows scanning a Kubernetes cluster or configuration files against multiple frameworks with a single click. The webinar demonstrates running an initial scan in under 3 minutes, analyzing results, and integrating Kubescape into CI/CD pipelines and clusters. It also introduces the ARMO platform for securing the full Kubernetes development lifecycle.

OpenStack on Kubernetes (BOS Summit / May 2017 update)rhirschfeld

This document discusses using Kubernetes as an underlay platform for OpenStack. Some key points: 1. Kubernetes is becoming more widely used and understood by operators compared to OpenStack. Using Kubernetes as an underlay could improve simplicity, stability, and upgrade processes for OpenStack. 2. There are still many technical challenges to address, such as networking, storage, tooling to manage OpenStack on Kubernetes, and ensuring containers meet Kubernetes' immutable infrastructure requirements. 3. Using Kubernetes as an underlay risks further confusing the messaging around OpenStack by implying Kubernetes is more stable or a replacement target. Clear communication will be important to avoid undermining OpenStack.

The Complexity to "Yes" in Analytics Software and the Possibilities with Dock...Docker, Inc.

When you have to say ""YES"" to everything, what does that really mean? The Boston Consulting Group (BCG) is a global management consulting firm that advises industry leading companies on value creation strategies, innovation, transformation, supply chain management and much more. BCG provides recommendations and analytics that are custom tailored to the needs of each client. To do this BCG is transforming what used to be presentations and manual models into software that is prototyped and distributed to their client to run on their infrastructure - in effect changing the way BCG delivers value. However the productization process poses unique challenges and opportunities. Their clients have every type of infrastructure and application stack within their IT environments, how can BCG ensure that the custom built analytics applications will operate well at scale in their client's production environment - especially when it is an environment that they don't control? The bespoke nature of the BCG business led the team to embark on an engineering led journey to containerization with Docker. Attend this session to learn more about the approach, challenges and how BCG is enabling transformation with Docker Enterprise Edition.

DockerCon SF 2015: Resilient Routing and DiscoveryDocker, Inc.

This document discusses resilient routing and discovery in large distributed systems. It describes Shopify's experience building reliable systems from unreliable components by focusing on resiliency, service discovery, routing and orchestration. It provides examples of techniques used like circuit breakers and failure injection tools. It also discusses the tradeoffs of different discovery solutions and Shopify's current approach of using DNS with Zookeeper for orchestration.

DCEU 18: Docker Container NetworkingDocker, Inc.

This document discusses Docker container networking and publishing applications securely with Docker Enterprise. It provides an overview of key Kubernetes networking concepts like pods, services, ingress and network policies. It then details how Docker Enterprise integrates with Calico for container networking and policy-driven security. The integration provides connectivity between pods and services out of the box. It also allows enforcing network policies and zero-trust security through Calico's policy engine. The document concludes with demos of publishing sample applications using Docker Swarm services and Kubernetes ingress resources.

Canary Releases on Kubernetes with Spinnaker, Istio, & Prometheus (2020)Kublr

In a microservices world, applications consist of dozens, hundreds, or even thousands of components. Manually deploying and verifying deployment quality in production is virtually impossible. Kubernetes, which natively supports rolling updates, enables blue-green application deployments with Spinnaker. However, the gradual rollout is a feature that doesn’t come out-of-the-box but can be achieved by adding Istio and Prometheus to the equation. During this meetup, Slava will discuss canary release implementations on Kubernetes with Spinnaker, Istio, and Prometheus. He’ll examine the role of each tool in the process and how they are all connected. During a demo, he will demonstrate a successful and failed canary release, and how these tools enable IT teams, to properly roll out changes to their customer base without any downtime.

Kubernetes: one cluster or many cornelia davis

When we think about establishing a Kubernetes capability for our organization, our instinct, or perhaps just habit, might lead us to stand up a single cluster that will then be a shared resource across numerous tenants. Kubernetes offers namespaces that are intended to carve up the capacity across different users or groups of users. And while this may work well in some scenarios, it does impose certain constraints and limitations on its use. For example, it is well understood that the multitenancy in Kubernetes is soft, meaning it does not guard against deliberately malicious attacks from one tenant to another. If instead, we align tenant boundaries to Kubernetes clusters, effectively creating many single tenant clusters we can not only avoid certain limitations but we gain some significant advantages. Add a control plane for managing these sets of clusters and we have a powerful solution built on decades of maturity in machine virtualization. In this session we will present both models, multi-tenant clusters and multi-clusters and study the tradeoffs of each.

Setup Hybrid Clusters Using Kubernetes Federationinwin stack

This document summarizes how to setup hybrid clusters using Kubernetes Federation. It discusses the benefits of federation such as keeping applications synced across multiple clusters and configuring network resources to route traffic. It then describes the federation architecture including the federation control plane and federated resources/clusters. Finally, it provides steps to setup a demo federation including initializing the control plane and joining clusters from different regions.

Manage thousands of k8s applications with minimal efforts using kube carrierLibbySchulze

KubeCarrier is an open source platform that allows managing applications and services across multiple Kubernetes clusters with minimal effort. It functions as an "operator of operators" by discovering custom resources from operators running in service clusters and making them available for users in a centralized service hub. This allows application operators to run in service clusters while KubeCarrier propagates the custom resources from the service hub to drive the operators across clusters. It provides a multi-tenant environment with support for multiple service providers and consumers.

Democratizing machine learning on kubernetesDocker, Inc.

One of the largest challenges facing the machine learning community today is understanding how to build a platform to run common open-source machine learning libraries such as Tensorflow. Both Joy and Lachie are both passionate about making machine learning accessible to the masses using Kubernetes. In this session they'll share how to deploy a distributed Tensorflow training cluster complete with GPU scheduling on Kubernetes. We'll also share how distributed Tensorflow training works, various options for distributed training, and when to choose what option. We'll also share some best practices on using distributed Tensorflow on top of Kubernetes, based on our latest performance tests performed on public cloud providers. All work presented in this session will be accessible via a public Github repository.

How to Run Kubernetes in Restrictive EnvironmentsKublr

Meeting the Needs of Enterprise Governance and Security Installing Kubernetes is easy. Ensuring it complies with your organization’s enterprise governance and security requirements isn’t. During this webinar, Oleg will explain how to use Kubernetes while meeting enterprise requirements. In this technically-focused talk, he’ll summarize common prerequisites for running Kubernetes in production, and how to leverage fine-grained controls and separation of responsibilities to meet enterprise governance and security needs. The presentation will include basic requirements for audit, security, authentication, authorization, integration with existing identity management, logging, and monitoring. Because on-premise Kubernetes deployments don’t come without their challenges, Oleg will cover the limitations of a bare-metal installation, interactions with vSphere’s API, achieving HA, reliability and disaster recovery, as well as handling OS upgrades, security patches, and Kubernetes upgrades. He’ll close with a quick outlook of what’s next, including infrastructure as code, immutable infrastructure, and GitOps.

Pivotal Container Service (PKS) at SF Cloud Foundry Meetupcornelia davis

Deploy prometheus on kubernetesCloud Technology Experts

Canary Releases on Kubernetes w/ Spinnaker, Istio, and PrometheusKublr

In a microservices world, applications consist of dozens, hundreds, or even thousands of components. Manually deploying and verifying deployment quality in production is virtually impossible. Kubernetes, which natively supports rolling updates, enables blue-green application deployments with Spinnaker. However, gradual rollouts is a feature that doesn't come out-of-the-box but can be achieved by adding Istio and Prometheus to the equation. During this meetup, Slava Koltovich, CEO of Kublr, and Oleg Atamanenko, Senior Software Architect, discussed canary release implementations on Kubernetes with Spinnaker, Istio, and Prometheus. They examined the role of each tool in the process and how they are all connected. During a demo, they demonstrated a successful and a failed canary release, and how these tools enable IT teams to properly roll out changes to their customer base without any downtime.

How Docker EE Helps Open Doors at Assa AbloyDocker, Inc.

Over the past 20 years, Assa Abloy has transformed from a mechanical lock producer to the global leader in door-opening solutions. Today, Assa Abloy is at the forefront of innovation when it comes to digital access solutions. During this talk, we will discuss how Assa Abloy is using Docker EE to build a Common Access Technology platform based on microservices running in containers. We will share the architectural decisions that were made and how those resulted in deploying Docker EE on AWS. We will discuss both the technical challenges Assa Abloy encountered and the organizational changes that affected the way they develop their software. Next, we will share how Assa Abloy plans to roll out on a global scale.

Application Portability with Kubernetes (k8)Kublr

Containers and Kubernetes allow for code portability across on-premise VMs, bare metal or multiple cloud provider environments. Yet, despite this portability promise, developers may include configuration and application definitions that constrain or even eliminate application portability. In this meetup Oleg Chunikhin, CTO at Kublr, described best practices for “configuration as code” in a Kubernetes environment. He demonstrated how a properly constructed containerized app can be deployed to both Amazon and Azure using the Kublr platform, and how Kubernetes objects, such as persistent volumes, ingress rules and services, can be used to abstract from the infrastructure.

The Truth Behind ServerlessDocker, Inc.

The document discusses serverless computing and functions as a service (FaaS) platforms. It provides an overview of Amazon Lambda including details on storage limits, duration limits, memory sizes, and how functions are executed in containers. It also summarizes the key points of Amazon's serverless manifesto and lists several FaaS providers and event sources. The document raises questions about the challenges of orchestrating containers at scale and implementing serverless architectures for low latency and state management.

Basics of Kubernetes on BOSH: Run Production-grade Kubernetes on the SDDCMatt McNeeney

This document provides an overview of running production-grade Kubernetes on VMware's Software Defined Data Center (SDDC) using BOSH and Pivotal Container Service (PKS). It begins with introductions and discusses the benefits of the SDDC for abstracting hardware resources. BOSH is introduced as a tool for deploying and managing distributed systems that provides capabilities for bundled releases, integration, and consistent deployments. Kubernetes is summarized as an open-source platform for container orchestration. KuBo and PKS are presented as solutions for deploying Kubernetes on BOSH that address challenges of configuration, tenancy, and isolation across teams. PKS provisions BOSH-managed Kubernetes environments through a service broker to provide each team

Kubernetes Meetup: CNI, Flex Volume, and SchedulerKatie Crimi

Want to deploy containers on your data center network with persistent storage? Kubernetes is a highly extensible container management system with support for many networking and storage technologies. Open-source contributor Chakri Nelluri will explain FlexVolume, an upstream Kubernetes API for pluggable storage providers, plus scheduler and Container Network Interface (CNI) plugins. Chakri will demonstrate pod deployment with standard Docker images on a Diamanti appliance. Bring your questions about Kubernetes, Docker, networking, and persistent storage and network with your peers Diamanti brings to market the first appliance purpose-built for containerized applications that combines the ease of hyperconverged infrastructure with the unparalleled performance and efficiency of bare-metal containers. Diamanti accelerates time-to-market, guarantees real-time service levels, and consolidates containers with 90% utilization. Dev done fast. Ops done right.™

DCEU 18: From Monolith to MicroservicesDocker, Inc.

Jeff Nickoloff - Co-founder, Topple Growth can be challenging to address once monolithic systems begin to fail under strain or internal software development processes begin to slow the release cadence. Many organizations are looking to microservices architecture to solve these application issues, whether they plan to write new applications or rewrite the monoliths into microservices. This talk will highlight the common technical and cultural issues that will make microservice architectures a challenge to adopt and maintain. Issues include impact of Dunbar's Number and Conway's Law, build-time vs runtime continuous integration, evolution of testability, API versioning impact, logistics overhead, artifact management, and strategies for iteration in a distributed environment. Attendees will learn: - How and why microservice architectures and ownership end up falling along organizational lines (and why that is a good thing) - How we can learn from monolith tooling to inform our tooling in a microservice environment - How you can achieve operational excellence at scale taking a logistical approach with Docker.

DockerCon SF 2015: Interconnecting Containers at Scale w/ NGINXDocker, Inc.

The document discusses how NGINX can help with interconnecting microservices at scale using containers. It provides an example docker-compose configuration that sets up Consul for service discovery, Registrator to register services with Consul, and NGINX Plus to load balance requests across multiple containers and automatically generate its configuration from Consul. The live demo shows how scaling a service results in new containers being automatically registered with Consul and load balanced by NGINX.

Tectonic Summit 2016: Managing 6 PB of Earth Imagery with KubernetesCoreOS

Tectonic Summit 2016: Networking for Kubernetes CoreOS

Sreekanth Pothanis, Cloud Engineering, eBay shares a networking Kubernetes tale from the trenches. Networking is the hardest component in any ones infrastructure, everything depends on it. Specifically when we have web scale infrastructure with tens of thousands of servers. eBay is investing heavily in Kubernetes and networking again is one of the areas we have the most difficulty with. During the course of this talk we will go through various approaches we tried to make container networking conform to Kubernetes networking principles, while ensuring that it adapts to the existing networking models our infrastructure supports. We would also cover how we have automated the process of setting up networking for Kubernetes clusters and how it offers seamless integration with non-Kubernetes workloads. 12/12/16

More Related Content

What's hot (20)

OpenStack on Kubernetes (BOS Summit / May 2017 update)rhirschfeld

The Complexity to "Yes" in Analytics Software and the Possibilities with Dock...Docker, Inc.

DockerCon SF 2015: Resilient Routing and DiscoveryDocker, Inc.

DCEU 18: Docker Container NetworkingDocker, Inc.

Canary Releases on Kubernetes with Spinnaker, Istio, & Prometheus (2020)Kublr

Kubernetes: one cluster or many cornelia davis

Setup Hybrid Clusters Using Kubernetes Federationinwin stack

Manage thousands of k8s applications with minimal efforts using kube carrierLibbySchulze

Democratizing machine learning on kubernetesDocker, Inc.

How to Run Kubernetes in Restrictive EnvironmentsKublr

Pivotal Container Service (PKS) at SF Cloud Foundry Meetupcornelia davis

Deploy prometheus on kubernetesCloud Technology Experts

Canary Releases on Kubernetes w/ Spinnaker, Istio, and PrometheusKublr

In a microservices world, applications consist of dozens, hundreds, or even thousands of components. Manually deploying and verifying deployment quality in production is virtually impossible. Kubernetes, which natively supports rolling updates, enables blue-green application deployments with Spinnaker. However, gradual rollouts is a feature that doesn't come out-of-the-box but can be achieved by adding Istio and Prometheus to the equation. During this meetup, Slava Koltovich, CEO of Kublr, and Oleg Atamanenko, Senior Software Architect, discussed canary release implementations on Kubernetes with Spinnaker, Istio, and Prometheus. They examined the role of each tool in the process and how they are all connected. During a demo, they demonstrated a successful and a failed canary release, and how these tools enable IT teams to properly roll out changes to their customer base without any downtime.

How Docker EE Helps Open Doors at Assa AbloyDocker, Inc.

Application Portability with Kubernetes (k8)Kublr

The Truth Behind ServerlessDocker, Inc.

Basics of Kubernetes on BOSH: Run Production-grade Kubernetes on the SDDCMatt McNeeney

Kubernetes Meetup: CNI, Flex Volume, and SchedulerKatie Crimi

DCEU 18: From Monolith to MicroservicesDocker, Inc.

DockerCon SF 2015: Interconnecting Containers at Scale w/ NGINXDocker, Inc.

OpenStack on Kubernetes (BOS Summit / May 2017 update)rhirschfeld

The Complexity to "Yes" in Analytics Software and the Possibilities with Dock...Docker, Inc.

DockerCon SF 2015: Resilient Routing and DiscoveryDocker, Inc.

DCEU 18: Docker Container NetworkingDocker, Inc.

Canary Releases on Kubernetes with Spinnaker, Istio, & Prometheus (2020)Kublr

Kubernetes: one cluster or many cornelia davis

Setup Hybrid Clusters Using Kubernetes Federationinwin stack

Manage thousands of k8s applications with minimal efforts using kube carrierLibbySchulze

Democratizing machine learning on kubernetesDocker, Inc.

How to Run Kubernetes in Restrictive EnvironmentsKublr

Pivotal Container Service (PKS) at SF Cloud Foundry Meetupcornelia davis

Deploy prometheus on kubernetesCloud Technology Experts

Canary Releases on Kubernetes w/ Spinnaker, Istio, and PrometheusKublr

How Docker EE Helps Open Doors at Assa AbloyDocker, Inc.

Application Portability with Kubernetes (k8)Kublr

The Truth Behind ServerlessDocker, Inc.

Basics of Kubernetes on BOSH: Run Production-grade Kubernetes on the SDDCMatt McNeeney

Kubernetes Meetup: CNI, Flex Volume, and SchedulerKatie Crimi

DCEU 18: From Monolith to MicroservicesDocker, Inc.

DockerCon SF 2015: Interconnecting Containers at Scale w/ NGINXDocker, Inc.

Viewers also liked (18)

Tectonic Summit 2016: Managing 6 PB of Earth Imagery with KubernetesCoreOS

Tectonic Summit 2016: Networking for Kubernetes CoreOS

Tectonic Summit 2016: Kubernetes 1.5 and BeyondCoreOS

Kubernetes 1.5 introduces several new features to simplify cluster setup and improve scheduling. It provides an easy way to initialize a Kubernetes cluster with a single command using kubeadm. Multiple clusters can also be easily federated together using kubefed. Additionally, Kubernetes 1.5 enhances scheduling capabilities with taints and tolerations, which allow pods to be selectively scheduled to nodes based on hardware requirements like GPUs. This helps optimize workload placement on large, heterogeneous clusters.

Tectonic Summit 2016: Betting on KubernetesCoreOS

DigitalOcean transitioned from inconsistent deployment tools to using Kubernetes for container orchestration. This improved their ability to deploy new services from hours to minutes. They customized Kubernetes by focusing on stateless services, declarative deployments, and abstracting operational concerns. They created "docc" to simplify Kubernetes usage. It allows describing applications and infrastructure through manifests. Docc helped deploy 50 applications in 6 months and powered an internal hackathon. Lessons included keeping up with Kubernetes' rapid changes and automating cluster management. They will invest in service meshes, network policies, and secure secret storage.

Scalable system operations presentationjames tong

This document summarizes Joshua Hoffman's talk on scalable system operations at Tumblr. The talk outlines Tumblr's management stack for automating server provisioning including iPXE, Invisible Touch, Collins, Phil, Kickstart, and Puppet. It describes how the tools are used together in workflows for server intake, provisioning, and addressing challenges like configuring networking and storage during installation. The talk emphasizes principles like modularity, simplicity, and avoiding breaking the operating system.

Puppet DB: Higher-Order Puppet - Deepak Giridharagopal - PuppetCamp LA '12Puppet

GKE vs OpenStack MagnumMotohiro OTSUKA

This document compares Google Container Engine (GKE) and OpenStack Magnum. It summarizes that while Magnum provides container orchestration using Kubernetes similar to GKE, it has some usability disadvantages compared to GKE due to being integrated with OpenStack. The document demonstrates using Magnum and GKE to deploy similar Kubernetes clusters and discusses some areas Magnum could improve like integrating additional OpenStack services and improving node management capabilities.

From dev to prod: Kubernetes on AWS (short ver.)佑介九岡

The document discusses Yusuke Kuoka's recommendations and experience for deploying Kubernetes on AWS from development to production, including tools for bootstrapping Kubernetes clusters on AWS, running local development environments, automating the deployment process, and implementing logging and monitoring across environments using DaemonSets and Concourse CI for continuous integration. It also notes challenges around achieving high availability with Kubernetes and etcd in the Tokyo region and ideas for further improvements.

Kubernetes and CoreOS @ Athens Docker meetupMist.io

Cluster management with KubernetesSatnam Singh

Florida Great NW Cluster TargetsEd Morrison

D2.1 Cluster of_leading_organisations_in_sdi_for_spatial_planningplan4all

This document provides an overview of spatial planning systems and spatial data infrastructure (SDI) in Europe. It identifies leading public administrations involved in building SDI for spatial planning. Section 1 discusses challenges facing European cities, such as urbanization and globalization. Section 2 outlines the report's structure. Section 3 further explores challenges, including the need for sustainable resource management and land use management using SDI. Section 4 defines key terms and describes European planning systems and the NUTS classification system. Section 5 describes SDI situations and relationships to planning systems within consortium countries. It also analyzes online access to planning documents and lists SDI projects. The report identifies public and private stakeholders and discusses European clusters and cooperation. Annexes

Honiton cluster Advance Care planning presentationHospiscare

Strategic Planning Workshop Mantar ICTPD CLusterNick Rate

This document summarizes a strategic planning workshop for integrating technology at the Mantar ICTPD Cluster. It includes an introduction, research on the advantages of elearning, visions for elearning, trends in technology and education, case studies of other schools, and frameworks for strategic planning. Key points discussed are personalized learning, increased collaboration, shifting teacher and student roles, engaging students, and visible participation. The workshop covers analyzing the current context, defining a desired future vision, and developing a strategic plan and projects to bridge gaps between the present and goals.

Capacity Planning For Your Growing MongoDB ClusterMongoDB

This document discusses capacity planning for deploying MongoDB. It defines capacity planning as planning for requirements like availability, throughput, and responsiveness by determining necessary resources like CPU, memory, storage, and network capacity. It emphasizes starting capacity planning before launch to avoid downtime. Key aspects of capacity planning for MongoDB include estimating working memory set size, storage I/O needs based on data size and access patterns, using tools like IOStat and MongoDB Management Service for monitoring and automation, and conducting iterative testing and deployments. Failure occurs if planned resources cannot meet requirements.

Nutrition Cluster Contingency PlanningDr. Vachagan Harutyunyan

Sustainability Concepts in the Design of High-Rise buildings: the case of Dia...Franco Bontempi Org Didattica

One of the evocative structural design solutions for sustainable tall buildings is embraced by the diagrid (diagonal grid) structural scheme. Diagrid, with a perimeter structural configuration characterized by a narrow grid of diagonal members involved both in gravity and in lateral load resistance, has emerged as a new design trend for tall-shaped complex structures, and is becoming increasingly popular due to aesthetics and structural performance. Since it requires less structural steel than a conventional steel frame, it provides for a more sustainable structure. This study focuses on the structural performance of a steel tall building, using FEM nonlinear analyses. Numerical comparisons between a traditional outrigger system and different diagrid configurations (with three different diagrid inclinations) are presented for a building of 40 stories, with a total height of 160m, and a footprint of 36m x 36m. The sustainability of the building (in terms of structural steel weight saving) is assessed, together with the structural behavior.

Container Days Boston - Kubernetes in productionMike Splain

Kubernetes in Production, From the Ground Up discusses setting up a Kubernetes cluster from scratch using CoreOS, etcd, Docker, and Terraform. The document outlines setting up etcd for high availability using an autoscaling group, configuring the Kubernetes master nodes to run the API server, scheduler, and controller manager as pods, and deploying worker nodes that run the kubelet to join the cluster. The process involves using cloud-init scripts, Terraform, and container images to automate the installation and configuration of all cluster components in a scalable and resilient way.

Tectonic Summit 2016: Managing 6 PB of Earth Imagery with KubernetesCoreOS

Tectonic Summit 2016: Networking for Kubernetes CoreOS

Tectonic Summit 2016: Kubernetes 1.5 and BeyondCoreOS

Tectonic Summit 2016: Betting on KubernetesCoreOS

Scalable system operations presentationjames tong

Puppet DB: Higher-Order Puppet - Deepak Giridharagopal - PuppetCamp LA '12Puppet

GKE vs OpenStack MagnumMotohiro OTSUKA

From dev to prod: Kubernetes on AWS (short ver.)佑介九岡

Kubernetes and CoreOS @ Athens Docker meetupMist.io

Cluster management with KubernetesSatnam Singh

Florida Great NW Cluster TargetsEd Morrison

D2.1 Cluster of_leading_organisations_in_sdi_for_spatial_planningplan4all

Honiton cluster Advance Care planning presentationHospiscare

Strategic Planning Workshop Mantar ICTPD CLusterNick Rate

Capacity Planning For Your Growing MongoDB ClusterMongoDB

Nutrition Cluster Contingency PlanningDr. Vachagan Harutyunyan

Sustainability Concepts in the Design of High-Rise buildings: the case of Dia...Franco Bontempi Org Didattica

Container Days Boston - Kubernetes in productionMike Splain

Similar to Tectonic Summit 2016: Multi-Cluster Kubernetes: Planning for Unknowns (20)

Google Cloud Fundamentals by CloudZoneIdan Tohami

This document provides an overview of Google Cloud Fundamentals. It introduces Andrew Liaskovski as the teacher and covers various Google Cloud topics including migration, security, DevOps, big data, and disaster recovery services. It also discusses CloudZone's full service package including consulting, managed services, and professional services. The rest of the document focuses on specific Google Cloud products and services such as Compute Engine, App Engine, Container Engine, Cloud Storage, Cloud SQL, networking, big data, and machine learning.

Webinar- Tea for the TillermanCumulus Networks

OpenFaaS 2019 Project UpdateAlex Ellis

Kubernetes and Cloud Native Meetup - March, 2019CloudOps2005

This year's first round of Kubernetes and Cloud Native meetups in Eastern Canada began with an update of the CNCF by Ayrat Khayretdinov, CNCF Ambassador and Solutions Architect at CloudOps. He explained the status of various projects and highlights from KubeCon + CloudNativeCon. To learn the basics of cloud native application modernization, sign up for one of our hands-on, three-day workshops on Docker and Kubernetes at https://www.cloudops.com/workshops/#DockerK8s

01 - VMUGIT - Lecce 2018 - Fabio Rapposelli, VMwareVMUG IT

Forced Evolution: Shopify's Journey to KubernetesC4Media

Niko Kurtti talks about the challenges Shopify saw in moving from a traditional host-based infrastructure to a cloud native one, moving not only their core app to Kubernetes but also hundreds of other apps at the same time. He focuses on the cluster tooling solutions they've built, such as controllers, cluster creators, and deploy tools. Filmed at qconnewyork.com. Niko Kurtti is a production engineer at Shopify. He started out as a software developer doing web apps with Java, but since then fell in love with container technologies. He was part of the effort to roll out Docker in production at Shopify in 2014 and is still working around the same domain, but today the focus is on Shopify’s internal PaaS based on k8s.

56k.cloud trainingBrian Christner

This document provides an overview of Docker and cloud native training presented by Brian Christner of 56K.Cloud. It includes an agenda for Docker labs, common IT struggles Docker can address, and 56K.Cloud's consulting and training services. It discusses concepts like containers, microservices, DevOps, infrastructure as code, and cloud migration. It also includes sections on Docker architecture, networking, volumes, logging, and monitoring tools. Case studies and examples are provided to demonstrate how Docker delivers speed, agility, and cost savings for application development.

The path to a serverless-native era with Kubernetessparkfabrik

GCP Meetup #3 - Approaches to Cloud Native Architecturesnine

Kubernetes 1.12 Update and Container Security with Liz RiceCloudOps2005

Whats new in Azure Functions and .NET 6.pptxCallon Campbell

OpenStack Marketing Meeting Oct 2OpenStack Foundation

The 10th release of OpenStack supports new use cases across many industries through expanded support of technologies. Key themes of the release include improved enterprise maturity, networking advances like NFV support, new data processing and container support through Docker integration, and continued focus on the user experience. Over 300 blueprints were completed and over 3,200 bugs were fixed for the 10th release. New features were added across Compute, Storage, Networking, and Shared Services like Identity. The next Kilo release is scheduled for April 2015 and will focus on integrating Bare Metal provisioning and setting the stage for new projects.

DevNexus 2015: Kubernetes & Container EngineKit Merker

AWS in PracticeAnna Ruokonen

This document discusses deploying microservices to AWS using containers and Kubernetes. It describes using EKS to run a Kubernetes cluster on AWS, deploying microservices as Docker containers to EKS, and implementing continuous integration/delivery pipelines with GitLab to build, test, and deploy updates. Frontend applications are deployed to S3 and backend services use technologies like EC2, ECS, Lambda, RDS, and API Gateway. The case study example shows building an IoT platform on this infrastructure with microservices for devices, processes, customers etc. deployed on EKS behind an ALB.

Monitoring kubernetes across data center and cloudDatadog

This document summarizes a presentation about monitoring Kubernetes clusters across data centers and cloud platforms using Datadog. It discusses how Kubernetes provides container-centric infrastructure and flexibility for hybrid cloud deployments. It also describes how monitoring works in Google Container Engine using cAdvisor, Heapster, and Stackdriver. Finally, it discusses how Datadog and Tectonic can be used to extend Kubernetes monitoring capabilities for enterprises.

Lessons from Building Large-Scale, Multi-Cloud, SaaS Software at DatabricksDatabricks

Highlights of OpenStack Mitaka and the OpenStack SummitCloud Standards Customer Council

This presentation explores the latest release of OpenStack (OpenStack Mitaka) and shares highlights from the OpenStack Summit held April 25-29, 2016 in Austin, TX. OpenStack is a free and open-source software platform for building and managing cloud computing platforms for public and private clouds, mostly deployed as an infrastructure-as-a-service (IaaS). The software platform consists of interrelated components that control hardware pools of processing, storage, and networking resources throughout a data center. OpenStack works with popular enterprise and open source technologies making it ideal for heterogeneous infrastructure.

CloudStack and GitOps at Enterprise Scale - Alex Dometrius, Rene Glover - AT&TShapeBlue

The AT&T team recently embarked on a journey with CloudStack and has since deployed a solution which encompasses multiple data-centers. This talk focuses on how they are using open source tools like CloudStack, FreeIPA, and Metal as a Service (MaaS) to support KVM-based VM provisioning at an enterprise scale within a GitOps model. ----------------------------------------- The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.

Containerised ASP.NET Core apps with KubernetesCodemotion Tel Aviv

Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications. It groups containerized applications into logical units for easy management and discovery called pods. It can be used to deploy a containerized ASP.NET Core application. It provides basic mechanisms for self-healing, auto-scaling and updates through concepts like deployments, services, replica sets and labels.

Discover the benefits of Kubernetes to host a SaaS solutionScaleway

Google Cloud Fundamentals by CloudZoneIdan Tohami

Webinar- Tea for the TillermanCumulus Networks

OpenFaaS 2019 Project UpdateAlex Ellis

Kubernetes and Cloud Native Meetup - March, 2019CloudOps2005

01 - VMUGIT - Lecce 2018 - Fabio Rapposelli, VMwareVMUG IT

Forced Evolution: Shopify's Journey to KubernetesC4Media

56k.cloud trainingBrian Christner

The path to a serverless-native era with Kubernetessparkfabrik

GCP Meetup #3 - Approaches to Cloud Native Architecturesnine

Kubernetes 1.12 Update and Container Security with Liz RiceCloudOps2005

Whats new in Azure Functions and .NET 6.pptxCallon Campbell

OpenStack Marketing Meeting Oct 2OpenStack Foundation

DevNexus 2015: Kubernetes & Container EngineKit Merker

AWS in PracticeAnna Ruokonen

Monitoring kubernetes across data center and cloudDatadog

Lessons from Building Large-Scale, Multi-Cloud, SaaS Software at DatabricksDatabricks

Highlights of OpenStack Mitaka and the OpenStack SummitCloud Standards Customer Council

CloudStack and GitOps at Enterprise Scale - Alex Dometrius, Rene Glover - AT&TShapeBlue

Containerised ASP.NET Core apps with KubernetesCodemotion Tel Aviv

Discover the benefits of Kubernetes to host a SaaS solutionScaleway

More from CoreOS (10)

Tectonic Summit 2016: It's Go Time CoreOS

Tectonic Summit 2016: Ticketmaster's Public Cloud & Kubernetes StrategyCoreOS

Tectonic Summit 2016: Alex Polvi, CEO of CoreOS, KeynoteCoreOS

CoreOS has renamed their CoreOS Linux distribution to Container Linux to better reflect its purpose of running containers. Container Linux uses self-driving mechanisms to automatically keep systems updated without downtime. CoreOS Tectonic is also now self-driving Kubernetes, making it easier to manage Kubernetes clusters. Both Container Linux and Tectonic are aimed at allowing users to spend less time on maintenance and more on innovation.

Tectonic Summit 2016: The Origins of KubernetesCoreOS

Tectonic Summit 2016: Preparing for Cloud Native CoreOS

Etcd- Mission Critical Key-Value StoreCoreOS

Xiang Li gave a presentation on etcd, a distributed key-value store. He discussed how etcd can be used to coordinate CoreOS cluster updates and store application configurations. He highlighted requirements like strong consistency, high availability, and watchability. Li also demonstrated etcd's capabilities including key-value operations, streaming watches, multi-version concurrency control, and leases. He showed how etcd achieves high performance and reliability through techniques such as incremental snapshots, write-ahead logging, and failure injection testing. Finally, he announced that etcd version 3.0 beta is now available.

Kube-AWSCoreOS

This document discusses Kube-AWS, which is a tool for deploying Kubernetes clusters on AWS. It outlines the design goals of creating artifacts that are secure, reproducible, and auditable. It then demonstrates "under the hood" how Kube-AWS works by initializing a cluster configuration, rendering assets, deploying the cluster, exporting the deployment details, and making changes to reproduce the cluster. Recent work is noted along with future plans.

Clair, A Container Image Security AnalyzerCoreOS

- Clair is an open source project for analyzing container images for known software vulnerabilities. It uses static analysis to detect vulnerabilities by examining the content of container images without running the containers. - Clair's analysis can be done once and reused to inform about current and future vulnerabilities. It also suggests fixes and notifies users about new vulnerabilities. - Clair is designed as an extensible framework, including detectors for vulnerabilities from different sources, datastores, updaters, notifiers and support for multiple container formats and operating systems. The presenter discusses current and potential future capabilities.

Tectonic Summit 2015: Containers Across the Cloud and Data CenterCoreOS

CoreOS in a NutshellCoreOS

Tectonic Summit 2016: It's Go Time CoreOS

Tectonic Summit 2016: Ticketmaster's Public Cloud & Kubernetes StrategyCoreOS

Tectonic Summit 2016: Alex Polvi, CEO of CoreOS, KeynoteCoreOS

Tectonic Summit 2016: The Origins of KubernetesCoreOS

Tectonic Summit 2016: Preparing for Cloud Native CoreOS

Etcd- Mission Critical Key-Value StoreCoreOS

Kube-AWSCoreOS

Clair, A Container Image Security AnalyzerCoreOS

Tectonic Summit 2015: Containers Across the Cloud and Data CenterCoreOS

CoreOS in a NutshellCoreOS

Recently uploaded (20)

AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB

I started my online journey with several hosting services before stumbling upon Ai EngineHost. At first, the idea of paying one fee and getting lifetime access seemed too good to pass up. The platform is built on reliable US-based servers, ensuring your projects run at high speeds and remain safe. Let me take you step by step through its benefits and features as I explain why this hosting solution is a perfect fit for digital entrepreneurs.

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock

Building 10x Organizations with Modern Productivity Metrics 10x developers may be a myth, but 10x organizations are very real, as proven by the influential study performed in the 1980s, ‘The Coding War Games.’ Right now, here in early 2025, we seem to be experiencing YAPP (Yet Another Productivity Philosophy), and that philosophy is converging on developer experience. It seems that with every new method we invent for the delivery of products, whether physical or virtual, we reinvent productivity philosophies to go alongside them. But which of these approaches actually work? DORA? SPACE? DevEx? What should we invest in and create urgency behind today, so that we don’t find ourselves having the same discussion again in a decade?

Electronic_Mail_Attacks-1-35.pdf by xploitniftliyevhuseyn

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Talk at the final event of Data Fusion Dynamics: A Collaborative UK-Saudi Initiative in Cybersecurity and Artificial Intelligence funded by the British Council UK-Saudi Challenge Fund 2024, Cardiff Metropolitan University, 29th April 2025 https://alandix.com/academic/talks/CMet2025-AI-Changes-Everything/ Is AI just another technology, or does it fundamentally change the way we live and think? Every technology has a direct impact with micro-ethical consequences, some good, some bad. However more profound are the ways in which some technologies reshape the very fabric of society with macro-ethical impacts. The invention of the stirrup revolutionised mounted combat, but as a side effect gave rise to the feudal system, which still shapes politics today. The internal combustion engine offers personal freedom and creates pollution, but has also transformed the nature of urban planning and international trade. When we look at AI the micro-ethical issues, such as bias, are most obvious, but the macro-ethical challenges may be greater. At a micro-ethical level AI has the potential to deepen social, ethnic and gender bias, issues I have warned about since the early 1990s! It is also being used increasingly on the battlefield. However, it also offers amazing opportunities in health and educations, as the recent Nobel prizes for the developers of AlphaFold illustrate. More radically, the need to encode ethics acts as a mirror to surface essential ethical problems and conflicts. At the macro-ethical level, by the early 2000s digital technology had already begun to undermine sovereignty (e.g. gambling), market economics (through network effects and emergent monopolies), and the very meaning of money. Modern AI is the child of big data, big computation and ultimately big business, intensifying the inherent tendency of digital technology to concentrate power. AI is already unravelling the fundamentals of the social, political and economic world around us, but this is a world that needs radical reimagining to overcome the global environmental and human challenges that confront us. Our challenge is whether to let the threads fall as they may, or to use them to weave a better future.

Build Your Own Copilot & Agents For DevsBrian McKeiver

How analogue intelligence complements AIPaul Rowe

Artificial Intelligence is providing benefits in many areas of work within the heritage sector, from image analysis, to ideas generation, and new research tools. However, it is more critical than ever for people, with analogue intelligence, to ensure the integrity and ethical use of AI. Including real people can improve the use of AI by identifying potential biases, cross-checking results, refining workflows, and providing contextual relevance to AI-driven results. News about the impact of AI often paints a rosy picture. In practice, there are many potential pitfalls. This presentation discusses these issues and looks at the role of analogue intelligence and analogue interfaces in providing the best results to our audiences. How do we deal with factually incorrect results? How do we get content generated that better reflects the diversity of our communities? What roles are there for physical, in-person experiences in the digital world?

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots. 📕 Here's what you can expect: - Modeling: Build end-to-end processes using BPMN. - Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes. - Operating: Control process instances with rewind, replay, pause, and stop functions. - Monitoring: Use dashboards and embedded analytics for real-time insights into process instances. This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes. 👨‍🏫 Speaker: Andrei Vintila, Principal Product Manager @UiPath This session streamed live on April 29, 2025, 16:00 CET. Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.

Quantum Computing Quick Research Guide by Arthur MorganArthur Morgan

This is a Quick Research Guide (QRG). QRGs include the following: - A brief, high-level overview of the QRG topic. - A milestone timeline for the QRG topic. - Links to various free online resource materials to provide a deeper dive into the QRG topic. - Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic. QRGs planned for the series: - Artificial Intelligence QRG - Quantum Computing QRG - Big Data Analytics QRG - Spacecraft Guidance, Navigation & Control QRG (coming 2026) - UK Home Computing & The Birth of ARM QRG (coming 2027) Any questions or comments? - Please contact Arthur Morgan at [email protected]. 100% human made.

Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

TrsLabs - Fintech Product & Business ConsultingTrs Labs

Hybrid Growth Mandate Model with TrsLabs Strategic Investments, Inorganic Growth, Business Model Pivoting are critical activities that business don't do/change everyday. In cases like this, it may benefit your business to choose a temporary external consultant. An unbiased plan driven by clearcut deliverables, market dynamics and without the influence of your internal office equations empower business leaders to make right choices. Getting things done within a budget within a timeframe is key to Growing Business - No matter whether you are a start-up or a big company Talk to us & Unlock the competitive advantage

AI and Data Privacy in 2025: Global TrendsInData Labs

In this infographic, we explore how businesses can implement effective governance frameworks to address AI data privacy. Understanding it is crucial for developing effective strategies that ensure compliance, safeguard customer trust, and leverage AI responsibly. Equip yourself with insights that can drive informed decision-making and position your organization for success in the future of data privacy. This infographic contains: -AI and data privacy: Key findings -Statistics on AI data privacy in the today’s world -Tips on how to overcome data privacy challenges -Benefits of AI data security investments. Keep up-to-date on how AI is reshaping privacy standards and what this entails for both individuals and organizations.

Drupalcamp Finland – Measuring Front-end Energy ConsumptionExove

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Aqusag Technologies

AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock

Electronic_Mail_Attacks-1-35.pdf by xploitniftliyevhuseyn

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Build Your Own Copilot & Agents For DevsBrian McKeiver

How analogue intelligence complements AIPaul Rowe

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

Quantum Computing Quick Research Guide by Arthur MorganArthur Morgan

Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

TrsLabs - Fintech Product & Business ConsultingTrs Labs

AI and Data Privacy in 2025: Global TrendsInData Labs

Drupalcamp Finland – Measuring Front-end Energy ConsumptionExove

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Aqusag Technologies

Tectonic Summit 2016: Multi-Cluster Kubernetes: Planning for Unknowns

2. Agenda • Why k8s? • Why CoreOS? • K8s @ Concur • Q & A

3. What is Concur? 6500+ employees Offices: Australia China Czech Republic France Germany Holland India Japan Philippines Singapore Sweden UK US HQ: Bellevue 70m transactions 50b+ USD T&E spend annually €59m New cloud bookings Q3 2015 Cloud DNA 99 Established 1993 > 60% Fortune 500

4. 2011 2012 2013 2014 2015 2016 20182017 Expense transactions Bookings growth 2013 2015 55 million 77+ million Provisioned users 35+ million 2015 Registered mobile users 2013 2015 2.1 million 5+ million Concur growth

5. A little about me Principal Architect • Concur since 1998 in various roles (DBA, Ops Manager & Architect, etc.) • Corking w/ k8s since mid 2015 • contributor to k8s and participant in federation & service catalog SIGs • Email danwilson on github, k8s slack & gmail

6. Why Kubernetes? • Largest community support • Gifted to Linux Foundation • Protection from shifts in container technology • Pluggable API • Capable of isolation between namespaces • Declarative syntax for the complete make up of services • Built in logging, service discovery, etc. • Networking design eliminates port conflicts of containers

7. Why CoreOS? • Simple updates by channel • Designed to run as a cluster • Low overhead • Best documentation for k8s

8. Why CoreOS? • Simple updates by channel • Designed to run as a cluster • Low overhead • Best documentation for k8s

9. CoreOS

10. High Availability • All things fail, yes everything! • K8s HA guide: http://kubernetes.io/docs/admin/high-availability/ • cluster etcd – 3, 5 or 7 nodes • replicated + load balanced api servers • many minions

11. High Availability If cluster == alwaysOnline { glog.V(1). Infof(“nothing to do here!”) }

12. staging prod N clusters CI K8s @ Concur

13. Location US EUROPE Zone A B C A B C Cluster v.1.2 us12a us12b us12c eur12a eur12b eur12c K8s @ Concur

14. Elastic (logging) Prometheus (monitoring) Load Balancers etcd Nodes etcd Nodes K8s @ Concur

15. K8s @ Concur • kube2cnqr • Golang docker container • Watches the k8s API for updates to services and worker nodes • Calls a Concur internal API to addremove load balancer entries as needed • Handles connecting multiple k8s clusters to a single load balancer endpoint • Extras • External-IP set on service objects • Annotation w/ DNS name set on service objects • Handles multiple load balancer tiers • Allow services to specify DNS name

16. Sample project • https://github.com/concur/kubegowatcher • A sample golang program that leverages kubernetes watch endpoints using the client-go library. • Designed to run as a container on k8s • example of setting annotation on the service • example of checking event delay • Apache 2.0 license • Add your own business logic • Contribute back improvements to make it better

17. Location US EUROPE Zone A B C A B C Cluster v.1.2 us12a us12b us12c eur12a eur12b eur12c K8s @ Concur – k8s upgrades

18. Location US EUROPE Zone A B C A B C Cluster v.1.2 us12a us12b us12c eur12a eur12b eur12c Cluster v.1.3 us13a us13b us13c eur13a eur13b eur13c K8s @ Concur – k8s upgrades

19. K8s @ Concur Deployment Challenges • Stale kubectl scripts • Stale kubectl config • Handling credentials for each ci system • Many commands for each cluster • Handling proxy

20. K8s @ Concur

21. Deployment API CI Deploy petshop:v1 to test test14a, b & c K8s API calls for service & deployment

22. Deployment API CI Deploy petshop:v1 to prod US14a, b & c EMEA14a, b & c APAC14a, b & c K8s API calls for service & deployment

23. Config API Add/remove cluster EMEA14a, b & c

24. Setup API curl /setup Output kubectl config commands for all cluster zones requested | bash

25. K8s @ Concur

26. K8s @ Concur Add features to kubernetes federation • v1.6 – deploying to clusters based on label #29887 Other potentials… • Location specific overrides • Global overrides • Feature limitations (for example, don’t allow pods/rc’s without a deployment) Docs: https://github.com/concur/skipper

27. K8s @ Concur

28. Q & A Email danwilson on github, k8s slack & gmail

Editor's Notes

#5: Tripit Hipmunk
#7: Tripit Hipmunk
#10: Explain hypercar components and how they relate to building a kubernetes cluster. CoreOS makes it easy by already having the pieces tested together (kernel, flannel, etcd, systemd, etc)
#12: Plan for unknown unknowns Locking thresholds or bad query plans are known unknowns
#13: kubelet to container which messed up dns settings
#16: Terraform deployments CoreOS Flannel Custom logstash container
#17: Updated to use client-go library From centurylink/ca-certs Working w/scratch Gotchas: checking for the delay on events and handling updates made
#18: Docker golang setup for kubernetes f5 plugin
#19: Best way to get to v.1.3? Blue/green
#21: So, we created skipper
#23: So what does this skipper thing do anyways?
#24: So what does this skipper thing do anyways?
#25: So what does this skipper thing do anyways?
#26: So what does this skipper thing do anyways?

Tectonic Summit 2016: Multi-Cluster Kubernetes: Planning for Unknowns

Recommended

More Related Content

What's hot (20)

Viewers also liked (18)

Similar to Tectonic Summit 2016: Multi-Cluster Kubernetes: Planning for Unknowns (20)

More from CoreOS (10)

Recently uploaded (20)

Tectonic Summit 2016: Multi-Cluster Kubernetes: Planning for Unknowns

Editor's Notes