KURMA - A Containerized Container Platform - KubeCon 2016

Mar 10, 20167 likes2,792 views

Kurma is a container runtime that is based on the container instrumentation built into the Apcera Platform. Kurma, and its accompanied “KurmaOS” is our vision of a lightweight, fully containerized operating system. This presentation will cover Apcera’s journey in its container instrumentation. Beginning with the pre-Docker landscape, how it grew over the course of 3+ years, and the “next-gen” adaption of it, where the base container instrumentation has been adapted to stand on its own, and growing it to be used beyond just Apcera’s own usage. Kurma incorporates a lot of lessons learned with both development and operations of a container platform, including building modular vs monolith, extensibility being built in vs built on, and managing a cluster of hosts and containers. We’ll also cover our experiences with introducing it to Kubernetes as another first class runtime provider. Taking how Kurma works and have it work with Kubernetes, and how we’d like to see Kubernetes grow in some of the areas we see Kurma growing.

KURMA - A Containerized Container Platform - KubeCon 2016

Instance Manager
State Machine Apocalypse
● Started out simple, but naive about the future
● Few small libraries…
● … but all integration logic was central
● 8 states
● 53 function handlers

Existing Weight
● Ubuntu base OS
● CAPS deployment
● .deb packaging
● Operational tooling

System Skew is a Problem
● Deploys non-atomic
● Different lifecycle per host
● Operational access

A New Model
Kurma
● Minimize host dependencies
● Everything is a container
● Simple notions that could be easily extended
● Simple, well defined APIs

What is Kurma made of?
Existing
● Go + C
● App Container (AppC)
● Apcera’s existing
instrumentation
Coming soon
● Go + C
● AppC
● libcontainer based
● CNI for networking

Delivery
kurmad
● Existing host
● Download and run
● Immediately benefit
● Depends on host kernel
and libc
kurmaOS
● Minimalist distro
● Services as containers
● A/B partition model
● Console is just a
container

Stager
Pluggable Process Orchestration
● Responsible for instrumenting the pod
● Packaged as a signed, trusted ACI image
● Gets own mount and network namespace

Stager API
● Simplest unit of work: an executable
● Setup via image ‘Exec’ setting
● Other calls through expected executables
– /opt/stager/run
– /opt/stager/status
– /opt/stager/logs
– ...

Networking API
● ACI image
● Passes along JSON configuration
● Executes commands to setup networking on
other containers
– /opt/network/add <ns> <container-id>
– /opt/network/del <ns> <container-id>

Kurma
Reusable Unit for Extensibility
/opt/stager/run cni /opt/network/add ...

Kurma
Extending Boundries with Semantics

Why?
● Kurma usage outside Apcera
● Increased platform flexibility
● Integrating with broader community

Kubelet
● Has existing Runtime interface
● Rich interface for engine communication
● Kubelet is a bit of a leaky abstraction
● Workarounds for Dockerisms

Testing
● Mystical
● Documentation gaps
● Excellent Github/PR integration

Codebase
● Godep pains
● “hack” directory?
● Documentation gaps
● Interface movement
Runtime.ConvertPodStatusToAPIPodStatus()

Kurmanetes
● Maturing Kurma based on Kubernetes needs
– Pods
– Networking
– Image management
● Runtime abstraction nearly complete

Kurmanetes
● Done
– Pod management
– Image retrieval and management
● Remaining
– Landing Kurma’s pod/stager branch
– cAdvisor integration
– Integration testing
– Work towards improving the abstraction leaks

Resources
Kurma
kurma.io
github.com/apcera/kurma
Me
ken@apcera.com
@krobertson
We’re hiring for the Kurma team.

Jeff Nickoloff - Co-founder, Topple Growth can be challenging to address once monolithic systems begin to fail under strain or internal software development processes begin to slow the release cadence. Many organizations are looking to microservices architecture to solve these application issues, whether they plan to write new applications or rewrite the monoliths into microservices. This talk will highlight the common technical and cultural issues that will make microservice architectures a challenge to adopt and maintain. Issues include impact of Dunbar's Number and Conway's Law, build-time vs runtime continuous integration, evolution of testability, API versioning impact, logistics overhead, artifact management, and strategies for iteration in a distributed environment. Attendees will learn: - How and why microservice architectures and ownership end up falling along organizational lines (and why that is a good thing) - How we can learn from monolith tooling to inform our tooling in a microservice environment - How you can achieve operational excellence at scale taking a logistical approach with Docker.

Containers: Life Beyond Microservices? by Sushil Kumar, Robin SystemsDocker, Inc.

The document discusses containers and how they can be used for stateless and stateful applications. It notes that while containers provide CPU and memory isolation, traditional storage systems cannot handle the scale and performance needs of containerized applications. The Robin Containerization Platform aims to address these issues with its container-aware storage layer that can support large volumes of variable sized volumes, quickly create and destroy snapshots and clones, and provide end-to-end performance isolation and QoS controls from applications to storage. It also decouples compute and storage to allow independent scaling and portability without data loss.

DockerCon EU 2015: Using Docker and SDN for telco-grade applicationsDocker, Inc.

Presented by Nico Janssens, Senior Researcher, Bell Labs, Alcatel-Lucent and Florian Otel, Director for Business Development and Strategy, Nuage Networks In this talk we will present how at Bell-Labs (Alcatel-Lucent R&D division) we benefit from using Docker in combination with the SDN solution from Nuage Networks for development and deployment of a next-gen chat-based communication platform. This communication platform does intensive data analytics, runs a number of multi-media services and can control remote appliances (e.g. thermostats, robots, cameras, etc). We will illustrate the stringent telco requirements to successfully operate such a communication platform, including some non-functional needs like high-availability, reliability, elasticity, QoS and lifecycle management. Furthermore, we will explain why we selected docker as a hosting platform and how we have utilized it. We will also share some of the deployment scenarios we are facing and how these are addressed by combining Docker and Nuage VSP. Lastly, we will share the lessons we have learned during this development process, and propose some improvements/extensions for Docker to evolve into an application stack that is able to meet the stringent needs of telco applications.

Proof of Concept: Serverless with Swarm by Nirmal Mehta, Booz Allen Hamilton Docker, Inc.

The document discusses serverless computing with Docker containers. It provides definitions of serverless and functions-as-a-service. It then summarizes several serverless platforms like Serverless.com, Iron.io IronWorker, and iopipe Dockaless and how they integrate Docker containers or allow running code on multiple clouds. It demonstrates running a simple Docker container function locally using the Dockaless library. In conclusion, while serverless is still early, Docker containers provide a way to build serverless applications that are infrastructure agnostic.

Application Deployment and Management at Scale with 1&1 by Matt BaldwinDocker, Inc.

1&1, Europe’s largest web hosting company, has been automatically deploying and managing multi-tenant server environments for 20 years. These servers support millions of active websites and services around the world. Historically software stacks were pre-installed using estimates of what was considered good, taking a ‘one size fits all’ approach. I am going to show how we are now combining Git, Gitlab, Openshift and Docker to revolutionise our approach to large scale hosting, providing greater power and flexibility without increasing support overhead. This includes showing: · Transforming the legacy multi-tenant LAMP environment into many single-tenant Docker projects · Managing thousands of projects on behalf of tenants · Gitlab CI for testing Docker containers · Testing container interactions and upgrade cycle

NetflixOSS and ZeroToDocker Talkaspyker

Andrew Spyker presented on the Netflix Cloud Platform and ZeroToDocker project. The following key points were discussed: - ZeroToDocker provides Docker images of Netflix OSS projects like Eureka, Zuul and Asgard to more easily evaluate the technologies. However, the images are not intended for direct production use. - A demo showed running a microservices application and supporting Netflix OSS services like Eureka and Zuul using Docker containers on a single machine. - While Docker aids development and evaluation, additional tooling is needed to operationalize containers at production scale across multiple hosts for tasks like networking, security, logging and scheduling. Competing ecosystems are emerging to address these needs.

A New Centralized Volume Storage Solution for Docker and Container Cloud by W...Docker, Inc.

Elara is a Docker volume plugin that provides a distributed volume management tool and connection between containers and shared storage providers. It supports advanced volume operations like snapshots, backups, migration, IOPS, disk quotas and extending volumes. Elara uses a key-value storage as a database to store node status remotely. It focuses on shared storage and supports multiple backend drivers like NFS, Cinder and filesystem/block devices.

OpenNebulaConf2019 - Welcome and Project Update - Ignacio M. Llorente, Rubén ...OpenNebula Project

We've made our way into the world of open cloud — where each organization can find the right cloud for its unique needs. A single cloud management platform cannot be all things to all people. There will be a cloud space with several offerings focused on different environments and/or industries. The OpenNebula commitment to the open cloud is at the very base of its mission — to become the simplest cloud enabling platform — and its purpose — to bring simplicity to the private and hybrid enterprise cloud. OpenNebula exists to help companies build simple, cost-effective, reliable, open enterprise clouds on existing IT infrastructure. The OpenNebula Conference will be a great opportunity to communicate and share our vision and commitment, to look back at how the project has grown in the last 9 years, and to shed some insight into what to expect from the project in the near future.

How we Upgraded Public Cloud From Juno to Queens with Minimal Downtime? | Ngu...Vietnam Open Infrastructure User Group

BizFly Cloud upgraded their OpenStack platform from the older Juno release to the newer Queens release with minimal downtime. They developed a plan to address challenges like converting the LDAP authentication to MySQL, maintaining network and metadata configurations, and ensuring data integrity across over 1,200 VMs during the upgrade. Through automation scripts and a 5 minute downtime window per VM, the upgrade was completed over several months with users able to continue using the cloud services throughout. After the upgrade, BizFly Cloud saw improvements like a new dashboard, support for additional services, and more powerful hardware infrastructure.

[OpenStack Day in Korea 2015] Track 2-6 - Apache Tajo on SwiftOpenStack Korea Community

Jihoon Son presents Apache Tajo, an open source data warehouse system that supports SQL queries. Tajo can run on OpenStack Swift object storage without any code modifications, addressing the need for SQL queries on Swift data. Son demonstrates how Tajo integrates with Swift, discusses configurations, and addresses the data locality problem. Advanced integration techniques like a location-aware computing model are presented to improve performance when Tajo and Swift clusters are co-located. The roadmap includes specialized storage layers for Swift and support for additional storage like Cinder and Ceph block storage.

Ibm cloud nativenetflixossfinalaspyker

1. The document discusses running NetflixOSS microservices on Docker locally and in the cloud. It demonstrates Docker local setup with Eureka for service discovery and Microscaler for auto scaling and recovery. 2. Key lessons from running SkyDNS and Eureka together for service discovery in Docker include that both work well but Eureka provides more application awareness while SkyDNS has looser coupling. 3. Microscaler is an open source auto scaling system developed to handle auto scaling, recovery, and version rolling for Docker local deployments, providing functionality similar to Amazon Auto Scaling and RightScale for Docker environments.

Everything You Need to Know About Docker and Storage by Ryan Wallner, ClusterHQ Docker, Inc.

In this talk, we will provide a 10,000-ft. overview of the key concepts, architectures, and common deployment scenarios for stateful services. We will cover the Docker volumes and available storage options in the community including ClusterHQ’s Flocker volume manager. After getting the lay of the land, we'll see these concepts in action. Starting by deploying a database container on a single node with UCP, Flocker and VolumeHub. Then, using the features of Docker Swarm and Flocker, we will then allow Swarm to automatically reschedule the stateful service along with Flocker moving its volume when the node fails giving us a HA containerized database.

DCSF19 Kubernetes Security with OPA Docker, Inc.

The document discusses using Open Policy Agent (OPA) to enforce guardrails and security policies in Kubernetes clusters. It provides examples of sample policies for OPA that restrict which image registries pods can use and prevent conflicting ingress hosts. It also summarizes key features of OPA such as its declarative policy language, sidecar deployment model, and community support from many major companies using it for admission control, authorization, risk management and other use cases.

Netflix Cloud Platform and Open Sourceaspyker

Andrew Spyker presented on Netflix's cloud platform and open source projects. Some key points included: - Netflix has migrated from monolithic architectures to microservices and continuous delivery enabled by their open source libraries and services. - Their platform focuses on elasticity, high availability through automation, and operational visibility. - Netflix uses technologies like Eureka, Ribbon, Hystrix, and Servo to enable scalability, resilience, and monitoring across their distributed systems. - They contribute over 50 open source projects to help others adopt their cloud-native approaches and are working on data and UI related projects.

Kubernetes on OpenStack @eBaySriram Subramanian

Using the SDACK Architecture on Security Event Inspection by Yu-Lun Chen and ...Docker, Inc.

The SDACK architecture stands for Spark, Docker, Akka, Cassandra, and Kafka. At TrendMicro, we adopted the SDACK architecture to implement a security event inspection platform for APT attack analysis. In this talk, we will introduce SDACK stack with Spark lambda architecture, Akka and Kafka for streaming data pipeline, Cassandra for time series data, and Docker for microservices. Specifically, we will show you how we Dockerize each SDACK component to facilitate the RD team of algorithms development, help the QA team test the product easily, and use the Docker as a Service strategy to ship our products to customers. Next, we will show you how we monitor each Docker container and adjust the resource usage based on monitoring metrics. And then, we will share our Docker security policy which ensures our products are safety before shipping to customers. After that, we'll show you how we develop an all-in-one Docker based data product and scale it out to multi-host Docker cluster to solve the big data problem. Finally, we will share some challenges we faced during the product development and some lesson learned.

How to accelerate docker adoption with a simple and powerful user experienceDocker, Inc.

1) Societe Generale aims to accelerate Docker adoption by providing a simple and powerful user experience. They plan to increase their container usage from 2000 to 15,000 containers. 2) They aim to achieve this growth while improving security, quality of service, and reducing VM costs. Their challenge is providing these improvements while maintaining a good user experience. 3) Docker Universal Control Plane (UCP) is used to provide a production cluster with logical isolation and central administration. This achieves multi-tenancy, security/compliance checks, and self-service onboarding.

Docker - A curtain raiser to the Container worldzekeLabs Technologies

The slides talk about Docker and container terminologies but will also be able to see the big picture of where & how it fits into your current project/domain. Topics that are covered: 1. What is Docker Technology? 2. Why Docker/Containers are important for your company? 3. What are its various features and use cases? 4. How to get started with Docker containers. 5. Case studies from various domains

DCEU 18: App-in-a-Box with Docker Application PackagesDocker, Inc.

Michael Irwin - Application Architect, Virginia Tech Docker Application Packages is an experimental tool that makes it easy to share multi-service applications. Create a Compose file, package it in an image, and voilà! You now have an "app-in-a-box"! Not convinced yet? No worries! It took a while for me to be convinced too! In this session, we'll start off by diving into how Docker Application Packages actually works, which will help us understand the use cases. We'll see how dev environments can hook in to this app-in-a-box by replacing the service being worked on with a dev container. Then we'll move on to see how end-to-end functional tests are much easier to run. And, finally, we'll see how to maintain an "app-in-a-box" with the latest versions of each component in a CI/CD pipeline, allowing for a unique app-in-a-box for each feature branch under development. Lots of good material! And lots of live demos!

Open Source & The Internet of ThingsAll Things Open

Sebastien goasguen cloud stack and dockerShapeBlue

This document discusses how Docker can be used with CloudStack. It provides several options: 1) Running Docker in VMs on CloudStack templates that include Docker, 2) Using Docker-optimized OS templates, 3) Launching containers through a container service API, 4) Using CloudStack plugins within the Docker ecosystem like Docker Machine. The document concludes that CloudStack should not try to write a Docker hypervisor plugin, but instead focus on Docker-optimized OS templates and deploying application frameworks to orchestrate Docker.

DCSF19 Deploying Istio as an Ingress Controller Docker, Inc.

Netflix and Containers: Not A Stranger Thingaspyker

Customers from over all over the world streamed Forty Two Billion hours of Netflix content last year. The Netflix streaming service had been powered by the Amazon cloud with virtual machines for over five years, blazing a trail for similar architectures. In the last year, it invested in containers for batch-style jobs and service-style applications. Andrew Spyker will explain the potential containers have to help Netflix create a more productive development experience while simultaneously deepening its control over resource management. Join Andrew to see why Netflix is moving forward with containers, how it can leverage its existing operational machinery, and how it’s running containers with a similar guarantee of high availability as current Netflix infrastructure provides.

Monitoring Docker Application in ProductionAlois Reitbauer

Docker Federal Summit 2017 General SessionDocker, Inc.

XCloudLabs- AWS Overview sangam biradar

This document provides an overview of AWS networking services including Virtual Private Cloud, Amazon Route 53, AWS Direct Connect, VPN, and Elastic Load Balancing. It describes each service's purpose such as Virtual Private Cloud allowing users to launch AWS resources in a virtual private network and Amazon Route 53 providing scalable and available cloud DNS. The document also defines networking terminology like scalability, fault tolerance, elasticity, durability, and availability.

The Truth Behind ServerlessDocker, Inc.

The document discusses serverless computing and functions as a service (FaaS) platforms. It provides an overview of Amazon Lambda including details on storage limits, duration limits, memory sizes, and how functions are executed in containers. It also summarizes the key points of Amazon's serverless manifesto and lists several FaaS providers and event sources. The document raises questions about the challenges of orchestrating containers at scale and implementing serverless architectures for low latency and state management.

Empower Your Docker Containers with Watson - DockerCon 2017 AustinPhil Estes

Simple Solutions for Complex Problems - Boulder MeetupApcera

NATS: Control Flow for Distributed SystemsApcera

This document discusses the design and implementation of a messaging queue for distributed systems using NATS and Elasticsearch. It describes how NATS is used for pub/sub messaging and request/reply patterns. Elasticsearch provides central data storage. Components communicate by publishing and subscribing to messages containing a standardized Msg struct. The queue abstracts messaging and caching interfaces to provide a common API for components.

More Related Content

What's hot (20)

How we Upgraded Public Cloud From Juno to Queens with Minimal Downtime? | Ngu...Vietnam Open Infrastructure User Group

[OpenStack Day in Korea 2015] Track 2-6 - Apache Tajo on SwiftOpenStack Korea Community

Ibm cloud nativenetflixossfinalaspyker

Everything You Need to Know About Docker and Storage by Ryan Wallner, ClusterHQ Docker, Inc.

DCSF19 Kubernetes Security with OPA Docker, Inc.

Netflix Cloud Platform and Open Sourceaspyker

Kubernetes on OpenStack @eBaySriram Subramanian

Using the SDACK Architecture on Security Event Inspection by Yu-Lun Chen and ...Docker, Inc.

How to accelerate docker adoption with a simple and powerful user experienceDocker, Inc.

Docker - A curtain raiser to the Container worldzekeLabs Technologies

DCEU 18: App-in-a-Box with Docker Application PackagesDocker, Inc.

Open Source & The Internet of ThingsAll Things Open

Sebastien goasguen cloud stack and dockerShapeBlue

DCSF19 Deploying Istio as an Ingress Controller Docker, Inc.

Netflix and Containers: Not A Stranger Thingaspyker

Monitoring Docker Application in ProductionAlois Reitbauer

Docker Federal Summit 2017 General SessionDocker, Inc.

XCloudLabs- AWS Overview sangam biradar

The Truth Behind ServerlessDocker, Inc.

Empower Your Docker Containers with Watson - DockerCon 2017 AustinPhil Estes

How we Upgraded Public Cloud From Juno to Queens with Minimal Downtime? | Ngu...Vietnam Open Infrastructure User Group

[OpenStack Day in Korea 2015] Track 2-6 - Apache Tajo on SwiftOpenStack Korea Community

Ibm cloud nativenetflixossfinalaspyker

Everything You Need to Know About Docker and Storage by Ryan Wallner, ClusterHQ Docker, Inc.

DCSF19 Kubernetes Security with OPA Docker, Inc.

Netflix Cloud Platform and Open Sourceaspyker

Kubernetes on OpenStack @eBaySriram Subramanian

Using the SDACK Architecture on Security Event Inspection by Yu-Lun Chen and ...Docker, Inc.

How to accelerate docker adoption with a simple and powerful user experienceDocker, Inc.

Docker - A curtain raiser to the Container worldzekeLabs Technologies

DCEU 18: App-in-a-Box with Docker Application PackagesDocker, Inc.

Open Source & The Internet of ThingsAll Things Open

Sebastien goasguen cloud stack and dockerShapeBlue

DCSF19 Deploying Istio as an Ingress Controller Docker, Inc.

Netflix and Containers: Not A Stranger Thingaspyker

Monitoring Docker Application in ProductionAlois Reitbauer

Docker Federal Summit 2017 General SessionDocker, Inc.

XCloudLabs- AWS Overview sangam biradar

The Truth Behind ServerlessDocker, Inc.

Empower Your Docker Containers with Watson - DockerCon 2017 AustinPhil Estes

Viewers also liked (18)

Simple Solutions for Complex Problems - Boulder MeetupApcera

NATS: Control Flow for Distributed SystemsApcera

Patterns for Asynchronous Microservices with NATSApcera

NATS: A Central Nervous System for IoT Messaging - Larry McQuearyApcera

Security, identity and scalability define the IoT landscape. Developers in any IoT ecosystem need a flexible, lightweight and secure method to communicate device status/telemetry and content that operates at the speed of a central nervous system and doesn’t rely on inflexible and outdated protocol specifications designed for point-to-point communication. Enter NATS. NATS is an open source messaging framework based on Go that is designed for simple, secure, lightweight and scalable messaging in any language and for any platform/processor architecture. Larry McQueary present's an overview and short demonstration on the NATS architecture and API that will demonstrate how NATS can enable “things” and backend infrastructure to communicate securely and scalably at high speed without locking in vendor-specific technology or protocols. You can learn more about NATS at http://www.nats.io

Securing the Cloud Native StackApcera

The document discusses cloud-native application architectures and how they enable speed, safety, and scale through approaches like twelve-factor applications and microservices. It outlines the cloud-native stack and where governance is needed to secure different components like code, orchestration tools, containers, services, and infrastructure. The document argues that while cloud-native approaches are well-suited for technology companies, traditional enterprises face challenges in fully adopting these architectures due to differences in priorities, skills, and scale.

Simple and Scalable Microservices: Using NATS with Docker Compose and SwarmApcera

Waldemar Quevedo, Senior Software Engineer at Apcera NATS is a high-performance messaging system optimized for simplicity, reliability and low latency which can be a lightweight solution for the internal communication of your distributed system. In this talk, we will cover its core feature set as well as how to develop and assemble NATS-based microservices using the latest Docker tooling such as Compose and Swarm mode. You can learn more about NATS at http://www.nats.io

NATS vs HTTPApcera

Implementing Microservices with NATSApcera

Actor Patterns and NATS - Boulder MeetupApcera

Micro on NATS - Microservices with MessagingApcera

Micro is a toolkit for building microservice applications. It includes tools like Go Micro for building microservices and API for an API gateway. Micro integrates with NATS for service registration, synchronous RPC, and asynchronous messaging between services. NATS is chosen because it is lightweight, high performance, and simple to use from Go. The Micro-NATS integration implements the registry, transport, and broker interfaces to provide service discovery, request-response communication, and publish-subscribe messaging using NATS. This allows Micro services to leverage the scalability and reliability of NATS for building distributed systems.

How Greta uses NATS to revolutionize data distribution on the InternetApcera

Dennis Mårtensson is the CTO and co-founder of Greta, a Swedish startup that wants to change the way content is delivered on the internet. Greta has developed a technology for peer-to-peer content delivery over webRTC and are using NATS to create rapid webRTC signaling. You can learn more about NATS at http://www.nats.io. You can learn more about Greta at https://greta.io/

How to Migrate to Cloud with Complete Confidence and TrustApcera

IT Modernization Doesn’t Mean You Leave Your Legacy Apps BehindApcera

As enterprises adopt cloud infrastructure and modern architectures, they can’t turn their back on existing applications. The challenge is that legacy applications are expensive-to-maintain and inflexible due to infrastructure requirements and dependencies. Explore new approaches to application modernization with Mark Thiele, Chief Strategy Officer at Apcera, and Ralph Loura, CTO and Rodan + Fields, to learn how to protect current IT investments and establish a secure path to the cloud.

NATS Connector Framework - Boulder MeetupApcera

Integration Patterns and Anti-Patterns for Microservices ArchitecturesApcera

From Mainframe to Microservice: An Introduction to Distributed SystemsTyler Treat

An introductory overview of distributed systems—what they are and why they're difficult to build. We explore fundamental ideas and practical concepts in distributed programming. What is the CAP theorem? What is distributed consensus? What are CRDTs? We also look at options for solving the split-brain problem while considering the trade-off of high availability as well as options for scaling shared data.

NATS for Modern Messaging and MicroservicesApcera

Probabilistic algorithms for fun and pseudorandom profitTyler Treat

There's an increasing demand for real-time data ingestion and processing. Systems like Apache Kafka, Samza, and Storm have become popular for this reason. This type of high-volume, online data processing presents an interesting set of new challenges, namely, how do we drink from the firehose without getting drenched? Explore some of the fundamental primitives used in stream processing and, specifically, how we can use probabilistic methods to solve the problem.

Simple Solutions for Complex Problems - Boulder MeetupApcera

NATS: Control Flow for Distributed SystemsApcera

Patterns for Asynchronous Microservices with NATSApcera

NATS: A Central Nervous System for IoT Messaging - Larry McQuearyApcera

Securing the Cloud Native StackApcera

Simple and Scalable Microservices: Using NATS with Docker Compose and SwarmApcera

NATS vs HTTPApcera

Implementing Microservices with NATSApcera

Actor Patterns and NATS - Boulder MeetupApcera

Micro on NATS - Microservices with MessagingApcera

How Greta uses NATS to revolutionize data distribution on the InternetApcera

How to Migrate to Cloud with Complete Confidence and TrustApcera

IT Modernization Doesn’t Mean You Leave Your Legacy Apps BehindApcera

NATS Connector Framework - Boulder MeetupApcera

Integration Patterns and Anti-Patterns for Microservices ArchitecturesApcera

From Mainframe to Microservice: An Introduction to Distributed SystemsTyler Treat

NATS for Modern Messaging and MicroservicesApcera

Probabilistic algorithms for fun and pseudorandom profitTyler Treat

Similar to KURMA - A Containerized Container Platform - KubeCon 2016 (20)

Apache Provisionr (incubating) - Bucharest JUG 10Andrei Savu

Truemotion Adventures in ContainerizationRyan Hunter

This document summarizes Ryan Hunter's experience switching his company's infrastructure from using Ansible to provision Debian-based servers to using Docker containers and ECS on AWS. Some key reasons for the switch included dependency issues with Ansible, inflexible server sizing, and a desire for more portable and standardized application builds. Docker provided containers as a flexible runtime artifact while ECS and CloudFormation helped with scheduling, provisioning, and configuring containers at scale on AWS. Monitoring tools like Consul, Sumo Logic, and custom monitoring libraries were also implemented.

From swarm to swam-mode in the CERN container serviceSpyros Trigazis

OpenStack Nova Scheduler Peeyush Gupta

OpenStack is an open source cloud operating system that provides on-demand provisioning of compute, storage, and networking resources. It consists of several interconnected components that are managed through a dashboard interface. The key components include Horizon (dashboard), Keystone (authentication), Swift (object storage), Glance (image repository), Nova (compute), Quantum (networking), and Cinder (block storage). Nova is responsible for running virtual machine instances by retrieving images from Glance and scheduling instances on compute hosts using the Nova scheduler. The Nova scheduler uses filters and weights to determine the most suitable host for an instance based on availability, capabilities, and load.

Creating pools of Virtual Machines - ApacheCon NA 2013Andrei Savu

Scalable Spark deployment using Kubernetesdatamantra

OpenStack & Ubuntu (india openstack day)openstackindia

- Canonical provides Ubuntu, the #1 Linux OS for cloud and desktop computing, and offers support services for deploying OpenStack on Ubuntu. - Deploying and managing cloud infrastructure and workloads at scale presents challenges around automation, orchestration, updates and compliance. - Canonical's Juju service orchestration tool and Ubuntu Cloud Jumpstart program help customers address these challenges by automating deployments, updates and operations across public and private clouds.

The benefits of running Spark on your own DockerItai Yaffe

Shir Bromberg (Big Data team leader) @ Yotpo: Nowadays, many of an organization’s main applications rely on Spark pipelines. As these applications become more significant to businesses, so does the need to quickly deploy, test and monitor them. The standard way of running spark jobs is to deploy it on a dedicated managed cluster. However, this solution is relatively expensive with potentially high setup time. Therefore, we developed a way to run Spark on any container orchestration platform. This allows us to run Spark in a simple, custom and testable way. In this talk, we will present our open-source dockers for running Spark on Nomad servers. We will cover: * The issues we had running spark on managed clusters and the solution we developed. * How to build a spark docker. * And finally, what you may achieve by using Spark on Nomad.

LCU14 310- Cisco ODP v2Linaro

LCU14 310- Cisco ODP --------------------------------------------------- Speaker: Robbie King Date: September 17, 2014 --------------------------------------------------- ★ Session Summary ★ Cisco to present their experience using ODP to provide portable accelerated access to crypto functions on various SoCs. --------------------------------------------------- ★ Resources ★ Zerista: http://lcu14.zerista.com/event/member/137757 Google Event: https://plus.google.com/u/0/events/ckmld1hll5jjijq11frbqmptet8 Video: https://www.youtube.com/watch?v=eFlTmslVK-Y&list=UUIVqQKxCyQLJS6xvSmfndLA Etherpad: http://pad.linaro.org/p/lcu14-310 --------------------------------------------------- ★ Event Details ★ Linaro Connect USA - #LCU14 September 15-19th, 2014 Hyatt Regency San Francisco Airport --------------------------------------------------- http://www.linaro.org http://connect.linaro.org

Docker 0.11 at MaxCDN meetup in Los AngelesJérôme Petazzoni

This document introduces Docker and provides an overview of its key concepts and capabilities. It explains that Docker allows deploying applications into lightweight Linux containers that are isolated but share resources and run at native speeds. It describes how Docker uses namespaces and cgroups for isolation and copy-on-write storage for efficiency. The document also outlines common Docker workflows for building, testing, and deploying containerized applications both locally and in production environments at scale.

Introduction to Docker, December 2014 "Tour de France" EditionJérôme Petazzoni

Workshop : 45 minutes pour comprendre Docker avec Jérôme PetazzoniTheFamily

Introduction to Docker and ContainersDocker, Inc.

This document introduces Docker and containers. It discusses that Docker provides a way to easily deploy applications by using lightweight virtualization to isolate applications into containers. These containers can then be easily shared between systems. The document outlines what problem containers solve, provides an overview of how Docker works, and discusses how to author Docker images using Dockerfiles or by committing changes to containers. It also discusses the Docker community and ecosystem and Docker's long term roadmap to further simplify deployment of applications.

OpenStack Best Practices and Considerations - terasky tech dayArthur Berezin

Docker+javaDPC Consulting Ltd

Docker provides lightweight virtualization using containers. It allows applications to be packaged with their dependencies and run consistently across environments. Java applications can be containerized using Docker to enable continuous delivery, running the same environment for development, testing, and production. The Docker ecosystem is growing with many tools and platforms supporting containerization of Java applications.

A Gentle Introduction to Docker and ContainersDocker, Inc.

This document provides an introduction to Docker and containers. It outlines that Docker is an open source tool that makes it easy to deploy applications by using containers. Containers allow applications to be isolated for easier management and deployment. The document discusses how Docker builds on existing container technologies and provides a standardized way to build, share, and run application containers.

20141111_SOS3_GalloAndrea Gallo

Linaro has enabled server class workloads for ARM servers by optimizing key open source software. They have contributed patches to projects like the Linux kernel, KVM, Xen, OpenJDK, Hadoop, and OpenStack. This has allowed OpenStack to run on ARMv8 hardware, with all applicable Tempest tests passing. Linaro is also working on optimizations for server workloads like the LAMP stack, HDFS, and HipHop JIT. Their efforts are helping to accelerate ARM's adoption in the server market.

Como creamos QuestDB Cloud, un SaaS basado en Kubernetes alrededor de QuestDB...javier ramirez

QuestDB es una base de datos open source de alto rendimiento. Mucha gente nos comentaba que les gustaría usarla como servicio, sin tener que gestionar las máquinas. Así que nos pusimos manos a la obra para desarrollar una solución que nos permitiese lanzar instancias de QuestDB con provisionado, monitorización, seguridad o actualizaciones totalmente gestionadas. Unos cuantos clusters de Kubernetes más tarde, conseguimos lanzar nuestra oferta de QuestDB Cloud. Esta charla es la historia de cómo llegamos ahí. Hablaré de herramientas como Calico, Karpenter, CoreDNS, Telegraf, Prometheus, Loki o Grafana, pero también de retos como autenticación, facturación, multi-nube, o de a qué tienes que decir que no para poder sobrevivir en la nube.

LXC, Docker, and the future of software delivery | LinuxCon 2013dotCloud

This document discusses Linux containers and Docker. It describes how Linux containers provide isolation using namespaces and cgroups to allow applications to run consistently across different environments. Docker builds on Linux containers to make them easy to use, create, share, and deploy. Docker allows building images from Dockerfiles, sharing images in registries, and developing hybrid cloud workflows. The document outlines Docker's roadmap and growing ecosystem of tools and projects building on Docker.

LXC Docker and the Future of Software DeliveryDocker, Inc.

This document discusses Linux containers and Docker. It describes how Linux containers provide isolation using namespaces and cgroups to allow applications to run consistently across different environments. Docker builds on Linux containers to make them easy to use, create, share, and deploy. Docker allows building images from Dockerfiles, sharing images in registries, and provides tools for continuous integration workflows. The document outlines Docker's roadmap and growing ecosystem of related projects.

Apache Provisionr (incubating) - Bucharest JUG 10Andrei Savu

Truemotion Adventures in ContainerizationRyan Hunter

From swarm to swam-mode in the CERN container serviceSpyros Trigazis

OpenStack Nova Scheduler Peeyush Gupta

Creating pools of Virtual Machines - ApacheCon NA 2013Andrei Savu

Scalable Spark deployment using Kubernetesdatamantra

OpenStack & Ubuntu (india openstack day)openstackindia

The benefits of running Spark on your own DockerItai Yaffe

LCU14 310- Cisco ODP v2Linaro

Docker 0.11 at MaxCDN meetup in Los AngelesJérôme Petazzoni

Introduction to Docker, December 2014 "Tour de France" EditionJérôme Petazzoni

Workshop : 45 minutes pour comprendre Docker avec Jérôme PetazzoniTheFamily

Introduction to Docker and ContainersDocker, Inc.

OpenStack Best Practices and Considerations - terasky tech dayArthur Berezin

Docker+javaDPC Consulting Ltd

A Gentle Introduction to Docker and ContainersDocker, Inc.

20141111_SOS3_GalloAndrea Gallo

Como creamos QuestDB Cloud, un SaaS basado en Kubernetes alrededor de QuestDB...javier ramirez

LXC, Docker, and the future of software delivery | LinuxCon 2013dotCloud

LXC Docker and the Future of Software DeliveryDocker, Inc.

More from Apcera (14)

Gopher fest 2017: Adding Context To NATSApcera

The Context package has been a popular topic in the Golang community for sometime and as of the Go 1.7 release, it has become a standard Go library. It carries a variety of details across API boundaries and between processes. NATS is an open-source, high-performance, lightweight cloud native messaging system. Many NATS users working in Go have been using Context alongside NATS, but there has not been an officially-supported Context-NATS integration – that is, until now. This talk will discuss what Context is, what observations and lessons Waldemar and his team have learned integrating Context and NATS, and how you use the two together. He'll also provide a quick demo to show the integration. About the Speaker: Waldemar Quevedo is a Senior Software Engineer at Apcera, where he develops the Apcera Trusted Platform and is part of the NATS team. Previously, he formed part of the PaaS team at Rakuten in Tokyo which was one of the early adopters of CloudFoundry for production usage where he experienced operating NATS for the first time, and became a fan of its simplicity. You can learn more about NATS at http://www.nats.io

How Clarifai uses NATS and Kubernetes for Machine LearningApcera

Clarifai uses NATS as its messaging system between microservices. Some key reasons for choosing NATS include its lightweight footprint, ease of use on Kubernetes, message persistence, queueing capabilities, and active community. NATS has been running in production at Clarifai for over 5 months, handling over 100k messages per day across multiple services. While manual acknowledgements caused some issues initially, NATS has provided 100% uptime and met Clarifai's requirements for microservice communication.

Modernizing IT in the Platform EraApcera

Debugging Network IssuesApcera

Jaime Piña, @variadico, Software Engineer at Apcera Microservice issues are networking issues. Fixing code in your app is easy, but the hard part of using microservices is the networking. How do you actually know if you're sending what you think you are? Why does this request fail in my app, but not when I use curl? Is this service very slow or is it up at all? This talk will help demystify some common problems you might experience while building out your collection of microservices. Once you can find the issue, it becomes way easier to fix.

The Zen of High Performance Messaging with NATSApcera

The Zen of High Performance Messaging with NATS Waldemar Quevedo Salinas, Senior Software Engineer NATS is an open source, high performant messaging system with a design oriented towards both being as simple and reliable as possible without at the same time trading off scalability. Originally written in Ruby, and then rewritten in Go, a NATS server can nowadays push over 11M messages per second. In this talk, we will cover how following simplicity as the main design constraint as well as focusing on a limited built-in feature set, resulted in a system which is easy to operate and reason about, making up for an attractive choice for when building many types of distributed systems where low latency and high availability are very important. You can learn more about NATS at http://www.nats.io

Simple Solutions for Complex Problems Apcera

Kubernetes, The Day AfterApcera

Policy-based Cloud Storage: Persisting Data in a Multi-Site, Multi-Cloud WorldApcera

Apcera's Earl Ruby discusses the role of policy in cloud storage, microservices and container management at SF Microservices meetup. As organizations are building storage and infrastructure at scale, policy supports provisioning, security, performance and business logic. What problems are we trying to solve? Define “Scale”... Cloud software has to to "play nice with others" Policy for Provisioning, Security, Performance, and Business Logic You can learn more about The Trusted Cloud Platform at: https://www.apcera.com/

Integration Patterns for Microservices ArchitecturesApcera

One of the fundamental principals of microservices is the idea of lightweight, composable loosely coupled applications that can either talk through some type of service endpoint, through some protocol like HTTP or through pipes. A lightweight messaging system such as NATS is a better way for microservices to talk to each other and integrate disparate systems outside the microservice or architecture. You can learn more about NATS at http://www.nats.io

Nats meetup sf 20150826Apcera

NATS was created by Derek Collison, founder and CEO of Apcera, who has spent 20+ years designing, building, and using publish-subscribe messaging systems. Unlike traditional enterprise messaging systems, NATS has an always-on dial tone that does whatever it takes to remain available. Learn how end users are building modern, reliable and scalable cloud and distributed systems with NATS. Talk given by David Williams, Principal, Williams & Garcia You can learn more about NATS at http://www.nats.io

Microservices: Notes From The FieldApcera

Docker + App Container = ocpApcera

The document discusses Docker and app containers, and introduces the new Open Container Project (OCP). It provides background on Docker and appc/CoreOS, and summarizes Apcera's use of container technologies. The creation of OCP is seen as positive, aiming to define common standards while different implementations remain. Key open questions for OCP include the image specification and future of projects like rkt and libcontainer.

Apcera: Agility and Security in Docker DeliveryApcera

Delivering Policy & Trust to the Hybrid CloudApcera

Gopher fest 2017: Adding Context To NATSApcera

How Clarifai uses NATS and Kubernetes for Machine LearningApcera

Modernizing IT in the Platform EraApcera

Debugging Network IssuesApcera

The Zen of High Performance Messaging with NATSApcera

Simple Solutions for Complex Problems Apcera

Kubernetes, The Day AfterApcera

Policy-based Cloud Storage: Persisting Data in a Multi-Site, Multi-Cloud WorldApcera

Integration Patterns for Microservices ArchitecturesApcera

Nats meetup sf 20150826Apcera

Microservices: Notes From The FieldApcera

Docker + App Container = ocpApcera

Apcera: Agility and Security in Docker DeliveryApcera

Delivering Policy & Trust to the Hybrid CloudApcera

Recently uploaded (20)

Drupalcamp Finland – Measuring Front-end Energy ConsumptionExove

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.

Cyber Awareness overview for 2025 month of securityriccardosl1

Manifest Pre-Seed Update | A Humanoid OEM Deeptech In Francechb3

tecnologias de las primeras civilizaciones.pdffjgm517

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

Join this UiPath Community Berlin meetup to explore the Orchestrator API, Swagger interface, and the Test Manager API. Learn how to leverage these tools to streamline automation, enhance testing, and integrate more efficiently with UiPath. Perfect for developers, testers, and automation enthusiasts! 📕 Agenda Welcome & Introductions Orchestrator API Overview Exploring the Swagger Interface Test Manager API Highlights Streamlining Automation & Testing with APIs (Demo) Q&A and Open Discussion Perfect for developers, testers, and automation enthusiasts! 👉 Join our UiPath Community Berlin chapter: https://community.uipath.com/berlin/ This session streamed live on April 29, 2025, 18:00 CET. Check out all our upcoming UiPath Community sessions at https://community.uipath.com/events/.

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Talk at the final event of Data Fusion Dynamics: A Collaborative UK-Saudi Initiative in Cybersecurity and Artificial Intelligence funded by the British Council UK-Saudi Challenge Fund 2024, Cardiff Metropolitan University, 29th April 2025 https://alandix.com/academic/talks/CMet2025-AI-Changes-Everything/ Is AI just another technology, or does it fundamentally change the way we live and think? Every technology has a direct impact with micro-ethical consequences, some good, some bad. However more profound are the ways in which some technologies reshape the very fabric of society with macro-ethical impacts. The invention of the stirrup revolutionised mounted combat, but as a side effect gave rise to the feudal system, which still shapes politics today. The internal combustion engine offers personal freedom and creates pollution, but has also transformed the nature of urban planning and international trade. When we look at AI the micro-ethical issues, such as bias, are most obvious, but the macro-ethical challenges may be greater. At a micro-ethical level AI has the potential to deepen social, ethnic and gender bias, issues I have warned about since the early 1990s! It is also being used increasingly on the battlefield. However, it also offers amazing opportunities in health and educations, as the recent Nobel prizes for the developers of AlphaFold illustrate. More radically, the need to encode ethics acts as a mirror to surface essential ethical problems and conflicts. At the macro-ethical level, by the early 2000s digital technology had already begun to undermine sovereignty (e.g. gambling), market economics (through network effects and emergent monopolies), and the very meaning of money. Modern AI is the child of big data, big computation and ultimately big business, intensifying the inherent tendency of digital technology to concentrate power. AI is already unravelling the fundamentals of the social, political and economic world around us, but this is a world that needs radical reimagining to overcome the global environmental and human challenges that confront us. Our challenge is whether to let the threads fall as they may, or to use them to weave a better future.

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc

Most consumers believe they’re making informed decisions about their personal data—adjusting privacy settings, blocking trackers, and opting out where they can. However, our new research reveals that while awareness is high, taking meaningful action is still lacking. On the corporate side, many organizations report strong policies for managing third-party data and consumer consent yet fall short when it comes to consistency, accountability and transparency. This session will explore the research findings from TrustArc’s Privacy Pulse Survey, examining consumer attitudes toward personal data collection and practical suggestions for corporate practices around purchasing third-party data. Attendees will learn: - Consumer awareness around data brokers and what consumers are doing to limit data collection - How businesses assess third-party vendors and their consent management operations - Where business preparedness needs improvement - What these trends mean for the future of privacy governance and public trust This discussion is essential for privacy, risk, and compliance professionals who want to ground their strategies in current data and prepare for what’s next in the privacy landscape.

Build Your Own Copilot & Agents For DevsBrian McKeiver

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots. 📕 Here's what you can expect: - Modeling: Build end-to-end processes using BPMN. - Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes. - Operating: Control process instances with rewind, replay, pause, and stop functions. - Monitoring: Use dashboards and embedded analytics for real-time insights into process instances. This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes. 👨‍🏫 Speaker: Andrei Vintila, Principal Product Manager @UiPath This session streamed live on April 29, 2025, 16:00 CET. Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.

How Can I use the AI Hype in my Business Context?Daniel Lehner

𝙄𝙨 𝘼𝙄 𝙟𝙪𝙨𝙩 𝙝𝙮𝙥𝙚? 𝙊𝙧 𝙞𝙨 𝙞𝙩 𝙩𝙝𝙚 𝙜𝙖𝙢𝙚 𝙘𝙝𝙖𝙣𝙜𝙚𝙧 𝙮𝙤𝙪𝙧 𝙗𝙪𝙨𝙞𝙣𝙚𝙨𝙨 𝙣𝙚𝙚𝙙𝙨? Everyone’s talking about AI but is anyone really using it to create real value? Most companies want to leverage AI. Few know 𝗵𝗼𝘄. ✅ What exactly should you ask to find real AI opportunities? ✅ Which AI techniques actually fit your business? ✅ Is your data even ready for AI? If you’re not sure, you’re not alone. This is a condensed version of the slides I presented at a Linkedin webinar for Tecnovy on 28.04.2025.

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB

I started my online journey with several hosting services before stumbling upon Ai EngineHost. At first, the idea of paying one fee and getting lifetime access seemed too good to pass up. The platform is built on reliable US-based servers, ensuring your projects run at high speeds and remain safe. Let me take you step by step through its benefits and features as I explain why this hosting solution is a perfect fit for digital entrepreneurs.

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark? At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍 Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀

Drupalcamp Finland – Measuring Front-end Energy ConsumptionExove

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Cyber Awareness overview for 2025 month of securityriccardosl1

Manifest Pre-Seed Update | A Humanoid OEM Deeptech In Francechb3

tecnologias de las primeras civilizaciones.pdffjgm517

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc

Build Your Own Copilot & Agents For DevsBrian McKeiver

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

How Can I use the AI Hype in my Business Context?Daniel Lehner

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

KURMA - A Containerized Container Platform - KubeCon 2016

2. 2016

3. In the beginning… (2012)

4. The Go Landscape 2012

5. Apcera Platform The Instance Manager

6. Instance Manager State Machine Apocalypse ● Started out simple, but naive about the future ● Few small libraries… ● … but all integration logic was central ● 8 states ● 53 function handlers

7. Existing Weight ● Ubuntu base OS ● CAPS deployment ● .deb packaging ● Operational tooling

8. System Skew is a Problem ● Deploys non-atomic ● Different lifecycle per host ● Operational access

10. A New Model Kurma ● Minimize host dependencies ● Everything is a container ● Simple notions that could be easily extended ● Simple, well defined APIs

11. What is Kurma made of? Existing ● Go + C ● App Container (AppC) ● Apcera’s existing instrumentation Coming soon ● Go + C ● AppC ● libcontainer based ● CNI for networking

12. What is Kurma made of? Existing ● Go + C ● App Container (AppC) ● Apcera’s existing instrumentation Coming soon ● Go + C ● AppC ● libcontainer based ● CNI for networking

13. Delivery kurmad ● Existing host ● Download and run ● Immediately benefit ● Depends on host kernel and libc kurmaOS ● Minimalist distro ● Services as containers ● A/B partition model ● Console is just a container

14. Delivery kurmad ● Existing host ● Download and run ● Immediately benefit ● Depends on host kernel and libc kurmaOS ● Minimalist distro ● Services as containers ● A/B partition model ● Console is just a container

15. Kurma Process Model

16. Kurma Stager Process

17. Kurma User Processes

18. Stager Pluggable Process Orchestration ● Responsible for instrumenting the pod ● Packaged as a signed, trusted ACI image ● Gets own mount and network namespace

19. Stager API ● Simplest unit of work: an executable ● Setup via image ‘Exec’ setting ● Other calls through expected executables – /opt/stager/run – /opt/stager/status – /opt/stager/logs – ...

20. Kurma Reusable Unit

21. Kurma Reusable Unit for Extensibility

22. Networking API ● ACI image ● Passes along JSON configuration ● Executes commands to setup networking on other containers – /opt/network/add <ns> <container-id> – /opt/network/del <ns> <container-id>

23. Kurma Reusable Unit for Extensibility /opt/stager/run cni /opt/network/add ...

24. Kurma Extensibility Through Reuse

25. Kurma Extensibility Through Reuse

26. Kurma Extending Boundries with Semantics

27. Kurma Remote API

28. Kubernetes + Kurma

29. Why? ● Kurma usage outside Apcera ● Increased platform flexibility ● Integrating with broader community

30. Kubelet ● Has existing Runtime interface ● Rich interface for engine communication ● Kubelet is a bit of a leaky abstraction ● Workarounds for Dockerisms

31. Testing ● Mystical ● Documentation gaps ● Excellent Github/PR integration

32. Codebase ● Godep pains ● “hack” directory? ● Documentation gaps ● Interface movement Runtime.ConvertPodStatusToAPIPodStatus()

33. Kurmanetes ● Maturing Kurma based on Kubernetes needs – Pods – Networking – Image management ● Runtime abstraction nearly complete

34. Kurmanetes ● Done – Pod management – Image retrieval and management ● Remaining – Landing Kurma’s pod/stager branch – cAdvisor integration – Integration testing – Work towards improving the abstraction leaks

35. Questions?

36. Resources Kurma kurma.io github.com/apcera/kurma Me [email protected] @krobertson We’re hiring for the Kurma team.

KURMA - A Containerized Container Platform - KubeCon 2016

Recommended

More Related Content

What's hot (20)

Viewers also liked (18)

Similar to KURMA - A Containerized Container Platform - KubeCon 2016 (20)

More from Apcera (14)

Recently uploaded (20)

KURMA - A Containerized Container Platform - KubeCon 2016