KubeCon NA, Seattle, 2016: Performance and Scalability Tuning Kubernetes for OpenShift and Docker

Nov 9, 20162 likes1,638 views

earn tips and tricks on how to best configure and tune your container infrastructure for maximum performance and scale. The Performance Engineering Group at Red Hat is responsible for performance of the complete container portfolio, including Docker, RHEL Atomic, Kubernetes and OpenShift. We will share: - Latest Performance Features in OpenShift, Docker and RHEL Atomic, tips and tricks on how to best configure and tune your system for maximum performance and scale - Latest performance and scale test results, using RHEL Atomic, OpenvSwitch, Cockpit multi-server container management - DevOps, Agile approach to Performance Analysis of OpenShift, Kubernetes, Docker and RHEL Atomic - Test harness code and example scripts Audience The audience is anyone interested in deploying containers to run performance sensitive workloads, as well as architecting highly scalable distributed systems for hosting those workloads. This includes workloads that require NUMA awareness, direct hardware access and kernel-bypass I/O.

KubeCon NA, Seattle, 2016: Performance and Scalability Tuning Kubernetes for OpenShift and Docker

http://j.mp/ose-perf-scale

Attribute Build Farm
CPU Intensive High
Memory Intensive High
Disk I/O Latency Low
Disk I/O Throughput High
Network Latency Low
Network Throughput High
Security Low
Uptime (Live Migration) N/A
Deployment Speed High
Alternative OS N/A
Icon Meaning
Mature and/or
No Perf Concerns
Immature and/or
Limited Perf Concerns
Mixed Concerns
Not Applicable

CONTAINER DISCOVERY
VIA REGISTRY
ORCHESTRATION WITH
KUBERNETES
Red Hat works with the open source community to drive standards for containerization.
ISOLATION WITH
LINUX CONTAINERS
CONTAINER FORMAT
WITH DOCKER

Atomic Host - a container-optimized,
minimal footprint OS powered by Red Hat
Enterprise Linux
Telemetry - logging and metrics for
pods/containers, services and underlying
infrastructure to make informed decisions
Runtime and Packaging Format -
standardized container packaging format and
runtime, powered by Docker (and OCI)
Automation and host configuration management
via Cockpit to dynamically provision
and configure container host clusters
Orchestration - for complex multi-container
services, powered by Kubernetes
Networking - scalable, multi-host container
networking, powered by Open vSwitch, that runs
anywhere Red Hat Enterprise Linux runs
Cluster Services - Scheduling for services
across a container host cluster, powered by
Kubernetes
Storage, with persistent storage plugins
to enable running of stateful services in containers
Atomic Registry - integrated storage and
management for sharing container images
Security to prevent tenants from compromising
other occupants

● 2x Intel E5-2680v3 12-core
● 256GB RAM
● 2x Intel S3610 400GB SSD
● 1x Intel P3700 800GB NVMe
PCIe SSD
● 1x QP Intel X710
●
●
●
●
●

ClusterLoader:
projects:
- num: 1000
basename: nginx-explorer
tuning: default
templates:
- num: 10
file: cluster-loader/nginx.yaml
- num: 20
file: cluster-loader/explorer-pod.yaml

Kubernetes Object Quantity
Nodes 1,000
Namespaces (projects) 13,000
Pods 52,000
Build Configs 39,000
Templates 78,000
Image Streams 13,000
Deployment Configs
and Services
39,000 (incl. 13,000
Replication Controllers)
Secrets 260,000
Routes 39,000

This document summarizes performance tuning techniques for OpenShift 3.5 and Docker 1.12. It discusses optimizing components like etcd, container storage, routing, metrics and logging. It also describes tools for testing OpenShift scalability through cluster loading, traffic generation and concurrent operations. Specific techniques are mentioned like using etcd 3.1, overlay2 storage and moving image metadata to the registry.

LinuxCon NA 2016: When Containers and Virtualization Do - and Don’t - Work T...Jeremy Eder

OSCON 2017: To contain or not to containJeremy Eder

DevConf 2017 - Realistic Container Platform SimulationsJeremy Eder

The document discusses realistic container platform simulations presented at DevConf 2017. It describes the aos-scalability team and adjunct professors presenting on workload classification, test utilities, and a demo. The team's focus is on classifying workloads and developing test harnesses like the System Verification Test Suite and cluster-loader tool to simulate thousands of deployment configurations. Gold mining successes are also summarized, including addressing performance issues with iptables, HAProxy, logging, and metrics.

CEPH DAY BERLIN - CEPH ON THE BRAIN!Ceph Community

How does Ceph perform when used in high-performance computing? This talk will cover a year of running Ceph on a (small) Cray supercomputer. I will describe how Ceph was configured to perform in an all-NVME configuration, and the process of analysis and optimisation of the configuration. I'll also give details on the efforts underway to adapt Ceph's messaging to run over high performance network fabrics, and how this work could become the next frontier in the battle against storage performance bottlenecks.

Ceph Tech Talk: Ceph at DigitalOceanCeph Community

DigitalOcean uses Ceph for block and object storage backing for their cloud services. They operate 37 production Ceph clusters running Nautilus and one on Luminous, storing over 54 PB of data across 21,500 OSDs. They deploy and manage Ceph clusters using Ansible playbooks and containerized Ceph packages, and monitor cluster health using Prometheus and Grafana dashboards. Upgrades can be challenging due to potential issues uncovered and slow performance on HDD backends.

CEPH DAY BERLIN - DEPLOYING CEPH IN KUBERNETES WITH ROOKCeph Community

HPC in a Box - Docker Workshop at ISC 2015inside-BigData.com

Remote secured storageSalo Shp

Protecting the Galaxy - Multi-Region Disaster Recovery with OpenStack and CephSean Cohen

IT organizations require a disaster recovery strategy addressing outages with loss of storage, or extended loss of availability at the primary site. Applications need to rapidly migrate to the secondary site and transition with little or no impact to their availability.This talk will cover the various architectural options and levels of maturity in OpenStack services for building multi-site configurations using the Mitaka release. We’ll present the latest capabilities for Volume, Image and Object Storage with Ceph as the backend storage solution, and look at the future developments the OpenStack and Ceph communities are driving to improve and simplify the relevant use cases. Slides from OpenStack Austin Summit 2016 session: http://alturl.com/hpesz

2021.06. Ceph Project UpdateCeph Community

The document provides an agenda and overview of the Ceph Project Update and Ceph Month event in June 2021. Some key points: - Ceph is open source software that provides scalable, reliable distributed storage across commodity hardware. - Ceph Month will include weekly sessions on topics like RADOS, RGW, RBD, and CephFS to promote interactive discussion. - The Ceph Foundation is working on projects to improve documentation, training materials, and lab infrastructure for testing and development.

NantOmicsCeph Community

This document discusses Nantomics' use of Ceph for genomics data storage and processing. Key points: - Nantomics generates large amounts of genomic data from testing and research that needs to be reliably stored and accessed for processing and analysis. - Ceph is used to provide scalable object, block, and POSIX storage across multiple clusters totaling over 40 petabytes. This replaces more expensive cloud storage and proprietary solutions. - Benefits of Ceph include lower costs, guaranteed performance, flexibility, and avoiding vendor lock-in. Managing Ceph also requires less than 0.25 FTE of effort through automation. - While Ceph provides many advantages, tuning large clusters and troubleshooting

Cephfs - Red Hat Openstack and Ceph meetup, Pune 28th november 2015bipin kunal

The document summarizes a meetup about Red Hat Openstack and Ceph held on November 28th, 2015 in Pune. It discusses the challenges of distributed filesystems like scalability, performance and stateful clients. It then explains how Ceph addresses these challenges through its POSIX interface, scalable data and metadata, and support for stateful clients. The rest of the document describes the architecture and components of Ceph, how it stores data and metadata in RADOS objects, and how clients interact with the MDS through sessions to perform lookups and manage file metadata. It also provides instructions for mounting CephFS using the kernel driver or FUSE.

Friends don't let friends do dual writes: Outbox pattern with OpenShift Strea...Red Hat Developers

Dual writes are a common source of issues in distributed event-driven applications. A dual write occurs when an application has to change data in two different systems - for instance, when an application needs to persist data in the database and send a Kafka message to notify other systems. If one of these two operations fail, you might end up with inconsistent data which can be hard to detect and fix. OpenShift Streams for Apache Kafka is Red Hat's fully hosted and managed Apache Kafka service targeting development teams that want to incorporate streaming data and scalable messaging in their applications, without the burden of setting up and maintaining a Kafka cluster infrastructure. Debezium is an open source distributed platform for change data capture. Built on top of Apache Kafka, it allows applications to react to inserts, updates, and deletes in your databases. In this session you will learn how you can leverage OpenShift Streams for Apache Kafka and Debezium to avoid the dual write issue in an event-driven application using the outbox pattern. More specifically, we will show you how to: Provision a Kafka cluster on OpenShift Streams for Apache Kafka. Deploy and configure Debezium to use OpenShift Streams for Apache Kafka. Refactor an application to leverage Debezium and OpenShift Streams for Apache Kafka to avoid the dual write problem.

Manila, an update from Liberty, OpenStack Summit - TokyoSean Cohen

Manila is a community-driven project that presents the management of file shares (e.g. NFS, CIFS, HDFS) as a core service to OpenStack. Manila currently works with a variety of storage platforms, as well as a reference implementation based on a Linux NFS server. Manila is exploding with new features, use cases, and deployers. In this session, we'll give an update on the new capabilities added in the Liberty release: • Integration with OpenStack Sahara • Migration of shares across different storage back-ends • Support for availability zones (AZs) and share replication across these AZs • The ability to grow and shrink file shares on demand • New mount automation framework • and much more… As well as provide a quick look of whats coming up in Mitaka release with Share Replication demo

Why you’re going to fail running java on docker!Red Hat Developers

This document discusses running Java applications on Docker containers and some of the challenges that can cause Java applications to fail when run this way. It begins by listing some big wins of using Docker for developers, such as portability and consistency across environments. It then discusses some potential cons, such as Docker not being a true virtual machine and portability issues. The document provides an overview of containers versus virtualization and the history of containers. It identifies specific challenges for Java applications related to seeing all host system resources rather than being constrained to container limits. Workarounds for memory and CPU limitations in Java are presented. The document emphasizes the importance of configuration for Java applications in containers.

Supercomputing by API: Connecting Modern Web Apps to HPCOpenStack

Audience Level Intermediate Synopsis The traditional user experience for High Performance Computing (HPC) centers around the command line, and the intricacies of the underlying hardware. At the same time, scientific software is moving towards the cloud, leveraging modern web-based frameworks, allowing rapid iteration, and a renewed focus on portability and reproducibility. This software still has need for the huge scale and specialist capabilities of HPC, but leveraging these resources is hampered by variation in implementation between facilities. Differences in software stack, scheduling systems and authentication all get in the way of developers who would rather focus on the research problem at hand. This presentation reviews efforts to overcome these barriers. We will cover container technologies, frameworks for programmatic HPC access, and RESTful APIs that can deliver this as a hosted solution. Speaker Bio Dr. David Perry is Compute Integration Specialist at The University of Melbourne, working to increase research productivity using cloud and HPC. David chairs Australia’s first community-owned wind farm, Hepburn Wind, and is co-founder/CTO of BoomPower, delivering simpler solar and battery purchasing decisions for consumers and NGOs.

Hyperconverged Cloud, Not just a toy anymore - Andrew Hatfield, Red HatOpenStack

Audience Level Intermediate Synopsis Hypercoverged Compute, Network and Storage is ready for production workloads – where it makes sense. Whether you’re a telecommunications carrier, service provider or enterprise; implementing Network Function Virtualisation (NFV), focusing on specific known workloads or simply a dev / test cloud – deploying a hypercoverged OpenStack cloud makes a lot of sense. Come along and discover which workloads fit a hyperconverged architecture, see examples and look into the very near future and learn how OpenStack is truly ready to serve your every need. Speaker Bio Andrew has over 20 years experience in the IT industry across APAC, specialising in Databases, Directory Systems, Groupware, Virtualisation and Storage for Enterprise and Government organisations. When not helping customers slash costs and increase agility by moving to the software-defined future, he’s enjoying the subtle tones of Islay Whisky and shredding pow pow on the world’s best snowboard resorts.

OSDC 2018 | Ops hates containers. Why? by Martin AlfkeNETWAYS

“Docker, Docker, Docker, Docker,…” developers really love Docker. Usually one sees the no longer need for configuration management, the easy way to spin up a platform on a laptop, the low resource footprint. But how do you deploy laptops in data centers? This talk will give you an insight how we (more Ops then Dev) started to learn (and love) containers, the issues we saw when running them in larger scale and how Ops people should start dealing with Container technologies.

Kubernetes and OpenStack at ScaleStephen Gordon

Kubernetes and OpenStack at Scale at OpenStack Summit Boston 2017 Imagine being able to stand up thousands of tenants with thousands of apps, running thousands of Docker-formatted container images and routes, all on a self-healing cluster and elastic infrastructure. Now, take that one step further - all of those images being updatable through a single upload to the registry, and with zero downtime. In this session, you will see just that. In this presentation, we will walk through a recent benchmarking deployment using Kubernetes and OpenStack on the Cloud Native Computing Foundation’s (CNCF's) 1,000 node cluster with OpenStack and Red Hat’s OpenShift Container Platform, the enterprise-ready Kubernetes for developers. You'll also what's been happening in subsequent rounds of testing in Red Hat's own SCALE lab and the CNCF cluster and how we are working with the relevant open source communities including OpenStack, Kubernetes, and Ansible to continue to raise the bar for horizontal scaling of these platforms via community powered innovation.

KubeCon EU 2016: Heroku to KubernetesKubeAcademy

Arkena's video-on-demand platform is used as backend by major european channels (TF1 / beIN SPORTS / Elisa) to propose a non-linear experience to their customers. Previously hosted on Heroku, the number of our users is increasing constantly. In order to optimize resources we decided to move on a bare metal infrastructure powered by Kubernetes. We'll share thoughts, feedbacks and technical details about this successful transition. Sched Link:

Ceph and OpenStack - Feb 2014Ian Colle

Ceph is an open-source distributed storage system that provides object, block, and file storage in a single unified platform. It has become popular for OpenStack deployments due to its ability to provide scalable storage using commodity hardware. Ceph uses a pseudo-random placement algorithm called CRUSH to distribute data and replicas across its clusters to provide fault tolerance and load balancing.

How to Prepare for CKA ExamAlfie Chen

The document provides information and tips for preparing for the CKA (Certified Kubernetes Administrator) exam. It outlines what to know prior to taking the exam such as it being offered by CNCF, the exam format, curriculum covered, and required equipment. It recommends practicing Linux CLI, kubectl commands, getting familiar with Kubernetes documentation, examples and APIs. Suggested study methods include using Minikube, Kube-Ansible, online courses, and YouTube videos. Registering for the exam and free learning materials are also mentioned.

Build Low-Latency Applications in Rust on ScyllaDBScyllaDB

Ceph RBD Update - June 2021Ceph Community

The document summarizes new features and updates in Ceph's RBD block storage component. Key points include: improved live migration support using external data sources; built-in LUKS encryption; up to 3x better small I/O performance; a new persistent write-back cache; snapshot quiesce hooks; kernel messenger v2 and replica read support; and initial RBD support on Windows. Future work planned for Quincy includes encryption-formatted clones, cache improvements, usability enhancements, and expanded ecosystem integration.

K8s Pod Scheduling - Deep Dive. By Tsahi Duek.Cloud Native Day Tel Aviv

Kubernetes LoggingDenys Havrysh

This document discusses implementing and testing a self-managed logging and visualization solution for a Kubernetes cluster. It considers tools like FluentD, Elasticsearch, Kibana, Helm, and Kops for collecting, processing, and visualizing logs. A turn-key deployment approach using Helm is recommended to install all stack components from a single chart and leverage dependencies. Concerns about authentication, capacity planning, and security hardening are noted for future improvement.

Kubernetes debug like a proGianluca Arbezzano

Go fit perfectly inside containers, you can ship apps as tiny images on k8s, distributing them across the globe. Gianluca will show how InfluxData debugs containers running on Kubernetes to allow sysadmins and developers to troubleshoot and replicate issues using core dump, debuggers, and logs. Go applications are perfect to be run inside a container. You can build a single binary, a tiny Docker image and you can ship them on your Kubernetes cluster. A successful production environment requires stability and simplicity, it needs to be easy to troubleshoot and operators need to be able to get all the information developers will need to fix a bug. During this talk, Gianluca will share what influxData is doing to allow developers and system administrator to work together, understanding problems running live at scale on Kubernetes and how to escalate them down to Software Engineer using logs, delve, gdb, core dumps, and traces to replicate and fix issues.

Testing kubernetes and_open_shift_at_scale_20170209mffiedler

This document discusses testing Kubernetes and OpenShift at scale. It describes installing large clusters of 1000+ nodes, using scalability test tools like the Kubernetes performance test repo and OpenShift SVT repo to load clusters and generate traffic. Sample results show loading clusters with thousands of pods and projects, and peaks in master node resource usage when loading and deleting hundreds of pods simultaneously.

OpenShift, Docker, Kubernetes: The next generation of PaaSGraham Dumpleton

The document discusses how platforms like OpenShift, Docker, and Kubernetes have evolved from earlier PaaS technologies to provide next generation platforms that enable automated builds, deployments, orchestration, and security across containers. It notes how these platforms allow applications to be deployed across custom strategies rather than being constrained to a single way of working, and how they integrate with existing CI/CD tools. The document encourages gradually adopting new tooling as it makes sense and provides various resources for trying OpenShift.

More Related Content

What's hot (20)

Remote secured storageSalo Shp

Protecting the Galaxy - Multi-Region Disaster Recovery with OpenStack and CephSean Cohen

2021.06. Ceph Project UpdateCeph Community

NantOmicsCeph Community

Cephfs - Red Hat Openstack and Ceph meetup, Pune 28th november 2015bipin kunal

Friends don't let friends do dual writes: Outbox pattern with OpenShift Strea...Red Hat Developers

Manila, an update from Liberty, OpenStack Summit - TokyoSean Cohen

Why you’re going to fail running java on docker!Red Hat Developers

Supercomputing by API: Connecting Modern Web Apps to HPCOpenStack

Hyperconverged Cloud, Not just a toy anymore - Andrew Hatfield, Red HatOpenStack

OSDC 2018 | Ops hates containers. Why? by Martin AlfkeNETWAYS

Kubernetes and OpenStack at ScaleStephen Gordon

KubeCon EU 2016: Heroku to KubernetesKubeAcademy

Ceph and OpenStack - Feb 2014Ian Colle

How to Prepare for CKA ExamAlfie Chen

Build Low-Latency Applications in Rust on ScyllaDBScyllaDB

Ceph RBD Update - June 2021Ceph Community

K8s Pod Scheduling - Deep Dive. By Tsahi Duek.Cloud Native Day Tel Aviv

Kubernetes LoggingDenys Havrysh

Kubernetes debug like a proGianluca Arbezzano

Remote secured storageSalo Shp

Protecting the Galaxy - Multi-Region Disaster Recovery with OpenStack and CephSean Cohen

2021.06. Ceph Project UpdateCeph Community

NantOmicsCeph Community

Cephfs - Red Hat Openstack and Ceph meetup, Pune 28th november 2015bipin kunal

Friends don't let friends do dual writes: Outbox pattern with OpenShift Strea...Red Hat Developers

Manila, an update from Liberty, OpenStack Summit - TokyoSean Cohen

Why you’re going to fail running java on docker!Red Hat Developers

Supercomputing by API: Connecting Modern Web Apps to HPCOpenStack

Hyperconverged Cloud, Not just a toy anymore - Andrew Hatfield, Red HatOpenStack

OSDC 2018 | Ops hates containers. Why? by Martin AlfkeNETWAYS

Kubernetes and OpenStack at ScaleStephen Gordon

KubeCon EU 2016: Heroku to KubernetesKubeAcademy

Ceph and OpenStack - Feb 2014Ian Colle

How to Prepare for CKA ExamAlfie Chen

Build Low-Latency Applications in Rust on ScyllaDBScyllaDB

Ceph RBD Update - June 2021Ceph Community

K8s Pod Scheduling - Deep Dive. By Tsahi Duek.Cloud Native Day Tel Aviv

Kubernetes LoggingDenys Havrysh

Kubernetes debug like a proGianluca Arbezzano

Viewers also liked (20)

Testing kubernetes and_open_shift_at_scale_20170209mffiedler

OpenShift, Docker, Kubernetes: The next generation of PaaSGraham Dumpleton

DevFestMN 2017 - Learning Docker and Kubernetes with OpenshiftKeith Resar

OpenShift Enterprise 3.1 vs kubernetesSamuel Terburg

OpenShift is Red Hat's container application platform that provides a full-stack platform for deploying and managing containerized applications. It is based on Docker and Kubernetes and provides additional capabilities for self-service, automation, multi-language support, and enterprise features like authentication, centralized logging, and integration with Red Hat's JBoss middleware. OpenShift handles building, deploying, and scaling applications in a clustered environment with capabilities for continuous integration/delivery, persistent storage, routing, and monitoring.

fabric8 ... and Docker, Kubernetes & OpenShiftroland.huss

Distributed Performance testing by funkloadAkhil Singh

Red hat storage objects, containers and Beyond!andreas kuncoro

Devid Casandra from Red Hat presented on different types of storage including file, object, and block storage. Red Hat offers Ceph and Gluster open source software defined storage solutions that provide scalable, self-managing storage for private clouds, containers, and other use cases. Recent improvements include multi-site replication, a new BlueStore backend for Ceph, and container-based deployment options. A unified management solution is also in development.

Why Software Defined Storage is Critical for Your IT Strategyandreas kuncoro

The document discusses how software-defined storage is critical for IT strategies as data centers evolve. It describes how development models, application architectures, deployment methods, and infrastructure like storage have changed over time. These changes include trends like virtualization, containers, hybrid cloud, and software-defined storage. The document then provides examples of Red Hat's storage portfolio and solutions to address different workload types and industry use cases.

禪心慧語3foonkok

Workshop-Build e deploy avançado com Openshift e Kubernetesjuniorjbn

OpenShift meetup BangaloreSuraj Deshmukh

Openshift/Kubernetes integration with Apache YARNverbal1714

Openshift presentationArmağan Ersöz

DevOps with OpenShift - Fabien Dupont - ManageIQ Design Summit 2016ManageIQ

This document discusses DevOps workflows using OpenShift and ManageIQ. It describes using GitLab for source code management, CI/CD, and collaboration. OpenShift is used as a platform for deploying and managing containerized applications. ManageIQ orchestrates provisioning of the DevOps tools including FreeIPA for authentication, GitLab, and OpenShift. The ecosystem is integrated through a CI/CD pipeline that builds, tests, reviews, and deploys code changes from a Git repository to OpenShift.

Developing microservices with wildfly swarm and deploying on openshiftandreas kuncoro

The document discusses developing microservices with WildFly Swarm and deploying them on OpenShift. It covers how WildFly Swarm allows Java EE components to be packaged independently as microservices. It also explains how OpenShift provides the prerequisites for managing microservices like automated deployment, service discovery, and containers. The key takeaways are that Java EE is still relevant through projects like WildFly Swarm, which enable microservices, and that OpenShift's PaaS capabilities complement a microservices architecture.

[Devconf.cz][2017] Understanding OpenShift Security Context ConstraintsAlessandro Arrichiello

The document discusses OpenShift security context constraints (SCCs) and how to configure them to allow running a WordPress container. It begins with an overview of SCCs and their purpose in OpenShift for controlling permissions for pods. It then describes issues running the WordPress container under the default "restricted" SCC due to permission errors. The document explores editing the "restricted" SCC and removing capabilities and user restrictions to address the errors. Alternatively, it notes the "anyuid" SCC can be used which is more permissive and standard for allowing the WordPress container to run successfully.

Ultimate DevOps - Jenkins Enterprise & Red Hat OpenShiftAndy Pemberton

This document discusses using OpenShift and CloudBees Jenkins Platform together for DevOps. OpenShift is a PaaS built on Docker and Kubernetes that allows deploying applications and services. Jenkins can be easily started and integrated with OpenShift to use it as an elastic runtime or deployment target. Jenkins Pipeline allows defining CI/CD pipelines as code. A live demo shows using OpenShift from a Jenkins Pipeline to build and deploy an application. Additional resources are provided to learn more about the OpenShift and CloudBees integration.

OpenShift In a Nutshell - Episode 04 - Infrastructure part IIBehnam Loghmani

OpenShift In a Nutshell - Episode 05 - Core Concepts Part IBehnam Loghmani

OpenShift In a Nutshell - Episode 03 - Infrastructure part IBehnam Loghmani

Testing kubernetes and_open_shift_at_scale_20170209mffiedler

OpenShift, Docker, Kubernetes: The next generation of PaaSGraham Dumpleton

DevFestMN 2017 - Learning Docker and Kubernetes with OpenshiftKeith Resar

OpenShift Enterprise 3.1 vs kubernetesSamuel Terburg

fabric8 ... and Docker, Kubernetes & OpenShiftroland.huss

Distributed Performance testing by funkloadAkhil Singh

Red hat storage objects, containers and Beyond!andreas kuncoro

Why Software Defined Storage is Critical for Your IT Strategyandreas kuncoro

禪心慧語3foonkok

Workshop-Build e deploy avançado com Openshift e Kubernetesjuniorjbn

OpenShift meetup BangaloreSuraj Deshmukh

Openshift/Kubernetes integration with Apache YARNverbal1714

Openshift presentationArmağan Ersöz

DevOps with OpenShift - Fabien Dupont - ManageIQ Design Summit 2016ManageIQ

Developing microservices with wildfly swarm and deploying on openshiftandreas kuncoro

[Devconf.cz][2017] Understanding OpenShift Security Context ConstraintsAlessandro Arrichiello

Ultimate DevOps - Jenkins Enterprise & Red Hat OpenShiftAndy Pemberton

OpenShift In a Nutshell - Episode 04 - Infrastructure part IIBehnam Loghmani

OpenShift In a Nutshell - Episode 05 - Core Concepts Part IBehnam Loghmani

OpenShift In a Nutshell - Episode 03 - Infrastructure part IBehnam Loghmani

Similar to KubeCon NA, Seattle, 2016: Performance and Scalability Tuning Kubernetes for OpenShift and Docker (20)

Achieving the Ultimate Performance with KVMDevOps.com

Building and managing a cloud is not an easy task. It needs solid knowledge, proper planning and extensive experience in selecting the proper components and putting them together. Many companies build new-age KVM clouds, only to find out that their applications & workloads do not perform well. Join this webinar to learn how to get the most out of your KVM cloud and how to optimize it for performance. Join this webinar and learn: Why performance matters and how to measure it properly? What are the main components of an efficient new-age cloud? How to select the right hardware? How to optimize CPU and memory for ultimate performance? Which network components work best? How to tune the storage layer for performance?

CETH for XDP [Linux Meetup Santa Clara | July 2016] IO Visor Project

This document discusses CETH (Common Ethernet Driver Framework), which aims to improve kernel networking performance for virtualization. CETH simplifies NIC drivers by consolidating common functions. It supports various NICs and accelerators. CETH features efficient memory and buffer management, flexible TX/RX scheduling, and a customizable metadata structure. It is being simplified to work with XDP for even higher performance network I/O processing in the kernel. Next steps include further optimizations and measuring performance gains when using CETH with XDP and virtualized environments.

Achieving the Ultimate Performance with KVMdata://disrupted®

Many companies build new-age KVM clouds, only to find out that their applications & workloads do not perform well. In this talk we’ll show you how to get the most out of your KVM cloud and how to optimize it for performance: You’ll understand why performance matters and how to measure it properly. We’ll teach you how to optimize CPU and memory for ultimate performance and how to tune the storage layer for performance. You’ll find out what are the main components of an efficient new-age cloud and which network components work best. In addition, you’ll learn how to select the right hardware to achieve unmatched performance for your new-age cloud and applications. Venko Moyankov is an experienced system administrator and solutions architect at StorPool storage. He has experience with managing large virtualizations, working in telcos, designing and supporting the infrastructure of large enterprises. In the last year, his focus has been in helping companies globally to build the best storage solution according to their needs and projects.

OpenStack High AvailabilityJakub Pavlik

OpenStack HAtcp cloud

Jakub Pavlik discusses high availability versus disaster recovery in OpenStack clouds. He describes four types of high availability in OpenStack: physical infrastructure, OpenStack control services, virtual machines, and applications. For each type, he outlines concepts like active/passive and active/active configurations, specific technologies used like Pacemaker, Corosync, HAProxy, and MySQL Galera, and considerations for shared and non-shared storage. Finally, he provides examples of high availability architectures and methods used by different OpenStack vendors.

Private Cloud with Open Stack, DockerDavinder Kohli

NAVER Ceph Storage on ssd for ContainerJangseon Ryu

KubernetesLinjith Kunnon

This document provides an overview of container orchestration with Kubernetes. It begins with recapping container and Docker concepts like namespaces, cgroups, and union filesystems. It then introduces Kubernetes architecture including components like kube-apiserver, kubelet and kube-proxy. Common Kubernetes objects like pods, services, replica sets and deployments are described. The document also covers Kubernetes networking with options like NodePort, LoadBalancer and Ingress. Additional topics include service discovery, logging/monitoring and persistent storage.

Introduction to HPC & Supercomputing in AITyrone Systems

Ceph Day Seoul - AFCeph: SKT Scale Out Storage Ceph Ceph Community

Ceph Day SF 2015 - Deploying flash storage for Ceph without compromising perf...Ceph Community

OpenStack Best Practices and Considerations - terasky tech dayArthur Berezin

Azure Event Hubs - Behind the Scenes With Kasun Indrasiri | Current 2022HostedbyConfluent

Azure Event Hubs - Behind the Scenes With Kasun Indrasiri | Current 2022 Azure Event Hubs is a hyperscale PaaS event stream broker with protocol support for HTTP, AMQP, and Apache Kafka RPC that accepts and forwards several trillion (!) events per day and is available in all global Azure regions. This session is a look behind the curtain where we dive deep into the architecture of Event Hubs and look at the Event Hubs cluster model, resource isolation, and storage strategies and also review some performance figures.

Ceph Community Talk on High-Performance Solid Sate Ceph Ceph Community

The document summarizes a presentation given by representatives from various companies on optimizing Ceph for high-performance solid state drives. It discusses testing a real workload on a Ceph cluster with 50 SSD nodes that achieved over 280,000 read and write IOPS. Areas for further optimization were identified, such as reducing latency spikes and improving single-threaded performance. Various companies then described their contributions to Ceph performance, such as Intel providing hardware for testing and Samsung discussing SSD interface improvements.

Best Practices for Virtualizing Apache HadoopHortonworks

Join this webinar to discuss best practices for designing and building a solid, robust and flexible Hadoop platform on an enterprise virtual infrastructure. Attendees will learn the flexibility and operational advantages of Virtual Machines such as fast provisioning, cloning, high levels of standardization, hybrid storage, vMotioning, increased stabilization of the entire software stack, High Availability and Fault Tolerance. This is a can`t miss presentation for anyone wanting to understand design, configuration and deployment of Hadoop in virtual infrastructures.

Accelerating Ceph with iWARP RDMA over Ethernet - Brien Porter, Haodong TangCeph Community

Ceph Day Amsterdam 2015 - Deploying flash storage for Ceph without compromisi...Ceph Community

Mellanox presented on optimizing Ceph performance over flash storage using high-performance interconnect solutions. Mellanox provides end-to-end Ethernet and InfiniBand solutions that can accelerate Ceph clusters today. Adding RDMA support to the Ceph messaging layer, as is being done in the XioMessenger project, will further optimize performance when using flash storage. Several customer deployments of Ceph powered storage solutions were highlighted that leverage Mellanox's 40GbE and InfiniBand networking.

OpenPOWER Acceleration of HPCC SystemsHPCC Systems

Open ebs 101LibbySchulze

OpenEBS is an open source container attached storage solution for Kubernetes that simplifies running stateful workloads. It provides containerized storage that is native to Kubernetes using features like CSI, dynamic provisioning of volumes, and integration with common DevOps tools. OpenEBS offers both local and replicated volume types to meet different use cases for availability, performance, and scalability. Developers can use OpenEBS volumes like any other Kubernetes storage by creating persistent volume claims in their applications.

OpenVZ Linux ContainersKirill Kolyshkin

The talk is about operating system virtualization technology known as OpenVZ. This is an effective way of partitioning a Linux machine into multiple isolated Linux containers. All containers are running on top of one single Linux kernel, which results in excellent density, performance and manageability. The talk gives an overall description of OpenVZ building blocks, such as namespaces, cgroups and various resource controllers. A few features, notably live migration and virtual swap, are described in greater details. Results of some performance measurements against VMware, Xen and KVM are given. Finally, we will provide a status update on merging bits and pieces of OpenVZ kernel to upstream Linux kernel, and share our plans for the future.

Achieving the Ultimate Performance with KVMDevOps.com

CETH for XDP [Linux Meetup Santa Clara | July 2016] IO Visor Project

Achieving the Ultimate Performance with KVMdata://disrupted®

OpenStack High AvailabilityJakub Pavlik

OpenStack HAtcp cloud

Private Cloud with Open Stack, DockerDavinder Kohli

NAVER Ceph Storage on ssd for ContainerJangseon Ryu

KubernetesLinjith Kunnon

Introduction to HPC & Supercomputing in AITyrone Systems

Ceph Day Seoul - AFCeph: SKT Scale Out Storage Ceph Ceph Community

Ceph Day SF 2015 - Deploying flash storage for Ceph without compromising perf...Ceph Community

OpenStack Best Practices and Considerations - terasky tech dayArthur Berezin

Azure Event Hubs - Behind the Scenes With Kasun Indrasiri | Current 2022HostedbyConfluent

Ceph Community Talk on High-Performance Solid Sate Ceph Ceph Community

Best Practices for Virtualizing Apache HadoopHortonworks

Accelerating Ceph with iWARP RDMA over Ethernet - Brien Porter, Haodong TangCeph Community

Ceph Day Amsterdam 2015 - Deploying flash storage for Ceph without compromisi...Ceph Community

OpenPOWER Acceleration of HPCC SystemsHPCC Systems

Open ebs 101LibbySchulze

OpenVZ Linux ContainersKirill Kolyshkin

More from Jeremy Eder (7)

NVIDIA GTC 2019: Red Hat and the NVIDIA DGX: Tried, Tested, TrustedJeremy Eder

Red Hat and NVIDIA collaborated to bring together two of the technology industry's most popular products: Red Hat Enterprise Linux 7 and the NVIDIA DGX system. This talk will cover how the combination of RHELs rock-solid stability with the incredible DGX hardware can deliver tremendous value to enterprise data scientists. We will also show how to leverage NVIDIA GPU Cloud container images with Kubernetes and RHEL to reap maximum benefits from this incredible hardware.

Best practices for optimizing Red Hat platforms for large scale datacenter de...Jeremy Eder

This presentation is from NVIDIA GTC DC on Oct 23, 2018: https://youtu.be/z5gEUL6dJRI Corresponding Press Release: https://www.redhat.com/en/about/press-releases/red-hat-nvidia-align-open-source-solutions-fuel-emerging-workloads Blog: https://www.redhat.com/en/blog/red-hat-and-nvidia-positioning-red-hat-enterprise-linux-and-openshift-primary-platforms-artificial-intelligence-and-other-gpu-accelerated-workloads Demo Video: https://www.youtube.com/watch?v=9iVYjA_WJgU

Red Hat Summit 2018 5 New High Performance Features in OpenShiftJeremy Eder

This document introduces 5 new high-performance features in Red Hat OpenShift Container Platform to support critical, latency-sensitive workloads. It describes CPU pinning, huge pages, device plugins for GPUs and other hardware, extended resources, and sysctl support. Demo sections show how these features allow workloads to consume exclusive CPUs, huge pages, GPUs, and configure kernel parameters in OpenShift pods. The roadmap discusses expanding support for NUMA, co-located device scheduling, and the Kubernetes resource API.

NVIDIA GTC 2018: Spectre/Meltdown Impact on High Performance WorkloadsJeremy Eder

This document summarizes a presentation given by Jeremy Eder from Red Hat Performance Engineering about the impact of the Spectre and Meltdown vulnerabilities on high performance workloads. It discusses performance data showing the impact on tasks like TensorFlow training on GPUs. It also provides suggestions for managing the performance impact, such as enabling transparent huge pages and PCID, and disabling specific kernel patches if needed. A list of additional reference links is also included.

NVIDIA GTC 2018: Enabling GPU-as-a-Service Providers with Red Hat OpenShiftJeremy Eder

Triangle Kubernetes Meetup - Performance Sensitive Apps in OpenShiftJeremy Eder

Jeremy Eder documented an all-in-one Kubernetes installation on an HPE Apollo 6500 server with 8 NVIDIA Tesla V100 GPUs. The installation included RHEL7, Kubernetes 1.8, CUDA 9, and an NVIDIA GPU device plugin to enable scheduling of pods that request GPU resources. Benchmark tests were run on the cluster that utilized all 8 GPUs and set new performance records for a prominent risk analytics benchmark.

KubeCon 2017 - Kubernetes SIG Scheduling and Resource Management Working Grou...Jeremy Eder

This document outlines the agenda and discussion topics for the SIG Schedule + Resource Management Working Group Deep Dive meeting on December 6th. The meeting will cover graduating features to general availability, the resource API design proposal, device plugins, and dynamic resource binding. It will also include a group discussion on areas of overlap between SIGs, two-level scheduling, common pain points in resource management, and testing priority and preemption features.

NVIDIA GTC 2019: Red Hat and the NVIDIA DGX: Tried, Tested, TrustedJeremy Eder

Best practices for optimizing Red Hat platforms for large scale datacenter de...Jeremy Eder

Red Hat Summit 2018 5 New High Performance Features in OpenShiftJeremy Eder

NVIDIA GTC 2018: Spectre/Meltdown Impact on High Performance WorkloadsJeremy Eder

NVIDIA GTC 2018: Enabling GPU-as-a-Service Providers with Red Hat OpenShiftJeremy Eder

Triangle Kubernetes Meetup - Performance Sensitive Apps in OpenShiftJeremy Eder

KubeCon 2017 - Kubernetes SIG Scheduling and Resource Management Working Grou...Jeremy Eder

Recently uploaded (20)

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

"Rebranding for Growth", Anna VelykoivanenkoFwdays

"PHP and MySQL CRUD Operations for Student Management System"Jainul Musani

Procurement Insights Cost To Value Guide.pptxJon Hansen

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Build Your Own Copilot & Agents For DevsBrian McKeiver

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

tecnologias de las primeras civilizaciones.pdffjgm517

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Cyber Awareness overview for 2025 month of securityriccardosl1

TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc

Most consumers believe they’re making informed decisions about their personal data—adjusting privacy settings, blocking trackers, and opting out where they can. However, our new research reveals that while awareness is high, taking meaningful action is still lacking. On the corporate side, many organizations report strong policies for managing third-party data and consumer consent yet fall short when it comes to consistency, accountability and transparency. This session will explore the research findings from TrustArc’s Privacy Pulse Survey, examining consumer attitudes toward personal data collection and practical suggestions for corporate practices around purchasing third-party data. Attendees will learn: - Consumer awareness around data brokers and what consumers are doing to limit data collection - How businesses assess third-party vendors and their consent management operations - Where business preparedness needs improvement - What these trends mean for the future of privacy governance and public trust This discussion is essential for privacy, risk, and compliance professionals who want to ground their strategies in current data and prepare for what’s next in the privacy landscape.

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Drupalcamp Finland – Measuring Front-end Energy ConsumptionExove

Network Security. Different aspects of Network Security.gregtap1

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Talk at the final event of Data Fusion Dynamics: A Collaborative UK-Saudi Initiative in Cybersecurity and Artificial Intelligence funded by the British Council UK-Saudi Challenge Fund 2024, Cardiff Metropolitan University, 29th April 2025 https://alandix.com/academic/talks/CMet2025-AI-Changes-Everything/ Is AI just another technology, or does it fundamentally change the way we live and think? Every technology has a direct impact with micro-ethical consequences, some good, some bad. However more profound are the ways in which some technologies reshape the very fabric of society with macro-ethical impacts. The invention of the stirrup revolutionised mounted combat, but as a side effect gave rise to the feudal system, which still shapes politics today. The internal combustion engine offers personal freedom and creates pollution, but has also transformed the nature of urban planning and international trade. When we look at AI the micro-ethical issues, such as bias, are most obvious, but the macro-ethical challenges may be greater. At a micro-ethical level AI has the potential to deepen social, ethnic and gender bias, issues I have warned about since the early 1990s! It is also being used increasingly on the battlefield. However, it also offers amazing opportunities in health and educations, as the recent Nobel prizes for the developers of AlphaFold illustrate. More radically, the need to encode ethics acts as a mirror to surface essential ethical problems and conflicts. At the macro-ethical level, by the early 2000s digital technology had already begun to undermine sovereignty (e.g. gambling), market economics (through network effects and emergent monopolies), and the very meaning of money. Modern AI is the child of big data, big computation and ultimately big business, intensifying the inherent tendency of digital technology to concentrate power. AI is already unravelling the fundamentals of the social, political and economic world around us, but this is a world that needs radical reimagining to overcome the global environmental and human challenges that confront us. Our challenge is whether to let the threads fall as they may, or to use them to weave a better future.

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

This is a Quick Research Guide (QRG). QRGs include the following: - A brief, high-level overview of the QRG topic. - A milestone timeline for the QRG topic. - Links to various free online resource materials to provide a deeper dive into the QRG topic. - Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic. QRGs planned for the series: - Artificial Intelligence QRG - Quantum Computing QRG - Big Data Analytics QRG - Spacecraft Guidance, Navigation & Control QRG (coming 2026) - UK Home Computing & The Birth of ARM QRG (coming 2027) Any questions or comments? - Please contact Arthur Morgan at [email protected]. 100% human made.

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark? At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍 Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀

Buckeye Dreamin 2024: Assessing and Resolving Technical DebtLynda Kane

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

"Rebranding for Growth", Anna VelykoivanenkoFwdays

"PHP and MySQL CRUD Operations for Student Management System"Jainul Musani

Procurement Insights Cost To Value Guide.pptxJon Hansen

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Build Your Own Copilot & Agents For DevsBrian McKeiver

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

tecnologias de las primeras civilizaciones.pdffjgm517

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Cyber Awareness overview for 2025 month of securityriccardosl1

TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Drupalcamp Finland – Measuring Front-end Energy ConsumptionExove

Network Security. Different aspects of Network Security.gregtap1

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Buckeye Dreamin 2024: Assessing and Resolving Technical DebtLynda Kane

KubeCon NA, Seattle, 2016: Performance and Scalability Tuning Kubernetes for OpenShift and Docker

2. ● ● ●

3. http://j.mp/ose-perf-scale

7. Attribute Build Farm CPU Intensive High Memory Intensive High Disk I/O Latency Low Disk I/O Throughput High Network Latency Low Network Throughput High Security Low Uptime (Live Migration) N/A Deployment Speed High Alternative OS N/A Icon Meaning Mature and/or No Perf Concerns Immature and/or Limited Perf Concerns Mixed Concerns Not Applicable

10. CONTAINER DISCOVERY VIA REGISTRY ORCHESTRATION WITH KUBERNETES Red Hat works with the open source community to drive standards for containerization. ISOLATION WITH LINUX CONTAINERS CONTAINER FORMAT WITH DOCKER

11. Atomic Host - a container-optimized, minimal footprint OS powered by Red Hat Enterprise Linux Telemetry - logging and metrics for pods/containers, services and underlying infrastructure to make informed decisions Runtime and Packaging Format - standardized container packaging format and runtime, powered by Docker (and OCI) Automation and host configuration management via Cockpit to dynamically provision and configure container host clusters Orchestration - for complex multi-container services, powered by Kubernetes Networking - scalable, multi-host container networking, powered by Open vSwitch, that runs anywhere Red Hat Enterprise Linux runs Cluster Services - Scheduling for services across a container host cluster, powered by Kubernetes Storage, with persistent storage plugins to enable running of stateful services in containers Atomic Registry - integrated storage and management for sharing container images Security to prevent tenants from compromising other occupants

13. 1. 2. 3.

14. ● 2x Intel E5-2680v3 12-core ● 256GB RAM ● 2x Intel S3610 400GB SSD ● 1x Intel P3700 800GB NVMe PCIe SSD ● 1x QP Intel X710 ● ● ● ● ●

15. ● ● ● ●

16. ● ● ● ● ● ● ● ●

17. ● ● ● ● ● ● ● ● ●

18. ClusterLoader: projects: - num: 1000 basename: nginx-explorer tuning: default templates: - num: 10 file: cluster-loader/nginx.yaml - num: 20 file: cluster-loader/explorer-pod.yaml

21. Kubernetes Object Quantity Nodes 1,000 Namespaces (projects) 13,000 Pods 52,000 Build Configs 39,000 Templates 78,000 Image Streams 13,000 Deployment Configs and Services 39,000 (incl. 13,000 Replication Controllers) Secrets 260,000 Routes 39,000

KubeCon NA, Seattle, 2016: Performance and Scalability Tuning Kubernetes for OpenShift and Docker

Recommended

More Related Content

What's hot (20)

Viewers also liked (20)

Similar to KubeCon NA, Seattle, 2016: Performance and Scalability Tuning Kubernetes for OpenShift and Docker (20)

More from Jeremy Eder (7)

Recently uploaded (20)

KubeCon NA, Seattle, 2016: Performance and Scalability Tuning Kubernetes for OpenShift and Docker