Openshift/Kubernetes integration with Apache YARN

Feb 22, 2017Download as PPTX, PDF1 like898 views

Openshift/Kubernetes integration with Apache YARN Shows how YARN allows Big Data/Hadoop and other workloads to run side by side on same cluster

Page1 © Hortonworks Inc. 2014
OpenShift scheduling docker
containers in YARN via Kubernetes

Page2 © Hortonworks Inc. 2014
Static website Web frontendUser DB Queue Analytics DB
Development VM
QA server Public Cloud Contributor’
s laptop
Docker: a shipping container system for codeMultiplicityofStacks
Multiplicityof
hardware
environments
Production
Cluster
Customer
Data Center
Doservicesandapps
interact
appropriately?
CanImigrate
smoothlyandquickly
…that can be manipulated using
standard operations and run
consistently on virtually any
hardware platform
An engine that enables
any payload to be
encapsulated as a
lightweight, portable,
self-sufficient
container…

Page3 © Hortonworks Inc. 2014
Why are Docker containers lightweight?
HDP 2.1
Hortonworks Data Platform
I/O performance comparable to Bare Metal

Page4 © Hortonworks Inc. 2014
Kubernetes – container orchestrator
• Service for container cluster management
• Allows deploying and managing applications running
on multiple hosts using docker
• Open sourced by Google
• Supports GCE, CoreOS, Azure, vSphere
• Used to manage Docker containers as a default
implementation
• Master – maintain state of Kubernetes Server runtime
• Scheduler, API server, registries, storage
• Minions – represent the host were containers created
• Kubelet – manage pod and container lifecycle

Page5 © Hortonworks Inc. 2014
OpenShift
• Red Hat’s platform as a service for
applications in the cloud that supports
both public and private cloud
• Provides high level abstraction for applications on top
of containers allowing easy scaling, service discovery,
and deployment
• Enable Docker image authors to easily deliver
reusable application components, including highly
available databases, monitoring and log aggregation
tools, service discovery platforms, and prepackaged
web applications
• Allow developers to deeply customize their runtime
environments while preserving operational support at
scale for those applications

Page6 © Hortonworks Inc. 2014
6
Kubernetes/YARN Integration
YARN Node Manager
YARN Node Manager
Kubernetes
AppMaster

Page7 © Hortonworks Inc. 2014
Demo: OpenShift scheduling docker container in YARN
Running in docker

Page8 © Hortonworks Inc. 2014
Demo: 1. Launch Docker container on YARN via OpenShift
#openshift kube create pods –c demo.json
#cat demo.json

Page9 © Hortonworks Inc. 2014
Demo: 2. Enter into container and confirm web server started
#openshift kube create pods –c demo.json

Page10 © Hortonworks Inc. 2014
Demo: 3. Webapp on Openshift interacting with Hadoop

Page11 © Hortonworks Inc. 2014
Demo: 4. Launch other workloads on YARN
YARN allows Big Data and other workloads to run side by side on same cluster

Page12 © Hortonworks Inc. 2014
Questions?

From 2013-04-14 OpenShift Origin Community Day in Portland, Oregon Presenter: (William) Bill DeCoste (Principal Software Engineer for OpenShift) will introduce Red Hat's PaaS. He'll describe the several flavors of OpenShift ranging from the upstream community project Origin, the EC2-based online offering at http://openshift.redhat.com, to the corresponding commercial offering, OpenShift Enterprise. OpenShift Origin and Online will be demonstrated.

Building Domain-specific PaaS with OpenShift Origin: The TRESOR Healthcare P...OpenShift Origin

Building Domain-specific PaaS with OpenShift Origin Presenter: Alexander Grzesik, Softwarearchitekt, Medisite.de Alexander will discuss customizing OpenShift Origin for the Healthcare industry to meet with specific to German government compliance regulations for cloud security as part of the German Federal Ministry of Economics and Technology's Trusted Cloud initiative also know as TRESOR - Trusted Ecosystem for Standardized and Open cloud-based Resources.

Welcome to the @OpenShift Origin Community by Diane Mueller @pythondj @redhatOpenShift Origin

OpenShift Meetup 8th july 2019 at ConSol - OpenShift v4Robert Bohne

Red Hat OpenShift 4 provides a cloud-like platform for containerized applications that can run on hybrid and multi-cloud infrastructures. It offers full-stack automation for simplified cluster installation and lifecycle management along with over-the-air updates. OpenShift 4 supports deployment on both infrastructure provisioned and managed by Red Hat as well as customer-managed infrastructure. It leverages containers, microservices, and Kubernetes concepts to empower developers to build, deploy and manage applications.

Pydata 2020 containers meetup Walid Shaari

- Docker started as an internal project at dotcloud and was later open sourced in 2013. It allows for standardized packaging of software and isolates applications from each other while sharing the same OS kernel. - Containers provide benefits over traditional virtual machines by providing an application-level rather than infrastructure-level construct, resulting in better performance and efficiency. - Kubernetes is an open source container orchestration platform originally developed by Google that provides self-healing and automated scaling of containerized applications. It abstracts away underlying infrastructure to provide a uniform interface for workloads.

OpenShift In a Nutshell - Episode 02 - ArchitectureBehnam Loghmani

Future of Microservices - Jakub HadvigWEBtlak

OpenStack Summit Tokyo 2015: Scale or Fail: Containers on OpenStack with Open...Diane Mueller

OPENSHIFT CONTAINER PLATFORM CI/CD Build & DeployNatale Vinto

PaaS Lessons: Cisco IT Deploys OpenShift to Meet Developer DemandCisco IT

Cisco IT added OpenShift by Red Hat to its technology mix to rapidly expose development staff to a rich set of web-scale application frameworks and runtimes. Deploying Platform-as-a-Service (PaaS) architectures, like OpenShift, bring with it: - A Focus on the Developer Experience - Container Technology - Network Security and User Isolation - Acceleration of DevOps Models without Negatively Impacting Business In this session, Cisco and Red Hat will take you through: - The problems Cisco set out to solve with PaaS. - How OpenShift aligned with their needs. - Key lessons learned during the process. Business & IT Strategy Alignment: This track targets the juncture of business and IT considerations necessary to create competitive advantage. Example topics include: new architecture deployments, competitive differentiators, long-term and hidden costs, and security. Attendees will learn how to align architecture and technology decisions with their specific business needs and how and when IT departments can provide competitive advantage.

Reproducible development to live applications with Red Hat CDK and Red Hat Op...Lalatendu Mohanty

Puzzle ITC Talk @Docker CH meetup CI CD_with_Openshift_0.2Amrita Prasad

This document discusses continuous delivery using OpenShift. It begins with an overview of OpenShift v3, including that it is a container platform as a service based on Docker and Kubernetes. It then covers key concepts in continuous integration and continuous delivery like automated database migrations and rolling updates. Finally, it provides an example of setting up a continuous integration/continuous delivery pipeline in OpenShift using Jenkins, including building and deploying a Java/Maven application through various stages.

Exploring Kubeflow on Kubernetes for AI/ML | DevNation Tech TalkRed Hat Developers

The Kubeflow project is dedicated to making deployments of machine learning (ML) workflows on Kubernetes simple, portable, and scalable by leveraging best-of-breed open source projects. These include Jupyter Notebooks, TensorFlow, and Pytorch for Training; Seldon and KFServing for Serving; and Kubeflow Pipelines. These are all wrapped up neatly in an easy-to-use portal so developers and data scientists can easily collaborate and deliver production-ready AI/ML workloads.

RPM Factory for RDOFrédéric Lepied

Docker in Production, die MobiliarPhilipp Grossenbacher

The document summarizes the Mobiliar insurance company's project to implement Docker in production to enable more agile software releases. It discusses their current application stack, the approach taken in the "PoC Agiler Release" project to create a deployment pipeline using Docker and Kubernetes, and some of the challenges encountered. A demo is then provided of using the new pipeline to deploy a brand refresh. Next steps discussed include improving monitoring, using templates in Git, enabling self-service, and evaluating open source alternatives.

Managing OpenShift From Installation and BeyondAndrew Block

Slides from the hands on lab at Red Hat Summit 2017. Configuring distributed systems can be difficult. Fortunately, automation tools such as Ansible are available to help manage even the most complex environments. This lab allowed attendees to take the reigns of their own cluster and experience firsthand how Ansible can be used to install, configure, and maintain OpenShift to support mission-critical systems. Once the installation of Red Hat OpenShift is complete, attendees learned how to diagnose, troubleshoot, and resolve common platform issues. Managing the platform doesn't stop once the installation is complete. Ansible can be used to simplify ongoing maintenance and to make worry-free platform upgrades, all facilitated in an automated fashion. Finally, the use of centralized management systems will be introduced into the environment in order to demonstrate its importance and to provide a streamlined experience for both platform maintainers and users.

[D2 COMMUNITY] Open Container Seoul Meetup - Kubernetes를 이용한 서비스 구축과 openshiftNAVER D2

Junho Lee is a Solutions Architect who has worked at Rockplace Inc. since 2014. The document compares Kubernetes (k8s), OpenShift, and Google Kubernetes Engine (GKE). k8s is an open-source container cluster manager originally designed by Google. OpenShift is Red Hat's container application platform based on k8s. GKE provides k8s clusters on Google Cloud Platform. Both OpenShift and GKE add services on top of k8s like app stores, logging, monitoring and technical support. The document outlines the key components, architectures and capabilities of each platform.

PuppetConf 2016: Using Puppet with Kubernetes and OpenShift – Diane Mueller, ...Puppet

11th Docker Switzerland User Group MeetupPhilipp Grossenbacher

This document discusses how Mobiliar built a "speedboat harbor" using Docker to rapidly develop and deploy a new e-bike sharing project called smide. Docker was used to containerize the application and deploy it separately from Mobiliar's main systems. Key challenges included separate monitoring, logging, and deployment from Mobiliar's normal processes. Mobiliar's existing Kubernetes cluster was extended to separately deploy the smide containers and isolate them from other applications for increased agility during development.

Pycon9 - Paas per tutti i gusti con Dokku and KubernetesClaudio Mignanti

DevFestMN 2017 - Learning Docker and Kubernetes with OpenshiftKeith Resar

Openstack benelux 2015Microsoft

This document summarizes a presentation about installation, upgrades, and migrations of OpenStack clouds in the enterprise. It discusses definitions of upgrades and updates, challenges with OpenStack deployments, and introduces the Cloud Director tool for deploying and managing OpenStack clouds on Red Hat Enterprise Linux in a simplified manner. It provides examples of using Cloud Director to deploy OpenStack infrastructure and manage the life cycle of OpenStack clouds.

Open shift 2.x and MongoDBplarsen67

This document discusses Red Hat OpenShift Platform as a Service (PaaS) and its architecture. OpenShift PaaS provides an automated platform for deploying and scaling applications. It utilizes Red Hat Enterprise Linux on computing nodes managed by a central broker. Developers can use OpenShift to easily deploy applications without having to manage the underlying infrastructure through its self-service interface. The document then demonstrates deploying a sample PHP and MongoDB application on OpenShift.

Meetup - Automate your project lifecycle using MuleSoft and Azure DevOpsRenato de Oliveira

This document discusses how to automate the project lifecycle for MuleSoft applications using MuleSoft and Azure DevOps. It covers setting up continuous integration (CI) and continuous delivery (CD) pipelines for building, testing, and deploying MuleSoft applications to different environments. The document provides an overview of the tools and processes used, including configuring notifications, auditing deployment logs, and securely managing application properties and secrets.

Red Hat OpenShift App Dev meetup - Operator SDK Dmitry Kartsev

OpenShift As A DevOps PlatformLalatendu Mohanty

OpenShift is a DevOps platform that provides a container application platform for deploying and managing containerized applications and microservices. It uses Kubernetes for orchestration and Docker containers. OpenShift provides features for the complete application lifecycle including continuous integration/delivery (CI/CD), automated image builds, deployments, networking, authentication, and integration with external services and registries. Developers can create and deploy applications from source code, templates, or Docker images to OpenShift without needing deep knowledge of Docker or Kubernetes.

Dev Ops and PaaS - Accelerate Application Delivery with OpenShiftFrederik Bijlsma

The document discusses DevOps and Platform as a Service (PaaS) provided by Red Hat OpenShift. It describes how DevOps emphasizes communication and collaboration between software developers and IT professionals to accelerate application delivery. OpenShift is positioned as a PaaS that can help implement DevOps principles through features like self-service access, automated provisioning, continuous integration/delivery, and standardized environments. These capabilities are said to provide benefits like accelerated application delivery and improved developer productivity.

Workshop-Build e deploy avançado com Openshift e Kubernetesjuniorjbn

Openshift presentationArmağan Ersöz

More Related Content

What's hot (20)

OpenStack Summit Tokyo 2015: Scale or Fail: Containers on OpenStack with Open...Diane Mueller

OPENSHIFT CONTAINER PLATFORM CI/CD Build & DeployNatale Vinto

PaaS Lessons: Cisco IT Deploys OpenShift to Meet Developer DemandCisco IT

Reproducible development to live applications with Red Hat CDK and Red Hat Op...Lalatendu Mohanty

Puzzle ITC Talk @Docker CH meetup CI CD_with_Openshift_0.2Amrita Prasad

Exploring Kubeflow on Kubernetes for AI/ML | DevNation Tech TalkRed Hat Developers

RPM Factory for RDOFrédéric Lepied

Docker in Production, die MobiliarPhilipp Grossenbacher

Managing OpenShift From Installation and BeyondAndrew Block

[D2 COMMUNITY] Open Container Seoul Meetup - Kubernetes를 이용한 서비스 구축과 openshiftNAVER D2

PuppetConf 2016: Using Puppet with Kubernetes and OpenShift – Diane Mueller, ...Puppet

11th Docker Switzerland User Group MeetupPhilipp Grossenbacher

Pycon9 - Paas per tutti i gusti con Dokku and KubernetesClaudio Mignanti

DevFestMN 2017 - Learning Docker and Kubernetes with OpenshiftKeith Resar

Openstack benelux 2015Microsoft

Open shift 2.x and MongoDBplarsen67

Meetup - Automate your project lifecycle using MuleSoft and Azure DevOpsRenato de Oliveira

Red Hat OpenShift App Dev meetup - Operator SDK Dmitry Kartsev

OpenShift As A DevOps PlatformLalatendu Mohanty

Dev Ops and PaaS - Accelerate Application Delivery with OpenShiftFrederik Bijlsma

OpenStack Summit Tokyo 2015: Scale or Fail: Containers on OpenStack with Open...Diane Mueller

OPENSHIFT CONTAINER PLATFORM CI/CD Build & DeployNatale Vinto

PaaS Lessons: Cisco IT Deploys OpenShift to Meet Developer DemandCisco IT

Reproducible development to live applications with Red Hat CDK and Red Hat Op...Lalatendu Mohanty

Puzzle ITC Talk @Docker CH meetup CI CD_with_Openshift_0.2Amrita Prasad

Exploring Kubeflow on Kubernetes for AI/ML | DevNation Tech TalkRed Hat Developers

RPM Factory for RDOFrédéric Lepied

Docker in Production, die MobiliarPhilipp Grossenbacher

Managing OpenShift From Installation and BeyondAndrew Block

[D2 COMMUNITY] Open Container Seoul Meetup - Kubernetes를 이용한 서비스 구축과 openshiftNAVER D2

PuppetConf 2016: Using Puppet with Kubernetes and OpenShift – Diane Mueller, ...Puppet

11th Docker Switzerland User Group MeetupPhilipp Grossenbacher

Pycon9 - Paas per tutti i gusti con Dokku and KubernetesClaudio Mignanti

DevFestMN 2017 - Learning Docker and Kubernetes with OpenshiftKeith Resar

Openstack benelux 2015Microsoft

Open shift 2.x and MongoDBplarsen67

Meetup - Automate your project lifecycle using MuleSoft and Azure DevOpsRenato de Oliveira

Red Hat OpenShift App Dev meetup - Operator SDK Dmitry Kartsev

OpenShift As A DevOps PlatformLalatendu Mohanty

Dev Ops and PaaS - Accelerate Application Delivery with OpenShiftFrederik Bijlsma

Viewers also liked (20)

Workshop-Build e deploy avançado com Openshift e Kubernetesjuniorjbn

Openshift presentationArmağan Ersöz

Ultimate DevOps - Jenkins Enterprise & Red Hat OpenShiftAndy Pemberton

This document discusses using OpenShift and CloudBees Jenkins Platform together for DevOps. OpenShift is a PaaS built on Docker and Kubernetes that allows deploying applications and services. Jenkins can be easily started and integrated with OpenShift to use it as an elastic runtime or deployment target. Jenkins Pipeline allows defining CI/CD pipelines as code. A live demo shows using OpenShift from a Jenkins Pipeline to build and deploy an application. Additional resources are provided to learn more about the OpenShift and CloudBees integration.

[Devconf.cz][2017] Understanding OpenShift Security Context ConstraintsAlessandro Arrichiello

The document discusses OpenShift security context constraints (SCCs) and how to configure them to allow running a WordPress container. It begins with an overview of SCCs and their purpose in OpenShift for controlling permissions for pods. It then describes issues running the WordPress container under the default "restricted" SCC due to permission errors. The document explores editing the "restricted" SCC and removing capabilities and user restrictions to address the errors. Alternatively, it notes the "anyuid" SCC can be used which is more permissive and standard for allowing the WordPress container to run successfully.

OpenShift In a Nutshell - Episode 04 - Infrastructure part IIBehnam Loghmani

OpenShift In a Nutshell - Episode 06 - Core Concepts Part IIBehnam Loghmani

Episode 06 of "OpenShift in a nutshell" presentations in Iran OpenStack community group This episode is about core concepts in OpenShift. Part 2 includes concepts of Users, Projects, Builds and Image streams At the end of presentation you can find a link that helps you to setup OpenShift in your local system ( this setup is not a enterprise setup and it's only for creating a small test environment ). I hope you will find it useful.

OpenShift In a Nutshell - Episode 05 - Core Concepts Part IBehnam Loghmani

OpenShift In a Nutshell - Episode 03 - Infrastructure part IBehnam Loghmani

Openshift Container Platform on AzureGlenn West

1) The document describes an Azure Resource Manager (ARM) template for deploying OpenShift Enterprise on Azure. It provisions masters, infra nodes, and worker nodes with load balancing and storage. 2) The ARM template automates the entire deployment process through nested templates for each resource and Bash scripts for configuration. It handles naming, load balancing, storage, networking, and more. 3) The goal is to create a production-ready reference architecture for OpenShift on Azure and automate the deployment process through the ARM template. Current work focuses on deployment, storage, authentication, and documentation. Future work includes additional features and integrations.

Understanding DevOps in simpler way with Continuous DeliverySwapnil Jain

DevOps with OpenShift - Fabien Dupont - ManageIQ Design Summit 2016ManageIQ

This document discusses DevOps workflows using OpenShift and ManageIQ. It describes using GitLab for source code management, CI/CD, and collaboration. OpenShift is used as a platform for deploying and managing containerized applications. ManageIQ orchestrates provisioning of the DevOps tools including FreeIPA for authentication, GitLab, and OpenShift. The ecosystem is integrated through a CI/CD pipeline that builds, tests, reviews, and deploys code changes from a Git repository to OpenShift.

Developing microservices with wildfly swarm and deploying on openshiftandreas kuncoro

The document discusses developing microservices with WildFly Swarm and deploying them on OpenShift. It covers how WildFly Swarm allows Java EE components to be packaged independently as microservices. It also explains how OpenShift provides the prerequisites for managing microservices like automated deployment, service discovery, and containers. The key takeaways are that Java EE is still relevant through projects like WildFly Swarm, which enable microservices, and that OpenShift's PaaS capabilities complement a microservices architecture.

Minishift (Run OpenShift locally)Praveen Kumar

KubeCon NA, Seattle, 2016: Performance and Scalability Tuning Kubernetes for...Jeremy Eder

earn tips and tricks on how to best configure and tune your container infrastructure for maximum performance and scale. The Performance Engineering Group at Red Hat is responsible for performance of the complete container portfolio, including Docker, RHEL Atomic, Kubernetes and OpenShift. We will share: - Latest Performance Features in OpenShift, Docker and RHEL Atomic, tips and tricks on how to best configure and tune your system for maximum performance and scale - Latest performance and scale test results, using RHEL Atomic, OpenvSwitch, Cockpit multi-server container management - DevOps, Agile approach to Performance Analysis of OpenShift, Kubernetes, Docker and RHEL Atomic - Test harness code and example scripts Audience The audience is anyone interested in deploying containers to run performance sensitive workloads, as well as architecting highly scalable distributed systems for hosting those workloads. This includes workloads that require NUMA awareness, direct hardware access and kernel-bypass I/O.

Microservices with JBoss EAP & OpenShiftbobmcwhirter

This document discusses microservices and how JBoss EAP and OpenShift can help implement them. It notes that microservices help define architecture, allow independent release cycles, and accelerate business velocity. Each microservice should do one thing well with well-defined inputs and outputs. This leads to loosely coupled implementations and locations. The document recommends that a bounded context, or microservice, should solve a problem that less than 8 people could handle. It provides examples of microservices for a conference application. JBoss EAP and WildFly Swarm can help implement microservices by wrapping servers around individual services while still providing capabilities like JAX-RS, CDI, JMS and more.

OpenShift In a Nutshell - Episode 01 - IntroductionBehnam Loghmani

OpenShift on OpenStack with KuryrAntoni Segura Puimedon

Simplifying and Securing your OpenShift Network with Project CalicoAndrew Randall

This document discusses Project Calico and how it can simplify and secure the network in OpenShift. It begins by acknowledging that virtual networking is now common but that current solutions do not scale well. It then discusses how Calico addresses this through a distributed architecture and fine-grained network policies. Calico implements a flat IP network without overlays for improved performance and simplifies troubleshooting. It can also enforce network policies by rendering them into ACL rules distributed to nodes. Calico has been deployed on thousands of clusters and integrates well with orchestrators like OpenShift.

Openshift: Build, deploy & manage open, standard containersJonh Wendell

OpenShift is a container platform for deploying and managing containerized applications. It uses Kubernetes for orchestration and Docker containers. OpenShift provides developers a way to build, deploy and manage applications throughout the lifecycle using containers and provides operations with stability, security and resource management tools. It supports choice of programming languages, continuous deployment and integration, and scaling of applications.

Automated Image Builds in OpenShift and KubernetesGraham Dumpleton

Workshop-Build e deploy avançado com Openshift e Kubernetesjuniorjbn

Openshift presentationArmağan Ersöz

Ultimate DevOps - Jenkins Enterprise & Red Hat OpenShiftAndy Pemberton

[Devconf.cz][2017] Understanding OpenShift Security Context ConstraintsAlessandro Arrichiello

OpenShift In a Nutshell - Episode 04 - Infrastructure part IIBehnam Loghmani

OpenShift In a Nutshell - Episode 06 - Core Concepts Part IIBehnam Loghmani

OpenShift In a Nutshell - Episode 05 - Core Concepts Part IBehnam Loghmani

OpenShift In a Nutshell - Episode 03 - Infrastructure part IBehnam Loghmani

Openshift Container Platform on AzureGlenn West

Understanding DevOps in simpler way with Continuous DeliverySwapnil Jain

DevOps with OpenShift - Fabien Dupont - ManageIQ Design Summit 2016ManageIQ

Developing microservices with wildfly swarm and deploying on openshiftandreas kuncoro

Minishift (Run OpenShift locally)Praveen Kumar

KubeCon NA, Seattle, 2016: Performance and Scalability Tuning Kubernetes for...Jeremy Eder

Microservices with JBoss EAP & OpenShiftbobmcwhirter

OpenShift In a Nutshell - Episode 01 - IntroductionBehnam Loghmani

OpenShift on OpenStack with KuryrAntoni Segura Puimedon

Simplifying and Securing your OpenShift Network with Project CalicoAndrew Randall

Openshift: Build, deploy & manage open, standard containersJonh Wendell

Automated Image Builds in OpenShift and KubernetesGraham Dumpleton

Similar to Openshift/Kubernetes integration with Apache YARN (20)

Docker and OpenStack Boston MeetupKamesh Pemmaraju

OpenStack, Containers, and Docker: The Future of Application Deployment Twenty years ago, developers built static applications on well-defined stacks that ran on proprietary, monolithic hardware. Developers today want freedom to build applications using their choice of services and stacks and, ideally, want to be able to run those applications on any available hardware. Of course, this raises questions about service interaction, the practicality of migrating applications across environments, and the challenges of managing unlimited combinations of services and hardware environment. By promoting an opensource approach to flexible and inter-operable infrastructure, OpenStack goes a long way towards achieving this vision of the future. This talk discusses the application and platform side of the equation, and the interplay between OpenStack, Container technology (e.g. LXC), and the opensource Docker.io project. Docker.io enables any application and its dependencies to be deployed as lightweight containers that run consistently virtually anywhere. The same containerized application that runs on a developer's laptop can run consistently on a bare metal server, an OpenStack cluster, a Rackspace cloud, a VM,etc. While providing isolation and compatibility, containers have significant size, performance, and deployment advantages over traditional VMs. Recently, the community created an integration between Docker and OpenStack Nova, opening up exciting possibilities for web scale application deployment, continuous integration and deployment, private PaaS, and hybrid cloud. This session will give an introduction to Docker and containers in the context of OpenStack, and will then demonstrate cross-environment deployment of applications.

Docker open stack bostondotCloud

This document discusses using Docker containers with OpenStack for application deployment. It begins with an introduction to Docker, describing its growth in usage and integration with various tools. Docker is presented as a solution to issues around deploying applications across different environments and hardware by providing lightweight, portable containers that package code and dependencies. The document demonstrates how Docker can be used with OpenStack through a new hypervisor that allows OpenStack to deploy and manage Linux containers, enabling control of Docker through the OpenStack dashboard. It outlines some benefits of Docker combined with OpenStack and the current state of the related OpenStack project.

OpenStack BostonDocker, Inc.

SS Introduction to DockerStephane Woillez

Docker provides a platform for building, shipping, and running distributed applications across environments using containers. It allows developers to quickly develop, deploy and scale applications. Docker DataCenter delivers Docker capabilities as a service and provides a unified control plane for both developers and IT operations to standardize, secure and manage containerized applications. It enables organizations to adopt modern practices like microservices, continuous integration/deployment and hybrid cloud through portable containers.

Docker and Microsoft - Windows Server 2016 Technical Deep DiveDocker, Inc.

This document summarizes a webinar about Docker and Windows Server 2016. It discusses how Docker is now supported on 98% of enterprise workloads, including Windows Server 2016, providing the same benefits of Docker on Linux to Windows developers and IT professionals. It outlines how Microsoft and Docker partnered to port Docker Engine to Windows, and how Docker images can now be built and run across Linux and Windows. It provides examples of using Docker with Windows Server 2016 for development/testing and migrating applications.

Docker OpenStack Cloud FoundryAnimesh Singh

Docker introNoelMc Grath

Docker is an open-source project that allows developers to package applications into lightweight, portable containers that can run on any Linux server. Containers isolate applications from one another and the underlying infrastructure, while still sharing operating system resources to improve efficiency. Docker eliminates inconsistencies between development and production environments by allowing applications to run identically in any computing environment, from a developer's laptop to the cloud. This portability and consistency accelerates the development lifecycle and improves deployment workflows for both developers and operations teams.

Docker Presentation at the OpenStack Austin Meetup | 2013-09-12dotCloud

Application Deployment on OpenstackDocker, Inc.

The document discusses using Docker containers with OpenStack to deploy applications. It begins with an introduction to Docker and its benefits. It then covers adding Docker support to the OpenStack Nova computing controller to deploy containers instead of virtual machines. The remainder demonstrates setting up DevStack to use Docker with OpenStack and shows examples of launching Docker containers through the OpenStack Horizon web interface.

A curtain-raiser to the container world Docker & KuberneteszekeLabs Technologies

Agenda 1. The changing landscape of IT Infrastructure 2. Containers - An introduction 3. Container management systems 4. Kubernetes 5. Containers and DevOps 6. Future of Infrastructure Mgmt About the talk In this talk, you will get a review of the components & the benefits of Container technologies - Docker & Kubernetes. The talk focuses on making the solution platform-independent. It gives an insight into Docker and Kubernetes for consistent and reliable Deployment. We talk about how the containers fit and improve your DevOps ecosystem and how to get started with containerization. Learn new deployment approach to effectively use your infrastructure resources to minimize the overall cost.

Intro to Docker at the 2016 Evans Developer relations conferenceMano Marks

Building large scale apps traditionally has traditionally meant building large monolithic apps to handle everything. In the new age of the cloud and on premise data centers, increasingly the world is looking to containers and microservices. This allows flexibility and agility. Individual teams can choose the tools they need and be assured they'll work in the environment they want. And it also has implications for how we do developer relations, making it easier to deploy samples without worrying about environment. This session will look at microservices and how they are changing both the enterprise, and our work in developer relations.

Dockerizing OpenStack for High AvailabilityDaniel Krook

This document discusses Dockerizing OpenStack high availability services. It begins by outlining existing challenges with OpenStack HA including complex configuration, scaling complexity, and lack of automation/visibility. It then discusses how Docker can help by allowing applications and dependencies to be packaged in lightweight containers, improving scaling, density, flexibility and reducing overhead. The document provides an example of running OpenStack services like Nova API in Docker containers for improved HA and manageability. It discusses sharing images in a private Docker registry and orchestrating container management.

DockerCon EU 2015 BarcelonaRoman Dembitsky

Docker Birthday #3 - Intro to Docker SlidesDocker, Inc.

Docker Birthday #3 Slides - OverviewChris Ciborowski

The document provides an agenda and information for Docker Birthday #3 event. The agenda includes an introduction to the Docker ecosystem, learning Docker with a birthday app training, a birthday app challenge, and socializing. The training involves building and deploying a simple voting app locally using Docker Toolbox to demonstrate Docker basics. Participants can then submit hacks or improvements to the app for prizes by the deadline. Mentors will be available to help beginners complete the training.

Docker for devErik Talboom

Kubernetes is all you needVishwas N

Containerization provides benefits like consistent environments, lightweight packages, and efficient resource utilization and isolation. Kubernetes is an open-source platform that provides tools to automate deployment, scaling, and management of containerized applications. It groups containerized applications into logical units called pods and uses labels to identify pods. It provides features like service discovery, load balancing, rolling updates, and self-healing capabilities. Kubernetes aims to provide a platform for automating deployment, scaling and operations of application containers across clusters of hosts.

Docker Online Training | Hyderabadnavyatejavisualpath

Kubernetes Online Training - Visualpath is the Leading and Best Software Online Docker Training institute in Ameerpet. Avail complete job-oriented Docker and Kubernetes Training Course by simply enrolling in our institute in Hyderabad. Call on - +91-9989971070. For more info: https://dockerandkubernetesonlinetraining.blogspot.com/ WhatsApp: https://www.whatsapp.com/catalog/919989971070/ Visit: https://www.visualpath.in/DevOps-docker-kubernetes-training.html

Docker Overview - Rise of the ContainersRyan Hodgin

Container on azureVishwas N

This document discusses containers and container orchestration on Azure. It begins with an introduction to containers and their advantages over virtual machines. It then covers building Dockerfiles, container commands, and hosting container registries and applications on Azure. Container orchestration with Kubernetes is discussed as a way to deploy and scale containerized applications on the cloud, providing capabilities like auto-scaling, self-healing, service discovery and load balancing. The document points to additional future content on using Azure Kubernetes Service.

Docker and OpenStack Boston MeetupKamesh Pemmaraju

Docker open stack bostondotCloud

OpenStack BostonDocker, Inc.

SS Introduction to DockerStephane Woillez

Docker and Microsoft - Windows Server 2016 Technical Deep DiveDocker, Inc.

Docker OpenStack Cloud FoundryAnimesh Singh

Docker introNoelMc Grath

Docker Presentation at the OpenStack Austin Meetup | 2013-09-12dotCloud

Application Deployment on OpenstackDocker, Inc.

A curtain-raiser to the container world Docker & KuberneteszekeLabs Technologies

Intro to Docker at the 2016 Evans Developer relations conferenceMano Marks

Dockerizing OpenStack for High AvailabilityDaniel Krook

DockerCon EU 2015 BarcelonaRoman Dembitsky

Docker Birthday #3 - Intro to Docker SlidesDocker, Inc.

Docker Birthday #3 Slides - OverviewChris Ciborowski

Docker for devErik Talboom

Kubernetes is all you needVishwas N

Docker Online Training | Hyderabadnavyatejavisualpath

Docker Overview - Rise of the ContainersRyan Hodgin

Container on azureVishwas N

Recently uploaded (20)

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

This is a Quick Research Guide (QRG). QRGs include the following: - A brief, high-level overview of the QRG topic. - A milestone timeline for the QRG topic. - Links to various free online resource materials to provide a deeper dive into the QRG topic. - Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic. QRGs planned for the series: - Artificial Intelligence QRG - Quantum Computing QRG - Big Data Analytics QRG - Spacecraft Guidance, Navigation & Control QRG (coming 2026) - UK Home Computing & The Birth of ARM QRG (coming 2027) Any questions or comments? - Please contact Arthur Morgan at [email protected]. 100% human made.

Network Security. Different aspects of Network Security.gregtap1

Automation Dreamin' 2022: Sharing Some Gratitude with Your UsersLynda Kane

Build Your Own Copilot & Agents For DevsBrian McKeiver

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots. 📕 Here's what you can expect: - Modeling: Build end-to-end processes using BPMN. - Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes. - Operating: Control process instances with rewind, replay, pause, and stop functions. - Monitoring: Use dashboards and embedded analytics for real-time insights into process instances. This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes. 👨‍🏫 Speaker: Andrei Vintila, Principal Product Manager @UiPath This session streamed live on April 29, 2025, 16:00 CET. Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.

Buckeye Dreamin 2024: Assessing and Resolving Technical DebtLynda Kane

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

"Rebranding for Growth", Anna VelykoivanenkoFwdays

Image processinglab image processing image processingRaghadHany

Buckeye Dreamin' 2023: De-fogging Debug LogsLynda Kane

How Can I use the AI Hype in my Business Context?Daniel Lehner

𝙄𝙨 𝘼𝙄 𝙟𝙪𝙨𝙩 𝙝𝙮𝙥𝙚? 𝙊𝙧 𝙞𝙨 𝙞𝙩 𝙩𝙝𝙚 𝙜𝙖𝙢𝙚 𝙘𝙝𝙖𝙣𝙜𝙚𝙧 𝙮𝙤𝙪𝙧 𝙗𝙪𝙨𝙞𝙣𝙚𝙨𝙨 𝙣𝙚𝙚𝙙𝙨? Everyone’s talking about AI but is anyone really using it to create real value? Most companies want to leverage AI. Few know 𝗵𝗼𝘄. ✅ What exactly should you ask to find real AI opportunities? ✅ Which AI techniques actually fit your business? ✅ Is your data even ready for AI? If you’re not sure, you’re not alone. This is a condensed version of the slides I presented at a Linkedin webinar for Tecnovy on 28.04.2025.

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Electronic_Mail_Attacks-1-35.pdf by xploitniftliyevhuseyn

AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB

I started my online journey with several hosting services before stumbling upon Ai EngineHost. At first, the idea of paying one fee and getting lifetime access seemed too good to pass up. The platform is built on reliable US-based servers, ensuring your projects run at high speeds and remain safe. Let me take you step by step through its benefits and features as I explain why this hosting solution is a perfect fit for digital entrepreneurs.

Hands On: Create a Lightning Aura Component with force:RecordDataLynda Kane

Datastucture-Unit 4-Linked List Presentation.pptxkaleeswaric3

What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat

The MCP (Model Context Protocol) is a framework designed to manage context and interaction within complex systems. This SlideShare presentation will provide a detailed overview of the MCP Model, its applications, and how it plays a crucial role in improving communication and decision-making in distributed systems. We will explore the key concepts behind the protocol, including the importance of context, data management, and how this model enhances system adaptability and responsiveness. Ideal for software developers, system architects, and IT professionals, this presentation will offer valuable insights into how the MCP Model can streamline workflows, improve efficiency, and create more intuitive systems for a wide range of use cases.

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

Network Security. Different aspects of Network Security.gregtap1

Automation Dreamin' 2022: Sharing Some Gratitude with Your UsersLynda Kane

Build Your Own Copilot & Agents For DevsBrian McKeiver

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

Buckeye Dreamin 2024: Assessing and Resolving Technical DebtLynda Kane

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

"Rebranding for Growth", Anna VelykoivanenkoFwdays

Image processinglab image processing image processingRaghadHany

Buckeye Dreamin' 2023: De-fogging Debug LogsLynda Kane

How Can I use the AI Hype in my Business Context?Daniel Lehner

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Electronic_Mail_Attacks-1-35.pdf by xploitniftliyevhuseyn

AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB

Hands On: Create a Lightning Aura Component with force:RecordDataLynda Kane

Datastucture-Unit 4-Linked List Presentation.pptxkaleeswaric3

What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat

Openshift/Kubernetes integration with Apache YARN

2. Page2 © Hortonworks Inc. 2014 Static website Web frontendUser DB Queue Analytics DB Development VM QA server Public Cloud Contributor’ s laptop Docker: a shipping container system for codeMultiplicityofStacks Multiplicityof hardware environments Production Cluster Customer Data Center Doservicesandapps interact appropriately? CanImigrate smoothlyandquickly …that can be manipulated using standard operations and run consistently on virtually any hardware platform An engine that enables any payload to be encapsulated as a lightweight, portable, self-sufficient container…

3. Page3 © Hortonworks Inc. 2014 Why are Docker containers lightweight? HDP 2.1 Hortonworks Data Platform I/O performance comparable to Bare Metal

4. Page4 © Hortonworks Inc. 2014 Kubernetes – container orchestrator • Service for container cluster management • Allows deploying and managing applications running on multiple hosts using docker • Open sourced by Google • Supports GCE, CoreOS, Azure, vSphere • Used to manage Docker containers as a default implementation • Master – maintain state of Kubernetes Server runtime • Scheduler, API server, registries, storage • Minions – represent the host were containers created • Kubelet – manage pod and container lifecycle

5. Page5 © Hortonworks Inc. 2014 OpenShift • Red Hat’s platform as a service for applications in the cloud that supports both public and private cloud • Provides high level abstraction for applications on top of containers allowing easy scaling, service discovery, and deployment • Enable Docker image authors to easily deliver reusable application components, including highly available databases, monitoring and log aggregation tools, service discovery platforms, and prepackaged web applications • Allow developers to deeply customize their runtime environments while preserving operational support at scale for those applications

8. Page8 © Hortonworks Inc. 2014 Demo: 1. Launch Docker container on YARN via OpenShift #openshift kube create pods –c demo.json #cat demo.json

9. Page9 © Hortonworks Inc. 2014 Demo: 2. Enter into container and confirm web server started #openshift kube create pods –c demo.json

11. Page11 © Hortonworks Inc. 2014 Demo: 4. Launch other workloads on YARN YARN allows Big Data and other workloads to run side by side on same cluster

Editor's Notes

#2: This lesson provides a high-level overview of Apache Hive.
#5: Doing a tech preview of Kafka ensures that we have the packaging mechanism in place and allows us to explore other things like Slider, Stack Definitions via Ambari, etc.
#13: This lesson provides a high-level overview of Apache Hive.

Openshift/Kubernetes integration with Apache YARN

Recommended

More Related Content

What's hot (20)

Viewers also liked (20)

Similar to Openshift/Kubernetes integration with Apache YARN (20)

Recently uploaded (20)

Openshift/Kubernetes integration with Apache YARN

Editor's Notes