Exploring Kubeflow on Kubernetes for AI/ML | DevNation Tech Talk

Jun 11, 20200 likes3,036 views

The Kubeflow project is dedicated to making deployments of machine learning (ML) workflows on Kubernetes simple, portable, and scalable by leveraging best-of-breed open source projects. These include Jupyter Notebooks, TensorFlow, and Pytorch for Training; Seldon and KFServing for Serving; and Kubeflow Pipelines. These are all wrapped up neatly in an easy-to-use portal so developers and data scientists can easily collaborate and deliver production-ready AI/ML workloads.

Juana Nakfour
CTO AI Center of Excellence
Open Data Hub

2
AGENDA
What is Open Data Hub
Kubeﬂow Introduction
Demo

BUILDING A PLATFORM FOR DATA SCIENCE
4
As a Data Scientist, I want a
“self-service cloud like” experience
for my Machine Learning projects,
where I can access a rich set of
modelling frameworks, data, and
computational resources, share and
collaborate with colleagues, and
deliver my work into production with
speed, agility and repeatability to
drive business value!
Self Service Portal to Select ML
Frameworks, and Data Sources
Perform ML Modelling
Inferencing w/ Hardware Acceleration
Model Deployment in
App Dev

The Open Data Hub Community Project
● Collaborate on a Data & AI platform for the Hybrid Cloud - opendatahub.io/
● Open Source community Meta-Project to integrate open source projects into an
end-to-end AI/ML platform on OpenShift
● Install today from the Openshift OperatorHub Community Operators

OPEN DATA HUB - Open Source Downstream/Upstream
6

OPEN DATA HUB - Kubeﬂow
9
● Kubeﬂow - A new open source project dedicated to making deployments of
machine learning (ML) workﬂows on Kubernetes simple, portable and
scalable - kubeﬂow.org
● It is now integrated into Open Data Hub and runs on OpenShift
● Kubeﬂow brings multiple new AI/ML capabilities and features
○ For model training Tensorﬂow and Pytorch
○ For model serving Seldon and KFServing
○ For pipelines Kubeﬂow Pipelines based on Argo

OPEN DATA HUB - Contact and Engagement
11
ODH site: opendatahub.io
ODH-Kubeﬂow Github: https://github.com/opendatahub-io
ODH Community Mailing lists: announcements@lists.opendatahub.io,
contributors@lists.opendatahub.io
ODH Community Meetings:
https://gitlab.com/opendatahub/opendatahub-community

In a time where container image building tools outnumber application frameworks, and deployment descriptors are lengthier than a small app, "deployment" is the stage where developer fun goes to die. In a less dramatic tone: The options and complexity of containerizing and deploying an application is, to say the least, a distraction for most developers. But it doesn't have to be. Quarkus provides extensions that help developers eliminate those distractions by making smart choices for them and by integrating with the rest of the Quarkus ecosystem. This demonstration will show that in Quarkusland, Kubernetes is not a killjoy but part of the fun, by providing a concise experience as you mix and match support for various platforms (vanilla Kubernetes & OpenShift) with image building solutions (Docker, Jib & S2i).

Serverless stream processing of Debezium data change events with Knative | De...Red Hat Developers

Come and join us for an (almost) no-slides session around the terrific trio of Debezium, Apache Kafka Streams, and Knative Eventing! Leveraging Apache Kafka as the de-facto standard for event-driven data pipelines, these open-source technologies allow you to ingest data changes from relational and NoSQL databases, process and enrich them, and consume them serverless-style. In a live demo, you’ll see how Debezium, Apache Kafka, Quarkus, and Knative are the dream-team for building serverless, cloud-native stream processing pipelines. You will learn: How to stream change events out of your database using Debezium How to use the Quarkus extension for Kafka Streams to build cloud-native stream processing applications, running either on the JVM or GraalVM How to consume and distribute Kafka messages with Knative Eventing, allowing you to manage modern serverless workloads on Kubernetes.

OpenShift Application Development | DO288 | Red Hat OpenShiftGlobal Knowledge Technologies

GPU enablement for data science on OpenShift | DevNation Tech TalkRed Hat Developers

Data scientists use Graphics Processing Unit, or GPU, to achieve the highest performance for deep learning training and inference. However, there is complexity to managing those hardware resources efficiently which may be outside the scope of the data scientists’ expertise. OpenShift is the ideal platform for simplifying that complexity by providing powerful abstractions for scalable cloud computing. This session will review the value of GPU in data science, how modern deep learning software frameworks consume GPU resources, and the operator-based architecture that enables GPU in OpenShift today.

Kubernetes-native or not? When should you ditch your traditional CI/CD server...Red Hat Developers

This document discusses when to use Kubernetes-native CI/CD tools like Tekton instead of traditional CI/CD servers. It introduces Tekton as an open-source framework for building reusable CI/CD pipelines that runs on Kubernetes. The key benefits of Kubernetes-native tools are centralized logging and monitoring, high availability guaranteed by Kubernetes, and self-healing capabilities. The document suggests considering Kubernetes-native CI/CD when your workloads are already running on Kubernetes.

Introduction to OpenShift Origin- Private, Public and CommunityOpenShift Origin

From 2013-04-14 OpenShift Origin Community Day in Portland, Oregon Presenter: (William) Bill DeCoste (Principal Software Engineer for OpenShift) will introduce Red Hat's PaaS. He'll describe the several flavors of OpenShift ranging from the upstream community project Origin, the EC2-based online offering at http://openshift.redhat.com, to the corresponding commercial offering, OpenShift Enterprise. OpenShift Origin and Online will be demonstrated.

Operatorhub.io and your Kubernetes cluster | DevNation Tech TalkRed Hat Developers

The document discusses Kubernetes operators and the Operator Lifecycle Manager. Operators are automated software managers that manage the entire lifecycle of Kubernetes applications. The Operator Lifecycle Manager allows publishing and subscribing to operators from an Operator Hub, which provides a catalog of community and commercial operators that can easily be installed and managed. Operators improve time to value, reduce upgrade risks, and provide cloud-like services on Kubernetes.

Secure your Quarkus applications | DevNation Tech TalkRed Hat Developers

So you have built - in no time - your Quarkus application and it's supersonic subatomic fast. Have you thought about security? Right, usually this is the thing we implement at the end. Even if it's a crucial part of our application, we often ignore it. The good news is that with Quarkus, adding security and identity management is a breeze. Join this 100% live coding session where we explore the different options that Quarkus offers you to secure your applications.

DevNation Workshop: Object detection with Red Hat OpenShift Data Science [Mar...Red Hat Developers

In this workshop, you’ll learn an easy way to incorporate data science and AI/ML into an OpenShift development workflow. As an example, you’ll use an object detection model to detect ‘dog(s)’ in an image. You will: Use Jupyter Notebooks and TensorFlow to explore a pre-trained object detection model Serve the model in a REST API as a Flask App Use Source-to-Image (S2I) to build and deploy the Flask app Explore Kafka streams from Notebooks Deploy a Kafka consumer with the same object detection model You’ll be able to do all of this without having to install anything on your own computer, thanks to Red Hat OpenShift Data Science and Red Hat OpenShift Streams for Apache Kafka. Note: Beginner data handling and Python skills are required for this workshop.

Red Hat OpenShift on Bare Metal and Containerized StorageGreg Hoelzer

OpenShift Hyper-Converged Infrastructure allows building a container application platform from bare metal using containerized Gluster storage without virtualization. The document discusses building a "Kontainer Garden" test environment using OpenShift on RHEL Atomic hosts with containerized GlusterFS storage. It describes configuring and testing the environment, including deploying PHP/MySQL and .NET applications using persistent storage. The observations are that RHEL Atomic is mature enough to evaluate for containers, and Docker/Kubernetes with containerized storage provide an alternative to virtualization for density and scale.

OpenShift Meetup 8th july 2019 at ConSol - OpenShift v4Robert Bohne

Red Hat OpenShift 4 provides a cloud-like platform for containerized applications that can run on hybrid and multi-cloud infrastructures. It offers full-stack automation for simplified cluster installation and lifecycle management along with over-the-air updates. OpenShift 4 supports deployment on both infrastructure provisioned and managed by Red Hat as well as customer-managed infrastructure. It leverages containers, microservices, and Kubernetes concepts to empower developers to build, deploy and manage applications.

Five Lessons Learned from Large-scale Implementation of Kubernetes in the Ent...DevOps.com

Learn what it takes to get a large-scale production Kubernetes cluster up and running in an on-premises environment. Get tips, best practices, and architectural approaches for the initial implementation. Understand the constraints, challenges, and how to solve for successful on-going day-2 operational issues. Join Sirish Raghuram, CEO of Platform9, and Ravi Ravichandran, VP cloud platform engineering at Juniper, for a fun conversational webinar where they will discuss how to avoid all the pitfalls of running production Kubernetes and ensuring high-reliability, scalability, and performance. They will also touch upon the implications of building and operating your own production clusters using your own resources and upstream Kubernetes versus commercial alternatives available in the market.

Multi-cloud Kubernetes BCDR with VeleroKublr

An application path to production does not end with a deployment, even if you are using Kubernetes (K8s) as your application deployment platform. Reliable BCDR (backup and disaster recovery) plan and framework is a must for any production-ready system. This presentation accompanies meetups and webinars in which Oleg Chunikhin, CTO at Kublr, shows how Velero BCDR framework works and demonstrates how it can be used to backup and recover realistic applications running on Kubernetes in different clouds and environments. What is covered: - general notions of Kubernetes applications BCDR - Velero BCDR framework - demo Velero BCDR for stateful applications running on AWS and Azure clouds - demo Velero BCDR using Strimzi / Kafka cluster and ArgoCD CI/CD manager as example application

Intro to Helm for KubernetesCarlos E. Salazar

Open shift 4 infra deep diveWinton Winton

The document provides an overview of Red Hat OpenShift Container Platform, including: - OpenShift provides a fully automated Kubernetes container platform for any infrastructure. - It offers integrated services like monitoring, logging, routing, and a container registry out of the box. - The architecture runs everything in pods on worker nodes, with masters managing the control plane using Kubernetes APIs and OpenShift services. - Key concepts include pods, services, routes, projects, configs and secrets that enable application deployment and management.

Cloud native fundamentalsVictor Morales

El desarrollo orientado hacia la nube es una realidad. Muchas empresas han reemplazado sus herramientas y modificado sus operaciones para obtener beneficios ofrecidos por este nuevo paradigma. Durante esta sesión se pretende abordar temas relacionados con el surgimiento de estas tecnologías. Entre los cuales destacan los distintos modelos de servicio y despliegue, estrategias para la adopción y el uso de herramientas existentes como Kubernetes.

Kubernetes Helm: Why It MattersPlatform9

Kubernetes Helm makes application deployment easy, standardized and reusable. Use of Kubernetes Helm leads to better developer productivity, reduced Kubernetes deployment complexity and enhanced enterprise production readiness. Enterprises using Kubernetes Helm can speed up the adoption of cloud native applications. These applications can be sourced from open-source community provided repositories, or from an organization’s internal repository of customized application blueprints. Developers can use Kubernetes Helm as a vehicle for packaging their applications and sharing them with the Kubernetes community. Kubernetes Helm also allows software vendors to offer their containerized applications at “the push of a button.” Through a single command or a few mouse clicks, users can install Kubernetes apps for dev-test or production environments.

Kubernetes LoggingDenys Havrysh

This document discusses implementing and testing a self-managed logging and visualization solution for a Kubernetes cluster. It considers tools like FluentD, Elasticsearch, Kibana, Helm, and Kops for collecting, processing, and visualizing logs. A turn-key deployment approach using Helm is recommended to install all stack components from a single chart and leverage dependencies. Concerns about authentication, capacity planning, and security hardening are noted for future improvement.

9 - Making Sense of Containers in the Microsoft CloudKangaroot

Everyone is talking about Containers, but what is this really about what are the benefits of Containers for your customers? You probably think you know, but there is more! And did you know you can run and manage Containers in the Microsoft Cloud? This session will go in to the benefits of Containers for your customers and what Microsoft is offering to facilitate in all your needs. We will touch on technologies like Kubernetes, Docker and we will elaborate on the strong partnerships Microsoft has built with true Open Source companies like Red Hat.

OpenShift Meetup - Red Hat OpenShift Container Storage explainedConSol Consulting & Solutions Software GmbH

Red Hat OpenShift Container Storage (RHOCS) is software-defined storage optimized for container environments that addresses challenges around platform services, application portability, and persistence. It uses Red Hat Ceph Storage, the Rook.io operator, and NooBaa's Multicloud Object Gateway technology. RHOCS provides simplified deployment and management of storage and allows applications and storage to run on the same or different nodes in an OpenShift cluster, or to connect multiple OpenShift clusters to an external Ceph storage cluster. The presentation demonstrated a proof-of-concept using an external Red Hat Ceph storage cluster with OpenShift Container Platform 4.6.

Welcome to the @OpenShift Origin Community by Diane Mueller @pythondj @redhatOpenShift Origin

Thinking One Step Further with Time-saving DevOps Tools with Open Telekom Clo...Bitnami

For on-demand recording of the webinar, click here: https://youtu.be/aN_DaNFfBx4 Why You Should Watch Application developers are well-advised to not only think about their actual programming, related time-saving tools and deployment schemes, but also about the specific needs of application operations - in particular with regards to data privacy requirements when dealing with clients in Europe and their customer data which are processed in applications. That's where the Open Telekom Cloud kicks in. As the the "new kid on the block", Open Telekom Cloud's public cloud offering features Bitnami's vast range of open source applications. Join Bitnami as we host our featured speaker, Max Guhl, from Deutsche Telekom. He will showcase the Open Telekom Cloud's intuitive user interface and how this Public Cloud does not only smoothly integrate Bitnami's application catalog, but also provides answers on how to comply with the upcoming European General Data Protection Regulation already today Register now to watch and learn: What the Open Telekom Cloud is How to launch and manage DevOps tools and instances on Open Telekom Cloud Actions to keep the new European General Data Protection Regulation (GDPR) in mind The benefits of using Bitnami with Open Telekom Cloud

Knative IntroJoe Searcy

Speaker: Scott Nichols We will take a look at Knative Serving and Eventing through an escalating demo that will let us tour the capabilities of Knative. Serving provides a container based scale to zero, scale real big functionality; as well as rainbow deploys, auto-TLS, domain mappings, and various knobs to control concurrency and scale traits. Eventing provides a thin abstraction on top of traditional message brokers (think Kafka or AMQP) that lets you compose your application without considering the message persistence choices in the moment.

[Lakmal] Automate Microservice to APILakmal Warusawithana

The recent constraints on businesses have pushed organizations to accelerate their plans for moving operations to the digital world—often shrinking timelines from years to months. Microservice architecture (MSA) is critical to accomplish fast innovation and the APIs exposed from microservices should be secured, managed, observed and monetized. All these steps require significant time. Kubernetes is designed for automation. The Operator pattern captures how you can write code and extend the Kubernetes cluster to automate a task going beyond its out-of-the-box capabilities. In this session, Lakmal will demonstrate and share his experience of how to automate microservice to API by introducing a Kubernetes Operator that works together with an API Management system while enhancing the developer experience.

Automate The Creation/Transformation of Infrastructure as Code Artifacts with...Konveyor Community

Watch the demo: https://youtu.be/tmGSqK3BahU Konveyor Move2Kube helps automate your migration from various platforms such as cloud foundry, docker swarm, VM based applications, or from your custom framework to Kubernetes. With the latest release of Move2Kube, v0.3.0, it has acquired extensive customization capabilities to help create the target artifacts as per your organization requirements. In this session, the Move2Kube team will demonstrate the migration of a typical application to run on Kubernetes. It will be followed by a demonstration of customization capabilities of Move2Kube, such as customizing the generated Dockerfile, the directory structure, the helm chart and custom artifacts. Website: https://move2kube.konveyor.io/ GitHub repo: https://github.com/konveyor/move2kube/

Webinar: End-to-End CI/CD with GitLab and DC/OSMesosphere Inc.

Seven years ago, Apache Mesos was born as a platform to bring the distributed computing capabilities that powered the largest digital companies to the masses. Today, Mesosphere DC/OS technologies power more containers in production than any other software stack in the world, and has emerged as the premier platform for building and elastically scaling data-rich, modern applications and the associated CI/CD infrastructure across any infrastructure, public or private. GitLab is an end-to-end software development and delivery platform with built-in CI/CD, monitoring, and performance metrics. With a unified experience for every step of the development lifecycle and seamless integration with container schedulers, GitLab provides the most efficient approach to reduce cycle time, increase velocity, and improve software quality. In this webinar, you will learn how to combine DC/OS and GitLab to easily build a CI/CD infrastructure and build a complete CI/CD pipeline in minutes. Slides cover: 1. An introduction to Apache Mesos and Mesosphere DC/OS and overview of DC/OS features and capabilities for developing, deploying, and operating containerized applications, microservices and CI/CD 2. An introduction to GitLab 3. How to use DC/OS and GitLab to build a CI/CD solution and go from idea to production

"Using Automation Tools To Deploy And Operate Applications In Real World Scen...ConSol Consulting & Solutions Software GmbH

Developer Intro to OpenShiftTiera Fann, MBA

This document discusses transforming monolithic applications into microservices using Red Hat OpenShift. It provides an overview of OpenShift capabilities like application lifecycle management, container orchestration, security and monitoring. It then describes a hands-on lab where developers will learn OpenShift concepts, efficient development workflows and promoting applications between environments using CI/CD pipelines.

Deploying and Managing Artificial Intelligence Services using the Open Data H...Orgad Kimchi

Scaling AI/ML with Containers and Kubernetes Tushar Katarki

Scaling AI and machine learning projects poses challenges around collaboration, data access, and deploying models into production. Containers and Kubernetes can help address these challenges by providing a self-service platform for data scientists to access tools, frameworks, and compute resources. This allows for rapid iteration and sharing of work. Kubernetes provides resource management and workload scheduling across hybrid cloud environments. OpenShift is a distribution of Kubernetes optimized for AI/ML workloads. It incorporates additional services for continuous integration/delivery and automation. Open Data Hub is an open source community project and reference architecture for building AI platforms on OpenShift and Kubernetes.

More Related Content

What's hot (20)

DevNation Workshop: Object detection with Red Hat OpenShift Data Science [Mar...Red Hat Developers

Red Hat OpenShift on Bare Metal and Containerized StorageGreg Hoelzer

OpenShift Meetup 8th july 2019 at ConSol - OpenShift v4Robert Bohne

Five Lessons Learned from Large-scale Implementation of Kubernetes in the Ent...DevOps.com

Multi-cloud Kubernetes BCDR with VeleroKublr

Intro to Helm for KubernetesCarlos E. Salazar

Open shift 4 infra deep diveWinton Winton

Cloud native fundamentalsVictor Morales

Kubernetes Helm: Why It MattersPlatform9

Kubernetes LoggingDenys Havrysh

9 - Making Sense of Containers in the Microsoft CloudKangaroot

OpenShift Meetup - Red Hat OpenShift Container Storage explainedConSol Consulting & Solutions Software GmbH

Welcome to the @OpenShift Origin Community by Diane Mueller @pythondj @redhatOpenShift Origin

Thinking One Step Further with Time-saving DevOps Tools with Open Telekom Clo...Bitnami

Knative IntroJoe Searcy

[Lakmal] Automate Microservice to APILakmal Warusawithana

Automate The Creation/Transformation of Infrastructure as Code Artifacts with...Konveyor Community

Webinar: End-to-End CI/CD with GitLab and DC/OSMesosphere Inc.

"Using Automation Tools To Deploy And Operate Applications In Real World Scen...ConSol Consulting & Solutions Software GmbH

Developer Intro to OpenShiftTiera Fann, MBA

DevNation Workshop: Object detection with Red Hat OpenShift Data Science [Mar...Red Hat Developers

Red Hat OpenShift on Bare Metal and Containerized StorageGreg Hoelzer

OpenShift Meetup 8th july 2019 at ConSol - OpenShift v4Robert Bohne

Five Lessons Learned from Large-scale Implementation of Kubernetes in the Ent...DevOps.com

Multi-cloud Kubernetes BCDR with VeleroKublr

Intro to Helm for KubernetesCarlos E. Salazar

Open shift 4 infra deep diveWinton Winton

Cloud native fundamentalsVictor Morales

Kubernetes Helm: Why It MattersPlatform9

Kubernetes LoggingDenys Havrysh

9 - Making Sense of Containers in the Microsoft CloudKangaroot

OpenShift Meetup - Red Hat OpenShift Container Storage explainedConSol Consulting & Solutions Software GmbH

Welcome to the @OpenShift Origin Community by Diane Mueller @pythondj @redhatOpenShift Origin

Thinking One Step Further with Time-saving DevOps Tools with Open Telekom Clo...Bitnami

Knative IntroJoe Searcy

[Lakmal] Automate Microservice to APILakmal Warusawithana

Automate The Creation/Transformation of Infrastructure as Code Artifacts with...Konveyor Community

Webinar: End-to-End CI/CD with GitLab and DC/OSMesosphere Inc.

"Using Automation Tools To Deploy And Operate Applications In Real World Scen...ConSol Consulting & Solutions Software GmbH

Developer Intro to OpenShiftTiera Fann, MBA

Similar to Exploring Kubeflow on Kubernetes for AI/ML | DevNation Tech Talk (20)

Deploying and Managing Artificial Intelligence Services using the Open Data H...Orgad Kimchi

Scaling AI/ML with Containers and Kubernetes Tushar Katarki

ApacheCon NA 2015 - Gabriele Columbro - Is Open Source the right model in the...Symphony Software Foundation

Open Source means a lot of things and revolutionized the way software is built over the last two decades. Whether developing a product or providing a service, companies are rushing to get their businesses cloud ready, increasingly (big) data driven and flexible enough to take advantage of the inherent business scalability opportunities offered by the cloud. And as the focus switches to the scale economies of execution, from ever cheaper opaque hosted web storage and connected services to the immutable containers movement, a question arises: what is the role of Open Source software in a world in which not only software (SaaS), but also platform (PaaS) and infrastructure (IaaS) are increasingly delivered (and consumed) as hosted services? In this session, we'll attempt to answer to this question, by providing examples of Open Source cloud & big data companies and studying the effects of open development ecosystems and how Open Source is engrained in the fabric of the Cloud.

ODSC East 2020 Accelerate ML Lifecycle with Kubernetes and Containerized Da...Abhinav Joshi

This deck provide an overview of containers and Kubernetes, and how these technologies can help solve the challenges faced by data scientists, ML engineers, and application developers. Next, it showcases the key capabilities required in a containers and kubernetes platform to help data scientists easily use technologies like Jupyter Notebooks, ML frameworks, programming languages to innovate faster. Finally it discusses the available platform options (e.g. KubeFlow, Open Data Hub, etc.), and some examples of how data scientists are accelerating their ML initiatives with containers and kubernetes platform.

Learning Apache OpenWhisk Developing Open Serverless Solutions 1st Edition Mi...goistcrilern

Runtime Fabric on OpenShift _--_ MuleSoft Meetup Deck.pptxSandeep Deshmukh

IBM Bluemix OpenwhiskSonia Baratas Alves

IBM Bluemix OpenWhisk: Interconnect 2016, Las Vegas: CCD-1088: The Future of ...OpenWhisk

Cloud Study Jam - 1 (AI/ML & GCP)Shiv Prakash

The document describes a community event called Study Jams that provides training on various Google Cloud technologies including BigQuery, Natural Language API, Speech API, and Cloud ML Engine. The event includes several hands-on labs that teach skills like introductory SQL for BigQuery, using the BigQuery and Cloud SQL consoles, and the Cloud Natural Language API and Cloud Speech API. Attendees will learn how to get started with these Google Cloud services and tools.

WSO2Con2024 - Hello Choreo Presentation - KanchanaWSO2

Webcast Presentation: Be lean. Be agile. Work together with DevOps Services (...GRUC

OPENi APIs & Personal Cloudlets - "Innovation in the cloud" @PT Showroom Lisb...Iosif Alvertis

OPENi Innovation in the cloudopeni_ict

OpenNebula - Enabling Business in Cloud - FIA 2014OpenNebula Project

Today we gave a talk at Future Internet Assembly 2014. Its aim was to show how OpenNebula is driving innovation in cloud computing, impacting the adoption of private cloud, and enabling business in the cloud. First, most organizations adopt cloud to optimize their IT investment, to improve existing services or to support new business and service models. In this scenario, OpenNebula lowers the barriers for new organizations to build their private cloud. Second, many organizations like the fact that open source allows great customization to meet individual requirements. They can build a differentiated cloud service to meet customers needs or to offer new cloud provision models for a specific market segment or geography. Third, open-source also encourages and supports innovation in the development of new cloud products. We have seen many examples of how its use lowers the barriers for new ICT players to create their own cloud offerings.

CNCF Introduction - Feb 2018Krishna-Kumar

Pa getting-started-azure-openshift-ebook-f20686-201911-enLisandro Julian Aguero

This document provides an introduction to Red Hat OpenShift and Azure Red Hat OpenShift. It discusses key concepts in OpenShift including containers, images, pods, services, projects and users. It highlights benefits of OpenShift such as improved developer productivity, automated operations, and security and maintenance efficiencies. It also compares OpenShift to Kubernetes, noting that OpenShift provides more ease of deployment, security, and flexibility out of the box through automation of tasks like cluster provisioning and management.

From idea to production in a day – Leveraging Azure ML and Streamlit to build...Florian Roscheck

How to leverage Azure ML, automated machine learning, and Streamlit to build and test machine learning apps quickly? Find out about our favorite Hackathon stack and walk away with some code to build and user-test your own machine learning ideas fast. Experimentation, bringing machine learning ideas in front of users, is essential to innovation. Yet, in our corporate hackathons, our data science team has struggled many times with how to build and deploy user-facing machine learning ideas in just a single day. Over the past 2+ years, we have developed a routine around using Azure Machine Learning, automated machine learning, and Streamlit to build and user test machine learning ideas quickly. The aim of this talk is to pass on practical, technical knowledge to fellow data scientists about how to leverage this stack to achieve high build and user test speeds. During the talk, we will walk through the process of building a computer vision system for identifying trash in images via an app using the open-source TACO dataset (http://tacodataset.org/). Working through a Jupyter notebook, we will load the data into Azure Machine Learning and trigger an automated machine learning run on the data. In this context, we will quickly get to know the training and testing metrics available in Azure ML to evaluate the model. We will then download the machine learning model as a file packaged in the open-source ONNX format (https://onnx.ai/). Using the open-source Python web application framework Streamlit (https://github.com/streamlit/streamlit), we will program an application in which users can upload images and embed the machine learning model in it to identify trash in these images. Using a to-be-published infrastructure-as-code pipeline on Azure DevOps, we will deploy the application to the public internet on the Azure platform. From here, users can test it. The stack and code presented in this talk will enable fellow data scientists to accelerate their data science development, leading to quicker experimentation and, therefore, to faster innovation of products with machine learning at their core.

Introduction to mulesoft - Alpharetta Developer Group MeetJitendra Zaa

This document provides an introduction and overview of Mulesoft. It discusses Mulesoft's history, from its founding in 2006 to its acquisition by Salesforce in 2018. It also outlines Mulesoft's API-led approach to integration and its deployment models, including runtime manager to cloudhub, cloud console to your own servers in a hybrid model, and on-premises console to on-premises deployment. The agenda includes presentations on Mulesoft history, API-led connectivity, deployment models, demos, and a Q&A session.

Cloud hubKrishna_in

CloudHub is a Platform as a Service (PaaS) that allows users to integrate SaaS applications, cloud services, and enterprise applications in real-time. It is built on Mule, the most widely used integration platform, and provides a scalable architecture that can be used to build integration applications. CloudHub also allows users to manage applications in the cloud as well as servers located on-premises. It offers predefined connectors to popular services, an API for automation, and management of applications from an intuitive console.

Publishing in an Agile WorldWebWorks

Deploying and Managing Artificial Intelligence Services using the Open Data H...Orgad Kimchi

Scaling AI/ML with Containers and Kubernetes Tushar Katarki

ApacheCon NA 2015 - Gabriele Columbro - Is Open Source the right model in the...Symphony Software Foundation

ODSC East 2020 Accelerate ML Lifecycle with Kubernetes and Containerized Da...Abhinav Joshi

Learning Apache OpenWhisk Developing Open Serverless Solutions 1st Edition Mi...goistcrilern

Runtime Fabric on OpenShift _--_ MuleSoft Meetup Deck.pptxSandeep Deshmukh

IBM Bluemix OpenwhiskSonia Baratas Alves

IBM Bluemix OpenWhisk: Interconnect 2016, Las Vegas: CCD-1088: The Future of ...OpenWhisk

Cloud Study Jam - 1 (AI/ML & GCP)Shiv Prakash

WSO2Con2024 - Hello Choreo Presentation - KanchanaWSO2

Webcast Presentation: Be lean. Be agile. Work together with DevOps Services (...GRUC

OPENi APIs & Personal Cloudlets - "Innovation in the cloud" @PT Showroom Lisb...Iosif Alvertis

OPENi Innovation in the cloudopeni_ict

OpenNebula - Enabling Business in Cloud - FIA 2014OpenNebula Project

CNCF Introduction - Feb 2018Krishna-Kumar

Pa getting-started-azure-openshift-ebook-f20686-201911-enLisandro Julian Aguero

From idea to production in a day – Leveraging Azure ML and Streamlit to build...Florian Roscheck

Introduction to mulesoft - Alpharetta Developer Group MeetJitendra Zaa

Cloud hubKrishna_in

Publishing in an Agile WorldWebWorks

More from Red Hat Developers (20)

DevNation Tech Talk: Getting GitOpsRed Hat Developers

In 2022 we heard your GitOps questions at meetups and gatherings, big stages and local panels and one question was often top of mind: how do I get started? The benefits of GitOps are calling your name, but getting started isn’t that straightforward. Red Hat is excited to kick off 2023 with a DevNation TechTalk, focused on GitOps to help you sift through your questions. At DevNation you’ll hear from passionate GitOps practitioners about the pitfalls to avoid and hurdles to jump while kicking off or evolving your GitOps practices. This event is aimed at audiences that are new to GitOps or early in their practice development within a cloud native environment. During this live session you’ll learn: Upcoming updates and key milestones in the ArgoCD roadmap and how Red Hat will support them How to simplify the delivery GitOps across multi-cloud environments GitOps best practices from experts at: PostNord Strålfors: Filip Jansson Arbetsförmedlingen: Misho Kmetovski & Richard Hermansson Swiss Railways (SBB): Manuel Wallrapp & Thomas Bruederli Plus stick around for an “Ask me Anything” segment to ask any outstanding questions live.

Exploring the power of OpenTelemetry on KubernetesRed Hat Developers

Modern cloud-native applications are incredibly complex systems. Keeping the systems healthy and meeting SLAs for our customers is crucial for long-term success. In this session, we will dive into the three pillars of observability - metrics, logs, tracing - the foundation of successful troubleshooting in distributed systems. You'll learn the gotchas and pitfalls of rolling out the OpenTelemetry stack on Kubernetes to effectively collect all your signals without worrying about a vendor lock in. Additionally we will replace parts of the Prometheus stack to scrape metrics with OpenTelemetry collector and operator.

GitHub Makeover | DevNation Tech TalkRed Hat Developers

GitHub plays a key role in the everyday work of thousands of developers and is a central piece of the open-source software ecosystem. Even though it is getting better and better every day, it still misses some key features that we need. If you want a better way of reviewing PRs, navigating through the code or better yet - writing the code without leaving the browser - this talk is for you! This talk will be demo driven, and as the title suggests, we will start with the aesthetic revamp. But we definitely won’t stop there! You will also learn a few cool things about interacting with GitHub through the command line. So not only your UI will be officially revamped, but you will also gain a productivity boost.

Quinoa: A modern Quarkus UI with no hassles | DevNation tech TalkRed Hat Developers

Extra micrometer practices with Quarkus | DevNation Tech TalkRed Hat Developers

This document discusses using metrics to monitor Quarkus applications. It recommends metrics like throughput, memory usage, queue time, average response time, and error rates. It explains how Quarkus supports Micrometer for instrumenting applications with metrics and integrating with monitoring systems. The document includes a demo of adding metrics to code. It provides tips for using annotations and tags to gain more insights from metrics. Source code examples are linked.

Event-driven autoscaling through KEDA and Knative Integration | DevNation Tec...Red Hat Developers

This talk will teach you how to redesign an event-driven autoscaling architecture for cloud-native microservices by utilizing Apache Kafka, Knative, and KEDA infrastructure. You will also learn how to deploy serverless applications (Quarkus) using a Knative service. Finally, KEDA will enable you to autoscale Knative Eventing components (KafkaSource) through events consumption over standard resources (CPU, memory).

Integrating Loom in Quarkus | DevNation Tech TalkRed Hat Developers

Loom is among the most highly anticipated projects in the Java world. It promises to address concurrency and Java execution model issues by providing virtual threads. Thus, there is no need to write concurrent programs using asynchronous or reactive APIs; it will be possible to use the traditional imperative model and let Loom handle the rest. The JVM will execute the program and leverage non-blocking APIs automatically! Sounds good, doesn't it? How does it work, though? Are there any hidden costs? What is Loom going to change in modern Java frameworks? We will answer these questions in this talk. Starting with the integration of Loom in Quarkus, we will compare the different approaches we considered, discuss their respective pros and cons, and show how Loom might change the Java world.

Quarkus Renarde 🦊♥: an old-school Web framework with today's touch | DevNatio...Red Hat Developers

Quarkus Renarde 🦊♥ is a new Web framework based on Quarkus. This framework focuses not on microservices but web applications and makes Quarkus even easier to use for web apps: - Endpoints based on convention, even easier than RESTEasy Reactive and JAX-RS - Server-side templating with Qute - Validation with Hibernate Validation - Data with Hibernate ORM or Reactive with Panache - Simple authentication with OpenID Connect or WebAuthn Quarkus Renarde 🦊♥ can deliver all this while still providing the joy of developing with Quarkus, with live reload, continuous testing, the Dev, and more.

Containers without docker | DevNation Tech TalkRed Hat Developers

This document summarizes a talk about running containers without Docker. It discusses alternatives like Podman and Buildah that can replace Docker functionality. The talk demonstrates installing and using Podman to run containers, Buildah to build images from Dockerfiles, and Skopeo to copy images between registries. The presentation encourages understanding containers beyond just Docker and knowing other tools in the ecosystem.

Distributed deployment of microservices across multiple OpenShift clusters | ...Red Hat Developers

Hybrid-cloud and multi-cloud patterns are the next application deployment architectures, and Kubernetes is the de facto container orchestration engine. 50% of production Kubernetes workloads involve some form of microservices applications. How can we manage this inter-cluster application connectivity? Meet Skupper: an open-source project that solves multi-cloud communication for Kubernetes. In this Tech Talk, you will briefly learn about Skupper and watch a live demo of an e-commerce application with 10 microservices spanning three OpenShift clusters running on three different public cloud providers.

Dear security, compliance, and auditing: We’re sorry. Love, DevOps | DevNatio...Red Hat Developers

DevOps solved the conflict between development and operations, but other essential aspects of the delivery lifecycle—security, compliance, and audit—were left out. DevSecOps is an excellent reminder that security must be DevOps’d, but compliance and audit are still missing. There’s no need for a new DevSecAuditComplianceOps buzzword; instead, let’s talk about continuous authorization, which applies Zero Trust principles to continuous monitoring. In this tech talk, Bill Bensing will discuss practical ways to start with continuous authorization for the software delivery lifecycle using Ploigos.

11 CLI tools every developer should know | DevNation Tech TalkRed Hat Developers

A Microservices approach with Cassandra and Quarkus | DevNation Tech TalkRed Hat Developers

We will dissect the world famous todo app that provides a REST API (which is the foundation of microservices) with data backed by Apache Cassandra. We will leverage the TODO MVC and the TODO backend projects with the back end that we will build with Quarkus and Cassandra. Attendees will get an overview of Cassandra, including the driver for Quarkus. Through live coding (that attendees can try out later) in a cloud-based environment, primarily in Quarkus and Cassandra, attendees will understand how to implement and connect the APIs to the backend and leverage the generic client(s)provided. After attending this session attendees will walk away with a good understanding of implementing microservices using Cassandra and Quarkus. They will also get a working knowledge of how Astra (Cassandra as a service) can be leveraged in other solutions.

GitHub Actions and OpenShift: Supercharging your software development loops...Red Hat Developers

Every software developer wants more productivity. What if the only commands you needed to deploy were "git commit" and "git push"? Join us as we walk you through a live demonstration of how you can ship your lovely application code from your local machine to a free OpenShift cluster, fully automated through GitHub Actions. By the end of this session, you'll have a sound understanding of building a GitHub Action workflow for your codebase that leverages OpenShift to deploy your application.

To the moon and beyond with Java 17 APIs! | DevNation Tech TalkRed Hat Developers

Since moving to a 6 monthly release cadence, the Java platform is evolving more dynamically than ever before. It can be quite a challenge to stay on top of all the changes and new features. In this talk we're going to explore the most important developments in the Java API: which classes have been added, and what has been removed? Join Duke, the Java mascot, for a trip to space and learn which exciting new APIs provided by the Java platform can help him with his journey: The Java Vector API for utilizing the SIMD capabilities of modern CPU architectures The Foreign Linker API for integrating with native code The JFR Event Streaming API for publishing JDK Flight Recorder Events We'll also take a look at some useful changes to the Java runtime, such as CDS archives for a faster spaceship..., uhm, application launch!

Profile your Java apps in production on Red Hat OpenShift with Cryostat | Dev...Red Hat Developers

Kafka at the Edge: an IoT scenario with OpenShift Streams for Apache Kafka | ...Red Hat Developers

This document discusses Apache Kafka and Red Hat OpenShift Streams for Apache Kafka. It begins with an overview of what Apache Kafka is and its common use cases. It then demonstrates how Red Hat OpenShift Streams provides a managed Apache Kafka cluster as a service, including a dedicated cluster, configuration management, metrics, monitoring and other features to provide a streamlined developer experience. It concludes with information on trying OpenShift Streams for Apache Kafka and additional resources.

Kubernetes configuration and security policies with KubeLinter | DevNation Te...Red Hat Developers

With Kubernetes, implementing security policies can be challenging. First, developers, administrators, and security teams need to understand security policies in collaboration to have the best chance of successful adoption. Next, policy enforcement needs to integrate with developer workflows. Lastly, policies need to contain corrective action that is as close to the developer as possible. KubeLinter solves these problems by linting Kubernetes YAML files and Helm charts at the source: the developer. In this session, we will evaluate KubeLinter by moving through a hands-on demo of the application, showing a use case for local machines and CI pipeline integration, and chatting about how best to integrate it into your organization: KubeLinter, and its default checks How you can leverage the application in your day-to-day operations The open source StackRox community

Level-up your gaming telemetry using Kafka Streams | DevNation Tech TalkRed Hat Developers

Many modern video games are constantly evolving post-release. New maps, game modes, and game balancing adjustments are rolled out, often on a weekly basis. This continuous iteration to improve player engagement and satisfaction requires data-driven decision making based on events and telemetry captured during gameplay, and from community forums and discussions. In this session you will learn how OpenShift Streams for Apache Kafka and Kafka Streams can be used to analyze real-time events and telemetry reported by a game server, using a practical example that encourages audience participation. Specifically you’ll learn how to: Provision Kafka clusters on OpenShift Streams for Apache Kafka. Develop a Java application that uses Kafka Streams and Quarkus to process event data. Deploy the application locally, or on OpenShift and connect it to your OpenShift Streams for Apache Kafka Cluster.

Friends don't let friends do dual writes: Outbox pattern with OpenShift Strea...Red Hat Developers

Dual writes are a common source of issues in distributed event-driven applications. A dual write occurs when an application has to change data in two different systems - for instance, when an application needs to persist data in the database and send a Kafka message to notify other systems. If one of these two operations fail, you might end up with inconsistent data which can be hard to detect and fix. OpenShift Streams for Apache Kafka is Red Hat's fully hosted and managed Apache Kafka service targeting development teams that want to incorporate streaming data and scalable messaging in their applications, without the burden of setting up and maintaining a Kafka cluster infrastructure. Debezium is an open source distributed platform for change data capture. Built on top of Apache Kafka, it allows applications to react to inserts, updates, and deletes in your databases. In this session you will learn how you can leverage OpenShift Streams for Apache Kafka and Debezium to avoid the dual write issue in an event-driven application using the outbox pattern. More specifically, we will show you how to: Provision a Kafka cluster on OpenShift Streams for Apache Kafka. Deploy and configure Debezium to use OpenShift Streams for Apache Kafka. Refactor an application to leverage Debezium and OpenShift Streams for Apache Kafka to avoid the dual write problem.