PKS - Solving Complexity for Modern Data Workloads

Dec 21, 2018Download as PPTX, PDF0 likes99 views

Jacob Bogie, Advisory Platform Architect explains how Pivotal's PKS abstracts the complexity of tackling Data Gravity, Kubernetes, and how it relates to the presentations of our partners Yugabyte, Portworx, SnappyData, Crunchy Data, and Confluent.

© Copyright 2018 Pivotal Software, Inc. All rights Reserved. Version 1.0
Jake Bogie
December 5, 2018
Pivotal PKS
What is it and what about databases...

PKS - Solving Complexity for Modern Data Workloads

A production ready platform enabling self-serve provisioning of
Kubernetes clusters and containerized workloads.
Fully automated Ops
Multi Cloud
Network management and security Built with open-source Kubernetes

What is it?
Kubernetes is a portable, extensible open-source platform
for managing containerized workloads and services.
Kubernetes provides a container-centric management
environment.
Kubernetes is not a traditional, all-inclusive PaaS (Platform
as a Service) system.
Interesting Fact: The name Kubernetes originates from Greek, meaning helmsman or pilot.

What is it?
BOSH is an open source tool chain for release engineering,
deployment, and lifecycle management of large scale
distributed services.
BOSH installs and updates software packages on large
numbers of VMs over many IaaS providers.
BOSH orchestrates initial deployments and ongoing
updates that are:
Predictable, repeatable, and reliable!

Cloud Foundry Container Runtime Project
Feb 2017 - Project Kubo was created by
Pivotal & Google
June 2017 - Donated to Cloud Foundry
Foundation
October 2017 - Renamed from Kubo to
Cloud Foundry Container Runtime
February 2018 - Pivotal begins support of
PKS backed by CFCR
Resources:
CFCR Bosh Release - https://github.com/cloudfoundry-incubator/kubo-release
CFCR Docs - https://docs-cfcr.cfapps.io/

Cloud Provider Interfaces
Pivotal Application
Service (PAS)
Pivotal Container
Service (PKS)
>cf push >kubectl run
vSphere
Azure &
Azure StackGoogle CloudAWSOpenstack
Pivotal Services
Marketplace
Pivotal and
Partner Products

*Azure support soon!
PKS Supported Cloud Providers

So you’re a successful Data Administration team...

The most widely used container images...

Challenges of containerizing databases...
“They require high-throughput and low-latency networking
capabilities.”
“They require, in our use, an ability to handle persistent data
storage.”
“They require layers of complex configuration.”
“They require disk space to store large amounts of data, and
are thus less portable.”
Source: New Relic - https://blog.newrelic.com/product-news/containerizing-databases/

The goodness of databases in containers...
“Rapidly deploy and scale new technologies.”
“Consistent configuration and delivery of data services.”
“Makes sense for shared nothing and distributed database platforms.”
“Helps with staying up on the data engine upgrade cycle, yet that still
needs some more attention.”

● Run stateful workloads in containers
● Enable locating workloads closer to data
● Provide HA, monitoring, and automated operations
● Security that is inherent by design
● Focus on delivering meaningful & actionable data!
● Offer new technologies (distributed & shared nothing)
● Reduce complexity of service offerings

Transforming How The World Builds Software
© Copyright 2018 Pivotal Software, Inc. All rights Reserved.

This document provides an overview of Portworx, including: 1. Portworx is a leader in providing stateful container orchestration that works across any cloud or scheduler. 2. It has an experienced team and investors, with headquarters in Los Altos, CA and 70 employees globally. 3. Portworx allows applications to run across different infrastructure types and clouds with a portable cloud stack that provides high availability, replication, security and data mobility features.

EasyStack True Private Cloud | Quek Keng OeiVietnam Open Infrastructure User Group

Modern, Private, Automated Private Cloud Altera Technologies is a cloud management company founded in 2014 that focuses on private cloud software and services. It has over 500 enterprise customers and 200 employees. Altera offers a true private cloud product called ECS that provides tenants secure platforms with logical and physical network separation between domains and projects. Key benefits of private cloud over public cloud include better security, control, and predictability while avoiding high public cloud costs over time.

Cloud Native Patterns Using AWS - Practical ExamplesAnderson Carvalho

This document discusses cloud native patterns using AWS. It defines cloud native as taking advantage of what the cloud offers to build scalable applications in public, private, and hybrid clouds. The document outlines foundation patterns like having one database per component, using event streaming, and event sourcing. It also discusses boundary patterns such as API gateways and backend for frontends. Finally, it covers control patterns involving event collaboration and orchestration and provides examples of how to implement these patterns using AWS services.

Build Robust Blockchain Services with Hyperledger and ContainersLinuxCon ContainerCon CloudOpen China

Presentation delivered at the 2017 LinuxCon China. Build robust blockchain services (Wenjie(Jay) Xie, wutongtree.com) - Blockchain is considered as a great evolution. But the performance, maintainability, and scalability are still confusing many companies. Jay will show you how they reach high availability, scalability, and performance by using hyperledger and container to build robust blockchain services. He will also share their experience on dealing TB data in blockchain and operating a large scale of blockchain services in containers, including linking hyperledger and hbase, service warmup, and much more.

DCSF19 Kubernetes Security with OPA Docker, Inc.

The document discusses using Open Policy Agent (OPA) to enforce guardrails and security policies in Kubernetes clusters. It provides examples of sample policies for OPA that restrict which image registries pods can use and prevent conflicting ingress hosts. It also summarizes key features of OPA such as its declarative policy language, sidecar deployment model, and community support from many major companies using it for admission control, authorization, risk management and other use cases.

How are containers enabling 20th Century Fox to release the next great movie?Docker, Inc.

compelling story. More than anything, those movies and the entertainment of the future tests the power of modern technologies and the alignment of those tools with the people who use them. In this Q&A session between HPE and 20th Century Fox, you will hear about how 20th Century Fox has selected to use Docker containers through HPE’s Helion Development Platform to deliver movies to deliver high-tech movie productions. Speakers will share an enterprise-level view of the journey, Docker technology in the enterprise, and how the partnership with HPE is helping them deliver faster, more efficient solutions to their business, and more engaging movies to people like us.

Securing Kubernetes WorkloadsJim Bugwadia

Kubernetes is the new cloud OS, and enterprises are rapidly migrating existing applications to Kubernetes as well as creating new Kubernetes-native applications. However, Kubernetes configuration management remains complex, and due to this complexity, most implementations do not leverage Kubernetes constructs for security. In this session you will learn: - Key Kubernetes constructs to use for properly securing application workloads in any cloud - How to manage Kubernetes configurations across multiple clusters and cloud providers - How to audit and enforce enterprise-wide Kubernetes best practices

On-the-Fly Containerization of Enterprise Java & .NET Apps by Amjad AfanahDocker, Inc.

Dockerizing brownfield enterprise applications can often be a daunting task - involving changes to the application code/configuration and existing build processes. The DCHQ platform provides “on-the-fly” containerization of both Linux & Windows enterprise applications – including Java, Oracle, .NET and others. By doing so, DCHQ transforms non-cloud-native applications into completely portable applications that can take advantage of cloud scaling, storage redundancy and most importantly, deployment agility without introducing a single change to the application source control repository. In this session, we will cover the deployment automation of an Enterprise Java application with PostgreSQL multi-host cluster set up for Master-Slave replication and automated storage management with redundant EBS volumes on AWS using DCHQ + EMC REX-Ray. We will also cover the deployment automation of an Enterprise .NET application demonstrating the application life-cycle management capabilities post-provision -- including monitoring, alerts, continuous delivery, application backups, scale in/out, in-browser terminal to access the containers, log streaming, and application updates.

Tectonic Summit 2016: Brandon Philips, CTO of CoreOS, KeynoteCoreOS

The document discusses CoreOS's expertise across the technology stack for container-based applications. This includes Linux, container engines, container image specifications, clustered databases like etcd, cloud independence, identity federation, and more. CoreOS is focused on open standards through initiatives like the Open Container Initiative and ensuring technologies like Kubernetes, rkt, and etcd can scale to power large production deployments.

Gentle introduction to containers and kubernetesNills Franssens

This document provides an introduction to containers and Kubernetes. It begins by stating the goals of the session and introducing the author. It then discusses moving applications from traditional architectures to modern microservices approaches using containers and Kubernetes. It provides explanations of what containers are and how Kubernetes works as an orchestration platform, managing containers across clusters of machines. It demonstrates building a Docker container and deploying containers to Kubernetes. Finally, it discusses advantages of running Kubernetes on Azure, such as ease of management and operations.

CNCF Introduction - Feb 2018Krishna-Kumar

Kubernetes on DC/OSCloud Technology Experts

Join us on Wednesday, January 9 as Mesosphere will demo how to install and run Kubernetes in under 10 minutes on DC/OS. We will walk you step-by-step through installing and running Kubernetes on Mesosphere DC/OS 1.10, discuss the benefits of container orchestrators, and answer frequently asked questions. Topics include: Live demo showing how to deploy and manage 100% pure Kubernetes distribution on DC/OS How to run multiple Kubernetes clusters (of different versions) alongside each other How to run both stateless and stateful workloads on the same infrastructure Live Q&A

Using the SDACK Architecture on Security Event Inspection by Yu-Lun Chen and ...Docker, Inc.

The SDACK architecture stands for Spark, Docker, Akka, Cassandra, and Kafka. At TrendMicro, we adopted the SDACK architecture to implement a security event inspection platform for APT attack analysis. In this talk, we will introduce SDACK stack with Spark lambda architecture, Akka and Kafka for streaming data pipeline, Cassandra for time series data, and Docker for microservices. Specifically, we will show you how we Dockerize each SDACK component to facilitate the RD team of algorithms development, help the QA team test the product easily, and use the Docker as a Service strategy to ship our products to customers. Next, we will show you how we monitor each Docker container and adjust the resource usage based on monitoring metrics. And then, we will share our Docker security policy which ensures our products are safety before shipping to customers. After that, we'll show you how we develop an all-in-one Docker based data product and scale it out to multi-host Docker cluster to solve the big data problem. Finally, we will share some challenges we faced during the product development and some lesson learned.

Docker Federal Summit 2017 General SessionDocker, Inc.

Modernizing Traditional ApplicationsDocker, Inc.

MetLife has adopted a containerization strategy using Docker to modernize its traditional applications. Some key points: - MetLife aims to embrace containers ubiquitously across its portfolio to improve speed, stability, scalability, security and reduce costs. - It has seen success with its strategy, such as a 70% reduction in infrastructure costs and millions of dollars avoided in costs. - MetLife provides training and knowledge sharing programs to help developers and operations teams adopt containers. It also offers services to support customers in piloting, putting early apps into production, and migrating apps at scale to containers.

Pivotal Container Service (PKS) at SF Cloud Foundry Meetupcornelia davis

Kubecon US 2019: Kubernetes Multitenancy WG Deep DiveSanjeev Rampal

This document provides an overview and agenda for a presentation on secure multitenancy in Kubernetes. It discusses what Kubernetes multitenancy is, available solutions, architectural models for multitenancy including namespace grouping and virtual Kubernetes clusters. It also covers community initiatives for multitenancy control plane including tenant controllers and hierarchical namespaces. The document outlines benchmarking categories and a proposed baseline reference implementation for multitenancy including control plane, data plane, and network isolation techniques.

All roads lead to the cloudDocker, Inc.

This document summarizes Liberty Mutual's journey with Docker EE to modernize applications and enable continuous deployment to the cloud. It discusses how Liberty Mutual started with Docker Datacenter 1.0 in 2015 to containerize applications and build a microservices architecture. They later upgraded to Docker Datacenter 2.1 to improve configuration management and reduce overhead. As of 2017, Liberty Mutual had over 330 services in production and Jenkins performing hundreds of deploys per day across 100 nodes and over 1500 services. The company aims to further automate operations using Kubernetes and improve security and inventory management. Alignment with agile teams was important to their success with Docker EE.

20 mins to Faking the DevOps Unicorn by Matt williams, DatadogDocker, Inc.

Something changed in job ads over the last few years: everyone wants the DevOps Unicorn. What is that and why did this happen? You probably have a good amount of what is in that description, but is there an easy way to fill in the rest of the 100%? It turns out that it is possible to fake your way to being a DevOps Unicorn. All that you need is a way to know which metrics are the most important. And to know that you need a framework that applies everywhere. No really, it's easier than you think. There is some work needed on your part, but just a few minutes is enough to get started. In this 20 minute session, we will cover what changed in the market, what the framework looks like, and how to apply it to all of the containerized applications you need to monitor.

Cloud Native DevelopmentManuel Garcia

In the modern era, software is commonly delivered as a service: called web apps, or software-as-a-service. The twelve-factor app is a methodology for building software-as-a-service apps that: Use declarative formats for setup automation, to minimize time and cost for new developers joining the project;Have a clean contract with the underlying operating system, offering maximum portability between execution environments;Are suitable for deployment on modern cloud platforms, obviating the need for servers and systems administration;Minimize divergence between development and production, enabling continuous deployment for maximum agility;And can scale up without significant changes to tooling, architecture, or development practices. The twelve-factor methodology can be applied to apps written in any programming language, and which use any combination of backing services (database, queue, memory cache, etc).

Using csi snapshot.pptxLibbySchulze

CSI snapshots provide a consistent backup method for Kubernetes applications. Snapshots capture all files in an application's persistent volume claim at the same time, avoiding data discrepancies that can occur with filesystem copies. While snapshots are crash consistent, they may not be application consistent without flushing data. The CSI driver framework allows storage vendors to integrate with Kubernetes without modifying the Kubernetes codebase, improving extensibility and manageability of storage backups.

Open Container Technologies and OpenStack - Sorting Through Kubernetes, the O...Daniel Krook

Presentation at the OpenStack Summit in Barcelona, Spain on October 25, 2016. http://bit.ly/os-kub-oci-cncf Containers along with next generation topics such as orchestration and serverless computing continue to draw interest across the application developer and data center operator communities because of the enormous potential of the technology and the rapid pace of change. As the potential of Docker continues to evolve, Kubernetes emerges as the leading orchestration technology, and the OpenStack Magnum project has matured, many want to see shared governance over the baseline container specification and associated runtime and format/image to protect investments and enable confident adoption of this emerging technology. Join this session to learn the latest about the Open Container Initiative (www.opencontainers.org) and the Cloud Native Computing Foundation (cncf.io) - both collaborative projects of the Linux Foundation - that drive the latest cloud native technologies and projects and see how they relate to Magnum and Kuryr. Daniel Krook, Senior Software Engineer, IBM Jeffrey Borek, Program Director, Open Tech, IBM Sarah Novotny, Senior Kubernetes Community Manger, Google

Red Hat multi-cluster management & what's new in OpenShiftKangaroot

10 tips for Cloud Native SecurityKarthik Gaekwad

Data protection in a kubernetes-native worldLibbySchulze

This document discusses data protection challenges in Kubernetes environments. It notes that traditional VM-based backup falls short for containerized applications due to lack of application visibility and scale. A Kubernetes-native approach is needed that focuses on complete application capture including resources and persistent state. It also discusses DevOps challenges around skills gaps and need for self-service, as well as concerns around Kubernetes upgrades, security, and ecosystem integration. The document promotes Kasten K10 as a solution built specifically for Kubernetes that provides ease of use, automation, security and support for applications across clusters and clouds.

SUSE CaaSP: deploy OpenFaaS and Ethereum Blockchain on KubernetesJuan Herrera Utande

This document discusses potential use cases for Kubernetes and provides examples of deploying serverless/Function as a Service (FaaS) workloads and blockchain databases on Kubernetes. It introduces OpenFaaS as an easy way to deploy FaaS on Kubernetes and deploy a demo Ethereum blockchain on Kubernetes to illustrate how blockchain concepts map to Kubernetes components. The document encourages finding a new use case in your organization to start using Kubernetes and provides resources for learning more about deploying Kubernetes.

AnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenarioRoberto Carratala

Roberto Carratalá and Diego Escobar will present on automating cybersecurity solutions in a cloud native scenario using Red Hat Ansible Tower. The presentation will cover 5 labs demonstrating how to provision Tower, deploy an Azure environment, automatically configure Checkpoint security management and gateways, deploy applications with cybersecurity rules, and deploy NAT and firewall access rules. Red Hat experts Adrienne, Leonardo, Asier, and German will assist during the presentation. Access details and passwords to the lab environments are provided.

Faster safer and 100 user centric application at equifax with dockerDocker, Inc.

Equifax faced challenges around software development lifecycles, vulnerability detection, and security. They implemented Docker to improve security, reduce development cycles, and support multiple platforms. Their solution involved Docker Swarm for infrastructure, CI/CD pipelines for builds and deployments, and Dockerized applications including APIs, web apps, and mobile apps. This allowed them to deliver a new product in 3 months with greater transparency, faster deployments, improved security and scaling.

Data Agility for Devops - OSI 2018OpenEBS

About the Talk: Cloud native ecosystem is bringing a huge change in the way of DevOps in every cloud native organisation. Developers and operators in cloud native organisations are using tools and platforms like Kubernetes to achieve the agility promised by DevOps and microservices. The tools and best practices for stateless applications have been well established and the results can be seen in the agility of teams using these stateless applications. However, stateful applications pose new challenges to DevOps teams in achieving the agility as the best practices around persistent storage management are still emerging. In this talk, first we discuss the challenges faced by DevOps while dealing with persistent storage handling in stateful applications. Then we discuss the open source tools and best practices for DevOps teams to achieve data agility of cloud native applications.

Episode 1: Building Kubernetes-as-a-ServiceMesosphere Inc.

The Kubernetes cloud native landscape is vast. Delivering a solution requires managing a puzzling array of required tooling, monitoring, disaster recovery, and other solutions that lie outside the realm of the central cluster. The governing body of Kubernetes, the Cloud Native Computing Foundation, has developed guidance for organizations interested in this topic by publishing the Cloud Native Landscape, but while a list of options is helpful it does not give operations and DevOps professionals the knowledge they need to execute. Learn best practices of setting up and managing the tools needed around Kubernetes. This presentation covers popular open source options (to avoid lock in) and how one can implement and manage these tools on an ongoing basis. Learn from, and do not repeat, the mistakes of previous centralized platforms. In this session, attendees will learn: 1. Cloud Native Landscape 101 - Prometheus, Sysdig, NGINX, and more. Where do they all fit in Kubernetes solution? 2. Avoiding the OpenStack sprawl of managing a multiverse of required tooling in the Kubernetes world. 3. Leverage technology like Kubernetes, now available on DC/OS, to provide part of the infrastructure framework that helps manage cloud native application patterns.

More Related Content

What's hot (20)

Tectonic Summit 2016: Brandon Philips, CTO of CoreOS, KeynoteCoreOS

Gentle introduction to containers and kubernetesNills Franssens

CNCF Introduction - Feb 2018Krishna-Kumar

Kubernetes on DC/OSCloud Technology Experts

Using the SDACK Architecture on Security Event Inspection by Yu-Lun Chen and ...Docker, Inc.

Docker Federal Summit 2017 General SessionDocker, Inc.

Modernizing Traditional ApplicationsDocker, Inc.

Pivotal Container Service (PKS) at SF Cloud Foundry Meetupcornelia davis

Kubecon US 2019: Kubernetes Multitenancy WG Deep DiveSanjeev Rampal

All roads lead to the cloudDocker, Inc.

20 mins to Faking the DevOps Unicorn by Matt williams, DatadogDocker, Inc.

Cloud Native DevelopmentManuel Garcia

Using csi snapshot.pptxLibbySchulze

Open Container Technologies and OpenStack - Sorting Through Kubernetes, the O...Daniel Krook

Red Hat multi-cluster management & what's new in OpenShiftKangaroot

10 tips for Cloud Native SecurityKarthik Gaekwad

Data protection in a kubernetes-native worldLibbySchulze

SUSE CaaSP: deploy OpenFaaS and Ethereum Blockchain on KubernetesJuan Herrera Utande

AnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenarioRoberto Carratala

Faster safer and 100 user centric application at equifax with dockerDocker, Inc.

Tectonic Summit 2016: Brandon Philips, CTO of CoreOS, KeynoteCoreOS

Gentle introduction to containers and kubernetesNills Franssens

CNCF Introduction - Feb 2018Krishna-Kumar

Kubernetes on DC/OSCloud Technology Experts

Using the SDACK Architecture on Security Event Inspection by Yu-Lun Chen and ...Docker, Inc.

Docker Federal Summit 2017 General SessionDocker, Inc.

Modernizing Traditional ApplicationsDocker, Inc.

Pivotal Container Service (PKS) at SF Cloud Foundry Meetupcornelia davis

Kubecon US 2019: Kubernetes Multitenancy WG Deep DiveSanjeev Rampal

All roads lead to the cloudDocker, Inc.

20 mins to Faking the DevOps Unicorn by Matt williams, DatadogDocker, Inc.

Cloud Native DevelopmentManuel Garcia

Using csi snapshot.pptxLibbySchulze

Open Container Technologies and OpenStack - Sorting Through Kubernetes, the O...Daniel Krook

Red Hat multi-cluster management & what's new in OpenShiftKangaroot

10 tips for Cloud Native SecurityKarthik Gaekwad

Data protection in a kubernetes-native worldLibbySchulze

SUSE CaaSP: deploy OpenFaaS and Ethereum Blockchain on KubernetesJuan Herrera Utande

AnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenarioRoberto Carratala

Faster safer and 100 user centric application at equifax with dockerDocker, Inc.

Similar to PKS - Solving Complexity for Modern Data Workloads (20)

Data Agility for Devops - OSI 2018OpenEBS

Episode 1: Building Kubernetes-as-a-ServiceMesosphere Inc.

Pivotal Cloud Foundry 2.0: First LookVMware Tanzu

Pivotal Cloud Foundry 2.0 is a presentation about new features in Pivotal's platform as a service (PaaS) offering. Key updates include deeper integration with VMware NSX for networking and security, a new monitoring dashboard called PCF Healthwatch, support for Windows containers and .NET applications, and new services like Pivotal Container Service (PKS) for Kubernetes and Pivotal Function Service (PFS) for serverless functions. The presentation discusses how these updates help with developer productivity, operational efficiency, security, and running applications on any infrastructure as a service (IaaS).

Choosing PaaS: Cisco and Open Source Options: an overviewCisco DevNet

This document discusses container platforms and PaaS. It provides context on containers and supporting technologies like Docker. It describes how containers are limited when confined to a single host, and how schedulers can distribute containers across multiple hosts. It outlines common production tools used with containers like configuration management, monitoring, and logging. It compares PaaS and containers, noting how PaaS consumed containers before they were widely known, and how the lines between the two are blurring as container platforms provide more services. It introduces Mantl as Cisco's container stack designed to run container workloads and big data applications across clouds.

Kubernetes: A Top Notch Automation SolutionFibonalabs

Kubernetes is a portable, extensible open-source platform that facilitates automated deployment, scaling, and management of Linux containerized applications. It was developed by Google, written using the GO language. It is a PaaS(Platform as a Service) when used on the cloud, whereas it is also flexible as an IaaS(Infrastructure as a Service) and SaaS(Software as a Service) by enabling portability, simplified scaling, and provision of robust software models.

Secrets of Successful Cloud Foundry AdoptersVMware Tanzu

This document discusses secrets of successful adoptions of Cloud Foundry. It provides examples of companies that have used Cloud Foundry to improve operations, increase developer productivity, and enhance security. Specific outcomes mentioned include reducing wait times, increasing revenue, and performing updates more frequently. It also discusses metrics for measuring the success of digital transformations and emphasizes the importance of measuring the right metrics.

Pivotal Developer-Ready Infrastructure SlidesVMware Tanzu

This document discusses developer ready infrastructure and the evolution of cloud platforms. It argues that platforms need to support developers through automation and by handling operational concerns so developers can focus on building applications. It outlines different platform layers from infrastructure as a service (IaaS) to fully managed application platforms and serverless functions. Pivotal's approach leverages Kubernetes, BOSH, and Cloud Foundry to provide a fully automated and production-ready container platform that can run on any cloud and handle all operational tasks.

2017 Microservices Practitioner Virtual Summit: Ancestry's Journey towards Mi...Ambassador Labs

Adopting new development approaches such as containerization is a big change for traditional enterprise environments. Ancestry, the global leader in family history and consumer genomics, has been a big data company long before the term existed with billions of historical records and millions of family trees, much of which ran in a traditional IT environment. With a new flood of genomic data from its AncestryDNA test and the desire to continue to increase the speed of innovation, Ancestry adopted containerization and micro services using Kubernetes orchestration APIs. This session will describe Ancestry's journey to containerization and how a coherent and consistent API set such as Kubernetes can aid companies looking to make a similar transition. Paul MacKay, one of Ancestry’s Software Architects, will discuss what the company has learned during the past few years of development from both a technical and cultural change perspective.

DevOps in Age of KubernetesMesosphere Inc.

There is a transformation brewing for DevOps in age of Kubernetes. The tools of the trade, configuration management solutions, have been superseded in agility and preference by development teams who want the declarative choreography of containerized applications. The new preference for mixing developer and operations is the site reliability engineering (SRE) model championed by Google. In this new structure, the need to automate doesn’t stop at the containerized application and DevOps professionals should seek to automate the Kubernetes service itself.

Cloud Computing using OpenStackJobayer Almahmud Hossain (RHCA, RHCDS, RHCSS)

This document discusses BRAC's transition to using OpenStack for its private cloud infrastructure. It provides an overview of cloud computing and OpenStack, including definitions, components, and architecture. It describes BRAC's transformation from physical servers to virtualization to OpenStack. BRAC chose OpenStack because it is open source, massively scalable, has a large community and developer base, and no licensing fees.

OpenStack Block Storage 101NetApp

This document provides an overview of OpenStack Block Storage (Cinder) and how it addresses challenges of scaling virtual environments. It discusses how virtualization led to cloud computing with goals of abstraction, automation, and scale. OpenStack was created as open source software to build and manage clouds with common APIs. Cinder provides block storage volumes to OpenStack instances, managing creation and attachment. SolidFire's storage system offers comprehensive Cinder support with guaranteed performance, high availability, and scale for production use.

Enabling Business Agility with SUSE CaaS PlatformSUSE

This document discusses enabling business agility with SUSE CaaS Platform. It describes how containers can make more efficient use of server resources while empowering development and operations staff. Containers allow developers to deploy the same code to development and production. SUSE CaaS Platform simplifies deployment and management of containers at scale through features like orchestration, load balancing, scaling, monitoring and maintenance. It provides a complete, curated platform to achieve faster time to value when deploying applications.

Open shift and docker - october,2014Hojoong Kim

Billions of Messages in Real Time: Why Paypal & LinkedIn Trust an Engagement ...confluent

(Bruno Simic, Solutions Engineer, Couchbase) Breakout during Confluent’s streaming event in Munich. This three-day hands-on course focused on how to build, manage, and monitor clusters using industry best-practices developed by the world’s foremost Apache Kafka™ experts. The sessions focused on how Kafka and the Confluent Platform work, how their main subsystems interact, and how to set up, manage, monitor, and tune your cluster.

Kubernetes meetup bangalore december 2017 - v02Kumar Gaurav

The document summarizes key announcements and discussions from the Kubernetes Meetup in Bangalore on December 16th 2017. Over 4,100 people attended the event where it was announced that CNCF now hosts 14 open source projects and 31 new members joined at the Silver level. Some of the discussions focused on the growing adoption of Kubernetes for building cloud-native applications, new projects being developed for Kubernetes like Metaparticle and Kata Containers, and the rise of serverless architectures and service meshes like Istio. The 2018 Europe Conference for Kubernetes and Cloud Native was also announced.

OpenStack in Action! 5 - Dell - OpenStack powered solutions - Patrick HamoneNovance

This document discusses Dell/Intel OpenStack-powered solutions and provides the following key points: 1) OpenStack is an open-source cloud operating system that is growing rapidly in adoption with over 10,000 individual members and contributors from over 70 countries. 2) Dell offers OpenStack reference architectures, hardware, software, services, and support to help customers accelerate their adoption of private and hybrid cloud solutions based on OpenStack. 3) Case studies show how Dell OpenStack solutions have helped customers like a research university and web hosting provider build scalable, cost-effective private clouds to meet their infrastructure and data storage needs.

Mesos and Kubernetes ecosystem overviewKrishna-Kumar

Democratizing Data Science on Kubernetes John Archer

PaaS with DockerAditya Jain

The presentation describes the functionality as well as the advantages of a project undertaken by us in the Cloud Computing course whereby we build a PaaS using Docker. The link to the project is : https://github.com/kanika2107/Paas_with_Docker_CloudProject Demo video : https://www.youtube.com/watch?v=2h-hodrzTu8&feature=youtu.be #IIITHyderabad #CloudComputing #CSE565 #Monsoon15 #SIEL #Docker #PaaS #Apache #Containers #PHP #SQL #HTML #Web2Py

Kubernetes - An introductionLoves Cloud

Data Agility for Devops - OSI 2018OpenEBS

Episode 1: Building Kubernetes-as-a-ServiceMesosphere Inc.

Pivotal Cloud Foundry 2.0: First LookVMware Tanzu

Choosing PaaS: Cisco and Open Source Options: an overviewCisco DevNet

Kubernetes: A Top Notch Automation SolutionFibonalabs

Secrets of Successful Cloud Foundry AdoptersVMware Tanzu

Pivotal Developer-Ready Infrastructure SlidesVMware Tanzu

2017 Microservices Practitioner Virtual Summit: Ancestry's Journey towards Mi...Ambassador Labs

DevOps in Age of KubernetesMesosphere Inc.

Cloud Computing using OpenStackJobayer Almahmud Hossain (RHCA, RHCDS, RHCSS)

OpenStack Block Storage 101NetApp

Enabling Business Agility with SUSE CaaS PlatformSUSE

Open shift and docker - october,2014Hojoong Kim

Billions of Messages in Real Time: Why Paypal & LinkedIn Trust an Engagement ...confluent

Kubernetes meetup bangalore december 2017 - v02Kumar Gaurav

OpenStack in Action! 5 - Dell - OpenStack powered solutions - Patrick HamoneNovance

Mesos and Kubernetes ecosystem overviewKrishna-Kumar

Democratizing Data Science on Kubernetes John Archer

PaaS with DockerAditya Jain

Kubernetes - An introductionLoves Cloud

More from Carlos Andrés García (8)

Cloud Native Security: New Approach for a New RealityCarlos Andrés García

Tsvi Korren, VP of Product Strategy at Aqua Security CISSP, has been an IT security professional for over 25 years. In previous positions at DEC and CA Inc., he consulted with various industry verticals on the process and organizational aspects of security. As the VP of Product Strategy at Aqua, he is tasked with delivering commercial and open source solutions that make Cloud Native workloads the most secure, compliant and resilient application delivery platform.

Automate and Enhance Application Security AnalysisCarlos Andrés García

Dave Meurer currently serves as the Senior Technical Alliances Manager at Synopsys' Software Integrity Group’s Business Development team, where he leads technical planning, solution development, enablement, and evangelism with existing and potential strategic alliances and partners of Synopsys. Dave joined Synopsys through the acquisition of Black Duck, where he served in a similar role as the director of sales engineering for North America. Before coming to Black Duck Software, Dave worked for Skyway Software, HSN.com, and Accenture in various management and development roles. When he’s not thinking about joint partner solutions, he plays Uber driver for his five kids’ sports activities. Follow him on Twitter at @davemeurer.

Securing a Cloud MigrationCarlos Andrés García

Erik Costlow, Product Evangelist at Contrast Security, was Oracle's principal product manager for Java 8 and 9, focused on security and performance. His security expertise involves threat modeling, code analysis, and instrumentation of security sensors. He is working to broaden this approach to security with Contrast Security. Before becoming involved in technology, Erik was a circus performer who juggled fire on a three-wheel vertical unicycle.

Cloud-Native Streaming Platform: Running Apache Kafka on PKS (Pivotal Contain...Carlos Andrés García

This document discusses running Apache Kafka on Kubernetes using the Confluent Operator. It provides an overview of Kafka's architecture including sharding, replication, and scaling. It then covers how the Operator allows automated provisioning, operations, resiliency and monitoring of Kafka and Confluent Platform on Kubernetes through custom resource definitions and controllers. The Operator helps with tasks like rolling upgrades, scaling, and meeting SLAs. Resources are provided to learn more about running Kafka on Kubernetes.

PostgreSQL-as-a-Service with Crunchy PostgreSQL for PKSCarlos Andrés García

High performance Spark distribution on PKS by SnappyDataCarlos Andrés García

A Planet-Scale Database for Low Latency Transactional Apps by YugabyteCarlos Andrés García

Orchestrating Stateful Applications with PKS and PortworxCarlos Andrés García

Cloud Native Security: New Approach for a New RealityCarlos Andrés García

Automate and Enhance Application Security AnalysisCarlos Andrés García

Securing a Cloud MigrationCarlos Andrés García

Cloud-Native Streaming Platform: Running Apache Kafka on PKS (Pivotal Contain...Carlos Andrés García

PostgreSQL-as-a-Service with Crunchy PostgreSQL for PKSCarlos Andrés García

High performance Spark distribution on PKS by SnappyDataCarlos Andrés García

A Planet-Scale Database for Low Latency Transactional Apps by YugabyteCarlos Andrés García

Orchestrating Stateful Applications with PKS and PortworxCarlos Andrés García

Recently uploaded (20)

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

Top 10 IT Help Desk Outsourcing ServicesInfrassist Technologies Pvt. Ltd.

Splunk Security Update | Public Sector Summit Germany 2025Splunk

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

Join this UiPath Community Berlin meetup to explore the Orchestrator API, Swagger interface, and the Test Manager API. Learn how to leverage these tools to streamline automation, enhance testing, and integrate more efficiently with UiPath. Perfect for developers, testers, and automation enthusiasts! 📕 Agenda Welcome & Introductions Orchestrator API Overview Exploring the Swagger Interface Test Manager API Highlights Streamlining Automation & Testing with APIs (Demo) Q&A and Open Discussion Perfect for developers, testers, and automation enthusiasts! 👉 Join our UiPath Community Berlin chapter: https://community.uipath.com/berlin/ This session streamed live on April 29, 2025, 18:00 CET. Check out all our upcoming UiPath Community sessions at https://community.uipath.com/events/.

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

AI and Data Privacy in 2025: Global TrendsInData Labs

In this infographic, we explore how businesses can implement effective governance frameworks to address AI data privacy. Understanding it is crucial for developing effective strategies that ensure compliance, safeguard customer trust, and leverage AI responsibly. Equip yourself with insights that can drive informed decision-making and position your organization for success in the future of data privacy. This infographic contains: -AI and data privacy: Key findings -Statistics on AI data privacy in the today’s world -Tips on how to overcome data privacy challenges -Benefits of AI data security investments. Keep up-to-date on how AI is reshaping privacy standards and what this entails for both individuals and organizations.

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots. 📕 Here's what you can expect: - Modeling: Build end-to-end processes using BPMN. - Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes. - Operating: Control process instances with rewind, replay, pause, and stop functions. - Monitoring: Use dashboards and embedded analytics for real-time insights into process instances. This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes. 👨‍🏫 Speaker: Andrei Vintila, Principal Product Manager @UiPath This session streamed live on April 29, 2025, 16:00 CET. Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including: -Artificial Intelligence Market Overview -Strategies for AI Adoption in 2025 -Anticipated drivers of AI adoption and transformative technologies -Benefits of AI and Big data for your business -Tips on how to prepare your business for innovation -AI and data privacy: Strategies for securing data privacy in AI models, etc. Download your free copy nowand implement the key findings to improve your business.

Cyber Awareness overview for 2025 month of securityriccardosl1

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Heap, Types of Heap, Insertion and DeletionJaydeep Kale

Are Cloud PBX Providers in India Reliable for Small Businesses (1).pdfTelecoms Supermarket

Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma

Build 3D Animated Safety Induction - Tech EHSTECH EHS Solution

Train Smarter, Not Harder – Let 3D Animation Lead the Way! Discover how 3D animation makes inductions more engaging, effective, and cost-efficient. Check out the slides to see how you can transform your safety training process! Slide 1: Why 3D animation changes the game Slide 2: Site-specific induction isn’t optional—it’s essential Slide 3: Visitors are most at risk. Keep them safe Slide 4: Videos beat text—especially when safety is on the line Slide 5: TechEHS makes safety engaging and consistent Slide 6: Better retention, lower costs, safer sites Slide 7: Ready to elevate your induction process? Can an animated video make a difference to your site's safety? Let's talk.

TrsLabs Consultants - DeFi, WEb3, Token ListingTrs Labs

tecnologias de las primeras civilizaciones.pdffjgm517

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

Top 10 IT Help Desk Outsourcing ServicesInfrassist Technologies Pvt. Ltd.

Splunk Security Update | Public Sector Summit Germany 2025Splunk

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

AI and Data Privacy in 2025: Global TrendsInData Labs

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

Cyber Awareness overview for 2025 month of securityriccardosl1

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Heap, Types of Heap, Insertion and DeletionJaydeep Kale

Are Cloud PBX Providers in India Reliable for Small Businesses (1).pdfTelecoms Supermarket

Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma

Build 3D Animated Safety Induction - Tech EHSTECH EHS Solution

TrsLabs Consultants - DeFi, WEb3, Token ListingTrs Labs

tecnologias de las primeras civilizaciones.pdffjgm517

PKS - Solving Complexity for Modern Data Workloads

3. A production ready platform enabling self-serve provisioning of Kubernetes clusters and containerized workloads. Fully automated Ops Multi Cloud Network management and security Built with open-source Kubernetes

4. What is it? Kubernetes is a portable, extensible open-source platform for managing containerized workloads and services. Kubernetes provides a container-centric management environment. Kubernetes is not a traditional, all-inclusive PaaS (Platform as a Service) system. Interesting Fact: The name Kubernetes originates from Greek, meaning helmsman or pilot.

5. What is it? BOSH is an open source tool chain for release engineering, deployment, and lifecycle management of large scale distributed services. BOSH installs and updates software packages on large numbers of VMs over many IaaS providers. BOSH orchestrates initial deployments and ongoing updates that are: Predictable, repeatable, and reliable!

6. Cloud Foundry Container Runtime Project Feb 2017 - Project Kubo was created by Pivotal & Google June 2017 - Donated to Cloud Foundry Foundation October 2017 - Renamed from Kubo to Cloud Foundry Container Runtime February 2018 - Pivotal begins support of PKS backed by CFCR Resources: CFCR Bosh Release - https://github.com/cloudfoundry-incubator/kubo-release CFCR Docs - https://docs-cfcr.cfapps.io/

9. Cloud Provider Interfaces Pivotal Application Service (PAS) Pivotal Container Service (PKS) >cf push >kubectl run vSphere Azure & Azure StackGoogle CloudAWSOpenstack Pivotal Services Marketplace Pivotal and Partner Products

10. *Azure support soon! PKS Supported Cloud Providers

11. So you’re a successful Data Administration team...

12. Everything was great until….

13. Someone thought this was a good idea...

15. The most widely used container images...

16. Challenges of containerizing databases... “They require high-throughput and low-latency networking capabilities.” “They require, in our use, an ability to handle persistent data storage.” “They require layers of complex configuration.” “They require disk space to store large amounts of data, and are thus less portable.” Source: New Relic - https://blog.newrelic.com/product-news/containerizing-databases/

17. The goodness of databases in containers... “Rapidly deploy and scale new technologies.” “Consistent configuration and delivery of data services.” “Makes sense for shared nothing and distributed database platforms.” “Helps with staying up on the data engine upgrade cycle, yet that still needs some more attention.”

18. ● Run stateful workloads in containers ● Enable locating workloads closer to data ● Provide HA, monitoring, and automated operations ● Security that is inherent by design ● Focus on delivering meaningful & actionable data! ● Offer new technologies (distributed & shared nothing) ● Reduce complexity of service offerings

19. A production ready platform enabling self-serve provisioning of Kubernetes clusters and containerized workloads. Fully automated Ops Multi Cloud Network management and security Built with open-source Kubernetes

Editor's Notes

#4: A turnkey solution (OpsManager tile + PKS API) to provision, operate and manage enterprise grade Kubernetes clusters Enterprise grade - No assembly required: OS, Registry, K8s, networking, storage included
#7: CFCR is the OSS Core of PKS. Dev/Eng collaboration A Kubernetes Bosh Release
#11: Future state: all clouds supported by BOSH.Q1’18: vSphere and GCP | Q2’18: AWS | Q3/Q4’18: OpenStack & Azure
#20: A turnkey solution (OpsManager tile + PKS API) to provision, operate and manage enterprise grade Kubernetes clusters Enterprise grade - No assembly required: OS, Registry, K8s, networking, storage included

PKS - Solving Complexity for Modern Data Workloads

Recommended

More Related Content

What's hot (20)

Similar to PKS - Solving Complexity for Modern Data Workloads (20)

More from Carlos Andrés García (8)

Recently uploaded (20)

PKS - Solving Complexity for Modern Data Workloads

Editor's Notes