The Building Blocks of DX: K8s Evolution from CLI to GitOps

Jul 25, 20200 likes245 views

Kubernetes has become the default container orchestrator framework, setting the standards for application deployment in a distributed architecture. Wider adaptability of the tool prompted the diversification of the end-user base, and a consistent DX for cluster interaction became essential for Kubernetes. The community channeled herculean efforts towards the enhancement of developer experience, by extending the cluster CLI, building portals and highly-responsive UIs. This talk will focus on the cluster interaction chronicles, showcasing tools and add-ons which contributed to a wider adoption for Kubernetes. An emphasis will be place on kubectl plugins and cluster state managers using mechanisms such as GitOps, ClickOps and even SheetOps.

THE CLOUD
CONNECTIVITY COMPANY
Destination:
Automation
San Francisco, CA
July 2020
THE CLOUD CONNECTIVITY
COMPANY
1

Katie Gamanji
Cloud Platform Engineer
@American Express
Technical Oversight Committee
@CNCF
@k_gamanji katie-gamanji

The Building
Blocks of DX
K8s Evolution from CLI to
GitOps
@k_gamanji katie-gamanji

Cluster CLI
DX Enhancement
ApplicationOps

The Building Blocks of DX: K8s Evolution from CLI to GitOps

Production
Systems
58%
Contributors
2K
KubeCon
Attendees
23K

Application developers
Application operators
Infrastructure operators

kubectl
Command line tool for
interaction and management of
Kubernetes objects.

KUBECONFIG
● ~/.kube/config
● --kubeconfig
● export KUBECONFIG

SIG-CLI:
● 40+ operations
● 70+ ﬂags
● Declarative and imperative
management techniques
kubectl

DX Enhancement
1. Simplicity
2. Optimization
3. Transparency
4. Durability

DX Enhancement
Extensions
Kubectl plugins
Wrappers
Web and terminal UIs

● Extend kubectl features
● Support for any language
● Custom DX
Kubectl Plugins

$ cat /usr/local/bin/kubectl-greetings
#!/bin/bash
echo "Hello Cloud Native!"
Kubectl
Plugins

$ kubectl plugin list
The following compatible plugins are
available:
/usr/local/bin/kubectl-greetings
/Users/bonsai/.krew/bin/kubectl-krew
/Users/bonsai/.krew/bin/kubectl-tree
Kubectl
Plugins

$ kubectl greetings
Hello Cloud Native!
Kubectl
Plugins

● Service discovery for plugins
● 90+ custom add-ons
● Plugin version manager

https://stats.krew.dev/

kubectl
plugins
Tailored CLI
Plugins + aliases
No overwrite

● Point of presence
● Developer-ﬁrst
● Coverage of basic operations
Kubectl Wrappers

ClickOps
Application deployment is
represented by a collection of
“clicks” through a myriad of menu
settings.

ClickOps Abstraction level
Powerful DX
Roll-backs

GitOps
Git repositories as the source of
truth for deﬁning the desired
application state.

GitOps
● PR based rollout
● Automatic reconciliation
● Versioned cluster state

SheetOps
Control the Kubernetes state
using Google Spreadsheets.

SheetOps
Control the Kubernetes state
using Google Spreadsheets.
Mission: replace YAML with spreadsheets

So far ...
K8s Evolution from CLI to GitOps
kubectl
apply -f micro.yaml kubectl
microsvc create
UI
git push

Cluster DX
Declarative conﬁguration
schema that advocates for
extensibility and
optimization of the user
journey.

Reach out!
@k_gamanji katie-gamanji
medium.com/@kgamanji

Simply connecting to a Kubernetes Service or a load balancer is nice -- if that is even an option. These days, operators have to contend with hybrid and multi-cloud. Namespaces are not enough; it's not uncommon to operate numerous K8s clusters in a single region with traffic being dynamically routed across multiple control planes. This session dives into the process of identifying requirements for a Kubernetes gateway that needs to handle both HTTP based services as well as hyper-optimized TCP workloads. Attendees will walk away with a working knowledge and a process to develop out ingress solutions that fit their needs, including: Deploying a local K8s cluster with K3d Installing the DataStax Kubernetes Operator for Apache Cassandra with Helm Provisioning and running a multi-node Cassandra cluster Deploying Kong Gateway with Helm Implementing multiple ingress approaches through Kong Gateway, with an accompanying discussion on the pros and cons of each Validation of each approach through an external client application

Continuous Deployment for Staging and Production EnvironmentsOlyaSurits

Continuous Deployment allows teams to get immediate feedback, debug, iterate, and fail fast, ultimately getting a better product into the hands of users faster. In this talk, Kendra and Celia will talk about the challenges and benefits of continuously deploying their staging environments and how they applied that to their production environment during the development of CockroachCloud. They will discuss their use of: Iterative development including PR structure and feature decomposition Pushing all PR to staging environment Feature Flags to make the customer magic happen

Security, Automation and the Software Supply ChainOlyaSurits

This document discusses software supply chain security and container deployment best practices. It recommends using continuous integration/continuous delivery pipelines to automate building, testing, and deploying container images. The document also advocates for scanning container images for vulnerabilities, digitally signing images, and controlling access to images and runtimes using policies. Canary and blue/green deployments are introduced as strategies to reduce risk when deploying changes.

Implementing a Reliable, Auto-Healing Scalable Platform at VMwareOlyaSurits

This document discusses VMware IT's implementation of a reliable, auto-healing, and scalable API gateway platform. They used multiple Kubernetes platforms across two data centers to enable auto-failover and auto-scaling. Centralized logging and monitoring tools provide visibility and enable fast troubleshooting. Custom scripts perform auto-failover between data centers upon failure detection. A combination of open-source and VMware tools allow for chaos engineering and testing of resiliency.

APIOps: Automated Processes for Even Better APIsOlyaSurits

The development of APIs always begins with the old -- and meanwhile boring -- battle of API-first or code-first. However, working with APIs involves a process that includes design, development and operation. With this in mind, along with the various ways API gateways and API platforms can support these processes, the question of how to automate these processes arises very quickly. In this session, Daniel Kocot will show how API gateways and API platforms can positively influence the development process of APIs based on the DevOps concept and CAMS model to deliver better and better APIs to consumers.

A Better Way for Applications to Communicate With Your MeshOlyaSurits

Ingress gateways are a quick and easy way to enable external clients to communicate with a service mesh. To demonstrate this, we implemented a powerful ingress gateway with a reliable ingress controller in an auto-healing, scalable platform. In this talk, we will demo several use cases, including service-to-service authorization with mTLS, service segmentation, and connectivity of services running on any platform to the service mesh. The solution we will share is built using HashiCorp Consul Ingress Gateway with Kong Ingress Controller on a Kubernetes platform with Consul Envoy proxy.

Full Stack Automation With GoOlyaSurits

The document discusses infrastructure as code and full stack automation using programming languages and tools like Pulumi and AWS CDK. It describes organizational problems with complexity and silos that infrastructure as code aims to address. The presentation includes an anatomy of infrastructure stacks, a demo, and benefits like providing a single pane of glass and familiarity for developers to manage infrastructure through code.

Connectivity Is the FutureOlyaSurits

As we grow our businesses, we transform our applications to become distributed and decoupled to iterate faster on customer feedback, adapt quicker to market transitions and improve reliability and availability. In this new distributed and decoupled era, we introduce service connectivity at the backbone of our applications at an unprecedented scale, and we need to adopt a new kind of platform to abstract away service connectivity from the application teams so that the business can innovate with minimal fragmentation and maximum speed. We need a service connectivity platform that allows the organization to break down vertical silos like API management and service mesh for a fully integrated connectivity abstraction. In this session, we will explore the market transitions that are defining this new distributed and decoupled era, and we will identify the main foundations for the new service connectivity platform category.

Building successful business Java apps: How to deliver more, code less, and c...Red Hat Developers

Building business applications is, in a higher-level perspective, a way to translate business needs into runnable software. Unfortunately, this is easier said than done. The complexity of encoding business requirements requires overcoming several challenges, such as improving communication between stakeholders and increasing agility of delivery. In this presentation, we'll learn how developers can "up" their game, deliver more in the cloud with less effort, and even increase communication skills.

Cloud Native Testing, 2020 Edition: A Modern Blueprint for Pre-production Tes...OlyaSurits

Cloud native applications can benefit greatly from end-to-end testing before deployment, but integration testing of microservices is often discouraged because it's costly and difficult. This talk proposes a modern blueprint for cloud native application testing, focusing on pre-production testing and in particular integration testing. Topics discussed include how to handle common challenges with end-to-end and integration testing, such as: Dealing with state How to speed up tests runs for improved developer feedback loops How to test the configuration of a whole system in the era of Infrastructure-as-Code We will also discuss other types of testing (such as testing in production), and pre-production workarounds often used as an alternative to integration testing (such as contract testing and test doubles), evaluating the pros and cons of each approach, and how they can complement each other.

Flexible, hybrid API-led software architectures with KongSven Bernhardt

Kong is a lightweight, cloud-native API solution that makes it easier and faster than ever to connect APIs and microservices in today’s hybrid, multi-cloud environments. With its agnostic, flexible deployment approach, Kong can be used in today’s heterogeneous IT system landscapes to integrate a wide variety of data and systems – even across company boundaries – using APIs. In addition to REST APIs, Kong also offers support for gRPC and GraphQL, which broadens the possibilities to implement modern application architectures. In this presentation, we will discuss deployment patterns and use cases for Kong to demonstrate the flexibility of the platform. Using a practical example, aspects of the API development and deployment process as well as the integration in existing software development processes will be discussed.

Importance of GCP: 30 Days of GCPAnshTyagi27

Google Cloud Platform (GCP) allows developers to build and deploy applications at scale. GCP provides infrastructure like virtual machines and containers to deploy applications without hardware limitations. It also offers services for continuous integration/delivery (CI/CD) pipelines, monitoring, error handling, and machine learning/artificial intelligence to add capabilities to applications. Completing a 30 day training on GCP can help engineers become more dynamic by learning how to use GCP's full suite of tools and services to build real-world applications.

Automating the API Product LifecycleOlyaSurits

Creating a successful API requires a proper process from concept and design, through development, and into ongoing maintenance and good developer support. There are many steps to a good API. As developer expectations for better-quality APIs increase, tools have made it easier to do this well. Looking at the full API Product Lifecycle to design an API people will use, Jeremy Glassenberg will share the newest tools -- and potentially upcoming opportunities -- to better automate the planning and creation of a solid developer program.

Meetup 23 - 03 - Application Delivery on K8S with GitOpsVietnam Open Infrastructure User Group

This document summarizes a presentation about deploying applications on Kubernetes with GitOps. The presentation covers GitOps workflows and tools like FluxCD and ArgoCD for managing Helm charts from Git repositories. It also discusses integrating continuous integration pipelines with ArgoCD and provides best practices for areas like secret management, scaling, and microservices. The presenter concludes by taking questions and inviting interested parties to join their company.

Designing a complete ci cd pipeline using argo events, workflow and cd productsJulian Mazzitelli

https://www.youtube.com/watch?v=YmIAatr3Who Presented at Cloud and AI DevFest GDG Montreal on September 27, 2019. Are you looking to get more flexibility out of your CICD platform? Interested how GitOps fits into the mix? Learn how Argo CD, Workflows, and Events can be combined to craft custom CICD flows. All while staying Kubernetes native, enabling you to leverage existing observability tooling.

[Konveyor] migrate and modernize your application portfolio to kubernetes wit...Konveyor Community

Meetup recording: https://youtu.be/S8ISWz87rlk Bringing legacy applications to Kubernetes can have a significant boost on software delivery performance – even without a complete rearchitecture and rewrite of your applications. The bigger question is, “How can an organization succeed in the daunting task of moving their legacy application portfolio to Kubernetes?” In this session, you’ll learn about Tackle, the Open Source toolkit designed to help organizations safely migrate and modernize their application portfolio to leverage Kubernetes. We will be discussing the benefits of bringing applications to Kubernetes, a common approach for migrating and modernizing them, and how Tackle can streamline the adoption process. We will also have a live demo for the first release of the tool! Presenter: Ramon Roman Nissen, Product Manager - Red Hat

CI:CD in Lightspeed with kubernetes and argo cdBilly Yuen

Enterprises have benefited greatly from the elastic scalability and multi-region availability by moving to AWS, but the fundamental deployment model remains the same. At Intuit, we have adopted k8s as our new saas platform and re-invented our CI/CD pipeline to take full advantage of k8s. In this presentation, we will discuss our journey from Spinnaker to Argo CD. 1. Reduce CI/CD time from 60 minutes to 10 minutes. 2. Reduce production release (or rollback) from 10 minutes to 2 minutes. 3. Enable concurrent deployment using spinnaker and argo cd as HA/DR to safely adopt the new platform with no downtime. 4. Be compatible with the existing application monitoring toolset.

Migrating from oracle soa suite to microservices on kubernetesKonveyor Community

Watch presentation recording: https://youtu.be/cxH6WjDZc2c In this session, we’ll explore how Randoli helped a Postal Technology company migrate their payment gateway applications off Oracle SOA Suite to Camel/Springboot on Kubernetes. The primary drivers for the migration were: move to cloud-native technologies in keeping with the organizational digital transformation mandate; move away from an outdated centralized platform to a decentralized architecture for efficiency, scalability, and manageability; and very high licensing costs of the existing platform. We’ll discuss: - The high-level approach we took during the migration including architecture and design decisions. - How we used Camel/Springboot to implement the services. - Why and how we used Drools for implementing business rules. - The test-driven approach using Camel testing framework and how it helped reduce issues. - CI/CD and build process on Kubernetes. - How we tackled logging, monitoring, and tracing challenges. Presenter: Rajith Attapattu, Managing Partner & CTO @ Randoli Inc.

Kubernetes and Docker Native Deployment Patterns for WSO2 Enterprise IntegratorWSO2

Container deployment is one of the most popular approaches in the industry. It helps you to move your code into different environments seamlessly. This deck will explore how you can write your integrations in a container friendly way and deploy it into the Kubernetes cluster. Discussion topics will also focus on k8s-EI-operator, the new project types introduced in WSO2 Integration studio, and how to integrate your project with CI/CD pipeline.

Automate Workflows With The Open-source Cloud-native Tool Boomerang FlowKonveyor Community

In the cloud-native workflow automation world, there are many great open-source projects such as Argo, Airflow, and Brigade. These tools require technical expertise to be used by business users, or they are aligned with a specific use case such as CI/CD. Boomerang Flow is an alternative tool that is usable by a business user but also provides an extensible framework developers can use for new use cases. It aims to replace Robotic Process Automation flows, which don’t necessarily need to be full-blown bots. And it doesn’t try to tackle use cases such as screen-scraping legacy green text applications. Instead, it tries to solve the problem where enterprises are using bots to perform tasks such as receiving a service now ticket and automatically moving it to a special status or workflow queue. These types of scenarios can be automated using Boomerang Flow. And the cost of running these workflows in Kubernetes is fractions of the cost of running an RPA bot for licensing. Presenters: Tyson W Lawrie, head of engineering - IBM, Marcus D Roy, Senior Lead Software engineer - IBM, and Benjamin Ruby, Analytics Consultant - IBM Recording link: https://youtu.be/-lOninwMoz4

Cloud Native API Management : Microservices to APIs in KubernetesWSO2

This document provides an overview of applying API management to microservices deployed in Kubernetes using the WSO2 API Operator. It discusses microservices architecture and service meshes. It then covers how the API Operator can be used to deploy an API gateway and apply API management functionality like security, throttling and monitoring to microservices. It provides examples of exposing microservices as APIs using both the "swagger first" and "publisher first" approaches. Finally, it outlines a demo of deploying sample microservices in an Istio service mesh and applying API management using the API Operator. Learning materials are also referenced to help understand configuring the required tools and components.

Automate The Creation/Transformation of Infrastructure as Code Artifacts with...Konveyor Community

Watch the demo: https://youtu.be/tmGSqK3BahU Konveyor Move2Kube helps automate your migration from various platforms such as cloud foundry, docker swarm, VM based applications, or from your custom framework to Kubernetes. With the latest release of Move2Kube, v0.3.0, it has acquired extensive customization capabilities to help create the target artifacts as per your organization requirements. In this session, the Move2Kube team will demonstrate the migration of a typical application to run on Kubernetes. It will be followed by a demonstration of customization capabilities of Move2Kube, such as customizing the generated Dockerfile, the directory structure, the helm chart and custom artifacts. Website: https://move2kube.konveyor.io/ GitHub repo: https://github.com/konveyor/move2kube/

Controller and Coffee: Deliver APIs in Real Time with API ManagementNGINX, Inc.

Watch the webinar https://www.nginx.com/resources/webinars/nginx-controller-coffee-july-2020/ About the Webinar In this third installment of our webinar series, we focus on how NGINX Controller provides full API lifecycle management to deliver real‑time APIs. We also discuss how our secure platform helps accelerate application delivery with cloud automation and high availability. We answer questions like these: – How can NGINX Controller’s API Management Module help API owners publish, secure, and manage their APIs? – Why is NGINX Controller’s Developer Portal valuable for API management? – What types of API insights are available with Controller? – What are the benefits of cloud automation? – What are the benefits of high availability, and when do you need it? – How can you avoid common mistakes with API management and cloud automation? – How secure is the NGINX Controller platform? If you’re responsible for managing APIs and API management tools, or involved in a digital transformation initiative to speed time to market and performance of your apps, don’t miss this webinar!

APIdays Paris 2018 - API Management is Dead, Augusto Marietti, CEO and Co-Fou...apidays

No Risk, No Reward: The Joys Of Testing In Production.UXDXConf

Natalia and Fabio will share their story of how the HBC DevOps culture and mindset evolved. Follow their journey from moving to a distributed microservice architecture to enable simple, quick and frequent production roll-outs, through phased deployments to dark and live canary nodes, to a radical 'no staging environment' approach. Hear about the benefits and caveats they've experienced along the way.

Migrating a Large Fortune 100 Healthcare Company to Kubernetes in 7 monthsKonveyor Community

Watch the presentation: https://youtu.be/E3LeAmH6Ems At the beginning of 2019, Chris Nuland and team were tasked with migrating a large mesosphere DC/OS cluster with hundreds of running containers to Kubernetes for a large fortune 100 healthcare company. One of the key challenges with this migration was the need to finish it within a 7 month timeframe to allow the sunsetting of DC/OS before the cluster’s end of life. In conjunction with this migration, there was also the need to containerize a couple hundred applications and deploy them into the newly built cluster. These tasks were completed in the desired time frame using a variety of migration and onboarding techniques, including the use of a few migration tools, like pathfinder, that would eventually be part of the Konveyor suite of applications. This presentation will go over many of the challenges of that migration, how certain tooling aided in the process, and how the process would look differently now given many of the migration tooling advantages found in the Konveyor suite of applications. Presenter: Christopher Nuland, Architect at Red Hat

Five Lessons Learned from Large-scale Implementation of Kubernetes in the Ent...DevOps.com

Learn what it takes to get a large-scale production Kubernetes cluster up and running in an on-premises environment. Get tips, best practices, and architectural approaches for the initial implementation. Understand the constraints, challenges, and how to solve for successful on-going day-2 operational issues. Join Sirish Raghuram, CEO of Platform9, and Ravi Ravichandran, VP cloud platform engineering at Juniper, for a fun conversational webinar where they will discuss how to avoid all the pitfalls of running production Kubernetes and ensuring high-reliability, scalability, and performance. They will also touch upon the implications of building and operating your own production clusters using your own resources and upstream Kubernetes versus commercial alternatives available in the market.

Bare Metal Cluster with Kubernetes, Istio and Metallb | Nguyen Phuong An, Ngu...Vietnam Open Infrastructure User Group

This document outlines an agenda for the Viet OpenInfra Days 2019 event. The event will cover Kubernetes clustering, MetalLB for load balancing, and Istio service mesh. It will include demonstrations and hands-on activities. The presenters will provide overviews of Kubernetes architecture, how MetalLB implements load balancing, and how Istio uses the Envoy proxy and sidecars to manage and secure microservices communication.

gitopsthekubernetesway-201026090439.pdfsaraichiba2

GitOps is a way of implementing continuous deployment for cloud native applications using Kubernetes. It focuses on a developer-centric experience by using tools like Git and continuous deployment that developers are already familiar with. GitOps uses Git as the single source of truth for infrastructure configuration and changes. It has four main principles: the system is described declaratively, Git is the single source of truth, changes can be automatically applied, and the system is continuously validated and improved. Common GitOps operators that facilitate continuous delivery include Flux, Argo CD, and Jenkins X. The GitOps model uses a pull-based deployment approach rather than pushing changes, improving security, observability, and productivity.

Gitops: the kubernetes waysparkfabrik

GitOps è un nuovo metodo di CD che utilizza Git come unica fonte di verità per le applicazioni e per l'infrastruttura (declarative infrastructure/infrastructure as code), fornendo sia il controllo delle revisioni che il controllo delle modifiche. In questo talk vedremo come implementare workflow di CI/CD Gitops basati su Kubernetes, dalla teoria alla pratica passando in rassegna i principali strumenti oggi a disposizione come ArgoCD, Flux (aka Gitops engine) e JenkinsX

More Related Content

What's hot (20)