Introduction of cloud native CI/CD on kubernetes

Aug 30, 20191 like532 views

This document discusses setting up continuous integration and continuous delivery (CI/CD) pipelines on Kubernetes using Concourse CI and Argo CD. It provides an overview of each tool, instructions for getting started with Concourse using Helm and configuring sample pipelines in YAML, and instructions for installing and configuring applications in Argo CD through application manifests.

Introduction of Cloud Native CI/CD
on Kubernetes

Trail Map
https://github.com/cncf/trailmap

CI/CD
From the trail map:
Setup Continuous Integration/Continuous Delivery
(CI/CD) so that changes to your source code
automatically result in a new container being
built, tested, and deployed to staging and
eventually, perhaps, to production

Landscape
https://github.com/cncf/landscape

Pipeline-based CI tool
Configuration as Code
Fancy Visualization
Management using CLI tool
Concourse CI
https://concourse-ci.org/

Get Started
https://github.com/helm/charts/tree/master/stable/concourse
TL;DR;
$ helm install stable/concourse
Need to set externalUrl to access from outside
Install the fly CLI tool for concourse management
$ fly -h

Pipeline
https://github.com/starkandwayne/concourse-tutorial/blob/master/tutorials/basic/job-
inputs/pipeline.yml
resources:
- name: resource-tutorial
type: git
source:
uri: https://github.com/starkandwayne/concourse-tutorial.git
branch: develop
- name: resource-app
type: git
source:
uri: https://github.com/cloudfoundry-community/simple-go-web-app.git
jobs:
- name: job-test-app
public: true
plan:
- get: resource-tutorial
- get: resource-app
trigger: true
- task: web-app-tests
file: resource-tutorial/tutorials/basic/job-inputs/task_run_tests.yml

Declarative, GitOps CD tool
Automated deployment of desired
application states
Support for config management tools
(Kustomize, Helm etc)
Argo CD
https://argoproj.github.io/argo-cd/

Get Started
Quick start
$ kubectl create namespace argocd
$ kubectl apply -n argocd -f
https://raw.githubusercontent.com/argoproj/argo-cd/stable/manifests/install.yaml
Access the endpoint by browser & Login
Get admin password
$ kubectl get pods -n argocd -l app.kubernetes.io/name=argocd-server
-o name | cut -d'/' -f 2

Application Manifest
apiVersion: argoproj.io/v1alpha1
kind: Application
metadata:
name: concourse
namespace: argocd
spec:
project: default
source:
repoURL: https://github.com/helm/charts.git
targetRevision: a7816917c50bc31471793f54036a7eaf0eeeb701
path: stable/concourse
helm:
parameters:
- name: "web.service.type"
value: "LoadBalancer"
- name: "concourse.web.bindPort"
value: "80"
- name: "concourse.web.externalUrl"
value: ${URL}
releaseName: concourse
destination:
server: https://kubernetes.default.svc
namespace: default

CI/CD Architecture
In my self-study project:

This document provides an agenda and instructions for a hands-on introduction to Kubernetes tutorial. The tutorial will cover Kubernetes basics like pods, services, deployments and replica sets. It includes steps for setting up a local Kubernetes environment using Minikube and demonstrates features like rolling updates, rollbacks and self-healing. Attendees will learn how to develop container-based applications locally with Kubernetes and deploy changes to preview them before promoting to production.

What Is HelmAMELIAOLIVIA2

Getting Started with Kubernetes VMware Tanzu

If you’re working with just a few containers, managing them isn't too complicated. But what if you have hundreds or thousands? Think about having to handle multiple upgrades for each container, keeping track of container and node state, available resources, and more. That’s where Kubernetes comes in. Kubernetes is an open source container management platform that helps you run containers at scale. This talk will cover Kubernetes components and show how to run applications on it.

Introduction to HelmHarshal Shah

Helm is a package manager for Kubernetes that allows easy installation and management of Kubernetes applications. It consists of a Helm client that runs on a user's machine and communicates with Tiller, which runs as a pod on the Kubernetes cluster and performs installation and management tasks. Charts, which are Helm packages containing Kubernetes manifest templates, are analogous to Puppet modules, while a release, which is an installed instance of a chart, is analogous to a Docker container.

Kubernetes IntroductionPeng Xiao

Kuberneteserialc_w

This document provides an overview of Kubernetes, a container orchestration system. It begins with background on Docker containers and orchestration tools prior to Kubernetes. It then covers key Kubernetes concepts including pods, labels, replication controllers, and services. Pods are the basic deployable unit in Kubernetes, while replication controllers ensure a specified number of pods are running. Services provide discovery and load balancing for pods. The document demonstrates how Kubernetes can be used to scale, upgrade, and rollback deployments through replication controllers and services.

Kubernetes 101Winton Winton

This document discusses microservices and containers, and how Kubernetes can be used for container orchestration. It begins with an overview of microservices and the benefits of breaking monolithic applications into independent microservices. It then discusses how containers can be used to package and deploy microservices, and introduces Docker as a container platform. Finally, it explains that as container usage grows, an orchestrator like Kubernetes is needed to manage multiple containers and microservices, and provides a high-level overview of Kubernetes' architecture and capabilities for scheduling, self-healing, scaling, and other management of containerized applications.

Intro to Helm for KubernetesCarlos E. Salazar

Gitops Hands OnBrice Fernandes

Introduction to kubernetesGabriel Carro

This document provides an introduction to Kubernetes including: - What Kubernetes is and what it does including abstracting infrastructure, providing self-healing capabilities, and providing a uniform interface across clouds. - Key concepts including pods, services, labels, selectors, and namespaces. Pods are the atomic unit and services provide a unified access method. Labels and selectors are used to identify and group related objects. - The Kubernetes architecture including control plane components like kube-apiserver, etcd, and kube-controller-manager. Node components include kubelet and kube-proxy. Optional services like cloud-controller-manager and cluster DNS are also described.

Kubernetes Helm: Why It MattersPlatform9

Kubernetes Helm makes application deployment easy, standardized and reusable. Use of Kubernetes Helm leads to better developer productivity, reduced Kubernetes deployment complexity and enhanced enterprise production readiness. Enterprises using Kubernetes Helm can speed up the adoption of cloud native applications. These applications can be sourced from open-source community provided repositories, or from an organization’s internal repository of customized application blueprints. Developers can use Kubernetes Helm as a vehicle for packaging their applications and sharing them with the Kubernetes community. Kubernetes Helm also allows software vendors to offer their containerized applications at “the push of a button.” Through a single command or a few mouse clicks, users can install Kubernetes apps for dev-test or production environments.

Kubernetes & Google Kubernetes Engine (GKE)Akash Agrawal

This document discusses Kubernetes and Google Kubernetes Engine (GKE). It begins with an agenda that covers understanding Kubernetes, containers, and GKE. It then discusses traditional application deployment versus containerized deployment. It defines Kubernetes and containers, explaining how Kubernetes is a container orchestration system that handles scheduling, scaling, self-healing, and other functions. The document outlines Kubernetes concepts like clusters, pods, services, and controllers. It describes GKE as a managed Kubernetes service on Google Cloud that provides auto-scaling, integration with Google Cloud services, and other features.

Kubernetes Architecture | Understanding Kubernetes Components | Kubernetes Tu...Edureka!

** Kubernetes Certification Training: https://www.edureka.co/kubernetes-certification ** This Edureka tutorial on "Kubernetes Architecture" will give you an introduction to popular DevOps tool - Kubernetes, and will deep dive into Kubernetes Architecture and its working. The following topics are covered in this training session: 1. What is Kubernetes 2. Features of Kubernetes 3. Kubernetes Architecture and Its Components 4. Components of Master Node and Worker Node 5. ETCD 6. Network Setup Requirements DevOps Tutorial Blog Series: https://goo.gl/P0zAfF

Meetup 23 - 03 - Application Delivery on K8S with GitOpsVietnam Open Infrastructure User Group

This document summarizes a presentation about deploying applications on Kubernetes with GitOps. The presentation covers GitOps workflows and tools like FluxCD and ArgoCD for managing Helm charts from Git repositories. It also discusses integrating continuous integration pipelines with ArgoCD and provides best practices for areas like secret management, scaling, and microservices. The presenter concludes by taking questions and inviting interested parties to join their company.

Get started with gitops and fluxLibbySchulze1

The document provides an overview of GitOps and Flux. It introduces GitOps as an operating model that utilizes a version controlled system like Git as a single source of truth for continuous delivery of cloud native applications like Kubernetes. It describes Flux as a GitOps tool that automates the deployment of Kubernetes workloads by automatically syncing apps and infrastructure from a Git repository to a Kubernetes cluster. The document highlights key benefits and capabilities of Flux such as working with any Kubernetes cluster and tools, multi-tenancy support, notifications, and an active community.

The Power of GitOps with Flux & GitOps ToolkitWeaveworks

GitOps Days Community Special Watch the video here: https://youtu.be/0v5bjysXTL8 New to GitOps or been a long-time Flux user? We'll walk you through the benefits of GitOps and then demo it in action with a sneak peak into the next gen Flux and GitOps Toolkit! * Automation! * Visibility! * Reconciliation! * Powerful use of Prometheus and Grafana! * GitOps for Helm! For Flux users, Flux v1 is decoupled into Flux v2 and GitOps Toolkit. We'll demo how this decoupling gives you more control over how you can do GitOps and with fewer steps! Join Leigh Capili and Tamao Nakahara as they show you GitOps in action with Flux and GitOps Toolkit. Note to our Flux community that Flux v2 and the GitOps Toolkit is in development and Flux v1 is in maintenance mode. These talks and upcoming guides will give you the most up-to-date info and steps to migrate once we reach feature parity and start the migration process. We are dedicated to the smoothest experience possible for our Flux community, so please join us if you'd like early access and to give us feedback for the migration process. We are really excited by the improvements and want to take this opportunity to show you what the GitOps Toolkit is all about, walk you through the guides and get your feedback! For more info, see https://toolkit.fluxcd.io/. Here's our latest blog post on Flux v2 and GitOps Toolkit updates: https://www.weave.works/blog/the-road-to-flux-v2-october-update

GitOps w/argocdJean-Philippe Bélanger

This document summarizes GitOps and the benefits of using GitOps for continuous delivery and deployment. It discusses how GitOps allows for simplified continuous delivery through using Git as a single source of truth, which can enhance productivity and experience while also increasing stability. Rollbacks are easy if issues arise by reverting commits in Git. Additional benefits include reliability, consistency, security, and auditability of changes. The document also provides an overview of ArgoCD, an open source GitOps tool for continuous delivery on Kubernetes, and its architecture.

Kubernetes ArchitectureKnoldus Inc.

Kubernetes for Beginners: An Introductory GuideBytemark

Kubernetes is an open-source tool for managing containerized workloads and services. It allows for deploying, maintaining, and scaling applications across clusters of servers. Kubernetes operates at the container level to automate tasks like deployment, availability, and load balancing. It uses a master-slave architecture with a master node controlling multiple worker nodes that host application pods, which are groups of containers that share resources. Kubernetes provides benefits like self-healing, high availability, simplified maintenance, and automatic scaling of containerized applications.

Gitlab, GitOps & ArgoCDHaggai Philip Zagury

This document discusses improving the developer experience through GitOps and ArgoCD. It recommends building developer self-service tools for cloud resources and Kubernetes to reduce frustration. Example GitLab CI/CD pipelines are shown that handle releases, deployments to ECR, and patching apps in an ArgoCD repository to sync changes. The goal is to create faster feedback loops through Git operations and automation to motivate developers.

Gitops: the kubernetes waysparkfabrik

GitOps è un nuovo metodo di CD che utilizza Git come unica fonte di verità per le applicazioni e per l'infrastruttura (declarative infrastructure/infrastructure as code), fornendo sia il controllo delle revisioni che il controllo delle modifiche. In questo talk vedremo come implementare workflow di CI/CD Gitops basati su Kubernetes, dalla teoria alla pratica passando in rassegna i principali strumenti oggi a disposizione come ArgoCD, Flux (aka Gitops engine) e JenkinsX

GrafanaNoelMc Grath

This document provides an overview of Grafana, an open source metrics dashboard and graph editor for Graphite, InfluxDB and OpenTSDB. It discusses Grafana's features such as rich graphing, time series querying, templated queries, annotations, dashboard search and export/import. The document also covers Grafana's history and alternatives. It positions Grafana as providing richer features than Graphite Web and highlights features like multiple y-axes, unit formats, mixing graph types, thresholds and tooltips.

Introduction to kubernetesRaffaele Di Fazio

Free GitOps Workshop + Intro to Kubernetes & GitOpsWeaveworks

Follow along in this free workshop and experience GitOps! AGENDA:  Welcome - Tamao Nakahara, Head of DX (Weaveworks)  Introduction to Kubernetes & GitOps - Mark Emeis, Principal Engineer (Weaveworks)  Weave Gitops Overview - Tamao Nakahara  Free Gitops Workshop - David Harris, Product Manager (Weaveworks) If you're new to Kubernetes and GitOps, we'll give you a brief introduction to both and how GitOps is the natural evolution of Kubernetes. Weave GitOps Core is a continuous delivery product to run apps in any Kubernetes. It is free and open source, and you can get started today! https://www.weave.works/product/gitops-core If you’re stuck, also come talk to us at our Slack channel! #weave-gitops http://bit.ly/WeaveGitOpsSlack (If you need to invite yourself to the Slack, visit https://slack.weave.works/)

Kubernetes a comprehensive overviewGabriel Carro

Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications. It groups containers that make up an application into logical units for easy management and discovery called pods. Its main components include a master node that manages the cluster and worker nodes that run the applications. It uses labels to identify pods and services and selectors to group related pods. Common concepts include deployments for updating apps, services for network access, persistent volumes for storage, and roles/bindings for access control. The deployment process involves the API server, controllers, scheduler and kubelet to reconcile the desired state and place pods on nodes from images while providing discovery and load balancing.

Kubernetes - A Comprehensive OverviewBob Killen

CD using ArgoCD(KnolX).pdfKnoldus Inc.

Kubernetes 101Crevise Technologies

Kubernetes is an open source container orchestration system that automates the deployment, maintenance, and scaling of containerized applications. It groups related containers into logical units called pods and handles scheduling pods onto nodes in a compute cluster while ensuring their desired state is maintained. Kubernetes uses concepts like labels and pods to organize containers that make up an application for easy management and discovery.

CI/CD with OCPDmitry Kartsev

This document discusses CI/CD workflows using OpenShift Container Platform. It describes key OpenShift concepts like ImageStreams, BuildConfigs, and DeploymentConfigs. ImageStreams provide abstraction for container images. BuildConfigs define build strategies like Docker, S2I, custom, and pipeline builds. Triggers control when BuildConfigs run. DeploymentConfigs manage deployments and allow transitioning between versions. The document provides links to OpenShift documentation for further information on these topics.

[DSC DACH 23] Creating Production-Ready Shiny Apps - Mario AnnauDataScienceConferenc1

We show how to turn a simple Shiny App into a state-of-the-art Shiny package which checks all boxes for production and maintenance: Install R and package dependencies on server Eliminate “dumb” errors Eliminate semantic errors Facilitate Maintenance through Structure/Doc Eliminate issues through different OS (Win vs Linux) To accomplish these goals we use a bunch of helper packages (), Github actions and - of course - ChatGPT :) Github: https://github.com/quantargo/shinyproduction

More Related Content

What's hot (20)

Gitops Hands OnBrice Fernandes

Introduction to kubernetesGabriel Carro

Kubernetes Helm: Why It MattersPlatform9

Kubernetes & Google Kubernetes Engine (GKE)Akash Agrawal

Kubernetes Architecture | Understanding Kubernetes Components | Kubernetes Tu...Edureka!

Meetup 23 - 03 - Application Delivery on K8S with GitOpsVietnam Open Infrastructure User Group

Get started with gitops and fluxLibbySchulze1

The Power of GitOps with Flux & GitOps ToolkitWeaveworks

GitOps w/argocdJean-Philippe Bélanger

Kubernetes ArchitectureKnoldus Inc.

Kubernetes for Beginners: An Introductory GuideBytemark

Gitlab, GitOps & ArgoCDHaggai Philip Zagury

Gitops: the kubernetes waysparkfabrik

GrafanaNoelMc Grath

Introduction to kubernetesRaffaele Di Fazio

Free GitOps Workshop + Intro to Kubernetes & GitOpsWeaveworks

Kubernetes a comprehensive overviewGabriel Carro

Kubernetes - A Comprehensive OverviewBob Killen

CD using ArgoCD(KnolX).pdfKnoldus Inc.

Kubernetes 101Crevise Technologies

Gitops Hands OnBrice Fernandes

Introduction to kubernetesGabriel Carro

Kubernetes Helm: Why It MattersPlatform9

Kubernetes & Google Kubernetes Engine (GKE)Akash Agrawal

Kubernetes Architecture | Understanding Kubernetes Components | Kubernetes Tu...Edureka!

Meetup 23 - 03 - Application Delivery on K8S with GitOpsVietnam Open Infrastructure User Group

Get started with gitops and fluxLibbySchulze1

The Power of GitOps with Flux & GitOps ToolkitWeaveworks

GitOps w/argocdJean-Philippe Bélanger

Kubernetes ArchitectureKnoldus Inc.

Kubernetes for Beginners: An Introductory GuideBytemark

Gitlab, GitOps & ArgoCDHaggai Philip Zagury

Gitops: the kubernetes waysparkfabrik

GrafanaNoelMc Grath

Introduction to kubernetesRaffaele Di Fazio

Free GitOps Workshop + Intro to Kubernetes & GitOpsWeaveworks

Kubernetes a comprehensive overviewGabriel Carro

Kubernetes - A Comprehensive OverviewBob Killen

CD using ArgoCD(KnolX).pdfKnoldus Inc.

Kubernetes 101Crevise Technologies

Similar to Introduction of cloud native CI/CD on kubernetes (20)

CI/CD with OCPDmitry Kartsev

[DSC DACH 23] Creating Production-Ready Shiny Apps - Mario AnnauDataScienceConferenc1

Kubernetes CI/CD with HelmAdnan Abdulhussein

CI/CD with Docker on AWSHart Hoover

Developing Serverless Applications on Kubernetes with KnativeVMware Tanzu

Serverless computing has become a hot topic in developer communities. The use of ephemeral containers eliminates the need for always-on infrastructure. But the real payoff for serverless is greater code simplicity and developer efficiency. Sounds great! Except the open-source serverless framework space is crowded and complex. Each unique offering approaches functions differently, with varying methods for triggering, scaling, and event formatting. How is that efficient? One thing that most everybody can agree on is to build on top of Kubernetes. With that as the only common ground though, there is still too much fragmentation for developers to wade through when deciding on the right open source serverless solution. That's where Knative comes in. An open-source project from Google, Pivotal, and other industry leaders, Knative provides a set of common tooling on top of Kubernetes to help developers build serverless applications. It extends Kubernetes by combining Istio with Custom Resource Definitions to enable a higher-level of abstraction for developers. This brings support for source-to-container builds, autoscaling, routing, and event sourcing. Join this session with Brian McClain and Bryan Friedman to see a complete working demo of Knative and learn: ● What are the components of Knative and how do they work together ● What are the different ways to deploy serverless applications and functions on Knative ● How and when to use Knative’s build features, such as Buildpacks ● What is Knative’s eventing model and how are event sources used to trigger functions Presenters: Bryan Friedman, Director of Product Marketing, Pivotal and Brian McClain, Principal Product Marketing Manager, Pivotal

Unlimited Staging Environments on KubernetesErik Osterman

How to run complete, disposable apps on Kubernetes for Staging and Development What if you could rapidly spin up new environments in a matter of minutes entirely from scratch, triggered simply by the push of a button or automatically for every Pull Request or Branch. Would that be cool? That’s what we thought too! Companies running complex microservices architectures need a better way to do QA, prototype new features & discuss changes. We want to show that there’s a simpler way to collaborate and it’s available today if you’re running Kubernetes. Tune in to learn how you can assemble 100% Open Source components with a CodeFresh CI/CD Pipeline to deploy your full stack for any branch and expose it on a unique URL that you can share. Not only that, we ensure that it’s fully integrated with CI/CD so console expertise is not required to push updates. Empower designers and front-end developers to push code freely. Hand it over to your sales team so they can demo upcoming features for customers! The possibilities are truly unlimited. =)

Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Anthony Dahanne

Les Buildpacks existent depuis plus de 10 ans ! D’abord, ils étaient utilisés pour détecter et construire une application avant de la déployer sur certains PaaS. Ensuite, nous avons pu créer des images Docker (OCI) avec leur dernière génération, les Cloud Native Buildpacks (CNCF en incubation). Sont-ils une bonne alternative au Dockerfile ? Que sont les buildpacks Paketo ? Quelles communautés les soutiennent et comment ? Venez le découvrir lors de cette session ignite

Orchestration with KubernetesKunal Kerkar

Kubernetes can be used to orchestrate an entire software development pipeline from code to production. A pipeline can include stages for building container images, testing, deploying to staging, load testing, and monitoring. Charts are used to package Kubernetes resources for deployment. Helm is used to deploy charts to clusters for staging and production. Load testing tools like K6 help determine system capacity before production. The pipeline provides fast deployments, failure debugging, and improves developer productivity. Future improvements include integrating Git, using Operators, and improving secret management.

Gitlab ci e kubernetes, build test and deploy your projects like a prosparkfabrik

This document discusses using GitLab CI and Kubernetes together for continuous integration, delivery, and deployment. It provides an overview of Kubernetes and GitLab, describes how to set up a GitLab runner using the Kubernetes executor, and provides an example YAML configuration. It also covers continuous deployment workflows, running GitLab on Kubernetes, and some tips and tricks as well as techniques for troubleshooting Kubernetes and GitLab CI/CD pipelines.

Automate Your Automation | DrupalCon ViennaPantheon

Greg Anderson provides guidance on automating various development and deployment tasks. He discusses automating tasks like development, testing, deployment and maintenance. Some key tools mentioned are Travis CI, Circle CI, Composer and hub. Automating tasks improves reliability, makes onboarding easier and allows doing more work. The costs of not automating include increased risk of errors and lost knowledge over time.

Native Application Development With Qtrahulnimbalkar

Bring Continuous Integration to Your Laptop With the Drone CI Docker Extensio...jemije2490

1. The Drone CI Docker extension allows developers to run continuous integration (CI) pipelines locally on their laptop using Docker Desktop. 2. With the extension, developers can import Drone CI pipelines into Docker Desktop and run specific steps of a pipeline to test and debug them. 3. The extension integrates Drone CI directly into Docker Desktop for streamlined management of CI/CD workflows during development.

KubernetesMeng-Ze Lee

Kubespray and Ansible can be used to automate the installation of Kubernetes in a production-ready environment. Kubespray provides tools to configure highly available Kubernetes clusters across multiple Linux distributions. Ansible is an IT automation tool that can deploy software and configure systems. The document then provides a 6 step guide for installing Kubernetes on Ubuntu using kubeadm, including installing Docker, kubeadm, kubelet and kubectl, disabling swap, configuring system parameters, initializing the cluster with kubeadm, and joining nodes. It also briefly explains Kubernetes architecture including the master node, worker nodes, addons, CNI, CRI, CSI and key concepts like pods, deployments, networking,

Drone CI/CD PlatformBo-Yi Wu

Unlimited Staging EnvironmentsCodefresh

Watch the webinar here: https://codefresh.io/unlimited-staging-environments-lp/ Sign up for a FREE Codefresh account today: https://codefresh.io/codefresh-signup/ How to run complete, disposable apps on Kubernetes or Staging and Development. See the full video webinar on our blog at https://codefresh.io/webinars/unlimited_staging_environments_webinar/

Github Action, AWS S3, CloudFront를 활용한 React 애플리케이션 CICD 파이프라인 구축Eunsu Kim

From 4 releases per year to 4 releases per daycontinuousphp

This session presents a case study where the delivery process for a large government web platform was dramatically improved by automating as much as possible. When the European Commission adopted Drupal for their internal websites, this project grew organically from a single site to a large Drupal 7 distribution running over 70 websites, developed by a team of 200 developers from 28 different countries. As the project grew the legacy workflow processes that were in use became unmaintainable. This session will show how we moved from a largely manual process to fully automated continuous deployment. Moving from SVN to git. Adopting the “successful git branching model”: feature branches, release branches, tags. Making the development process accessible by external contractors by moving from a DMZ to third party services. Automating many steps in the QA procedure. Rejecting bad code through static analysis before it reaches a human QA engineer. Providing automated tests using Behat to replace manual regression testing. Testing compatibility with new releases of components in the stack (e.g. PHP 7) to catch problems early. Deploying ticket branches to ephemeral acceptance servers hosted on Amazon AWS. Automating Drupal site builds with Drush Make, Composer and Phing. Providing a “starterkit” that includes standardized build tools to allow rapidly create new websites. Adopting continuousphp to highly parallelize our delivery pipelines and get quick feedback.

CI/CD with Github ActionsMd. Minhazul Haque

This document discusses setting up a CI/CD pipeline using GitHub Actions. It begins with an introduction to CI/CD pipelines and their importance. It then provides an overview of GitHub Actions and how they can be used to automate builds, tests, releases and deployments. The document demonstrates a sample GitHub Actions workflow file and explains its key components like jobs, steps and actions. It also covers topics like workflow events, jobs and steps/actions that can be used in GitHub Actions.

Concource CI/CDKnoldus Inc.

Gitlab ci, cncf.skJuraj Hantak

This document provides an introduction to Gitlab CI and continuous integration/continuous delivery (CI/CD) workflows. It discusses DevOps practices and the benefits of Gitlab CI. It then covers how to set up Gitlab runners, write a basic Gitlab CI configuration file, define jobs, stages, variables and environments. The document demonstrates concepts like Docker integration, artifacts, auto and manual deployments, and stopping deployments. It concludes with a live demo of a Gitlab CI configuration.

CI/CD with OCPDmitry Kartsev

[DSC DACH 23] Creating Production-Ready Shiny Apps - Mario AnnauDataScienceConferenc1

Kubernetes CI/CD with HelmAdnan Abdulhussein

CI/CD with Docker on AWSHart Hoover

Developing Serverless Applications on Kubernetes with KnativeVMware Tanzu

Unlimited Staging Environments on KubernetesErik Osterman

Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Anthony Dahanne

Orchestration with KubernetesKunal Kerkar

Gitlab ci e kubernetes, build test and deploy your projects like a prosparkfabrik

Automate Your Automation | DrupalCon ViennaPantheon

Native Application Development With Qtrahulnimbalkar

Bring Continuous Integration to Your Laptop With the Drone CI Docker Extensio...jemije2490

KubernetesMeng-Ze Lee

Drone CI/CD PlatformBo-Yi Wu

Unlimited Staging EnvironmentsCodefresh

Github Action, AWS S3, CloudFront를 활용한 React 애플리케이션 CICD 파이프라인 구축Eunsu Kim

From 4 releases per year to 4 releases per daycontinuousphp

CI/CD with Github ActionsMd. Minhazul Haque

Concource CI/CDKnoldus Inc.

Gitlab ci, cncf.skJuraj Hantak

More from Kyohei Mizumoto (10)

Introduction to telepresenceKyohei Mizumoto

Telepresence allows developers to test applications locally that are deployed to Kubernetes clusters. It creates a network proxy between a local development environment and a pod running in the cluster, enabling local development and testing that reflects the cluster environment. Key features include deploying and debugging services locally without changing code in the cluster. The document provides an overview of Telepresence and examples for installing it and using it to swap a deployment for local development of both a Python HTTP server and Docker container-based application.

Windowsコンテナ入門Kyohei Mizumoto

Deploy Mattermost on AKSKyohei Mizumoto

This document discusses deploying Mattermost, an open source Slack-alternative, on Azure Kubernetes Service (AKS). It outlines configuring AKS, deploying Kubernetes resources like Mattermost, Prometheus and Grafana using tools like Terraform and Helm. Future prospects discussed include adding logging with Fluentd, continuous delivery with Spinnaker/Tekton, and a service mesh like Istio. The GitHub source provided does not include a database, which must be provisioned separately beforehand using Azure Database for PostgreSQL.

Recap of de code 2019Kyohei Mizumoto

The document summarizes the speaker's experience at the de:code 2019 technical conference hosted by Microsoft. It discusses several sessions that were of interest, including Windows containers, Virtual Kubelet which allows Kubernetes to manage non-node resources, Kubernetes-based event-driven autoscaling (KEDA), and NetApp services. It also provides a demo of using Virtual Kubelet to run both Linux and Windows containers on AKS clusters through Azure container instances, showing how the pods are scheduled on virtual nodes.

Running k3s on raspberry piKyohei Mizumoto

The document discusses running k3s, a lightweight Kubernetes distribution, on a Raspberry Pi single-board computer. It begins with an introduction to k3s and its advantages for resource-constrained edge and IoT devices. Instructions are provided to install k3s on a Raspberry Pi and join it to an existing k3s cluster. An example Python program is given to blink an LED connected to the Raspberry Pi via GPIO to demonstrate controlling the device through k3s.

Kubernetes logging introductionKyohei Mizumoto

Kubernetes monitoring introductionKyohei Mizumoto

Git入門Kyohei Mizumoto

Istio service mesh introductionKyohei Mizumoto

The document discusses Istio, an open source service mesh that provides traffic management, service migration and monitoring for microservices. It provides an overview of key Istio concepts like the control plane, data plane and components like Envoy, Pilot and Mixer. It also includes steps to install Istio on GKE and deploy a sample Bookinfo application to demonstrate traffic routing and load balancing capabilities.

Multi cluster management with rancherKyohei Mizumoto

The document discusses multi-cluster management using Rancher. It begins with an introduction to Rancher and its features for managing Kubernetes clusters across different platforms. It then demonstrates how to install Rancher, add custom and AKS clusters, and deploy applications like WordPress using Rancher's catalog across different clusters. While Rancher provides a unified interface for multi-cluster management, the document notes some current limitations in integrating with AKS clusters.

Introduction to telepresenceKyohei Mizumoto

Windowsコンテナ入門Kyohei Mizumoto

Deploy Mattermost on AKSKyohei Mizumoto

Recap of de code 2019Kyohei Mizumoto

Running k3s on raspberry piKyohei Mizumoto

Kubernetes logging introductionKyohei Mizumoto

Kubernetes monitoring introductionKyohei Mizumoto

Git入門Kyohei Mizumoto

Istio service mesh introductionKyohei Mizumoto

Multi cluster management with rancherKyohei Mizumoto

Recently uploaded (20)

Electronic_Mail_Attacks-1-35.pdf by xploitniftliyevhuseyn

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Linux Support for SMARC: How Toradex Empowers Embedded DevelopersToradex

Toradex brings robust Linux support to SMARC (Smart Mobility Architecture), ensuring high performance and long-term reliability for embedded applications. Here’s how: • Optimized Torizon OS & Yocto Support – Toradex provides Torizon OS, a Debian-based easy-to-use platform, and Yocto BSPs for customized Linux images on SMARC modules. • Seamless Integration with i.MX 8M Plus and i.MX 95 – Toradex SMARC solutions leverage NXP’s i.MX 8 M Plus and i.MX 95 SoCs, delivering power efficiency and AI-ready performance. • Secure and Reliable – With Secure Boot, over-the-air (OTA) updates, and LTS kernel support, Toradex ensures industrial-grade security and longevity. • Containerized Workflows for AI & IoT – Support for Docker, ROS, and real-time Linux enables scalable AI, ML, and IoT applications. • Strong Ecosystem & Developer Support – Toradex offers comprehensive documentation, developer tools, and dedicated support, accelerating time-to-market. With Toradex’s Linux support for SMARC, developers get a scalable, secure, and high-performance solution for industrial, medical, and AI-driven applications. Do you have a specific project or application in mind where you're considering SMARC? We can help with Free Compatibility Check and help you with quick time-to-market For more information: https://www.toradex.com/computer-on-modules/smarc-arm-family

AI and Data Privacy in 2025: Global TrendsInData Labs

In this infographic, we explore how businesses can implement effective governance frameworks to address AI data privacy. Understanding it is crucial for developing effective strategies that ensure compliance, safeguard customer trust, and leverage AI responsibly. Equip yourself with insights that can drive informed decision-making and position your organization for success in the future of data privacy. This infographic contains: -AI and data privacy: Key findings -Statistics on AI data privacy in the today’s world -Tips on how to overcome data privacy challenges -Benefits of AI data security investments. Keep up-to-date on how AI is reshaping privacy standards and what this entails for both individuals and organizations.

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, presentation slides, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Build Your Own Copilot & Agents For DevsBrian McKeiver

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Want to learn practical tips for designing systems that can scale efficiently without compromising speed? Join us for a workshop where we’ll address these challenges head-on and explore how to architect low-latency systems using Rust. During this free interactive workshop oriented for developers, engineers, and architects, we’ll cover how Rust’s unique language features and the Tokio async runtime enable high-performance application development. As you explore key principles of designing low-latency systems with Rust, you will learn how to: - Create and compile a real-world app with Rust - Connect the application to ScyllaDB (NoSQL data store) - Negotiate tradeoffs related to data modeling and querying - Manage and monitor the database for consistently low latencies

TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc

Most consumers believe they’re making informed decisions about their personal data—adjusting privacy settings, blocking trackers, and opting out where they can. However, our new research reveals that while awareness is high, taking meaningful action is still lacking. On the corporate side, many organizations report strong policies for managing third-party data and consumer consent yet fall short when it comes to consistency, accountability and transparency. This session will explore the research findings from TrustArc’s Privacy Pulse Survey, examining consumer attitudes toward personal data collection and practical suggestions for corporate practices around purchasing third-party data. Attendees will learn: - Consumer awareness around data brokers and what consumers are doing to limit data collection - How businesses assess third-party vendors and their consent management operations - Where business preparedness needs improvement - What these trends mean for the future of privacy governance and public trust This discussion is essential for privacy, risk, and compliance professionals who want to ground their strategies in current data and prepare for what’s next in the privacy landscape.

Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma

DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock

Building 10x Organizations with Modern Productivity Metrics 10x developers may be a myth, but 10x organizations are very real, as proven by the influential study performed in the 1980s, ‘The Coding War Games.’ Right now, here in early 2025, we seem to be experiencing YAPP (Yet Another Productivity Philosophy), and that philosophy is converging on developer experience. It seems that with every new method we invent for the delivery of products, whether physical or virtual, we reinvent productivity philosophies to go alongside them. But which of these approaches actually work? DORA? SPACE? DevEx? What should we invest in and create urgency behind today, so that we don’t find ourselves having the same discussion again in a decade?

What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat

The MCP (Model Context Protocol) is a framework designed to manage context and interaction within complex systems. This SlideShare presentation will provide a detailed overview of the MCP Model, its applications, and how it plays a crucial role in improving communication and decision-making in distributed systems. We will explore the key concepts behind the protocol, including the importance of context, data management, and how this model enhances system adaptability and responsiveness. Ideal for software developers, system architects, and IT professionals, this presentation will offer valuable insights into how the MCP Model can streamline workflows, improve efficiency, and create more intuitive systems for a wide range of use cases.

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

TrsLabs - Fintech Product & Business ConsultingTrs Labs

Hybrid Growth Mandate Model with TrsLabs Strategic Investments, Inorganic Growth, Business Model Pivoting are critical activities that business don't do/change everyday. In cases like this, it may benefit your business to choose a temporary external consultant. An unbiased plan driven by clearcut deliverables, market dynamics and without the influence of your internal office equations empower business leaders to make right choices. Getting things done within a budget within a timeframe is key to Growing Business - No matter whether you are a start-up or a big company Talk to us & Unlock the competitive advantage

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

Heap, Types of Heap, Insertion and DeletionJaydeep Kale

Mobile App Development Company in Saudi ArabiaSteve Jonas

EmizenTech is a globally recognized software development company, proudly serving businesses since 2013. With over 11+ years of industry experience and a team of 200+ skilled professionals, we have successfully delivered 1200+ projects across various sectors. As a leading Mobile App Development Company In Saudi Arabia we offer end-to-end solutions for iOS, Android, and cross-platform applications. Our apps are known for their user-friendly interfaces, scalability, high performance, and strong security features. We tailor each mobile application to meet the unique needs of different industries, ensuring a seamless user experience. EmizenTech is committed to turning your vision into a powerful digital product that drives growth, innovation, and long-term success in the competitive mobile landscape of Saudi Arabia.

Electronic_Mail_Attacks-1-35.pdf by xploitniftliyevhuseyn

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Linux Support for SMARC: How Toradex Empowers Embedded DevelopersToradex

AI and Data Privacy in 2025: Global TrendsInData Labs

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Build Your Own Copilot & Agents For DevsBrian McKeiver

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc

Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma

DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock

What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

TrsLabs - Fintech Product & Business ConsultingTrs Labs

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

Heap, Types of Heap, Insertion and DeletionJaydeep Kale

Mobile App Development Company in Saudi ArabiaSteve Jonas

Introduction of cloud native CI/CD on kubernetes

1. Introduction of Cloud Native CI/CD on Kubernetes

2. Trail Map https://github.com/cncf/trailmap

3. CI/CD From the trail map: Setup Continuous Integration/Continuous Delivery (CI/CD) so that changes to your source code automatically result in a new container being built, tested, and deployed to staging and eventually, perhaps, to production

4. Landscape https://github.com/cncf/landscape

5. Landscape

6. CI/CD on Kubernetes

7. Pipeline-based CI tool Configuration as Code Fancy Visualization Management using CLI tool Concourse CI https://concourse-ci.org/

8. Get Started https://github.com/helm/charts/tree/master/stable/concourse TL;DR; $ helm install stable/concourse Need to set externalUrl to access from outside Install the fly CLI tool for concourse management $ fly -h

9. Pipeline https://github.com/starkandwayne/concourse-tutorial/blob/master/tutorials/basic/job- inputs/pipeline.yml resources: - name: resource-tutorial type: git source: uri: https://github.com/starkandwayne/concourse-tutorial.git branch: develop - name: resource-app type: git source: uri: https://github.com/cloudfoundry-community/simple-go-web-app.git jobs: - name: job-test-app public: true plan: - get: resource-tutorial - get: resource-app trigger: true - task: web-app-tests file: resource-tutorial/tutorials/basic/job-inputs/task_run_tests.yml

10. Pipeline

11. Declarative, GitOps CD tool Automated deployment of desired application states Support for config management tools (Kustomize, Helm etc) Argo CD https://argoproj.github.io/argo-cd/

12. Get Started Quick start $ kubectl create namespace argocd $ kubectl apply -n argocd -f https://raw.githubusercontent.com/argoproj/argo-cd/stable/manifests/install.yaml Access the endpoint by browser & Login Get admin password $ kubectl get pods -n argocd -l app.kubernetes.io/name=argocd-server -o name | cut -d'/' -f 2

13. Application

14. Application Manifest apiVersion: argoproj.io/v1alpha1 kind: Application metadata: name: concourse namespace: argocd spec: project: default source: repoURL: https://github.com/helm/charts.git targetRevision: a7816917c50bc31471793f54036a7eaf0eeeb701 path: stable/concourse helm: parameters: - name: "web.service.type" value: "LoadBalancer" - name: "concourse.web.bindPort" value: "80" - name: "concourse.web.externalUrl" value: ${URL} releaseName: concourse destination: server: https://kubernetes.default.svc namespace: default

15. CI/CD Architecture In my self-study project:

16. Demo

17. Thank you!

Introduction of cloud native CI/CD on kubernetes

Recommended

More Related Content

What's hot (20)

Similar to Introduction of cloud native CI/CD on kubernetes (20)

More from Kyohei Mizumoto (10)

Recently uploaded (20)

Introduction of cloud native CI/CD on kubernetes