Next generation pipelines

May 28, 2018Download as PPTX, PDF0 likes197 views

Micro-Services and cloud-based applications demand robust and flexible CI/CD pipelines. Manually creating a Jenkins Job using the UI is just not an option any more, but which tool should we use? In this talk we will cover Jenkns Pipeline, Gitlab CI and Concourse. We will see the use case for every tool and when should we use it.

The next generation of
CI/CD pipelines
Alex Landa
Head of DevOps and BigData technologies at Trainologic

CI Pipeline
Code
committed
compile
test
Static
analysis
package
Publish to
artifact
repo

CD Pipeline
Fetch
artifacts
deploy to
staging
integration
tests
Performance
tests?
Deploy to
production

Why are we having this talk?
• Because ”Micro Services” and “Cloud”
• We need to build and deploy
• More services
• Faster
• Flexible
• Reliable
• Reproduceable
• To more environments
• And awesome 

Jenkins – the swiss knife of CI
• If you didn’t hear about Jenkins..
• Flexible Job runner adapted for CI/CD purposes
• Job is a runnable task controlled by Jenkins
• Executed on a Jenkins nodes
• Has its own “workspace”
• Jenkins provides plugins for almost anything

No Manual Jobs ever again
• Traditionally Jenkins jobs were created in the UI by the CM
• Customization per job were manual as well
• But what if you have more than 20 services?
• How do you manage these different configurations?
• Who manages them?
• How does a developer know what Jenkins is executing?

Jenkins Pipeline
• Suite of plugin that introduces continues delivery pipelines to
Jenkins
• The pipeline is describe in Jenkinsfile using groovy DSL.
• It is kept as part of the project repository
• Changes are versioned
• Developers have access to the build
• Different branches may have different builds

Syntax
Declarative
• DSL based
• Strict
• “Best Practice”
• Limited
• Can include scripts
Scripted
• Groovy based
• Flexible
• Groovy learning curve
• Doesn’t ensure future

Why Docker is great for CI Pipeline?
• Can be used as the build tool
• Complete environment isolation
• Predefined settings
• Can be used for integration tests – docker-compose
• Can be used as the scale framework
• Run Jenkins on K8s or ECS

Gitlab
• Aren’t they into Git something?
• Gitlab provide the “complete DevOps experience”
• Issue board
• Git
• CI pipelines
• Docker registry
• Static analysis and security testing
• Release and environment management
• Monitoring
• More..

Gitlab pipelines
• Built-in support for Docker
• Jobs are defined in “.gitlab-ci.yml”
• Stages – specify the lifecycle of the build
• Useful for multistage pipelines
• Jobs – execution step, run in separate from each other
• Every job to a stage, if not specified belongs to the build stage
• Runner – run the jobs, can be a VM, a VPS, a docker container
or even a k8s cluster

Summary
• Define your CI in code – no matter which CI tool you use
• Use Docker for the CI process as much as possible
• Jenkins is great
• Gitlab is also great and provides a complete solution

This document discusses plans to improve the Apache CloudStack project. It outlines proposals to clean up code, infrastructure, documentation and the ecosystem. Specific areas of focus include removing unused code, improving testing, consolidating documentation, and defining a catalog of common cluster configurations. The document also proposes an engineering roadmap to address upgrades, logging, storage, networking, the UI/API and QA. The goal is to modernize the architecture through better abstraction layers and make CloudStack more configurable, composable and developer-friendly.

Docker in the CloudSascha Möllering

Sebastien goasguen cloud stack and dockerShapeBlue

This document discusses how Docker can be used with CloudStack. It provides several options: 1) Running Docker in VMs on CloudStack templates that include Docker, 2) Using Docker-optimized OS templates, 3) Launching containers through a container service API, 4) Using CloudStack plugins within the Docker ecosystem like Docker Machine. The document concludes that CloudStack should not try to write a Docker hypervisor plugin, but instead focus on Docker-optimized OS templates and deploying application frameworks to orchestrate Docker.

Sas 2015 event_drivenSascha Möllering

This document summarizes an event-driven architecture presentation using Java. It discusses using Apache Kafka/Amazon Kinesis for messaging, Docker for containerization, Vert.x for reactive applications, Apache Camel/AWS Lambda for integration, and Google Protocol Buffers for data serialization. It covers infrastructure components, software frameworks, local and AWS deployment, and integration testing between Kinesis and Kafka. The presentation provides resources for code samples and Docker images discussed.

NetflixOSS and ZeroToDocker Talkaspyker

Andrew Spyker presented on the Netflix Cloud Platform and ZeroToDocker project. The following key points were discussed: - ZeroToDocker provides Docker images of Netflix OSS projects like Eureka, Zuul and Asgard to more easily evaluate the technologies. However, the images are not intended for direct production use. - A demo showed running a microservices application and supporting Netflix OSS services like Eureka and Zuul using Docker containers on a single machine. - While Docker aids development and evaluation, additional tooling is needed to operationalize containers at production scale across multiple hosts for tasks like networking, security, logging and scheduling. Competing ecosystems are emerging to address these needs.

Externalized Spring Boot App ConfigurationHaufe-Lexware GmbH & Co KG

Containers and Developer Defined Data Centers - Evan Powell - Keynote in Bang...CodeOps Technologies LLP

Serverless and cloud computingzekeLabs Technologies

Netflix0SS Services on DockerDocker, Inc.

1. The document describes a Docker implementation of NetflixOSS microservices on IBM SoftLayer. 2. Key aspects discussed include networking Docker containers across multiple SoftLayer datacenters, managing the Docker API across multiple hosts, and integrating Docker images with SoftLayer image management. 3. Lessons learned include the need for a proxy for the Docker remote API across multiple hosts, and approaches for keeping Docker advantages like image portability when integrating with an IaaS platform.

TDC2017 | São Paulo - Trilha Containers How we figured out we had a SRE team ...tdc-globalcode

DevOpsCon Cloud Workshop Sascha Möllering

Sascha Möllering gave a presentation on deploying applications to the AWS cloud. He began with an overview of AWS services like EC2, S3, RDS and explained how to initially create a simple cloud service with one instance each for a web application and database. He then described how to improve the architecture by separating components, adding redundancy and elasticity using services like ELB, autoscaling and read replicas. Sascha demonstrated deploying a sample application built with JHipster and Docker to AWS Elastic Beanstalk, which handles running the containers and mapping environment variables for the database connection.

Docker in Production at the Aurora TeamHaufe-Lexware GmbH & Co KG

ServerlessDaniel Cottone

Autoscaling Docker Containers by Konstantinos Faliagkas, Docker Birthday #3 A...Docker, Inc.

Docker Birthday App key feature improvements: - A haproxy load balancer, based on the dockercloud/haproxy image, for dynamic configuration. - Dockerized the locust load testing framework, in order to create fake http requests to the voting page. - Autoscaling of the voting-app and worker containers. Using the docker remote API, I monitor the CPU usage of the two containers and scale up or down, depending on the threshold. The bottom threshold is 5% and the upper at 30%.

On Prem Container Cloud - Lessons LearnedCodeOps Technologies LLP

This document discusses best practices for setting up a Docker and Kubernetes environment. It covers topics like Docker storage drivers, Docker networking, Kubernetes authentication and authorization, exposing services, integrating logging and monitoring. The key recommendations are to use OverlayFS or Devicemapper storage, Calico networking, Kubernetes security policies, namespaces and RBAC, and Ingress for exposing services. ETCD backup and fault tolerance is also important.

Kubernetes for Serverless - Serverless Summit 2017 - Krishna KumarCodeOps Technologies LLP

Serverless frameworks are changing the way we do computing. In open source container world, Kubernetes is playing a pivotal role in manifesting this. This presentation will go deep into various features of Kubernetes to create serverless functions. Also includes a comparative study of various serverless frameworks such as Kubeless, Fission and Funktion are available in open source world. Will conclude with an implementation demo and some real world use cases. Presented in serverless summit 2017: www.inserverless.com

Proof of Concept: Serverless with Swarm by Nirmal Mehta, Booz Allen Hamilton Docker, Inc.

The document discusses serverless computing with Docker containers. It provides definitions of serverless and functions-as-a-service. It then summarizes several serverless platforms like Serverless.com, Iron.io IronWorker, and iopipe Dockaless and how they integrate Docker containers or allow running code on multiple clouds. It demonstrates running a simple Docker container function locally using the Dockaless library. In conclusion, while serverless is still early, Docker containers provide a way to build serverless applications that are infrastructure agnostic.

Containers: Life Beyond Microservices? by Sushil Kumar, Robin SystemsDocker, Inc.

The document discusses containers and how they can be used for stateless and stateful applications. It notes that while containers provide CPU and memory isolation, traditional storage systems cannot handle the scale and performance needs of containerized applications. The Robin Containerization Platform aims to address these issues with its container-aware storage layer that can support large volumes of variable sized volumes, quickly create and destroy snapshots and clones, and provide end-to-end performance isolation and QoS controls from applications to storage. It also decouples compute and storage to allow independent scaling and portability without data loss.

Webcast - Making kubernetes production readyApplatix

Building Micro-Services with ScalaYardena Meymann

"Microservices" is one of the hottest buzzwords and, as usual, everyone wants them, but few know how to build them. In this talk we will offer our interpretation of microservice architecture, and show how we are implementing these ideas: using Scala, Akka, sbt and Docker, we modularized Akka applications, Spark jobs and Play servers. In the talk we will discuss design trade-offs and challenges that we faced in the process, and how we have overcome them. The focus is not on particular features of Scala language or a library, but on building modern applications using the Typesafe stack and other open-source tools.

Securing Containers From Day One | null Ahmedabad MeetupKumar Ashwin

Kumar Ashwin gives a presentation on securing containers from day one. The presentation covers what containers are, why we need them, the difference between virtual machines and containers, cgroups and namespaces, Docker basics, building optimized Docker images, and best practices for Dockerfile security. Some key points discussed include using minimal base images, ignoring unnecessary files, creating "golden images" as hardened base templates, not running as root, avoiding secrets in Dockerfiles, and using tools like Hadolint and Dockle to scan for issues.

Henrique Rodrigues (NotOnTheHighStreet.com) - Building a Future-Proof Infrast...Outlyer

This document discusses the evolution of notonthehighstreet.com's infrastructure from a monolithic Ruby on Rails application hosted on over 150 physical and virtual servers, to a microservices architecture using Docker containers, Mesos for clustering, and Consul for service discovery and configuration management. The goals of the new architecture were to build a scalable, self-service infrastructure that allows for easy creation and management of new services. Key aspects of the implementation include using Docker to define service environments, Mesos for container orchestration, Consul as a configuration store, and ELK stack for logging. Ansible is used for configuration management and deploying services via integration with tools like Marathon and Jenkins.

Building CI/CD Pipelines with Jenkins and KubernetesJanakiram MSV

Adopting containers and kubernetes in productionTa Ching Chen

Ta-Ching Chen is a DevOps and backend engineer with experience in system architecture design, implementation, and performance tuning. His blog details his work with Kubernetes, an open-source platform for automating deployment, scaling, and operations of application containers across clusters of hosts, providing container-centric infrastructure. He discusses how Kubernetes helps eliminate dependency problems and ensure compatibility between services during upgrades through features like rolling upgrades and built-in service monitoring.

Greetings from AWS User Group TaiwanCliff Chao-kuan Lu

Serverless Summit India 2017: FissionVishal Biyani

The document discusses serverless computing on Kubernetes using the Fission platform. It provides an overview of Fission concepts and architecture, including that Fission allows running serverless functions on Kubernetes, hides underlying complexity from developers, and optimizes resource usage. It also describes Fission features like event queues, function environments, composing functions into workflows, and monitoring. A demo of Fission is mentioned.

Intro to ServerlessCliff Chao-kuan Lu

From Virtual Machines to Containerscamunda services GmbH

The document discusses Camunda's transition from a traditional Jenkins setup with virtual machines to a containerized continuous integration infrastructure using Docker and Jenkins. Some of the key problems with the previous setup included a lack of isolation between jobs, limited scalability, and difficulties maintaining the infrastructure. The new system achieves isolated and reproducible jobs through one-off Docker containers, scalability through Docker Swarm on commodity hardware, and infrastructure maintenance through immutable Docker images and infrastructure as code definitions. Lessons learned include automating as much as possible, designing for scale, testing all aspects of the new system, and controlling dependencies.

JUC Europe 2015: From Virtual Machines to Containers: Achieving Continuous In...CloudBees

By Christian Lipphardt, Camunda Services Camunda is an open source, Java-based framework process/business process automation. As a middleware technology, Camunda integrates with six different Java application servers (in different versions) and supports six different database products. The team at Camunda maintains five supported versions of Camunda itself, adding two versions every year. Maintaining the necessary continuous integration (CI) infrastructure based on virtual machines became increasingly problematic, with poor build reproducibility and limited scalability. Feedback cycles for developers were unacceptable. Recently Camunda switched from the virtual machine model to a container model based on Docker. The Camunda team now develops infrastructure as code and applies microservice-like separation of concerns. In the talk, Daniel will share the new CI architecture and present lessons learned.

More Related Content

What's hot (20)

Serverless and cloud computingzekeLabs Technologies

Netflix0SS Services on DockerDocker, Inc.

TDC2017 | São Paulo - Trilha Containers How we figured out we had a SRE team ...tdc-globalcode

DevOpsCon Cloud Workshop Sascha Möllering

Docker in Production at the Aurora TeamHaufe-Lexware GmbH & Co KG

ServerlessDaniel Cottone

Autoscaling Docker Containers by Konstantinos Faliagkas, Docker Birthday #3 A...Docker, Inc.

On Prem Container Cloud - Lessons LearnedCodeOps Technologies LLP

Kubernetes for Serverless - Serverless Summit 2017 - Krishna KumarCodeOps Technologies LLP

Proof of Concept: Serverless with Swarm by Nirmal Mehta, Booz Allen Hamilton Docker, Inc.

Containers: Life Beyond Microservices? by Sushil Kumar, Robin SystemsDocker, Inc.

Webcast - Making kubernetes production readyApplatix

Building Micro-Services with ScalaYardena Meymann

Securing Containers From Day One | null Ahmedabad MeetupKumar Ashwin

Henrique Rodrigues (NotOnTheHighStreet.com) - Building a Future-Proof Infrast...Outlyer

Building CI/CD Pipelines with Jenkins and KubernetesJanakiram MSV

Adopting containers and kubernetes in productionTa Ching Chen

Greetings from AWS User Group TaiwanCliff Chao-kuan Lu

Serverless Summit India 2017: FissionVishal Biyani

Intro to ServerlessCliff Chao-kuan Lu

Serverless and cloud computingzekeLabs Technologies

Netflix0SS Services on DockerDocker, Inc.

TDC2017 | São Paulo - Trilha Containers How we figured out we had a SRE team ...tdc-globalcode

DevOpsCon Cloud Workshop Sascha Möllering

Docker in Production at the Aurora TeamHaufe-Lexware GmbH & Co KG

ServerlessDaniel Cottone

Autoscaling Docker Containers by Konstantinos Faliagkas, Docker Birthday #3 A...Docker, Inc.

On Prem Container Cloud - Lessons LearnedCodeOps Technologies LLP

Kubernetes for Serverless - Serverless Summit 2017 - Krishna KumarCodeOps Technologies LLP

Proof of Concept: Serverless with Swarm by Nirmal Mehta, Booz Allen Hamilton Docker, Inc.

Containers: Life Beyond Microservices? by Sushil Kumar, Robin SystemsDocker, Inc.

Webcast - Making kubernetes production readyApplatix

Building Micro-Services with ScalaYardena Meymann

Securing Containers From Day One | null Ahmedabad MeetupKumar Ashwin

Henrique Rodrigues (NotOnTheHighStreet.com) - Building a Future-Proof Infrast...Outlyer

Building CI/CD Pipelines with Jenkins and KubernetesJanakiram MSV

Adopting containers and kubernetes in productionTa Ching Chen

Greetings from AWS User Group TaiwanCliff Chao-kuan Lu

Serverless Summit India 2017: FissionVishal Biyani

Intro to ServerlessCliff Chao-kuan Lu

Similar to Next generation pipelines (20)

From Virtual Machines to Containerscamunda services GmbH

JUC Europe 2015: From Virtual Machines to Containers: Achieving Continuous In...CloudBees

Introduction to jenkinsAbe Diaz

Jenkins-CIGong Haibing

This document discusses Jenkins-CI, an open source tool for continuous integration and continuous delivery. It provides an overview of Jenkins-CI capabilities including building and testing software projects continuously, integrating changes, and continuously delivering software. The document also demonstrates Jenkins-CI in action with a live demo and discusses configuring Jenkins jobs, managing Jenkins, and requirements for deployment beyond Jenkins-CI like standardization, workflow, monitoring, and high availability.

SD DevOps Meet-up - Jenkins 2.0 and Pipeline-as-CodeBrian Dawson

Continuos Integration and Delivery: from Zero to Hero with TeamCity, Docker a...Lean IT Consulting

DevOps World | Jenkins World 2018 and The Future of JenkinsNigel Charman

Codifying the Build and Release Process with a Jenkins Pipeline Shared LibraryAlvin Huang

CI/CD (DevOps) 101Hazzim Anaya

DockerCon 15 Keynote - Day 2Docker, Inc.

The document summarizes Day 2 of DockerCon. It discusses Docker being ready for production use with solutions for building, shipping, and running containers. It highlights Docker Hub growth and improvements to quality. Business Insider's journey with Docker is presented, covering lessons learned around local development and using Puppet and Docker Hub. Future directions discussed include orchestration tools and image security.

Basic Jenkins Guide.pptxJayanga V. Liyanage

This document provides an overview of Jenkins, an open-source tool for continuous integration and continuous delivery. It discusses key Jenkins concepts like architecture, pipelines, and shared libraries. Jenkins allows integrating multiple stages of development through continuous integration and delivery. It has a master-slave architecture and supports defining automated build processes through pipelines implemented as code.

Efficient Parallel Testing with Docker by Laura FrankDocker, Inc.

Fast and efficient software testing is easy with Docker. We often use containers to maintain parity across development, testing, and production environments, but we can also use containerization to significantly reduce time needed for testing by spinning up multiple instances of fully isolated testing environments and executing tests in parallel. This strategy also helps you maximize the utilization of infrastructure resources. The enhanced toolset provided by Docker makes this process simple and unobtrusive, and you’ll see how Docker Engine, Registry, Machine, and Compose can work together to make your tests fast.

Devops Online Training.pdfSpiritsoftsTraining

Phone:+91 970 442 9989 (WhatsApp Also) Email: [email protected] A DevOps certification training course is designed to teach individuals and organizations how to implement DevOps practices and principles for software development and delivery. The course typically covers topics such as continuous integration, continuous delivery, infrastructure as code, and automated testing. The course is usually delivered through a combination of instructor-led training, hands-on exercises, and online resources. Participants will learn how to use tools and techniques to automate software development and delivery processes, improve collaboration between development and operations teams, and increase the speed and quality of software delivery. The course may also cover advanced topics such as containerization, microservices architecture, and DevOps culture and mindset. Upon completion of the course, participants should have a comprehensive understanding of DevOps principles and practices and be able to implement them effectively in their own organizations. They may also receive a certification credential from a recognized DevOps certification authority, such as DevOps Institute or the DevOps Agile Skills Association (DASA).

Devops Online Training.pdfSpiritsoftsTraining

Phone:+91 970 442 9989 (WhatsApp Also) Email: [email protected] DevOps is a set of practices and methodologies that emphasize collaboration and communication between development and operations teams to enable continuous delivery and faster deployment of software applications. A DevOps certification training course can help you gain the skills and knowledge needed to succeed as a DevOps professional. A good DevOps certification training course should cover the following topics: DevOps Fundamentals: This topic covers the basics of DevOps, including its principles, practices, and benefits. Continuous Integration and Delivery: This topic covers how to use tools and techniques to automate the building, testing, and deployment of software applications. Cloud Infrastructure: This topic covers how to set up and manage cloud infrastructure using tools like AWS, Azure, and Google Cloud. Configuration Management: This topic covers how to manage and automate the configuration of infrastructure and software using tools like Ansible, Chef, and Puppet. Containerization and Orchestration: This topic covers how to use tools like Docker and Kubernetes to containerize and orchestrate software applications. Monitoring and Logging: This topic covers how to monitor and analyze system and application logs to identify and resolve issues. The best DevOps certification training course should provide you with hands-on experience with DevOps tools and techniques and should also offer support and guidance from experienced DevOps professionals. It should be interactive and engaging, with plenty of exercises, quizzes, and projects to help you apply what you learn. Finally, it should be flexible and affordable, allowing you to learn at your own pace and within your budget. There are many online training platforms that offer DevOps certification courses, such as Udemy, Coursera, and LinkedIn Learning. It's important to choose a course that is up-to-date with the latest DevOps tools and practices and is taught by experienced DevOps professionals. You can check the ratings and reviews of the courses before purchasing them to ensure you find the best course for your needs.

Devops Online Training.pdfSpiritsoftsTraining

Devops Online Training provide you with in depth practical knowledge of different Devops tools Git Jenkins Docker Vagrant New Relic ELK Ansible Puppet Nagios and Kubernetes Devops Online Training help you to get the practical knowledge in the different aspects of continuous development continuous integration continuous testing continuous deployment. Spiritsofts is the best Training Institutes to expand your skills and knowledge. We Provides the best learning Environment. Obtain all the training by our expert professional which is having working experience from Top IT companies. The Training in is every thing we explained based on real time scenarios it works which we do in companies.

Devops Online Training.pdfSpiritsoftsTraining

Continuous Deployment into the Unknown with Artifactory, Bintray, Docker and ...Gilad Garon

VMware’s Common SaaS Platform (CSP) is a brand new offering designed to enhance the productivity of developers and cloud providers by equipping them with a set of common and configurable capabilities (such as Identity, Telemetry, Account Management, Billing etc.), thus enabling them to focus on their core businesses. But enough with the product pitch. CSP is distributed to numerous cloud providers around the globe, used by developers and IT alike to empower their services and better answer the business need of their customers. Please join us and witness how we take continuous delivery to the next step where sometimes the target environment is not on our control and still seamlessly manage and deliver our unique collection of capabilities, packaged as platform for ease of use, using the best and shiniest tools the frogs can provide.

Building Efficient Parallel Testing Platforms with DockerLaura Frank Tacho

We often use containers to maintain parity across development, testing, and production environments, but we can also use containerization to significantly reduce time needed for testing by spinning up multiple instances of fully isolated testing environments and executing tests in parallel. This strategy also helps you maximize the utilization of infrastructure resources. The enhanced toolset provided by Docker makes this process simple and unobtrusive, and you’ll see how Docker Engine, Registry, and Compose can work together to make your tests fast.

Continuous Deployment with Kubernetes, Docker and GitLab CIalexanderkiel

This document discusses continuous deployment of Clojure services to Kubernetes using Docker and GitLab CI. It provides an overview of Docker, Kubernetes, deploying a sample Clojure service, and configuring GitLab CI for continuous integration and deployment. The sample Clojure service is built as a Docker image, tested using GitLab CI, and deployed to Kubernetes clusters for testing and production using configuration files and GitLab CI pipelines.

From Virtual Machines to Containerscamunda services GmbH

JUC Europe 2015: From Virtual Machines to Containers: Achieving Continuous In...CloudBees

Introduction to jenkinsAbe Diaz

Jenkins-CIGong Haibing

SD DevOps Meet-up - Jenkins 2.0 and Pipeline-as-CodeBrian Dawson

Continuos Integration and Delivery: from Zero to Hero with TeamCity, Docker a...Lean IT Consulting

DevOps World | Jenkins World 2018 and The Future of JenkinsNigel Charman

Codifying the Build and Release Process with a Jenkins Pipeline Shared LibraryAlvin Huang

CI/CD (DevOps) 101Hazzim Anaya

DockerCon 15 Keynote - Day 2Docker, Inc.

Basic Jenkins Guide.pptxJayanga V. Liyanage

Efficient Parallel Testing with Docker by Laura FrankDocker, Inc.

Devops Online Training.pdfSpiritsoftsTraining

Continuous Deployment into the Unknown with Artifactory, Bintray, Docker and ...Gilad Garon

Building Efficient Parallel Testing Platforms with DockerLaura Frank Tacho

Continuous Deployment with Kubernetes, Docker and GitLab CIalexanderkiel

Recently uploaded (20)

Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

Heap, Types of Heap, Insertion and DeletionJaydeep Kale

AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB

I started my online journey with several hosting services before stumbling upon Ai EngineHost. At first, the idea of paying one fee and getting lifetime access seemed too good to pass up. The platform is built on reliable US-based servers, ensuring your projects run at high speeds and remain safe. Let me take you step by step through its benefits and features as I explain why this hosting solution is a perfect fit for digital entrepreneurs.

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Quantum Computing Quick Research Guide by Arthur MorganArthur Morgan

This is a Quick Research Guide (QRG). QRGs include the following: - A brief, high-level overview of the QRG topic. - A milestone timeline for the QRG topic. - Links to various free online resource materials to provide a deeper dive into the QRG topic. - Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic. QRGs planned for the series: - Artificial Intelligence QRG - Quantum Computing QRG - Big Data Analytics QRG - Spacecraft Guidance, Navigation & Control QRG (coming 2026) - UK Home Computing & The Birth of ARM QRG (coming 2027) Any questions or comments? - Please contact Arthur Morgan at [email protected]. 100% human made.

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including: -Artificial Intelligence Market Overview -Strategies for AI Adoption in 2025 -Anticipated drivers of AI adoption and transformative technologies -Benefits of AI and Big data for your business -Tips on how to prepare your business for innovation -AI and data privacy: Strategies for securing data privacy in AI models, etc. Download your free copy nowand implement the key findings to improve your business.

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

tecnologias de las primeras civilizaciones.pdffjgm517

How analogue intelligence complements AIPaul Rowe

Artificial Intelligence is providing benefits in many areas of work within the heritage sector, from image analysis, to ideas generation, and new research tools. However, it is more critical than ever for people, with analogue intelligence, to ensure the integrity and ethical use of AI. Including real people can improve the use of AI by identifying potential biases, cross-checking results, refining workflows, and providing contextual relevance to AI-driven results. News about the impact of AI often paints a rosy picture. In practice, there are many potential pitfalls. This presentation discusses these issues and looks at the role of analogue intelligence and analogue interfaces in providing the best results to our audiences. How do we deal with factually incorrect results? How do we get content generated that better reflects the diversity of our communities? What roles are there for physical, in-person experiences in the digital world?

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Talk at the final event of Data Fusion Dynamics: A Collaborative UK-Saudi Initiative in Cybersecurity and Artificial Intelligence funded by the British Council UK-Saudi Challenge Fund 2024, Cardiff Metropolitan University, 29th April 2025 https://alandix.com/academic/talks/CMet2025-AI-Changes-Everything/ Is AI just another technology, or does it fundamentally change the way we live and think? Every technology has a direct impact with micro-ethical consequences, some good, some bad. However more profound are the ways in which some technologies reshape the very fabric of society with macro-ethical impacts. The invention of the stirrup revolutionised mounted combat, but as a side effect gave rise to the feudal system, which still shapes politics today. The internal combustion engine offers personal freedom and creates pollution, but has also transformed the nature of urban planning and international trade. When we look at AI the micro-ethical issues, such as bias, are most obvious, but the macro-ethical challenges may be greater. At a micro-ethical level AI has the potential to deepen social, ethnic and gender bias, issues I have warned about since the early 1990s! It is also being used increasingly on the battlefield. However, it also offers amazing opportunities in health and educations, as the recent Nobel prizes for the developers of AlphaFold illustrate. More radically, the need to encode ethics acts as a mirror to surface essential ethical problems and conflicts. At the macro-ethical level, by the early 2000s digital technology had already begun to undermine sovereignty (e.g. gambling), market economics (through network effects and emergent monopolies), and the very meaning of money. Modern AI is the child of big data, big computation and ultimately big business, intensifying the inherent tendency of digital technology to concentrate power. AI is already unravelling the fundamentals of the social, political and economic world around us, but this is a world that needs radical reimagining to overcome the global environmental and human challenges that confront us. Our challenge is whether to let the threads fall as they may, or to use them to weave a better future.

How Can I use the AI Hype in my Business Context?Daniel Lehner

𝙄𝙨 𝘼𝙄 𝙟𝙪𝙨𝙩 𝙝𝙮𝙥𝙚? 𝙊𝙧 𝙞𝙨 𝙞𝙩 𝙩𝙝𝙚 𝙜𝙖𝙢𝙚 𝙘𝙝𝙖𝙣𝙜𝙚𝙧 𝙮𝙤𝙪𝙧 𝙗𝙪𝙨𝙞𝙣𝙚𝙨𝙨 𝙣𝙚𝙚𝙙𝙨? Everyone’s talking about AI but is anyone really using it to create real value? Most companies want to leverage AI. Few know 𝗵𝗼𝘄. ✅ What exactly should you ask to find real AI opportunities? ✅ Which AI techniques actually fit your business? ✅ Is your data even ready for AI? If you’re not sure, you’re not alone. This is a condensed version of the slides I presented at a Linkedin webinar for Tecnovy on 28.04.2025.

What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat

The MCP (Model Context Protocol) is a framework designed to manage context and interaction within complex systems. This SlideShare presentation will provide a detailed overview of the MCP Model, its applications, and how it plays a crucial role in improving communication and decision-making in distributed systems. We will explore the key concepts behind the protocol, including the importance of context, data management, and how this model enhances system adaptability and responsiveness. Ideal for software developers, system architects, and IT professionals, this presentation will offer valuable insights into how the MCP Model can streamline workflows, improve efficiency, and create more intuitive systems for a wide range of use cases.

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Want to learn practical tips for designing systems that can scale efficiently without compromising speed? Join us for a workshop where we’ll address these challenges head-on and explore how to architect low-latency systems using Rust. During this free interactive workshop oriented for developers, engineers, and architects, we’ll cover how Rust’s unique language features and the Tokio async runtime enable high-performance application development. As you explore key principles of designing low-latency systems with Rust, you will learn how to: - Create and compile a real-world app with Rust - Connect the application to ScyllaDB (NoSQL data store) - Negotiate tradeoffs related to data modeling and querying - Manage and monitor the database for consistently low latencies

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots. 📕 Here's what you can expect: - Modeling: Build end-to-end processes using BPMN. - Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes. - Operating: Control process instances with rewind, replay, pause, and stop functions. - Monitoring: Use dashboards and embedded analytics for real-time insights into process instances. This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes. 👨‍🏫 Speaker: Andrei Vintila, Principal Product Manager @UiPath This session streamed live on April 29, 2025, 16:00 CET. Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

Heap, Types of Heap, Insertion and DeletionJaydeep Kale

AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Quantum Computing Quick Research Guide by Arthur MorganArthur Morgan

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

tecnologias de las primeras civilizaciones.pdffjgm517

How analogue intelligence complements AIPaul Rowe

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

How Can I use the AI Hype in my Business Context?Daniel Lehner

What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

Next generation pipelines

1. The next generation of CI/CD pipelines Alex Landa Head of DevOps and BigData technologies at Trainologic

2. CI Pipeline Code committed compile test Static analysis package Publish to artifact repo

3. CD Pipeline Fetch artifacts deploy to staging integration tests Performance tests? Deploy to production

4. Why are we having this talk? • Because ”Micro Services” and “Cloud” • We need to build and deploy • More services • Faster • Flexible • Reliable • Reproduceable • To more environments • And awesome 

5. Jenkins – the swiss knife of CI • If you didn’t hear about Jenkins.. • Flexible Job runner adapted for CI/CD purposes • Job is a runnable task controlled by Jenkins • Executed on a Jenkins nodes • Has its own “workspace” • Jenkins provides plugins for almost anything

6. No Manual Jobs ever again • Traditionally Jenkins jobs were created in the UI by the CM • Customization per job were manual as well • But what if you have more than 20 services? • How do you manage these different configurations? • Who manages them? • How does a developer know what Jenkins is executing?

7. Jenkins Pipeline • Suite of plugin that introduces continues delivery pipelines to Jenkins • The pipeline is describe in Jenkinsfile using groovy DSL. • It is kept as part of the project repository • Changes are versioned • Developers have access to the build • Different branches may have different builds

8. Syntax Declarative • DSL based • Strict • “Best Practice” • Limited • Can include scripts Scripted • Groovy based • Flexible • Groovy learning curve • Doesn’t ensure future

9. Jenkins Demo

10. Why Docker is great for CI Pipeline? • Can be used as the build tool • Complete environment isolation • Predefined settings • Can be used for integration tests – docker-compose • Can be used as the scale framework • Run Jenkins on K8s or ECS

11. Gitlab • Aren’t they into Git something? • Gitlab provide the “complete DevOps experience” • Issue board • Git • CI pipelines • Docker registry • Static analysis and security testing • Release and environment management • Monitoring • More..

12. Gitlab pipelines • Built-in support for Docker • Jobs are defined in “.gitlab-ci.yml” • Stages – specify the lifecycle of the build • Useful for multistage pipelines • Jobs – execution step, run in separate from each other • Every job to a stage, if not specified belongs to the build stage • Runner – run the jobs, can be a VM, a VPS, a docker container or even a k8s cluster

13. Gitlab demo

14. Summary • Define your CI in code – no matter which CI tool you use • Use Docker for the CI process as much as possible • Jenkins is great • Gitlab is also great and provides a complete solution

Next generation pipelines

Recommended

More Related Content

What's hot (20)

Similar to Next generation pipelines (20)

Recently uploaded (20)

Next generation pipelines