DevOps in realtime

Jun 18, 2014Download as ODP, PDF2 likes1,300 views

1) DevOps in real time discusses challenges of maintaining 24/7 operations for multiple online projects and teams spread across different geographies. 2) The plan is to use tools like Chef, continuous integration, monitoring, backups, and team communication to improve processes around deployment cycles, server configuration, and working with many teams. 3) Chef is highlighted as a tool to help with automatic server configuration, continuous delivery, simplifying testing, controlling monitoring and backups. Templates, autoscaling, and single naming rules are also discussed to help manage infrastructure.

DevOps in real time
Andriy Samilyak
OpsWay
CEO

20 online projects
One 24х7 support team

Me v0.1
● 7 yrs in IT
● since 2008 – Smile Ukraine CTO
● since 2013 – leading OpsWay
● coaching people on DevOps

Problem №1 – life in 24x7
Часы
%
new
requests

Problem №3 - Developers
“When I see ... developers – all I see is risk”
Chuck Rossi, Facebook

Plan
● Processes
– Deployment cycle
– Working with many teams
● Tools
– Chef for automatic configuration
– Continuous integration
– Monitoring
– Backups
– Team communication

Opscode Chef
● Full control over server configuration
● Continuous delivery
● Access control
● Making testing simplier
● Controlling what and when is monitored
● Configuration as application vs documentation

Why Chef?
● Facebook, Amazon
● Ruby vs XML
● Simple start
● Not expensive and reliable hosted server
● Historically it was a decision against Puppet
(no holy wars!)
vs

Single rules for server naming
ansam@vostok:~$ knife sshx projectx-live-node
Multiple instances found!
1. i-cca165f0 since 2013-08-06 10:11:16 UTC ip 54.253.26.66
2. i-6ca71550 since 2013-08-07 19:06:05 UTC ip 54.253.66.83
3. i-6ea71552 since 2013-08-07 19:06:05 UTC ip 54.253.44.185
4. i-6fa71553 since 2013-08-07 19:06:05 UTC ip 54.252.44.245
Choose <1-4>: [1] 2
Instance i-6ca71550 ip 54.253.66.83
Connecting to 54.253.66.83 as user ubuntu on port 22
проект среда роль

Continuous integration
What else can you choose?:
– TeamCity
– Bamboo
– Travis CI
– tool Х
Why Jenkins?

Simple deployment cycle
Development
Vagrant box
Test server Live
Many features simultaneously developed

Working with other teams
master
develop
fork for DevTeamX - develop

Bakery
Jenkins
jobs
Live Amazon AMI
Sandbox
about 4 hours
5 min

Sandbox
● DNS via Route53
● Can make demo to client
● Deployed from к github repo/branch
● New job in Jenkins for deployment – easily
redeployed
● EC2 instance
● Almost complete copy of live project

Workflow 1.1
Scheduled, once a day
Live
Test
Sandbox1 Sandbox2

Monitoring
Configure
monitoring
depending on
server type
● Message routing
● Scheduling plugins
● Cyclic DB
● Data processing
● Charting and plotting
● results DB
● search
● alerts
● Analysis and charting

● Take all records from access.log from all servers of ProjectX
● Include records with User-Agent = “Apache*” and URL like /aaaa/bbb-123.html
● Calculate avg time of such requests for the last 7 days

Chef + Amazon EBS = Backup profit
EBS
Server configuration
(Chef)
/var/www

Andriy Samilyak
samilyak@gmail.com
skype: samilyaka
http://opsway.com

This document summarizes Noam Shochat's presentation at the Jenkins User Conference Israel on building a deployment pipeline at eToro. It describes eToro's infrastructure with 120 services, 300 servers across 3 data centers and 2 clouds. It outlines the problems they faced with manual deployments and lack of uniformity. The solution involved using Jenkins for continuous integration and delivery, along with Mcollective for orchestration and Puppet for deployment automation. Key components of the pipeline included committing code, building, running unit tests, deploying to QA, running integration tests, and deploying to production.

Flash Camp Chennai - Build automation of Flex and AIR applicationsRIA RUI Society

Software Delivery in 2016 - A Continuous Delivery ApproachGiovanni Toraldo

Continuous operations in AWSAleksandr Maklakov

This document outlines best practices for continuous operations in DevOps. It discusses challenges with traditional system administration approaches being slower than development teams. The document recommends a DevOps approach where system administrators have development skills and focus on automation to deploy code within minutes. It provides an overview of continuous integration/delivery pipelines and infrastructure as code using AWS Elastic Beanstalk as an example. The document concludes by offering additional DevOps training.

An OpenShift Migration: From 3.9 to 4.5Everett Toews

The document summarizes a migration from OpenShift 3.9 to OpenShift 4.5. The plan involved building a proof of concept, building test clusters, communications, performing a cutover, validating the new clusters, and decommissioning the old clusters. There were some initial challenges around VMware and networking configurations, but the migration went smoothly overall. Going forward, the organization will focus on upgrades, new technologies like Tekton and service mesh, and ensuring a seamless experience for end users.

Travis CIАнете Аннемария

Travis CI is a hosted continuous integration service that is integrated with GitHub. It monitors GitHub projects, runs tests, provides feedback, builds artifacts, checks code quality, and can deploy to cloud services. Compared to Jenkins, Travis CI is a commercial service that emphasizes convention over configuration and is easier to use, while Jenkins is open-source and more flexible. Travis CI automatically runs builds when code is pushed to GitHub, using fresh virtual machine environments for each build to provide a clean build environment. It supports over 20 programming languages and deployment to various cloud services.

Gitlab ci-cdDan MAGIER

This document discusses GitLab Continuous Integration (GitLab CI/CD). It defines continuous integration, continuous delivery, and continuous deployment. It explains that GitLab CI/CD uses pipelines made up of stages and jobs to test, build, and deploy code. Pipelines are configured using a YAML file. Jobs run on GitLab runners, which can execute jobs locally or using Docker. Benefits of GitLab CI/CD include integrated pipelines, Docker/Kubernetes integration, and not requiring plugins. The downside is that it is only available within GitLab.

Report portalCOMAQA.BY

Automated testing with OpenshiftOleg Popov

The document discusses options for testing software including manual testing with Vagrant and Robot Framework as well as automated testing. It recommends using OpenShift for automated testing as it provides a reliable solution with Kubernetes that is scalable and controllable while Docker provides speed and high density. Open vSwitch enables network connectivity in OpenShift. Workflow and reference details are also included.

Version ControllingVaidik Kapoor

This document discusses version control and introduces Git. It defines version control as a system to record changes to files. Centralized version control stores changes on a central server, while distributed version control gives each user a complete copy of the code repository. The document then covers basic Git commands like init, add, commit, log, revert, branch, merge, and handling merge conflicts. More resources for learning Git are provided.

Successful DevOps implementation for small teams a true storyJakub Paweł Głazik

DevOps aims to reduce the time between committing code changes and deploying to production while ensuring high quality. The document discusses how to successfully implement DevOps for small teams through automation, containers, cloud infrastructure, and streamlining deployment and infrastructure processes. It recommends enabling developers, using Kubernetes for deployments, implementing infrastructure as code with Terraform and Atlantis, and fostering collaboration between dev and ops teams. The approach is shown to work based on the author's experience implementing DevOps at two companies with numerous daily deployments and infrastructure changes managed through pull requests.

Slow, Flaky and Legacy Tests: FTFY - Our New Testing Strategy at Net-A-Porter...Sauce Labs

As part of a recent replatforming exercise, Net-A-Porter has worked hard not only to refresh their technology, but to create a great testing culture. As a result, they have come a long way from “throwing tests over the wall.” Testing concerns are now part of their NFRs and technical decisions. Developers are responsible for unit and functional tests, working alongside test specialists who are part of every delivery team for guidance. In this SauceCon 2018 session, Adela Mosincat and James Collins will walk attendees through how Sauce Labs has helped in this process. She will review how the “test-runner” was born to facilitate the consistent and seamless running of their tests on Sauce Labs across teams. The test-runner is a Docker image, whose purpose is to handle the running of the tests both locally and in their CI pipeline. It parallelizes the tests as much as possible, executes intelligent waiting for VMs and retrying for flaky tests, supports test tagging and quarantining and handles reporting to both Sauce Labs and Jenkins. In addition to the test-runner, Adela and Jim will review how Net-A-Porter improved their dev/test culture and CI pipeline, and share what they learned along the way.

A little nginx (1)yang bingwu

Nginx is a popular web server that is known for its speed and flexibility. It uses an event-driven architecture called a reactor pattern that employs one master process and multiple worker processes to handle input/output operations efficiently. Nginx's code is written in C and optimized for performance. It also supports embedding the Lua programming language to add dynamic capabilities. The ngx_http_lua module allows running Lua code on certain Nginx hooks and injecting the Nginx C API into Lua.

Git+jenkins+rex presentationDwi Sasongko Supriyadi

This document discusses Git, Jenkins, and Rex in the context of continuous integration and delivery. It provides an overview of what each tool is and how they can work together. Git is used for version control and tracking changes. Jenkins monitors Git repositories for new commits and triggers automated builds. Rex is a tool that can be used by Jenkins to deploy builds to different environments and server groups. The document outlines how developers would use Git and how Jenkins would integrate with Git to build, test, and deploy code changes.

[Quality Meetup #20] Michał Górski - Continuous Deployment w chmurzeFuture Processing

W dzisiejszych czasach praca z chmurą pozwala niesamowicie zmniejszyć koszta wejścia na rynek z rozwiązaniami typu PoC i MVP oraz w późniejszych etapach rozwoju produktów skalować oprogramowanie według potrzeb. Niestety nie jest to złoty środekt i rozwiązując stare problemy, tworzy nowe. Dlatego, oprócz zapoznania się z technologią serverless, czy Infrastructure as a Code, spróbujemy przede wszystkim stworzyć bezpieczne środowisko, pozwalające na Continuous Deployment.

The automated tests inside OpenshiftOleg Popov

The document discusses automated testing inside Openshift including the contour of automated testing, dynamic configurations of Openshift, and integration with TestLink. It outlines pros and cons of automated testing using lightweight containers across a variety of operating systems. It describes how to dynamically configure tests by variables like project, branch, product name and version, and OS. It also covers how to create, execute, verify and delete configurations as well as generate reports and artifacts from test runs. Finally, it discusses integrating test results with TestLink for reporting.

Celery workshopEswar Vandanapu

This document provides an overview of Celery, an asynchronous task queue/job queue based on distributed message passing. It discusses offline execution vs online, installing and configuring Celery, creating simple tasks, integrating with Django, deployment considerations, and how Celery is used at Aviso. The agenda includes an introduction to Celery, installing it, creating simple tasks, using Celery Canvas to divide work, and deployment best practices.

CeleryYipit

This document discusses using Celery to handle asynchronous tasks in Django. It covers what Celery is, why it's useful to not block the user, speed and scale considerations, common use cases like logging and email, choosing a message queue like RabbitMQ, setting up queues vs hosts, tools and commands, and setting up a Celery daemon on Ubuntu. It also provides links to the Yipit Django team's blog which discusses more about using Celery.

Performance testing and monitoring: a guided tour through CLIF tools and feat...OW2

The CLIF project is 15 years old now - older than OW2 actually! Over the years, this performance testing software integrated new ideas, needs and technologies to keep efficient, powerful, maintainable and extendible: distributed and component-oriented programming, autonomic computing, continuous integration, cloud computing, containers... While CLIF production version 2.3.5 has just been released, let's have an overview of all available features and tools, and see how the project will carry on towards automation for efficient performance testing and monitoring.

Queick: A Simple Job Queue System for PythonRyota Suenaga

Ryota SUENAGA presented Queick, a simple job queue system he created for Python. Queick uses multi-threading to asynchronously execute jobs in the background. It was designed to be lightweight and use only Python's standard libraries. Key features include asynchronous and scheduled job execution, retries of failed jobs, and checking for network connectivity to re-enqueue jobs if the connection is lost. The architecture includes a job queue, worker processes to run jobs, and a separate process to monitor network status and retry downed jobs when the connection returns.

From Test to Live with RexJan Gehring

This document discusses Rex, a tool for automating server orchestration, configuration management, and deployments. Rex allows defining tasks in a Rexfile to provision and deploy virtual machines and hardware. It supports deploying applications via Git, package managers, or symlinks. Environments like development, test, and live can be managed. The philosophy is to get things done fast and reliably through automation and reproducibility.

Володимир Дубенко "Node.js for desktop development (based on Electron library)"Fwdays

Docker Practical Use CasesAlexei Yuzhakov

This document outlines several practical use cases for Docker, including running different versions of software like MySQL and PHP, using Docker as a development playground to test software across environments, and setting up local build farms. It also discusses common issues with Docker like the difference between containers and virtual machines, and tips for working with Docker like using docker exec to access running containers. Overall, the document argues that Docker is a useful tool with many potential use cases and over 100,000 available images, though there are some nuances to using containers effectively.

Creating a continuous delivery pipeline with dockercontainershipio

Vincit Teatime 2015.2 - Niko Kurtti: SaaSiin pa(i)nostustaVincitOy

Modernin ohjelmistoprojektin odotetaan olevan yksikkö- ja integraatiotestattu, koodikattavuuden kartoitettu, muutosten katselmoitu, ja koodin siirtyvän automaattisesti versiohallinnasta ajoon beta- ja tuotantoklustereille. Milloin? No versiohallintaan puskettaessa tietysti. Versiohallintalähtöistä, automoitua lähdekoodin ja tuotteenhallintaa GitHubista Traviksen syövereihin ja ajoon Amazonin Elastic Beanstalkiin. Tule kuulemaan hiljaista tietoa tämän vuosituhannen ohjelmistokehityksen perustyökaluista.

Debugging Effectively in the Cloud - Felipe Fidelix - Presentation at eZ Con...eZ Systems

Felipe Fidelix, Business Development Manager (UK) at Platform.sh spoke at eZ Conference 2017 on Debugging Effectively in the Cloud. Debugging PHP can be quite fun, if you just know how to do it. But what happens when you need to go beyond that? In his presentation, Felipe explains in depth how to debug PHP and related services using not-often-explored techniques like filesystem monitoring, mysql proxy interception, system call tracing, debugging remotely and a lot more.

Docker from a team perspectiveEdwin Vlieg

"Wix Serverless from inside", Mykola BorozdinFwdays

Сергей Кибиткин - Meet Magento Ukraine - Что вы никогда не сделаете в MagentoAtwix

Александр Смага, Юрий Муратов - Meet Magento Ukraine - Технический обзор OroCRM Atwix

More Related Content

What's hot (20)

Automated testing with OpenshiftOleg Popov

Version ControllingVaidik Kapoor

Successful DevOps implementation for small teams a true storyJakub Paweł Głazik

Slow, Flaky and Legacy Tests: FTFY - Our New Testing Strategy at Net-A-Porter...Sauce Labs

A little nginx (1)yang bingwu

Git+jenkins+rex presentationDwi Sasongko Supriyadi

[Quality Meetup #20] Michał Górski - Continuous Deployment w chmurzeFuture Processing

The automated tests inside OpenshiftOleg Popov

Celery workshopEswar Vandanapu

CeleryYipit

Performance testing and monitoring: a guided tour through CLIF tools and feat...OW2

Queick: A Simple Job Queue System for PythonRyota Suenaga

From Test to Live with RexJan Gehring

Володимир Дубенко "Node.js for desktop development (based on Electron library)"Fwdays

Docker Practical Use CasesAlexei Yuzhakov

Creating a continuous delivery pipeline with dockercontainershipio

Vincit Teatime 2015.2 - Niko Kurtti: SaaSiin pa(i)nostustaVincitOy

Debugging Effectively in the Cloud - Felipe Fidelix - Presentation at eZ Con...eZ Systems

Docker from a team perspectiveEdwin Vlieg

"Wix Serverless from inside", Mykola BorozdinFwdays

Automated testing with OpenshiftOleg Popov

Version ControllingVaidik Kapoor

Successful DevOps implementation for small teams a true storyJakub Paweł Głazik

Slow, Flaky and Legacy Tests: FTFY - Our New Testing Strategy at Net-A-Porter...Sauce Labs

A little nginx (1)yang bingwu

Git+jenkins+rex presentationDwi Sasongko Supriyadi

[Quality Meetup #20] Michał Górski - Continuous Deployment w chmurzeFuture Processing

The automated tests inside OpenshiftOleg Popov

Celery workshopEswar Vandanapu

CeleryYipit

Performance testing and monitoring: a guided tour through CLIF tools and feat...OW2

Queick: A Simple Job Queue System for PythonRyota Suenaga

From Test to Live with RexJan Gehring

Володимир Дубенко "Node.js for desktop development (based on Electron library)"Fwdays

Docker Practical Use CasesAlexei Yuzhakov

Creating a continuous delivery pipeline with dockercontainershipio

Vincit Teatime 2015.2 - Niko Kurtti: SaaSiin pa(i)nostustaVincitOy

Debugging Effectively in the Cloud - Felipe Fidelix - Presentation at eZ Con...eZ Systems

Docker from a team perspectiveEdwin Vlieg

"Wix Serverless from inside", Mykola BorozdinFwdays

Viewers also liked (20)

Сергей Кибиткин - Meet Magento Ukraine - Что вы никогда не сделаете в MagentoAtwix

Александр Смага, Юрий Муратов - Meet Magento Ukraine - Технический обзор OroCRM Atwix

DevOps в реальном времениAndriy Samilyak

Itea dev ops_course_topic2Vad Tymoshyk

This document contains notes from a DevOps training course. It discusses DevOps methodologies like Agile, ITIL, BPM and SOA. It also covers the software development lifecycle and definitions of ready and done. Infrastructure as code and the differences between application and infrastructure code are explained. Finally, common DevOps tools are listed and homework is assigned to create a Jenkins job to import a database dump.

Андрей Самиляк - Meet Magento Ukraine - Как мы играли в DevOps и как получилс...Atwix

Roman Valchuk "Introducing to DevOps technologies"Vadym Muliavka

Functional web with elixir and elm in phoenixIzzet Mustafaiev

Final melnyk 2Roman Melnyk

This document is Roman Melnyk's final presentation for group DevOps 086. It introduces Roman, discusses his studies and hobbies, and outlines an agenda covering environment management, network structure, disaster recovery plans, tenant management, types of hostings, and a price comparison of hosting options. The presentation then details the internal cloud infrastructure, how DHCP servers work, a disaster recovery plan for DNS and DHCP servers, an AWS cloud infrastructure using Route 53, and concludes by comparing the prices of dedicated servers, VPS, AWS, and Rackspace for a sample infrastructure configuration.

#nostaging - Software Circus - Amsterdam, 2-9-2016Pavel Chunyayev

Metrics: where and howVsevolod Polyakov

This document discusses Graphite and options for optimizing its performance for high volumes of metrics data. It summarizes the default Graphite architecture using Carbon and Whisper and different approaches for scaling it up including using go-carbon, carbon-c-relay, and evaluating alternative time series databases like Influx and OpenTSDB. Various techniques for optimizing whisper and cache configurations, I/O performance, and system parameters are also explored. Overall the best performing combination found was go-carbon with carbon-c-relay to handle over 1 million requests per second.

Monitoring base, golang meetup, kyivVsevolod Polyakov

Continuous integration with Docker and AnsibleDmytro Slupytskyi

This document discusses using continuous integration with Docker and Ansible. It describes building and deploying microservices across multiple technologies using Docker containers managed by Ansible playbooks. The process involves cloning repositories, building Docker images, testing, pushing images to a private Docker registry, and deploying containers to environments with Ansible. Benefits include easily managing container environments, portability across machines, and isolated workspaces for each service. Challenges addressed are timeouts, freezes, and long build times.

Implementing DevOps In PracticeZoltán Németh

At Ustream the teams developing the streaming technology stack are also responsible for operating it. This means we have our monitoring and alerting in place (including those based on error logs I mentioned above, but many others too) which alert the engineers themselves. I would like to talk about how we made this transition from the traditional setup where the devs did the coding and the sysops did the operation - what lessons we learned, how we convinced the sysop guys to give us permissions and so on

JUST EAT: Embracing DevOpsPeter Mounce

JUST EAT is an online food delivery company based in the UK that processes around 900 orders per minute at peak times. They have embraced DevOps practices to manage their Windows-based ecommerce platform on AWS. They use a microservices architecture with autonomous teams owning their own features and infrastructure. Key aspects of their approach include using persistent chat, real-time monitoring, alerting and logging to enable rapid debugging in production. Their culture emphasizes that teams are responsible for operating the features they build. They are continually working to improve test coverage and confidence while publishing more tools as open source software.

Lean part of DevOps - DevOps Amsterdam meetup - 17-8-2016Pavel Chunyayev

DevOps - Retour d'expérience - MarsJug du 29 Juin 2011Henri Gomez

Devops: от заката до рассветаAlexander Titov

Прошло время, когда DevOps не был еще модным, началось время карго-культов и безбашенных внедрений. В докладе я расскажу про основные ошибки перехода компании к DevOps из моей практики, покажу как не надо использовать инструменты и как не надо организовывать команды, а также многое другое.

Continuous Delivery by Alexey Turchanikov @ AgilePizza, Kyiv 2015Agile Ukraine

This document describes how a company achieved continuous delivery of software through breaking down bottlenecks, automating processes, and establishing a feature pipeline. The key steps included forming feature teams, deploying features to isolated environments, implementing automated testing and deployment, and removing dependencies on operations for releases. This enabled the goals of lower risk, faster feedback, and releasing multiple times per day while maintaining quality. Ongoing work includes further automating infrastructure configuration and deployments.

Improve the Development Process with DevOps Practices by Fedorov VadimSoftServe

The document discusses improving development processes with DevOps practices. It describes current issues like a lack of communication between development and operations teams and differences between development and production environments. It evaluates project maturity levels and suggests organizational changes like shared success metrics for teams. The document recommends implementing infrastructure as code, automating testing, and using a delivery pipeline to improve quality, repeatability and reduce risks. Adopting DevOps practices and tools can help align development and production environments.

Глобальні навчальні дні друпалAndrii Podanenko

Сергей Кибиткин - Meet Magento Ukraine - Что вы никогда не сделаете в MagentoAtwix

Александр Смага, Юрий Муратов - Meet Magento Ukraine - Технический обзор OroCRM Atwix

DevOps в реальном времениAndriy Samilyak

Itea dev ops_course_topic2Vad Tymoshyk

Андрей Самиляк - Meet Magento Ukraine - Как мы играли в DevOps и как получилс...Atwix

Roman Valchuk "Introducing to DevOps technologies"Vadym Muliavka

Functional web with elixir and elm in phoenixIzzet Mustafaiev

Final melnyk 2Roman Melnyk

#nostaging - Software Circus - Amsterdam, 2-9-2016Pavel Chunyayev

Metrics: where and howVsevolod Polyakov

Monitoring base, golang meetup, kyivVsevolod Polyakov

Continuous integration with Docker and AnsibleDmytro Slupytskyi

Implementing DevOps In PracticeZoltán Németh

JUST EAT: Embracing DevOpsPeter Mounce

Lean part of DevOps - DevOps Amsterdam meetup - 17-8-2016Pavel Chunyayev

DevOps - Retour d'expérience - MarsJug du 29 Juin 2011Henri Gomez

Devops: от заката до рассветаAlexander Titov

Continuous Delivery by Alexey Turchanikov @ AgilePizza, Kyiv 2015Agile Ukraine

Improve the Development Process with DevOps Practices by Fedorov VadimSoftServe

Глобальні навчальні дні друпалAndrii Podanenko

Similar to DevOps in realtime (20)

Continuous testingOleksandr Metelytsia

Continuous Delivery: 5 years later (Incontro DevOps 2018)Giovanni Toraldo

Continuous delivery is a software engineering approach where teams produce software in short cycles to ensure the software can be reliably released at any time. This allows for more incremental updates to applications in production. The document discusses the tools and processes used by Cloudesire to implement continuous delivery practices, including GitHub for issue tracking, CircleCI for continuous integration, Docker for packaging, Chef for configuration management, and various other tools for monitoring, logging, and metrics.

Test automation proposalMihai-Cristian Fratila

This document proposes an automated test architecture for the UI Builder application using REST API testing, UI testing, and integration testing. It recommends the Rest Assured library for API testing due to its ability to integrate with Jenkins and remove the need for manual HTTP calls. Protractor is proposed for UI testing as it allows testing Angular applications in JavaScript and integrates well with Selenium. Both test frameworks would be set up with their own Git repositories linked to Jenkins jobs. Integration testing would link the API and UI test repos. The test automation aims to provide faster feedback and reduce regressions as the application grows.

Introduction to DevOps. Continuous Integration by Myroslav Dmytrus Binary Studio

Continuous integration is a development practice where developers integrate code into a shared repository frequently, preferably several times a day. Every change is built and tested on an integration machine. The goal is to detect problems early to minimize integration issues. Continuous integration uses automated builds that are triggered on every code commit to provide rapid feedback. It helps teams integrate code and build quality in from the start.

Building a Distributed & Automated Open Source Program at NetflixAll Things Open

Netflix Open Source: Building a Distributed and Automated Open Source Programaspyker

Netflix has been using and contributing to open source for several years. Over the years, Netflix has released over one hundred Netflix Open Source (aka NetflixOSS) libraries, servers, and technologies. Netflix engineers benefit by accepting contributions and gathering feedback with key collaborators around the world. Users of NetflixOSS from many industries benefit from our solutions including Big Data, Build and Delivery Tools, Runtime Services and Libraries, Data Persistence, Insight, Reliability and Performance, Security and User Interface. With such a large and mature open source program, Netflix has worked on approaches and tools that help manage and improve the NetflixOSS source offerings and communities. Netflix has taken a different approach to building support for open source as compared to other Internet scale companies. Come to this session to learn about the unique approaches Netflix has taken to both distribute and automate the responsibilities of building a world-class open source program.

Bots on guard of sdlcAlexey Tokar

Automation: The Good, The Bad and The Ugly with DevOpsGuys - AppD Summit EuropeAppDynamics

A cornerstone of the DevOps philosophy, investment in automation at all stages across the SDLC has increased over recent years. Automation promises velocity and reduced errors, helps foster repeatable processes, and removes the need for long hours on dull, repetitive tasks. So what’s not to like? The downside of automation is that unless applied at the right place in your SDLC it can make a bad process worse. Automation also raises questions around job security, the need for re-skilling in other areas, and tool sprawl if different teams each choose their preferred technology. This session will outline: -A short chronology of where automation has impacted the modern software stack -Where it makes the most sense to automate (by identifying your key constraints) -Best practices for adopting automation and how to identify where it’s working — and where it isn’t For more information, visit: www.appdynamics.com

DevOpsGuys - DevOps Automation - The Good, The Bad and The UglyDevOpsGroup

Software TestingAndrew Wang

The document discusses software testing and how to prevent defects. It recommends implementing various types of tests at different stages, including unit tests, integration tests, UI tests, system tests, and manual tests. The faster a test can run, the more often it should be run. Tests should run in parallel and be distributed to improve efficiency. Flaky tests waste time and hurt trust in the test suite, so they must be addressed promptly. Writing automated tests of various granularities helps enable fast development cycles and prevents regressions.

Continuous Integration for OpenVMS with Jenkinsecubemarketing

Extensible dev secops pipelines with Jenkins, Docker, Terraform, and a kitche...Richard Bullington-McGuire

Have you ever needed to wrestle a legacy application onto a modern, scalable cloud platform, while increasing security test coverage? Sometimes real applications are not easily stuffed into a Docker container and deployed in a container orchestration system. In this talk, Modus Create Principal Architect Richard Bullington-McGuire will show how to compose Jenkins, Docker, Terraform, Packer, Ansible, Packer, Vagrant, Gauntlt, OpenSCAP, the CIS Benchmark for Linux, AWS CodeDeploy, Auto Scaling Groups, Application Load Balancers, and other AWS services to create a performant and scalable solution for deploying applications. A local development environment using Vagrant mirrors the cloud deployment environment to minimize surprises upon deployment.

DevOps for TYPO3 Teams and ProjectsFedir RYKHTIK

The document discusses DevOps practices for TYPO3 projects. It defines DevOps as the confluence of development and operations. It highlights the importance of communication between different roles like developers, system administrators, and integrators. It also provides examples of tools and techniques that can be used at different stages of a TYPO3 project to facilitate DevOps practices, such as automated testing, deployment automation, and content synchronization.

Evolution of deploy.shLeonid Mamchenkov

Agile NCR 2013- Shekhar Gulati - Open shift platform-for-rapid-and-agile-deve...AgileNCR2013

OpenShift is a platform as a service (PaaS) by Red Hat that allows developers to rapidly develop and deploy applications in the cloud. The presentation demonstrates how to use OpenShift through its web console and command line tools to create Java and MySQL applications integrated with Jenkins for continuous integration. It also shows how to install the code quality tool Sonar and agile issue tracking tool YouTrack on OpenShift. The key benefits of OpenShift are that it allows developers to focus on coding while handling deployment, scaling, and infrastructure management.

Deploying software at ScaleKris Buytaert

This document discusses deploying software at scale through automation. It advocates treating infrastructure as code and using version control, continuous integration, and packaging tools. The key steps are to automate deployments, make them reproducible, and deploy changes frequently and consistently through a pipeline that checks code, runs tests, builds packages, and deploys to testing and production environments. This allows deploying changes safely and quickly while improving collaboration between developers and operations teams.

Devops with Python by Yaniv Cohen DevopShiftYaniv cohen

This document discusses implementing DevOps with Python using Ansible. It provides an agenda for the presentation including discussing DevOps hotspots, infrastructure as code with Ansible, continuous integration/continuous delivery (CI/CD) using TravisCI and CircleCI, and an open discussion on monitoring and automated tests. It then covers problems commonly faced, how DevOps solves these problems, and the expected benefits of adopting a DevOps culture including standardized environments, infrastructure as code, automated delivery, monitoring, and improved collaboration. It provides an overview of Ansible concepts like inventories, ad-hoc commands, modules, playbooks, roles, and templates. It also demonstrates writing a custom Python module for Ansible and using it in a playbook. Finally, it

Test parallelization using JenkinsRogue Wave Software

Presented at STPCon 2016. With the extensive amount of testing performed nightly on large software projects, test and verification teams often experience lengthy wait times for the availability of test results of the latest build. As we strive to identify and resolve issues as fast as possible, alternative methods of test execution have to be found. Learn how to use Jenkins to launch tests in parallel across a number of Virtual Machines, monitor execution health, and process results. Learn about various Jenkins plugins and how they contributed to the solution. Learn how to trigger downstream jobs, even if they are on separate Jenkins instances.

Mastering selenium for automated acceptance testsNick Belhomme

The document discusses Nick Belhomme, who will be hosting an upcoming conference hour. It then provides information on Selenium, an automated testing tool. It discusses how Selenium can be used to run acceptance tests, browser compatibility tests, and regression tests. It summarizes various testing approaches like manual testing, capture and replay, and using scripts/bots. It then dives into details of how to set up Selenium using its IDE, server-side in headless mode, and integrating it into a Jenkins continuous integration environment. It also covers optimizing tests using a Selenium grid and parallelizing tests with Paratest.

TechWiseTV Workshop: Open NX-OS and Devops with Puppet LabsRobb Boyd

Continuous testingOleksandr Metelytsia

Continuous Delivery: 5 years later (Incontro DevOps 2018)Giovanni Toraldo

Test automation proposalMihai-Cristian Fratila

Introduction to DevOps. Continuous Integration by Myroslav Dmytrus Binary Studio

Building a Distributed & Automated Open Source Program at NetflixAll Things Open

Netflix Open Source: Building a Distributed and Automated Open Source Programaspyker

Bots on guard of sdlcAlexey Tokar

Automation: The Good, The Bad and The Ugly with DevOpsGuys - AppD Summit EuropeAppDynamics

DevOpsGuys - DevOps Automation - The Good, The Bad and The UglyDevOpsGroup

Software TestingAndrew Wang

Continuous Integration for OpenVMS with Jenkinsecubemarketing

Extensible dev secops pipelines with Jenkins, Docker, Terraform, and a kitche...Richard Bullington-McGuire

DevOps for TYPO3 Teams and ProjectsFedir RYKHTIK

Evolution of deploy.shLeonid Mamchenkov

Agile NCR 2013- Shekhar Gulati - Open shift platform-for-rapid-and-agile-deve...AgileNCR2013

Deploying software at ScaleKris Buytaert

Devops with Python by Yaniv Cohen DevopShiftYaniv cohen

Test parallelization using JenkinsRogue Wave Software

Mastering selenium for automated acceptance testsNick Belhomme

TechWiseTV Workshop: Open NX-OS and Devops with Puppet LabsRobb Boyd

More from Andriy Samilyak (15)

Kaizen Magento Support - 2 Andriy Samilyak

Kaizen Magento Support has solved over 50,000 issues for over 10 Magento partners. They follow a DevOps culture that emphasizes sharing knowledge, treating all employees equally, and addressing client issues immediately. Kaizen utilizes automation and monitoring tools to deploy sandboxes quickly, test for issues proactively, respond to server problems, and ensure sites are always secure and protected from attacks.

Kaizen Magento supportAndriy Samilyak

Kaizen provides Magento support and development services through a team located around the world to ensure 24/7 coverage. They emphasize effective communication with clients, following an approach of continuous small improvements rather than large changes, and establishing systems like automated testing and deployment to reduce errors and ensure smooth operations. The document outlines Kaizen's philosophy of making changes for the better through a culture of collaboration, simplicity, and proactively addressing issues.

Amazon Cognito + Lambda + S3 + IAM Andriy Samilyak

MageClinic: Affiliative programAndriy Samilyak

This document summarizes the low cost 24x7 support services offered by MageClinic for Magento stores. For $99 per month, they provide monitoring and 30 minute response times to issues like DNS problems, connectivity issues, reindexing, server reboots, cache flushes, and database deadlocks. Additional bugs can be fixed for another $99 fixed fee. They offer an affiliate program where referrals earn $100 commissions and a free 30 day trial for clients using the coupon code provided.

Magento - choosing Order Management SaaSAndriy Samilyak

TOCAT Introduction (English)Andriy Samilyak

This document introduces TOCAT (Theory of Constraints Applied to Teams) as a way to implement Theory of Constraints principles to increase productivity and profitability in IT service companies. It discusses how TOCAT restructures companies into autonomous teams, tracks billable hours and bonuses for employees, and keeps team and company finances aligned. Implementing TOCAT revealed hidden issues and inefficiencies, and engaged employees who now understand goals. The company is developing a commercial TOCAT software to extend its benefits to other types of service companies.

TOCAT IntroductionAndriy Samilyak

Как мы играли в DevOps и как получился Magento AutoscaleAndriy Samilyak

Magento autoscalingAndriy Samilyak

Synthetic web performance testing with SeleniumAndriy Samilyak

This document discusses using Selenium to perform synthetic performance monitoring of web applications. It proposes running Selenium tests to simulate user workflows and transactions, sending timestamps via UDP to Splunk at each step to combine into transactions. Screenshots and HAR files are captured when tests fail to help debug issues. While this provides monitoring with existing Selenium tests, it requires significant effort to support and doesn't always provide enough debug information.

Chef training - Day3Andriy Samilyak

Chef training Day5Andriy Samilyak

Chef training Day4Andriy Samilyak

Chef training - Day1Andriy Samilyak

Chef training - Day2Andriy Samilyak

Kaizen Magento Support - 2 Andriy Samilyak

Kaizen Magento supportAndriy Samilyak

Amazon Cognito + Lambda + S3 + IAM Andriy Samilyak

MageClinic: Affiliative programAndriy Samilyak

Magento - choosing Order Management SaaSAndriy Samilyak

TOCAT Introduction (English)Andriy Samilyak

TOCAT IntroductionAndriy Samilyak

Как мы играли в DevOps и как получился Magento AutoscaleAndriy Samilyak

Magento autoscalingAndriy Samilyak

Synthetic web performance testing with SeleniumAndriy Samilyak

Chef training - Day3Andriy Samilyak

Chef training Day5Andriy Samilyak

Chef training Day4Andriy Samilyak

Chef training - Day1Andriy Samilyak

Chef training - Day2Andriy Samilyak

Recently uploaded (19)

APNIC -Policy Development Process, presented at Local APIGA Taiwan 2025APNIC

DNS Resolvers and Nameservers (in New Zealand)APNIC

Reliable Vancouver Web Hosting with Local Servers & 24/7 Supportsteve198109

Looking for powerful and affordable web hosting in Vancouver? 4GoodHosting offers premium Canadian web hosting solutions designed specifically for individuals, startups, and businesses across British Columbia. With local data centers in Vancouver and Toronto, we ensure blazing-fast website speeds, superior uptime, and enhanced data privacy—all critical for your business success in today’s competitive digital landscape. Our Vancouver web hosting plans are packed with value—starting as low as $2.95/month—and include secure cPanel management, free domain transfer, one-click WordPress installs, and robust email support with anti-spam protection. Whether you're hosting a personal blog, business website, or eCommerce store, our scalable cloud hosting packages are built to grow with you. Enjoy enterprise-grade features like daily backups, DDoS protection, free SSL certificates, and unlimited bandwidth on select plans. Plus, our expert Canadian support team is available 24/7 to help you every step of the way. At 4GoodHosting, we understand the needs of local Vancouver businesses. That’s why we focus on speed, security, and service—all hosted on Canadian soil. Start your online journey today with a reliable hosting partner trusted by thousands across Canada.

Determining Glass is mechanical textileAzizul Hakim

(Hosting PHising Sites) for Cryptography and network securityaluacharya169

APNIC Update, presented at NZNOG 2025 by Terry SweetserAPNIC

OSI TCP IP Protocol Layers description fcbr49917

IT Services Workflow From Request to Resolutionmzmziiskd

Computers Networks Computers Networks Computers NetworksTito208863

White and Red Clean Car Business Pitch Presentation.pptxcanumatown

Perguntas dos animais - Slides ilustrados de múltipla escolhasocaslev

project_based_laaaaaaaaaaearning,kelompok 10.pptxredzuriel13

Mobile database for your company telemarketing or sms marketing campaigns. Fr...DataProvider1

highend-srxseries-services-gateways-customer-presentation.pptxelhadjcheikhdiop

Top Vancouver Green Business Ideas for 2025 Powered by 4GoodHostingsteve198109

Vancouver in 2025 is more than scenic views, yoga studios, and oat milk lattes—it’s a thriving hub for eco-conscious entrepreneurs looking to make a real difference. If you’ve ever dreamed of launching a purpose-driven business, now is the time. Whether it’s urban mushroom farming, upcycled furniture sales, or vegan skincare sold online, your green idea deserves a strong digital foundation. The 2025 Canadian eCommerce landscape is being shaped by trends like sustainability, local innovation, and consumer trust. To stay ahead, eco-startups need reliable hosting that aligns with their values. That’s where 4GoodHosting.com comes in—one of the top-rated Vancouver web hosting providers of 2025. Offering secure, sustainable, and Canadian-based hosting solutions, they help green entrepreneurs build their brand with confidence and conscience. As eCommerce in Canada embraces localism and environmental responsibility, choosing a hosting provider that shares your vision is essential. 4GoodHosting goes beyond just hosting websites—they champion Canadian businesses, sustainable practices, and meaningful growth. So go ahead—start that eco-friendly venture. With Vancouver web hosting from 4GoodHosting, your green business and your values are in perfect sync.

5-Proses-proses Akuisisi Citra Digital.pptxandani26

Best web hosting Vancouver 2025 for you businesssteve198109

Understanding the Tor Network and Exploring the Deep Webnabilajabin35

While the Tor network, Dark Web, and Deep Web can seem mysterious and daunting, they are simply parts of the internet that prioritize privacy and anonymity. Using tools like Ahmia and onionland search, users can explore these hidden spaces responsibly and securely. It’s essential to understand the technology behind these networks, as well as the risks involved, to navigate them safely. Visit https://torgol.com/

Smart Mobile App Pitch Deck丨AI Travel App Presentation Templateyojeari421237

🚀 Smart Mobile App Pitch Deck – "Trip-A" | AI Travel App Presentation Template This professional, visually engaging pitch deck is designed specifically for developers, startups, and tech students looking to present a smart travel mobile app concept with impact. Whether you're building an AI-powered travel planner or showcasing a class project, Trip-A gives you the edge to impress investors, professors, or clients. Every slide is cleanly structured, fully editable, and tailored to highlight key aspects of a mobile travel app powered by artificial intelligence and real-time data. 💼 What’s Inside: - Cover slide with sleek app UI preview - AI/ML module implementation breakdown - Key travel market trends analysis - Competitor comparison slide - Evaluation challenges & solutions - Real-time data training model (AI/ML) - “Live Demo” call-to-action slide 🎨 Why You'll Love It: - Professional, modern layout with mobile app mockups - Ideal for pitches, hackathons, university presentations, or MVP launches - Easily customizable in PowerPoint or Google Slides - High-resolution visuals and smooth gradients 📦 Format: - PPTX / Google Slides compatible - 16:9 widescreen - Fully editable text, charts, and visuals

APNIC -Policy Development Process, presented at Local APIGA Taiwan 2025APNIC

DNS Resolvers and Nameservers (in New Zealand)APNIC

Reliable Vancouver Web Hosting with Local Servers & 24/7 Supportsteve198109

Determining Glass is mechanical textileAzizul Hakim

(Hosting PHising Sites) for Cryptography and network securityaluacharya169

APNIC Update, presented at NZNOG 2025 by Terry SweetserAPNIC

OSI TCP IP Protocol Layers description fcbr49917

IT Services Workflow From Request to Resolutionmzmziiskd

Computers Networks Computers Networks Computers NetworksTito208863

White and Red Clean Car Business Pitch Presentation.pptxcanumatown

Perguntas dos animais - Slides ilustrados de múltipla escolhasocaslev

project_based_laaaaaaaaaaearning,kelompok 10.pptxredzuriel13

Mobile database for your company telemarketing or sms marketing campaigns. Fr...DataProvider1

highend-srxseries-services-gateways-customer-presentation.pptxelhadjcheikhdiop

Top Vancouver Green Business Ideas for 2025 Powered by 4GoodHostingsteve198109

5-Proses-proses Akuisisi Citra Digital.pptxandani26

Best web hosting Vancouver 2025 for you businesssteve198109

Understanding the Tor Network and Exploring the Deep Webnabilajabin35

Smart Mobile App Pitch Deck丨AI Travel App Presentation Templateyojeari421237

DevOps in realtime

1. DevOps in real time Andriy Samilyak OpsWay CEO

2. 20 online projects One 24х7 support team

3. Me v0.1 ● 7 yrs in IT ● since 2008 – Smile Ukraine CTO ● since 2013 – leading OpsWay ● coaching people on DevOps

4. Problem №1 – life in 24x7 Часы % new requests

5. Problem №2 - Geography

6. Problem №3 - Developers “When I see ... developers – all I see is risk” Chuck Rossi, Facebook

7. Plan ● Processes – Deployment cycle – Working with many teams ● Tools – Chef for automatic configuration – Continuous integration – Monitoring – Backups – Team communication

8. Opscode Chef ● Full control over server configuration ● Continuous delivery ● Access control ● Making testing simplier ● Controlling what and when is monitored ● Configuration as application vs documentation

9. Why Chef? ● Facebook, Amazon ● Ruby vs XML ● Simple start ● Not expensive and reliable hosted server ● Historically it was a decision against Puppet (no holy wars!) vs

10. Opscode Chef - beginning

11. Autoscaling projects

12. Single rules for server naming ansam@vostok:~$ knife sshx projectx-live-node Multiple instances found! 1. i-cca165f0 since 2013-08-06 10:11:16 UTC ip 54.253.26.66 2. i-6ca71550 since 2013-08-07 19:06:05 UTC ip 54.253.66.83 3. i-6ea71552 since 2013-08-07 19:06:05 UTC ip 54.253.44.185 4. i-6fa71553 since 2013-08-07 19:06:05 UTC ip 54.252.44.245 Choose <1-4>: [1] 2 Instance i-6ca71550 ip 54.253.66.83 Connecting to 54.253.66.83 as user ubuntu on port 22 проект среда роль

13. Controll access by SSH

14. Templates Apache virtual host template

15. Continuous integration What else can you choose?: – TeamCity – Bamboo – Travis CI – tool Х Why Jenkins?

16. Deployment

17. Access control

18. Simple deployment cycle Development Vagrant box Test server Live Many features simultaneously developed

19. Branch switch

20. Working with other teams master develop fork for DevTeamX - develop

21. Bakery Jenkins jobs Live Amazon AMI Sandbox about 4 hours 5 min

22. Creating a Sandbox

23. Sandbox ● DNS via Route53 ● Can make demo to client ● Deployed from к github repo/branch ● New job in Jenkins for deployment – easily redeployed ● EC2 instance ● Almost complete copy of live project

24. Workflow 1.1 Scheduled, once a day Live Test Sandbox1 Sandbox2

25. Code is live – is it working?

26. Monitoring Configure monitoring depending on server type ● Message routing ● Scheduling plugins ● Cyclic DB ● Data processing ● Charting and plotting ● results DB ● search ● alerts ● Analysis and charting

27. Chef-controlled monitoring

31. ● Take all records from access.log from all servers of ProjectX ● Include records with User-Agent = “Apache*” and URL like /aaaa/bbb-123.html ● Calculate avg time of such requests for the last 7 days

32. Our dashboards

33. Synthetic tests

35. Redmine SMS email Splunk alerts

36. Chef + Amazon EBS = Backup profit EBS Server configuration (Chef) /var/www

37. Backups

38. Backups: snapshots

40. Andriy Samilyak [email protected] skype: samilyaka http://opsway.com

Editor's Notes

#5: 24 часа в день и 7 дней в неделю мы помогаем поддерживать онлайн бизнесы рабочими и приносящими деньги их владельцам
#11: 95% автоматизации серверов Сейчас мы можем сконфигурировать сервер в нескольких строках кода
#13: Плагин для быстрого подключения к серверам по имени
#18: Jenkins также позволил нам управлять доступами к деплойменту для разных команд/проектов
#21: В результате такого процесса мы стали получать все больше и больше задач “пожалуйста, выложите изменения по SA-332”, а потом “ой, ошибка, пожалуйста, откатите изменения”
#26: Инженер поддержки не может проверить все, соответственно ошибка если и будет допущена то неважно, кто ее выложит – поддержка или разработка
#34: Selenium-based Jenkins-job that is periodically making test purchase from sites, measuring time and sending results to Splunk
#35: Splunk “умеет” отслеживать транзакции: полные и неполные, время транзакции

DevOps in realtime

Recommended

More Related Content

What's hot (20)

Viewers also liked (20)

Similar to DevOps in realtime (20)

More from Andriy Samilyak (15)

Recently uploaded (19)

DevOps in realtime

Editor's Notes