SlideShare a Scribd company logo
Continuous Delivery
It’s not about the technology it’s about the
people.
Tomas Riha
Architect @ VGT/WirelessCar
Passionate about creativity, change and improvement
Horrible at following instructions and performing repetitive tasks
MAJOR Project Liability
mail: triha74@gmail.com
twitter: @TomasRihaSE
blog: continuous-delivery-and-more.blogspot.com
Four Years ago
New Telematics Delivery Platform
Multiple Stakeholders
Continuous Regression Testing
How hard can it be?
Regression Test
Unit Testing
Component Testing
System Testing
Rollback/Compatibility Testing
Failover Testing
Performance Testing
At first it was super easy!
Small team of just product owner, architects and scrum
master.
Huge productivity, natural acceptance test driven
development.
Fast return on investment
All by the book.... we were doing
Continuous Delivery!
Then we tried to scale it...
... and we failed in every possible way.
We lost our test driven development
We lost the individual responsibility
We more or less became a automated waterfall unable to
deliver daily
Continuous Delivery changes our behaviour
Changing the behaviour of 5 people is easy.
Changing the behaviour of 50 is super hard.
You have to understand the changes!
Continuous Delivery changes the entire organization.
Developers
Everything has to work all the time!
Pre
Planning
Dev Sys Test Reg Test
Pre
Planning
Dev Sys Test Reg Test
In traditional scrummerfall projects system only works once every iteration.
No one cares if you check something in before lunch just to “save” your work.
Sprint
Developers
Pre
Planning
Dev
Test
Automation
Reg Test
Thats an awful lot of testing... YES!
Test driven development requires that developers work with testing.
Pre
Planning
Reg Test Reg Test
Verification
Verification
Acceptance Test Driven Development
Developers
Pre
Planning
Dev
Test
Automation
Reg Test
This creates context switching but its up to the developer to step it up!
Pre
Planning
Reg Test Reg Test
Verification
Verification
Regression has priority! ALWAYS!
Developers
Developers hate branches, or so they say
Hate merging because it mixes their code with others
Love feature branches because they don't have to integrate their work
Developers LOVE BRANCHES!!
Continuous Delivery is done on the trunk.
Developers
Developers need to take more responsibility for
Regression test
Writing test code
Testing the system
Integrating their code
Understanding Production Runtime
In order to always have a working system
Need to take more responsibility
Developers
So it’s just up to the developers to shape up?
The Continuous Delivery process needs to provide visibility and traceability to
provide means to take responsibility.
Developers need to be coached to increase responsibility and to mitigate fear.
Testers
When we scaled up we added testers
Developers were happy because they could go back to
handing over code for testing.
Adding testers we lost all test driven development.
Our QUALITY DROPPED!!
Testers
Why did this happen?
Handover developer to test
Lost consensus
What is test automation for
How is test automation built
Who does test automation
Test as Code
Testers
Pre
Planning
Dev Sys Test Reg Test
Pre
Planning
Dev Sys Test Reg Test
Sprint
Recruiting the Role
A tester is a tester is a tester
Manual System & Regression Testing is a reactive repetitive task.
Testers
Pre
Planning
Dev
Test
Automation
Reg Test
Acceptance Test Driven Development is NOT Test Driven
its driven by Automated Requirement Verification, checking.
Not all testers have the skill set or mind set
to work with Automated Requirement Verification!
Pre
Planning
Reg Test Reg Test
Verification
Verification
Acceptance Test Driven Development is proactive!
Testing in the past
How its been done
SYSTEM
GUI
Building testable systems
Internal
Service
GUI
Internal
Service
Internal
Service
Service API
Component Tests
Internal
Service
Internal
Service
Internal
Service
Each Service Tested as Black Box in isolation
and with high detail level
Continuous Delivery
Build Release Deploy Test
Build Release Deploy Test
Build Release Deploy Test
Build Release Deploy Test
Build Release Deploy Test
Assemble Release Deploy Test
Component Pipe
100s of tests run in parallel testing
System Pipe
10s Use Case Requirements Verified
Testers
Exploratory Testing
Requirement Verification/Checking ensures we deliver what we promise
Exploratory Testing ensures that we improve our application
Exploratory testing done outside the release cycle
Never hide manual regression testing behind Exploratory Testing
Exploratory testing can NEVER block a production deploy
Testers
Agreement is key
Reliable and Repeatable Test Automation
has to be done on a black box.
Never verify on system files, databases or code.
Build quality in
Verify on interfaces
Tests as Code
Testers
Managing the change to the tester profession.
Developers have an expanded role
Testers have a changed role which is much harder to manage
Testers must let developers work with test
The Team creates the Tests as Code with the knowledge and experience of the
Tester and the Developer.
Testers
Our most sought after profile
Testers with strong technical skills
Developers with strong testing skills
Be either and earn $$$$
Be either to have a job
Project Management
Pre
Planning
Dev Sys Test Reg Test
Pre
Planning
Dev Sys Test Reg Test
Sprint
Scrum really doesn't fit all that well
Scrum builds up to a end of sprint release, but why not release daily?
Project Management
Kanban inspired feature development better fit
Building and releasing one feature “at the time” is a much better fit.
Feature cycle
Pre Planning
Dev
Test Automation
Pre Planning
Verification
Verification
Pre
Planning
Dev
Test
Automation
Pre
Planning
Verification
Verification
Feature cycle
The Team
The Team only takes responsibility to the next hand over
The Team will never reach out to an external party for help
The Team is only aware of its weaknesses
if its responsible for its deliveries
DevOps is a must in order to take production responsibility
The Team
The Team
Requirements
Architecture
Code
Deployment
Automation
Middleware
Databases Infrastructure
Monitoring
Logging
Testing
Verification
Automation
The Team
The Team
Requirements
Architecture
Code
Deployment
Automation
Middleware
Databases Infrastructure
Monitoring
Logging
Testing
Verification
Automation
A
TD
We recruited by roles and this is what we got!
The Team
The Team
Requirements
Architecture
Code
Deployment
Automation
Middleware
Databases Infrastructure
Monitoring
Logging
Testing
Verification
Automation
Recruiting by Competence and T shape
How did it go?
Organization changed to delivery micro service based platform through
Continuous Delivery
Team dedicated to building and delivering Continuous Delivery as a Service for
all the development teams.
Continuous Delivery as a Service used by 100+ Team Members
and
Over 200 deployable applications and libraries
We still suck at Continuous Delivery!
Thats it!
Feedback & Any questions you forgot to ask?
http://continuous-delivery-and-more.blogspot.se
@TomasRihaSE
triha74@gmail.com
or at
Coffee machine

More Related Content

PPTX
Dev ops
PPTX
Puppet Labs EMC DevOps Day NYC Aug-2015
PPTX
Testing in a DevOps team
PDF
DevOps Testing | Continuous Testing In DevOps | DevOps Tutorial | DevOps Trai...
PPTX
Shifting Left Webinar Slideshow
PDF
What is DevOps
PPTX
Introducing DevOps
PPTX
Building Quality into Your DevSecOps Pipelines
Dev ops
Puppet Labs EMC DevOps Day NYC Aug-2015
Testing in a DevOps team
DevOps Testing | Continuous Testing In DevOps | DevOps Tutorial | DevOps Trai...
Shifting Left Webinar Slideshow
What is DevOps
Introducing DevOps
Building Quality into Your DevSecOps Pipelines

What's hot (20)

PPTX
Automation CICD
PPTX
The Challenges & Pitfalls of Database Continuous Delivery
PDF
DevOps
PDF
Continuous Testing - What QA means for DevOps
PPTX
Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...
PPTX
Continuous Integration
PPTX
Spark 2013 Presentation of making the enterprise agile
PDF
Understanding DevOps in simpler way with Continuous Delivery
PPTX
Devconf - Moving 65000 Microsofties to DevOps with Visual Studio Team Services
PDF
How to implement DevOps in your Organization
PDF
Continuous testing for devops
PPTX
CI/CT/CD and Role of Quality Engineering
PDF
DevOps Powerpoint Presentation Slides
PDF
DevOps vs Agile | DevOps Tutorial For Beginners | DevOps Training | Edureka
PPTX
DevOps in Salesforce AppCloud
PDF
Managing Agile IT Operation and DevOps processes
PDF
QA in DevOps: Transformation thru Automation via Jenkins
PDF
Agile Adoption Story in LGE (Aps2010)
PDF
Roles and Responsibilities of a DevOps Engineer
PPTX
Creating a pull for DevOps in an Agile Transformation
Automation CICD
The Challenges & Pitfalls of Database Continuous Delivery
DevOps
Continuous Testing - What QA means for DevOps
Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...
Continuous Integration
Spark 2013 Presentation of making the enterprise agile
Understanding DevOps in simpler way with Continuous Delivery
Devconf - Moving 65000 Microsofties to DevOps with Visual Studio Team Services
How to implement DevOps in your Organization
Continuous testing for devops
CI/CT/CD and Role of Quality Engineering
DevOps Powerpoint Presentation Slides
DevOps vs Agile | DevOps Tutorial For Beginners | DevOps Training | Edureka
DevOps in Salesforce AppCloud
Managing Agile IT Operation and DevOps processes
QA in DevOps: Transformation thru Automation via Jenkins
Agile Adoption Story in LGE (Aps2010)
Roles and Responsibilities of a DevOps Engineer
Creating a pull for DevOps in an Agile Transformation
Ad

Similar to Continuous delivery its not about the technology, its about the people. @satsq1 stockholm (20)

PDF
Continuous delivery its not about the technology, its about the people. @pipe...
PDF
Continuous delivery its not about the technology, its about the people.
PDF
Continuous Delivery Testing @HiQ
PDF
Continuous delivery @ hi q
KEY
Testing and DevOps Culture: Lessons Learned
PDF
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
PDF
Continuous delivery @ Diabol
PPSX
PDF
Using Crowdsourced Testing to Turbocharge your Development Team
PPTX
Agile & DevOps - It's all about project success
PPTX
The Evolution of Test Automation for DevOps
PPTX
Continuous testing the new must have skill of tomorrow's tech leaders
PPT
product Qa workflow
PPT
Tester developer interaction
PDF
Continuous Testing: A Key to DevOps Success
PDF
Continuous testing & devops with @petemar5hall
PDF
Jonny wooldridge DevOps Large and Small
PDF
Growing Object Oriented Software
PDF
Scaling continuous delivery @ GeeCon 2014
PDF
A journey to_be_a_software_craftsman
Continuous delivery its not about the technology, its about the people. @pipe...
Continuous delivery its not about the technology, its about the people.
Continuous Delivery Testing @HiQ
Continuous delivery @ hi q
Testing and DevOps Culture: Lessons Learned
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
Continuous delivery @ Diabol
Using Crowdsourced Testing to Turbocharge your Development Team
Agile & DevOps - It's all about project success
The Evolution of Test Automation for DevOps
Continuous testing the new must have skill of tomorrow's tech leaders
product Qa workflow
Tester developer interaction
Continuous Testing: A Key to DevOps Success
Continuous testing & devops with @petemar5hall
Jonny wooldridge DevOps Large and Small
Growing Object Oriented Software
Scaling continuous delivery @ GeeCon 2014
A journey to_be_a_software_craftsman
Ad

More from Tomas Riha (7)

PDF
Driving change
PDF
DevOps - Its just Agile done right
PPTX
Test Automation
PDF
Show me the money!
PDF
Show me the money! - Draft
PPTX
Into the cloud
PDF
Continuous delivery @åf consult
Driving change
DevOps - Its just Agile done right
Test Automation
Show me the money!
Show me the money! - Draft
Into the cloud
Continuous delivery @åf consult

Recently uploaded (20)

PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Encapsulation theory and applications.pdf
PDF
Machine learning based COVID-19 study performance prediction
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PPT
Teaching material agriculture food technology
PDF
Empathic Computing: Creating Shared Understanding
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPTX
A Presentation on Artificial Intelligence
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Approach and Philosophy of On baking technology
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
gpt5_lecture_notes_comprehensive_20250812015547.pdf
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Encapsulation theory and applications.pdf
Machine learning based COVID-19 study performance prediction
Programs and apps: productivity, graphics, security and other tools
Advanced methodologies resolving dimensionality complications for autism neur...
Mobile App Security Testing_ A Comprehensive Guide.pdf
Reach Out and Touch Someone: Haptics and Empathic Computing
Group 1 Presentation -Planning and Decision Making .pptx
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Spectral efficient network and resource selection model in 5G networks
Network Security Unit 5.pdf for BCA BBA.
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Teaching material agriculture food technology
Empathic Computing: Creating Shared Understanding
Diabetes mellitus diagnosis method based random forest with bat algorithm
A Presentation on Artificial Intelligence
MIND Revenue Release Quarter 2 2025 Press Release
Approach and Philosophy of On baking technology

Continuous delivery its not about the technology, its about the people. @satsq1 stockholm

  • 1. Continuous Delivery It’s not about the technology it’s about the people.
  • 2. Tomas Riha Architect @ VGT/WirelessCar Passionate about creativity, change and improvement Horrible at following instructions and performing repetitive tasks MAJOR Project Liability mail: [email protected] twitter: @TomasRihaSE blog: continuous-delivery-and-more.blogspot.com
  • 3. Four Years ago New Telematics Delivery Platform Multiple Stakeholders Continuous Regression Testing How hard can it be?
  • 4. Regression Test Unit Testing Component Testing System Testing Rollback/Compatibility Testing Failover Testing Performance Testing
  • 5. At first it was super easy! Small team of just product owner, architects and scrum master. Huge productivity, natural acceptance test driven development. Fast return on investment All by the book.... we were doing Continuous Delivery!
  • 6. Then we tried to scale it... ... and we failed in every possible way. We lost our test driven development We lost the individual responsibility We more or less became a automated waterfall unable to deliver daily
  • 7. Continuous Delivery changes our behaviour Changing the behaviour of 5 people is easy. Changing the behaviour of 50 is super hard. You have to understand the changes! Continuous Delivery changes the entire organization.
  • 8. Developers Everything has to work all the time! Pre Planning Dev Sys Test Reg Test Pre Planning Dev Sys Test Reg Test In traditional scrummerfall projects system only works once every iteration. No one cares if you check something in before lunch just to “save” your work. Sprint
  • 9. Developers Pre Planning Dev Test Automation Reg Test Thats an awful lot of testing... YES! Test driven development requires that developers work with testing. Pre Planning Reg Test Reg Test Verification Verification Acceptance Test Driven Development
  • 10. Developers Pre Planning Dev Test Automation Reg Test This creates context switching but its up to the developer to step it up! Pre Planning Reg Test Reg Test Verification Verification Regression has priority! ALWAYS!
  • 11. Developers Developers hate branches, or so they say Hate merging because it mixes their code with others Love feature branches because they don't have to integrate their work Developers LOVE BRANCHES!! Continuous Delivery is done on the trunk.
  • 12. Developers Developers need to take more responsibility for Regression test Writing test code Testing the system Integrating their code Understanding Production Runtime In order to always have a working system Need to take more responsibility
  • 13. Developers So it’s just up to the developers to shape up? The Continuous Delivery process needs to provide visibility and traceability to provide means to take responsibility. Developers need to be coached to increase responsibility and to mitigate fear.
  • 14. Testers When we scaled up we added testers Developers were happy because they could go back to handing over code for testing. Adding testers we lost all test driven development. Our QUALITY DROPPED!!
  • 15. Testers Why did this happen? Handover developer to test Lost consensus What is test automation for How is test automation built Who does test automation Test as Code
  • 16. Testers Pre Planning Dev Sys Test Reg Test Pre Planning Dev Sys Test Reg Test Sprint Recruiting the Role A tester is a tester is a tester Manual System & Regression Testing is a reactive repetitive task.
  • 17. Testers Pre Planning Dev Test Automation Reg Test Acceptance Test Driven Development is NOT Test Driven its driven by Automated Requirement Verification, checking. Not all testers have the skill set or mind set to work with Automated Requirement Verification! Pre Planning Reg Test Reg Test Verification Verification Acceptance Test Driven Development is proactive!
  • 18. Testing in the past How its been done SYSTEM GUI
  • 20. Component Tests Internal Service Internal Service Internal Service Each Service Tested as Black Box in isolation and with high detail level
  • 21. Continuous Delivery Build Release Deploy Test Build Release Deploy Test Build Release Deploy Test Build Release Deploy Test Build Release Deploy Test Assemble Release Deploy Test Component Pipe 100s of tests run in parallel testing System Pipe 10s Use Case Requirements Verified
  • 22. Testers Exploratory Testing Requirement Verification/Checking ensures we deliver what we promise Exploratory Testing ensures that we improve our application Exploratory testing done outside the release cycle Never hide manual regression testing behind Exploratory Testing Exploratory testing can NEVER block a production deploy
  • 23. Testers Agreement is key Reliable and Repeatable Test Automation has to be done on a black box. Never verify on system files, databases or code. Build quality in Verify on interfaces Tests as Code
  • 24. Testers Managing the change to the tester profession. Developers have an expanded role Testers have a changed role which is much harder to manage Testers must let developers work with test The Team creates the Tests as Code with the knowledge and experience of the Tester and the Developer.
  • 25. Testers Our most sought after profile Testers with strong technical skills Developers with strong testing skills Be either and earn $$$$ Be either to have a job
  • 26. Project Management Pre Planning Dev Sys Test Reg Test Pre Planning Dev Sys Test Reg Test Sprint Scrum really doesn't fit all that well Scrum builds up to a end of sprint release, but why not release daily?
  • 27. Project Management Kanban inspired feature development better fit Building and releasing one feature “at the time” is a much better fit. Feature cycle Pre Planning Dev Test Automation Pre Planning Verification Verification Pre Planning Dev Test Automation Pre Planning Verification Verification Feature cycle
  • 28. The Team The Team only takes responsibility to the next hand over The Team will never reach out to an external party for help The Team is only aware of its weaknesses if its responsible for its deliveries DevOps is a must in order to take production responsibility
  • 29. The Team The Team Requirements Architecture Code Deployment Automation Middleware Databases Infrastructure Monitoring Logging Testing Verification Automation
  • 30. The Team The Team Requirements Architecture Code Deployment Automation Middleware Databases Infrastructure Monitoring Logging Testing Verification Automation A TD We recruited by roles and this is what we got!
  • 31. The Team The Team Requirements Architecture Code Deployment Automation Middleware Databases Infrastructure Monitoring Logging Testing Verification Automation Recruiting by Competence and T shape
  • 32. How did it go? Organization changed to delivery micro service based platform through Continuous Delivery Team dedicated to building and delivering Continuous Delivery as a Service for all the development teams. Continuous Delivery as a Service used by 100+ Team Members and Over 200 deployable applications and libraries We still suck at Continuous Delivery!
  • 33. Thats it! Feedback & Any questions you forgot to ask? http://continuous-delivery-and-more.blogspot.se @TomasRihaSE [email protected] or at Coffee machine