SlideShare a Scribd company logo
How to Scale Quality
With Kaizen
From building MVPs to addressing scale
● Theodo
○ agile tech-team-for-hire, Paris & London, 200 people
○ x10 growth from 2012 to 2016
● Our strength: build & deploy MVPs in less than 10 weeks
○ Small teams of excellent engineers + super strong agile discipline
● Until 2016, when the project scaled...
○ ↘ velocity and enthusiasm
○ ↗testing time, complexity and cost of integrating new devs
Today, I will share with you 3 counter-examples from 2017
A dev team produced 220 perfect user stories in a row...
...and tripled the velocity!
A dev team scaled from 4 to 12 devs over the year...
… while continuously decreasing the build time
A dev team trying to integrate 3 new developers efficiently...
was so efficient that the average velocity increased by 2x!
It all started with two things
1. Benoît went to Japan with Michael Ballé
2. Theodo UK forced us to rethink our added value
...to go fast?
Why would you need excellent engineers?
For that we have quick&dirty off-shoring
...to make a good product?
For that we have excellent design agencies
...
French CTO
UK CEO
Brits are pragmatic, they buy business results
What is the business impact of excellent engineers?
=> Products that scale
So:
● we had to focus on becoming expert at code that scales
● and for that we looked at Toyota...
Scale quality with kaizen - Tech.Rocks conference
改善
My definition of Kaizen:
The cultural effort of trying to improve continuously, as a
team, on an identified problem.
What is 改善?
Scale quality with kaizen - Tech.Rocks conference
Our current recipe (continuously improving)
● A clear target addressing a problem “0 bugs deployed by 31/10/2017”
● A team, a team leader, a coach and a sponsor
● A whiteboard
● Make sure time is spent on Kaizen
A clear indicator, updated
every day / every week
A schema of the
situation
The last identified
defects to analyse
them
Ideas for experiment,
expected results and
checks
#1: “0 bugs Kaizen” on a large project in production
What?
● Look at every bug in production to find team improvements
Improvement examples:
● Create a standard way of coding an API call cache
● Make sure everyone is using a well-configured IDE with a debugger
BUT
● Bugs not clearly defined: some UX issues were not considered important
● Analysis was very hard: not reproducible or too old to understand
● Temptation to solve and move on was too strong
Kaizen topic chosen by CTO without proper go&see...
… is not the right way to do kaizen!
#2: “0 defects Kaizen” on a long redevelopment
Why?
● Client voice: “I wish I could validate all user stories at first try”
What?
● Look at every issue during the development flow to find improvements
Improvement examples
● Agree to define validation steps beforehand
● Improve the definition of a “perfect” user story ready for development
● Refactor emails to not have duplicate code for text and html versions
Results:
● 220 User Stories in a row validated at first try by the Product Owner!
● x3.5 velocity over 15 weeks
#3: “Divide build by 2 Kaizen” on a 3 teams project
Why?
● Devs were fed up of wasting so much time on failed and/or long builds
What?
● Inspect build failure rate & build time and experiment ideas every week
Improvement examples
● Refactor tests, update testing libraries, migrate to ES6
● Pre-hook to run tests locally before build, stop tests at first fail
● Switch to Circle-CI 2.0
● Only run tests linked to modified code
Results:
● Build failure rate divided by 3
● Build time divided by 2 and maintained low
#4: “Succeed 100% of sprints” (while integrating 3 new devs)
Why?
● There were many late sprints already and the team was concerned of how
worse it would become with the dev team growing from 3 to 6
What?
● For every ticket, plan the “how” before coding (steps of 2 to 20 minutes),
get it challenged and ask for help as soon as the plan goes wrong
Improvement examples
● Script ticket start to reduce that step from 10 to 3 minutes
● Change DB creation step to reduce testing from 18 to 7 minutes
● Competency matrix of every dev to know whom to train on what
Results:
● Less than 5% User Story longer than planned!
● 7/7 sprint success!
● Average velocity x2!
The
Future
● Not only is kaizen helping us scale quality
● It is also empowering every developer to act as a tech leader...
● … growing Theodoers at much faster speed than ever before
“J’ai autant appris cet après-midi
qu’en deux ans chez Theodo”
Nicolas
Seeing the spectacular progress made me think of the 10x developer myth
At current speed of progress, 10x is just a few years away…
… and unlike the car industry, software is not limited by the law of mechanics.
What is the limit of progression?
Are we creating an army of 100x developers?
Thank you.
fabriceb@theodo.co.uk
@theodo
Rendez-vous in 2025

More Related Content

What's hot (20)

PPTX
The StartUp Agency - A Case Study on CFPB
GovLoop
 
PDF
Full-Stack Agile - What's your Cycle Time?
Ashley-Christian Hardy
 
PPTX
Why Limit WIP?
LeanKit
 
PDF
Big rewrites without big risks
Flavius Stef
 
PDF
Does this Fizz Good?
LeanKit
 
PDF
rtCamp WordPress Services
rtCamp
 
PDF
Dicoding Developer Coaching #38: Android | 5 Library Android yang Patut Kamu ...
DicodingEvent
 
PPTX
Why we use scrum
Juliano Ribeiro
 
PDF
Boost your development speed - ITAKE Unconference
Patroklos Papapetrou (Pat)
 
PDF
Beyond WIP Limits (Lean Kanban Tour Edition)
Pawel Brodzinski
 
PDF
Efficient or Just Busy?
Pawel Brodzinski
 
PDF
Does this FizzGood? Improve velocity, predictability & agility by asking a si...
Jon Terry
 
PDF
How to Sell Kanban to Your Boss
LeanKit
 
PDF
Cómo construir un pipeline de entrega continua
Software Guru
 
PDF
Being agile while standing in a waterfall
Mike Edwards
 
PDF
Product Vs Craft
MagenTys
 
PDF
Delivering Projects the Pivotal Way
Aaron Severs
 
PPTX
Xcode eXtreme Programming - #pragmamark 2014, Milan
Giulio Roggero
 
PDF
What not to do when adopting Agile
Killick Agile Consulting Services
 
PPTX
Zero to tested
MagenTys
 
The StartUp Agency - A Case Study on CFPB
GovLoop
 
Full-Stack Agile - What's your Cycle Time?
Ashley-Christian Hardy
 
Why Limit WIP?
LeanKit
 
Big rewrites without big risks
Flavius Stef
 
Does this Fizz Good?
LeanKit
 
rtCamp WordPress Services
rtCamp
 
Dicoding Developer Coaching #38: Android | 5 Library Android yang Patut Kamu ...
DicodingEvent
 
Why we use scrum
Juliano Ribeiro
 
Boost your development speed - ITAKE Unconference
Patroklos Papapetrou (Pat)
 
Beyond WIP Limits (Lean Kanban Tour Edition)
Pawel Brodzinski
 
Efficient or Just Busy?
Pawel Brodzinski
 
Does this FizzGood? Improve velocity, predictability & agility by asking a si...
Jon Terry
 
How to Sell Kanban to Your Boss
LeanKit
 
Cómo construir un pipeline de entrega continua
Software Guru
 
Being agile while standing in a waterfall
Mike Edwards
 
Product Vs Craft
MagenTys
 
Delivering Projects the Pivotal Way
Aaron Severs
 
Xcode eXtreme Programming - #pragmamark 2014, Milan
Giulio Roggero
 
What not to do when adopting Agile
Killick Agile Consulting Services
 
Zero to tested
MagenTys
 

Similar to Scale quality with kaizen - Tech.Rocks conference (20)

PDF
DevOps Year One
Magnus Hedemark
 
PDF
DevOps Kaizen: Find and Fix What is Really Behind Your Problems
dev2ops
 
PDF
The quest of one-piece-flow in IT by Pierre Masai, Toyota Motor Europe
Institut Lean France
 
PDF
DEVNET-2015 DevOps In Depth - Damon Edwards on DevOps Kaizen: Building an Ent...
Cisco DevNet
 
PDF
Scaling Dimensions - Scaling is more than adding people to a product team
Christoph Mathis
 
PDF
Agile Kaizen: Agile Product Management - Course Slides
Proyectalis / Improvement21
 
PDF
Radical Quality From Toyota to Tech
Flavian Hautbois
 
PPTX
Lean sw development il tech-talks
Elad Sofer
 
PDF
Fighting with Waste Driven Development - XP Days Ukraine 2017
Lemi Orhan Ergin
 
PDF
Agile Product Management - Co-Training with Angel Medinilla (c)
Andrea Darabos
 
PPTX
Challenges with measuring quality for agile distributed research type project
Chandan Patary
 
PDF
Kaizen in Action for Regional Scrum Gathering Tokyo 2017
Kiro Harada
 
PPTX
Kaizen good for improvement ..continual
makarjyothipolymers
 
PDF
DevOps and the Culture of High-Performing Software Organizations
Josiah Renaudin
 
PPT
Lean Software Development & Kanban
Rishi Chaddha
 
PDF
Heavyweight agile Processes? Let's make them leaner!
Michael Mahlberg
 
PDF
P L N 07 B O1 C Naya Making Big Lean Stick
Laurence Yap M.A. (UM) CHRM
 
PDF
Kaizen and Continuous Improvement...pdf
Abdullah Al Seam
 
PDF
XP fes. 2019 B-6 Application of statistical quality control to agile software...
Akinori SAKATA
 
PDF
Business Value of Lean Thinking
David Rico
 
DevOps Year One
Magnus Hedemark
 
DevOps Kaizen: Find and Fix What is Really Behind Your Problems
dev2ops
 
The quest of one-piece-flow in IT by Pierre Masai, Toyota Motor Europe
Institut Lean France
 
DEVNET-2015 DevOps In Depth - Damon Edwards on DevOps Kaizen: Building an Ent...
Cisco DevNet
 
Scaling Dimensions - Scaling is more than adding people to a product team
Christoph Mathis
 
Agile Kaizen: Agile Product Management - Course Slides
Proyectalis / Improvement21
 
Radical Quality From Toyota to Tech
Flavian Hautbois
 
Lean sw development il tech-talks
Elad Sofer
 
Fighting with Waste Driven Development - XP Days Ukraine 2017
Lemi Orhan Ergin
 
Agile Product Management - Co-Training with Angel Medinilla (c)
Andrea Darabos
 
Challenges with measuring quality for agile distributed research type project
Chandan Patary
 
Kaizen in Action for Regional Scrum Gathering Tokyo 2017
Kiro Harada
 
Kaizen good for improvement ..continual
makarjyothipolymers
 
DevOps and the Culture of High-Performing Software Organizations
Josiah Renaudin
 
Lean Software Development & Kanban
Rishi Chaddha
 
Heavyweight agile Processes? Let's make them leaner!
Michael Mahlberg
 
P L N 07 B O1 C Naya Making Big Lean Stick
Laurence Yap M.A. (UM) CHRM
 
Kaizen and Continuous Improvement...pdf
Abdullah Al Seam
 
XP fes. 2019 B-6 Application of statistical quality control to agile software...
Akinori SAKATA
 
Business Value of Lean Thinking
David Rico
 
Ad

Recently uploaded (20)

PDF
HR agent at Mediq: Lessons learned on Agent Builder & Maestro by Tacstone Tec...
UiPathCommunity
 
PDF
Building Resilience with Digital Twins : Lessons from Korea
SANGHEE SHIN
 
PDF
Wojciech Ciemski for Top Cyber News MAGAZINE. June 2025
Dr. Ludmila Morozova-Buss
 
PPT
Interview paper part 3, It is based on Interview Prep
SoumyadeepGhosh39
 
PDF
HydITEx corporation Booklet 2025 English
Георгий Феодориди
 
PDF
TrustArc Webinar - Data Privacy Trends 2025: Mid-Year Insights & Program Stra...
TrustArc
 
PPTX
Building a Production-Ready Barts Health Secure Data Environment Tooling, Acc...
Barts Health
 
PDF
GITLAB-CICD_For_Professionals_KodeKloud.pdf
deepaktyagi0048
 
PDF
Are there government-backed agri-software initiatives in Limerick.pdf
giselawagner2
 
PPTX
Extensions Framework (XaaS) - Enabling Orchestrate Anything
ShapeBlue
 
PDF
SWEBOK Guide and Software Services Engineering Education
Hironori Washizaki
 
PPTX
Simplifying End-to-End Apache CloudStack Deployment with a Web-Based Automati...
ShapeBlue
 
PPTX
Building and Operating a Private Cloud with CloudStack and LINBIT CloudStack ...
ShapeBlue
 
PDF
Why Orbit Edge Tech is a Top Next JS Development Company in 2025
mahendraalaska08
 
PDF
Meetup Kickoff & Welcome - Rohit Yadav, CSIUG Chairman
ShapeBlue
 
PPTX
UI5Con 2025 - Get to Know Your UI5 Tooling
Wouter Lemaire
 
PDF
Sustainable and comertially viable mining process.pdf
Avijit Kumar Roy
 
PDF
Arcee AI - building and working with small language models (06/25)
Julien SIMON
 
PDF
Upgrading to z_OS V2R4 Part 01 of 02.pdf
Flavio787771
 
PDF
Market Wrap for 18th July 2025 by CIFDAQ
CIFDAQ
 
HR agent at Mediq: Lessons learned on Agent Builder & Maestro by Tacstone Tec...
UiPathCommunity
 
Building Resilience with Digital Twins : Lessons from Korea
SANGHEE SHIN
 
Wojciech Ciemski for Top Cyber News MAGAZINE. June 2025
Dr. Ludmila Morozova-Buss
 
Interview paper part 3, It is based on Interview Prep
SoumyadeepGhosh39
 
HydITEx corporation Booklet 2025 English
Георгий Феодориди
 
TrustArc Webinar - Data Privacy Trends 2025: Mid-Year Insights & Program Stra...
TrustArc
 
Building a Production-Ready Barts Health Secure Data Environment Tooling, Acc...
Barts Health
 
GITLAB-CICD_For_Professionals_KodeKloud.pdf
deepaktyagi0048
 
Are there government-backed agri-software initiatives in Limerick.pdf
giselawagner2
 
Extensions Framework (XaaS) - Enabling Orchestrate Anything
ShapeBlue
 
SWEBOK Guide and Software Services Engineering Education
Hironori Washizaki
 
Simplifying End-to-End Apache CloudStack Deployment with a Web-Based Automati...
ShapeBlue
 
Building and Operating a Private Cloud with CloudStack and LINBIT CloudStack ...
ShapeBlue
 
Why Orbit Edge Tech is a Top Next JS Development Company in 2025
mahendraalaska08
 
Meetup Kickoff & Welcome - Rohit Yadav, CSIUG Chairman
ShapeBlue
 
UI5Con 2025 - Get to Know Your UI5 Tooling
Wouter Lemaire
 
Sustainable and comertially viable mining process.pdf
Avijit Kumar Roy
 
Arcee AI - building and working with small language models (06/25)
Julien SIMON
 
Upgrading to z_OS V2R4 Part 01 of 02.pdf
Flavio787771
 
Market Wrap for 18th July 2025 by CIFDAQ
CIFDAQ
 
Ad

Scale quality with kaizen - Tech.Rocks conference

  • 1. How to Scale Quality With Kaizen
  • 2. From building MVPs to addressing scale ● Theodo ○ agile tech-team-for-hire, Paris & London, 200 people ○ x10 growth from 2012 to 2016 ● Our strength: build & deploy MVPs in less than 10 weeks ○ Small teams of excellent engineers + super strong agile discipline ● Until 2016, when the project scaled... ○ ↘ velocity and enthusiasm ○ ↗testing time, complexity and cost of integrating new devs
  • 3. Today, I will share with you 3 counter-examples from 2017
  • 4. A dev team produced 220 perfect user stories in a row... ...and tripled the velocity!
  • 5. A dev team scaled from 4 to 12 devs over the year... … while continuously decreasing the build time
  • 6. A dev team trying to integrate 3 new developers efficiently... was so efficient that the average velocity increased by 2x!
  • 7. It all started with two things 1. Benoît went to Japan with Michael Ballé
  • 8. 2. Theodo UK forced us to rethink our added value
  • 9. ...to go fast? Why would you need excellent engineers? For that we have quick&dirty off-shoring ...to make a good product? For that we have excellent design agencies ... French CTO UK CEO
  • 10. Brits are pragmatic, they buy business results What is the business impact of excellent engineers? => Products that scale So: ● we had to focus on becoming expert at code that scales ● and for that we looked at Toyota...
  • 13. My definition of Kaizen: The cultural effort of trying to improve continuously, as a team, on an identified problem. What is 改善?
  • 15. Our current recipe (continuously improving) ● A clear target addressing a problem “0 bugs deployed by 31/10/2017” ● A team, a team leader, a coach and a sponsor ● A whiteboard ● Make sure time is spent on Kaizen
  • 16. A clear indicator, updated every day / every week A schema of the situation The last identified defects to analyse them Ideas for experiment, expected results and checks
  • 17. #1: “0 bugs Kaizen” on a large project in production What? ● Look at every bug in production to find team improvements Improvement examples: ● Create a standard way of coding an API call cache ● Make sure everyone is using a well-configured IDE with a debugger BUT ● Bugs not clearly defined: some UX issues were not considered important ● Analysis was very hard: not reproducible or too old to understand ● Temptation to solve and move on was too strong
  • 18. Kaizen topic chosen by CTO without proper go&see...
  • 19. … is not the right way to do kaizen!
  • 20. #2: “0 defects Kaizen” on a long redevelopment Why? ● Client voice: “I wish I could validate all user stories at first try” What? ● Look at every issue during the development flow to find improvements Improvement examples ● Agree to define validation steps beforehand ● Improve the definition of a “perfect” user story ready for development ● Refactor emails to not have duplicate code for text and html versions
  • 21. Results: ● 220 User Stories in a row validated at first try by the Product Owner! ● x3.5 velocity over 15 weeks
  • 22. #3: “Divide build by 2 Kaizen” on a 3 teams project Why? ● Devs were fed up of wasting so much time on failed and/or long builds What? ● Inspect build failure rate & build time and experiment ideas every week Improvement examples ● Refactor tests, update testing libraries, migrate to ES6 ● Pre-hook to run tests locally before build, stop tests at first fail ● Switch to Circle-CI 2.0 ● Only run tests linked to modified code
  • 23. Results: ● Build failure rate divided by 3 ● Build time divided by 2 and maintained low
  • 24. #4: “Succeed 100% of sprints” (while integrating 3 new devs) Why? ● There were many late sprints already and the team was concerned of how worse it would become with the dev team growing from 3 to 6 What? ● For every ticket, plan the “how” before coding (steps of 2 to 20 minutes), get it challenged and ask for help as soon as the plan goes wrong Improvement examples ● Script ticket start to reduce that step from 10 to 3 minutes ● Change DB creation step to reduce testing from 18 to 7 minutes ● Competency matrix of every dev to know whom to train on what
  • 25. Results: ● Less than 5% User Story longer than planned! ● 7/7 sprint success! ● Average velocity x2!
  • 27. ● Not only is kaizen helping us scale quality ● It is also empowering every developer to act as a tech leader... ● … growing Theodoers at much faster speed than ever before
  • 28. “J’ai autant appris cet après-midi qu’en deux ans chez Theodo” Nicolas
  • 29. Seeing the spectacular progress made me think of the 10x developer myth
  • 30. At current speed of progress, 10x is just a few years away… … and unlike the car industry, software is not limited by the law of mechanics. What is the limit of progression?
  • 31. Are we creating an army of 100x developers?