SlideShare a Scribd company logo
A Practical Approach to

Large Scale Agile Development
Gary Gruver
May 31, 2013
Gary Gruver:
• 24 year veteran in high tech
• Led HP’s 400+ developers on a
journey from waterfall to agile
development
• Currently VP of
QE, Release, and Operations
at Macys.com
4+ Year Large-Scale Agile Journey

400+ engineers
around the world
Over 10M lines of code
High-end
LaserJet
printers and
MFPs

Embedded SW
& FW

Digital Sending
and HP open
Extensibility
Platform
State of the Development Process: 2008
•

Lengthy Build
Integration &
Testing Cycles

6 weeks + to get through a complete testing
cycle (mainly manual)

•

Build integration taking 15-20% of resources a
week to get fixes to main

•

Manual testing a key driver and constraint for
adding products

•

Products
Lagging the
Competition

Ongoing customer issues with consistency
and lack of features

•

Marketing had essentially given up asking
for FW innovations
State of the Development Process: 2008
•

•

Up to 10 different branches (driven by each
product release window) in MFP

•

Costs out of
control

Development costs growing 2.5X from 20042008 and the business was
still constrained

CPE driving millions/year in CPE investments

•

Couldn’t Add
Enough
Resources

80-90% of resources just porting existing
FW to new products and qualifying

•

Unable to add new products to the plans
due to lack of FW resources

•

20% of resources developing plans that
quickly became obsolete
Firmware Development Transformation
Integrated
Tools

Consistent Dev
Environment

Agile
Development
with Mini
Milestones
(Sprints)

Fully automated
unit and
system test

Organizational
Change
Management

Continuous
integration and
test system

Architected for
product
variability

One branch for
all products
including CPE
Breakthrough Capacity Transformation
Firmware Development for Development
New Customer
Capabilities

FutureSmart
FW Large Scale
Agile
Development
Engine

Defect
Fixes
•
•
•
•
•
•

400+ developers
10+M LOC
75,000-100,000 LOC turmoil
100-150 Commits
10-15 builds /day
15,000 hours/day of testing
(90% pass rate)
Cycletime Driver Improvements
2008

2011

Build Bosses 1 Week

Continuous Integration 3hrs

Number of Builds 1-2

Continuous Integration 10-15/Day

Feedback on Main 1 Commit/Day

Autorevert ~100 Commits/Day

Full Manual Registration 6 Weeks

Auto Regression Testing 24 Hrs
Development Cost Driver Improvements
2008

2011

Code Integration 10%

Continuous Integration 2%

Detailed Planning 20%

Agile Planning 5%

Porting Code 25%

One Main Branch 15%

Current Product Support 25%

One Branch CPE 5%

Manual Testing 15%

Most Testing Automated 5%

Capacity for Innovation ~5%

Capacity for Innovation ~40%
State of the art FW development model
2008

2011

Costs out of control

~70% reduction in FW
development cost per program

Couldn’t add resources fast enough

50% reduction in FW headcount

Lengthy build, integration
and testing cycles

Cont. integration, daily
automated regression

Products lagging the competition

Vintage chart unleashed
and capacity for innovation
Making an
Enterprise
Agile

VS.

Enabling Small
Agile Teams in
the Enterprise
Scrum

≠

Agile
Water Scrum

Fall
Improvements Best Driven at the
Enterprise Level

✔

Business
Objectives/
Priorities

✔

Enterprise
Level
Continuous
Improvement

✔

✔

CI/CD and test
automation
infrastructure

Planning
Process
Business Objectives (Don’t “Do Agile”)

Define
Understand your
Either automate, eliminate, orcost & cycle-time the
engineer out
your value
proposition
drivers
drivers that aren’t key to the value prop
Business Objectives (Don’t “Continuous Delivery”)
Increase the quality and frequency of feedback

Reduce the time and resources between release branch & production

Improve deployment repeatability
Interative Approach to Agile Management
Mini-milestone
Objectives

Agile Adjustments

Cascading Objectives
to Track Progress

Having real-time
metrics is essential for
the speed of agile &
aligning the org.
But don’t manage by
metrics.
Use the metrics to
understand where to
have conversations
about what is not
getting done.

Learnings

Conversations
Finding the offending code
What Code?
When? Are you
sure it wasn’t Jez?
Embedded System Pipeline

Cost of Testing

Simulator

Emulator
Drive test escapes upstream

Product
Continuous Integration and Test System
STAGE 1

L1 Sim
(10-14x/day)

STAGE 2

L2 Sim
(12x/day)

L3 Emu
(6x/day)

L4 Sim
(1x/day)
Embedded System Pipeline
100%

90%

80%

70%

60%
Sim. Quality bar
Emulator

50%

Sim. Regression

Product

40%

30%

20%

10%

0%

1

2

3

4

5

6
Building up a Large SW System

Agile
Comp 4

Agile
Comp 2

Agile
Comp 5

Agile
Comp 3

Agile
Comp 6

Legacy
Waterfall
IT 1

Interface Test Simulator

Agile
Comp 1

Legacy
Waterfall
IT 2

Legacy
Waterfall
IT 3
One of the biggest challenges with
Agile Planning at the enterprise
level is getting the organization to
accept the uncertainty in SW
development and appreciate the
flexibility and opportunity.
Long Term Predictability for SW Schedules
Do we really need the predictability of our current planning processes?
Are our current planning processes really that accurate?

Accuracy

100%

Planning Investment
A Practical Approach to

Large Scale Agile Development
E-mail: gbgruver@gmail.com
Blog: largescaleagile.com
Twitter: @GRUVERGary
Ad

More Related Content

What's hot (20)

Software update for embedded systems
Software update for embedded systemsSoftware update for embedded systems
Software update for embedded systems
SZ Lin
 
Kubernetes monitoring using prometheus stack
Kubernetes monitoring using prometheus stackKubernetes monitoring using prometheus stack
Kubernetes monitoring using prometheus stack
Juraj Hantak
 
Ceph: Open Source Storage Software Optimizations on Intel® Architecture for C...
Ceph: Open Source Storage Software Optimizations on Intel® Architecture for C...Ceph: Open Source Storage Software Optimizations on Intel® Architecture for C...
Ceph: Open Source Storage Software Optimizations on Intel® Architecture for C...
Odinot Stanislas
 
Gitlab, GitOps & ArgoCD
Gitlab, GitOps & ArgoCDGitlab, GitOps & ArgoCD
Gitlab, GitOps & ArgoCD
Haggai Philip Zagury
 
Monitoring with prometheus
Monitoring with prometheusMonitoring with prometheus
Monitoring with prometheus
Kasper Nissen
 
Git and GitHub workflows
Git and GitHub workflowsGit and GitHub workflows
Git and GitHub workflows
Arthur Shvetsov
 
Dynamic Scaling: How Apache Flink Adapts to Changing Workloads (at FlinkForwa...
Dynamic Scaling: How Apache Flink Adapts to Changing Workloads (at FlinkForwa...Dynamic Scaling: How Apache Flink Adapts to Changing Workloads (at FlinkForwa...
Dynamic Scaling: How Apache Flink Adapts to Changing Workloads (at FlinkForwa...
Till Rohrmann
 
Kubernetes extensibility: CRDs & Operators
Kubernetes extensibility: CRDs & OperatorsKubernetes extensibility: CRDs & Operators
Kubernetes extensibility: CRDs & Operators
SIGHUP
 
Disaster Recovery with MirrorMaker 2.0 (Ryanne Dolan, Cloudera) Kafka Summit ...
Disaster Recovery with MirrorMaker 2.0 (Ryanne Dolan, Cloudera) Kafka Summit ...Disaster Recovery with MirrorMaker 2.0 (Ryanne Dolan, Cloudera) Kafka Summit ...
Disaster Recovery with MirrorMaker 2.0 (Ryanne Dolan, Cloudera) Kafka Summit ...
confluent
 
Meetup 23 - 03 - Application Delivery on K8S with GitOps
Meetup 23 - 03 - Application Delivery on K8S with GitOpsMeetup 23 - 03 - Application Delivery on K8S with GitOps
Meetup 23 - 03 - Application Delivery on K8S with GitOps
Vietnam Open Infrastructure User Group
 
NVMe Takes It All, SCSI Has To Fall
NVMe Takes It All, SCSI Has To FallNVMe Takes It All, SCSI Has To Fall
NVMe Takes It All, SCSI Has To Fall
inside-BigData.com
 
Container Performance Analysis
Container Performance AnalysisContainer Performance Analysis
Container Performance Analysis
Brendan Gregg
 
Docker Ecosystem on Azure
Docker Ecosystem on AzureDocker Ecosystem on Azure
Docker Ecosystem on Azure
Patrick Chanezon
 
Introduction and Deep Dive Into Containerd
Introduction and Deep Dive Into ContainerdIntroduction and Deep Dive Into Containerd
Introduction and Deep Dive Into Containerd
Kohei Tokunaga
 
Exploring the power of OpenTelemetry on Kubernetes
Exploring the power of OpenTelemetry on KubernetesExploring the power of OpenTelemetry on Kubernetes
Exploring the power of OpenTelemetry on Kubernetes
Red Hat Developers
 
Meet cute-between-ebpf-and-tracing
Meet cute-between-ebpf-and-tracingMeet cute-between-ebpf-and-tracing
Meet cute-between-ebpf-and-tracing
Viller Hsiao
 
LAS16-402: ARM Trusted Firmware – from Enterprise to Embedded
LAS16-402: ARM Trusted Firmware – from Enterprise to EmbeddedLAS16-402: ARM Trusted Firmware – from Enterprise to Embedded
LAS16-402: ARM Trusted Firmware – from Enterprise to Embedded
Linaro
 
Extreme programming
Extreme programmingExtreme programming
Extreme programming
Chuu Htet Naing
 
Broadcom PCIe & CXL Switches OCP Final.pptx
Broadcom PCIe & CXL Switches OCP Final.pptxBroadcom PCIe & CXL Switches OCP Final.pptx
Broadcom PCIe & CXL Switches OCP Final.pptx
Memory Fabric Forum
 
GitOps with ArgoCD
GitOps with ArgoCDGitOps with ArgoCD
GitOps with ArgoCD
CloudOps2005
 
Software update for embedded systems
Software update for embedded systemsSoftware update for embedded systems
Software update for embedded systems
SZ Lin
 
Kubernetes monitoring using prometheus stack
Kubernetes monitoring using prometheus stackKubernetes monitoring using prometheus stack
Kubernetes monitoring using prometheus stack
Juraj Hantak
 
Ceph: Open Source Storage Software Optimizations on Intel® Architecture for C...
Ceph: Open Source Storage Software Optimizations on Intel® Architecture for C...Ceph: Open Source Storage Software Optimizations on Intel® Architecture for C...
Ceph: Open Source Storage Software Optimizations on Intel® Architecture for C...
Odinot Stanislas
 
Monitoring with prometheus
Monitoring with prometheusMonitoring with prometheus
Monitoring with prometheus
Kasper Nissen
 
Git and GitHub workflows
Git and GitHub workflowsGit and GitHub workflows
Git and GitHub workflows
Arthur Shvetsov
 
Dynamic Scaling: How Apache Flink Adapts to Changing Workloads (at FlinkForwa...
Dynamic Scaling: How Apache Flink Adapts to Changing Workloads (at FlinkForwa...Dynamic Scaling: How Apache Flink Adapts to Changing Workloads (at FlinkForwa...
Dynamic Scaling: How Apache Flink Adapts to Changing Workloads (at FlinkForwa...
Till Rohrmann
 
Kubernetes extensibility: CRDs & Operators
Kubernetes extensibility: CRDs & OperatorsKubernetes extensibility: CRDs & Operators
Kubernetes extensibility: CRDs & Operators
SIGHUP
 
Disaster Recovery with MirrorMaker 2.0 (Ryanne Dolan, Cloudera) Kafka Summit ...
Disaster Recovery with MirrorMaker 2.0 (Ryanne Dolan, Cloudera) Kafka Summit ...Disaster Recovery with MirrorMaker 2.0 (Ryanne Dolan, Cloudera) Kafka Summit ...
Disaster Recovery with MirrorMaker 2.0 (Ryanne Dolan, Cloudera) Kafka Summit ...
confluent
 
NVMe Takes It All, SCSI Has To Fall
NVMe Takes It All, SCSI Has To FallNVMe Takes It All, SCSI Has To Fall
NVMe Takes It All, SCSI Has To Fall
inside-BigData.com
 
Container Performance Analysis
Container Performance AnalysisContainer Performance Analysis
Container Performance Analysis
Brendan Gregg
 
Introduction and Deep Dive Into Containerd
Introduction and Deep Dive Into ContainerdIntroduction and Deep Dive Into Containerd
Introduction and Deep Dive Into Containerd
Kohei Tokunaga
 
Exploring the power of OpenTelemetry on Kubernetes
Exploring the power of OpenTelemetry on KubernetesExploring the power of OpenTelemetry on Kubernetes
Exploring the power of OpenTelemetry on Kubernetes
Red Hat Developers
 
Meet cute-between-ebpf-and-tracing
Meet cute-between-ebpf-and-tracingMeet cute-between-ebpf-and-tracing
Meet cute-between-ebpf-and-tracing
Viller Hsiao
 
LAS16-402: ARM Trusted Firmware – from Enterprise to Embedded
LAS16-402: ARM Trusted Firmware – from Enterprise to EmbeddedLAS16-402: ARM Trusted Firmware – from Enterprise to Embedded
LAS16-402: ARM Trusted Firmware – from Enterprise to Embedded
Linaro
 
Broadcom PCIe & CXL Switches OCP Final.pptx
Broadcom PCIe & CXL Switches OCP Final.pptxBroadcom PCIe & CXL Switches OCP Final.pptx
Broadcom PCIe & CXL Switches OCP Final.pptx
Memory Fabric Forum
 
GitOps with ArgoCD
GitOps with ArgoCDGitOps with ArgoCD
GitOps with ArgoCD
CloudOps2005
 

Similar to Spark 2013 Presentation of making the enterprise agile (20)

Continuous Delivery Leadership Seminar May 2013
Continuous Delivery Leadership Seminar May 2013Continuous Delivery Leadership Seminar May 2013
Continuous Delivery Leadership Seminar May 2013
gbgruver
 
FlowCon 2013 Conference
FlowCon 2013 ConferenceFlowCon 2013 Conference
FlowCon 2013 Conference
gbgruver
 
Agile conference 2013
Agile conference 2013Agile conference 2013
Agile conference 2013
gbgruver
 
Modernizing Your Testing Tools
Modernizing Your Testing ToolsModernizing Your Testing Tools
Modernizing Your Testing Tools
QASymphony
 
Lean_Design_sample
Lean_Design_sampleLean_Design_sample
Lean_Design_sample
ahmad bassiouny
 
Lean Design Sample
Lean Design SampleLean Design Sample
Lean Design Sample
ahmad bassiouny
 
Lean Solutions – Agile Transformation at the United States Postal Service
Lean Solutions  – Agile Transformation at the United States Postal ServiceLean Solutions  – Agile Transformation at the United States Postal Service
Lean Solutions – Agile Transformation at the United States Postal Service
ITSM Academy, Inc.
 
Agile Journey to agile
Agile   Journey to agileAgile   Journey to agile
Agile Journey to agile
Brijesh Prabhakar
 
RamkumarMV15
RamkumarMV15RamkumarMV15
RamkumarMV15
Ramkumar Meenakshisundaram PMP
 
Test Automation using UiPath Test Suite - Developer Circle Part-1.pdf
Test Automation using UiPath Test Suite - Developer Circle Part-1.pdfTest Automation using UiPath Test Suite - Developer Circle Part-1.pdf
Test Automation using UiPath Test Suite - Developer Circle Part-1.pdf
Diana Gray, MBA
 
What is DevOps? How can it impact my Customers and my Business
What is DevOps? How can it impact my Customers and my BusinessWhat is DevOps? How can it impact my Customers and my Business
What is DevOps? How can it impact my Customers and my Business
Qualitest
 
FCB Partners Webinar: Process 2020: The Cutting Edge of Process Innovation
FCB Partners Webinar: Process 2020: The Cutting Edge of Process Innovation FCB Partners Webinar: Process 2020: The Cutting Edge of Process Innovation
FCB Partners Webinar: Process 2020: The Cutting Edge of Process Innovation
FCBPartners
 
Zero touch QA automation platform for DevOps
Zero touch QA automation platform for DevOpsZero touch QA automation platform for DevOps
Zero touch QA automation platform for DevOps
TaUB Solutions
 
Continuous Improvement
Continuous ImprovementContinuous Improvement
Continuous Improvement
Jez Humble
 
Presentation - Test Automation in Digital Transformation - IITPSA SIGIST 2016042
Presentation - Test Automation in Digital Transformation - IITPSA SIGIST 2016042Presentation - Test Automation in Digital Transformation - IITPSA SIGIST 2016042
Presentation - Test Automation in Digital Transformation - IITPSA SIGIST 2016042
Wayne Sinclair
 
Ashok bhandari
Ashok bhandariAshok bhandari
Ashok bhandari
Ashok Bhandari
 
Agile webinar pack (2)
Agile webinar pack (2)Agile webinar pack (2)
Agile webinar pack (2)
Basis Technologies
 
How Applied Materials Deploys Faster SAP® Projects and Boosts Quality with Wo...
How Applied Materials Deploys Faster SAP® Projects and Boosts Quality with Wo...How Applied Materials Deploys Faster SAP® Projects and Boosts Quality with Wo...
How Applied Materials Deploys Faster SAP® Projects and Boosts Quality with Wo...
Worksoft
 
Eliminate Bottlenecks in Software Development & Delivery
Eliminate Bottlenecks in Software Development & DeliveryEliminate Bottlenecks in Software Development & Delivery
Eliminate Bottlenecks in Software Development & Delivery
Micro Focus
 
Forward5 Auxis VMware
Forward5 Auxis VMwareForward5 Auxis VMware
Forward5 Auxis VMware
Auxis Consulting & Outsourcing
 
Continuous Delivery Leadership Seminar May 2013
Continuous Delivery Leadership Seminar May 2013Continuous Delivery Leadership Seminar May 2013
Continuous Delivery Leadership Seminar May 2013
gbgruver
 
FlowCon 2013 Conference
FlowCon 2013 ConferenceFlowCon 2013 Conference
FlowCon 2013 Conference
gbgruver
 
Agile conference 2013
Agile conference 2013Agile conference 2013
Agile conference 2013
gbgruver
 
Modernizing Your Testing Tools
Modernizing Your Testing ToolsModernizing Your Testing Tools
Modernizing Your Testing Tools
QASymphony
 
Lean Solutions – Agile Transformation at the United States Postal Service
Lean Solutions  – Agile Transformation at the United States Postal ServiceLean Solutions  – Agile Transformation at the United States Postal Service
Lean Solutions – Agile Transformation at the United States Postal Service
ITSM Academy, Inc.
 
Test Automation using UiPath Test Suite - Developer Circle Part-1.pdf
Test Automation using UiPath Test Suite - Developer Circle Part-1.pdfTest Automation using UiPath Test Suite - Developer Circle Part-1.pdf
Test Automation using UiPath Test Suite - Developer Circle Part-1.pdf
Diana Gray, MBA
 
What is DevOps? How can it impact my Customers and my Business
What is DevOps? How can it impact my Customers and my BusinessWhat is DevOps? How can it impact my Customers and my Business
What is DevOps? How can it impact my Customers and my Business
Qualitest
 
FCB Partners Webinar: Process 2020: The Cutting Edge of Process Innovation
FCB Partners Webinar: Process 2020: The Cutting Edge of Process Innovation FCB Partners Webinar: Process 2020: The Cutting Edge of Process Innovation
FCB Partners Webinar: Process 2020: The Cutting Edge of Process Innovation
FCBPartners
 
Zero touch QA automation platform for DevOps
Zero touch QA automation platform for DevOpsZero touch QA automation platform for DevOps
Zero touch QA automation platform for DevOps
TaUB Solutions
 
Continuous Improvement
Continuous ImprovementContinuous Improvement
Continuous Improvement
Jez Humble
 
Presentation - Test Automation in Digital Transformation - IITPSA SIGIST 2016042
Presentation - Test Automation in Digital Transformation - IITPSA SIGIST 2016042Presentation - Test Automation in Digital Transformation - IITPSA SIGIST 2016042
Presentation - Test Automation in Digital Transformation - IITPSA SIGIST 2016042
Wayne Sinclair
 
How Applied Materials Deploys Faster SAP® Projects and Boosts Quality with Wo...
How Applied Materials Deploys Faster SAP® Projects and Boosts Quality with Wo...How Applied Materials Deploys Faster SAP® Projects and Boosts Quality with Wo...
How Applied Materials Deploys Faster SAP® Projects and Boosts Quality with Wo...
Worksoft
 
Eliminate Bottlenecks in Software Development & Delivery
Eliminate Bottlenecks in Software Development & DeliveryEliminate Bottlenecks in Software Development & Delivery
Eliminate Bottlenecks in Software Development & Delivery
Micro Focus
 
Ad

Recently uploaded (20)

2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptx2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptx
Samuele Fogagnolo
 
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
BookNet Canada
 
Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025
Splunk
 
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
BookNet Canada
 
Generative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in BusinessGenerative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in Business
Dr. Tathagat Varma
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul
 
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In FranceManifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
chb3
 
Role of Data Annotation Services in AI-Powered Manufacturing
Role of Data Annotation Services in AI-Powered ManufacturingRole of Data Annotation Services in AI-Powered Manufacturing
Role of Data Annotation Services in AI-Powered Manufacturing
Andrew Leo
 
Mobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi ArabiaMobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi Arabia
Steve Jonas
 
Complete Guide to Advanced Logistics Management Software in Riyadh.pdf
Complete Guide to Advanced Logistics Management Software in Riyadh.pdfComplete Guide to Advanced Logistics Management Software in Riyadh.pdf
Complete Guide to Advanced Logistics Management Software in Riyadh.pdf
Software Company
 
TrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business ConsultingTrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business Consulting
Trs Labs
 
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptx
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxDevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptx
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptx
Justin Reock
 
Cyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of securityCyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of security
riccardosl1
 
Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.
hpbmnnxrvb
 
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Aqusag Technologies
 
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
SOFTTECHHUB
 
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfSAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
Precisely
 
Cybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure ADCybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure AD
VICTOR MAESTRE RAMIREZ
 
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell
 
2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptx2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptx
Samuele Fogagnolo
 
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
BookNet Canada
 
Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025
Splunk
 
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
BookNet Canada
 
Generative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in BusinessGenerative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in Business
Dr. Tathagat Varma
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul
 
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In FranceManifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
chb3
 
Role of Data Annotation Services in AI-Powered Manufacturing
Role of Data Annotation Services in AI-Powered ManufacturingRole of Data Annotation Services in AI-Powered Manufacturing
Role of Data Annotation Services in AI-Powered Manufacturing
Andrew Leo
 
Mobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi ArabiaMobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi Arabia
Steve Jonas
 
Complete Guide to Advanced Logistics Management Software in Riyadh.pdf
Complete Guide to Advanced Logistics Management Software in Riyadh.pdfComplete Guide to Advanced Logistics Management Software in Riyadh.pdf
Complete Guide to Advanced Logistics Management Software in Riyadh.pdf
Software Company
 
TrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business ConsultingTrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business Consulting
Trs Labs
 
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptx
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxDevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptx
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptx
Justin Reock
 
Cyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of securityCyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of security
riccardosl1
 
Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.
hpbmnnxrvb
 
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Aqusag Technologies
 
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
SOFTTECHHUB
 
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfSAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
Precisely
 
Cybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure ADCybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure AD
VICTOR MAESTRE RAMIREZ
 
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell
 
Ad

Spark 2013 Presentation of making the enterprise agile

  • 1. A Practical Approach to Large Scale Agile Development Gary Gruver May 31, 2013
  • 2. Gary Gruver: • 24 year veteran in high tech • Led HP’s 400+ developers on a journey from waterfall to agile development • Currently VP of QE, Release, and Operations at Macys.com
  • 3. 4+ Year Large-Scale Agile Journey 400+ engineers around the world Over 10M lines of code High-end LaserJet printers and MFPs Embedded SW & FW Digital Sending and HP open Extensibility Platform
  • 4. State of the Development Process: 2008 • Lengthy Build Integration & Testing Cycles 6 weeks + to get through a complete testing cycle (mainly manual) • Build integration taking 15-20% of resources a week to get fixes to main • Manual testing a key driver and constraint for adding products • Products Lagging the Competition Ongoing customer issues with consistency and lack of features • Marketing had essentially given up asking for FW innovations
  • 5. State of the Development Process: 2008 • • Up to 10 different branches (driven by each product release window) in MFP • Costs out of control Development costs growing 2.5X from 20042008 and the business was still constrained CPE driving millions/year in CPE investments • Couldn’t Add Enough Resources 80-90% of resources just porting existing FW to new products and qualifying • Unable to add new products to the plans due to lack of FW resources • 20% of resources developing plans that quickly became obsolete
  • 6. Firmware Development Transformation Integrated Tools Consistent Dev Environment Agile Development with Mini Milestones (Sprints) Fully automated unit and system test Organizational Change Management Continuous integration and test system Architected for product variability One branch for all products including CPE
  • 7. Breakthrough Capacity Transformation Firmware Development for Development New Customer Capabilities FutureSmart FW Large Scale Agile Development Engine Defect Fixes • • • • • • 400+ developers 10+M LOC 75,000-100,000 LOC turmoil 100-150 Commits 10-15 builds /day 15,000 hours/day of testing (90% pass rate)
  • 8. Cycletime Driver Improvements 2008 2011 Build Bosses 1 Week Continuous Integration 3hrs Number of Builds 1-2 Continuous Integration 10-15/Day Feedback on Main 1 Commit/Day Autorevert ~100 Commits/Day Full Manual Registration 6 Weeks Auto Regression Testing 24 Hrs
  • 9. Development Cost Driver Improvements 2008 2011 Code Integration 10% Continuous Integration 2% Detailed Planning 20% Agile Planning 5% Porting Code 25% One Main Branch 15% Current Product Support 25% One Branch CPE 5% Manual Testing 15% Most Testing Automated 5% Capacity for Innovation ~5% Capacity for Innovation ~40%
  • 10. State of the art FW development model 2008 2011 Costs out of control ~70% reduction in FW development cost per program Couldn’t add resources fast enough 50% reduction in FW headcount Lengthy build, integration and testing cycles Cont. integration, daily automated regression Products lagging the competition Vintage chart unleashed and capacity for innovation
  • 14. Improvements Best Driven at the Enterprise Level ✔ Business Objectives/ Priorities ✔ Enterprise Level Continuous Improvement ✔ ✔ CI/CD and test automation infrastructure Planning Process
  • 15. Business Objectives (Don’t “Do Agile”) Define Understand your Either automate, eliminate, orcost & cycle-time the engineer out your value proposition drivers drivers that aren’t key to the value prop
  • 16. Business Objectives (Don’t “Continuous Delivery”) Increase the quality and frequency of feedback Reduce the time and resources between release branch & production Improve deployment repeatability
  • 17. Interative Approach to Agile Management Mini-milestone Objectives Agile Adjustments Cascading Objectives to Track Progress Having real-time metrics is essential for the speed of agile & aligning the org. But don’t manage by metrics. Use the metrics to understand where to have conversations about what is not getting done. Learnings Conversations
  • 18. Finding the offending code What Code? When? Are you sure it wasn’t Jez?
  • 19. Embedded System Pipeline Cost of Testing Simulator Emulator Drive test escapes upstream Product
  • 20. Continuous Integration and Test System STAGE 1 L1 Sim (10-14x/day) STAGE 2 L2 Sim (12x/day) L3 Emu (6x/day) L4 Sim (1x/day)
  • 21. Embedded System Pipeline 100% 90% 80% 70% 60% Sim. Quality bar Emulator 50% Sim. Regression Product 40% 30% 20% 10% 0% 1 2 3 4 5 6
  • 22. Building up a Large SW System Agile Comp 4 Agile Comp 2 Agile Comp 5 Agile Comp 3 Agile Comp 6 Legacy Waterfall IT 1 Interface Test Simulator Agile Comp 1 Legacy Waterfall IT 2 Legacy Waterfall IT 3
  • 23. One of the biggest challenges with Agile Planning at the enterprise level is getting the organization to accept the uncertainty in SW development and appreciate the flexibility and opportunity.
  • 24. Long Term Predictability for SW Schedules Do we really need the predictability of our current planning processes? Are our current planning processes really that accurate? Accuracy 100% Planning Investment
  • 25. A Practical Approach to Large Scale Agile Development E-mail: [email protected] Blog: largescaleagile.com Twitter: @GRUVERGary