SlideShare a Scribd company logo
© 2009 Mountain Goat Software© Copyright Mountain Goat Software®
Prioritizing Your
Product Backlog
Mike Cohn
mike@mountaingoatsoftware.com
June 8, 2010
1
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Mike Cohn
Founding member and
director of Agile Alliance
and Scrum Alliance
Founder of Mountain
Goat Software
Doing Scrum since 1995
Started my career as a
programmer
2
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Combine formal & informal
Formal prioritization approaches for
Choosing among projects
Choosing between ā€œepicsā€ or ā€œbig featuresā€
An informal approach (expert opinion)
Once you’ve selected the epics / big features
3
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Why?
Features that are too small cannot be
effectively prioritized against each other
What’s more important in a word processor?
The A key or the E key?
Tables or undo?
What’s more important on a car?
The left front wheel or the right front wheel?
Increased leg room or a larger engine?
4
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
5
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Prioritize epics then open them up to
optimize release contents
The release
6
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Approaches to prioritizing
Kano analysis
Expert opinion
Theme screening
Theme scoring
Relative weighting
Financial analysis
7
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Non-financial
prioritization
8
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Kano analysis1
Must be present in order for users to be
Mandatory / Baseline
The more of it, the better
Linear
Features a user doesn’t know she wants,
until she sees it
Exciters / Delighters
9
© 2009 Mountain Goat Software© Copyright Mountain Goat Software®
Ā®
Impact on user satisfaction
Feature
Presence
SatisfactionLowHigh
Low High
Exciters/
Delighters
Mandatory
Linear
10
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Surveying users
To assess whether a feature is baseline,
linear, or exciting we can:
Sometimes guess
Or survey a small set of users (20-30)
We ask two questions
A functional question
How do you feel if a feature is present?
And a dysfunctional question
How do you feel if that feature is absent?
11
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Functional and dysfunctional forms
If your hotel room
includes a free
bottle of water, how
do you feel?
I expect it to be that way.
I like it that way.
I am neutral.
I can live with it that way.
I dislike it that way.
āœ”
If your hotel room
does not include a
free bottle of
water, how do you
feel?
I expect it to be that way.
I like it that way.
I am neutral.
I can live with it that way.
I dislike it that way.
āœ”
Functional
form of
question
Dysfunctional
form of
question
12
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Categorizing an answer pair
Dysfuncctional Quuestion
Like Expect Neutral Live with Dislike
Like
Expect
Neutral
Live with
Dislike
Q E E E L
R I I I M
R I I I M
R I I I M
R R R R Q
Functional
Question
Mandatory
Linear
Exciter
Questionable
Reverse
Indifferent
13
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Aggregating results
Apply stylesheets
Automate report
execution
Export reports to
PowerPoint
3 11 31 1 3 2
4 22 20 4 1 0
21 9 14 5 1 1
Questionable
Reverse
Indifferent
Mandatory
Linear
Exciter
Themes
14
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
What to include
All of the baseline features
Some amount of linear features
But leaving room for at least a few exciters
15
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
You are thinking about buying a new eco-friendly
car. Identify examples of:
Mandatory features
Linear features
Exciters
Your new car
16
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Relative weighting
Assess the impact of having a story/theme from 1-9
Assess impact of NOT having it from 1-9
Calculate the value of each story or theme relative to
the entire product backlog
This gives you the relative value of that story or theme
Estimate the cost of each story theme
Calculate the cost of each story or theme relative to
the entire product backlog
This gives the relative cost of that story or theme
Priority is given by (RelativeValue Ć· Relative Cost)
2
17
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Relative weighting: an example
More investment choices
Portfolio rebalancing
Comply with new law
Total: RelativePenalty
TotalValue
ValuePercent
Estimate
CostPercent
Priority
8
9
1
6
2
9
14
11
10
35
40
31
29
100
64
40
42
146
44
27
29
100
91
115
100
Value Percent = TotalValue / āˆ‘ (TotalValue)
Cost Percent = Estimate / āˆ‘ (Estimate)
18
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
You are theVP of Product Development at
MyCookSpace.com, a social networking site
You have a minimally functional site up with 4,000
registered cooks
You are trying to grow that to 400,000 as quickly as
possible before you run out of money
You are also interested in other features that result in
revenue
Identify 4-5 epics or big features to develop
Complete a relative weighting worksheet
Make reasonable but wild guesses at development effort
estimates
Prioritizing MyCookSpace.com
19
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
20
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Expert opinion
Focus needs to be on delivering value to the
customer
But consider these four factors
1. Delivery of new capabilities
2. Development of new knowledge
3. Mitigation of risk
4. Changes in relative cost
3
21
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Theme screening
Identify around 5-9 selection criteria for
what is important in the next release
Select a baseline theme
Likely to be included in the next release
Understood by most team members
Assess each candidate theme relative to the
baseline theme
4
22
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Theme screening: an example
Continue?
ThemeARank
Net Score
Generates revenue in Q2
Starts us integrating product lines
Competitiveness with ABC Corp.
Importance to existing customers
0
ThemeB
āˆ’
0
0
EpicC
BaselineTheme
ThemeD
EpicE
EpicF
0
āˆ’
0
0
0
āˆ’1
0
0
0
0
0
āˆ’
0 0
āˆ’
0
0
0
0
1 7 34 4 4 2
N N NY Y Y Y
Selection
criteria Themes
	

= better than
0	

= same as
āˆ’	

= worse than
23
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Theme scoring
Like theme screening but selection criteria are
weighted
Need to select a baseline theme for each criteria
Avoids category compression
Each theme is assessed against the baseline for
each selection criteria
5
Much worse than reference 1
Worse than reference 2
Same as reference 3
Better than reference 4
Much better than reference 5
24
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
3.90
1 3 2
Yes No Yes
Theme scoring: an example
Continue?
Rank
Net Score
Generates revenue in Q2
Starts us integrating product lines
Competitiveness with ABC Corp.
Importance to existing customers
Weight
Rating
Theme A
Weighted
Score
3
2
3
5
0.75
0.20
0.45
2.50
Rating
Epic B
Weighted
Score
1
3
4
2
2.15
0.25
0.30
0.60
1.00
Rating
Theme C
Weighted
Score
4
3
4
3
3.40
1.00
0.30
0.60
1.50
25%
10%
15%
50%
25
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
the relative weighting exercise, complete
a theme screening or theme scoring
worksheet for MyCookSpace.com
Theme screening or scoring
26
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Financial
prioritization
27
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
How much?
How long?
At what interest rate?
If you’re buying a house:
It’s a $220,000 loan
For 30 years
At 7% per year
Three factors to consider
28
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Technique #1
Net PresentValue (NPV)
29
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Which project would you prefer?
Year
Projeect A Projeect B
Investment Return Investment Return
0
1
2
3
4
5
$1,000 $1,000
$200 $3,000
$300 $500
$500 $300
$3,000 $200
$0 $0
30
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
A dollar today is worth more than a dollar a
year from now
The time-value of money
I’ll gladly pay you on
Tuesday for a hamburger
today.
31
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Calculating the value of future dollars
To buy a $5 hamburger
next Tuesday…
To buy a $5 hamburger
in a year, how much do
I put in the bank today?
I would put around $4.99
in the bank today
$5.00 $5.00
1.10
$4.54==
Assumes 10%
interest rate
The present value of
$5.00 a year from now
32
© 2009 Mountain Goat Software© Copyright Mountain Goat Software®
Ā®
Present value of one future amount
FutureValuePresent
Value
=
$5.00
= $4.54An example:
Generalizing
FV
t
PV =
Simplifying
-t
33
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Measures the return on a theme or project
as an amount of money
Net present value (NPV)
Ft
-tNPV(i) = āˆ‘t=0
n
34
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
NPV example
Quarter
Cash
Flow
-t Discounted
Cash Flow
Running
Total
0
1
2
3
4
-200 1.000 -200 -200
-600 0.971 -583 -783
100 0.943 94 -689
300 0.915 275 -414
500 0.888 444 30
Assuming 12% annual discount rate (3% / quarter)
35
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Discount rate sensitivity
Quarter Cash Flow
Discounted Cash
Flow (3%)
Discounted
Cash Flow (6%)
0
1
2
3
4
Total
–200 –200 –200
–600 –583 –783
100 94 –689
300 275 –414
500 444 30
100 30 –29
NPV is highly sensitive to the chosen discount rate
Do the project under
these circumstances
But not under
these
36
© 2009 Mountain Goat Software© Copyright Mountain Goat Software®
Ā®
Comparing NPVs
Highest NPV brings the most present-value dollars
to the company
Theme NPV
Scalability
Gift registry
Ad hoc reporting
Pay by invoice
$2,100
$1,253
$784
$385
Comparing NPVs can be
misleading. What if:
ā€¢ā€œPay by invoiceā€ requires
a $5 investment
ā€¢ā€œScalabilityā€ requires
$50,000?
37
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Technique #2
Internal Rate
of
Return (IRR)
38
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Rather than expressing returns in dollars,
we’d like to express return as a percentage
Allows for direct comparisons
NPV = how much money a project will
return
ROI = how quickly an investment will grow
Return as a percentage
39
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Internal rate of return (IRR) and ROI
IRR = Internal Rate of Return
Often called Return On Investment (ROI)
The interest rate at which NPV is 0
0 = PV(i*
) = Ft 1+ i( )
āˆ’t
t= 0
n
āˆ‘
40
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
IRR gives us the discount rate at which we don’t
care whether or not we do the project
We don’t make $30; we don’t lose $29; we break even
Remember this table?
Quarter Cash Flow
Discounted Cash
Flow (3%)
Discounted Cash
Flow (6%)
0
1
2
3
4
Total
–200 –200 –200
–600 –583 –783
100 94 –689
300 275 –414
500 444 30
100 30 –29
41
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Use Excel’s irr function
How to calculate ROI or IRR
āˆ’200, āˆ’600, 100, 300, 500})
An investment
day of the project
remainder of
project
(4 quarters)
42
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Advantages and disadvantages
Advantages
You don’t need to guess at a discount rate like
with NPV
Can be used to directly compare projects
Disadvantages
Calculation is hard to do by hand (but easy in
Excel); may lead to numbers being distrusted
Cannot use in all circumstances
positive
43
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Technique #3
Payback period
44
© 2009 Mountain Goat Software© Copyright Mountain Goat Software®
Ā®
Payback period
The amount of time before an initial investment is
paid back
I loan you $5.You pay me back $1/week.The payback
period is 5 weeks.
Quarter Cash Flow
Running
Total
0
1
2
3
4
-200 -200
-200 -400
100 -300
300 0
500 500
Payback
period is 3
quarters.
45
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Advantages
Calculation is very easy
Longer payback period = greater risk
Disadvantages
Doesn’t consider the time-value of money
Advantages and disadvantages
46
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Discounted payback period
Quarter
Cash
Flow
-t
i=3%
Discounted
Cash Flow
Running
Total
0
1
2
3
4
-200 1.000 -200 -200
-200 0.971 -194 -394
100 0.943 94 -300
300 0.915 275 -25
500 0.888 444 419
investment is paid back
Discounted payback
period = 4 quarters
47
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Net PresentValue (NPV)
Expresses return as an amount of money
Return on Investment (ROI) / Internal Rate of Return
The interest rate at which NPV = 0
That is, at which you’d be indifferent to the investment
Expresses return as a percentage
Discounted payback period
Amount of time before discounted returns equal the
investment
Expresses return as an amount of time
Financial analysis recap
48
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Person
Weeks
Cost
3-Year
Return
NPV IRR
D. Payback
(Quarters)
Feature A
Feature B
Feature C
Feature D
Feature E
Feature F
Feature G
Feature H
Feature I
Feature J
Feature K
Feature L
Feature M
Feature N
Feature O
25 $150 $1,085 $448 133% 2
32 192 $2,109 $940 172% 4
90 $540 $2,537 $883 89% 2
48 $288 $1,360 $443 76% 4
55 $330 $900 $191 48% 2
79 $474 $1,365 $331 56% 4
90 $540 $5,964 $2,519 139% 5
50 $300 $2,415 $1,023 146% 2
15 90 $1,600 $747 221% 1
30 $180 $640 $182 65% 2
75 $450 $516 ($104) 5% NA
40 $240 $171 ($110) (12%) NA
80 $480 $1,025 $142 36% 3
18 $108 $185 $7 24% 2
12 $72 $1,505 $748 355% 1
Comparison matrix
49
Ā© Copyright Mountain Goat SoftwareĀ®
Ā®
Mike Cohn
mike@mountaingoatsoftware.com
www.mountaingoatsoftware.com
twitter: mikewcohn
(720) 890āˆ’6110
50

More Related Content

PDF
Scrum 101: Introduction to Scrum
Arrielle Mali
Ā 
PPTX
Introduction to Scrum.ppt
Mohan Late
Ā 
PDF
Product Backlog Refinement
Katarzyna Kot
Ā 
PPTX
SAFe SCRUMxp Overview
Rob Betcher
Ā 
PDF
Scrum - Agile Methodology
Niel Deckx
Ā 
PPTX
The Values and Principles of Agile Software Development
Brad Appleton
Ā 
PDF
Estimating Story Points in Agile - MAGIC Approach
Marraju Bollapragada V
Ā 
PPTX
[HCM Scrum Breakfast] Agile estimation - Story points
Scrum Breakfast Vietnam
Ā 
Scrum 101: Introduction to Scrum
Arrielle Mali
Ā 
Introduction to Scrum.ppt
Mohan Late
Ā 
Product Backlog Refinement
Katarzyna Kot
Ā 
SAFe SCRUMxp Overview
Rob Betcher
Ā 
Scrum - Agile Methodology
Niel Deckx
Ā 
The Values and Principles of Agile Software Development
Brad Appleton
Ā 
Estimating Story Points in Agile - MAGIC Approach
Marraju Bollapragada V
Ā 
[HCM Scrum Breakfast] Agile estimation - Story points
Scrum Breakfast Vietnam
Ā 

What's hot (20)

PPTX
Agile Estimation Techniques
Mikalai Alimenkou
Ā 
PPTX
How to facilitate product backlog refinement sessions
LuxoftAgilePractice
Ā 
PDF
Product Backlog - Refinement and Prioritization Techniques
Vikash Karuna
Ā 
PPTX
Agile scrum fundamentals
Deniz Gungor
Ā 
PDF
Agile 101
Sunil Mundra
Ā 
PPTX
Splitting User Stories
DCG Software Value
Ā 
PDF
Agile & SCRUM basics
Arun R
Ā 
PPTX
Scrum 101
beLithe
Ā 
PPTX
Scaled Agile Framework (SAFe) Roles and Meetings
Rob Betcher
Ā 
PPTX
2017 Scrum by Picture
Pawel Lewinski
Ā 
PPTX
Scrum - Product Backlog
Upekha Vandebona
Ā 
PDF
How to write good user stories
Jose E. Rodriguez Huerta
Ā 
PDF
Workshop - Writing Good User Stories
Easy Agile
Ā 
PDF
An Introduction to Scaled Agile Framework (SAFe)
CA Technologies
Ā 
PDF
Scrum in a nutshell
Muhammad Azani Hasibuan, M.T.I., PMP
Ā 
PDF
Scrumban
CoachingSaga
Ā 
PPT
Scrum In 15 Minutes
Srikanth Shreenivas
Ā 
PPTX
Agile estimating 12112013 - Agile KC Dec 2013
molsonkc
Ā 
Agile Estimation Techniques
Mikalai Alimenkou
Ā 
How to facilitate product backlog refinement sessions
LuxoftAgilePractice
Ā 
Product Backlog - Refinement and Prioritization Techniques
Vikash Karuna
Ā 
Agile scrum fundamentals
Deniz Gungor
Ā 
Agile 101
Sunil Mundra
Ā 
Splitting User Stories
DCG Software Value
Ā 
Agile & SCRUM basics
Arun R
Ā 
Scrum 101
beLithe
Ā 
Scaled Agile Framework (SAFe) Roles and Meetings
Rob Betcher
Ā 
2017 Scrum by Picture
Pawel Lewinski
Ā 
Scrum - Product Backlog
Upekha Vandebona
Ā 
How to write good user stories
Jose E. Rodriguez Huerta
Ā 
Workshop - Writing Good User Stories
Easy Agile
Ā 
An Introduction to Scaled Agile Framework (SAFe)
CA Technologies
Ā 
Scrumban
CoachingSaga
Ā 
Scrum In 15 Minutes
Srikanth Shreenivas
Ā 
Agile estimating 12112013 - Agile KC Dec 2013
molsonkc
Ā 
Ad

Viewers also liked (20)

PDF
Succeeding with Agile
Mike Cohn
Ā 
PDF
Agile Development - Are you building the right thing ? (Follow the value)
Martin Nymann Vinther
Ā 
PDF
Becoming an Effective Product Owner
Mike Cohn
Ā 
PDF
The next leap in digital mobility
Aleksandar Tasev
Ā 
PPTX
Product backlog refinement
espeo
Ā 
PPTX
Spohrer icer 20150810 v1
home
Ā 
PPTX
The DNA of an Innovative Product Owner by Anu Smalley
Accenture | SolutionsIQ
Ā 
PDF
Planning for Contract Agile Projects
Mike Cohn
Ā 
PDF
Composing User Stories - Beginners Guide
Raja Soundaramourty
Ā 
PDF
What is-agile henrik kniberg august 20 2013
Richard P. Doerer
Ā 
PDF
Scaling Agile and Working with a Distributed Team
Mike Cohn
Ā 
PDF
Agile Estimating - NDC 2014
Mike Cohn
Ā 
PDF
Agile Product Management
Mike Cohn
Ā 
PDF
Marie Davidova: Socio-Environmental Relations of Non-Discrete Spaces and Arch...
RSD Relating Systems Thinking and Design
Ā 
PDF
Resilience in Sociotechnical Systems: Studying Stakeholder Perspectives acros...
RSD Relating Systems Thinking and Design
Ā 
PDF
Greg Van Alstyne and Dr Robert K Logan: Designing for Emergence : Integrating...
RSD Relating Systems Thinking and Design
Ā 
PPTX
Hierarchy in Flux: Interfacing Robots
RSD Relating Systems Thinking and Design
Ā 
PDF
Managing Creativity: Oxymoron or Necessity?
RSD Relating Systems Thinking and Design
Ā 
PDF
Anticipatory Factors in Dialogic Design ISSS 2016
Peter Jones
Ā 
PDF
Introduction to User Stories
Mike Cohn
Ā 
Succeeding with Agile
Mike Cohn
Ā 
Agile Development - Are you building the right thing ? (Follow the value)
Martin Nymann Vinther
Ā 
Becoming an Effective Product Owner
Mike Cohn
Ā 
The next leap in digital mobility
Aleksandar Tasev
Ā 
Product backlog refinement
espeo
Ā 
Spohrer icer 20150810 v1
home
Ā 
The DNA of an Innovative Product Owner by Anu Smalley
Accenture | SolutionsIQ
Ā 
Planning for Contract Agile Projects
Mike Cohn
Ā 
Composing User Stories - Beginners Guide
Raja Soundaramourty
Ā 
What is-agile henrik kniberg august 20 2013
Richard P. Doerer
Ā 
Scaling Agile and Working with a Distributed Team
Mike Cohn
Ā 
Agile Estimating - NDC 2014
Mike Cohn
Ā 
Agile Product Management
Mike Cohn
Ā 
Marie Davidova: Socio-Environmental Relations of Non-Discrete Spaces and Arch...
RSD Relating Systems Thinking and Design
Ā 
Resilience in Sociotechnical Systems: Studying Stakeholder Perspectives acros...
RSD Relating Systems Thinking and Design
Ā 
Greg Van Alstyne and Dr Robert K Logan: Designing for Emergence : Integrating...
RSD Relating Systems Thinking and Design
Ā 
Hierarchy in Flux: Interfacing Robots
RSD Relating Systems Thinking and Design
Ā 
Managing Creativity: Oxymoron or Necessity?
RSD Relating Systems Thinking and Design
Ā 
Anticipatory Factors in Dialogic Design ISSS 2016
Peter Jones
Ā 
Introduction to User Stories
Mike Cohn
Ā 
Ad

Similar to Prioritizing Your Product Backlog (20)

PPTX
Feature Prioritization Strategies
Afshin Ganjoo
Ā 
PDF
Experiencing Agility From Requirements to Planning
Mike Cohn
Ā 
PPTX
priortization-ofproducts.pptx
chachca1
Ā 
PDF
Measurement in a Continuous World - Jim Highsmith
Thoughtworks
Ā 
PDF
Teaching an Elephant to Dance or Scaling Agile to Large Project Teams
VersionOne
Ā 
PPTX
Prioritization for Product Managers
Mike Chowla
Ā 
PDF
Incorporating Learning and Expected Cost of Change
Mike Cohn
Ā 
PDF
nahpriorituz.pdf
ssuser3458db
Ā 
PDF
User Stories for Agile Requirements
Mike Cohn
Ā 
PDF
User-Stories-for-Agile-Requirements-Norwegian-Developers-Conference-2014.pdf
SLowe7
Ā 
PDF
Priority Starts at the Top
Productized
Ā 
PDF
Enterprise re novation january 2013
Shahid Solomon
Ā 
PDF
Agile software measurement, governance, and portfolio management
Kurt Bittner
Ā 
PDF
Don't demo facts. Demo stories! (handouts)
Tudor Girba
Ā 
PDF
The Metrics Trap...And How to Avoid It
Douglas Novo
Ā 
PDF
Advanced Topics in Agile Planning
Mike Cohn
Ā 
PPTX
No More Pet Projects
Corecom Consulting
Ā 
PPTX
Houston - We Have a Priority - Natalie Warnert Scrum Gathering Orlando 2016
Natalie Warnert
Ā 
KEY
Prioritization 301 - Advanced Roadmapping Class, Bruce McCarthy
ProductCamp Boston
Ā 
KEY
Prioritization 301: An Advanced Roadmapping Class for Product People
UpUp Labs
Ā 
Feature Prioritization Strategies
Afshin Ganjoo
Ā 
Experiencing Agility From Requirements to Planning
Mike Cohn
Ā 
priortization-ofproducts.pptx
chachca1
Ā 
Measurement in a Continuous World - Jim Highsmith
Thoughtworks
Ā 
Teaching an Elephant to Dance or Scaling Agile to Large Project Teams
VersionOne
Ā 
Prioritization for Product Managers
Mike Chowla
Ā 
Incorporating Learning and Expected Cost of Change
Mike Cohn
Ā 
nahpriorituz.pdf
ssuser3458db
Ā 
User Stories for Agile Requirements
Mike Cohn
Ā 
User-Stories-for-Agile-Requirements-Norwegian-Developers-Conference-2014.pdf
SLowe7
Ā 
Priority Starts at the Top
Productized
Ā 
Enterprise re novation january 2013
Shahid Solomon
Ā 
Agile software measurement, governance, and portfolio management
Kurt Bittner
Ā 
Don't demo facts. Demo stories! (handouts)
Tudor Girba
Ā 
The Metrics Trap...And How to Avoid It
Douglas Novo
Ā 
Advanced Topics in Agile Planning
Mike Cohn
Ā 
No More Pet Projects
Corecom Consulting
Ā 
Houston - We Have a Priority - Natalie Warnert Scrum Gathering Orlando 2016
Natalie Warnert
Ā 
Prioritization 301 - Advanced Roadmapping Class, Bruce McCarthy
ProductCamp Boston
Ā 
Prioritization 301: An Advanced Roadmapping Class for Product People
UpUp Labs
Ā 

More from Mike Cohn (20)

PDF
Advanced Agile Planning - NDC 2014
Mike Cohn
Ā 
PDF
Leading Self Organizing Teams - NDC 2014
Mike Cohn
Ā 
PDF
Getting Agile with Srum
Mike Cohn
Ā 
PDF
Advanced Agile Planning
Mike Cohn
Ā 
PDF
Agile Estimating
Mike Cohn
Ā 
PDF
Getting Agile with Srum
Mike Cohn
Ā 
PDF
Scaling Agile and Working with a Distributed Team
Mike Cohn
Ā 
PDF
User Stories
Mike Cohn
Ā 
PDF
Agile planning and project management
Mike Cohn
Ā 
PDF
Scrum: Leading a Self-Organizing Team
Mike Cohn
Ā 
PDF
ADAPTing to Agile Development
Mike Cohn
Ā 
PDF
ADAPTing to Agile for Continued Success
Mike Cohn
Ā 
PDF
ADAPTing to Enterprise Agile
Mike Cohn
Ā 
PDF
Agile and Scrum for Video Game Development
Mike Cohn
Ā 
PDF
Agile and the Seven Sins of Project Management
Mike Cohn
Ā 
PDF
Agile Estimating
Mike Cohn
Ā 
PDF
Getting Agile with Scrum
Mike Cohn
Ā 
PDF
Assessing Your Agility: Introducing the Comparative Agility Assessment
Mike Cohn
Ā 
PDF
Planning and Tracking Agile Projects
Mike Cohn
Ā 
PDF
Overcoming Waterfallacies & Agilephobias
Mike Cohn
Ā 
Advanced Agile Planning - NDC 2014
Mike Cohn
Ā 
Leading Self Organizing Teams - NDC 2014
Mike Cohn
Ā 
Getting Agile with Srum
Mike Cohn
Ā 
Advanced Agile Planning
Mike Cohn
Ā 
Agile Estimating
Mike Cohn
Ā 
Getting Agile with Srum
Mike Cohn
Ā 
Scaling Agile and Working with a Distributed Team
Mike Cohn
Ā 
User Stories
Mike Cohn
Ā 
Agile planning and project management
Mike Cohn
Ā 
Scrum: Leading a Self-Organizing Team
Mike Cohn
Ā 
ADAPTing to Agile Development
Mike Cohn
Ā 
ADAPTing to Agile for Continued Success
Mike Cohn
Ā 
ADAPTing to Enterprise Agile
Mike Cohn
Ā 
Agile and Scrum for Video Game Development
Mike Cohn
Ā 
Agile and the Seven Sins of Project Management
Mike Cohn
Ā 
Agile Estimating
Mike Cohn
Ā 
Getting Agile with Scrum
Mike Cohn
Ā 
Assessing Your Agility: Introducing the Comparative Agility Assessment
Mike Cohn
Ā 
Planning and Tracking Agile Projects
Mike Cohn
Ā 
Overcoming Waterfallacies & Agilephobias
Mike Cohn
Ā 

Recently uploaded (20)

PPT
Coupa-Kickoff-Meeting-Template presentai
annapureddyn
Ā 
PDF
Doc9.....................................
SofiaCollazos
Ā 
PDF
Structs to JSON: How Go Powers REST APIs
Emily Achieng
Ā 
PDF
How-Cloud-Computing-Impacts-Businesses-in-2025-and-Beyond.pdf
Artjoker Software Development Company
Ā 
PPTX
OA presentation.pptx OA presentation.pptx
pateldhruv002338
Ā 
PPTX
AI and Robotics for Human Well-being.pptx
JAYMIN SUTHAR
Ā 
PDF
A Strategic Analysis of the MVNO Wave in Emerging Markets.pdf
IPLOOK Networks
Ā 
PPTX
What-is-the-World-Wide-Web -- Introduction
tonifi9488
Ā 
PDF
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
Ā 
PPTX
How to Build a Scalable Micro-Investing Platform in 2025 - A Founder’s Guide ...
Third Rock Techkno
Ā 
PPTX
ChatGPT's Deck on The Enduring Legacy of Fax Machines
Greg Swan
Ā 
PDF
SparkLabs Primer on Artificial Intelligence 2025
SparkLabs Group
Ā 
PDF
A Day in the Life of Location Data - Turning Where into How.pdf
Precisely
Ā 
PDF
Software Development Methodologies in 2025
KodekX
Ā 
PPTX
Coupa-Overview _Assumptions presentation
annapureddyn
Ā 
PDF
Research-Fundamentals-and-Topic-Development.pdf
ayesha butalia
Ā 
PDF
Oracle AI Vector Search- Getting Started and what's new in 2025- AIOUG Yatra ...
Sandesh Rao
Ā 
PDF
AI Unleashed - Shaping the Future -Starting Today - AIOUG Yatra 2025 - For Co...
Sandesh Rao
Ā 
PPTX
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
Ā 
PDF
The Evolution of KM Roles (Presented at Knowledge Summit Dublin 2025)
Enterprise Knowledge
Ā 
Coupa-Kickoff-Meeting-Template presentai
annapureddyn
Ā 
Doc9.....................................
SofiaCollazos
Ā 
Structs to JSON: How Go Powers REST APIs
Emily Achieng
Ā 
How-Cloud-Computing-Impacts-Businesses-in-2025-and-Beyond.pdf
Artjoker Software Development Company
Ā 
OA presentation.pptx OA presentation.pptx
pateldhruv002338
Ā 
AI and Robotics for Human Well-being.pptx
JAYMIN SUTHAR
Ā 
A Strategic Analysis of the MVNO Wave in Emerging Markets.pdf
IPLOOK Networks
Ā 
What-is-the-World-Wide-Web -- Introduction
tonifi9488
Ā 
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
Ā 
How to Build a Scalable Micro-Investing Platform in 2025 - A Founder’s Guide ...
Third Rock Techkno
Ā 
ChatGPT's Deck on The Enduring Legacy of Fax Machines
Greg Swan
Ā 
SparkLabs Primer on Artificial Intelligence 2025
SparkLabs Group
Ā 
A Day in the Life of Location Data - Turning Where into How.pdf
Precisely
Ā 
Software Development Methodologies in 2025
KodekX
Ā 
Coupa-Overview _Assumptions presentation
annapureddyn
Ā 
Research-Fundamentals-and-Topic-Development.pdf
ayesha butalia
Ā 
Oracle AI Vector Search- Getting Started and what's new in 2025- AIOUG Yatra ...
Sandesh Rao
Ā 
AI Unleashed - Shaping the Future -Starting Today - AIOUG Yatra 2025 - For Co...
Sandesh Rao
Ā 
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
Ā 
The Evolution of KM Roles (Presented at Knowledge Summit Dublin 2025)
Enterprise Knowledge
Ā 

Prioritizing Your Product Backlog

  • 1. Ā© 2009 Mountain Goat SoftwareĀ© Copyright Mountain Goat SoftwareĀ® Prioritizing Your Product Backlog Mike Cohn [email protected] June 8, 2010 1
  • 2. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Mike Cohn Founding member and director of Agile Alliance and Scrum Alliance Founder of Mountain Goat Software Doing Scrum since 1995 Started my career as a programmer 2
  • 3. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Combine formal & informal Formal prioritization approaches for Choosing among projects Choosing between ā€œepicsā€ or ā€œbig featuresā€ An informal approach (expert opinion) Once you’ve selected the epics / big features 3
  • 4. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Why? Features that are too small cannot be effectively prioritized against each other What’s more important in a word processor? The A key or the E key? Tables or undo? What’s more important on a car? The left front wheel or the right front wheel? Increased leg room or a larger engine? 4
  • 5. Ā© Copyright Mountain Goat SoftwareĀ® Ā® 5
  • 6. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Prioritize epics then open them up to optimize release contents The release 6
  • 7. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Approaches to prioritizing Kano analysis Expert opinion Theme screening Theme scoring Relative weighting Financial analysis 7
  • 8. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Non-financial prioritization 8
  • 9. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Kano analysis1 Must be present in order for users to be Mandatory / Baseline The more of it, the better Linear Features a user doesn’t know she wants, until she sees it Exciters / Delighters 9
  • 10. Ā© 2009 Mountain Goat SoftwareĀ© Copyright Mountain Goat SoftwareĀ® Ā® Impact on user satisfaction Feature Presence SatisfactionLowHigh Low High Exciters/ Delighters Mandatory Linear 10
  • 11. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Surveying users To assess whether a feature is baseline, linear, or exciting we can: Sometimes guess Or survey a small set of users (20-30) We ask two questions A functional question How do you feel if a feature is present? And a dysfunctional question How do you feel if that feature is absent? 11
  • 12. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Functional and dysfunctional forms If your hotel room includes a free bottle of water, how do you feel? I expect it to be that way. I like it that way. I am neutral. I can live with it that way. I dislike it that way. āœ” If your hotel room does not include a free bottle of water, how do you feel? I expect it to be that way. I like it that way. I am neutral. I can live with it that way. I dislike it that way. āœ” Functional form of question Dysfunctional form of question 12
  • 13. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Categorizing an answer pair Dysfuncctional Quuestion Like Expect Neutral Live with Dislike Like Expect Neutral Live with Dislike Q E E E L R I I I M R I I I M R I I I M R R R R Q Functional Question Mandatory Linear Exciter Questionable Reverse Indifferent 13
  • 14. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Aggregating results Apply stylesheets Automate report execution Export reports to PowerPoint 3 11 31 1 3 2 4 22 20 4 1 0 21 9 14 5 1 1 Questionable Reverse Indifferent Mandatory Linear Exciter Themes 14
  • 15. Ā© Copyright Mountain Goat SoftwareĀ® Ā® What to include All of the baseline features Some amount of linear features But leaving room for at least a few exciters 15
  • 16. Ā© Copyright Mountain Goat SoftwareĀ® Ā® You are thinking about buying a new eco-friendly car. Identify examples of: Mandatory features Linear features Exciters Your new car 16
  • 17. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Relative weighting Assess the impact of having a story/theme from 1-9 Assess impact of NOT having it from 1-9 Calculate the value of each story or theme relative to the entire product backlog This gives you the relative value of that story or theme Estimate the cost of each story theme Calculate the cost of each story or theme relative to the entire product backlog This gives the relative cost of that story or theme Priority is given by (RelativeValue Ć· Relative Cost) 2 17
  • 18. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Relative weighting: an example More investment choices Portfolio rebalancing Comply with new law Total: RelativePenalty TotalValue ValuePercent Estimate CostPercent Priority 8 9 1 6 2 9 14 11 10 35 40 31 29 100 64 40 42 146 44 27 29 100 91 115 100 Value Percent = TotalValue / āˆ‘ (TotalValue) Cost Percent = Estimate / āˆ‘ (Estimate) 18
  • 19. Ā© Copyright Mountain Goat SoftwareĀ® Ā® You are theVP of Product Development at MyCookSpace.com, a social networking site You have a minimally functional site up with 4,000 registered cooks You are trying to grow that to 400,000 as quickly as possible before you run out of money You are also interested in other features that result in revenue Identify 4-5 epics or big features to develop Complete a relative weighting worksheet Make reasonable but wild guesses at development effort estimates Prioritizing MyCookSpace.com 19
  • 20. Ā© Copyright Mountain Goat SoftwareĀ® Ā® 20
  • 21. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Expert opinion Focus needs to be on delivering value to the customer But consider these four factors 1. Delivery of new capabilities 2. Development of new knowledge 3. Mitigation of risk 4. Changes in relative cost 3 21
  • 22. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Theme screening Identify around 5-9 selection criteria for what is important in the next release Select a baseline theme Likely to be included in the next release Understood by most team members Assess each candidate theme relative to the baseline theme 4 22
  • 23. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Theme screening: an example Continue? ThemeARank Net Score Generates revenue in Q2 Starts us integrating product lines Competitiveness with ABC Corp. Importance to existing customers 0 ThemeB āˆ’ 0 0 EpicC BaselineTheme ThemeD EpicE EpicF 0 āˆ’ 0 0 0 āˆ’1 0 0 0 0 0 āˆ’ 0 0 āˆ’ 0 0 0 0 1 7 34 4 4 2 N N NY Y Y Y Selection criteria Themes = better than 0 = same as āˆ’ = worse than 23
  • 24. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Theme scoring Like theme screening but selection criteria are weighted Need to select a baseline theme for each criteria Avoids category compression Each theme is assessed against the baseline for each selection criteria 5 Much worse than reference 1 Worse than reference 2 Same as reference 3 Better than reference 4 Much better than reference 5 24
  • 25. Ā© Copyright Mountain Goat SoftwareĀ® Ā® 3.90 1 3 2 Yes No Yes Theme scoring: an example Continue? Rank Net Score Generates revenue in Q2 Starts us integrating product lines Competitiveness with ABC Corp. Importance to existing customers Weight Rating Theme A Weighted Score 3 2 3 5 0.75 0.20 0.45 2.50 Rating Epic B Weighted Score 1 3 4 2 2.15 0.25 0.30 0.60 1.00 Rating Theme C Weighted Score 4 3 4 3 3.40 1.00 0.30 0.60 1.50 25% 10% 15% 50% 25
  • 26. Ā© Copyright Mountain Goat SoftwareĀ® Ā® the relative weighting exercise, complete a theme screening or theme scoring worksheet for MyCookSpace.com Theme screening or scoring 26
  • 27. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Financial prioritization 27
  • 28. Ā© Copyright Mountain Goat SoftwareĀ® Ā® How much? How long? At what interest rate? If you’re buying a house: It’s a $220,000 loan For 30 years At 7% per year Three factors to consider 28
  • 29. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Technique #1 Net PresentValue (NPV) 29
  • 30. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Which project would you prefer? Year Projeect A Projeect B Investment Return Investment Return 0 1 2 3 4 5 $1,000 $1,000 $200 $3,000 $300 $500 $500 $300 $3,000 $200 $0 $0 30
  • 31. Ā© Copyright Mountain Goat SoftwareĀ® Ā® A dollar today is worth more than a dollar a year from now The time-value of money I’ll gladly pay you on Tuesday for a hamburger today. 31
  • 32. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Calculating the value of future dollars To buy a $5 hamburger next Tuesday… To buy a $5 hamburger in a year, how much do I put in the bank today? I would put around $4.99 in the bank today $5.00 $5.00 1.10 $4.54== Assumes 10% interest rate The present value of $5.00 a year from now 32
  • 33. Ā© 2009 Mountain Goat SoftwareĀ© Copyright Mountain Goat SoftwareĀ® Ā® Present value of one future amount FutureValuePresent Value = $5.00 = $4.54An example: Generalizing FV t PV = Simplifying -t 33
  • 34. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Measures the return on a theme or project as an amount of money Net present value (NPV) Ft -tNPV(i) = āˆ‘t=0 n 34
  • 35. Ā© Copyright Mountain Goat SoftwareĀ® Ā® NPV example Quarter Cash Flow -t Discounted Cash Flow Running Total 0 1 2 3 4 -200 1.000 -200 -200 -600 0.971 -583 -783 100 0.943 94 -689 300 0.915 275 -414 500 0.888 444 30 Assuming 12% annual discount rate (3% / quarter) 35
  • 36. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Discount rate sensitivity Quarter Cash Flow Discounted Cash Flow (3%) Discounted Cash Flow (6%) 0 1 2 3 4 Total –200 –200 –200 –600 –583 –783 100 94 –689 300 275 –414 500 444 30 100 30 –29 NPV is highly sensitive to the chosen discount rate Do the project under these circumstances But not under these 36
  • 37. Ā© 2009 Mountain Goat SoftwareĀ© Copyright Mountain Goat SoftwareĀ® Ā® Comparing NPVs Highest NPV brings the most present-value dollars to the company Theme NPV Scalability Gift registry Ad hoc reporting Pay by invoice $2,100 $1,253 $784 $385 Comparing NPVs can be misleading. What if: ā€¢ā€œPay by invoiceā€ requires a $5 investment ā€¢ā€œScalabilityā€ requires $50,000? 37
  • 38. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Technique #2 Internal Rate of Return (IRR) 38
  • 39. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Rather than expressing returns in dollars, we’d like to express return as a percentage Allows for direct comparisons NPV = how much money a project will return ROI = how quickly an investment will grow Return as a percentage 39
  • 40. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Internal rate of return (IRR) and ROI IRR = Internal Rate of Return Often called Return On Investment (ROI) The interest rate at which NPV is 0 0 = PV(i* ) = Ft 1+ i( ) āˆ’t t= 0 n āˆ‘ 40
  • 41. Ā© Copyright Mountain Goat SoftwareĀ® Ā® IRR gives us the discount rate at which we don’t care whether or not we do the project We don’t make $30; we don’t lose $29; we break even Remember this table? Quarter Cash Flow Discounted Cash Flow (3%) Discounted Cash Flow (6%) 0 1 2 3 4 Total –200 –200 –200 –600 –583 –783 100 94 –689 300 275 –414 500 444 30 100 30 –29 41
  • 42. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Use Excel’s irr function How to calculate ROI or IRR āˆ’200, āˆ’600, 100, 300, 500}) An investment day of the project remainder of project (4 quarters) 42
  • 43. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Advantages and disadvantages Advantages You don’t need to guess at a discount rate like with NPV Can be used to directly compare projects Disadvantages Calculation is hard to do by hand (but easy in Excel); may lead to numbers being distrusted Cannot use in all circumstances positive 43
  • 44. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Technique #3 Payback period 44
  • 45. Ā© 2009 Mountain Goat SoftwareĀ© Copyright Mountain Goat SoftwareĀ® Ā® Payback period The amount of time before an initial investment is paid back I loan you $5.You pay me back $1/week.The payback period is 5 weeks. Quarter Cash Flow Running Total 0 1 2 3 4 -200 -200 -200 -400 100 -300 300 0 500 500 Payback period is 3 quarters. 45
  • 46. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Advantages Calculation is very easy Longer payback period = greater risk Disadvantages Doesn’t consider the time-value of money Advantages and disadvantages 46
  • 47. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Discounted payback period Quarter Cash Flow -t i=3% Discounted Cash Flow Running Total 0 1 2 3 4 -200 1.000 -200 -200 -200 0.971 -194 -394 100 0.943 94 -300 300 0.915 275 -25 500 0.888 444 419 investment is paid back Discounted payback period = 4 quarters 47
  • 48. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Net PresentValue (NPV) Expresses return as an amount of money Return on Investment (ROI) / Internal Rate of Return The interest rate at which NPV = 0 That is, at which you’d be indifferent to the investment Expresses return as a percentage Discounted payback period Amount of time before discounted returns equal the investment Expresses return as an amount of time Financial analysis recap 48
  • 49. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Person Weeks Cost 3-Year Return NPV IRR D. Payback (Quarters) Feature A Feature B Feature C Feature D Feature E Feature F Feature G Feature H Feature I Feature J Feature K Feature L Feature M Feature N Feature O 25 $150 $1,085 $448 133% 2 32 192 $2,109 $940 172% 4 90 $540 $2,537 $883 89% 2 48 $288 $1,360 $443 76% 4 55 $330 $900 $191 48% 2 79 $474 $1,365 $331 56% 4 90 $540 $5,964 $2,519 139% 5 50 $300 $2,415 $1,023 146% 2 15 90 $1,600 $747 221% 1 30 $180 $640 $182 65% 2 75 $450 $516 ($104) 5% NA 40 $240 $171 ($110) (12%) NA 80 $480 $1,025 $142 36% 3 18 $108 $185 $7 24% 2 12 $72 $1,505 $748 355% 1 Comparison matrix 49
  • 50. Ā© Copyright Mountain Goat SoftwareĀ® Ā® Mike Cohn [email protected] www.mountaingoatsoftware.com twitter: mikewcohn (720) 890āˆ’6110 50