SlideShare a Scribd company logo
Turn by Turn: A Practical Guide to Test Management
NICO KRÜGER, CTO, HELIX ALM — PERFORCE SOFTWARE
2 | A Practical Guide to Test Management in Helix ALM perforce.com
Presenter
Nico Krüger
Chief Technical Officer, Helix ALM
Perforce Software
3 | A Practical Guide to Test Management in Helix ALM perforce.com
What We’ll Cover
1
2
3
What shift left and shift right testing cover.
How to track testing progress, handle bugs, and manage re-testing efforts.
Why Helix ALM is the best way to ensure complete test coverage.
4 | A Practical Guide to Test Management in Helix ALM perforce.com
What Shift Left and Shift Right Testing Cover
Shift Left Shift Right
of New Code of Every Build of Every Deployment In Production
5 | A Practical Guide to Test Management in Helix ALM perforce.com
Why Shift Left?
• Deliver more software at a faster
rate.
• Shift left: start testing earlier in the
process.
• Focus on problem prevention.
AttentiontoQuality
Plan and
Design
Develop
and Build
Test Deploy and
Release
Monitor
and Analyze
Shift Left
Model Traditional
Quality
Model
6 | A Practical Guide to Test Management in Helix ALM perforce.com
Why Shift Right?
• Building quality in itself is not enough in today’s
competitive market.
• Using continuous feedback from users is equally
important in the testing process.
• Ensuring that what was created works in
practice for real users — not just matches the
design or user needs.
7 | A Practical Guide to Test Management in Helix ALM perforce.com
Benefits of Shifting Left and Shifting Right
• Find bugs earlier.
• Save time later on.
• Improve test coverage and quality.
• Foster teamwork between
developers and testers.
• Improve software delivery cycles.
• Reduce costs over time.
• Reduce technical debt.
Illustration from “Continuous testing in DevOps” (Dan Ashby)
8 | A Practical Guide to Test Management in Helix ALM perforce.com
Things to Think About
Change
How do you handle design changes
based on customer feedback?
Visibility
Can you capture all these testing results
effectively? And prioritize and act on
them?
Risk
How can this help you reduce risk and lower
time to market?
A Practical Guide to Test Management with Helix ALM
Track testing progress, handle bugs, and manage re-testing efforts
10 | A Practical Guide to Test Management in Helix ALM perforce.com
Common Test Activities For Each Release
Risk analysis
Effort estimates
Test strategy
Project plan
Requirements review
Test design
Test data creation
Test automation
Automated testing
Manual test execution
Performance testing
Test results
Defect reports
Metrics analysis
Actuals vs. planned
Planning Preparation Execution Outcome
11 | A Practical Guide to Test Management in Helix ALM perforce.com
Planning Activities
• What are we building?
• High risk items
• Release and sprint breakdown
• Test plan and strategy
Requirement / user story
Test cases, test suites, estimations
Commit work to sprint / release
Classification, risk score
12 | A Practical Guide to Test Management in Helix ALM perforce.com
1. What Are We Building?
• Requirement / user story in Helix ALM:
13 | A Practical Guide to Test Management in Helix ALM perforce.com
2. High Risk Items
• Classification and risk score in Helix ALM:
14 | A Practical Guide to Test Management in Helix ALM perforce.com
3. Release and Sprint Breakdown
• Commit work to sprint / release in Helix ALM:
15 | A Practical Guide to Test Management in Helix ALM perforce.com
4. Test Plan and Strategy
• Test cases and test suites in Helix ALM:
16 | A Practical Guide to Test Management in Helix ALM perforce.com
Preparation Activities
• Requirements reviewed
• Test coverage
• Test design
• Manual vs. automated
Review process, approvals
Traceability
Test cases
Manual vs. automated inputs
17 | A Practical Guide to Test Management in Helix ALM perforce.com
1. Requirements Reviewed
• Review process and approvals in Helix ALM:
18 | A Practical Guide to Test Management in Helix ALM perforce.com
2. Test Coverage
• Traceability in Helix ALM:
19 | A Practical Guide to Test Management in Helix ALM perforce.com
3. Test Design
• Manual test cases in Helix ALM:
20 | A Practical Guide to Test Management in Helix ALM perforce.com
4. Manual vs. Automated
• Capture results in Helix ALM:
REST API
< />
Helix ALM
Server
Define and manage test
cases in Helix ALM.
Use {ANY} test automation
framework to create and
execute tests in.
1. Create automation scripts.
2. Create test case in Helix
ALM for each automated
test.
3. Use Helix ALM’s REST API
to generate test runs and
record test results.
Endpoint:
…/helix-
alm/api/v0/testruns/generate/
POST:
{
testCaseIDs : [50,89],
events : []
}
21 | A Practical Guide to Test Management in Helix ALM perforce.com
Execution Activities
• Execution
• Results
Pass, fail actions
Track results
22 | A Practical Guide to Test Management in Helix ALM perforce.com
1. Execution
• Pass or fail actions in Helix ALM:
23 | A Practical Guide to Test Management in Helix ALM perforce.com
2. Execution
• Track results in Helix ALM:
24 | A Practical Guide to Test Management in Helix ALM perforce.com
Outcome Activities
• Production monitoring and feedback
• How to track and manage results and
feedback
• Incorporate into future testing
Capture feedback
Capture feedback
Improve test coverage
25 | A Practical Guide to Test Management in Helix ALM perforce.com
• Capture feedback in Helix ALM:
1. Production Monitoring and Feedback
26 | A Practical Guide to Test Management in Helix ALM perforce.com
2. How to Track and Manage Results and Feedback
• Capture feedback in Helix ALM:
SoloSubmit
REST API
Web or Desktop Client
27 | A Practical Guide to Test Management in Helix ALM perforce.com
3. Incorporate into Future Testing
• Improve test coverage in Helix ALM:
The Results
End-to-end traceability
Higher quality
Faster time to deployment
Q & A
Ad

More Related Content

What's hot (20)

Test automation - What? Why? How?
Test automation - What? Why? How?Test automation - What? Why? How?
Test automation - What? Why? How?
Anand Bagmar
 
Agile Test Automation: Truth, Oxymoron or Lie?
Agile Test Automation: Truth, Oxymoron or Lie?Agile Test Automation: Truth, Oxymoron or Lie?
Agile Test Automation: Truth, Oxymoron or Lie?
Original Software
 
Neotys PAC 2018 - Helen Bally
Neotys PAC 2018 - Helen BallyNeotys PAC 2018 - Helen Bally
Neotys PAC 2018 - Helen Bally
Neotys_Partner
 
How to organize qa process in agile speed
How to organize qa process in agile speedHow to organize qa process in agile speed
How to organize qa process in agile speed
Svitlana Dubyk
 
Optimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile WorldOptimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile World
Original Software
 
Building a Test Automation Strategy for Success
Building a Test Automation Strategy for SuccessBuilding a Test Automation Strategy for Success
Building a Test Automation Strategy for Success
Lee Barnes
 
Agile performance testing
Agile performance testingAgile performance testing
Agile performance testing
Andriy Melnyk
 
QA Process Overview for Firefox OS 2014
QA Process Overview for Firefox OS 2014QA Process Overview for Firefox OS 2014
QA Process Overview for Firefox OS 2014
Anthony Chung
 
Shorten Business Life Cycle Using DevOps
Shorten Business Life Cycle Using DevOpsShorten Business Life Cycle Using DevOps
Shorten Business Life Cycle Using DevOps
Perfecto Mobile
 
Test Automation is for Everyone
Test Automation is for EveryoneTest Automation is for Everyone
Test Automation is for Everyone
Worksoft
 
Agile KPIs
Agile KPIsAgile KPIs
Agile KPIs
Gaetano Mazzanti
 
Deliver Fast, Break Nothing Via Effective Building Developer and Tester Colla...
Deliver Fast, Break Nothing Via Effective Building Developer and Tester Colla...Deliver Fast, Break Nothing Via Effective Building Developer and Tester Colla...
Deliver Fast, Break Nothing Via Effective Building Developer and Tester Colla...
Ho Chi Minh City Software Testing Club
 
Shift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality AssuranceShift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality Assurance
Zbyszek Mockun
 
Small is Beautiful- Fully Automate your Test Case Design
Small is Beautiful- Fully Automate your Test Case DesignSmall is Beautiful- Fully Automate your Test Case Design
Small is Beautiful- Fully Automate your Test Case Design
Georgina Tilby
 
Addressing Performance Testing Challenges in Agile- Impetus Webinar
Addressing Performance Testing Challenges in Agile- Impetus WebinarAddressing Performance Testing Challenges in Agile- Impetus Webinar
Addressing Performance Testing Challenges in Agile- Impetus Webinar
Impetus Technologies
 
Agile Aspects of Performance Testing
Agile Aspects of Performance TestingAgile Aspects of Performance Testing
Agile Aspects of Performance Testing
Alexander Podelko
 
Continuous Testing of Cloud Applications
Continuous Testing of Cloud ApplicationsContinuous Testing of Cloud Applications
Continuous Testing of Cloud Applications
TechWell
 
MESUT DURUKAL «4 Pillars of Successful Agile Test Automation» Online QADay 2021
MESUT DURUKAL «4 Pillars of Successful Agile Test Automation» Online QADay 2021MESUT DURUKAL «4 Pillars of Successful Agile Test Automation» Online QADay 2021
MESUT DURUKAL «4 Pillars of Successful Agile Test Automation» Online QADay 2021
QADay
 
Managing software projects with Team Foundation Server 2013 in Agile Scrum
Managing software projects with Team Foundation Server 2013 in Agile ScrumManaging software projects with Team Foundation Server 2013 in Agile Scrum
Managing software projects with Team Foundation Server 2013 in Agile Scrum
Hossein Sarshar
 
An Agile Testing Dashboard: Metrics that Matter
An Agile Testing Dashboard: Metrics that MatterAn Agile Testing Dashboard: Metrics that Matter
An Agile Testing Dashboard: Metrics that Matter
TechWell
 
Test automation - What? Why? How?
Test automation - What? Why? How?Test automation - What? Why? How?
Test automation - What? Why? How?
Anand Bagmar
 
Agile Test Automation: Truth, Oxymoron or Lie?
Agile Test Automation: Truth, Oxymoron or Lie?Agile Test Automation: Truth, Oxymoron or Lie?
Agile Test Automation: Truth, Oxymoron or Lie?
Original Software
 
Neotys PAC 2018 - Helen Bally
Neotys PAC 2018 - Helen BallyNeotys PAC 2018 - Helen Bally
Neotys PAC 2018 - Helen Bally
Neotys_Partner
 
How to organize qa process in agile speed
How to organize qa process in agile speedHow to organize qa process in agile speed
How to organize qa process in agile speed
Svitlana Dubyk
 
Optimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile WorldOptimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile World
Original Software
 
Building a Test Automation Strategy for Success
Building a Test Automation Strategy for SuccessBuilding a Test Automation Strategy for Success
Building a Test Automation Strategy for Success
Lee Barnes
 
Agile performance testing
Agile performance testingAgile performance testing
Agile performance testing
Andriy Melnyk
 
QA Process Overview for Firefox OS 2014
QA Process Overview for Firefox OS 2014QA Process Overview for Firefox OS 2014
QA Process Overview for Firefox OS 2014
Anthony Chung
 
Shorten Business Life Cycle Using DevOps
Shorten Business Life Cycle Using DevOpsShorten Business Life Cycle Using DevOps
Shorten Business Life Cycle Using DevOps
Perfecto Mobile
 
Test Automation is for Everyone
Test Automation is for EveryoneTest Automation is for Everyone
Test Automation is for Everyone
Worksoft
 
Deliver Fast, Break Nothing Via Effective Building Developer and Tester Colla...
Deliver Fast, Break Nothing Via Effective Building Developer and Tester Colla...Deliver Fast, Break Nothing Via Effective Building Developer and Tester Colla...
Deliver Fast, Break Nothing Via Effective Building Developer and Tester Colla...
Ho Chi Minh City Software Testing Club
 
Shift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality AssuranceShift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality Assurance
Zbyszek Mockun
 
Small is Beautiful- Fully Automate your Test Case Design
Small is Beautiful- Fully Automate your Test Case DesignSmall is Beautiful- Fully Automate your Test Case Design
Small is Beautiful- Fully Automate your Test Case Design
Georgina Tilby
 
Addressing Performance Testing Challenges in Agile- Impetus Webinar
Addressing Performance Testing Challenges in Agile- Impetus WebinarAddressing Performance Testing Challenges in Agile- Impetus Webinar
Addressing Performance Testing Challenges in Agile- Impetus Webinar
Impetus Technologies
 
Agile Aspects of Performance Testing
Agile Aspects of Performance TestingAgile Aspects of Performance Testing
Agile Aspects of Performance Testing
Alexander Podelko
 
Continuous Testing of Cloud Applications
Continuous Testing of Cloud ApplicationsContinuous Testing of Cloud Applications
Continuous Testing of Cloud Applications
TechWell
 
MESUT DURUKAL «4 Pillars of Successful Agile Test Automation» Online QADay 2021
MESUT DURUKAL «4 Pillars of Successful Agile Test Automation» Online QADay 2021MESUT DURUKAL «4 Pillars of Successful Agile Test Automation» Online QADay 2021
MESUT DURUKAL «4 Pillars of Successful Agile Test Automation» Online QADay 2021
QADay
 
Managing software projects with Team Foundation Server 2013 in Agile Scrum
Managing software projects with Team Foundation Server 2013 in Agile ScrumManaging software projects with Team Foundation Server 2013 in Agile Scrum
Managing software projects with Team Foundation Server 2013 in Agile Scrum
Hossein Sarshar
 
An Agile Testing Dashboard: Metrics that Matter
An Agile Testing Dashboard: Metrics that MatterAn Agile Testing Dashboard: Metrics that Matter
An Agile Testing Dashboard: Metrics that Matter
TechWell
 

Similar to Turn by Turn: A Practical Guide To Test Management (20)

Quality Not Compromise; Best Practices for Automated Testing
Quality Not Compromise; Best Practices for Automated TestingQuality Not Compromise; Best Practices for Automated Testing
Quality Not Compromise; Best Practices for Automated Testing
Rachel Maxwell
 
Testing in Agile Development
Testing in Agile DevelopmentTesting in Agile Development
Testing in Agile Development
Hariprakash Agrawal
 
7 steps to Software test automation success
7 steps to Software test automation success7 steps to Software test automation success
7 steps to Software test automation success
ngowda gowda (Looking For New job in Bangalore
 
Testing Essentials for the Age of Agile
Testing Essentials for the Age of AgileTesting Essentials for the Age of Agile
Testing Essentials for the Age of Agile
Applause
 
AgileTesting_Ver1.0
AgileTesting_Ver1.0AgileTesting_Ver1.0
AgileTesting_Ver1.0
Subramanya Mudukutore
 
RPALM for SAP S/4 Journey
RPALM for SAP S/4 JourneyRPALM for SAP S/4 Journey
RPALM for SAP S/4 Journey
Matt Angerer
 
Software Testing Process, Testing Automation and Software Testing Trends
Software Testing Process, Testing Automation and Software Testing TrendsSoftware Testing Process, Testing Automation and Software Testing Trends
Software Testing Process, Testing Automation and Software Testing Trends
KMS Technology
 
Linking Testing Requirements to Test Cases to Save Time
Linking Testing Requirements to Test Cases to Save TimeLinking Testing Requirements to Test Cases to Save Time
Linking Testing Requirements to Test Cases to Save Time
Perforce
 
Linking Requirements to Test Cases to Save Time & Frustration
Linking Requirements to Test Cases to Save Time & Frustration Linking Requirements to Test Cases to Save Time & Frustration
Linking Requirements to Test Cases to Save Time & Frustration
Perforce
 
Shift Left Quality Assurance: How to do it. Why it matters.
Shift Left Quality Assurance: How to do it. Why it matters.Shift Left Quality Assurance: How to do it. Why it matters.
Shift Left Quality Assurance: How to do it. Why it matters.
Worksoft
 
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
Emerasoft, solutions to collaborate
 
Continuous testing in agile projects 2015
Continuous testing in agile projects 2015Continuous testing in agile projects 2015
Continuous testing in agile projects 2015
Fabricio Epaminondas
 
qLabs Test Automation
qLabs Test AutomationqLabs Test Automation
qLabs Test Automation
qLabs
 
Agile Model & Methodology
Agile Model & MethodologyAgile Model & Methodology
Agile Model & Methodology
yasirkhan_77
 
ALM-PLM Integration with Business Process Management
ALM-PLM Integration with Business Process ManagementALM-PLM Integration with Business Process Management
ALM-PLM Integration with Business Process Management
Intland Software GmbH
 
ALM-PLM Integration with BPM
ALM-PLM Integration with BPMALM-PLM Integration with BPM
ALM-PLM Integration with BPM
Intland Software GmbH
 
Does dev ops need continuous testing devops days des moines 2018 v1
Does dev ops need continuous testing devops days des moines 2018 v1Does dev ops need continuous testing devops days des moines 2018 v1
Does dev ops need continuous testing devops days des moines 2018 v1
GerieOwen
 
Software Testing Process & Trend
Software Testing Process & TrendSoftware Testing Process & Trend
Software Testing Process & Trend
KMS Technology
 
QA Role in Agile Teams
QA Role in Agile Teams QA Role in Agile Teams
QA Role in Agile Teams
Synerzip
 
Agile Methodology - Software Engineering
Agile Methodology - Software EngineeringAgile Methodology - Software Engineering
Agile Methodology - Software Engineering
Purvik Rana
 
Quality Not Compromise; Best Practices for Automated Testing
Quality Not Compromise; Best Practices for Automated TestingQuality Not Compromise; Best Practices for Automated Testing
Quality Not Compromise; Best Practices for Automated Testing
Rachel Maxwell
 
Testing Essentials for the Age of Agile
Testing Essentials for the Age of AgileTesting Essentials for the Age of Agile
Testing Essentials for the Age of Agile
Applause
 
RPALM for SAP S/4 Journey
RPALM for SAP S/4 JourneyRPALM for SAP S/4 Journey
RPALM for SAP S/4 Journey
Matt Angerer
 
Software Testing Process, Testing Automation and Software Testing Trends
Software Testing Process, Testing Automation and Software Testing TrendsSoftware Testing Process, Testing Automation and Software Testing Trends
Software Testing Process, Testing Automation and Software Testing Trends
KMS Technology
 
Linking Testing Requirements to Test Cases to Save Time
Linking Testing Requirements to Test Cases to Save TimeLinking Testing Requirements to Test Cases to Save Time
Linking Testing Requirements to Test Cases to Save Time
Perforce
 
Linking Requirements to Test Cases to Save Time & Frustration
Linking Requirements to Test Cases to Save Time & Frustration Linking Requirements to Test Cases to Save Time & Frustration
Linking Requirements to Test Cases to Save Time & Frustration
Perforce
 
Shift Left Quality Assurance: How to do it. Why it matters.
Shift Left Quality Assurance: How to do it. Why it matters.Shift Left Quality Assurance: How to do it. Why it matters.
Shift Left Quality Assurance: How to do it. Why it matters.
Worksoft
 
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
Emerasoft, solutions to collaborate
 
Continuous testing in agile projects 2015
Continuous testing in agile projects 2015Continuous testing in agile projects 2015
Continuous testing in agile projects 2015
Fabricio Epaminondas
 
qLabs Test Automation
qLabs Test AutomationqLabs Test Automation
qLabs Test Automation
qLabs
 
Agile Model & Methodology
Agile Model & MethodologyAgile Model & Methodology
Agile Model & Methodology
yasirkhan_77
 
ALM-PLM Integration with Business Process Management
ALM-PLM Integration with Business Process ManagementALM-PLM Integration with Business Process Management
ALM-PLM Integration with Business Process Management
Intland Software GmbH
 
Does dev ops need continuous testing devops days des moines 2018 v1
Does dev ops need continuous testing devops days des moines 2018 v1Does dev ops need continuous testing devops days des moines 2018 v1
Does dev ops need continuous testing devops days des moines 2018 v1
GerieOwen
 
Software Testing Process & Trend
Software Testing Process & TrendSoftware Testing Process & Trend
Software Testing Process & Trend
KMS Technology
 
QA Role in Agile Teams
QA Role in Agile Teams QA Role in Agile Teams
QA Role in Agile Teams
Synerzip
 
Agile Methodology - Software Engineering
Agile Methodology - Software EngineeringAgile Methodology - Software Engineering
Agile Methodology - Software Engineering
Purvik Rana
 
Ad

More from Perforce (20)

How to Organize Game Developers With Different Planning Needs
How to Organize Game Developers With Different Planning NeedsHow to Organize Game Developers With Different Planning Needs
How to Organize Game Developers With Different Planning Needs
Perforce
 
Regulatory Traceability: How to Maintain Compliance, Quality, and Cost Effic...
Regulatory Traceability:  How to Maintain Compliance, Quality, and Cost Effic...Regulatory Traceability:  How to Maintain Compliance, Quality, and Cost Effic...
Regulatory Traceability: How to Maintain Compliance, Quality, and Cost Effic...
Perforce
 
Efficient Security Development and Testing Using Dynamic and Static Code Anal...
Efficient Security Development and Testing Using Dynamic and Static Code Anal...Efficient Security Development and Testing Using Dynamic and Static Code Anal...
Efficient Security Development and Testing Using Dynamic and Static Code Anal...
Perforce
 
Understanding Compliant Workflow Enforcement SOPs
Understanding Compliant Workflow Enforcement SOPsUnderstanding Compliant Workflow Enforcement SOPs
Understanding Compliant Workflow Enforcement SOPs
Perforce
 
Branching Out: How To Automate Your Development Process
Branching Out: How To Automate Your Development ProcessBranching Out: How To Automate Your Development Process
Branching Out: How To Automate Your Development Process
Perforce
 
How to Do Code Reviews at Massive Scale For DevOps
How to Do Code Reviews at Massive Scale For DevOpsHow to Do Code Reviews at Massive Scale For DevOps
How to Do Code Reviews at Massive Scale For DevOps
Perforce
 
How to Spark Joy In Your Product Backlog
How to Spark Joy In Your Product Backlog How to Spark Joy In Your Product Backlog
How to Spark Joy In Your Product Backlog
Perforce
 
Going Remote: Build Up Your Game Dev Team
Going Remote: Build Up Your Game Dev Team Going Remote: Build Up Your Game Dev Team
Going Remote: Build Up Your Game Dev Team
Perforce
 
Shift to Remote: How to Manage Your New Workflow
Shift to Remote: How to Manage Your New WorkflowShift to Remote: How to Manage Your New Workflow
Shift to Remote: How to Manage Your New Workflow
Perforce
 
Hybrid Development Methodology in a Regulated World
Hybrid Development Methodology in a Regulated WorldHybrid Development Methodology in a Regulated World
Hybrid Development Methodology in a Regulated World
Perforce
 
Better, Faster, Easier: How to Make Git Really Work in the Enterprise
Better, Faster, Easier: How to Make Git Really Work in the EnterpriseBetter, Faster, Easier: How to Make Git Really Work in the Enterprise
Better, Faster, Easier: How to Make Git Really Work in the Enterprise
Perforce
 
Easier Requirements Management Using Diagrams In Helix ALM
Easier Requirements Management Using Diagrams In Helix ALMEasier Requirements Management Using Diagrams In Helix ALM
Easier Requirements Management Using Diagrams In Helix ALM
Perforce
 
How To Master Your Mega Backlog
How To Master Your Mega Backlog How To Master Your Mega Backlog
How To Master Your Mega Backlog
Perforce
 
Achieving Software Safety, Security, and Reliability Part 3: What Does the Fu...
Achieving Software Safety, Security, and Reliability Part 3: What Does the Fu...Achieving Software Safety, Security, and Reliability Part 3: What Does the Fu...
Achieving Software Safety, Security, and Reliability Part 3: What Does the Fu...
Perforce
 
How to Scale With Helix Core and Microsoft Azure
How to Scale With Helix Core and Microsoft Azure How to Scale With Helix Core and Microsoft Azure
How to Scale With Helix Core and Microsoft Azure
Perforce
 
Achieving Software Safety, Security, and Reliability Part 2
Achieving Software Safety, Security, and Reliability Part 2Achieving Software Safety, Security, and Reliability Part 2
Achieving Software Safety, Security, and Reliability Part 2
Perforce
 
Should You Break Up With Your Monolith?
Should You Break Up With Your Monolith?Should You Break Up With Your Monolith?
Should You Break Up With Your Monolith?
Perforce
 
Achieving Software Safety, Security, and Reliability Part 1: Common Industry ...
Achieving Software Safety, Security, and Reliability Part 1: Common Industry ...Achieving Software Safety, Security, and Reliability Part 1: Common Industry ...
Achieving Software Safety, Security, and Reliability Part 1: Common Industry ...
Perforce
 
What's New in Helix ALM 2019.4
What's New in Helix ALM 2019.4What's New in Helix ALM 2019.4
What's New in Helix ALM 2019.4
Perforce
 
Free Yourself From the MS Office Prison
Free Yourself From the MS Office Prison Free Yourself From the MS Office Prison
Free Yourself From the MS Office Prison
Perforce
 
How to Organize Game Developers With Different Planning Needs
How to Organize Game Developers With Different Planning NeedsHow to Organize Game Developers With Different Planning Needs
How to Organize Game Developers With Different Planning Needs
Perforce
 
Regulatory Traceability: How to Maintain Compliance, Quality, and Cost Effic...
Regulatory Traceability:  How to Maintain Compliance, Quality, and Cost Effic...Regulatory Traceability:  How to Maintain Compliance, Quality, and Cost Effic...
Regulatory Traceability: How to Maintain Compliance, Quality, and Cost Effic...
Perforce
 
Efficient Security Development and Testing Using Dynamic and Static Code Anal...
Efficient Security Development and Testing Using Dynamic and Static Code Anal...Efficient Security Development and Testing Using Dynamic and Static Code Anal...
Efficient Security Development and Testing Using Dynamic and Static Code Anal...
Perforce
 
Understanding Compliant Workflow Enforcement SOPs
Understanding Compliant Workflow Enforcement SOPsUnderstanding Compliant Workflow Enforcement SOPs
Understanding Compliant Workflow Enforcement SOPs
Perforce
 
Branching Out: How To Automate Your Development Process
Branching Out: How To Automate Your Development ProcessBranching Out: How To Automate Your Development Process
Branching Out: How To Automate Your Development Process
Perforce
 
How to Do Code Reviews at Massive Scale For DevOps
How to Do Code Reviews at Massive Scale For DevOpsHow to Do Code Reviews at Massive Scale For DevOps
How to Do Code Reviews at Massive Scale For DevOps
Perforce
 
How to Spark Joy In Your Product Backlog
How to Spark Joy In Your Product Backlog How to Spark Joy In Your Product Backlog
How to Spark Joy In Your Product Backlog
Perforce
 
Going Remote: Build Up Your Game Dev Team
Going Remote: Build Up Your Game Dev Team Going Remote: Build Up Your Game Dev Team
Going Remote: Build Up Your Game Dev Team
Perforce
 
Shift to Remote: How to Manage Your New Workflow
Shift to Remote: How to Manage Your New WorkflowShift to Remote: How to Manage Your New Workflow
Shift to Remote: How to Manage Your New Workflow
Perforce
 
Hybrid Development Methodology in a Regulated World
Hybrid Development Methodology in a Regulated WorldHybrid Development Methodology in a Regulated World
Hybrid Development Methodology in a Regulated World
Perforce
 
Better, Faster, Easier: How to Make Git Really Work in the Enterprise
Better, Faster, Easier: How to Make Git Really Work in the EnterpriseBetter, Faster, Easier: How to Make Git Really Work in the Enterprise
Better, Faster, Easier: How to Make Git Really Work in the Enterprise
Perforce
 
Easier Requirements Management Using Diagrams In Helix ALM
Easier Requirements Management Using Diagrams In Helix ALMEasier Requirements Management Using Diagrams In Helix ALM
Easier Requirements Management Using Diagrams In Helix ALM
Perforce
 
How To Master Your Mega Backlog
How To Master Your Mega Backlog How To Master Your Mega Backlog
How To Master Your Mega Backlog
Perforce
 
Achieving Software Safety, Security, and Reliability Part 3: What Does the Fu...
Achieving Software Safety, Security, and Reliability Part 3: What Does the Fu...Achieving Software Safety, Security, and Reliability Part 3: What Does the Fu...
Achieving Software Safety, Security, and Reliability Part 3: What Does the Fu...
Perforce
 
How to Scale With Helix Core and Microsoft Azure
How to Scale With Helix Core and Microsoft Azure How to Scale With Helix Core and Microsoft Azure
How to Scale With Helix Core and Microsoft Azure
Perforce
 
Achieving Software Safety, Security, and Reliability Part 2
Achieving Software Safety, Security, and Reliability Part 2Achieving Software Safety, Security, and Reliability Part 2
Achieving Software Safety, Security, and Reliability Part 2
Perforce
 
Should You Break Up With Your Monolith?
Should You Break Up With Your Monolith?Should You Break Up With Your Monolith?
Should You Break Up With Your Monolith?
Perforce
 
Achieving Software Safety, Security, and Reliability Part 1: Common Industry ...
Achieving Software Safety, Security, and Reliability Part 1: Common Industry ...Achieving Software Safety, Security, and Reliability Part 1: Common Industry ...
Achieving Software Safety, Security, and Reliability Part 1: Common Industry ...
Perforce
 
What's New in Helix ALM 2019.4
What's New in Helix ALM 2019.4What's New in Helix ALM 2019.4
What's New in Helix ALM 2019.4
Perforce
 
Free Yourself From the MS Office Prison
Free Yourself From the MS Office Prison Free Yourself From the MS Office Prison
Free Yourself From the MS Office Prison
Perforce
 
Ad

Recently uploaded (20)

Designing AI-Powered APIs on Azure: Best Practices& Considerations
Designing AI-Powered APIs on Azure: Best Practices& ConsiderationsDesigning AI-Powered APIs on Azure: Best Practices& Considerations
Designing AI-Powered APIs on Azure: Best Practices& Considerations
Dinusha Kumarasiri
 
Societal challenges of AI: biases, multilinguism and sustainability
Societal challenges of AI: biases, multilinguism and sustainabilitySocietal challenges of AI: biases, multilinguism and sustainability
Societal challenges of AI: biases, multilinguism and sustainability
Jordi Cabot
 
Why Orangescrum Is a Game Changer for Construction Companies in 2025
Why Orangescrum Is a Game Changer for Construction Companies in 2025Why Orangescrum Is a Game Changer for Construction Companies in 2025
Why Orangescrum Is a Game Changer for Construction Companies in 2025
Orangescrum
 
Solidworks Crack 2025 latest new + license code
Solidworks Crack 2025 latest new + license codeSolidworks Crack 2025 latest new + license code
Solidworks Crack 2025 latest new + license code
aneelaramzan63
 
How to Batch Export Lotus Notes NSF Emails to Outlook PST Easily?
How to Batch Export Lotus Notes NSF Emails to Outlook PST Easily?How to Batch Export Lotus Notes NSF Emails to Outlook PST Easily?
How to Batch Export Lotus Notes NSF Emails to Outlook PST Easily?
steaveroggers
 
Avast Premium Security Crack FREE Latest Version 2025
Avast Premium Security Crack FREE Latest Version 2025Avast Premium Security Crack FREE Latest Version 2025
Avast Premium Security Crack FREE Latest Version 2025
mu394968
 
Exploring Wayland: A Modern Display Server for the Future
Exploring Wayland: A Modern Display Server for the FutureExploring Wayland: A Modern Display Server for the Future
Exploring Wayland: A Modern Display Server for the Future
ICS
 
Douwan Crack 2025 new verson+ License code
Douwan Crack 2025 new verson+ License codeDouwan Crack 2025 new verson+ License code
Douwan Crack 2025 new verson+ License code
aneelaramzan63
 
Exploring Code Comprehension in Scientific Programming: Preliminary Insight...
Exploring Code Comprehension  in Scientific Programming:  Preliminary Insight...Exploring Code Comprehension  in Scientific Programming:  Preliminary Insight...
Exploring Code Comprehension in Scientific Programming: Preliminary Insight...
University of Hawai‘i at Mānoa
 
Download YouTube By Click 2025 Free Full Activated
Download YouTube By Click 2025 Free Full ActivatedDownload YouTube By Click 2025 Free Full Activated
Download YouTube By Click 2025 Free Full Activated
saniamalik72555
 
Top 10 Client Portal Software Solutions for 2025.docx
Top 10 Client Portal Software Solutions for 2025.docxTop 10 Client Portal Software Solutions for 2025.docx
Top 10 Client Portal Software Solutions for 2025.docx
Portli
 
How can one start with crypto wallet development.pptx
How can one start with crypto wallet development.pptxHow can one start with crypto wallet development.pptx
How can one start with crypto wallet development.pptx
laravinson24
 
Kubernetes_101_Zero_to_Platform_Engineer.pptx
Kubernetes_101_Zero_to_Platform_Engineer.pptxKubernetes_101_Zero_to_Platform_Engineer.pptx
Kubernetes_101_Zero_to_Platform_Engineer.pptx
CloudScouts
 
Secure Test Infrastructure: The Backbone of Trustworthy Software Development
Secure Test Infrastructure: The Backbone of Trustworthy Software DevelopmentSecure Test Infrastructure: The Backbone of Trustworthy Software Development
Secure Test Infrastructure: The Backbone of Trustworthy Software Development
Shubham Joshi
 
Meet the Agents: How AI Is Learning to Think, Plan, and Collaborate
Meet the Agents: How AI Is Learning to Think, Plan, and CollaborateMeet the Agents: How AI Is Learning to Think, Plan, and Collaborate
Meet the Agents: How AI Is Learning to Think, Plan, and Collaborate
Maxim Salnikov
 
Explaining GitHub Actions Failures with Large Language Models Challenges, In...
Explaining GitHub Actions Failures with Large Language Models Challenges, In...Explaining GitHub Actions Failures with Large Language Models Challenges, In...
Explaining GitHub Actions Failures with Large Language Models Challenges, In...
ssuserb14185
 
EASEUS Partition Master Crack + License Code
EASEUS Partition Master Crack + License CodeEASEUS Partition Master Crack + License Code
EASEUS Partition Master Crack + License Code
aneelaramzan63
 
Mastering Fluent Bit: Ultimate Guide to Integrating Telemetry Pipelines with ...
Mastering Fluent Bit: Ultimate Guide to Integrating Telemetry Pipelines with ...Mastering Fluent Bit: Ultimate Guide to Integrating Telemetry Pipelines with ...
Mastering Fluent Bit: Ultimate Guide to Integrating Telemetry Pipelines with ...
Eric D. Schabell
 
TestMigrationsInPy: A Dataset of Test Migrations from Unittest to Pytest (MSR...
TestMigrationsInPy: A Dataset of Test Migrations from Unittest to Pytest (MSR...TestMigrationsInPy: A Dataset of Test Migrations from Unittest to Pytest (MSR...
TestMigrationsInPy: A Dataset of Test Migrations from Unittest to Pytest (MSR...
Andre Hora
 
What Do Contribution Guidelines Say About Software Testing? (MSR 2025)
What Do Contribution Guidelines Say About Software Testing? (MSR 2025)What Do Contribution Guidelines Say About Software Testing? (MSR 2025)
What Do Contribution Guidelines Say About Software Testing? (MSR 2025)
Andre Hora
 
Designing AI-Powered APIs on Azure: Best Practices& Considerations
Designing AI-Powered APIs on Azure: Best Practices& ConsiderationsDesigning AI-Powered APIs on Azure: Best Practices& Considerations
Designing AI-Powered APIs on Azure: Best Practices& Considerations
Dinusha Kumarasiri
 
Societal challenges of AI: biases, multilinguism and sustainability
Societal challenges of AI: biases, multilinguism and sustainabilitySocietal challenges of AI: biases, multilinguism and sustainability
Societal challenges of AI: biases, multilinguism and sustainability
Jordi Cabot
 
Why Orangescrum Is a Game Changer for Construction Companies in 2025
Why Orangescrum Is a Game Changer for Construction Companies in 2025Why Orangescrum Is a Game Changer for Construction Companies in 2025
Why Orangescrum Is a Game Changer for Construction Companies in 2025
Orangescrum
 
Solidworks Crack 2025 latest new + license code
Solidworks Crack 2025 latest new + license codeSolidworks Crack 2025 latest new + license code
Solidworks Crack 2025 latest new + license code
aneelaramzan63
 
How to Batch Export Lotus Notes NSF Emails to Outlook PST Easily?
How to Batch Export Lotus Notes NSF Emails to Outlook PST Easily?How to Batch Export Lotus Notes NSF Emails to Outlook PST Easily?
How to Batch Export Lotus Notes NSF Emails to Outlook PST Easily?
steaveroggers
 
Avast Premium Security Crack FREE Latest Version 2025
Avast Premium Security Crack FREE Latest Version 2025Avast Premium Security Crack FREE Latest Version 2025
Avast Premium Security Crack FREE Latest Version 2025
mu394968
 
Exploring Wayland: A Modern Display Server for the Future
Exploring Wayland: A Modern Display Server for the FutureExploring Wayland: A Modern Display Server for the Future
Exploring Wayland: A Modern Display Server for the Future
ICS
 
Douwan Crack 2025 new verson+ License code
Douwan Crack 2025 new verson+ License codeDouwan Crack 2025 new verson+ License code
Douwan Crack 2025 new verson+ License code
aneelaramzan63
 
Exploring Code Comprehension in Scientific Programming: Preliminary Insight...
Exploring Code Comprehension  in Scientific Programming:  Preliminary Insight...Exploring Code Comprehension  in Scientific Programming:  Preliminary Insight...
Exploring Code Comprehension in Scientific Programming: Preliminary Insight...
University of Hawai‘i at Mānoa
 
Download YouTube By Click 2025 Free Full Activated
Download YouTube By Click 2025 Free Full ActivatedDownload YouTube By Click 2025 Free Full Activated
Download YouTube By Click 2025 Free Full Activated
saniamalik72555
 
Top 10 Client Portal Software Solutions for 2025.docx
Top 10 Client Portal Software Solutions for 2025.docxTop 10 Client Portal Software Solutions for 2025.docx
Top 10 Client Portal Software Solutions for 2025.docx
Portli
 
How can one start with crypto wallet development.pptx
How can one start with crypto wallet development.pptxHow can one start with crypto wallet development.pptx
How can one start with crypto wallet development.pptx
laravinson24
 
Kubernetes_101_Zero_to_Platform_Engineer.pptx
Kubernetes_101_Zero_to_Platform_Engineer.pptxKubernetes_101_Zero_to_Platform_Engineer.pptx
Kubernetes_101_Zero_to_Platform_Engineer.pptx
CloudScouts
 
Secure Test Infrastructure: The Backbone of Trustworthy Software Development
Secure Test Infrastructure: The Backbone of Trustworthy Software DevelopmentSecure Test Infrastructure: The Backbone of Trustworthy Software Development
Secure Test Infrastructure: The Backbone of Trustworthy Software Development
Shubham Joshi
 
Meet the Agents: How AI Is Learning to Think, Plan, and Collaborate
Meet the Agents: How AI Is Learning to Think, Plan, and CollaborateMeet the Agents: How AI Is Learning to Think, Plan, and Collaborate
Meet the Agents: How AI Is Learning to Think, Plan, and Collaborate
Maxim Salnikov
 
Explaining GitHub Actions Failures with Large Language Models Challenges, In...
Explaining GitHub Actions Failures with Large Language Models Challenges, In...Explaining GitHub Actions Failures with Large Language Models Challenges, In...
Explaining GitHub Actions Failures with Large Language Models Challenges, In...
ssuserb14185
 
EASEUS Partition Master Crack + License Code
EASEUS Partition Master Crack + License CodeEASEUS Partition Master Crack + License Code
EASEUS Partition Master Crack + License Code
aneelaramzan63
 
Mastering Fluent Bit: Ultimate Guide to Integrating Telemetry Pipelines with ...
Mastering Fluent Bit: Ultimate Guide to Integrating Telemetry Pipelines with ...Mastering Fluent Bit: Ultimate Guide to Integrating Telemetry Pipelines with ...
Mastering Fluent Bit: Ultimate Guide to Integrating Telemetry Pipelines with ...
Eric D. Schabell
 
TestMigrationsInPy: A Dataset of Test Migrations from Unittest to Pytest (MSR...
TestMigrationsInPy: A Dataset of Test Migrations from Unittest to Pytest (MSR...TestMigrationsInPy: A Dataset of Test Migrations from Unittest to Pytest (MSR...
TestMigrationsInPy: A Dataset of Test Migrations from Unittest to Pytest (MSR...
Andre Hora
 
What Do Contribution Guidelines Say About Software Testing? (MSR 2025)
What Do Contribution Guidelines Say About Software Testing? (MSR 2025)What Do Contribution Guidelines Say About Software Testing? (MSR 2025)
What Do Contribution Guidelines Say About Software Testing? (MSR 2025)
Andre Hora
 

Turn by Turn: A Practical Guide To Test Management

  • 1. Turn by Turn: A Practical Guide to Test Management NICO KRÜGER, CTO, HELIX ALM — PERFORCE SOFTWARE
  • 2. 2 | A Practical Guide to Test Management in Helix ALM perforce.com Presenter Nico Krüger Chief Technical Officer, Helix ALM Perforce Software
  • 3. 3 | A Practical Guide to Test Management in Helix ALM perforce.com What We’ll Cover 1 2 3 What shift left and shift right testing cover. How to track testing progress, handle bugs, and manage re-testing efforts. Why Helix ALM is the best way to ensure complete test coverage.
  • 4. 4 | A Practical Guide to Test Management in Helix ALM perforce.com What Shift Left and Shift Right Testing Cover Shift Left Shift Right of New Code of Every Build of Every Deployment In Production
  • 5. 5 | A Practical Guide to Test Management in Helix ALM perforce.com Why Shift Left? • Deliver more software at a faster rate. • Shift left: start testing earlier in the process. • Focus on problem prevention. AttentiontoQuality Plan and Design Develop and Build Test Deploy and Release Monitor and Analyze Shift Left Model Traditional Quality Model
  • 6. 6 | A Practical Guide to Test Management in Helix ALM perforce.com Why Shift Right? • Building quality in itself is not enough in today’s competitive market. • Using continuous feedback from users is equally important in the testing process. • Ensuring that what was created works in practice for real users — not just matches the design or user needs.
  • 7. 7 | A Practical Guide to Test Management in Helix ALM perforce.com Benefits of Shifting Left and Shifting Right • Find bugs earlier. • Save time later on. • Improve test coverage and quality. • Foster teamwork between developers and testers. • Improve software delivery cycles. • Reduce costs over time. • Reduce technical debt. Illustration from “Continuous testing in DevOps” (Dan Ashby)
  • 8. 8 | A Practical Guide to Test Management in Helix ALM perforce.com Things to Think About Change How do you handle design changes based on customer feedback? Visibility Can you capture all these testing results effectively? And prioritize and act on them? Risk How can this help you reduce risk and lower time to market?
  • 9. A Practical Guide to Test Management with Helix ALM Track testing progress, handle bugs, and manage re-testing efforts
  • 10. 10 | A Practical Guide to Test Management in Helix ALM perforce.com Common Test Activities For Each Release Risk analysis Effort estimates Test strategy Project plan Requirements review Test design Test data creation Test automation Automated testing Manual test execution Performance testing Test results Defect reports Metrics analysis Actuals vs. planned Planning Preparation Execution Outcome
  • 11. 11 | A Practical Guide to Test Management in Helix ALM perforce.com Planning Activities • What are we building? • High risk items • Release and sprint breakdown • Test plan and strategy Requirement / user story Test cases, test suites, estimations Commit work to sprint / release Classification, risk score
  • 12. 12 | A Practical Guide to Test Management in Helix ALM perforce.com 1. What Are We Building? • Requirement / user story in Helix ALM:
  • 13. 13 | A Practical Guide to Test Management in Helix ALM perforce.com 2. High Risk Items • Classification and risk score in Helix ALM:
  • 14. 14 | A Practical Guide to Test Management in Helix ALM perforce.com 3. Release and Sprint Breakdown • Commit work to sprint / release in Helix ALM:
  • 15. 15 | A Practical Guide to Test Management in Helix ALM perforce.com 4. Test Plan and Strategy • Test cases and test suites in Helix ALM:
  • 16. 16 | A Practical Guide to Test Management in Helix ALM perforce.com Preparation Activities • Requirements reviewed • Test coverage • Test design • Manual vs. automated Review process, approvals Traceability Test cases Manual vs. automated inputs
  • 17. 17 | A Practical Guide to Test Management in Helix ALM perforce.com 1. Requirements Reviewed • Review process and approvals in Helix ALM:
  • 18. 18 | A Practical Guide to Test Management in Helix ALM perforce.com 2. Test Coverage • Traceability in Helix ALM:
  • 19. 19 | A Practical Guide to Test Management in Helix ALM perforce.com 3. Test Design • Manual test cases in Helix ALM:
  • 20. 20 | A Practical Guide to Test Management in Helix ALM perforce.com 4. Manual vs. Automated • Capture results in Helix ALM: REST API < /> Helix ALM Server Define and manage test cases in Helix ALM. Use {ANY} test automation framework to create and execute tests in. 1. Create automation scripts. 2. Create test case in Helix ALM for each automated test. 3. Use Helix ALM’s REST API to generate test runs and record test results. Endpoint: …/helix- alm/api/v0/testruns/generate/ POST: { testCaseIDs : [50,89], events : [] }
  • 21. 21 | A Practical Guide to Test Management in Helix ALM perforce.com Execution Activities • Execution • Results Pass, fail actions Track results
  • 22. 22 | A Practical Guide to Test Management in Helix ALM perforce.com 1. Execution • Pass or fail actions in Helix ALM:
  • 23. 23 | A Practical Guide to Test Management in Helix ALM perforce.com 2. Execution • Track results in Helix ALM:
  • 24. 24 | A Practical Guide to Test Management in Helix ALM perforce.com Outcome Activities • Production monitoring and feedback • How to track and manage results and feedback • Incorporate into future testing Capture feedback Capture feedback Improve test coverage
  • 25. 25 | A Practical Guide to Test Management in Helix ALM perforce.com • Capture feedback in Helix ALM: 1. Production Monitoring and Feedback
  • 26. 26 | A Practical Guide to Test Management in Helix ALM perforce.com 2. How to Track and Manage Results and Feedback • Capture feedback in Helix ALM: SoloSubmit REST API Web or Desktop Client
  • 27. 27 | A Practical Guide to Test Management in Helix ALM perforce.com 3. Incorporate into Future Testing • Improve test coverage in Helix ALM:
  • 28. The Results End-to-end traceability Higher quality Faster time to deployment
  • 29. Q & A