Scribd
Upload
25 views20 pages

Test Process Assessment: - An Orientation

Test Process Assessment (TPA) is a Test Process Framework based on Industry best Test Process Models like TMMi, TIM, TOM, TPI & T-Map (Sogeti) Results of Assessments are used for testing process improvements Scalable Delivery A Catalyst to the Test Central Transformation vision roadmap.

Uploaded by

Prema Sunderraman
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
25 views20 pages

Test Process Assessment: - An Orientation

Test Process Assessment (TPA) is a Test Process Framework based on Industry best Test Process Models like TMMi, TIM, TOM, TPI & T-Map (Sogeti) Results of Assessments are used for testing process improvements Scalable Delivery A Catalyst to the Test Central Transformation vision roadmap.

Uploaded by

Prema Sunderraman
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 20

Test Process

Assessment
An
Orientation

Jagan Mishra
TCEQ, FEL, STSD

2006 Hewlett-Packard Development Company, L.P.


The information contained herein is subject to change without notice

HP Confidentia

TPA Overview & Objectives


What is TPA?
Is a Test Process Framework based
on Industry best Test Process
Models like TMMi, TIM, TOM, TPI &
T-Map (Sogeti)

Stakeholder Expectations and


Value Proposition

Multi-OS
Capability
H/W
Interoperabil
ity

HPUX

C
T

Testing
Services

F
T

Results of Assessments are used


for testing process improvements

Scalable
Delivery

Proces
s

A Catalyst to the TCT Vision


Roadmap

March 2

People

OVMS

Merchant
OS

NSK

H/W Interoperability
(server, storage, switch)

Designed to facilitate periodic


cycle of Test Process Assessment
to maximize Testing process
business values

Stands as the foundation of Test


Central Transformation (TCT)

TCT Intent

U
T

S
T

Modular Testing Services

Methodolo
gy

R
T

Tools

World-class Test Engineering


Competencies

Objectives of TPA:

Diagnose testing process weaknesses

Quantified evaluation of test process using metrics

Assess test competency gaps & training needs

Identify chronic symptoms causing bottlenecks

Identify Action plans for Test Process Improvement

TPA Framework
12 KPAs~115 Practices

Compliance

Non-compliance due
to:
Week Practices

Why ?? :

Missing Practices

Knowledge Gap

NVA Practices

Execution Gap

Known Issues

What
Intervention ?? :
Training

Consistency/Rig
or
Process ReTPA R
esult
Engg.
s Ana
lysis
ends Quality
TPA Results are analyzed and TPA findings with
here
TPI Template
Assurance
recommended interventions are shared with the
project team
team then
3 Project
March
2 comes up with Actionable items for

(for Action planning)

Action Plan :

TPA Structure

March 2

#
Practices

KPA
Rating

11

25

27

35

33

30

25

14

55

25

15

19

75

30

14

50

115

425

TPA Approach

Behavior
changes for
varying x.

. }
PROCESS

Gaps Visible

x3, .

Engg.
Practices
being
followed

Systemic
Issues
affecting the
practice rigor

Skills at which
practices are
exercised

TPA step - 1

TPA step - 2

TPA step - 3

Practice
Evaluation

Symptom
Study

Skill
Assessmen
t

Ext.
Issues

Skill &
Competency
Gaps

Questionnaire:
Int.
Issues

x2 ,

Birds Eye
View

Ext.
Issues

x1,

March 2

115 Key practices

425 KPA scores


- % Not complied
- % Partially

Questionnaire:

Skill Data:

60 questions

Rating by skill
category

20 symptoms
7 major issues
- Contribute !!!
- Influence !!!

Key competency gap

TPA Results

from Practice Evaluation (1)

L4 Compliance
80% ??

/
L3 Compliance
70% ??
L2 Compliance
70% ??

/
6

March 2

L5 Compliance
80% ??

(---)% Gap in
Goals Aspired

TPA Results

from Practice Evaluation (2)


Less focus on
Product Quality
Management,
Test
Measurement
and Defect
Prevention

More focus on
Planning and
Execution

Observations:
Focus on Execution is necessary to be Cost-Effective, this
justifies the projects L3 test maturity, whereas equal focus
on product and quality can bring more TCE, where there is
7
Marchshift.
2
an adherence

TPA Results

Major Systemic Issues

from Symptom Study

Influenced by other
Issues

Contributes to other Issues

Lack of Testing & Quality


Ownership

Poor Quality of Testing

Lack of control on product quality & release


readiness

Poor Quality of Testing

Quality of Developer Test &


Build
Test Competency & Training

Test collaboration with partner/user


Control over Product Quality and Release
Readiness

Schedule and Effort Variances

Lack of control in Planning &


Budgeting

March 2

Milestone Slippage
Poor Quality of Testing

TPA Results
2

from Skill Assessment (1)


2

3
1

Contributes to
Testing &
Quality
Ownership

Contributes to
Poor Quality of
Testing

Lack of Control
in Test Planning
& Budgeting

Competency Gaps
found in key areas:
Test design
Test methods &
techniques
Programming
Test execution
Test management
Test domain
knowledge

March 2

TPA Results

from Skill Assessment (2)

Competency training
and development more
to focus at T2-T4 level
Major competency gap
w.r.t minimum
expectations at T2-T4
level
Training to focus more
on programming, test
design, test methods &
techniques

March 2

TPA Results

from Skill Assessment (3)

Competency Gap is
very high for
Specialists and Experts
positions

March 2

Interventions needed
Improvement Areas

March 2

Action Items Identified

TPI Action Plan


- <Project Name>
Ref.: TPA
Assessment
21-Jan-09

2006 Hewlett-Packard Development Company, L.P.


The information contained herein is subject to change without notice

HP Confidentia

Test Process Improvement


Plan
Project Group: XYZ
GUIDELINES:
Select Improvement areas based on priority
(project/partner/business)
Set Goals and Timeline for each Improvements
Identify potential action items for each Improvement based on
RCA (root cause analysis) done using a Cause-and-Effect diagram
Use SIPOC model for process re-structuring, if any
Use other Lean templates as needed (provided as back-up slide)
Review implementation progress at periodic intervals as defined

March 2

TPI Roadmap
Category

Problem Statement /
Improvement
Description

Process

People

Tools &
Technolog
y

March 2

Current
Performan
ce

Q2-09

Goal

Feb

Mar

Apr

Q3-09
May

Jun

Q4-09
Jul

Aug

Sep

Oct

Analyzing Root Causes

NB: Double-click to update the excel object. Repeat the slide as needed.

March 2

SIPOC Process Map System view


Suppliers

Inputs

Process

Customers

The product or

Who receives

Who provides the

What is required

inputs?

to execute the

service from the

the product or

process?

process

service?

Name of
process

STAR
T
Step 1:

See Below

Outputs

Step 2:

Step 3:

Step 4:

NB: Repeat the slide for each process, as needed.

March 2

STOP
Step 5:

Step 6:

Step 7:

TPI Action Plan Status


#

Action Items

4
5

March 2

Actions Taken

Status

Progress Achieved

Remarks

Improvement Tree Diagram


Measures

Improvement:

Goal

Before

After

Measure 1

Measure 2

Objective(s):

Measure 3

NB: This slide can be used to track the Results of each improvement. Repeat the slide as needed.

March 2

Thank
You

You might also like