MODELING THE TESTING PROCESS

INPUT PROCESS OUTPUT Formal Testing

Requirements Software Design Risk Data Approved, Debugged, Eng. Tested Code Automated Test Tools
(1.0)
Test Doc. Review Results Problems Found in Testing

Tested Code Test Report Test Incidents System Limitations Updated Test Doc. Customer Problems Change Requests

Requirements, Design, and Code Issues

MODELING THE TESTING PROCESS

Program Plan Issues Requirements Risk Standards, Templates Requirements Issues Test Tool Data

Program Plans

Extract Test Information from Program Plans 1.1

Requirements, Design, and Code Issues

Test Design, Cases, Test Cases, Test SW, and Test Procedures1.3 Procedures, 1.4 Input Data Design, Reqts. Code Test Test Tools Engineering Issues Tools Test Doc. Problems Test Data Tested Source and Object Code Test Report Test Doc. Update Test Test Incidents Problems Updated System Limitations Documentation Test 1.5 Documentation

Requirements 1.2 from Pgm. Plans Resources Standards, Design, Code, and Staff Templates and Complexity Test Plan Data Requirements, Issues SW Design, Create Test Design, Code

Create Test Plan

Test Plan

Perform Formal Test

Test Documentation

MODELING THE TESTING PROCESS

INPUT PROCESS OUTPUT Extract Test Information from Program Plans 1.1
Program Plan Review Results

PMP, SDP, CMP, QAP, or other plans as appropriate Standards and Templates

Reviewed Program Plans Program Plan Issues Test Requirements from Program Plans Documentation Problems

Program Plan Issues

MODELING THE TESTING PROCESS

(Extract Test Information From Program Plans)
PMP Issues Testing Reqts. QAP QAP Issues

Program Management Plan Doc. Problems from Later Phases

Review Program Management Plan 1.1.1

Doc. Problems from Later Phases Standards and Templates SDP Issues

Review Quality Assurance Plan 1.1.2

Testing Reqts.

Standards and Templates

CMP Issues Test Engineering Review of PMP, CMP, QAP, and SDP

Review Config. Mgmt. Plan

CMP

1.1.4 Doc. Problems from Later Phases

Review Software Development Plan 1.1.3

Testing Reqts.

SDP Doc. Problems from Later Phases

Testing Reqts.

MODELING THE TESTING PROCESS (Review Program Management Plan)

PMP Issues Program Management Plan PMP Issues PMP Issues

Review Table of Contents of PMP 1.1.1.1

Review Org. Section of PMP 1.1.1.2

Review Life Cycle Section of PMP 1.1.1.3

Doc. Problems from Later Phases Standards and Templates

Format Testing and Testing Standards Reqts. and Templates Issues

Testing Standards Life Cycle and Templates Reqts.

PMP Review Results Test Engineering Review of PMP, Review Comments PMP Issues

Review Schedule Section of PMP

1.1.1.5 PMP Issues

Review Testing Section of PMP 1.1.1.4

Testing Reqts.

MODELING THE TESTING PROCESS (Review Quality Assurance Plan)

QAP Issues QAP Issues QAP Issues

QAP

Review Table of Contents of QAP 1.1.2.1

Format and Testing Issues

Review Stds. Section of QAP 1.1.2.2

Review Reviews Section of QAP 1.1.2.3

Doc. Problems from Later Phases Standards and Templates

Standards and Templates

Testing Reqts.

Testing Standards Reqts. and Templates

QAP Review Results TE Review of QAP, Review Comments QAP Issues

Review Incident-Reporting Section of QAP

Review CM Section of QAP

QAP Issues Testing Reqts.

1.1.2.5

1.1.2.4

MODELING THE TESTING PROCESS

(Review Software Development Plan)
SDP Issues Software Development Plan SDP Issues SDP Issues

Review Table of Contents of SDP 1.1.3.1

Format and Testing Issues

Review Life Cycle Section of SDP

1.1.3.2

Review Qual. Factors Section of SDP 1.1.3.3

Doc. Problems from Later Phases Standards and Templates

Standards and Templates

Testing Reqts.

Testing Standards Reqts. and Templates

TE Review of SDP, Review Comments SDP Issues

SDP Review Results

Review Software Engineering Section of SDP

1.1.3.6

Review Schedules Section of SDP

SDP Issues 1.1.3.5 SDP Testing Issues Reqts.

Review Software Components Section of SDP

1.1.3.4 Testing Reqts.

MODELING THE TESTING PROCESS

(Review Configuration Management Plan)
CMP Issues Configuration Management Plan CMP Issues CMP Issues

Review Table of Contents of CMP 1.1.4.1

Format and Testing Issues

Review Mgmt. Section of CMP 1.1.4.2

Review CM Activities Section of CMP 1.1.4.3

Doc. Problems from Later Phases Standards and Templates

Standards and Templates

Testing Reqts.

Testing Standards Reqts. and Templates

TE Review of CMP, Review Comments CMP Issues

CMP Review Results

Review Storage and Delivery Section of CMP

1.1.4.6 Testing Reqts. CMP Issues

Review Records Section of CMP

1.1.4.5 Testing Reqts. CMP Issues

Review Tools Section of CMP

1.1.4.4 Testing Reqts.

MODELING THE TESTING PROCESS

INPUT PROCESS OUTPUT Create Test Plan 1.2

Requirements Requirements from Program Plans CM System Incident-Handling System Standards and Templates Staff Resources Risks Test Tool Information Requirements Issues

Approved Test Plan

Test Plan Review Results Requirements Review Results

Test Plan Issues

MODELING THE TESTING PROCESS

(Create Test Plan)
Requirements Issues Reqts. from Program Plans Incident-Handling System
Staff Reqts. Issues

Requirements

Analyze Requirements 1.2.1

Testable Requirements

Write Test Plan

1.2.2

Test Tool Data, Test Techniques, CM Test Environment, Standards and Templates System Reqts. Review Results Test Items Approved Test Plan, including Features to Test, Features Not to Test, Pass/Fail Criteria, Training Needs, Schedule, Risks Meeting Report Test Plan Review Results

Review Test Plan

1.2.3

Test Plan

MODELING THE TESTING PROCESS

(Analyze Requirements)
Reqts. Issues Reqts. Issues Customer Problems Reqts. Issues

Reqts

Ensure Reqts. Not Ambiguous 1.2.1.1

Traceability Matrix

Determine If Reqts. Complete 1.2.1.2

Reqts. Issues Reqts. Issues

Ensure Reqts. Consistent 1.2.1.3

Determine If Reqts. Traceable 1.2.1.6

Reqts Issues

Ensure Reqts. Non-Compound

Reqts. Issues

1.2.1.5

Ensure Reqts. Correct 1.2.1.4

Reqts. Issues

Review Reqts. Attributes 1.2.1.7

Ensure Reqts. Verifiable 1.2.1.8

Review Constraints

1.2.1.9 Testable Reqts

MODELING THE TESTING PROCESS

Reqts. from Program Plans IncidentHandling System

(Write Test Plan)

Reqts. Issues Test Methods, Techniques, Test Tool Data Standards and Templates

Reqts. to Test/Not Test Test Tool Data, Test Techniques, Test Environment

Define Test Reqts.

1.2.2.1 Test Items

Define Test Tasks 1.2.2.2

CM System

List Test Documents 1.2.2.3

Test Reqts., Test Tasks

Define Test Environment

Staff Needs, Schedule Constraints

1.2.2.6 Risks

Define CM Tasks

1.2.2.5
Standards and Templates

List Pass/Fail Criteria

1.2.2.4 Draft Test Plan

Test Tasks

Define Staff, Schedule 1.2.2.7

Establish Risks

1.2.2.8

Document Test Plan 1.2.2.9

Test Plan Problems from Subprocess 1.2.3.3

MODELING THE TESTING PROCESS

(Review Test Plan)
Meeting Notice Requirements Requirements

Test Plan

Distribute Meeting Data Pack and Agenda 1.2.3.1

Meeting Data Pack Meeting Attendees

Review Test Plan

1.2.3.2

Review Comments

Requirements Issues

Test Plan Problems

Test Plan Updates

Meeting Report

Publish Meeting Report

1.2.3.4

Conduct Meeting
1.2.3.3

Approved Test Plan

Meeting Data Pack

MODELING THE TESTING PROCESS

INPUT PROCESS OUTPUT Create Test Design, Test Cases, Test Software, and Test Procedures 1.3
Test Case,Test Design, Test Procedure Review Results

Requirements Approved Test Plan Software Design Source Code Complexity Data Standards and Templates Test Tool Requirements

Test Cases Test Design Test Input Data Test Software Test Procedures

Design and Code Issues Test Plan Issues

Test Documentation Problems

MODELING THE TESTING PROCESS

(Create Test Design, Test Cases, Test Software, And Test Procedures)
Test Plan Issues Requirements

Test Plan Software Design, Requirements Reqts. and Test Plan Issues Features List,

Design Issues

Test Plan

Review Test Plan

Test Env.

1.3.1

Create Test Design

Test Design 1.3.2

Review Test Design

1.3.3

Minutes

Complexity Design, Code Issues Code Review Data, Defect History

CM System, Standards and Templates Techniques, Methods Test Data Test Software Reqts. Test Items

Create Test Procedures

Test Doc. Entry, Exit Criteria 1.3.7

Acquire Test Software Build 1.3.5

Test Software Doc. Test Cases

Create Test Cases

1.3.4 Design Issues

Pass/Fail Criteria

Acquire Test Software Buy 1.3.6

Test Env.

CM System

MODELING THE TESTING PROCESS

(Review Test Plan)
Test Plan Issues Requirements Requirements Issues Requirements Issues

Read Test Plan

Test Plan 1.3.1.1

Review Reqts. Volatility

1.3.1.2 Change Requests Requirements Issues

Evaluate Ambiguity of Reqts. 1.3.1.3

Requirements Issues

Review Testability
1.3.1.6 Requirements Issues, Test Plan Issues

Identify Interface Issues 1.3.1.5

Identify Performance Issues 1.3.1.4

MODELING THE TESTING PROCESS

(Create Test Design)
Software Design Test Plan Issues

Features List Test Plan from Test Plan Issues

Requirements and Test Plan Issues

Requirements Test Plan

Identify Features to Be Tested 1.3.2.1

Refine Test Approach

1.3.2.2

Identify Test Cases

1.3.2.3

Complexity Requirements and Standards and Test Plan Issues Templates

Test Plan

Requirements and Test Plan Issues

Test Design

Document Test Design

1.3.2.6

Update Risks
1.3.2.5 CM System

Define Pass/Fail Criteria 1.3.2.4

MODELING THE TESTING PROCESS

(Review Test Design)
Requirements Approved Test Plan Draft Test Design Meeting Notice Meeting Data Pack

Shading indicates that the action must be taken by other groups besides test engineering

Distribute Meeting Data Pack and Agenda 1.3.3.1

Review Test Design

1.3.3.2 Review Comments

Meeting Attendees Test Design Update Recommendation Meeting Report

Test Doc. Problems

Test Design Updates

Publish Meeting Report

1.3.3.4

Conduct Review Meeting

1.3.3.3 Meeting Data Pack

Approved Test Design

MODELING THE TESTING PROCESS

(Create Test Cases)
Test Plan and Test Design Issues Approved Test Design Design Issues Design Issues

Identify Test Items

1.3.4.1 Approved Test Plan Test Items Standards and Templates

Develop Input Specifications

1.3.4.2

Develop Output Specifications

1.3.4.3 Test Software Reqts.

Test Environment Complexity Test Plan and Test Design Issues

Test Environment

Document Test Cases

1.3.4.6 Test Cases

Identify Inter-Case Dependencies

1.3.4.5 CM System

Test Cases

Identify Environment 1.3.4.4 Needs

MODELING THE TESTING PROCESS

(Acquire Test SoftwareBuild)
Software Test Design, Design Test Cases

Techniques, Methods

Test Software Issues Test Cases for Techniques, from Subprocess Test Software 1.3.5.5 Methods

Analyze Test Software Reqts. 1.3.5.1

Test Software Reqts. Test Report Test Software Issues to Subprocess 1.3.5.3

Create Test Software Design 1.3.5.2

Test Env. CM System Documented Issues

Code Test Software

1.3.5.3

Change Requests

Doc.

Document User Instructions for Test Software 1.3.5.6

Test Software

Perform Test of Test Software 1.3.5.5

CM System

Review Test Software

1.3.5.4

Test Cases for Test Software

Standards and Templates

MODELING THE TESTING PROCESS

(Acquire Test SoftwareBuy)
Software Test Design, Design Test Cases Techniques, Methods Candidate Tools Test Cases for Candidate Test Software Tools

Analyze Test Software Reqts. 1.3.6.1

Test Software Reqts. Test Report Test Software Issues to Vendor

Research Test Software

1.3.6.2 CM System

Select and Evaluate Test Software 1.3.6.3

Test Environment

Doc.

Document User Instructions for Test Software 1.3.6.6

Test Software

Perform Test of Test Software 1.3.6.5

CM System

Purchase Test Software

1.3.6.4

Test Cases for Test Software

Standards and Templates

MODELING THE TESTING PROCESS

(Create Test Procedures)
Requirements Software Design Test Plan
Test Design, Test Cases Test Design, Test Cases

Define Procedures Purpose 1.3.7.1

Test Design, Test Cases Design, Code Issues Test Items

Identify Test Setup Reqts.

1.3.7.2

Describe Entry/Exit Criteria 1.3.7.3

Test Design, Test Cases

Test Environment

Standards and Templates

Document Test Procedures

1.3.7.6 Test Procedures CM System

Identify Data Analysis Reqts. 1.3.7.5

Define Procedures Test Steps

1.3.7.4

Design, Test Code Issues Cases Test Plan, Test Design, Test Case Issues

MODELING THE TESTING PROCESS

INPUT PROCESS OUTPUT Perform Formal Test 1.4
IncidentReports Fixes

Approved Test Documentation CM System Engineering Test Data Resources and Staff Software Documentation Source Code Test Schedule Test Tools

Tested Code Incidents, including Test Incidents with Test Documentation Problems System Limitations Test Report Meeting Minutes

Requirements, Design and Code Issues Test Documentation Problems

MODELING THE TESTING PROCESS

(Perform Formal Test)
Test Documentation Source Code, Problems Software Doc., Test Minutes Test Doc., Schedule Resources, Software Test Tools Documentation Test Documentation Engineering Test Data Staff System Limitations Requirements, Design, Code Issues

Hold Pretest Meeting

Execute Test
1.4.2

Tested Code, Incidents, Test Output Data

1.4.1 Test Documentation Problems Environment Staff

CM System Retest

Write Test Report

1.4.5

Hold Posttest Meeting

1.4.4

Determine Disposition of Incidents 1.4.3

Test Report

CM System Tested Code

Minutes

Test Documentation Incident-Tracking Problems Reqts., Design, System Code Issues

MODELING THE TESTING PROCESS

(Hold Pretest Meeting)
Meeting Notice Test Documentation Engineering Test Data Meeting Data Pack

Distribute Meeting Data Pack and Agenda 1.4.1.1

Review Data
1.4.1.2 Review Comments Status Updates

Test Environment Status

Test Item Status

Test Schedule Meeting Attendees

Schedule Updates

Test Documentation Issues

Publish Meeting Report

1.4.1.5 Meeting Report

Make Test Start Decision

1.4.1.4 Test Team Recommendations

Conduct Meeting
1.4.1.3

Meeting Data Pack

MODELING THE TESTING PROCESS

(Execute Test)
Test Environment Test Items Test Items, Test Schedule Software Doc., Test Resources, Test Environment

Test Documentation Test Documentation Issues System Limitations

Verify Test Environment

1.4.2.1

Perform Test Procedures

1.4.2.2

Incidents, Tested Code, Test Output Data

Test Logs

Test Tools Reports

Test Cases, Test Procedures Test Documentation Retest Signal Issues from Subprocess 1.4.3.5

Analyze Test Output Data 1.4.2.5

Analyzed Test Data

Monitor Test Status

1.4.2.4 Test Output Data

Document Incidents
1.4.2.3 Incidents; Reqts., Design, Code Issues

Code Incidents

Planned Schedule

Incident-Tracking System

MODELING THE TESTING PROCESS

(Determine Disposition Of Incidents)
IncidentTracking System Test Output Data Test Documentation Identifying Expected Results

Incident

Enter Incident in Tracking System 1.4.3.1

Review Prior Incidents

1.4.3.2

Review Test Output

1.4.3.3

Requirements, Design, or Code Fix

Incident-Tracking Test Documentation Fix Tool

Incident-Tracking System

Retest Signal to Subprocess 1.4.2.2

Specify and Implement Software Fix 1.4.3.5

Specify and Implement Test Fix 1.4.3.4

Retest Signal to Subprocess 1.4.2.2 CM System

CM System

MODELING THE TESTING PROCESS

(Hold Posttest Meeting)
Meeting Notice Test Documentation Meeting Data Pack Incident List

Test Data

Distribute Review Materials and Agenda 1.4.4.1

Review Test Output Data

1.4.4.2 Review Comments

Meeting Attendees Test Manager Recommendation Test Doc. Issues Status Updates

System Limitations

Meeting Report

Publish Meeting Report 1.4.4.5

Make Pass/Fail Decision

1.4.4.4

Conduct Meeting
1.4.4.3

Schedule Updates

Manager Consensus

Meeting Data Pack

MODELING THE TESTING PROCESS

(Write Test Report)
Analyzed Test Output Data Test Documentation Test Status Reports

Collect Test Output Data 1.4.5.1

Posttest Meeting Report

Review IncidentReport Status

1.4.5.2

Review Test Logs

1.4.5.3

Hardware and Software Configuration Status

Incident-Tracking System Test Manager Approval

Test Logs Standards and Templates

CM System

Author Inputs Test Report

Publish Test Report

1.4.5.6

Create and Review Test Report 1.4.5.5

Set Up Test Report Format

1.4.5.4 Project Team Inputs

MODELING THE TESTING PROCESS

INPUT PROCESS OUTPUT Update Test Documentation
Test Documentation Review Comments

Test Plan Problems Test Design Problems Test Case Problems Test Procedure Problems Test Documentation Requirements Design Standards and Templates

1.5

Updated Test Plan Updated Test Design Updated Test Cases Updated Test Procedures

MODELING THE TESTING PROCESS

(Update Test Documentation)
Test Plan Problems Requirements, Design, Code Test Design, Test Case, Test Input Data Problems Test Procedure Problems Test Plan, Test Design

Analyze Test Documentation Problems 1.5.1

Test Cases, Test Input Data, Test Procedures

Update Test Documents

1.5.2

Review Comments Incident Reports Test Plan, Test Design, Test Cases, Test Input Data, Test Procedures

Review and Approve Software Test Documents 1.5.3

MODELING THE TESTING PROCESS

(Analyze Test Documentation Problems)
Incidents with Test Plan Problems Test Plan,Test Design Incidents with Test Design Problems

Test Plan

Analyze Test Plan Problems

1.5.1.1 Requirements, Design

Analyze Test Design Problems 1.5.1.2

Requirements

Incidents with Test Procedure Problems

Incidents with Test Test Design, Test Cases Case Problems

Problems, with Proposed Updates

Analyze Test Procedure Problems 1.5.1.4

Test Procedures Requirements, Design

Analyze Test Case Problems

1.5.1.3

Requirements, Design

MODELING THE TESTING PROCESS

(Update Test Documents)
Updates to Test Plan Standards and Templates Standards and Templates Updates to Test Design Test Plan, Test Design

Test Plan

Update Sections of Test Plan 1.5.2.1

Requirements, Design

Update Sections of Test Design

1.5.2.2

Requirements Internal Review Comments

Updated Documents Ready for Review

Internal Review Comments Test Design, Test Cases

Updates to Test Procedures

Internally Review Updates

Reviewed Test Plan, Test Design, Test Cases, Test Procedures

1.5.2.5

Update Sections of Test Procedures 1.5.2.4

Update Sections of Test Cases

1.5.2.3

Standards and Requirements, Test Templates Design Procedures Standards and Templates

Updates to Requirements, Test Cases Design Standards and Templates

MODELING THE TESTING PROCESS

(Review And Approve Software Test Documents)
Review Request Requirements Requirements

Distribute Updated Test Documents

Updated Test Documents
1.5.3.1

Review Updated Test Documents

1.5.3.2 Test Documents Reviewers Review Comments Test Documents

CM System

Approved Test Documents

Approve and Publish Test Documents 1.5.3.4

Incorporate Review Comments

1.5.3.3

CM System