Week 4: Test Management

Unit 1: Introduction to Test Management

 Introduction to Test Management
Focused Build for application / software

• Project plan
Create project • Track project readiness, issues and risks Manage q-gate Hand-over
• Release, waves, and
PMO plan • Manage scope change deliverables, release to
sprints
sign-off customer

Fit-Gap • Process model

Explore Team • Application landscape
WS for
(Business) Requirements • Requirements & gaps

Create Work
Assign Work • Functional specification
Build Team Manage
Package
Items & build • Config. guide, test cases
(Plan) show & tell
teams • System landscape

Develop,
Build Team
configure, unit
Document Work Release Work Defect • Tech. design
(Development) Item & progress Item Correction • Dev. Objects in transports
test

Plan & execute Execute • Test Steps Designer

Test Release Tests • Test plan
Wave tests Manage Defects
Management (SFT & AT) (FIT & RT) • My Test Executions

Release Build, test and Manage • Release

Management validate release hyper-care

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 2

Introduction to Test Management
Launchpad and tasks with Focused Build for test manager

▪ Project roles: test manager, test coordinator, dispatcher

▪ Responsibilities:
– Reach the defined and agreed test goals
– Define requirements and coordinate setup of the technical test environment, test data management, and test tool selection
– Review of project deliverables (test concept, test cases, scripts, test documentation, test reporting, error handling)
– Monitor and control test process quality and results
– Guide and coach by defining documentation policies
and conventions
– Coordinate and manage all test activities
– Plan automation of regression tests
▪ Outputs:
– Test plan
– Single functional test
– Acceptance test
– Functional integration test
– Regression test

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 3

Introduction to Test Management
Capabilities of SAP Solution Manager Test Suite and Focused Build

On-Top Functionality of Focused Build for SAP Solution Manager

Prepare Explore Realize Deploy Run

▪ Work Package-Based Test Plan Generation ▪ Test Execution: My Test Executions

▪ Manual Test Cases: Test Steps ▪ Test Suite Dashboard

SAP Solution Manager – Test Suite

Solution Documentation Change Impact Analysis Test Planning Test System Setup Test Execution and Analytics

▪ Manual Test Cases ▪ Change Impact Analysis

▪ Automated Test Cases ▪ Test Plan and Test Package Management
▪ Test Automation Framework with 3rd Party Test Tool Integration ▪ Test Execution of Manual And Automated Tests
▪ Test Composition Environment to Manage SAP and Partner Tools ▪ Gap and Completeness Analytics
▪ Test Data Management ▪ Test Execution Analytics

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 4

Introduction to Test Management
Test planning and execution

Test
Work-
Test Preparation Test Planning Test Execution Execution
streams Analytics

▪ Set up Solution Check assignment Access tester

Documentation of test cases to worklist
▪ Set up projects work packages
and release
Test case Operational Test
▪ Create and select Generate test plan execution Management
requirements derived from WP (manual/automatic) Reporting
▪ Create work status
Tasks package
Document test
Create test result/set status/
packages create defects
Create/assign test
cases to process Defect correction
steps (developer
Assign tester provides fix) Test Management
Dashboard
▪ Assign test case
to work package Retest and set test
case status

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 5

 Introduction to Test Management
Build project for agile development of a single release

Project structure sample with 2 waves of 2 sprints

Prepare Explore Realize Deploy Run

Phases of
Prepare Build Test Deploy Hypercare
Release Cycle

Wave 1 Wave 2 Functional

Integration
Test
SFT AT SFT AT
Wave FS Completed Completed Regression
Milestones Released Test
WP Build WP Build
Finished Finished

SFT SFT SFT SFT

Single Functional Test

Sprints Sprint 1 Sprint 2 Sprint 1 Sprint 2

Tech. Design Released

(Note: Point of NO RETURN
Sprint Build Started
Milestones for the Transports in these WP)
Build Completed
Unit Test Completed Handover
to Release
Unit Unit Unit Unit
Test Test Test Test

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 6

Introduction to Test Management
Definition – Required Testing Types

Test Types Test Level Test Requirement Definition Test System

Work Item Test to ensure that the work (e.g. WRICEF, Config)
Unit Test Sprint QAS
(Tech. Design) was implemented correctly

Validation of requested functionality by the requestor.

After validation, corresponding work packages (WP) and defect
(Business) Work Packages corrections (DC) would be ready for handover to release.
Wave QAS
Acceptance Test (Requirement) (This is the most important test, as after setting the work package
status ‘Handover to Release’, all assigned transports will end in
PRD system.)

E2E tests of the new or extended functionality,

Functional Integration validating the end-to-end business process.
Release E2E Processes PRE
Test (Remember all transports in WP/DC that were handed over to
release will go live)

Regression Test Release Productive Processes Test of productive processes or functions PRE

* Excluding: Data Migration Tests; End User AT

DR; Performance Tests, ... Technical System Tests

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 7

Introduction to Test Management
Definition – Optional Testing Types

Test Types Test Level Test Requirement Definition Test System

Business function test to ensure that

the feature was implemented correctly.
Single Work Package SFT of a work package (WP) can be executed when all
Single Functional Test Wave work items (WI) QAS
(Func. Spec)
of a WP have been successfully unit tested.
(Depending on the project approach
the singe functional test might be without test plan creation)

Related Work Packages

Early Functional Early validation of modular processes.
Wave(s) (Process with QAS
Integration Test (Can include tests from earlier wave(s))
Requirements)

Early Regression Test Wave(s) Productive Processes Early test of productive processes or functions QAS

* Excluding: Data Migration Tests; End User AT

DR; Performance Tests, ... Technical System Tests

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 8

Introduction to Test Management
Check Report

With the Check Report you can check your project for test management requirements.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 9

Thank you.
Contact information:

[email protected]
Follow all of SAP

www.sap.com/contactsap

© 2021 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of
SAP SE or an SAP affiliate company.
The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its
distributors contain proprietary software components of other software vendors. National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or
warranty of any kind, and SAP or its affiliated companies shall not be liable for errors or omissions with respect to the materials.
The only warranties for SAP or SAP affiliate company products and services are those that are set forth in the express warranty
statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional
warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or
any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation,
and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platforms, directions, and
functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason
without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or
functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ
materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, and they
should not be relied upon in making purchasing decisions.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered
trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. All other product and service names
mentioned are the trademarks of their respective companies.
See www.sap.com/trademark for additional trademark information and notices.
Week 4: Test Management
Unit 2: Test Preparation
Test Preparation
Process overview Test Manager

Test
Work
Test Preparation Test Planning Test Execution Execution
Streams Analytics

▪ Set up Solution Check assignment Access tester

Documentation of test cases to worklist
▪ Set up projects work packages
and release
Test case Operational Test
▪ Create and select Generate test plan execution Management
requirements derived from WP (manual/automatic) Reporting
▪ Create work status
Tasks package
Document test
Create test result/set status/
packages create defects
Create/assign test
cases to process Defect correction
steps (developer
Assign tester provides fix) Test Management
Dashboard
▪ Assign test case
to work package Retest and set test
case status

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 2

Test Preparation
Test case types supported by Focused Build

With Focused Build you can choose what test case types you want to use – office documents, test steps, or automated.

Manual Test Case Test Steps Automated Tests

(e.g. Word, Excel, etc.) (manual tests) (e.g. CBTA)

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 3

Test Preparation
Update and finalize test cases

Recommendation:
▪ A Business Analyst should review the test
cases available in Solution Documentation
▪ If an update of existing test cases or the
upload of additional test cases is required:
− Test cases can be added directly in SolDoc
− Functionality test cases can be assigned to
the respective Work Item (WI)
− In addition to that or alternatively test cases
of type Test Steps can be used

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 4

Test Preparation
Create test cases of type Test Steps

Test Steps
▪ Designer application for process experts / business analysts to create test cases for manual tests
▪ Fully embedded in Test Suite of SAP Solution Manager

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 5

Test Preparation
Create test steps from Solution Documentation

With Focused Build you can create new test cases of type Test Steps directly from Solution Documentation.
Process information can be directly re-used so it will be efficient and easy to create process tests.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 6

Test Preparation
Demo

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 7

Thank you.
Contact information:

[email protected]
Follow all of SAP

www.sap.com/contactsap

© 2021 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of
SAP SE or an SAP affiliate company.
The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its
distributors contain proprietary software components of other software vendors. National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or
warranty of any kind, and SAP or its affiliated companies shall not be liable for errors or omissions with respect to the materials.
The only warranties for SAP or SAP affiliate company products and services are those that are set forth in the express warranty
statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional
warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or
any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation,
and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platforms, directions, and
functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason
without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or
functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ
materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, and they
should not be relied upon in making purchasing decisions.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered
trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. All other product and service names
mentioned are the trademarks of their respective companies.
See www.sap.com/trademark for additional trademark information and notices.
Week 4: Test Management
Unit 3: Test Planning
Test Planning
Requirements-based test approach Test Manager

Test
Work-
Test Preparation Test Planning Test Execution Execution
streams Analytics

▪ Set up Solution Check assignment Access tester

Documentation of test cases to worklist
▪ Set up projects work packages
and release
Test case Operational Test
▪ Create and select Generate test plan execution Management
requirements derived from WP (manual/automatic) Reporting
▪ Create work status
Tasks package
Document test
Create test result/set status/
packages create defects
Create/assign test
cases to process Defect correction
steps (developer
Assign tester provides fix) Test Management
Dashboard
▪ Assign test case
to work package Retest and set test
case status

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 2

 Test Planning
Validating functions and end-to-end processes

SBX DEV QAS PRE PRD

Definition and Specification Implementation and Configuration Functional Tests Process Tests PRD Use

Functional Integration
Requirements (Business) Acceptance Test
Test

Regression Test

Work Packages Single Functional Test

(Functional Specification)

Work Items Unit Test

(Technical Design)

Software Implementation and Related

(Note: Point of NO RETURN
Configuration
for the Transports in these WP)

Handover
to Release
* Excluding: Data Migration Tests; End User AT
DR; Performance Tests, ... Technical System Tests

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 3

Test Planning
Variants for test documentation

 Assigned to
Variant A: Work Package Test Cases

Without Test Plan


Assigned to
(Using option to create defect correction during w/ documentation
single functional test / acceptance test starting of test results Defect Correction
directly from the work package)

 Assigned to
Work Package Test Cases


Assigned to
Variant B: w/ documentation
Assigned to
Defect Correction


With Test Plan(s) of test results


Defect Test Plan

You can choose the variant fitting best to your individual test requirements.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 4

Test Planning
Variant A supported by Focused Build

Variant A – with formal documentation, without test plan

▪ Use 'Show and Tell' sessions for testing w/ documentation
▪ Make sure that 'Show and Tell' are guided by test cases added to the WPs of test results
▪ After the sessions, add 'Test Notes' documenting results of sessions to each WP  Assigned to
Work Package Test Cases
▪ In case of errors, create defect correction directly from the work package on Scope tab
▪ Work package will switch into status ‘To be Tested' for retesting when defect correction


Assigned to
is confirmed
Defect Correction
▪ Change status of WP from ‘To Be Tested' to 'Successfully Tested' manually WP by WP

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 5

Test Planning
Variant B supported by Focused Build

Variant B – with formal documentation, with test plan(s)

▪ Use test plan as agenda for 'Show and Tell' sessions
▪ Add test cases to the WPs (even in scoping phase a test case or an empty template can be uploaded)
▪ Create SFT test plan and/or an AT test plan via Assignment Analysis, which makes sure that the test w/ documentation
plan is linked to the project. It is recommended to use the option '1 Test Package per WP' during of test results
creation of the test plan, as this option makes it easy to identify the WP that can be set to
 Assigned to
'Successfully Tested' when the TP is finished. This is also required for automatic status change of WP, Work Package Test Cases
depending on defect correction status (WP 'in repair') and enables the linking of defect corrections
automatically to WP, which makes sure that DC must be released / imported together with the WP


Assigned to
▪ Remark: In case the DCs are not finished (user status Confirmed) please refer to L2 presentation Assigned to
Defect and Defect Correction for further details Defect Correction



Only One Test Plan:
a) Use test plan only for AT. For SFT, follow variant A. Defect Test Plan

Separate Test Plans for SFT and AT:

b) AT test plan contains a subset of test packages / test cases of SFT test plan but is executed by different testers (key user, person responsible for
requirement)
c) AT test plan is a 1:1 copy of SFT test plan but is executed by different testers (key user, person responsible for requirement)
d) AT test plan contains different test cases than SFT test plan

▪ Ensure that status is set and 'Test Results' are documented per test case
▪ In case of errors, create test defects, defect correction, and retest
▪ Optional: Create final test report for test plan from test plan analytics and add it to respective WPs
▪ Change status of WP from ‘To Be Tested' to 'Successfully Tested' only if exit criteria for test phase(s) are met. Mass change functionality for WPs could be
used for this if no final test report is used

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 6

Test Planning
Test preparation checks using the Test Suite Dashboard

‘Test Preparation’ Tab :

▪ In this tile you can view the amount of work packages
for a given project and wave
▪ It will help you to easily identify the work packages to
which no test cases (of any types) are assigned
▪ It will also highlight the work packages which do not
have any test case assigned according to their statuses
▪ In this example, you can see that a work package in the
status 'To Be Tested' which does not have a test case
assignment is ranked as “red”
▪ In the table you will find the work package details (ID,
name, priority, test case assignment, …)
▪ You can jump directly to the work package application
to update any work package
▪ You can also navigate to the 'assignment analysis'
application to perform any missing assignment

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 7

Test Planning
Test plan creation Test Manager

Test Preparation & Test Plan / Package Generation Tester Assignment

Process

Processes
Test Team

Tester

Test Package

Work Package Test Plan

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 8

Test Planning
Demo

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 9

Thank you.
Contact information:

[email protected]
Follow all of SAP

www.sap.com/contactsap

© 2021 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of
SAP SE or an SAP affiliate company.
The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its
distributors contain proprietary software components of other software vendors. National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or
warranty of any kind, and SAP or its affiliated companies shall not be liable for errors or omissions with respect to the materials.
The only warranties for SAP or SAP affiliate company products and services are those that are set forth in the express warranty
statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional
warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or
any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation,
and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platforms, directions, and
functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason
without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or
functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ
materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, and they
should not be relied upon in making purchasing decisions.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered
trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. All other product and service names
mentioned are the trademarks of their respective companies.
See www.sap.com/trademark for additional trademark information and notices.
Week 4: Test Management
Unit 4: Test Execution
Test Execution
Requirements-based test approach Tester

Test
Work-
Test Preparation Test Planning Test Execution Execution
streams Analytics

▪ Set up Solution Check assignment Access tester

Documentation of test cases to worklist
▪ Set up projects work packages
and release
Test case Operational Test
▪ Create and select Generate test plan execution Management
requirements derived from WP (manual/automatic) Reporting
▪ Create work status
Tasks package
Document test
Create test result/set status/
packages create defects
Create/assign test
cases to process Defect correction
steps (developer
Assign tester provides fix) Test Management
Dashboard
▪ Assign test case
to work package Retest and set test
case status

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 2

Test Execution
Overview – Activities and responsible

Test Execution

Maintain Test Plan Lock/Unlock or Maintain Results

Track Status and
Status → Release Replace One or
Progress of Testing
Test Manager TP for Execution Multiple Testers

Create Test Note

Execute Test Case

Access Testers Maintain Status of
Access Test Cases (Manual or Create Test Defect Execute Retest
Worklist Test Case
Tester Automatic)

Defect Correction

Developer
Defect Analysis

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 3

Test Execution
My Test Executions (MTE)

Convenient access for manual testers to test cases, test execution, defect creation,
and status setting

Benefits
▪ Tester can easily view test packages and included test cases assigned to him/her
▪ Tester can quickly open the assigned test script to familiarize themselves with the test steps to be executed
▪ Convenient access with 1 click to the test system to perform test execution
▪ Intuitive status setting, test note, and optional defect creation
© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 4
Test Execution
Execute test case and document results

Steps
1. Tester opens the test case document and
runs the test according to test case.
2. Tester uploads the result doc via ‘drag and
drop’.
3. Tester creates or assigns the defects.
4. Tester retests the test case when defect
correction is solved.
5. Tester updates the test status.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 5

Test Execution
In case of an error: report defect

Steps
1. Input all the related information and
assign the processor.
2. Assign category to specify the team.
3. Reproduce the steps and attach
screenshots to the defect. Thus, the
processor can get a quick analysis of the
defect.

Recommendations
▪ Defect Type should be Defect.
▪ System should be the test system, then
later, if the defect is fixed via a defect
correction with transport, the transport will
be imported to the test system via
scheduled import variant of the release
batch import.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 6

Test Execution
Demo

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 7

Thank you.
Contact information:

[email protected]
Follow all of SAP

www.sap.com/contactsap

© 2021 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of
SAP SE or an SAP affiliate company.
The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its
distributors contain proprietary software components of other software vendors. National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or
warranty of any kind, and SAP or its affiliated companies shall not be liable for errors or omissions with respect to the materials.
The only warranties for SAP or SAP affiliate company products and services are those that are set forth in the express warranty
statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional
warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or
any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation,
and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platforms, directions, and
functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason
without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or
functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ
materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, and they
should not be relied upon in making purchasing decisions.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered
trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. All other product and service names
mentioned are the trademarks of their respective companies.
See www.sap.com/trademark for additional trademark information and notices.
Week 4: Test Management
Unit 5: Test Analytics
Test Analytics
Requirements-based test approach Test Manager

Test
Work
Test Preparation Test Planning Test Execution Execution
Streams Analytics

▪ Set up Solution Check assignment Access tester

Documentation of test cases to worklist
▪ Set up projects work packages
and release
Test case Operational Test
▪ Create and select Generate test plan execution Management
requirements derived from WP (manual/automatic) Reporting
▪ Create work status
Tasks package
Document test
Create test result/set status/
packages create defects
Create/assign test
cases to process Defect correction
steps (developer
Assign tester provides fix) Test Management
Dashboard
▪ Assign test case
to work package Retest and set test
case status

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 2

Test Analytics
Test Suite Dashboard

Test Suite Dashboard – Launch from SAP Solution Manager Launchpad

Test Suite Dashboard – Start from Selection Screen

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 3

Test Analytics
Test Suite Dashboard – Track test progress and generate test report

Via Test Suite Dashboard, test

managers and test coordinators
are able to:
▪ Get overview of all test types
▪ Track all test plans and test
package execution status
▪ Track all defect statuses via diff
dimension
▪ Check traceability matrix from
requirement to defect

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 4

Test Analytics
Test Suite Dashboard – Test Execution Status

▪ Ready-to-use dashboard for test manager and test coordinator with aggregated and detail information
▪ View Test Execution Status: Test cases in different statuses, as well as remaining testing days

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 5

Test Analytics
Test Suite Dashboard – Defect Status

Monitor Test Defect Status

1. Navigate to Test Suite Dashboard
2. Select test plan
3. Navigate to ‘Defect Status’ tab to monitor
all the related defects

Recommendation
▪ ‘Change & Release Management’ tile can
be used to access additional details of test
defects

Monitor Defect Corrections

1. Navigate to ‘Mass Change’ app
2. Select ‘Defect Correction’
3. Search the ‘Defect Correction’ within
scope for monitoring

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 6

Test Analytics
Test Suite Dashboard – Traceability Matrix

Traceability Matrix offers tiles that

highlight the important categories
and their corresponding KPIs:
▪ Requirements
▪ Work packages
▪ Work items
▪ Assignment of test cases to work
packages
▪ Test execution status
▪ Defect and defect corrections

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 7

Test Analytics
Test Suite Dashboard – Test Execution Results

Detailed reporting on test execution results

of manual tests is available.
You get an immediate overview of relevant
information like overall status, current step,
or number of defects.
With the drill-down navigation you can find
more details like attached results, defects,
or even actual results and evidence
documents on step level.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 8

Test Analytics
Demo

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 9

Thank you.
Contact information:

[email protected]
Follow all of SAP

www.sap.com/contactsap

© 2021 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of
SAP SE or an SAP affiliate company.
The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its
distributors contain proprietary software components of other software vendors. National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or
warranty of any kind, and SAP or its affiliated companies shall not be liable for errors or omissions with respect to the materials.
The only warranties for SAP or SAP affiliate company products and services are those that are set forth in the express warranty
statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional
warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or
any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation,
and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platforms, directions, and
functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason
without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or
functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ
materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, and they
should not be relied upon in making purchasing decisions.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered
trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. All other product and service names
mentioned are the trademarks of their respective companies.
See www.sap.com/trademark for additional trademark information and notices.
Week 4: Test Management
Unit 6: Test Optimization
Test Optimization
Sample usage scenarios for regression tests

Scenario 1 – Regression Test Before Deploy

▪ Re-execute selected test cases across the test types executed before, to ensure no side-effects on test
results of earlier test types occurred
▪ Scope: All units, functionalities, and processes of the entire release
▪ Recommendation: Focus on high-priority test cases

Scenario 2 – Regression Tests After Waves or Sprints

▪ Re-execute selected test cases across the test cases in former waves and sprints to make sure respective
test results are still 'OK' after new developments or bugfixes have been introduced
▪ Scope: Selected units, functionalities, and processes of former waves and sprints
▪ Recommendation: Focus on high-priority test cases

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 2

Test Optimization
Recommendations

▪ Regression test activities such as creation of test plans or test execution can be handled very similarly to the procedure
described for FIT.
▪ To further facilitate those activities, SAP Solution Manager offers:
– Business process change analyzer (BPCA) to define an optimized test scope
– Test automation framework (TAF) including component-based test automation (CBTA) to reduce manual testing efforts

BPCA TAF

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 3

Test Optimization
Business process change analyzer (BPCA)

▪ Change impact analysis for business processes

resulting from software change events
▪ Use cases:
– Impact analysis for Customizing and code
changes
▪ Benefits:
– Precise impact analysis and significant test
scope reduction

Identify your test scope and significantly reduce your test effort for regression tests with BPCA!

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 4

Test Optimization
Business process change analyzer (BPCA) – Prerequisites

Solution Documentation Usage Data Setup Usage Data Collection BPCA Self-Check

▪ Minimum: executable ▪ SAP Solution Manager

library Configuration: Scenario Usage ▪ ABAP call monitor (SCMON) or
Logging (root flag!) UPL data will be collected and
▪ Checks BPCA
extracted from managed system
prerequisites in SAP
Solution Manager and
managed systems
Semi-Dynamic TBOM Dynamic TBOM

Completeness Reports
Manual Test or
Test Automation

▪ Where: Execution library or scope in ▪ Where: High-priority process steps

Solution Documentation ▪ How: Manual test execution,
▪ How: Background job to generate semi- manual process step execution, ▪ Check: Process steps without
dyn. TBOMs using UPL or SCMON data automated test (dynamic) TBOMs
© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 5
Test Optimization
Test automation framework (TAF)

Test Automation Framework

Non-SAP

Test Design Test Execution Test Result Analysis Accelerated Repair

▪ Seamless integration ▪ Start of automated ▪ Test manager can view ▪ Workflow between
between SAP Solution tests from Test test results from tester and test engineer
Manager and test tools Management work manual and automated to trigger test case
from SAP and partners center tests in one repair
▪ Test data container ▪ Ad-hoc start or environment ▪ Rich environment for
(TDC) provides test scheduler for ▪ Status and progress test engineer to analyze
data for test script unattended execution resports problems and perform
parameters ▪ Integrated test ▪ Integrated partner repair activities
▪ Central management of execution logs from reports
system under test partner tools

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 6

Test Optimization
Flow to create new automated test configuration

Solution Documentation Test Composition Environment (TCE)

Select a business process, Create new test configuration
process step, or an executable Select SAP or Non-SAP Tools
Create CBTA test configuration

CBTA – Test Creation Wizard

Quotation Sales Order Delivery

Test Composition Environment (TCE)

Finalize test configuration

CBTA – Test Components / Test Script

Test Data Assignment Wizard

Assign test data

Test Data
Container
© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 7
Test Optimization
Flow to execute automated test configurations

Test Suite
Tester Worklist
Test Script
CBTA
5 Test results and logs

1 User starts test execution

Test Configuration Logon and automated

Test execution: handover of 4 business process execution
3 test script + test data + SUT info
Test Script Test Data System Data
System under Test

2 Test data selection

TDC Test Data Container (TDC)

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 8

Test Optimization
Demo

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 9

Thank you.
Contact information:

[email protected]
Follow all of SAP

www.sap.com/contactsap

© 2021 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of
SAP SE or an SAP affiliate company.
The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its
distributors contain proprietary software components of other software vendors. National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or
warranty of any kind, and SAP or its affiliated companies shall not be liable for errors or omissions with respect to the materials.
The only warranties for SAP or SAP affiliate company products and services are those that are set forth in the express warranty
statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional
warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or
any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation,
and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platforms, directions, and
functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason
without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or
functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ
materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, and they
should not be relied upon in making purchasing decisions.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered
trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. All other product and service names
mentioned are the trademarks of their respective companies.
See www.sap.com/trademark for additional trademark information and notices.
Week 4: Test Management
Unit 7: New Features Since SP03
What’s New with Focused Build SP4?
Test Suite
Test Suite - New with SP04
Improve Up-/ Download functionality

Application
Test Steps Designer

Features
Test Step Designer is now supporting:
• Upload of Test Step Versions and Sub-steps
• Download of Test Steps Test Cases
Use Case
To accelerate the usage of Test Steps Test Cases, the Up-/
Download functionality was improved. Now, an existing test
case can be updated with the help of the upload – in that case,
a new version of the test case is created. Also sub-steps, which
are describing the process more in details, can be uploaded via
excel.
Furthermore, for an easy maintenance of Test Steps test cases
outside of the Test Steps Designer, the test cases can be
downloaded to an Excel-file.
© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 3
Test Suite - New with SP04
Attachment improvements

Application
Test Steps Designer

Features
Attachments can now be:
• Uploaded via Drag&Drop
• Shown as a Thumbnail
Use Case
Attachments can be used now more
efficient – the upload can be realized fast via
Drag&Drop. All common graphical files are
supported to show a smaller version of the picture via click – all
other file types are downloaded immediately via a click on the
icon. Additionally the icon indicates the file type.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 4

Test Suite - New with SP04
Add content from Solution Documentation

Application
Test Steps Designer

Features
• Add new content from SolDoc to Test
Steps test case
Use Case
If a Test Steps test case was created based on
Solution Documentation content and later the
content in the solution changes, there is a
simplified way to add the new content to the test
step test case.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 5

Test Suite - New with SP04
Customizable comment field

Application
My Test Executions

Features
• Standard Comment field for test execution
Use Case
The comment field (known from the standard tester
worklist) can be used to handover relevant test
information

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 6

Test Suite - New with SP04
Support change mode for “On behalf of”

Application
My Test Executions

Features
• ”On behalf of” supports change mode
Use Case
Now, users with the necessary
authorization are allowed to change test
execution data on behalf of another tester.
The changes were logged within the „Last
Changed By“ field (for Test Steps also in
tab Change Log).

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 7

Test Suite - New with SP04
Usability improvements – Test Package / Test Case list

Application
My Test Executions

Features
• Test Package list
• Refresh, Filter, Settings

• Test Case list

• Search field
• Refresh, Sorter, Filter, Settings
Use Case
Test Package and Test Case list can now be
clearly arranged to the users needs. Last
columns settings will be saved as
personalization.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 8

Test Suite - New with SP04
Others Test Result

Application
My Test Executions

Features
• Other’s Test Results are visible for Testers
Use Case
Testers can view Test Results of other
Testers, which are assigned to the same Test
Package and already tested the selected test
case. That provide a transparent test
execution with much more traceability.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 9

Test Suite - New with SP04
Usage of live data instead of BW data

Application
Test Suite Dashboard

Features
• Live data is used for Test Suite Dashboard
Use Case
By using live data instead of BW data, the Test Suite
Dashboard can now always provide the latest status of
testing. This is important for status meetings, especially
for them at very short notice. There is no need to wait
anymore for the next data extraction.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 10

Test Suite - New with SP04
New Tile “Single Functional Test Case”

Application
Solution Readiness Dashboard

Features
• New tile available for Single Functional Test Cases
Use Case
Percentage of Single Functional Test Cases according to Work
Package status and KPI due date. The KPI considers whether a
Single Functional Test Case with the correct document type and
expected status​ has been assigned to a Work Package.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 11

What’s New with Focused Build SP5?
Test Suite
Test Suite – new with Focused Build SP5
Improved Executable F4 help

Applications
Test Steps Designer

Feature details
• Enter search criteria directly without waiting time
• Initial search is still running in background
• By entering the dialog the next time, results from the initial
search are shown immediately

Benefits
Faster search results

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 13

Test Suite – new with Focused Build SP5
Avoid unnecessary branch selection

Applications
Test Steps Designer

Features
• Editable branch is selected automatically
• For Change Controlled branches, the pop-up is still
shown to enter the Change Document

Benefits
Better user experience and faster maintenance of Test
Steps test cases.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 14

Test Suite – new with Focused Build SP5
User information if changes were done since last load

Applications
Test Steps Designer

Features
• Information about changes made on the test case since
the last load
• Information about last last person who changed the test
case

Benefits
More transparency and security

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 15

Test Suite – new with Focused Build SP5
Inactive flag for Result Attributes

Applications
Test Steps Designer

Features
• Result Attributes which are no longer used can be defined as
Inactive
• Inactive Result Attributes are still visible in test cases, where they
are used for test execution but cannot be defined for new test
cases

Benefits
Ensure traceability of Result Attributes which should no longer be
used.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 16

Test Suite – new with Focused Build SP5
Public Result Attributes for Test Sequences

Applications
Test Steps Designer, My Test Executions

Features
• Result Attributes can be defined as Public to
make them visible in Test Sequences
• Public Result Attributes are shown in My Test Executions as
“Previous Results from Test Sequence”

Benefits
Easy hand over of data between Test Steps test cases in Test
Sequences.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 17

Test Suite – new with Focused Build SP5
Email Notification with Link to My Test Executions

Applications
My Test Executions

Features
• Standard Email Notification contains additional link to My Test
Executions

Benefits
Testers can decide which Test Execution tool in Solution Manager
they want to use. More traceability.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 18

Test Suite – new with Focused Build SP5
Improved “Assign Defect” dialog

Applications
My Test Executions

Features
The ”Assign Defect” dialog supports now
• Search for Defect Title
• Search for Defect Priority

Benefits
Faster and more efficient search for already created Defects.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 19

Test Suite – new with Focused Build SP5
User information if changes were done since last load

Applications
My Test Executions

Features
• Information about changes made on the test case since the
last load

Benefits
More transparency and security.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 20

Test Suite – new with Focused Build SP5
Further improvements

Application Application
My Test Executions Test Steps Designer

Feature details Feature details

▪ Change Log visibility depends on authorization object ▪ Change Log visibility depends on authorization object
▪ Usage of On-behalf mode depends on authorization object ▪ Authorization based on folders
▪ Improved exception handling ▪ Limit status values in aggregation customizing
▪ Display of version title and test mode in header tab
▪ Support of mandatory Test Note / Test Result
▪ Filter for empty test package priority
▪ Avoid status ”Untested” for changed test cases

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 21

Test Suite – new with Focused Build SP5
Further improvements

Application Application
Assignment Analysis Test Suite Dashboard

Feature details Feature details

▪ Support Site “Global” ▪ In-place navigation and filtering
▪ Adjusted filter setting “Overwrite” ▪ Using standard libraries

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 22

What’s New with Focused Build SP6
Test Suite
Test Suite – new with Focused Build SP6
Where-used list

Applications
Test Steps Designer

Feature details
• List of all Test Plans, where Test Case is part of
• Direct access from the Test Case to the linked
Test Plan, Package and Sequence
• The Version indicates a needed update in the
Test Plan

Benefits
Transparency about Test Case usage and
versions in Test Plans.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 24

Test Suite – new with Focused Build SP6
Support multiple Document Status Schemas

Applications
Test Steps Designer

Feature details
• Test Cases can have different Document Status Schemas
• Status Schema is set at creation time and cannot be
changed afterwards
• Document Status Schemas need to be activated for Test
Steps in SPRO (Focused Build > Test Suite Extensions > Test Steps > General
Settings for Test Steps Application)

Benefits
Possibility to differ between Test Cases which require a
special Document Status Schema e.g. with a digital
signature and other Test Case types.
© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 25
Test Suite – new with Focused Build SP6
Mass Update of Test Steps Header details

Applications
Test Steps Designer

Feature details
• Mass Update of Header details
• Test Steps test cases in changed controlled
branches or in a locked status cannot be
changed via Mass Update
• Mass Download of selected Test Steps
Test Cases

Benefits
Easy and fast update of general header
information for more than one test case.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 26

Test Suite – new with Focused Build SP6
Test Steps Parameters

Applications
Test Steps Designer, My Test Executions

Feature details
• Additional app to maintain Test Data for
Test Steps test cases centrally
• Test Data could be defined as dependent
from Test Plans, Test Package and Tester
• Parameters are available via right-mouse
click in all long-text fields of a test case

Benefits
Central maintenance for Test Data related to
Test Steps test cases and Test Plans.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 27

Test Suite – new with Focused Build SP6
Landing Page Quick Filters

Applications
My Test Executions

Feature details
• Tabs for quick filtering of the Worklist of a
Tester
• Assigned: all Test Packages assigned to the User
• Ready to Test: all Test Packages with Test Cases
which are "Ready to Test"
• Released: all Test Packages with Test Cases which
are not ”Ready to Test”
• Protected: all Test Packages which are "Locked”
(e.g. if a Test Plan is not allowed for execution)

Benefits
Increase the Productivity of Testers by
seeing Test Packages which are Ready to
Test first.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 28

Test Suite – new with Focused Build SP6
Additional dialog for Defect Type selection

Applications
My Test Executions

Feature details
• Selection dialog appears before Defect creation
• The defect dialog can be adjusted via
Personalization (Test Suite App catalog) for each
user

Benefits
Automatic Defect Type Determination based on
Customizing/Personalization

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 29

Test Suite – new with Focused Build SP6
Default Defect Priority

Applications
My Test Executions

Feature details
• The Defect Priority is automatically set related to
specific rules. The following order is considered:
• Test Case Priority
• Test Package Priority (if no Test Case Priority exists)
• CRM Customizing (if no Test Package Priority exists)
• Priority: Medium (if no CRM Customizing Priority exists)

• The Defect Priority can still be changed manually

Benefits
Easier estimation of the Defect Priority.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 30

Test Suite – new with Focused Build SP6
Take over Evidence Attachment as Defect Attachment

Applications
My Test Executions

Feature details
• Option to take over evidence document as
defect attachment, if this is uploaded for
the Step with Errors
• The evidence document is attached to the
defect while creating it
Benefits
Faster assignment of Defect Attachments

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 31

Test Suite – new with Focused Build SP6
Further improvements

Application Application
My Test Executions Test Steps Designer

Feature details Feature details

▪ Support of Web Assistant ▪ Support navigation via keyboard (tab key)
▪ Limit Business Partner value help to valid ▪ Support of Web Assistant
partners ▪ Automatic setting of Test Case Owner
▪ UI changes on Attachments and Results tab ▪ Testing Mode not changeable if used in Test
Plan
▪ Limit Business Partner value help to valid
partners
▪ UI changes for display mode

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 32

Test Suite – new with Focused Build SP6
Further improvements

Application Application
Assignment Analysis Test Suite Dashboard

Feature details Feature details

▪ Warn when removing Test Cases with ▪ Support Category in Traceability Matrix
execution data ▪ Provide correct filter options for text fields
▪ Automatic 1:1 relation between Test Package
and Work Package in certain statuses

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 33

In-App Help – new with Focused Build SP6
More applications covered by Web Assistant

Application

Content for web-based help system to provide you with

context-sensitive user assistance

Feature details

Can be activated with Help control

With SP6 the following applications are covered:

▪ Requirements Management
▪ Project Management
▪ My Test Execution
▪ Test Steps Designer
▪ Test Steps Parameters

Benefits

Intuitive access to help information

See Configuring SAP Web Dispatcher for In-App Help on the SAP Help Portal at https://help.sap.com/viewer/product/SM_FIORI/
> Configuration Guide > Setting Up the System Landscape > Setup of In-App Help.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 34

What’s New with Focused Build SP7
Test Suite
Test Suite – new with Focused Build SP7
Extend Up-/ Download of Test Steps

Applications
Test Steps Designer

Feature details
• Support of xlsx files
• Upload / Download of Test Steps in different
languages
• Upload / Download of Custom Columns

Benefits
Easier and more comprehensive creation and
maintenance of Test Steps test cases.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 36

Test Suite – new with Focused Build SP7
Improved Copy functionality

Applications
Test Steps Designer

Feature details
• More options to create a appropriate Test Steps
test case copy
• Option to assign the copied Test Case directly
to Solution Documentation

Benefits
Reduced rework after copy creation.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 37

Test Suite – new with Focused Build SP7
Handling of Executables

Applications
Test Steps Designer

Feature details
• Executables used in Test Steps test cases
cannot be deleted
• Test Steps test cases cannot be released, if the
assigned Executable(s) are not part of the
target branch or the release package

Benefits
Ensures consistency of Test Steps test cases.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 38

Test Suite – new with Focused Build SP7
Improvement of Create Defect dialog (1)

Applications
My Test Executions

Feature details
• Open defect creation dialog on setting error
status via
• Customizing
• User Personalization (SU01)

Benefits
Faster creation of Defects by taking over existing
information.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 39

Test Suite – new with Focused Build SP7
Improvement of Create Defect dialog (2)

Applications
My Test Executions

Feature details
• Defect Type (Personalization)
• Take over System / Client for Step Executables
• Take over Actual Result and Expected Result
• Support of any number of levels in MLC
• Limited Extensibility (via Customer Enhancement)

Benefits
Faster creation of Defects by taking over existing
information.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 40

Test Suite – new with Focused Build SP7
Further improvements

Application Application
My Test Executions Test Steps Designer

Feature details Feature details

• Evidence attachment via Drag & Drop • No new run on version update if test case was
• Save search criteria in Assign Defect dialog not executed yet
• Support of Archiving of Test Steps Executions • Mass Update: Filter for Solution, Mass Deletion
• Performance Improvements for Defect Creation • Filter Improvements for Owner, Created By,
Changed By and Test Case Type
• Sticky Header for Test Steps table

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 41

Test Suite – new with Focused Build SP7
Further improvements

Application Application
Assignment Analysis Test Suite Dashboard

Feature details Feature details

• Checkbox “Workflow” is available for Test Plan • No innovation
creation
• Show Test Plan Classification
• New Columns Work Package Priority and Work
Package Classification

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 42

What’s New with Focused Build SP8
Test Suite
Test Suite – new with Focused Build SP8
Ensure valid values for all testers

Applications
Test Steps Parameters

Feature details
• Global value assignment across all Test Plans
• Validity Check

Benefits
Easy assignment of values, which are globally
valid.
Comprehensive check of values related to the
assigned tester. Missing values can easily
identified.

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 44

Test Suite – new with Focused Build SP8
Customizing of create Defect dialog

Applications
My Test Executions

Feature details
• Customizing table for visibility and necessity of
• System
• Component
• Defect Category
• Message Processor
• Support Team
• Multilevel Categorization
• BAdI to provide default values for defect
creation

Benefits
Fast and efficient creation of Defects.
© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 45
Test Suite – new with Focused Build SP8
Further improvements

Application Application
My Test Executions Test Steps Designer

Feature details Feature details

▪ Improve Performance of loading Test Package ▪ Digital Signature Workflow Adjustments
information ▪ Extend amount of characters for Test Case
▪ Responsiveness of Test Package and Test name to 100
Case List (columns pop-in for better readability ▪ Include Sorter / Filter in “Add from SolDoc”
of cell content)
▪ Translate* at once in multiple languages
▪ Save On-behalf of information in appState
(Test Package List could be shared via link)

* The automated translation of Test Cases could only be achieved via external
service (e.g. SAP Translation Hub)
© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 46
Test Suite – new with Focused Build SP8
Further improvements

Application Application
Assignment Analysis Test Suite Dashboard

Feature details Feature details

▪ Support “Test Team” field from Work Package ▪ No innovation

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 47

Thank you.
Contact information:

[email protected]
Follow all of SAP

www.sap.com/contactsap

© 2021 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of
SAP SE or an SAP affiliate company.
The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its
distributors contain proprietary software components of other software vendors. National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or
warranty of any kind, and SAP or its affiliated companies shall not be liable for errors or omissions with respect to the materials.
The only warranties for SAP or SAP affiliate company products and services are those that are set forth in the express warranty
statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional
warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or
any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation,
and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platforms, directions, and
functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason
without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or
functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ
materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, and they
should not be relied upon in making purchasing decisions.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered
trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. All other product and service names
mentioned are the trademarks of their respective companies.
See www.sap.com/copyright for additional trademark information and notices.