SDP Test Automation

Demo

Oct 04th Monday, 2010

Presentation_ID
© © 2007
2007 Cisco Systems, Inc. Ciscoreserved.
All rights Systems, Inc.Cisco
All rights reserved.
Confidential Cisco Confidential 1
 Agenda

 SDP Automation Scope

 Automation Framework
 Execution Method
 Effort Analysis
 Maintenance
 Observations and Challenges
 SDP Automation Plan

© 2007 Cisco Systems, Inc. All rights reserved. Cisco Confidential 2

 SDP Automation Scope
Following I2Rs are consider for Q3 regression scope

I2R Name Total Regression Test Cases Test Case Consider

I2R 7047 – Premium Parts & Labor 70 41

I2R 7821 – Warranty 10th business Day 24 24

I2R 8688 – Advance Replacement & Shipping 34 17

© 2007 Cisco Systems, Inc. All rights reserved. Cisco Confidential 3

 Automation Framework (HYBRID MODEL)

Note : Hybrid frame work is combination of frameworks , best fits most of the applications
Eg : Functional Decomposition with Data Driven

© 2007 Cisco Systems, Inc. All rights reserved. Cisco Confidential 4

 Execution Method
Option 1 Option 2

Data Mining Initiate Data Mining Default

Validate Orders Validate Orders
Order Creation Concurrent Program Order Creation Concurrent Program

Execute Yes
Successfully

No

Yes Environment No
Error

© 2007 Cisco Systems, Inc. All rights reserved. Cisco Confidential 5

 Effort Analysis

Data Automated Effort Number

Manual execution Preparationexecution Saved per Effort Saved in of cycles
  effort (PDs) (PDs) effort (PDs) cycle (PDs) % per year

SDP

Data Preparation:
1.Creation of the Test set for each build
2.Environment/Property file updates
3.Data file updates as per Data requirements

© 2007 Cisco Systems, Inc. All rights reserved. Cisco Confidential 6

 Maintenance
Corrective Maintenance Perfective Maintenance
CR

KT from SME

Impact Analysis

Update/ Implement

Debug

Validate With SME

No Go
Go
Execute

Analyze Result

© 2007 Cisco Systems, Inc. All rights reserved. Cisco Confidential 7

 Observations and Challenges
Following observations and challenges were found
during the Automation
Order Number Display
After Clicking on "Submit" Button some times application taking
more time to respond. In this situation application doesn’t displaying the
order number on front end screen, alternatively we are capturing the order
number from SVO Status Tool if order got created

Order Resolve
Some times, in order resolve tool, once the HOLD got resolved and
after refreshing the page, the hold which is resolved is still displaying in the
page. In some cases it is resolved after resolving continuously more than 5
times

© 2007 Cisco Systems, Inc. All rights reserved. Cisco Confidential 8

 Observations and Challenges …Contd
Access Required for External tools
Few test cases are required to access external Tools / Urls to
continue the flow , which required full VPN connection or Ports to be open
for that Urls

Privileges Required to Update Database

Few test cases are required to update the database to continue
the flow , which required update privileges to update the database

© 2007 Cisco Systems, Inc. All rights reserved. Cisco Confidential 9

S.No Activity Name
SDP Automation Plan
Start Date End Date Status Comment
           

1 Knowledge Sharing on the application and test case identification for POC 9/20/2010 9/24/2010 Completed  
2 Identifieng the frame work and design 9/27/2010 9/29/2010 Completed  
3 Automating the identified test cases for POC 9/30/2010 10/8/2010 Completed  
10/11/2010 10/15/2010
4 Identifying the Q3 Scope and Knowledge Sharing Completed  
Automate the 24 test cases related to I2R 7821 - Warranty 10th Business day

5 10/18/2010 10/21/2010 Completed  

Validate the automation script with SME - Functional Review

6 10/22/2010 10/22/2010 Completed  

Dry run of 12 test cases related to I2R 7821

7 10/22/2010 10/25/2010   test cases will execute on business day during the office hours and after office hours
Dry run of 12 test cases related to I2R 7821

8 10/30/2010 11/1/2010   test cases will execute on holiday or weekend

Automate the 41 test cases related to I2R 7047 - Premium Parts & Labor

9 10/25/2010 10/28/2010    
Validate the automation script with SME - Functional Review

10 10/29/2010 10/29/2010    
Dry run 26 test cases related to I2R 7047

11 10/29/2010 10/29/2010   test cases will execute on business day during the office hours and after office hours
Dry run 15 test cases related to I2R 7047

12 10/30/2010 11/1/2010   test cases will execute on holiday or weekend

Automate the 12 test cases related to I2R 8688 Scope of this I2R will be decided after discussing with JIM

13 11/1/2010 11/3/2010  
Validate the automation script with SME - Functional Review

14 11/4/2010 11/4/2010    
Dry run 12 test cases related to I2R 8688
15 11/4/2010 11/5/2010    
Knowledge Sharing session on the changes due to Q3 scope

16 11/5/2010 11/8/2010   Based on the scope finalization

Maintenance due to changes in Q3FY11 Release time lines will be decide after application deployment and execution in TCA will be based on
17  
the availability of the time
Dry run of 70 test cases along with TCA manual execution

18  
Re-work on the script if any gaps found during the dry run TBD

19  
Execution - 1st Cycle in TCA
20  
Execution - 1st Cycle in TCB
21  
Execution - 2nd Cycle in TCB Planning to execute as needed. We will execute test cases that are impacted by the defects
fixed.
   

22  

© 2007 Cisco Systems, Inc. All rights reserved. Cisco Confidential 10

 Q&A

© 2007 Cisco Systems, Inc. All rights reserved. Cisco Confidential 11

 Thank You

© 2007 Cisco Systems, Inc. All rights reserved. Cisco Confidential 12