SlideShare a Scribd company logo
W9
Test Automation
5/7/2014 1:45:00 PM
Leveraging Open Source
Automation: A Selenium
WebDriver Example
Presented by:
David Dang
Zenergy Technologies
Brought to you by:
340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
David Dang
Zenergy Technologies
David Dang is an industry recognized automation expert who has provided strategy, design, and
implementation assistance to more than one hundred organizations. By designing advanced
frameworks that reduce maintenance and increase scalability, David ensures clients get the
return on investment they expect from automation efforts. As VP of automation solutions for the
software QA and testing firm Zenergy Technologies, David is in high demand for his significant
knowledge in HP UFT and ALM, SAP automation, Selenium open source frameworks, and
mobile testing.
4/26/2014
1
Slide 1 Software Peace of Mind in Action
Presented By: David Dang
Leveraging Open Source Test Automation: A
Selenium WebDriver Case Study
StarEast 2014
Slide 2 Software Peace of Mind in Action
???
Introduction
Case Study Background
Decision to select open source vs. packaged tool
Assess and plan for test automation
Design an automation framework for Selenium
WebDriver
Framework Implementation
Outcome
Conclusion
4/26/2014
2
Slide 3 Software Peace of Mind in Action
???
Most companies grasp the importance of leveraging test
automation to increase test coverage, reduce execution
time, and provide more frequent testing. But test
automation can be expensive. More than ever,
companies are seeking open source tools like Selenium
to reduce the cost. This case study demonstrates one
company’s experience using Selenium for test
automation.
Introduction
Slide 4 Software Peace of Mind in Action
???
Software company that provides online instructional
tools for teachers and students
Agile software development methodologies used
Continuous integration deployed
Company open-minded toward open source toolsets
Good collaboration between QA and development
Automated unit testing paired with Continuous
Integration tool
Case Study Background
4/26/2014
3
Slide 5 Software Peace of Mind in Action
???
Needed a robust automation suite to perform “UI”
testing for integration/regression
Needed a subset of the automation suite (smoke test) to
run as part of Continuous Integration
Needed method for product owner, developers, and QA
to create automated tests
Needed to ensure maintainability of automated suite
Needed the automated suite to handle advanced and
dynamic web content
Case Study Background
Slide 6 Software Peace of Mind in Action
???
Selenium - Positives
FREE!
Supports multiple browsers
Scripts can be created with multiple programming
languages (Java, Ruby, Python, etc…)
Runs on Windows, Linux, and Mac
Not confined to the features of the tool
Integrates with other tools
Selenium vs. HP UFT
4/26/2014
4
Slide 7 Software Peace of Mind in Action
???
Selenium - Downsides
Only supports web-based natively
No formal support (the user community provides
good feedback but questions are not always
answered)
Higher technical skillsets necessary to optimize the
Selenium framework
Reporting features are not as robust
Harder to find resources with both QA/testing and
Selenium experience
Selenium vs. HP UFT
Slide 8 Software Peace of Mind in Action
???
UFT - Positives
Established tool with wide usage
Supports multiple technologies (Web, Java, .Net,
SAP, Siebel CRM, PeopleSoft, Terminal Emulator,
etc.)
Has many built-in features (embedded data table,
smart identification, object configuration, object
repository, etc.)
Ease of use
Professional support, although room for improvement
Selenium vs. HP UFT
4/26/2014
5
Slide 9 Software Peace of Mind in Action
???
UFT - Downsides
Cost! Purchase cost and yearly maintenance fees
Only supports IE and Firefox
Cannot run multiple instances on one machine
Selenium vs. HP UFT
Slide 10 Software Peace of Mind in Action
???
Cost
Alignment with the organization direction (most of the
development toolsets are open source)
Alignment with Agile methodologies
Ability to test on Mac
Ability to test on multiple browsers
Perception by both development and QA that Selenium
was easier to adapt
Factors in choosing Selenium
4/26/2014
6
Slide 11 Software Peace of Mind in Action
???
QA roles and responsibilities
Type of testing within a sprint (unit, functional,
integration, etc.)
Test environments
Test data strategies
Level of testing (UI, backend, database, etc.)
Application technologies
Defect tracking
QA resource skillsets
Assess QA Process
Slide 12 Software Peace of Mind in Action
???
Develop a test automation framework/approach based
on findings and recomendations from the assessment
Plan and Design Test Automation
4/26/2014
7
Slide 13 Software Peace of Mind in Action
???
Determine the number of resources necessary to build
the framework
1 Lead and 3 automation developers
Determine the timeline to completely build out the
framework
5 months
Identify Selenium components, development language,
and IDE
Selenium WebDriver, Ruby, Eclipse
Plan and Design Test Automation
Slide 14 Software Peace of Mind in Action
???
Identify execution environment (physical machines,
VMs, or cloud services)
Cloud service
Identify long-term maintenance and execution resources
The automation engine is handled by a dedicated automation
specialist
The automated tests are supported by QA or development
Determine automation development methodologies
Scrum with 3 weeks sprint
Determine training and mentoring needs
Plan and Design Test Automation
4/26/2014
8
Slide 15 Software Peace of Mind in Action
???
Build the components:
Data file
Object map
Engine components
Logging file
Reporting engine
Test Automation Implementation
Slide 16 Software Peace of Mind in Action
???
Data file: Store test case information
Test Automation Implementation
4/26/2014
9
Slide 17 Software Peace of Mind in Action
???
Object map: Store object information
Test Automation Implementation
Slide 18 Software Peace of Mind in Action
???
Engine components: Interpret test case information to
dynamically create “automation script” during execution
Test Automation Implementation
4/26/2014
10
Slide 19 Software Peace of Mind in Action
???
Logging file: The logging file will capture all the events
that take place in the Interpret Engine. This will help in
debugging the Interpret Engine
Reporting engine: The reporting will be created in html
format. The reporting can be set in two modes; info and
debug. In info mode, the html report will only report on
Verify Action. In debug mode, the html report will
contain all steps in the test case
Test Automation Implementation
Slide 20 Software Peace of Mind in Action
???
Automated 830 test cases
Integration level test cases with average of 38 steps/test
case
20 test cases are used for smoke testing by pairing with
continuous integration tool
Test cases are divided into three priorities (high, medium,
low)
Development and QA determine tests to run
Project Outcome
4/26/2014
11
Slide 21 Software Peace of Mind in Action
???
Execution of full automation suite takes around 3
hours using Sauce Lab
Manual testing would have taken 4 resources 40 hours to
execute the same suite
Maintenance of the suite, on average, is less than 8 hours
per execution
New enhancements for the automation framework
Data file will be replaced by database tables
A web UI will be created to make test case creation faster
A test execution scheduler will be created to manage off-
hour execution
Outcome of the project
Slide 22 Software Peace of Mind in Action
???
There are many benefits to leverage Selenium for test
automation. However, it is important to create a
detailed plan and roadmap to ensure success.
Conclusion

More Related Content

What's hot (20)

PDF
5 Steps to Jump Start Your Test Automation
Sauce Labs
 
PDF
Top 3 selenium IDE alternatives for Chrome and Firefox
Katalon Studio
 
PPTX
Selenium RC, Selenium WebDriver and HP LoadRunner
Murageppa-QA
 
PDF
Software Testing Tutorial For Beginners | Manual & Automation Testing | Selen...
Edureka!
 
PDF
Introduction to Back End Automation Testing - Nguyen Vu Hoang, Hoang Phi
Ho Chi Minh City Software Testing Club
 
PPTX
Testing NodeJS, REST APIs and MongoDB with UFT
Ori Bendet
 
PDF
Disruptive Technology Trends - Cloud, Mobile, IoT and Beyond
Dr Ganesh Iyer
 
PPTX
Start Your Automation Journey With Rapise
Inflectra
 
PDF
Top 50 Software Testing Interview Questions & Answers | Edureka
Edureka!
 
PDF
Continuous testing for devops
Subrahmaniam S.R.V
 
PDF
Top 10 Automation Testing Tools in 2020
Marianne Harness
 
PPT
Testwarez 2009 Use Proper Tool
Adam Sandman
 
PPTX
Building Resilient Automated UI Tests for Cloud Applications using Scripless ...
Adam Sandman
 
PDF
Functional and Non-functional Test automation
Dr Ganesh Iyer
 
PDF
Test Automation Interview Questions and Answers | Edureka
Edureka!
 
PPTX
Testing Your Software Testers
Ori Bendet
 
PPTX
Four Keys to Efficient DevOps
Perfecto by Perforce
 
PDF
Why Ranorex
Ranorex
 
PPTX
Keeping Your Continuous Test Automation Continuously Valuable
Perfecto by Perforce
 
PDF
Test Environment Management
Kanoah
 
5 Steps to Jump Start Your Test Automation
Sauce Labs
 
Top 3 selenium IDE alternatives for Chrome and Firefox
Katalon Studio
 
Selenium RC, Selenium WebDriver and HP LoadRunner
Murageppa-QA
 
Software Testing Tutorial For Beginners | Manual & Automation Testing | Selen...
Edureka!
 
Introduction to Back End Automation Testing - Nguyen Vu Hoang, Hoang Phi
Ho Chi Minh City Software Testing Club
 
Testing NodeJS, REST APIs and MongoDB with UFT
Ori Bendet
 
Disruptive Technology Trends - Cloud, Mobile, IoT and Beyond
Dr Ganesh Iyer
 
Start Your Automation Journey With Rapise
Inflectra
 
Top 50 Software Testing Interview Questions & Answers | Edureka
Edureka!
 
Continuous testing for devops
Subrahmaniam S.R.V
 
Top 10 Automation Testing Tools in 2020
Marianne Harness
 
Testwarez 2009 Use Proper Tool
Adam Sandman
 
Building Resilient Automated UI Tests for Cloud Applications using Scripless ...
Adam Sandman
 
Functional and Non-functional Test automation
Dr Ganesh Iyer
 
Test Automation Interview Questions and Answers | Edureka
Edureka!
 
Testing Your Software Testers
Ori Bendet
 
Four Keys to Efficient DevOps
Perfecto by Perforce
 
Why Ranorex
Ranorex
 
Keeping Your Continuous Test Automation Continuously Valuable
Perfecto by Perforce
 
Test Environment Management
Kanoah
 

Similar to Leveraging Open Source Automation: A Selenium WebDriver Example (20)

PPTX
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
DevDay Da Nang
 
PDF
Ghhfghjbfyhhebook-agile-software-testing.pdf
4rmgm5snvq
 
PPTX
Software testing
KarnatiChandramoules
 
PPTX
Challenges and Opportunities Faced While Migrating to Selenium
BugRaptors
 
PDF
Learn Selenium - Online Guide
bigspire
 
PPTX
Selenium test automation
Srikanth Vuriti
 
PPT
190711_Testbirds_Selenium_eclipsecon_FINAL_0.ppt
NaviAningi
 
PPT
KKSD_Testbirds_Selenium_eclipsecon_FINAL_0.ppt
Kiran Kumar SD
 
PPTX
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5
hemasubbu08
 
PPTX
AUTOMATION TESTING prsentation about selenium basics and types of selenium co...
ssuser94400e
 
PDF
Automated Testing Using Selenium
TechWell
 
PPTX
Selenium Testing @ Agile Speed
David Harrison
 
PPTX
How selenium can transform your qa career
Shama Ugale
 
PPTX
AUTOMATION TESTING tools extensive application
ssuser94400e
 
ODP
Web Testen mit Selenium
openForce Information Technology GesmbH
 
PPTX
Making the Transition from Manual to Automated Testing
Sauce Labs
 
PDF
Intelligent Testing Tool: Selenium Web Driver
IRJET Journal
 
PDF
Lesson_06_Software_and_Automation_Testing_Frameworks.pdf
Minh Quân Đoàn
 
PDF
Pros and Cons of Selenium In Automation Testing_ A Comprehensive Assessment.pdf
kalichargn70th171
 
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
DevDay Da Nang
 
Ghhfghjbfyhhebook-agile-software-testing.pdf
4rmgm5snvq
 
Software testing
KarnatiChandramoules
 
Challenges and Opportunities Faced While Migrating to Selenium
BugRaptors
 
Learn Selenium - Online Guide
bigspire
 
Selenium test automation
Srikanth Vuriti
 
190711_Testbirds_Selenium_eclipsecon_FINAL_0.ppt
NaviAningi
 
KKSD_Testbirds_Selenium_eclipsecon_FINAL_0.ppt
Kiran Kumar SD
 
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5
hemasubbu08
 
AUTOMATION TESTING prsentation about selenium basics and types of selenium co...
ssuser94400e
 
Automated Testing Using Selenium
TechWell
 
Selenium Testing @ Agile Speed
David Harrison
 
How selenium can transform your qa career
Shama Ugale
 
AUTOMATION TESTING tools extensive application
ssuser94400e
 
Making the Transition from Manual to Automated Testing
Sauce Labs
 
Intelligent Testing Tool: Selenium Web Driver
IRJET Journal
 
Lesson_06_Software_and_Automation_Testing_Frameworks.pdf
Minh Quân Đoàn
 
Pros and Cons of Selenium In Automation Testing_ A Comprehensive Assessment.pdf
kalichargn70th171
 
Ad

More from TechWell (20)

PDF
Failing and Recovering
TechWell
 
PDF
Instill a DevOps Testing Culture in Your Team and Organization
TechWell
 
PDF
Test Design for Fully Automated Build Architecture
TechWell
 
PDF
System-Level Test Automation: Ensuring a Good Start
TechWell
 
PDF
Build Your Mobile App Quality and Test Strategy
TechWell
 
PDF
Testing Transformation: The Art and Science for Success
TechWell
 
PDF
Implement BDD with Cucumber and SpecFlow
TechWell
 
PDF
Develop WebDriver Automated Tests—and Keep Your Sanity
TechWell
 
PDF
Ma 15
TechWell
 
PDF
Eliminate Cloud Waste with a Holistic DevOps Strategy
TechWell
 
PDF
Transform Test Organizations for the New World of DevOps
TechWell
 
PDF
The Fourth Constraint in Project Delivery—Leadership
TechWell
 
PDF
Resolve the Contradiction of Specialists within Agile Teams
TechWell
 
PDF
Pin the Tail on the Metric: A Field-Tested Agile Game
TechWell
 
PDF
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
TechWell
 
PDF
A Business-First Approach to DevOps Implementation
TechWell
 
PDF
Databases in a Continuous Integration/Delivery Process
TechWell
 
PDF
Mobile Testing: What—and What Not—to Automate
TechWell
 
PDF
Cultural Intelligence: A Key Skill for Success
TechWell
 
PDF
Turn the Lights On: A Power Utility Company's Agile Transformation
TechWell
 
Failing and Recovering
TechWell
 
Instill a DevOps Testing Culture in Your Team and Organization
TechWell
 
Test Design for Fully Automated Build Architecture
TechWell
 
System-Level Test Automation: Ensuring a Good Start
TechWell
 
Build Your Mobile App Quality and Test Strategy
TechWell
 
Testing Transformation: The Art and Science for Success
TechWell
 
Implement BDD with Cucumber and SpecFlow
TechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
TechWell
 
Ma 15
TechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
TechWell
 
Transform Test Organizations for the New World of DevOps
TechWell
 
The Fourth Constraint in Project Delivery—Leadership
TechWell
 
Resolve the Contradiction of Specialists within Agile Teams
TechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
TechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
TechWell
 
A Business-First Approach to DevOps Implementation
TechWell
 
Databases in a Continuous Integration/Delivery Process
TechWell
 
Mobile Testing: What—and What Not—to Automate
TechWell
 
Cultural Intelligence: A Key Skill for Success
TechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
TechWell
 
Ad

Recently uploaded (20)

PPTX
Future Tech Innovations 2025 – A TechLists Insight
TechLists
 
PDF
AI Agents in the Cloud: The Rise of Agentic Cloud Architecture
Lilly Gracia
 
PDF
Go Concurrency Real-World Patterns, Pitfalls, and Playground Battles.pdf
Emily Achieng
 
PPTX
Seamless Tech Experiences Showcasing Cross-Platform App Design.pptx
presentifyai
 
PDF
Newgen 2022-Forrester Newgen TEI_13 05 2022-The-Total-Economic-Impact-Newgen-...
darshakparmar
 
PDF
“Squinting Vision Pipelines: Detecting and Correcting Errors in Vision Models...
Edge AI and Vision Alliance
 
PPTX
Designing_the_Future_AI_Driven_Product_Experiences_Across_Devices.pptx
presentifyai
 
PDF
The 2025 InfraRed Report - Redpoint Ventures
Razin Mustafiz
 
PDF
Agentic AI lifecycle for Enterprise Hyper-Automation
Debmalya Biswas
 
PDF
How do you fast track Agentic automation use cases discovery?
DianaGray10
 
PPTX
From Sci-Fi to Reality: Exploring AI Evolution
Svetlana Meissner
 
PPTX
COMPARISON OF RASTER ANALYSIS TOOLS OF QGIS AND ARCGIS
Sharanya Sarkar
 
PDF
Peak of Data & AI Encore AI-Enhanced Workflows for the Real World
Safe Software
 
PPTX
Agentforce World Tour Toronto '25 - MCP with MuleSoft
Alexandra N. Martinez
 
PDF
Reverse Engineering of Security Products: Developing an Advanced Microsoft De...
nwbxhhcyjv
 
PDF
Transcript: Book industry state of the nation 2025 - Tech Forum 2025
BookNet Canada
 
PDF
Newgen Beyond Frankenstein_Build vs Buy_Digital_version.pdf
darshakparmar
 
PDF
SIZING YOUR AIR CONDITIONER---A PRACTICAL GUIDE.pdf
Muhammad Rizwan Akram
 
PPTX
Mastering ODC + Okta Configuration - Chennai OSUG
HathiMaryA
 
PDF
Bitcoin for Millennials podcast with Bram, Power Laws of Bitcoin
Stephen Perrenod
 
Future Tech Innovations 2025 – A TechLists Insight
TechLists
 
AI Agents in the Cloud: The Rise of Agentic Cloud Architecture
Lilly Gracia
 
Go Concurrency Real-World Patterns, Pitfalls, and Playground Battles.pdf
Emily Achieng
 
Seamless Tech Experiences Showcasing Cross-Platform App Design.pptx
presentifyai
 
Newgen 2022-Forrester Newgen TEI_13 05 2022-The-Total-Economic-Impact-Newgen-...
darshakparmar
 
“Squinting Vision Pipelines: Detecting and Correcting Errors in Vision Models...
Edge AI and Vision Alliance
 
Designing_the_Future_AI_Driven_Product_Experiences_Across_Devices.pptx
presentifyai
 
The 2025 InfraRed Report - Redpoint Ventures
Razin Mustafiz
 
Agentic AI lifecycle for Enterprise Hyper-Automation
Debmalya Biswas
 
How do you fast track Agentic automation use cases discovery?
DianaGray10
 
From Sci-Fi to Reality: Exploring AI Evolution
Svetlana Meissner
 
COMPARISON OF RASTER ANALYSIS TOOLS OF QGIS AND ARCGIS
Sharanya Sarkar
 
Peak of Data & AI Encore AI-Enhanced Workflows for the Real World
Safe Software
 
Agentforce World Tour Toronto '25 - MCP with MuleSoft
Alexandra N. Martinez
 
Reverse Engineering of Security Products: Developing an Advanced Microsoft De...
nwbxhhcyjv
 
Transcript: Book industry state of the nation 2025 - Tech Forum 2025
BookNet Canada
 
Newgen Beyond Frankenstein_Build vs Buy_Digital_version.pdf
darshakparmar
 
SIZING YOUR AIR CONDITIONER---A PRACTICAL GUIDE.pdf
Muhammad Rizwan Akram
 
Mastering ODC + Okta Configuration - Chennai OSUG
HathiMaryA
 
Bitcoin for Millennials podcast with Bram, Power Laws of Bitcoin
Stephen Perrenod
 

Leveraging Open Source Automation: A Selenium WebDriver Example

  • 1. W9 Test Automation 5/7/2014 1:45:00 PM Leveraging Open Source Automation: A Selenium WebDriver Example Presented by: David Dang Zenergy Technologies Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ [email protected] ∙ www.sqe.com
  • 2. David Dang Zenergy Technologies David Dang is an industry recognized automation expert who has provided strategy, design, and implementation assistance to more than one hundred organizations. By designing advanced frameworks that reduce maintenance and increase scalability, David ensures clients get the return on investment they expect from automation efforts. As VP of automation solutions for the software QA and testing firm Zenergy Technologies, David is in high demand for his significant knowledge in HP UFT and ALM, SAP automation, Selenium open source frameworks, and mobile testing.
  • 3. 4/26/2014 1 Slide 1 Software Peace of Mind in Action Presented By: David Dang Leveraging Open Source Test Automation: A Selenium WebDriver Case Study StarEast 2014 Slide 2 Software Peace of Mind in Action ??? Introduction Case Study Background Decision to select open source vs. packaged tool Assess and plan for test automation Design an automation framework for Selenium WebDriver Framework Implementation Outcome Conclusion
  • 4. 4/26/2014 2 Slide 3 Software Peace of Mind in Action ??? Most companies grasp the importance of leveraging test automation to increase test coverage, reduce execution time, and provide more frequent testing. But test automation can be expensive. More than ever, companies are seeking open source tools like Selenium to reduce the cost. This case study demonstrates one company’s experience using Selenium for test automation. Introduction Slide 4 Software Peace of Mind in Action ??? Software company that provides online instructional tools for teachers and students Agile software development methodologies used Continuous integration deployed Company open-minded toward open source toolsets Good collaboration between QA and development Automated unit testing paired with Continuous Integration tool Case Study Background
  • 5. 4/26/2014 3 Slide 5 Software Peace of Mind in Action ??? Needed a robust automation suite to perform “UI” testing for integration/regression Needed a subset of the automation suite (smoke test) to run as part of Continuous Integration Needed method for product owner, developers, and QA to create automated tests Needed to ensure maintainability of automated suite Needed the automated suite to handle advanced and dynamic web content Case Study Background Slide 6 Software Peace of Mind in Action ??? Selenium - Positives FREE! Supports multiple browsers Scripts can be created with multiple programming languages (Java, Ruby, Python, etc…) Runs on Windows, Linux, and Mac Not confined to the features of the tool Integrates with other tools Selenium vs. HP UFT
  • 6. 4/26/2014 4 Slide 7 Software Peace of Mind in Action ??? Selenium - Downsides Only supports web-based natively No formal support (the user community provides good feedback but questions are not always answered) Higher technical skillsets necessary to optimize the Selenium framework Reporting features are not as robust Harder to find resources with both QA/testing and Selenium experience Selenium vs. HP UFT Slide 8 Software Peace of Mind in Action ??? UFT - Positives Established tool with wide usage Supports multiple technologies (Web, Java, .Net, SAP, Siebel CRM, PeopleSoft, Terminal Emulator, etc.) Has many built-in features (embedded data table, smart identification, object configuration, object repository, etc.) Ease of use Professional support, although room for improvement Selenium vs. HP UFT
  • 7. 4/26/2014 5 Slide 9 Software Peace of Mind in Action ??? UFT - Downsides Cost! Purchase cost and yearly maintenance fees Only supports IE and Firefox Cannot run multiple instances on one machine Selenium vs. HP UFT Slide 10 Software Peace of Mind in Action ??? Cost Alignment with the organization direction (most of the development toolsets are open source) Alignment with Agile methodologies Ability to test on Mac Ability to test on multiple browsers Perception by both development and QA that Selenium was easier to adapt Factors in choosing Selenium
  • 8. 4/26/2014 6 Slide 11 Software Peace of Mind in Action ??? QA roles and responsibilities Type of testing within a sprint (unit, functional, integration, etc.) Test environments Test data strategies Level of testing (UI, backend, database, etc.) Application technologies Defect tracking QA resource skillsets Assess QA Process Slide 12 Software Peace of Mind in Action ??? Develop a test automation framework/approach based on findings and recomendations from the assessment Plan and Design Test Automation
  • 9. 4/26/2014 7 Slide 13 Software Peace of Mind in Action ??? Determine the number of resources necessary to build the framework 1 Lead and 3 automation developers Determine the timeline to completely build out the framework 5 months Identify Selenium components, development language, and IDE Selenium WebDriver, Ruby, Eclipse Plan and Design Test Automation Slide 14 Software Peace of Mind in Action ??? Identify execution environment (physical machines, VMs, or cloud services) Cloud service Identify long-term maintenance and execution resources The automation engine is handled by a dedicated automation specialist The automated tests are supported by QA or development Determine automation development methodologies Scrum with 3 weeks sprint Determine training and mentoring needs Plan and Design Test Automation
  • 10. 4/26/2014 8 Slide 15 Software Peace of Mind in Action ??? Build the components: Data file Object map Engine components Logging file Reporting engine Test Automation Implementation Slide 16 Software Peace of Mind in Action ??? Data file: Store test case information Test Automation Implementation
  • 11. 4/26/2014 9 Slide 17 Software Peace of Mind in Action ??? Object map: Store object information Test Automation Implementation Slide 18 Software Peace of Mind in Action ??? Engine components: Interpret test case information to dynamically create “automation script” during execution Test Automation Implementation
  • 12. 4/26/2014 10 Slide 19 Software Peace of Mind in Action ??? Logging file: The logging file will capture all the events that take place in the Interpret Engine. This will help in debugging the Interpret Engine Reporting engine: The reporting will be created in html format. The reporting can be set in two modes; info and debug. In info mode, the html report will only report on Verify Action. In debug mode, the html report will contain all steps in the test case Test Automation Implementation Slide 20 Software Peace of Mind in Action ??? Automated 830 test cases Integration level test cases with average of 38 steps/test case 20 test cases are used for smoke testing by pairing with continuous integration tool Test cases are divided into three priorities (high, medium, low) Development and QA determine tests to run Project Outcome
  • 13. 4/26/2014 11 Slide 21 Software Peace of Mind in Action ??? Execution of full automation suite takes around 3 hours using Sauce Lab Manual testing would have taken 4 resources 40 hours to execute the same suite Maintenance of the suite, on average, is less than 8 hours per execution New enhancements for the automation framework Data file will be replaced by database tables A web UI will be created to make test case creation faster A test execution scheduler will be created to manage off- hour execution Outcome of the project Slide 22 Software Peace of Mind in Action ??? There are many benefits to leverage Selenium for test automation. However, it is important to create a detailed plan and roadmap to ensure success. Conclusion