SlideShare a Scribd company logo
The Future of Testing / QA Richard Bornet [email_address] 416-895-7176 www.scenariotester.com
Can we predict the future? Most people say no. We can predict patterns? Future is not just passive, we can affect the future!
History of World in One Slide You can predict the future. But you have to look at the long term big picture. Stone Age -> Agriculture Age -> Industrial Age -> Information Age The one common element across the ages is CHANGE and change is speeding-up. The reason for change is innovation.
How Innovation Changes Work Home workers  Manual  Cottage Industry Central Workplace Manual Work Tools Assembly line for component assembly Robots / Automation Unit Cost Decreased.  Fewer individuals involved in creating the product.
So Where Are We in QA Manual with tools Word Excel Defect-tracking systems Requirements managers Test automation Change in QA will follow traditional growth patterns. Future Goal Much higher productivity and efficiency. Significantly improved ROI
Return on Investment ROI will be the central driving force behind IT budgets in next decade. QA will have to show a +ve ROI. “ Business units will control virtually all discretionary IT spending. ” Gartner
Return on Investment “ Software defects are costing the U.S. economy 60 billion dollars.” National Institute of Standards and  Technology  “ It is much more cost effective to catch a bug in test than it is in production. About half the cost.” “ Quality must be raised without incurring additional costs.”
Moving to an improved ROI Organizations are employing strategies to increase ROI. If catching the defect in QA is more cost-effective than finding it in production then: Finding it before QA will be even more cost effective Not creating it in the 1 st  place will be preferred.
So how is QA going to change? We Predict More testing by End user  5% More testing by Developers  5% Significantly shorter development cycles  7% More knowledgeable QA Resources  7% Increased appreciation for QA    8% Improved Processes  14% More Test Automation  31%
Move to Packaged Software Less in-house development. Buy packages which will execute the functions SAP, BPCS , PeopleSoft. Fewer and larger vendors. Customize for specific business.
What this means for QA Vendors provides a stable application.  Vendors thoroughly test application. QA will need to do less testing. Test A good regression Custom adaptations Concentrate on whether business needs are being met.
Pre-built components   Common model in hardware. Not just objects. Whole functional modules. Storage facility for On Demand videos Database may come for IBM Web Services through .Net Logging and monitoring system through another company.
What this means for QA Vendors provides stable modules. Less testing. Test  A good regression Code that is built in-house Concentrate on whether business needs are being met. Don’t test the video management system, it should work.
Outsourcing   Bring in a third party to develop and maintain your systems. Outsourcers bring: Stable code Libraries of re-usable code Applications tested in various companies Costs shared between clients Faster turnaround.
What this means for QA Outsourcer provides stable code. Outsourcers can perform the QA functions. If testing in house test less testing.  Outsourcer responsible for providing solid code Concentrate on whether business needs are being met.
Offshore development   Same as outsourcing except theoretically cheaper. Again, you can demand stable and defect free code. What this means for QA Less testing
Move testing to the developers   Some companies have moved testing responsibilities onto their developers QA departments shut down or downsized
Move testing to the developers Problems Programmers over worked. Programmers may not know the business. Programmers hate to test. Programmers have time pressures. Person who build should not have sole responsibility for testing. Programmers may not know how to create and execute thorough testing.
Move testing to the developers Advantages Moves testing earlier in development cycle. Cost effective to catch bugs earlier. Catch bugs at development stage even more cost effective. Programmers like to use tools.
Move testing to the developers Extreme programming Programmers design and build in tests Large use of Unit Testing tools Programmers build their own tools Many tools are available often for free.
Test Automation Many organizations try to automate. It has huge potential. Many fail (78%). Almost never is it complete testing. To often it is used for Smoke Tests.
Traditional Development Cycle Courtesy of Borland
New Model
Efficiency Improvements - Define / Requirements Stage Huge cost savings by catching problems early $65 per defect at Requirements stage $1000 to $3000 at System test $10,000 or more in Production Test  the requirements Proof read the requirements There are technologies available now that will: Give you 100 % test coverage Automatically generate test cases Put testers and developers on same page Better tools for management of requirements. In the future  Process will be enhanced, simplified and automated more.
Efficiency Improvements - Design Stage Designers and Developers will build software mindful of  how we are going to test it.  Build tests into the application. Build hooks for testing into application.
Efficiency Improvements Development Stage Unit test automation Automation Deployment Stage Automation Production Automation
TEST AUTOMATION Single biggest change in QA, will be the amount and type of test automation This will include: New types of testing New tools New strategies
Test Automation – Current State Stage 1: Record and Playback Stage 2: Write Code Stage 3: Modularity Stage 4: Data Driven Testing
Test Automation – Who Does What Stage 5: Teach the testers how to program. Stage 6: Make the automation tools simpler Tree view diagrams. “ WinRunner Lite”. Stage 7: Teach programmers the business. Stage 8 : Bring in Automation experts.  Hire a programmer. Bring in an external consultants. Create a test automation team.
Test Automation – Current State None of these stages fit the way testers work. Having to code or handing off your work and responsibilities to a 3 rd  party is not acceptable. Almost never is it complete testing. No wonder many automation efforts fail. (78%).
Stage 9: Empower the TESTERS  Give testers an interface to enter test cases / test scripts. Press a button to execute them. Needs to be simple and powerful. Create test scripts before the application is even built.
Web Services Endorsed by Microsoft, Borland, Sun and IBM. It is the ability to provide hooks to an application which can be utilized by external applications. CIO like it because they can keep their legacy systems. Users like it because they can get new and useful interfaces.
Web Services – Testing  Multiple Inputs GUI application, Palm Pilot, your phone,  your TV, Voice, special devices Testing will be more interesting as new forms of accessibility are developed. Component model of software.
Web Services – Testing Web Services creates a stable environment. Testing components. Testing is split between  Testing the web service Testing the GUI / application Testing the business rules. New simple tools.
 
 
 
New Model
FUTURE: Building the interface between the tests and the app. Currently you Point and Click Building the scripts automatically Screen scrapers Web services test tools will pick up the WSDL file.
FUTURE: Building the interface between the tests and the app. Design Stage Developers when they design application, design hooks into the application to allow for data to be passed to and from the app. Design to expose the application to an outside test tool. Generally straightforward.
FUTURE: Building hooks to test automation into the application  Application arrives automatically automated. Test tool automatically connects test cases and app. Build extra scripts in VB and Java and compile code. Same cost no matter how many testers. Cheaper /more control.
FUTURE: Building testing right into the application.  Hardware manufacturers have been doing this for ages. In Production we call it monitoring. eBay.
Future of QA Test in Production Automatic monitors for functionality and performance. Programs, which can execute tests both automatically and on request. Same set-up can be used at Deployment and Development stage
Future of QA Get requirements right by thoroughly testing them. Automating the writing of the test cases and test scripts. Automated environment for testing  Automatic monitors for functionality and performance. Programs, which can execute tests both automatically and on request. Deployment testing is automated. Production is automatically monitored and tested Automated system allows for Troubleshooting and Diagnostics.
Future QA – Solves problems Increased ROI. Decreased costs. Complete test coverage. Faster turnaround. We need to reinvent ourselves or we will become obsolete. Huge opportunities for QA.
New Model
Contact Information Richard Bornet 416-895-7176 [email_address] Web site www.scenariotester.com Presentation www.scenariotester.com  and go to Articles
Ad

More Related Content

What's hot (20)

Quality Assurance Guidelines
Quality Assurance GuidelinesQuality Assurance Guidelines
Quality Assurance Guidelines
Tim Stribos
 
Scaling Test first for the Enterprise
Scaling Test first for the EnterpriseScaling Test first for the Enterprise
Scaling Test first for the Enterprise
QASymphony
 
Software Testing Interview Questions For Experienced
Software Testing Interview Questions For ExperiencedSoftware Testing Interview Questions For Experienced
Software Testing Interview Questions For Experienced
zynofustechnology
 
Best Practises In Test Automation
Best Practises In Test AutomationBest Practises In Test Automation
Best Practises In Test Automation
99tests
 
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
QA or the Highway
 
Continuous Quality: DevOps with Quality by Josh Eastman
Continuous Quality: DevOps with Quality by Josh EastmanContinuous Quality: DevOps with Quality by Josh Eastman
Continuous Quality: DevOps with Quality by Josh Eastman
QA or the Highway
 
From Zero to 2.7 Million - How Verizon Media Embraced Open Source to Accelera...
From Zero to 2.7 Million - How Verizon Media Embraced Open Source to Accelera...From Zero to 2.7 Million - How Verizon Media Embraced Open Source to Accelera...
From Zero to 2.7 Million - How Verizon Media Embraced Open Source to Accelera...
Sauce Labs
 
Enabling agility with continuous integration testing
Enabling agility with continuous integration testingEnabling agility with continuous integration testing
Enabling agility with continuous integration testing
IBM Rational software
 
Testing Comes into its Own in DevOps by Jack Maher
Testing Comes into its Own in DevOps by Jack MaherTesting Comes into its Own in DevOps by Jack Maher
Testing Comes into its Own in DevOps by Jack Maher
QA or the Highway
 
Try: Fail, Try: Succeed by Tim Grant
Try: Fail, Try: Succeed by Tim GrantTry: Fail, Try: Succeed by Tim Grant
Try: Fail, Try: Succeed by Tim Grant
QA or the Highway
 
Automation testing strategy, approach & planning
Automation testing  strategy, approach & planningAutomation testing  strategy, approach & planning
Automation testing strategy, approach & planning
SivaprasanthRentala1975
 
software testing for beginners
software testing for beginnerssoftware testing for beginners
software testing for beginners
Bharathi Ashok
 
Pooja shift left 1.0
Pooja shift left 1.0Pooja shift left 1.0
Pooja shift left 1.0
Xebia India
 
Testing Your Software Testers
Testing Your Software TestersTesting Your Software Testers
Testing Your Software Testers
Ori Bendet
 
Beginners QA Testing
Beginners QA TestingBeginners QA Testing
Beginners QA Testing
Danielle Mickey
 
IoT Software Testing Challenges: The IoT World Is Really Different
IoT Software Testing Challenges: The IoT World Is Really DifferentIoT Software Testing Challenges: The IoT World Is Really Different
IoT Software Testing Challenges: The IoT World Is Really Different
TechWell
 
Shift left - find defects earlier through automated test and deployment
Shift left - find defects earlier through automated test and deploymentShift left - find defects earlier through automated test and deployment
Shift left - find defects earlier through automated test and deployment
Claudia Ring
 
Zado Success Story - Mobile Automation using Selenium Robotium
Zado Success Story - Mobile Automation using Selenium RobotiumZado Success Story - Mobile Automation using Selenium Robotium
Zado Success Story - Mobile Automation using Selenium Robotium
Zado Technologies
 
AfterTest Madrid March 2016 - DevOps and Testing Introduction
AfterTest Madrid March 2016 - DevOps and Testing IntroductionAfterTest Madrid March 2016 - DevOps and Testing Introduction
AfterTest Madrid March 2016 - DevOps and Testing Introduction
Peter Marshall
 
Testing Solutions for Hyper Connected Apps by Sivakumar Anna
Testing Solutions for Hyper Connected Apps by Sivakumar AnnaTesting Solutions for Hyper Connected Apps by Sivakumar Anna
Testing Solutions for Hyper Connected Apps by Sivakumar Anna
QA or the Highway
 
Quality Assurance Guidelines
Quality Assurance GuidelinesQuality Assurance Guidelines
Quality Assurance Guidelines
Tim Stribos
 
Scaling Test first for the Enterprise
Scaling Test first for the EnterpriseScaling Test first for the Enterprise
Scaling Test first for the Enterprise
QASymphony
 
Software Testing Interview Questions For Experienced
Software Testing Interview Questions For ExperiencedSoftware Testing Interview Questions For Experienced
Software Testing Interview Questions For Experienced
zynofustechnology
 
Best Practises In Test Automation
Best Practises In Test AutomationBest Practises In Test Automation
Best Practises In Test Automation
99tests
 
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
QA or the Highway
 
Continuous Quality: DevOps with Quality by Josh Eastman
Continuous Quality: DevOps with Quality by Josh EastmanContinuous Quality: DevOps with Quality by Josh Eastman
Continuous Quality: DevOps with Quality by Josh Eastman
QA or the Highway
 
From Zero to 2.7 Million - How Verizon Media Embraced Open Source to Accelera...
From Zero to 2.7 Million - How Verizon Media Embraced Open Source to Accelera...From Zero to 2.7 Million - How Verizon Media Embraced Open Source to Accelera...
From Zero to 2.7 Million - How Verizon Media Embraced Open Source to Accelera...
Sauce Labs
 
Enabling agility with continuous integration testing
Enabling agility with continuous integration testingEnabling agility with continuous integration testing
Enabling agility with continuous integration testing
IBM Rational software
 
Testing Comes into its Own in DevOps by Jack Maher
Testing Comes into its Own in DevOps by Jack MaherTesting Comes into its Own in DevOps by Jack Maher
Testing Comes into its Own in DevOps by Jack Maher
QA or the Highway
 
Try: Fail, Try: Succeed by Tim Grant
Try: Fail, Try: Succeed by Tim GrantTry: Fail, Try: Succeed by Tim Grant
Try: Fail, Try: Succeed by Tim Grant
QA or the Highway
 
Automation testing strategy, approach & planning
Automation testing  strategy, approach & planningAutomation testing  strategy, approach & planning
Automation testing strategy, approach & planning
SivaprasanthRentala1975
 
software testing for beginners
software testing for beginnerssoftware testing for beginners
software testing for beginners
Bharathi Ashok
 
Pooja shift left 1.0
Pooja shift left 1.0Pooja shift left 1.0
Pooja shift left 1.0
Xebia India
 
Testing Your Software Testers
Testing Your Software TestersTesting Your Software Testers
Testing Your Software Testers
Ori Bendet
 
IoT Software Testing Challenges: The IoT World Is Really Different
IoT Software Testing Challenges: The IoT World Is Really DifferentIoT Software Testing Challenges: The IoT World Is Really Different
IoT Software Testing Challenges: The IoT World Is Really Different
TechWell
 
Shift left - find defects earlier through automated test and deployment
Shift left - find defects earlier through automated test and deploymentShift left - find defects earlier through automated test and deployment
Shift left - find defects earlier through automated test and deployment
Claudia Ring
 
Zado Success Story - Mobile Automation using Selenium Robotium
Zado Success Story - Mobile Automation using Selenium RobotiumZado Success Story - Mobile Automation using Selenium Robotium
Zado Success Story - Mobile Automation using Selenium Robotium
Zado Technologies
 
AfterTest Madrid March 2016 - DevOps and Testing Introduction
AfterTest Madrid March 2016 - DevOps and Testing IntroductionAfterTest Madrid March 2016 - DevOps and Testing Introduction
AfterTest Madrid March 2016 - DevOps and Testing Introduction
Peter Marshall
 
Testing Solutions for Hyper Connected Apps by Sivakumar Anna
Testing Solutions for Hyper Connected Apps by Sivakumar AnnaTesting Solutions for Hyper Connected Apps by Sivakumar Anna
Testing Solutions for Hyper Connected Apps by Sivakumar Anna
QA or the Highway
 

Viewers also liked (7)

Devopsdays Goteborg 2011 - State of the Union
Devopsdays Goteborg 2011 - State of the UnionDevopsdays Goteborg 2011 - State of the Union
Devopsdays Goteborg 2011 - State of the Union
John Willis
 
2005 Annual Report
2005 Annual Report2005 Annual Report
2005 Annual Report
QuarterlyEarningsReports
 
Cloud Camp Atlanta
Cloud Camp AtlantaCloud Camp Atlanta
Cloud Camp Atlanta
John Willis
 
Guns, Germs and Microservices LISA 2015
Guns, Germs and Microservices  LISA 2015 Guns, Germs and Microservices  LISA 2015
Guns, Germs and Microservices LISA 2015
John Willis
 
Operations as a Strategic Weapon (Part 2)
Operations as a Strategic Weapon (Part 2) Operations as a Strategic Weapon (Part 2)
Operations as a Strategic Weapon (Part 2)
John Willis
 
Opscode Lightning Talk - Operations as Code
Opscode Lightning Talk - Operations as CodeOpscode Lightning Talk - Operations as Code
Opscode Lightning Talk - Operations as Code
John Willis
 
I get up at 7
I get up at 7I get up at 7
I get up at 7
conglaoshi
 
Devopsdays Goteborg 2011 - State of the Union
Devopsdays Goteborg 2011 - State of the UnionDevopsdays Goteborg 2011 - State of the Union
Devopsdays Goteborg 2011 - State of the Union
John Willis
 
Cloud Camp Atlanta
Cloud Camp AtlantaCloud Camp Atlanta
Cloud Camp Atlanta
John Willis
 
Guns, Germs and Microservices LISA 2015
Guns, Germs and Microservices  LISA 2015 Guns, Germs and Microservices  LISA 2015
Guns, Germs and Microservices LISA 2015
John Willis
 
Operations as a Strategic Weapon (Part 2)
Operations as a Strategic Weapon (Part 2) Operations as a Strategic Weapon (Part 2)
Operations as a Strategic Weapon (Part 2)
John Willis
 
Opscode Lightning Talk - Operations as Code
Opscode Lightning Talk - Operations as CodeOpscode Lightning Talk - Operations as Code
Opscode Lightning Talk - Operations as Code
John Willis
 
Ad

Similar to Futureofqa (20)

An Ultimate Guide to Continuous Testing in Agile Projects.pdf
An Ultimate Guide to Continuous Testing in Agile Projects.pdfAn Ultimate Guide to Continuous Testing in Agile Projects.pdf
An Ultimate Guide to Continuous Testing in Agile Projects.pdf
KMSSolutionsMarketin
 
Future of Test Automation with Latest Trends in Software Testing.pdf
Future of Test Automation with Latest Trends in Software Testing.pdfFuture of Test Automation with Latest Trends in Software Testing.pdf
Future of Test Automation with Latest Trends in Software Testing.pdf
kalichargn70th171
 
Enhancing Software Quality
Enhancing Software QualityEnhancing Software Quality
Enhancing Software Quality
Anand Prabhala
 
A Complete Guide to Codeless Testing.pdf
A Complete Guide to Codeless Testing.pdfA Complete Guide to Codeless Testing.pdf
A Complete Guide to Codeless Testing.pdf
pCloudy
 
A Complete Guide to Functional Testing
A Complete Guide to Functional TestingA Complete Guide to Functional Testing
A Complete Guide to Functional Testing
Matthew Allen
 
Why Enterprises Should Embrace Automated Testing In 2024.pdf
Why Enterprises Should Embrace Automated Testing In 2024.pdfWhy Enterprises Should Embrace Automated Testing In 2024.pdf
Why Enterprises Should Embrace Automated Testing In 2024.pdf
RohitBhandari66
 
Quality at the speed of digital
Quality   at the speed of digitalQuality   at the speed of digital
Quality at the speed of digital
rajni singh
 
Automation Concepts
Automation ConceptsAutomation Concepts
Automation Concepts
Nishant Worah
 
Myths and reality about software testing
Myths and reality about software testingMyths and reality about software testing
Myths and reality about software testing
Alisha Henderson
 
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdfimplementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
sarah david
 
A Complete Guide to Functional Testing
A Complete Guide to Functional TestingA Complete Guide to Functional Testing
A Complete Guide to Functional Testing
Abhay Kumar
 
"Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry""Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry"
Applitools
 
How Does No Code Testing Work........pdf
How Does No Code Testing Work........pdfHow Does No Code Testing Work........pdf
How Does No Code Testing Work........pdf
pcloudy2
 
Improving ROI with Scriptless Test Automation
Improving ROI with Scriptless Test AutomationImproving ROI with Scriptless Test Automation
Improving ROI with Scriptless Test Automation
Mindfire LLC
 
Agile & DevOps - It's all about project success
Agile & DevOps - It's all about project successAgile & DevOps - It's all about project success
Agile & DevOps - It's all about project success
Adam Stephensen
 
5 Essential Tools for a Successful QA Process in Your Startup
5 Essential Tools for a Successful QA Process in Your Startup5 Essential Tools for a Successful QA Process in Your Startup
5 Essential Tools for a Successful QA Process in Your Startup
QuekelsBaro
 
www-valuecoders-com-blog-technology-and-apps-latest-trends-of-qa-engineers-hi...
www-valuecoders-com-blog-technology-and-apps-latest-trends-of-qa-engineers-hi...www-valuecoders-com-blog-technology-and-apps-latest-trends-of-qa-engineers-hi...
www-valuecoders-com-blog-technology-and-apps-latest-trends-of-qa-engineers-hi...
JamesEddie2
 
Agile driven development main principles
Agile driven development main principlesAgile driven development main principles
Agile driven development main principles
Tanya Epstein
 
How to Attain Business Success with CI_CD Pipeline Automation Testing (1).pdf
How to Attain Business Success with CI_CD Pipeline Automation Testing (1).pdfHow to Attain Business Success with CI_CD Pipeline Automation Testing (1).pdf
How to Attain Business Success with CI_CD Pipeline Automation Testing (1).pdf
kalichargn70th171
 
Top 10 Practices for Software Testing in 2023.pptx
Top 10 Practices for Software Testing in 2023.pptxTop 10 Practices for Software Testing in 2023.pptx
Top 10 Practices for Software Testing in 2023.pptx
Oprim Solutions
 
An Ultimate Guide to Continuous Testing in Agile Projects.pdf
An Ultimate Guide to Continuous Testing in Agile Projects.pdfAn Ultimate Guide to Continuous Testing in Agile Projects.pdf
An Ultimate Guide to Continuous Testing in Agile Projects.pdf
KMSSolutionsMarketin
 
Future of Test Automation with Latest Trends in Software Testing.pdf
Future of Test Automation with Latest Trends in Software Testing.pdfFuture of Test Automation with Latest Trends in Software Testing.pdf
Future of Test Automation with Latest Trends in Software Testing.pdf
kalichargn70th171
 
Enhancing Software Quality
Enhancing Software QualityEnhancing Software Quality
Enhancing Software Quality
Anand Prabhala
 
A Complete Guide to Codeless Testing.pdf
A Complete Guide to Codeless Testing.pdfA Complete Guide to Codeless Testing.pdf
A Complete Guide to Codeless Testing.pdf
pCloudy
 
A Complete Guide to Functional Testing
A Complete Guide to Functional TestingA Complete Guide to Functional Testing
A Complete Guide to Functional Testing
Matthew Allen
 
Why Enterprises Should Embrace Automated Testing In 2024.pdf
Why Enterprises Should Embrace Automated Testing In 2024.pdfWhy Enterprises Should Embrace Automated Testing In 2024.pdf
Why Enterprises Should Embrace Automated Testing In 2024.pdf
RohitBhandari66
 
Quality at the speed of digital
Quality   at the speed of digitalQuality   at the speed of digital
Quality at the speed of digital
rajni singh
 
Myths and reality about software testing
Myths and reality about software testingMyths and reality about software testing
Myths and reality about software testing
Alisha Henderson
 
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdfimplementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
sarah david
 
A Complete Guide to Functional Testing
A Complete Guide to Functional TestingA Complete Guide to Functional Testing
A Complete Guide to Functional Testing
Abhay Kumar
 
"Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry""Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry"
Applitools
 
How Does No Code Testing Work........pdf
How Does No Code Testing Work........pdfHow Does No Code Testing Work........pdf
How Does No Code Testing Work........pdf
pcloudy2
 
Improving ROI with Scriptless Test Automation
Improving ROI with Scriptless Test AutomationImproving ROI with Scriptless Test Automation
Improving ROI with Scriptless Test Automation
Mindfire LLC
 
Agile & DevOps - It's all about project success
Agile & DevOps - It's all about project successAgile & DevOps - It's all about project success
Agile & DevOps - It's all about project success
Adam Stephensen
 
5 Essential Tools for a Successful QA Process in Your Startup
5 Essential Tools for a Successful QA Process in Your Startup5 Essential Tools for a Successful QA Process in Your Startup
5 Essential Tools for a Successful QA Process in Your Startup
QuekelsBaro
 
www-valuecoders-com-blog-technology-and-apps-latest-trends-of-qa-engineers-hi...
www-valuecoders-com-blog-technology-and-apps-latest-trends-of-qa-engineers-hi...www-valuecoders-com-blog-technology-and-apps-latest-trends-of-qa-engineers-hi...
www-valuecoders-com-blog-technology-and-apps-latest-trends-of-qa-engineers-hi...
JamesEddie2
 
Agile driven development main principles
Agile driven development main principlesAgile driven development main principles
Agile driven development main principles
Tanya Epstein
 
How to Attain Business Success with CI_CD Pipeline Automation Testing (1).pdf
How to Attain Business Success with CI_CD Pipeline Automation Testing (1).pdfHow to Attain Business Success with CI_CD Pipeline Automation Testing (1).pdf
How to Attain Business Success with CI_CD Pipeline Automation Testing (1).pdf
kalichargn70th171
 
Top 10 Practices for Software Testing in 2023.pptx
Top 10 Practices for Software Testing in 2023.pptxTop 10 Practices for Software Testing in 2023.pptx
Top 10 Practices for Software Testing in 2023.pptx
Oprim Solutions
 
Ad

Recently uploaded (20)

Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptxSpecial Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
shyamraj55
 
Cybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure ADCybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure AD
VICTOR MAESTRE RAMIREZ
 
Cyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of securityCyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of security
riccardosl1
 
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Impelsys Inc.
 
Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.
hpbmnnxrvb
 
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
SOFTTECHHUB
 
tecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdftecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdf
fjgm517
 
Electronic_Mail_Attacks-1-35.pdf by xploit
Electronic_Mail_Attacks-1-35.pdf by xploitElectronic_Mail_Attacks-1-35.pdf by xploit
Electronic_Mail_Attacks-1-35.pdf by xploit
niftliyevhuseyn
 
How analogue intelligence complements AI
How analogue intelligence complements AIHow analogue intelligence complements AI
How analogue intelligence complements AI
Paul Rowe
 
Quantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur MorganQuantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur Morgan
Arthur Morgan
 
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsTechnology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data Analytics
InData Labs
 
Generative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in BusinessGenerative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in Business
Dr. Tathagat Varma
 
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell
 
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul
 
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In FranceManifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
chb3
 
Big Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur MorganBig Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur Morgan
Arthur Morgan
 
What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...
Vishnu Singh Chundawat
 
TrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business ConsultingTrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business Consulting
Trs Labs
 
Heap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and DeletionHeap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and Deletion
Jaydeep Kale
 
Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)
Ortus Solutions, Corp
 
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptxSpecial Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
shyamraj55
 
Cybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure ADCybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure AD
VICTOR MAESTRE RAMIREZ
 
Cyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of securityCyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of security
riccardosl1
 
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Impelsys Inc.
 
Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.
hpbmnnxrvb
 
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
SOFTTECHHUB
 
tecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdftecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdf
fjgm517
 
Electronic_Mail_Attacks-1-35.pdf by xploit
Electronic_Mail_Attacks-1-35.pdf by xploitElectronic_Mail_Attacks-1-35.pdf by xploit
Electronic_Mail_Attacks-1-35.pdf by xploit
niftliyevhuseyn
 
How analogue intelligence complements AI
How analogue intelligence complements AIHow analogue intelligence complements AI
How analogue intelligence complements AI
Paul Rowe
 
Quantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur MorganQuantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur Morgan
Arthur Morgan
 
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsTechnology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data Analytics
InData Labs
 
Generative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in BusinessGenerative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in Business
Dr. Tathagat Varma
 
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell
 
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul
 
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In FranceManifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
chb3
 
Big Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur MorganBig Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur Morgan
Arthur Morgan
 
What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...
Vishnu Singh Chundawat
 
TrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business ConsultingTrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business Consulting
Trs Labs
 
Heap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and DeletionHeap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and Deletion
Jaydeep Kale
 
Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)
Ortus Solutions, Corp
 

Futureofqa

  • 1. The Future of Testing / QA Richard Bornet [email_address] 416-895-7176 www.scenariotester.com
  • 2. Can we predict the future? Most people say no. We can predict patterns? Future is not just passive, we can affect the future!
  • 3. History of World in One Slide You can predict the future. But you have to look at the long term big picture. Stone Age -> Agriculture Age -> Industrial Age -> Information Age The one common element across the ages is CHANGE and change is speeding-up. The reason for change is innovation.
  • 4. How Innovation Changes Work Home workers Manual Cottage Industry Central Workplace Manual Work Tools Assembly line for component assembly Robots / Automation Unit Cost Decreased. Fewer individuals involved in creating the product.
  • 5. So Where Are We in QA Manual with tools Word Excel Defect-tracking systems Requirements managers Test automation Change in QA will follow traditional growth patterns. Future Goal Much higher productivity and efficiency. Significantly improved ROI
  • 6. Return on Investment ROI will be the central driving force behind IT budgets in next decade. QA will have to show a +ve ROI. “ Business units will control virtually all discretionary IT spending. ” Gartner
  • 7. Return on Investment “ Software defects are costing the U.S. economy 60 billion dollars.” National Institute of Standards and Technology “ It is much more cost effective to catch a bug in test than it is in production. About half the cost.” “ Quality must be raised without incurring additional costs.”
  • 8. Moving to an improved ROI Organizations are employing strategies to increase ROI. If catching the defect in QA is more cost-effective than finding it in production then: Finding it before QA will be even more cost effective Not creating it in the 1 st place will be preferred.
  • 9. So how is QA going to change? We Predict More testing by End user 5% More testing by Developers 5% Significantly shorter development cycles 7% More knowledgeable QA Resources 7% Increased appreciation for QA 8% Improved Processes 14% More Test Automation 31%
  • 10. Move to Packaged Software Less in-house development. Buy packages which will execute the functions SAP, BPCS , PeopleSoft. Fewer and larger vendors. Customize for specific business.
  • 11. What this means for QA Vendors provides a stable application. Vendors thoroughly test application. QA will need to do less testing. Test A good regression Custom adaptations Concentrate on whether business needs are being met.
  • 12. Pre-built components Common model in hardware. Not just objects. Whole functional modules. Storage facility for On Demand videos Database may come for IBM Web Services through .Net Logging and monitoring system through another company.
  • 13. What this means for QA Vendors provides stable modules. Less testing. Test A good regression Code that is built in-house Concentrate on whether business needs are being met. Don’t test the video management system, it should work.
  • 14. Outsourcing Bring in a third party to develop and maintain your systems. Outsourcers bring: Stable code Libraries of re-usable code Applications tested in various companies Costs shared between clients Faster turnaround.
  • 15. What this means for QA Outsourcer provides stable code. Outsourcers can perform the QA functions. If testing in house test less testing. Outsourcer responsible for providing solid code Concentrate on whether business needs are being met.
  • 16. Offshore development Same as outsourcing except theoretically cheaper. Again, you can demand stable and defect free code. What this means for QA Less testing
  • 17. Move testing to the developers Some companies have moved testing responsibilities onto their developers QA departments shut down or downsized
  • 18. Move testing to the developers Problems Programmers over worked. Programmers may not know the business. Programmers hate to test. Programmers have time pressures. Person who build should not have sole responsibility for testing. Programmers may not know how to create and execute thorough testing.
  • 19. Move testing to the developers Advantages Moves testing earlier in development cycle. Cost effective to catch bugs earlier. Catch bugs at development stage even more cost effective. Programmers like to use tools.
  • 20. Move testing to the developers Extreme programming Programmers design and build in tests Large use of Unit Testing tools Programmers build their own tools Many tools are available often for free.
  • 21. Test Automation Many organizations try to automate. It has huge potential. Many fail (78%). Almost never is it complete testing. To often it is used for Smoke Tests.
  • 22. Traditional Development Cycle Courtesy of Borland
  • 24. Efficiency Improvements - Define / Requirements Stage Huge cost savings by catching problems early $65 per defect at Requirements stage $1000 to $3000 at System test $10,000 or more in Production Test the requirements Proof read the requirements There are technologies available now that will: Give you 100 % test coverage Automatically generate test cases Put testers and developers on same page Better tools for management of requirements. In the future Process will be enhanced, simplified and automated more.
  • 25. Efficiency Improvements - Design Stage Designers and Developers will build software mindful of how we are going to test it. Build tests into the application. Build hooks for testing into application.
  • 26. Efficiency Improvements Development Stage Unit test automation Automation Deployment Stage Automation Production Automation
  • 27. TEST AUTOMATION Single biggest change in QA, will be the amount and type of test automation This will include: New types of testing New tools New strategies
  • 28. Test Automation – Current State Stage 1: Record and Playback Stage 2: Write Code Stage 3: Modularity Stage 4: Data Driven Testing
  • 29. Test Automation – Who Does What Stage 5: Teach the testers how to program. Stage 6: Make the automation tools simpler Tree view diagrams. “ WinRunner Lite”. Stage 7: Teach programmers the business. Stage 8 : Bring in Automation experts. Hire a programmer. Bring in an external consultants. Create a test automation team.
  • 30. Test Automation – Current State None of these stages fit the way testers work. Having to code or handing off your work and responsibilities to a 3 rd party is not acceptable. Almost never is it complete testing. No wonder many automation efforts fail. (78%).
  • 31. Stage 9: Empower the TESTERS Give testers an interface to enter test cases / test scripts. Press a button to execute them. Needs to be simple and powerful. Create test scripts before the application is even built.
  • 32. Web Services Endorsed by Microsoft, Borland, Sun and IBM. It is the ability to provide hooks to an application which can be utilized by external applications. CIO like it because they can keep their legacy systems. Users like it because they can get new and useful interfaces.
  • 33. Web Services – Testing Multiple Inputs GUI application, Palm Pilot, your phone, your TV, Voice, special devices Testing will be more interesting as new forms of accessibility are developed. Component model of software.
  • 34. Web Services – Testing Web Services creates a stable environment. Testing components. Testing is split between Testing the web service Testing the GUI / application Testing the business rules. New simple tools.
  • 35.  
  • 36.  
  • 37.  
  • 39. FUTURE: Building the interface between the tests and the app. Currently you Point and Click Building the scripts automatically Screen scrapers Web services test tools will pick up the WSDL file.
  • 40. FUTURE: Building the interface between the tests and the app. Design Stage Developers when they design application, design hooks into the application to allow for data to be passed to and from the app. Design to expose the application to an outside test tool. Generally straightforward.
  • 41. FUTURE: Building hooks to test automation into the application Application arrives automatically automated. Test tool automatically connects test cases and app. Build extra scripts in VB and Java and compile code. Same cost no matter how many testers. Cheaper /more control.
  • 42. FUTURE: Building testing right into the application. Hardware manufacturers have been doing this for ages. In Production we call it monitoring. eBay.
  • 43. Future of QA Test in Production Automatic monitors for functionality and performance. Programs, which can execute tests both automatically and on request. Same set-up can be used at Deployment and Development stage
  • 44. Future of QA Get requirements right by thoroughly testing them. Automating the writing of the test cases and test scripts. Automated environment for testing Automatic monitors for functionality and performance. Programs, which can execute tests both automatically and on request. Deployment testing is automated. Production is automatically monitored and tested Automated system allows for Troubleshooting and Diagnostics.
  • 45. Future QA – Solves problems Increased ROI. Decreased costs. Complete test coverage. Faster turnaround. We need to reinvent ourselves or we will become obsolete. Huge opportunities for QA.
  • 47. Contact Information Richard Bornet 416-895-7176 [email_address] Web site www.scenariotester.com Presentation www.scenariotester.com and go to Articles