SlideShare a Scribd company logo
©Unpickle, 2016. All Rights Reserved - Privileged and Confidentialwww.unpickle.in
Automated testing of software
applications using Machine Learning
Milind Kelkar
Chief Analytics Officer
August 05, 2016
1
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
CONFERENCE PROGRAM AUG 05, 2016
2
• STePIN SUMMIT 2016
• Conference Day 2
• Park Plaza, Bangalore, India
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
Today’s Agenda
3
• What is Machine Learning (ML)
• Framework to leverage ML
• Software Testing Use Cases
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
Support
Vector
Machine
Machine Learning Techniques
4
Deep
Learning
Dimension
Reduction
Regression
Anomaly Detection Classification
Ensemble Bayes
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
Deep Learning
5
ww.huffingtonpost.com
Driverless Car using Neural Networks
Stay on
Course
Accelerator
Brakes
Steering
Wheel
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential 6
Zebra or
Horse
Stripes
Yes
SLP MLP ABT
No
GBN PNN
Classification
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
Why Machine Learning for Testing
7
• Embed a “robot” inside a program
– Fast, consistent conformance of a product to requirements
• Real time decisioning
– Reduce time to test and monitor
• Software applications we cannot program by hand
– Analyse the weaknesses of test suites so as to be able to
iteratively improve them
• Self-Customization Programs
– Auto-correct complexity of the software application
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
T
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
Framework to leverage ML
8
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
Leveraging Machine Learning (ML)
9
Machines testing software applications
Machines masquerading as Humans
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
Summarizing Machine Learning
10
• Virtual Assistant
• Re-engineering of
test suites
• Driverless Car
• Adaptive
Automation
• Spam detection
• Software Defect
Prediction
• Intelligent Search
• Live Validation
Humans RationalActThink
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
Software defect prediction in 3 steps
11
• Goal of Machine Learning
1. BUILD computer systems
2. Learn from EXPERIENCE
3. Improve PERFORMANCE over experience
1. BUILD
% of code correctly classified as “defect”
or “not a defect”
Machine classifying a line code as “defect”
or “not a defect”
2. EXPERIENCEMachine - Learning from YOU labelling a
code as “defect” or “not a defect”
3. PERFORM
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
Software defect prediction
12
Occurrence of corrections to a tested file
Physical
Line of
Code
Total Line
count
Blank Line
of Code
Comment
Line of
Code
Coupling
between
Objects
Cyclomatic
Complexity
Number
Weighted
Methods per
Class
Depth of
Inheritance
Tree
Source Code
Metric Set
Test Source Code
Metric Set
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
Intelligent Search
13
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
Live Validation - Infer
14
• Finding Bugs before it goes Live
• Potential issues and bad coding habits
• Guesses rationally
• Spot bugs in minutes
• Fix rate of about 80 percent
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
Adaptive Automation – Test Case Generation
15
• Adaptive Automation: Leveraging Machine Learning to Support Uninterrupted Automated Testing of Software
Application; Rajesh Mathur, Scott Miles, Miao Du arXiv:1508.00671v1 [cs.SE] 4 Aug 2015
1. Automatically exploring the screens or
pages
2. Generating tests which exercise all of the
discovered fields
3. Guide the values used in the test cases
4. Employ a database of common field
names and associated formats
5. Historical user interaction logs to test
most often used navigation paths
Check that it
only accepts
mobile formats
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
Act like Humans
16
Commercial Bank of Dubai
https://www.cbd.ae/
Virtual Assistant on the Website
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
Link Problems to Test Cases
17
• Using Machine Learning to Refine Black-Box Test Specifications and Test Suites; Lionel
C. Briand ; Yvan Labiche; Zaheer Bawar; (2007)
Problems Causes
Misspecification
Missed Category
Unused
Categories
Ill-defined
Choices
Missing Test
Cases
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
Languages for Machine Learning
18
• Prolog
• Python
• R
• Matlab
• Scala
• Clojure
• Ruby
• Rapidminer
• Java
• Weka Toolkit
• SpringXD
• Mahout
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
T
©Unpickle, 2016. All Rights Reserved - Privileged and Confidential
Thank You
19
Ad

More Related Content

Similar to Automated testing of software applications using machine learning edited (20)

Swiss Army Knife for Automation Testing
Swiss Army Knife for Automation TestingSwiss Army Knife for Automation Testing
Swiss Army Knife for Automation Testing
Abhishek Kant
 
Ensuring Maximum Quality in the Era of IoT and Wearables
Ensuring Maximum Quality in the Era of IoT and WearablesEnsuring Maximum Quality in the Era of IoT and Wearables
Ensuring Maximum Quality in the Era of IoT and Wearables
Josiah Renaudin
 
Codeless Test Automation - Myth or Magic
Codeless Test Automation - Myth or MagicCodeless Test Automation - Myth or Magic
Codeless Test Automation - Myth or Magic
Adam Sandman
 
5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy
SOASTA
 
3 tips to increase mobile test coverage
3 tips to increase mobile test coverage3 tips to increase mobile test coverage
3 tips to increase mobile test coverage
SOASTA
 
How AI is Transforming Test Automation_ 10 Key Use Cases.pdf
How AI is Transforming Test Automation_ 10 Key Use Cases.pdfHow AI is Transforming Test Automation_ 10 Key Use Cases.pdf
How AI is Transforming Test Automation_ 10 Key Use Cases.pdf
kalichargn70th171
 
How AI is Transforming Test Automation_ 10 Key Use Cases.pdf
How AI is Transforming Test Automation_ 10 Key Use Cases.pdfHow AI is Transforming Test Automation_ 10 Key Use Cases.pdf
How AI is Transforming Test Automation_ 10 Key Use Cases.pdf
flufftailshop
 
Test Automation Seminar Momentum
Test Automation Seminar MomentumTest Automation Seminar Momentum
Test Automation Seminar Momentum
Momentum NI
 
Bhabani Shankar Behera_CV
Bhabani Shankar Behera_CVBhabani Shankar Behera_CV
Bhabani Shankar Behera_CV
chiku134
 
Real Devices or Emulators: Wen to use What for Automated Testing
Real Devices or Emulators: Wen to use What for Automated TestingReal Devices or Emulators: Wen to use What for Automated Testing
Real Devices or Emulators: Wen to use What for Automated Testing
Sauce Labs
 
Amalgamation of BDD, parallel execution and mobile automation
Amalgamation of BDD, parallel execution and mobile automationAmalgamation of BDD, parallel execution and mobile automation
Amalgamation of BDD, parallel execution and mobile automation
Agile Testing Alliance
 
Test Masters 2016 Spring Conference
Test Masters 2016 Spring ConferenceTest Masters 2016 Spring Conference
Test Masters 2016 Spring Conference
Adam Sandman
 
D-CAST: The Future of Agile Testing Meetup
D-CAST: The Future of Agile Testing MeetupD-CAST: The Future of Agile Testing Meetup
D-CAST: The Future of Agile Testing Meetup
Adam Sandman
 
B4usolution_AI for automation
B4usolution_AI for automationB4usolution_AI for automation
B4usolution_AI for automation
b4usolution .
 
Mobile Automation: Lessons From The Trenches
Mobile Automation: Lessons From The TrenchesMobile Automation: Lessons From The Trenches
Mobile Automation: Lessons From The Trenches
Ashok Karania
 
Hyper-connected apps: Hyper-Connected Apps: Testing Peripherals and Mobile Ap...
Hyper-connected apps: Hyper-Connected Apps: Testing Peripherals and Mobile Ap...Hyper-connected apps: Hyper-Connected Apps: Testing Peripherals and Mobile Ap...
Hyper-connected apps: Hyper-Connected Apps: Testing Peripherals and Mobile Ap...
Infostretch
 
Understanding Automated Testing Tools for Web Applications.pdf
Understanding Automated Testing Tools for Web Applications.pdfUnderstanding Automated Testing Tools for Web Applications.pdf
Understanding Automated Testing Tools for Web Applications.pdf
kalichargn70th171
 
Continuous Testing vs Test Automation Share on Facebook Share on LinkedIn Sha...
Continuous Testing vs Test Automation Share on Facebook Share on LinkedIn Sha...Continuous Testing vs Test Automation Share on Facebook Share on LinkedIn Sha...
Continuous Testing vs Test Automation Share on Facebook Share on LinkedIn Sha...
DevOps.com
 
Crowd4Test business_proposal
Crowd4Test business_proposalCrowd4Test business_proposal
Crowd4Test business_proposal
Ranganadh Damera
 
Top 5 Pitfalls of Test Automation and How To Avoid Them
Top 5 Pitfalls of Test Automation and How To Avoid ThemTop 5 Pitfalls of Test Automation and How To Avoid Them
Top 5 Pitfalls of Test Automation and How To Avoid Them
Sundar Sritharan
 
Swiss Army Knife for Automation Testing
Swiss Army Knife for Automation TestingSwiss Army Knife for Automation Testing
Swiss Army Knife for Automation Testing
Abhishek Kant
 
Ensuring Maximum Quality in the Era of IoT and Wearables
Ensuring Maximum Quality in the Era of IoT and WearablesEnsuring Maximum Quality in the Era of IoT and Wearables
Ensuring Maximum Quality in the Era of IoT and Wearables
Josiah Renaudin
 
Codeless Test Automation - Myth or Magic
Codeless Test Automation - Myth or MagicCodeless Test Automation - Myth or Magic
Codeless Test Automation - Myth or Magic
Adam Sandman
 
5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy
SOASTA
 
3 tips to increase mobile test coverage
3 tips to increase mobile test coverage3 tips to increase mobile test coverage
3 tips to increase mobile test coverage
SOASTA
 
How AI is Transforming Test Automation_ 10 Key Use Cases.pdf
How AI is Transforming Test Automation_ 10 Key Use Cases.pdfHow AI is Transforming Test Automation_ 10 Key Use Cases.pdf
How AI is Transforming Test Automation_ 10 Key Use Cases.pdf
kalichargn70th171
 
How AI is Transforming Test Automation_ 10 Key Use Cases.pdf
How AI is Transforming Test Automation_ 10 Key Use Cases.pdfHow AI is Transforming Test Automation_ 10 Key Use Cases.pdf
How AI is Transforming Test Automation_ 10 Key Use Cases.pdf
flufftailshop
 
Test Automation Seminar Momentum
Test Automation Seminar MomentumTest Automation Seminar Momentum
Test Automation Seminar Momentum
Momentum NI
 
Bhabani Shankar Behera_CV
Bhabani Shankar Behera_CVBhabani Shankar Behera_CV
Bhabani Shankar Behera_CV
chiku134
 
Real Devices or Emulators: Wen to use What for Automated Testing
Real Devices or Emulators: Wen to use What for Automated TestingReal Devices or Emulators: Wen to use What for Automated Testing
Real Devices or Emulators: Wen to use What for Automated Testing
Sauce Labs
 
Amalgamation of BDD, parallel execution and mobile automation
Amalgamation of BDD, parallel execution and mobile automationAmalgamation of BDD, parallel execution and mobile automation
Amalgamation of BDD, parallel execution and mobile automation
Agile Testing Alliance
 
Test Masters 2016 Spring Conference
Test Masters 2016 Spring ConferenceTest Masters 2016 Spring Conference
Test Masters 2016 Spring Conference
Adam Sandman
 
D-CAST: The Future of Agile Testing Meetup
D-CAST: The Future of Agile Testing MeetupD-CAST: The Future of Agile Testing Meetup
D-CAST: The Future of Agile Testing Meetup
Adam Sandman
 
B4usolution_AI for automation
B4usolution_AI for automationB4usolution_AI for automation
B4usolution_AI for automation
b4usolution .
 
Mobile Automation: Lessons From The Trenches
Mobile Automation: Lessons From The TrenchesMobile Automation: Lessons From The Trenches
Mobile Automation: Lessons From The Trenches
Ashok Karania
 
Hyper-connected apps: Hyper-Connected Apps: Testing Peripherals and Mobile Ap...
Hyper-connected apps: Hyper-Connected Apps: Testing Peripherals and Mobile Ap...Hyper-connected apps: Hyper-Connected Apps: Testing Peripherals and Mobile Ap...
Hyper-connected apps: Hyper-Connected Apps: Testing Peripherals and Mobile Ap...
Infostretch
 
Understanding Automated Testing Tools for Web Applications.pdf
Understanding Automated Testing Tools for Web Applications.pdfUnderstanding Automated Testing Tools for Web Applications.pdf
Understanding Automated Testing Tools for Web Applications.pdf
kalichargn70th171
 
Continuous Testing vs Test Automation Share on Facebook Share on LinkedIn Sha...
Continuous Testing vs Test Automation Share on Facebook Share on LinkedIn Sha...Continuous Testing vs Test Automation Share on Facebook Share on LinkedIn Sha...
Continuous Testing vs Test Automation Share on Facebook Share on LinkedIn Sha...
DevOps.com
 
Crowd4Test business_proposal
Crowd4Test business_proposalCrowd4Test business_proposal
Crowd4Test business_proposal
Ranganadh Damera
 
Top 5 Pitfalls of Test Automation and How To Avoid Them
Top 5 Pitfalls of Test Automation and How To Avoid ThemTop 5 Pitfalls of Test Automation and How To Avoid Them
Top 5 Pitfalls of Test Automation and How To Avoid Them
Sundar Sritharan
 

Recently uploaded (20)

TYPES OF SOFTWARE_ A Visual Guide.pdf CA SUVIDHA CHAPLOT
TYPES OF SOFTWARE_ A Visual Guide.pdf CA SUVIDHA CHAPLOTTYPES OF SOFTWARE_ A Visual Guide.pdf CA SUVIDHA CHAPLOT
TYPES OF SOFTWARE_ A Visual Guide.pdf CA SUVIDHA CHAPLOT
CA Suvidha Chaplot
 
AI ------------------------------ W1L2.pptx
AI ------------------------------ W1L2.pptxAI ------------------------------ W1L2.pptx
AI ------------------------------ W1L2.pptx
AyeshaJalil6
 
Day 1 MS Excel Basics #.pptxDay 1 MS Excel Basics #.pptxDay 1 MS Excel Basics...
Day 1 MS Excel Basics #.pptxDay 1 MS Excel Basics #.pptxDay 1 MS Excel Basics...Day 1 MS Excel Basics #.pptxDay 1 MS Excel Basics #.pptxDay 1 MS Excel Basics...
Day 1 MS Excel Basics #.pptxDay 1 MS Excel Basics #.pptxDay 1 MS Excel Basics...
Jayantilal Bhanushali
 
Chapter 6-3 Introducingthe Concepts .pptx
Chapter 6-3 Introducingthe Concepts .pptxChapter 6-3 Introducingthe Concepts .pptx
Chapter 6-3 Introducingthe Concepts .pptx
PermissionTafadzwaCh
 
Red Hat Openshift Training - openshift (1).pptx
Red Hat Openshift Training - openshift (1).pptxRed Hat Openshift Training - openshift (1).pptx
Red Hat Openshift Training - openshift (1).pptx
ssuserf60686
 
Mining a Global Trade Process with Data Science - Microsoft
Mining a Global Trade Process with Data Science - MicrosoftMining a Global Trade Process with Data Science - Microsoft
Mining a Global Trade Process with Data Science - Microsoft
Process mining Evangelist
 
AWS RDS Presentation to make concepts easy.pptx
AWS RDS Presentation to make concepts easy.pptxAWS RDS Presentation to make concepts easy.pptx
AWS RDS Presentation to make concepts easy.pptx
bharatkumarbhojwani
 
CERTIFIED BUSINESS ANALYSIS PROFESSIONAL™
CERTIFIED BUSINESS ANALYSIS PROFESSIONAL™CERTIFIED BUSINESS ANALYSIS PROFESSIONAL™
CERTIFIED BUSINESS ANALYSIS PROFESSIONAL™
muhammed84essa
 
How to Set Up Process Mining in a Decentralized Organization?
How to Set Up Process Mining in a Decentralized Organization?How to Set Up Process Mining in a Decentralized Organization?
How to Set Up Process Mining in a Decentralized Organization?
Process mining Evangelist
 
Publication-launch-How-is-Life-for-Children-in-the-Digital-Age-15-May-2025.pdf
Publication-launch-How-is-Life-for-Children-in-the-Digital-Age-15-May-2025.pdfPublication-launch-How-is-Life-for-Children-in-the-Digital-Age-15-May-2025.pdf
Publication-launch-How-is-Life-for-Children-in-the-Digital-Age-15-May-2025.pdf
StatsCommunications
 
Process Mining Machine Recoveries to Reduce Downtime
Process Mining Machine Recoveries to Reduce DowntimeProcess Mining Machine Recoveries to Reduce Downtime
Process Mining Machine Recoveries to Reduce Downtime
Process mining Evangelist
 
report (maam dona subject).pptxhsgwiswhs
report (maam dona subject).pptxhsgwiswhsreport (maam dona subject).pptxhsgwiswhs
report (maam dona subject).pptxhsgwiswhs
AngelPinedaTaguinod
 
Process Mining as Enabler for Digital Transformations
Process Mining as Enabler for Digital TransformationsProcess Mining as Enabler for Digital Transformations
Process Mining as Enabler for Digital Transformations
Process mining Evangelist
 
Time series for yotube_1_data anlysis.pdf
Time series for yotube_1_data anlysis.pdfTime series for yotube_1_data anlysis.pdf
Time series for yotube_1_data anlysis.pdf
asmaamahmoudsaeed
 
Analysis of Billboards hot 100 toop five hit makers on the chart.docx
Analysis of Billboards hot 100 toop five hit makers on the chart.docxAnalysis of Billboards hot 100 toop five hit makers on the chart.docx
Analysis of Billboards hot 100 toop five hit makers on the chart.docx
hershtara1
 
hersh's midterm project.pdf music retail and distribution
hersh's midterm project.pdf music retail and distributionhersh's midterm project.pdf music retail and distribution
hersh's midterm project.pdf music retail and distribution
hershtara1
 
Dr. Robert Krug - Expert In Artificial Intelligence
Dr. Robert Krug - Expert In Artificial IntelligenceDr. Robert Krug - Expert In Artificial Intelligence
Dr. Robert Krug - Expert In Artificial Intelligence
Dr. Robert Krug
 
AWS Certified Machine Learning Slides.pdf
AWS Certified Machine Learning Slides.pdfAWS Certified Machine Learning Slides.pdf
AWS Certified Machine Learning Slides.pdf
philsparkshome
 
Process Mining at Deutsche Bank - Journey
Process Mining at Deutsche Bank - JourneyProcess Mining at Deutsche Bank - Journey
Process Mining at Deutsche Bank - Journey
Process mining Evangelist
 
L1_Slides_Foundational Concepts_508.pptx
L1_Slides_Foundational Concepts_508.pptxL1_Slides_Foundational Concepts_508.pptx
L1_Slides_Foundational Concepts_508.pptx
38NoopurPatel
 
TYPES OF SOFTWARE_ A Visual Guide.pdf CA SUVIDHA CHAPLOT
TYPES OF SOFTWARE_ A Visual Guide.pdf CA SUVIDHA CHAPLOTTYPES OF SOFTWARE_ A Visual Guide.pdf CA SUVIDHA CHAPLOT
TYPES OF SOFTWARE_ A Visual Guide.pdf CA SUVIDHA CHAPLOT
CA Suvidha Chaplot
 
AI ------------------------------ W1L2.pptx
AI ------------------------------ W1L2.pptxAI ------------------------------ W1L2.pptx
AI ------------------------------ W1L2.pptx
AyeshaJalil6
 
Day 1 MS Excel Basics #.pptxDay 1 MS Excel Basics #.pptxDay 1 MS Excel Basics...
Day 1 MS Excel Basics #.pptxDay 1 MS Excel Basics #.pptxDay 1 MS Excel Basics...Day 1 MS Excel Basics #.pptxDay 1 MS Excel Basics #.pptxDay 1 MS Excel Basics...
Day 1 MS Excel Basics #.pptxDay 1 MS Excel Basics #.pptxDay 1 MS Excel Basics...
Jayantilal Bhanushali
 
Chapter 6-3 Introducingthe Concepts .pptx
Chapter 6-3 Introducingthe Concepts .pptxChapter 6-3 Introducingthe Concepts .pptx
Chapter 6-3 Introducingthe Concepts .pptx
PermissionTafadzwaCh
 
Red Hat Openshift Training - openshift (1).pptx
Red Hat Openshift Training - openshift (1).pptxRed Hat Openshift Training - openshift (1).pptx
Red Hat Openshift Training - openshift (1).pptx
ssuserf60686
 
Mining a Global Trade Process with Data Science - Microsoft
Mining a Global Trade Process with Data Science - MicrosoftMining a Global Trade Process with Data Science - Microsoft
Mining a Global Trade Process with Data Science - Microsoft
Process mining Evangelist
 
AWS RDS Presentation to make concepts easy.pptx
AWS RDS Presentation to make concepts easy.pptxAWS RDS Presentation to make concepts easy.pptx
AWS RDS Presentation to make concepts easy.pptx
bharatkumarbhojwani
 
CERTIFIED BUSINESS ANALYSIS PROFESSIONAL™
CERTIFIED BUSINESS ANALYSIS PROFESSIONAL™CERTIFIED BUSINESS ANALYSIS PROFESSIONAL™
CERTIFIED BUSINESS ANALYSIS PROFESSIONAL™
muhammed84essa
 
How to Set Up Process Mining in a Decentralized Organization?
How to Set Up Process Mining in a Decentralized Organization?How to Set Up Process Mining in a Decentralized Organization?
How to Set Up Process Mining in a Decentralized Organization?
Process mining Evangelist
 
Publication-launch-How-is-Life-for-Children-in-the-Digital-Age-15-May-2025.pdf
Publication-launch-How-is-Life-for-Children-in-the-Digital-Age-15-May-2025.pdfPublication-launch-How-is-Life-for-Children-in-the-Digital-Age-15-May-2025.pdf
Publication-launch-How-is-Life-for-Children-in-the-Digital-Age-15-May-2025.pdf
StatsCommunications
 
Process Mining Machine Recoveries to Reduce Downtime
Process Mining Machine Recoveries to Reduce DowntimeProcess Mining Machine Recoveries to Reduce Downtime
Process Mining Machine Recoveries to Reduce Downtime
Process mining Evangelist
 
report (maam dona subject).pptxhsgwiswhs
report (maam dona subject).pptxhsgwiswhsreport (maam dona subject).pptxhsgwiswhs
report (maam dona subject).pptxhsgwiswhs
AngelPinedaTaguinod
 
Process Mining as Enabler for Digital Transformations
Process Mining as Enabler for Digital TransformationsProcess Mining as Enabler for Digital Transformations
Process Mining as Enabler for Digital Transformations
Process mining Evangelist
 
Time series for yotube_1_data anlysis.pdf
Time series for yotube_1_data anlysis.pdfTime series for yotube_1_data anlysis.pdf
Time series for yotube_1_data anlysis.pdf
asmaamahmoudsaeed
 
Analysis of Billboards hot 100 toop five hit makers on the chart.docx
Analysis of Billboards hot 100 toop five hit makers on the chart.docxAnalysis of Billboards hot 100 toop five hit makers on the chart.docx
Analysis of Billboards hot 100 toop five hit makers on the chart.docx
hershtara1
 
hersh's midterm project.pdf music retail and distribution
hersh's midterm project.pdf music retail and distributionhersh's midterm project.pdf music retail and distribution
hersh's midterm project.pdf music retail and distribution
hershtara1
 
Dr. Robert Krug - Expert In Artificial Intelligence
Dr. Robert Krug - Expert In Artificial IntelligenceDr. Robert Krug - Expert In Artificial Intelligence
Dr. Robert Krug - Expert In Artificial Intelligence
Dr. Robert Krug
 
AWS Certified Machine Learning Slides.pdf
AWS Certified Machine Learning Slides.pdfAWS Certified Machine Learning Slides.pdf
AWS Certified Machine Learning Slides.pdf
philsparkshome
 
L1_Slides_Foundational Concepts_508.pptx
L1_Slides_Foundational Concepts_508.pptxL1_Slides_Foundational Concepts_508.pptx
L1_Slides_Foundational Concepts_508.pptx
38NoopurPatel
 
Ad

Automated testing of software applications using machine learning edited

  • 1. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidentialwww.unpickle.in Automated testing of software applications using Machine Learning Milind Kelkar Chief Analytics Officer August 05, 2016 1
  • 2. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential CONFERENCE PROGRAM AUG 05, 2016 2 • STePIN SUMMIT 2016 • Conference Day 2 • Park Plaza, Bangalore, India
  • 3. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential Today’s Agenda 3 • What is Machine Learning (ML) • Framework to leverage ML • Software Testing Use Cases
  • 4. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential Support Vector Machine Machine Learning Techniques 4 Deep Learning Dimension Reduction Regression Anomaly Detection Classification Ensemble Bayes
  • 5. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential Deep Learning 5 ww.huffingtonpost.com Driverless Car using Neural Networks Stay on Course Accelerator Brakes Steering Wheel
  • 6. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential 6 Zebra or Horse Stripes Yes SLP MLP ABT No GBN PNN Classification
  • 7. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential Why Machine Learning for Testing 7 • Embed a “robot” inside a program – Fast, consistent conformance of a product to requirements • Real time decisioning – Reduce time to test and monitor • Software applications we cannot program by hand – Analyse the weaknesses of test suites so as to be able to iteratively improve them • Self-Customization Programs – Auto-correct complexity of the software application
  • 8. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential T ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential Framework to leverage ML 8
  • 9. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential Leveraging Machine Learning (ML) 9 Machines testing software applications Machines masquerading as Humans
  • 10. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential Summarizing Machine Learning 10 • Virtual Assistant • Re-engineering of test suites • Driverless Car • Adaptive Automation • Spam detection • Software Defect Prediction • Intelligent Search • Live Validation Humans RationalActThink
  • 11. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential Software defect prediction in 3 steps 11 • Goal of Machine Learning 1. BUILD computer systems 2. Learn from EXPERIENCE 3. Improve PERFORMANCE over experience 1. BUILD % of code correctly classified as “defect” or “not a defect” Machine classifying a line code as “defect” or “not a defect” 2. EXPERIENCEMachine - Learning from YOU labelling a code as “defect” or “not a defect” 3. PERFORM
  • 12. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential Software defect prediction 12 Occurrence of corrections to a tested file Physical Line of Code Total Line count Blank Line of Code Comment Line of Code Coupling between Objects Cyclomatic Complexity Number Weighted Methods per Class Depth of Inheritance Tree Source Code Metric Set Test Source Code Metric Set
  • 13. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential Intelligent Search 13
  • 14. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential Live Validation - Infer 14 • Finding Bugs before it goes Live • Potential issues and bad coding habits • Guesses rationally • Spot bugs in minutes • Fix rate of about 80 percent
  • 15. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential Adaptive Automation – Test Case Generation 15 • Adaptive Automation: Leveraging Machine Learning to Support Uninterrupted Automated Testing of Software Application; Rajesh Mathur, Scott Miles, Miao Du arXiv:1508.00671v1 [cs.SE] 4 Aug 2015 1. Automatically exploring the screens or pages 2. Generating tests which exercise all of the discovered fields 3. Guide the values used in the test cases 4. Employ a database of common field names and associated formats 5. Historical user interaction logs to test most often used navigation paths Check that it only accepts mobile formats
  • 16. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential Act like Humans 16 Commercial Bank of Dubai https://www.cbd.ae/ Virtual Assistant on the Website
  • 17. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential Link Problems to Test Cases 17 • Using Machine Learning to Refine Black-Box Test Specifications and Test Suites; Lionel C. Briand ; Yvan Labiche; Zaheer Bawar; (2007) Problems Causes Misspecification Missed Category Unused Categories Ill-defined Choices Missing Test Cases
  • 18. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential Languages for Machine Learning 18 • Prolog • Python • R • Matlab • Scala • Clojure • Ruby • Rapidminer • Java • Weka Toolkit • SpringXD • Mahout
  • 19. ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential T ©Unpickle, 2016. All Rights Reserved - Privileged and Confidential Thank You 19