SlideShare a Scribd company logo
SOFTWARE TESTING
METRICS
Presenter : P.M.Venkatesh Babu
2
What is a METRIC
• Metrics can be defined as “STANDARDS OF
MEASUREMENT
• Metric is a unit used for describing or
measuring an attribute
• Test metrics are the means by which the
software quality can be measured
• Test metrics provides the visibility into the
readiness of the product, and gives clear
measurement of the quality and
completeness of the product
3
Why we need Metrics ?
• You cannot improve what you cannot measure
• You cannot Control what you cannot measure
 Without measurement it is impossible to tell whether the
process implemented is improving or not
 Metrics helps in taking decisions for next phase of
activities
 Metrics helps in understanding the type of improvement
required and helps in taking decisions on process or
technology change
4
Why Metrics in Software Testing?
There will be certain questions during and after testing such as :
 How long would it take to test ?
 How Bad / Good is the product?
 How many bugs still remain in the product?
 Will testing be completed on time?
 Was the testing done effectively?
 How much effort went into testing the product?
To Answer these questions properly we need some type of
measurements and record keeping to justify the answers.
This is where the testing metrics comes into picture.
Testing Metrics Life Cycle
 Analysis Phase:
• Identify the Metrics which has to be generated
• Define the identified Metrics
 Communication Phase:
• Explain the need of the Metrics to the stakeholders
• Educate the testing team about the data points for generating the Metrics
 Evaluation Phase:
• Capture and verify the data used for generating the Metrics
• Calculate the Metrics based on the data captured
 Reporting Phase :
• Develop the Metrics report and distribute to the stakeholders
• Take feedback from the stakeholders for any improvements
5
6
Types Of Metrics
Base metrics (Direct Measure)
• The Base metrics constitute the raw data gathered by the
test Engineers throughout the testing effort
• The Base metrics are used to provide project status reports
to the Test lead and to the project manager
• The Base metrics provide the input data to feed into the
formulas used to derive Calculated metrics
• Examples of Base metrics are:
# of test cases
# of test cases executed
7
Types Of Metrics (contd..)
Calculated Metrics (Indirect Measure)
• The Calculated Metrics convert the Base metrics data into
more useful information
• The Calculated Metrics are generally prepared by the Test
lead and is used to track the progress of the project at
different levels like at Module level, at Tester level and for
the project as a whole
• The Calculated Metrics provide valuable information that
when used and implemented often times leads to significant
improvements in the Overall SDLC
8
Base Metrics and Testing Phases
TEST METRIC TESTING PHASE
Number of test cases Test Development Phase
Number of Test cases Passed Test Execution Phase
Number of Test cases Executed Test Execution Phase
Number of Test cases Failed Test Execution Phase
Number of Test cases under
Investigation
Test Development Phase
Number of Test cases Blocked Test Dev / Execution Phase
Number of Test cases Re-
executed
Regression Phase
Number of First run Failures Test execution Phase
Total Executions Test Reporting Phase
Total Passes and Failures Test Reporting Phase
Test case Execution time Test Reporting Phase
Test Execution time Test Reporting Phase
9
Calculated Metrics and Phases
The Following Calculated metrics are created at Test Reporting
Phase or Post Test Analysis Phase:
 % of Test cases Passed
 % of Test Coverage
 % of Defects corrected
 % of Test cases Blocked
 % of Rework
 % of Test Effectiveness
 1st
Run Fail Rate
 Defect discovery rate
 Overall Fail rate
10
Test case Defect Density
The number of errors found in test cases v/s test cases developed and
executed
• ( Defective Test cases / Total Test cases ) * 100
Example : Total no of test cases developed is 1360, total test cases executed
is 1280, total no of test cases passed is 1065, total no of test scripts failed
is 215
So Test case Defect Density is :
215 X 100
------------------------------- = 16.8 %
1280
The 16.8 % value can also be called as Test Case Efficiency % which
depends upon the total number of Test cases which found defects
11
Defect Slippage Ratio
No of bugs reported from Production V/S No of defects reported during
execution
No of Defects slipped / ( Number of Defects Raised – Number Defects
Withdrawn) * 100
Example : Customer reported 21 defects, total no of defects found
while testing are, total no of Invalid defects are 17
So Slippage ratio is : [ 21 / (267 – 17) ] X 100 = 8.4%
12
Requirement Volatility Metric
This metric ensures that the requirements are normalized or defined
properly while estimating
No of requirements agreed V/S No of requirements changed
• (No of requirements Added + Deleted + Modified) * 100 / No of
original requirements
Example : SVN 1.3 release has 67 requirements initially, later 7 new
requirements are added, 3 requirements are deleted from initial
requirements and modified 11 requirements
Hence Requirement volatility is calculated as :
(7 + 3 + 11 ) X 100 / 67 = 31.34 %
This means that almost 1/3 of the requirements changed after the initial
identification of requirements
13
Conclusion
• The Test metrics should be reviewed & interpreted on regular basis
throughout the test effort and particularly after the application is
released into production
• There are several key factors in implementing and using the metrics
in the organization, beginning with determining the goal for
developing the metrics, followed by the identification of metrics to be
tracked and ending with sufficient analysis of the resulting data to be
able to make changes to the software development lifecycle
• - So finally Metrics themselves so not create improvements, they do
provide the objective information necessary to understand what
changes are necessary to be implemented
14
Questions ???
Ad

More Related Content

What's hot (20)

STLC (Software Testing Life Cycle)
STLC (Software Testing Life Cycle)STLC (Software Testing Life Cycle)
STLC (Software Testing Life Cycle)
Ch Fahadi
 
Software Test Metrics and Measurements
Software Test Metrics and MeasurementsSoftware Test Metrics and Measurements
Software Test Metrics and Measurements
Davis Thomas
 
Test Management introduction
Test Management introductionTest Management introduction
Test Management introduction
Oana Feidi
 
Software Testing Life Cycle – A Beginner’s Guide
Software Testing Life Cycle – A Beginner’s GuideSoftware Testing Life Cycle – A Beginner’s Guide
Software Testing Life Cycle – A Beginner’s Guide
Syed Hassan Raza
 
SOFTWARE TESTING
SOFTWARE TESTINGSOFTWARE TESTING
SOFTWARE TESTING
Priyanka Karancy
 
Software testing life cycle
Software testing life cycleSoftware testing life cycle
Software testing life cycle
Garuda Trainings
 
Software testing & Quality Assurance
Software testing & Quality Assurance Software testing & Quality Assurance
Software testing & Quality Assurance
Webtech Learning
 
Types of testing
Types of testingTypes of testing
Types of testing
Sonam Agarwal
 
Software testing
Software testingSoftware testing
Software testing
balamurugan.k Kalibalamurugan
 
Types of software testing
Types of software testingTypes of software testing
Types of software testing
Prachi Sasankar
 
Software testing methods, levels and types
Software testing methods, levels and typesSoftware testing methods, levels and types
Software testing methods, levels and types
Confiz
 
SOFTWARE TESTING UNIT-4
SOFTWARE TESTING UNIT-4  SOFTWARE TESTING UNIT-4
SOFTWARE TESTING UNIT-4
Mohammad Faizan
 
Software Testing Life Cycle (STLC) | Software Testing Tutorial | Edureka
Software Testing Life Cycle (STLC) | Software Testing Tutorial | EdurekaSoftware Testing Life Cycle (STLC) | Software Testing Tutorial | Edureka
Software Testing Life Cycle (STLC) | Software Testing Tutorial | Edureka
Edureka!
 
Software Testing Fundamentals
Software Testing FundamentalsSoftware Testing Fundamentals
Software Testing Fundamentals
Chankey Pathak
 
Software Testing - Part 1 (Techniques, Types, Levels, Methods, STLC, Bug Life...
Software Testing - Part 1 (Techniques, Types, Levels, Methods, STLC, Bug Life...Software Testing - Part 1 (Techniques, Types, Levels, Methods, STLC, Bug Life...
Software Testing - Part 1 (Techniques, Types, Levels, Methods, STLC, Bug Life...
Ankit Prajapati
 
Basic software-testing-concepts
Basic software-testing-conceptsBasic software-testing-concepts
Basic software-testing-concepts
medsherb
 
Software Testing Process
Software Testing ProcessSoftware Testing Process
Software Testing Process
guest1f2740
 
Integration testing
Integration testingIntegration testing
Integration testing
queen jemila
 
Software Testing or Quality Assurance
Software Testing or Quality AssuranceSoftware Testing or Quality Assurance
Software Testing or Quality Assurance
Trimantra Software Solutions
 
Quality Assurance and Software Testing
Quality Assurance and Software TestingQuality Assurance and Software Testing
Quality Assurance and Software Testing
pingkapil
 
STLC (Software Testing Life Cycle)
STLC (Software Testing Life Cycle)STLC (Software Testing Life Cycle)
STLC (Software Testing Life Cycle)
Ch Fahadi
 
Software Test Metrics and Measurements
Software Test Metrics and MeasurementsSoftware Test Metrics and Measurements
Software Test Metrics and Measurements
Davis Thomas
 
Test Management introduction
Test Management introductionTest Management introduction
Test Management introduction
Oana Feidi
 
Software Testing Life Cycle – A Beginner’s Guide
Software Testing Life Cycle – A Beginner’s GuideSoftware Testing Life Cycle – A Beginner’s Guide
Software Testing Life Cycle – A Beginner’s Guide
Syed Hassan Raza
 
Software testing life cycle
Software testing life cycleSoftware testing life cycle
Software testing life cycle
Garuda Trainings
 
Software testing & Quality Assurance
Software testing & Quality Assurance Software testing & Quality Assurance
Software testing & Quality Assurance
Webtech Learning
 
Types of software testing
Types of software testingTypes of software testing
Types of software testing
Prachi Sasankar
 
Software testing methods, levels and types
Software testing methods, levels and typesSoftware testing methods, levels and types
Software testing methods, levels and types
Confiz
 
SOFTWARE TESTING UNIT-4
SOFTWARE TESTING UNIT-4  SOFTWARE TESTING UNIT-4
SOFTWARE TESTING UNIT-4
Mohammad Faizan
 
Software Testing Life Cycle (STLC) | Software Testing Tutorial | Edureka
Software Testing Life Cycle (STLC) | Software Testing Tutorial | EdurekaSoftware Testing Life Cycle (STLC) | Software Testing Tutorial | Edureka
Software Testing Life Cycle (STLC) | Software Testing Tutorial | Edureka
Edureka!
 
Software Testing Fundamentals
Software Testing FundamentalsSoftware Testing Fundamentals
Software Testing Fundamentals
Chankey Pathak
 
Software Testing - Part 1 (Techniques, Types, Levels, Methods, STLC, Bug Life...
Software Testing - Part 1 (Techniques, Types, Levels, Methods, STLC, Bug Life...Software Testing - Part 1 (Techniques, Types, Levels, Methods, STLC, Bug Life...
Software Testing - Part 1 (Techniques, Types, Levels, Methods, STLC, Bug Life...
Ankit Prajapati
 
Basic software-testing-concepts
Basic software-testing-conceptsBasic software-testing-concepts
Basic software-testing-concepts
medsherb
 
Software Testing Process
Software Testing ProcessSoftware Testing Process
Software Testing Process
guest1f2740
 
Integration testing
Integration testingIntegration testing
Integration testing
queen jemila
 
Quality Assurance and Software Testing
Quality Assurance and Software TestingQuality Assurance and Software Testing
Quality Assurance and Software Testing
pingkapil
 

Viewers also liked (7)

Linux comands for Hadoop
Linux comands for HadoopLinux comands for Hadoop
Linux comands for Hadoop
PM Venkatesha Babu
 
Software Testing Services
Software Testing ServicesSoftware Testing Services
Software Testing Services
Fuad Mak
 
Coding by Example - Tutorial Agiles 2012
Coding by Example - Tutorial Agiles 2012Coding by Example - Tutorial Agiles 2012
Coding by Example - Tutorial Agiles 2012
Wildtech
 
Coding standards
Coding standardsCoding standards
Coding standards
Mimoh Ojha
 
Software coding & testing, software engineering
Software coding & testing, software engineeringSoftware coding & testing, software engineering
Software coding & testing, software engineering
Rupesh Vaishnav
 
Coding standards and guidelines
Coding standards and guidelinesCoding standards and guidelines
Coding standards and guidelines
brijraj_singh
 
Coding and testing in Software Engineering
Coding and testing in Software EngineeringCoding and testing in Software Engineering
Coding and testing in Software Engineering
Abhay Vijay
 
Software Testing Services
Software Testing ServicesSoftware Testing Services
Software Testing Services
Fuad Mak
 
Coding by Example - Tutorial Agiles 2012
Coding by Example - Tutorial Agiles 2012Coding by Example - Tutorial Agiles 2012
Coding by Example - Tutorial Agiles 2012
Wildtech
 
Coding standards
Coding standardsCoding standards
Coding standards
Mimoh Ojha
 
Software coding & testing, software engineering
Software coding & testing, software engineeringSoftware coding & testing, software engineering
Software coding & testing, software engineering
Rupesh Vaishnav
 
Coding standards and guidelines
Coding standards and guidelinesCoding standards and guidelines
Coding standards and guidelines
brijraj_singh
 
Coding and testing in Software Engineering
Coding and testing in Software EngineeringCoding and testing in Software Engineering
Coding and testing in Software Engineering
Abhay Vijay
 
Ad

Similar to Testing Metrics (20)

Testing Metrics and Tools, Analyse de tests
Testing Metrics and Tools, Analyse de testsTesting Metrics and Tools, Analyse de tests
Testing Metrics and Tools, Analyse de tests
HervKoya
 
Software-Testing-Chapgdgdgsghshshshshshshs
Software-Testing-ChapgdgdgsghshshshshshshsSoftware-Testing-Chapgdgdgsghshshshshshshs
Software-Testing-Chapgdgdgsghshshshshshshs
shaikbab
 
Use the Windshield, Not the Mirror Predictive Metrics that Drive Successful ...
 Use the Windshield, Not the Mirror Predictive Metrics that Drive Successful ... Use the Windshield, Not the Mirror Predictive Metrics that Drive Successful ...
Use the Windshield, Not the Mirror Predictive Metrics that Drive Successful ...
Seapine Software
 
A metric expresses the degree to which a system, system component, or process...
A metric expresses the degree to which a system, system component, or process...A metric expresses the degree to which a system, system component, or process...
A metric expresses the degree to which a system, system component, or process...
preekrishiv
 
unit-2_20-july-2018 (1).pptx
unit-2_20-july-2018 (1).pptxunit-2_20-july-2018 (1).pptx
unit-2_20-july-2018 (1).pptx
PriyaFulpagare1
 
Measurements &milestones for monitoring and controlling
Measurements &milestones for monitoring and controllingMeasurements &milestones for monitoring and controlling
Measurements &milestones for monitoring and controlling
Dhiraj Singh
 
Test Planning in Software Testing and Automation.pptx
Test Planning in Software Testing and Automation.pptxTest Planning in Software Testing and Automation.pptx
Test Planning in Software Testing and Automation.pptx
siddiqsid0006
 
Software Engineering (Testing Activities, Management, and Automation)
Software Engineering (Testing Activities, Management, and Automation)Software Engineering (Testing Activities, Management, and Automation)
Software Engineering (Testing Activities, Management, and Automation)
ShudipPal
 
QACampus PPT (STLC)
QACampus PPT (STLC)QACampus PPT (STLC)
QACampus PPT (STLC)
QACampus Noida
 
Software test management
Software test managementSoftware test management
Software test management
Vishad Garg
 
SDET UNIT 3.pptx
SDET UNIT 3.pptxSDET UNIT 3.pptx
SDET UNIT 3.pptx
Dr. Pallawi Bulakh
 
Creating Functional Testing Strategy.pptx
Creating Functional Testing Strategy.pptxCreating Functional Testing Strategy.pptx
Creating Functional Testing Strategy.pptx
Mohit Rajvanshi
 
Test performance indicators
Test performance indicatorsTest performance indicators
Test performance indicators
Idexcel Technologies
 
Test Reporting writing in Software Testing
Test Reporting writing in Software TestingTest Reporting writing in Software Testing
Test Reporting writing in Software Testing
ansari28069
 
Beige Pastel Minimalist Thesis Defense Presentation_20241108_232131_0000.pptx
Beige Pastel Minimalist Thesis Defense Presentation_20241108_232131_0000.pptxBeige Pastel Minimalist Thesis Defense Presentation_20241108_232131_0000.pptx
Beige Pastel Minimalist Thesis Defense Presentation_20241108_232131_0000.pptx
ansari28069
 
1)Testing-Fundamentals_L_D.pptx
1)Testing-Fundamentals_L_D.pptx1)Testing-Fundamentals_L_D.pptx
1)Testing-Fundamentals_L_D.pptx
gianggiang114
 
Chapter 1 Fundamental of testing ISTQB v4
Chapter 1 Fundamental of testing ISTQB v4Chapter 1 Fundamental of testing ISTQB v4
Chapter 1 Fundamental of testing ISTQB v4
LinhNguye
 
What is Test Matrix?
What is Test Matrix?What is Test Matrix?
What is Test Matrix?
QA InfoTech
 
chapter 7.ppt
chapter 7.pptchapter 7.ppt
chapter 7.ppt
TesfahunAsmare1
 
Health Care Project Testing Process
Health Care Project Testing ProcessHealth Care Project Testing Process
Health Care Project Testing Process
H2Kinfosys
 
Testing Metrics and Tools, Analyse de tests
Testing Metrics and Tools, Analyse de testsTesting Metrics and Tools, Analyse de tests
Testing Metrics and Tools, Analyse de tests
HervKoya
 
Software-Testing-Chapgdgdgsghshshshshshshs
Software-Testing-ChapgdgdgsghshshshshshshsSoftware-Testing-Chapgdgdgsghshshshshshshs
Software-Testing-Chapgdgdgsghshshshshshshs
shaikbab
 
Use the Windshield, Not the Mirror Predictive Metrics that Drive Successful ...
 Use the Windshield, Not the Mirror Predictive Metrics that Drive Successful ... Use the Windshield, Not the Mirror Predictive Metrics that Drive Successful ...
Use the Windshield, Not the Mirror Predictive Metrics that Drive Successful ...
Seapine Software
 
A metric expresses the degree to which a system, system component, or process...
A metric expresses the degree to which a system, system component, or process...A metric expresses the degree to which a system, system component, or process...
A metric expresses the degree to which a system, system component, or process...
preekrishiv
 
unit-2_20-july-2018 (1).pptx
unit-2_20-july-2018 (1).pptxunit-2_20-july-2018 (1).pptx
unit-2_20-july-2018 (1).pptx
PriyaFulpagare1
 
Measurements &milestones for monitoring and controlling
Measurements &milestones for monitoring and controllingMeasurements &milestones for monitoring and controlling
Measurements &milestones for monitoring and controlling
Dhiraj Singh
 
Test Planning in Software Testing and Automation.pptx
Test Planning in Software Testing and Automation.pptxTest Planning in Software Testing and Automation.pptx
Test Planning in Software Testing and Automation.pptx
siddiqsid0006
 
Software Engineering (Testing Activities, Management, and Automation)
Software Engineering (Testing Activities, Management, and Automation)Software Engineering (Testing Activities, Management, and Automation)
Software Engineering (Testing Activities, Management, and Automation)
ShudipPal
 
Software test management
Software test managementSoftware test management
Software test management
Vishad Garg
 
Creating Functional Testing Strategy.pptx
Creating Functional Testing Strategy.pptxCreating Functional Testing Strategy.pptx
Creating Functional Testing Strategy.pptx
Mohit Rajvanshi
 
Test Reporting writing in Software Testing
Test Reporting writing in Software TestingTest Reporting writing in Software Testing
Test Reporting writing in Software Testing
ansari28069
 
Beige Pastel Minimalist Thesis Defense Presentation_20241108_232131_0000.pptx
Beige Pastel Minimalist Thesis Defense Presentation_20241108_232131_0000.pptxBeige Pastel Minimalist Thesis Defense Presentation_20241108_232131_0000.pptx
Beige Pastel Minimalist Thesis Defense Presentation_20241108_232131_0000.pptx
ansari28069
 
1)Testing-Fundamentals_L_D.pptx
1)Testing-Fundamentals_L_D.pptx1)Testing-Fundamentals_L_D.pptx
1)Testing-Fundamentals_L_D.pptx
gianggiang114
 
Chapter 1 Fundamental of testing ISTQB v4
Chapter 1 Fundamental of testing ISTQB v4Chapter 1 Fundamental of testing ISTQB v4
Chapter 1 Fundamental of testing ISTQB v4
LinhNguye
 
What is Test Matrix?
What is Test Matrix?What is Test Matrix?
What is Test Matrix?
QA InfoTech
 
Health Care Project Testing Process
Health Care Project Testing ProcessHealth Care Project Testing Process
Health Care Project Testing Process
H2Kinfosys
 
Ad

Recently uploaded (20)

#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
BookNet Canada
 
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Semantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AISemantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AI
artmondano
 
Big Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur MorganBig Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur Morgan
Arthur Morgan
 
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveDesigning Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
ScyllaDB
 
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsTechnology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data Analytics
InData Labs
 
Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)
Ortus Solutions, Corp
 
Rusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond SparkRusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond Spark
carlyakerly1
 
tecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdftecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdf
fjgm517
 
Mobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi ArabiaMobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi Arabia
Steve Jonas
 
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
organizerofv
 
Role of Data Annotation Services in AI-Powered Manufacturing
Role of Data Annotation Services in AI-Powered ManufacturingRole of Data Annotation Services in AI-Powered Manufacturing
Role of Data Annotation Services in AI-Powered Manufacturing
Andrew Leo
 
Cybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure ADCybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure AD
VICTOR MAESTRE RAMIREZ
 
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Aqusag Technologies
 
HCL Nomad Web – Best Practices and Managing Multiuser Environments
HCL Nomad Web – Best Practices and Managing Multiuser EnvironmentsHCL Nomad Web – Best Practices and Managing Multiuser Environments
HCL Nomad Web – Best Practices and Managing Multiuser Environments
panagenda
 
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell
 
Complete Guide to Advanced Logistics Management Software in Riyadh.pdf
Complete Guide to Advanced Logistics Management Software in Riyadh.pdfComplete Guide to Advanced Logistics Management Software in Riyadh.pdf
Complete Guide to Advanced Logistics Management Software in Riyadh.pdf
Software Company
 
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In FranceManifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
chb3
 
Procurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptxProcurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptx
Jon Hansen
 
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
BookNet Canada
 
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Semantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AISemantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AI
artmondano
 
Big Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur MorganBig Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur Morgan
Arthur Morgan
 
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveDesigning Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
ScyllaDB
 
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsTechnology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data Analytics
InData Labs
 
Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)
Ortus Solutions, Corp
 
Rusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond SparkRusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond Spark
carlyakerly1
 
tecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdftecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdf
fjgm517
 
Mobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi ArabiaMobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi Arabia
Steve Jonas
 
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
organizerofv
 
Role of Data Annotation Services in AI-Powered Manufacturing
Role of Data Annotation Services in AI-Powered ManufacturingRole of Data Annotation Services in AI-Powered Manufacturing
Role of Data Annotation Services in AI-Powered Manufacturing
Andrew Leo
 
Cybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure ADCybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure AD
VICTOR MAESTRE RAMIREZ
 
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Aqusag Technologies
 
HCL Nomad Web – Best Practices and Managing Multiuser Environments
HCL Nomad Web – Best Practices and Managing Multiuser EnvironmentsHCL Nomad Web – Best Practices and Managing Multiuser Environments
HCL Nomad Web – Best Practices and Managing Multiuser Environments
panagenda
 
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell
 
Complete Guide to Advanced Logistics Management Software in Riyadh.pdf
Complete Guide to Advanced Logistics Management Software in Riyadh.pdfComplete Guide to Advanced Logistics Management Software in Riyadh.pdf
Complete Guide to Advanced Logistics Management Software in Riyadh.pdf
Software Company
 
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In FranceManifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
chb3
 
Procurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptxProcurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptx
Jon Hansen
 

Testing Metrics

  • 2. 2 What is a METRIC • Metrics can be defined as “STANDARDS OF MEASUREMENT • Metric is a unit used for describing or measuring an attribute • Test metrics are the means by which the software quality can be measured • Test metrics provides the visibility into the readiness of the product, and gives clear measurement of the quality and completeness of the product
  • 3. 3 Why we need Metrics ? • You cannot improve what you cannot measure • You cannot Control what you cannot measure  Without measurement it is impossible to tell whether the process implemented is improving or not  Metrics helps in taking decisions for next phase of activities  Metrics helps in understanding the type of improvement required and helps in taking decisions on process or technology change
  • 4. 4 Why Metrics in Software Testing? There will be certain questions during and after testing such as :  How long would it take to test ?  How Bad / Good is the product?  How many bugs still remain in the product?  Will testing be completed on time?  Was the testing done effectively?  How much effort went into testing the product? To Answer these questions properly we need some type of measurements and record keeping to justify the answers. This is where the testing metrics comes into picture.
  • 5. Testing Metrics Life Cycle  Analysis Phase: • Identify the Metrics which has to be generated • Define the identified Metrics  Communication Phase: • Explain the need of the Metrics to the stakeholders • Educate the testing team about the data points for generating the Metrics  Evaluation Phase: • Capture and verify the data used for generating the Metrics • Calculate the Metrics based on the data captured  Reporting Phase : • Develop the Metrics report and distribute to the stakeholders • Take feedback from the stakeholders for any improvements 5
  • 6. 6 Types Of Metrics Base metrics (Direct Measure) • The Base metrics constitute the raw data gathered by the test Engineers throughout the testing effort • The Base metrics are used to provide project status reports to the Test lead and to the project manager • The Base metrics provide the input data to feed into the formulas used to derive Calculated metrics • Examples of Base metrics are: # of test cases # of test cases executed
  • 7. 7 Types Of Metrics (contd..) Calculated Metrics (Indirect Measure) • The Calculated Metrics convert the Base metrics data into more useful information • The Calculated Metrics are generally prepared by the Test lead and is used to track the progress of the project at different levels like at Module level, at Tester level and for the project as a whole • The Calculated Metrics provide valuable information that when used and implemented often times leads to significant improvements in the Overall SDLC
  • 8. 8 Base Metrics and Testing Phases TEST METRIC TESTING PHASE Number of test cases Test Development Phase Number of Test cases Passed Test Execution Phase Number of Test cases Executed Test Execution Phase Number of Test cases Failed Test Execution Phase Number of Test cases under Investigation Test Development Phase Number of Test cases Blocked Test Dev / Execution Phase Number of Test cases Re- executed Regression Phase Number of First run Failures Test execution Phase Total Executions Test Reporting Phase Total Passes and Failures Test Reporting Phase Test case Execution time Test Reporting Phase Test Execution time Test Reporting Phase
  • 9. 9 Calculated Metrics and Phases The Following Calculated metrics are created at Test Reporting Phase or Post Test Analysis Phase:  % of Test cases Passed  % of Test Coverage  % of Defects corrected  % of Test cases Blocked  % of Rework  % of Test Effectiveness  1st Run Fail Rate  Defect discovery rate  Overall Fail rate
  • 10. 10 Test case Defect Density The number of errors found in test cases v/s test cases developed and executed • ( Defective Test cases / Total Test cases ) * 100 Example : Total no of test cases developed is 1360, total test cases executed is 1280, total no of test cases passed is 1065, total no of test scripts failed is 215 So Test case Defect Density is : 215 X 100 ------------------------------- = 16.8 % 1280 The 16.8 % value can also be called as Test Case Efficiency % which depends upon the total number of Test cases which found defects
  • 11. 11 Defect Slippage Ratio No of bugs reported from Production V/S No of defects reported during execution No of Defects slipped / ( Number of Defects Raised – Number Defects Withdrawn) * 100 Example : Customer reported 21 defects, total no of defects found while testing are, total no of Invalid defects are 17 So Slippage ratio is : [ 21 / (267 – 17) ] X 100 = 8.4%
  • 12. 12 Requirement Volatility Metric This metric ensures that the requirements are normalized or defined properly while estimating No of requirements agreed V/S No of requirements changed • (No of requirements Added + Deleted + Modified) * 100 / No of original requirements Example : SVN 1.3 release has 67 requirements initially, later 7 new requirements are added, 3 requirements are deleted from initial requirements and modified 11 requirements Hence Requirement volatility is calculated as : (7 + 3 + 11 ) X 100 / 67 = 31.34 % This means that almost 1/3 of the requirements changed after the initial identification of requirements
  • 13. 13 Conclusion • The Test metrics should be reviewed & interpreted on regular basis throughout the test effort and particularly after the application is released into production • There are several key factors in implementing and using the metrics in the organization, beginning with determining the goal for developing the metrics, followed by the identification of metrics to be tracked and ending with sufficient analysis of the resulting data to be able to make changes to the software development lifecycle • - So finally Metrics themselves so not create improvements, they do provide the objective information necessary to understand what changes are necessary to be implemented