SlideShare a Scribd company logo
Perfecto by Perforce © 2020 Perforce Software, Inc.
Best Practices for Shifting Left Performance
and Accessibility Testing
perfecto.io2 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Today’s Speakers
Dylan BarrellEran Kinsbruner Tzvika Shahaf Henrik Rexed
• Chief Product Officer at Deque
• 20+ years in technology development,
sales, product management, product
marketing, and corporate development
• MBA from University of Michigan, BS
from University of Witwatersrand
• dylanbarrell
• Chief Evangelist and author at
Perfecto
• Blogger and speaker
• 20+ years in development & testing
• Author of “The Digital Quality
Handbook” and “Continuous
Testing for DevOps Professionals”
• ek121268
• Performance Engineer at Neotys
• Extensive background and experience in
software performance
• Founded Performance CoE in major
enterprises
• henrik-rexed-a85a8315
• @hrexed
• VP Product Management at Perfecto
• Software professional with over 12 years
in product management, development,
and testing
• Expert in implementing and advising on
test strategies for Fortune 500
enterprises and leading tech companies
• http://linkedin.com/in/tzvikashahaf/
• @Tzvika_Shahaf
perfecto.io3 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Today’s Agenda
1
2
3
Setting the Stage: Agile Testing Manifesto
Definitions: Shift Left Testing, Performance Testing, Accessibility Testing
5
Fundamentals of Performance Testing for Mobile and Web Apps
Best Practices for Embedding Performance & Accessibility Testing in the Build Cycle
4 Fundamentals of Accessibility Testing for Mobile and Web Apps
6 Demos
7 Q&A
Digital Engagement Reality – More Relevant Than Ever
perfecto.io5 | Perfecto by Perforce © 2020 Perforce Software, Inc.
The Agile Testing Manifesto
THE DEVOPS MANIFESTO
✔ Continuous testing over testing at the end.
✔ Embracing all testing activities over only automated functional testing.
✔ Testing what gives value over testing everything.
✔ Testing across the team over testing in siloed testing departments.
✔ Product coverage over code coverage.
perfecto.io6 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Valuable Test Automation to Optimize the Delivery Pipeline
vs
OPTIMIZED
DELIVERY PIPELINE Innovation
Throughput
Quality of
Output
Time Cost
perfecto.io7 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Balancing Test Automation Coverage
Definitions
perfecto.io9 | Perfecto by Perforce © 2020 Perforce Software, Inc.
• Accessibility is the practice of making your apps (mobile/web) usable by as many people as
possible. We traditionally think of this as being about people with disabilities, but the practice
of making sites accessible also benefits other groups — such as those with slow network
connections, etc.
• Apps need to be accessible for everyone, including those that have vision disabilities, hearing
disabilities, or otherwise impaired users (physical, cognitive, etc.).
• 15% of the world population experiences some form of disability (The World Bank).
• Cost of non-compliance with WCAG/508/ADA and other accessibility standards varies by
jurisdiction, with an average fines of $300,000- $600,000 (this does not include additional costs
— engineering, brand, etc.).
• https://getadaaccessible.com/ada-compliance-law-and-penalities/
• https://www.ada.gov/civil_penalties_2014.htm
• Varying levels of Accessibility Success Criteria: A, AA, AAA
• https://www.w3.org/WAI/standards-guidelines/wcag/
What Is Accessibility Testing?
perfecto.io10 | Perfecto by Perforce © 2020 Perforce Software, Inc.
• Most accessibility tests are done manually or not at all, most
cycles are being outsourced by enterprises.
• Accessibility testing is not part of the cycle and does not occur
as often as needed since it’s not automated —
• Real-life examrisk of penalties due to escaped defects and lack
of compliance.ple: $356,775 for an accessibility lawsuit after
total cost for litigation.
• Will disrupt sprint cycles and product defects are 100X more
expensive to fix after the fact.
Accessibility Testing — What’s the Pain Today?
perfecto.io11 | Perfecto by Perforce © 2020 Perforce Software, Inc.
• PERFORMANCE TESTING checks the speed, response time, reliability, resource usage,
and scalability of a software program under their expected workload.
• In performance testing, there are two types:
• Load Testing
• Stress Testing
• The purpose of performance testing is not to find functional defects, but to eliminate
performance bottlenecks in the software or device.
• The focus of performance testing is checking a software program’s following KPIs:
• Speed — Determines whether the application responds quickly (response time).
• Scalability — Determines maximum user load the software application can handle (bandwidth).
• Stability — Determines if the application is stable under varying loads.
• Reliability — Measurement of software consistency to give same results repeatedly.
What Is Performance Testing?
Performance Testing
Neotys © . All Rights Reserved.
Change of
Methodology
Requirements Design Implementation Testing Acceptance Deployment
Inception Elaboration Construction Transition
Development Operations
DevOps
Big Bang
Waterfall
Incremental
Rational Unified
Process
Agile
Scrum, Kanban
Continuous
DevOps
Digital Singularity
Agile Event Horizon
6+
4
2
1
Change of Methodology
Neotys © . All Rights Reserved.
OK, but let’s
review our
architecture first
• From Monolithic
Presentation Layer
Business Layer
Data Layer
One application per host
Having the entire business logic
Let’s Review Our Architecture First
Neotys © . All Rights Reserved.
OK, but let’s
review our
architecture first
• To New Microservices
Front
Service
A
Service
B
Service
C
Sevice
D
Service
E
Service
F
Service
G
Every service is
managed by a
dedicated
team
Let’s Review Our Architecture First
Neotys © . All Rights Reserved.
Let’s move to
the cloud!
• Reduce the cost.
• Increase the availability of the application.
• Simplify, modernize.
Let’s Move to the Cloud
Neotys © . All Rights Reserved.
Efficient and
realistic
workload model
Efficient and Realistic Workload Model
Neotys © . All Rights Reserved.
Traditional
monitoring
Tracking
system
APM
Let’s Re-Use Monitoring Data
Neotys © . All Rights Reserved.
Test
Performance
Continuously
API Testing
Test a Component
Application Testing
Test Real World
Integration Testing
Test a System
Continuous Testing Embedded in CI/CD
Pipelines
Let’s Extract Data From Our APM to Learn How Our App is
Used
Neotys © . All Rights Reserved.
Architecture is
based on
components
Architecture Is Based on Components
Neotys © . All Rights Reserved.
Error
rate
Throughput + response time versus
objectives
Resources
check
Test
failure
Process to Analyse
Neotys © . All Rights Reserved.
File defining the
indicators
and the objectives
Quality
Gate
Collecting the
specification
Retrieving the data
from the datasource
Calculate the
score
Datasourc
e
Quality Gate
Accessibility Testing
perfecto.io24 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Most Accessibility Work Is Done Much Too Late in the Process
Production
Environment
Most accessibility activity
is conducted out here
perfecto.io25 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Deque Enables You to Shift Left
WorldSpace
Attest
WorldSpace
Assure
WorldSpace
Comply
Deque Solution
Design Training and
Services
perfecto.io26 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Where You Find and Fix Issues Matters
If issue caught
during
maintenance:
$7,600
If issue caught
during
QA/testing:
$960
If issue
caught
during
build:$240
If issue caught
in
development
$80 Good
Bad
Source: IBM
http://www-01.ibm.com/support/docview.wss?uid=swg27048410&aid=1
perfecto.io27 | Perfecto by Perforce © 2020 Perforce Software, Inc.
• Accessibility testing cannot be automated.
• Accessibility testing is usability testing.
Accessibility Myths
perfecto.io28 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Generic Accessibility Automation
powered by Deque
perfecto.io29 | Perfecto by Perforce © 2020 Perforce Software, Inc.
No Code Merges Until #axeClean!
Best Practices for Shifting Left Performance and Accessibility Testing
perfecto.io31 | Perfecto by Perforce © 2020 Perforce Software, Inc.
• Test while you develop.
Interactive Testing
perfecto.io32 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Encode Design Annotation in Automated Tests
…
// Check the edit button’s text
// select the button and the heading
let button = fixture.querySelector(‘button.edit’)
let heading = fixture.querySelector(‘.Heading’)
// get the two elements’ accessible names
let headingText = axe.commons.text.accessibleText (heading)
let buttonText = axe.commons.text.accessibleText(button)
// compare
expect(buttonText).toBe(‘Edit ‘ + headingText)
…
Best Practices & Recommendations
perfecto.io34 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Pipeline Testing Coverage Example: Where Does
Performance/Accessibility Fit?
Demos
perfecto.io36 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Perfecto Integrates With Both Neotys & Deque Axe Solutions
Demo Environment
Load generators
Pipeline
1 Retrieve latest version of the Code/Test
Build and launch tests 2 Build the application and launch
the selenium tests
Generate Junit Report 3 Generate Junit report in Jenkins
Deploy load testing
infrastructure
4 Deploy NeoLoad Load Generator
Run Load Test 5 Run Load test with perfecto
integration
Demo
NeoLoad : Reduce Total Cost of Ownership (TCO)
• Digital, web, mobile, SAP Oracle EBS…
• 5-10x faster test design:
• Scriptless test design and validation — reduce errors.
• Reduce time to market — spend more time on
performance engineering vs. script writing.
• 20x faster script maintenance — Agile/DevOps.
• Reduce spend on tools:
• Much higher ROI.
• Flexible pricing model.
“We saw an 80% reduction in costs
while NeoLoad generated 1.2 million
virtual users from Neotys Cloud
Platform in 15 minutes to prep for our
busiest day of the year, Boxing Day.”
Neotys © . All Rights Reserved.
NeoLoad’s Platform
On-Prem Docker Stack
RESTful APIs
NeoLoad
Core
NeoLoad
Web
NeoLoad
SaaS
Managed/Hosted
Load Generators
&
Neotys © . All Rights Reserved.
NeoLoad
Web
Design
Desktop GUI
connection
On-
premise
SaaS
Runtime &
Analysis
NeoLoad Web
Neotys © . All Rights Reserved.
Collaboration Between Teams
• Performance engineers can update the project’s build by the developers from NeoLoad GUI.
• Early testing assets can be reused in system-wide testing.
Neotys © . All Rights Reserved.
One Platform for Component Testing & System Wide Testing
Free axe Browser Extension
Run automated accessibility tests against your website. It’s totally free and even
has cool beta features available with sign up.
✓ Single page tests ✓ Remediation help
axe Auditor
Perform comprehensive WCAG audits
of all content and applications.
✓ Comprehensive testing
methodology
✓ Predefined issues for all content
✓ Group and filter issues for easy
communication
axe DevTools
Integrate accessibility testing into
your existing automated testing
process with this toolkit.
✓ Automated testing
✓ Intelligent guided testing
✓ CI/CD integrations
✓ CLI
✓ Expert tools
axe Monitor
Dynamically scan, monitor, and report
on the accessibility status of your site.
✓ PDFs and web pages
✓ Scan whole sites
✓ Scan behind authentication
✓ Scan behind the firewall
✓ Drill-down dashboard
axe: the Standard in Accessibility Testing
perfecto.io46 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Deque Enables You to Shift Left
What Is the Difference Between the Free Extension & axe DevTools?
Free extension axe DevTools
Axe-core library ✓ ✓
"Learn more" remediation resources ✓ ✓
Intelligent guided tests ✓* ✓
Test record manager & user dashboard ✓* ✓
Export issues & limit test scope ✓* ✓
Managed user data and analytics ✓
CLI ✓
CI/CD integration ✓
On-prem installation option ✓
Custom rules support ✓
Enterprise support ✓ *currently in beta
perfecto.io48 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Perfecto’s 4 Key Pillars of Continuous Testing in DevOps
This is where money is spent (Time, Tools, Resources)
This is where value is being
realized, quality is improved
Unified solution serves DevOps with greater effectiveness.
Q&A
Thank You!
Visit perfecto.io or follow us @perfectomobile
Ad

More Related Content

What's hot (20)

Red Bend Software: Optimizing the User Experience with Over-the-Air Updates
Red Bend Software: Optimizing the User Experience with Over-the-Air UpdatesRed Bend Software: Optimizing the User Experience with Over-the-Air Updates
Red Bend Software: Optimizing the User Experience with Over-the-Air Updates
Red Bend Software
 
OWASP Top 10 Proactive Controls
OWASP Top 10 Proactive ControlsOWASP Top 10 Proactive Controls
OWASP Top 10 Proactive Controls
Katy Anton
 
Automated Security Analysis of Android & iOS Applications with Mobile Securit...
Automated Security Analysis of Android & iOS Applications with Mobile Securit...Automated Security Analysis of Android & iOS Applications with Mobile Securit...
Automated Security Analysis of Android & iOS Applications with Mobile Securit...
Ajin Abraham
 
The Image that called me - Active Content Injection with SVG Files
The Image that called me - Active Content Injection with SVG FilesThe Image that called me - Active Content Injection with SVG Files
The Image that called me - Active Content Injection with SVG Files
Mario Heiderich
 
The OWASP Zed Attack Proxy
The OWASP Zed Attack ProxyThe OWASP Zed Attack Proxy
The OWASP Zed Attack Proxy
Aditya Gupta
 
Playwright Begginers Presentation
Playwright Begginers PresentationPlaywright Begginers Presentation
Playwright Begginers Presentation
FranPerea6
 
Automation Testing With Appium
Automation Testing With AppiumAutomation Testing With Appium
Automation Testing With Appium
Knoldus Inc.
 
Source Code Analysis with SAST
Source Code Analysis with SASTSource Code Analysis with SAST
Source Code Analysis with SAST
Blueinfy Solutions
 
Getting started with appium
Getting started with appiumGetting started with appium
Getting started with appium
Pratik Patel
 
Introduction to MuleSoft
Introduction to MuleSoftIntroduction to MuleSoft
Introduction to MuleSoft
Alexandra N. Martinez
 
Playwright: A New Test Automation Framework for the Modern Web
Playwright: A New Test Automation Framework for the Modern WebPlaywright: A New Test Automation Framework for the Modern Web
Playwright: A New Test Automation Framework for the Modern Web
Applitools
 
Introduction to Flutter.pptx
Introduction to Flutter.pptxIntroduction to Flutter.pptx
Introduction to Flutter.pptx
DiffouoFopaEsdras
 
Veracode - Overview
Veracode - OverviewVeracode - Overview
Veracode - Overview
Stephen Durrant
 
Flutter
Flutter Flutter
Flutter
Mohit Nainwal
 
DevSecOps 101
DevSecOps 101DevSecOps 101
DevSecOps 101
Narudom Roongsiriwong, CISSP
 
Peeling the Onion: Making Sense of the Layers of API Security
Peeling the Onion: Making Sense of the Layers of API SecurityPeeling the Onion: Making Sense of the Layers of API Security
Peeling the Onion: Making Sense of the Layers of API Security
Matt Tesauro
 
Static code analysis with sonar qube
Static code analysis with sonar qubeStatic code analysis with sonar qube
Static code analysis with sonar qube
Hayi Nukman
 
Performance testing presentation
Performance testing presentationPerformance testing presentation
Performance testing presentation
Belatrix Software
 
Checkmarx meetup API Security - API Security top 10 - Erez Yalon
Checkmarx meetup API Security -  API Security top 10 - Erez YalonCheckmarx meetup API Security -  API Security top 10 - Erez Yalon
Checkmarx meetup API Security - API Security top 10 - Erez Yalon
Adar Weidman
 
SC conference - Building AppSec Teams
SC conference  - Building AppSec TeamsSC conference  - Building AppSec Teams
SC conference - Building AppSec Teams
Dinis Cruz
 
Red Bend Software: Optimizing the User Experience with Over-the-Air Updates
Red Bend Software: Optimizing the User Experience with Over-the-Air UpdatesRed Bend Software: Optimizing the User Experience with Over-the-Air Updates
Red Bend Software: Optimizing the User Experience with Over-the-Air Updates
Red Bend Software
 
OWASP Top 10 Proactive Controls
OWASP Top 10 Proactive ControlsOWASP Top 10 Proactive Controls
OWASP Top 10 Proactive Controls
Katy Anton
 
Automated Security Analysis of Android & iOS Applications with Mobile Securit...
Automated Security Analysis of Android & iOS Applications with Mobile Securit...Automated Security Analysis of Android & iOS Applications with Mobile Securit...
Automated Security Analysis of Android & iOS Applications with Mobile Securit...
Ajin Abraham
 
The Image that called me - Active Content Injection with SVG Files
The Image that called me - Active Content Injection with SVG FilesThe Image that called me - Active Content Injection with SVG Files
The Image that called me - Active Content Injection with SVG Files
Mario Heiderich
 
The OWASP Zed Attack Proxy
The OWASP Zed Attack ProxyThe OWASP Zed Attack Proxy
The OWASP Zed Attack Proxy
Aditya Gupta
 
Playwright Begginers Presentation
Playwright Begginers PresentationPlaywright Begginers Presentation
Playwright Begginers Presentation
FranPerea6
 
Automation Testing With Appium
Automation Testing With AppiumAutomation Testing With Appium
Automation Testing With Appium
Knoldus Inc.
 
Source Code Analysis with SAST
Source Code Analysis with SASTSource Code Analysis with SAST
Source Code Analysis with SAST
Blueinfy Solutions
 
Getting started with appium
Getting started with appiumGetting started with appium
Getting started with appium
Pratik Patel
 
Playwright: A New Test Automation Framework for the Modern Web
Playwright: A New Test Automation Framework for the Modern WebPlaywright: A New Test Automation Framework for the Modern Web
Playwright: A New Test Automation Framework for the Modern Web
Applitools
 
Introduction to Flutter.pptx
Introduction to Flutter.pptxIntroduction to Flutter.pptx
Introduction to Flutter.pptx
DiffouoFopaEsdras
 
Peeling the Onion: Making Sense of the Layers of API Security
Peeling the Onion: Making Sense of the Layers of API SecurityPeeling the Onion: Making Sense of the Layers of API Security
Peeling the Onion: Making Sense of the Layers of API Security
Matt Tesauro
 
Static code analysis with sonar qube
Static code analysis with sonar qubeStatic code analysis with sonar qube
Static code analysis with sonar qube
Hayi Nukman
 
Performance testing presentation
Performance testing presentationPerformance testing presentation
Performance testing presentation
Belatrix Software
 
Checkmarx meetup API Security - API Security top 10 - Erez Yalon
Checkmarx meetup API Security -  API Security top 10 - Erez YalonCheckmarx meetup API Security -  API Security top 10 - Erez Yalon
Checkmarx meetup API Security - API Security top 10 - Erez Yalon
Adar Weidman
 
SC conference - Building AppSec Teams
SC conference  - Building AppSec TeamsSC conference  - Building AppSec Teams
SC conference - Building AppSec Teams
Dinis Cruz
 

Similar to Best Practices for Shifting Left Performance and Accessibility Testing (20)

How to Scale Digital App Testing With Jenkins & Automation You Can Trust
How to Scale Digital App Testing With Jenkins & Automation You Can TrustHow to Scale Digital App Testing With Jenkins & Automation You Can Trust
How to Scale Digital App Testing With Jenkins & Automation You Can Trust
Perfecto by Perforce
 
Deliver Flawless Mobile Apps Faster with CI/CD & CT
Deliver Flawless Mobile Apps Faster with CI/CD & CTDeliver Flawless Mobile Apps Faster with CI/CD & CT
Deliver Flawless Mobile Apps Faster with CI/CD & CT
Perfecto by Perforce
 
Fast Data, Fast Delivery: How Smart Analysis Accelerates App Testing
Fast Data, Fast Delivery: How Smart Analysis Accelerates App TestingFast Data, Fast Delivery: How Smart Analysis Accelerates App Testing
Fast Data, Fast Delivery: How Smart Analysis Accelerates App Testing
Perfecto by Perforce
 
Keeping Your Continuous Test Automation Continuously Valuable
Keeping Your Continuous Test Automation Continuously ValuableKeeping Your Continuous Test Automation Continuously Valuable
Keeping Your Continuous Test Automation Continuously Valuable
Perfecto by Perforce
 
Integrating Automated Testing into DevOps
Integrating Automated Testing into DevOpsIntegrating Automated Testing into DevOps
Integrating Automated Testing into DevOps
TechWell
 
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
QA or the Highway
 
Enhancing Your Test Automation Scenario Coverage with Selenium - QA or the Hi...
Enhancing Your Test Automation Scenario Coverage with Selenium - QA or the Hi...Enhancing Your Test Automation Scenario Coverage with Selenium - QA or the Hi...
Enhancing Your Test Automation Scenario Coverage with Selenium - QA or the Hi...
Perfecto by Perforce
 
How to Prepare Your Apps for iOS 14 - Test Strategy, Coverage, & Best Practices
How to Prepare Your Apps for iOS 14 - Test Strategy, Coverage, & Best PracticesHow to Prepare Your Apps for iOS 14 - Test Strategy, Coverage, & Best Practices
How to Prepare Your Apps for iOS 14 - Test Strategy, Coverage, & Best Practices
Perfecto by Perforce
 
How to Do Code Reviews at Massive Scale For DevOps
How to Do Code Reviews at Massive Scale For DevOpsHow to Do Code Reviews at Massive Scale For DevOps
How to Do Code Reviews at Massive Scale For DevOps
Perforce
 
Mastering Cross-Browser Test Automation With Cypress and Selenium
Mastering Cross-Browser Test Automation With Cypress and SeleniumMastering Cross-Browser Test Automation With Cypress and Selenium
Mastering Cross-Browser Test Automation With Cypress and Selenium
Perfecto by Perforce
 
Software Test Engineer with 3.6 years of experience
Software Test Engineer with 3.6 years of experienceSoftware Test Engineer with 3.6 years of experience
Software Test Engineer with 3.6 years of experience
vijaya lakshmi
 
5 Mobile App Trends & What They Mean for Dev & Testing
5 Mobile App Trends & What They Mean for Dev & Testing5 Mobile App Trends & What They Mean for Dev & Testing
5 Mobile App Trends & What They Mean for Dev & Testing
Perfecto by Perforce
 
Il paradigma DevOps e Continuous Delivery Automation
Il paradigma DevOps e Continuous Delivery AutomationIl paradigma DevOps e Continuous Delivery Automation
Il paradigma DevOps e Continuous Delivery Automation
HP Enterprise Italia
 
Il paradigma DevOps e Continuous Delivery Automation
Il paradigma DevOps e Continuous Delivery Automation Il paradigma DevOps e Continuous Delivery Automation
Il paradigma DevOps e Continuous Delivery Automation
HP Enterprise Italia
 
Cloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More AccessibleCloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More Accessible
Perfecto by Perforce
 
OMSOFTWARE NEW Service
OMSOFTWARE NEW ServiceOMSOFTWARE NEW Service
OMSOFTWARE NEW Service
OM SOFTWARE PVT LTD
 
How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks
Ulf Mattsson
 
Mobile Monitoring Best Practices
Mobile Monitoring Best PracticesMobile Monitoring Best Practices
Mobile Monitoring Best Practices
Lizzy Guido (she/her)
 
Pure App + Patterns + Prolifics = Feeding Change
Pure App + Patterns + Prolifics = Feeding Change Pure App + Patterns + Prolifics = Feeding Change
Pure App + Patterns + Prolifics = Feeding Change
Prolifics
 
Agile & DevOps - It's all about project success
Agile & DevOps - It's all about project successAgile & DevOps - It's all about project success
Agile & DevOps - It's all about project success
Adam Stephensen
 
How to Scale Digital App Testing With Jenkins & Automation You Can Trust
How to Scale Digital App Testing With Jenkins & Automation You Can TrustHow to Scale Digital App Testing With Jenkins & Automation You Can Trust
How to Scale Digital App Testing With Jenkins & Automation You Can Trust
Perfecto by Perforce
 
Deliver Flawless Mobile Apps Faster with CI/CD & CT
Deliver Flawless Mobile Apps Faster with CI/CD & CTDeliver Flawless Mobile Apps Faster with CI/CD & CT
Deliver Flawless Mobile Apps Faster with CI/CD & CT
Perfecto by Perforce
 
Fast Data, Fast Delivery: How Smart Analysis Accelerates App Testing
Fast Data, Fast Delivery: How Smart Analysis Accelerates App TestingFast Data, Fast Delivery: How Smart Analysis Accelerates App Testing
Fast Data, Fast Delivery: How Smart Analysis Accelerates App Testing
Perfecto by Perforce
 
Keeping Your Continuous Test Automation Continuously Valuable
Keeping Your Continuous Test Automation Continuously ValuableKeeping Your Continuous Test Automation Continuously Valuable
Keeping Your Continuous Test Automation Continuously Valuable
Perfecto by Perforce
 
Integrating Automated Testing into DevOps
Integrating Automated Testing into DevOpsIntegrating Automated Testing into DevOps
Integrating Automated Testing into DevOps
TechWell
 
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
QA or the Highway
 
Enhancing Your Test Automation Scenario Coverage with Selenium - QA or the Hi...
Enhancing Your Test Automation Scenario Coverage with Selenium - QA or the Hi...Enhancing Your Test Automation Scenario Coverage with Selenium - QA or the Hi...
Enhancing Your Test Automation Scenario Coverage with Selenium - QA or the Hi...
Perfecto by Perforce
 
How to Prepare Your Apps for iOS 14 - Test Strategy, Coverage, & Best Practices
How to Prepare Your Apps for iOS 14 - Test Strategy, Coverage, & Best PracticesHow to Prepare Your Apps for iOS 14 - Test Strategy, Coverage, & Best Practices
How to Prepare Your Apps for iOS 14 - Test Strategy, Coverage, & Best Practices
Perfecto by Perforce
 
How to Do Code Reviews at Massive Scale For DevOps
How to Do Code Reviews at Massive Scale For DevOpsHow to Do Code Reviews at Massive Scale For DevOps
How to Do Code Reviews at Massive Scale For DevOps
Perforce
 
Mastering Cross-Browser Test Automation With Cypress and Selenium
Mastering Cross-Browser Test Automation With Cypress and SeleniumMastering Cross-Browser Test Automation With Cypress and Selenium
Mastering Cross-Browser Test Automation With Cypress and Selenium
Perfecto by Perforce
 
Software Test Engineer with 3.6 years of experience
Software Test Engineer with 3.6 years of experienceSoftware Test Engineer with 3.6 years of experience
Software Test Engineer with 3.6 years of experience
vijaya lakshmi
 
5 Mobile App Trends & What They Mean for Dev & Testing
5 Mobile App Trends & What They Mean for Dev & Testing5 Mobile App Trends & What They Mean for Dev & Testing
5 Mobile App Trends & What They Mean for Dev & Testing
Perfecto by Perforce
 
Il paradigma DevOps e Continuous Delivery Automation
Il paradigma DevOps e Continuous Delivery AutomationIl paradigma DevOps e Continuous Delivery Automation
Il paradigma DevOps e Continuous Delivery Automation
HP Enterprise Italia
 
Il paradigma DevOps e Continuous Delivery Automation
Il paradigma DevOps e Continuous Delivery Automation Il paradigma DevOps e Continuous Delivery Automation
Il paradigma DevOps e Continuous Delivery Automation
HP Enterprise Italia
 
Cloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More AccessibleCloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More Accessible
Perfecto by Perforce
 
How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks
Ulf Mattsson
 
Pure App + Patterns + Prolifics = Feeding Change
Pure App + Patterns + Prolifics = Feeding Change Pure App + Patterns + Prolifics = Feeding Change
Pure App + Patterns + Prolifics = Feeding Change
Prolifics
 
Agile & DevOps - It's all about project success
Agile & DevOps - It's all about project successAgile & DevOps - It's all about project success
Agile & DevOps - It's all about project success
Adam Stephensen
 
Ad

More from Perfecto by Perforce (20)

Is BDD Worth It? Considerations for Advanced Test Automation
Is BDD Worth It? Considerations for Advanced Test AutomationIs BDD Worth It? Considerations for Advanced Test Automation
Is BDD Worth It? Considerations for Advanced Test Automation
Perfecto by Perforce
 
Yoda debunks the top 5 challenges of continuous testing in the cloud
Yoda debunks the top 5 challenges of continuous testing in the cloudYoda debunks the top 5 challenges of continuous testing in the cloud
Yoda debunks the top 5 challenges of continuous testing in the cloud
Perfecto by Perforce
 
Cognitive Engineering - Shifting Right with Gated.AI Testing - DevOps Next
Cognitive Engineering - Shifting Right with Gated.AI Testing - DevOps NextCognitive Engineering - Shifting Right with Gated.AI Testing - DevOps Next
Cognitive Engineering - Shifting Right with Gated.AI Testing - DevOps Next
Perfecto by Perforce
 
The Rise and Benefits of Robotic Process Automation (RPA) - DevOps Next
The Rise and Benefits of Robotic Process Automation (RPA) - DevOps NextThe Rise and Benefits of Robotic Process Automation (RPA) - DevOps Next
The Rise and Benefits of Robotic Process Automation (RPA) - DevOps Next
Perfecto by Perforce
 
The New Categories of Software Defects in the Era of AI and ML - DevOps Next
The New Categories of Software Defects in the Era of AI and ML - DevOps NextThe New Categories of Software Defects in the Era of AI and ML - DevOps Next
The New Categories of Software Defects in the Era of AI and ML - DevOps Next
Perfecto by Perforce
 
Moving to Modern DevOps with Fuzzing and ML - DevOps Next
Moving to Modern DevOps with Fuzzing and ML - DevOps NextMoving to Modern DevOps with Fuzzing and ML - DevOps Next
Moving to Modern DevOps with Fuzzing and ML - DevOps Next
Perfecto by Perforce
 
Leveraging AI and ML in Test Management Systems - DevOps Next
Leveraging AI and ML in Test Management Systems - DevOps NextLeveraging AI and ML in Test Management Systems - DevOps Next
Leveraging AI and ML in Test Management Systems - DevOps Next
Perfecto by Perforce
 
How Does AIOps Benefit DevOps Pipeline and Software Quality? - DevOps Next
How Does AIOps Benefit DevOps Pipeline and Software Quality? - DevOps NextHow Does AIOps Benefit DevOps Pipeline and Software Quality? - DevOps Next
How Does AIOps Benefit DevOps Pipeline and Software Quality? - DevOps Next
Perfecto by Perforce
 
Classification of Advanced AI and ML Testing Tools - DevOps Next
Classification of Advanced AI and ML Testing Tools - DevOps NextClassification of Advanced AI and ML Testing Tools - DevOps Next
Classification of Advanced AI and ML Testing Tools - DevOps Next
Perfecto by Perforce
 
Automated Code Reviews with AI and ML - DevOps Next
Automated Code Reviews with AI and ML - DevOps NextAutomated Code Reviews with AI and ML - DevOps Next
Automated Code Reviews with AI and ML - DevOps Next
Perfecto by Perforce
 
Advancing the State of The Art in AI and Testing - DevOps Next
Advancing the State of The Art in AI and Testing - DevOps NextAdvancing the State of The Art in AI and Testing - DevOps Next
Advancing the State of The Art in AI and Testing - DevOps Next
Perfecto by Perforce
 
How to Create a Risk Based Testing Strategy With Simulators, Emulators, and R...
How to Create a Risk Based Testing Strategy With Simulators, Emulators, and R...How to Create a Risk Based Testing Strategy With Simulators, Emulators, and R...
How to Create a Risk Based Testing Strategy With Simulators, Emulators, and R...
Perfecto by Perforce
 
How to Eliminate Escaped Defects With a Proven Test Automation Coverage Strategy
How to Eliminate Escaped Defects With a Proven Test Automation Coverage StrategyHow to Eliminate Escaped Defects With a Proven Test Automation Coverage Strategy
How to Eliminate Escaped Defects With a Proven Test Automation Coverage Strategy
Perfecto by Perforce
 
Accelerating Digital Transformation With API Lifecycle & Test Automation
Accelerating Digital Transformation With API Lifecycle & Test AutomationAccelerating Digital Transformation With API Lifecycle & Test Automation
Accelerating Digital Transformation With API Lifecycle & Test Automation
Perfecto by Perforce
 
Keeping Your Continuous Test Automation Suites Continuously Valuable in DevOps
Keeping Your Continuous Test Automation Suites Continuously Valuable in DevOpsKeeping Your Continuous Test Automation Suites Continuously Valuable in DevOps
Keeping Your Continuous Test Automation Suites Continuously Valuable in DevOps
Perfecto by Perforce
 
The Automation Firehose: Be Strategic & Tactical With Your Mobile & Web Testing
The Automation Firehose: Be Strategic & Tactical With Your Mobile & Web TestingThe Automation Firehose: Be Strategic & Tactical With Your Mobile & Web Testing
The Automation Firehose: Be Strategic & Tactical With Your Mobile & Web Testing
Perfecto by Perforce
 
Why Mobile and Web Testing MUST Move to the Cloud
Why Mobile and Web Testing MUST Move to the CloudWhy Mobile and Web Testing MUST Move to the Cloud
Why Mobile and Web Testing MUST Move to the Cloud
Perfecto by Perforce
 
Uncovering the unknowns of appium and beyond
Uncovering the unknowns of appium and beyondUncovering the unknowns of appium and beyond
Uncovering the unknowns of appium and beyond
Perfecto by Perforce
 
4 Testing Methods to Scale and Automate Your DevOps Pipeline
4 Testing Methods to Scale and Automate Your DevOps Pipeline4 Testing Methods to Scale and Automate Your DevOps Pipeline
4 Testing Methods to Scale and Automate Your DevOps Pipeline
Perfecto by Perforce
 
How to Guarantee Continuous Value from your Test Automation
How to Guarantee Continuous Value from your Test AutomationHow to Guarantee Continuous Value from your Test Automation
How to Guarantee Continuous Value from your Test Automation
Perfecto by Perforce
 
Is BDD Worth It? Considerations for Advanced Test Automation
Is BDD Worth It? Considerations for Advanced Test AutomationIs BDD Worth It? Considerations for Advanced Test Automation
Is BDD Worth It? Considerations for Advanced Test Automation
Perfecto by Perforce
 
Yoda debunks the top 5 challenges of continuous testing in the cloud
Yoda debunks the top 5 challenges of continuous testing in the cloudYoda debunks the top 5 challenges of continuous testing in the cloud
Yoda debunks the top 5 challenges of continuous testing in the cloud
Perfecto by Perforce
 
Cognitive Engineering - Shifting Right with Gated.AI Testing - DevOps Next
Cognitive Engineering - Shifting Right with Gated.AI Testing - DevOps NextCognitive Engineering - Shifting Right with Gated.AI Testing - DevOps Next
Cognitive Engineering - Shifting Right with Gated.AI Testing - DevOps Next
Perfecto by Perforce
 
The Rise and Benefits of Robotic Process Automation (RPA) - DevOps Next
The Rise and Benefits of Robotic Process Automation (RPA) - DevOps NextThe Rise and Benefits of Robotic Process Automation (RPA) - DevOps Next
The Rise and Benefits of Robotic Process Automation (RPA) - DevOps Next
Perfecto by Perforce
 
The New Categories of Software Defects in the Era of AI and ML - DevOps Next
The New Categories of Software Defects in the Era of AI and ML - DevOps NextThe New Categories of Software Defects in the Era of AI and ML - DevOps Next
The New Categories of Software Defects in the Era of AI and ML - DevOps Next
Perfecto by Perforce
 
Moving to Modern DevOps with Fuzzing and ML - DevOps Next
Moving to Modern DevOps with Fuzzing and ML - DevOps NextMoving to Modern DevOps with Fuzzing and ML - DevOps Next
Moving to Modern DevOps with Fuzzing and ML - DevOps Next
Perfecto by Perforce
 
Leveraging AI and ML in Test Management Systems - DevOps Next
Leveraging AI and ML in Test Management Systems - DevOps NextLeveraging AI and ML in Test Management Systems - DevOps Next
Leveraging AI and ML in Test Management Systems - DevOps Next
Perfecto by Perforce
 
How Does AIOps Benefit DevOps Pipeline and Software Quality? - DevOps Next
How Does AIOps Benefit DevOps Pipeline and Software Quality? - DevOps NextHow Does AIOps Benefit DevOps Pipeline and Software Quality? - DevOps Next
How Does AIOps Benefit DevOps Pipeline and Software Quality? - DevOps Next
Perfecto by Perforce
 
Classification of Advanced AI and ML Testing Tools - DevOps Next
Classification of Advanced AI and ML Testing Tools - DevOps NextClassification of Advanced AI and ML Testing Tools - DevOps Next
Classification of Advanced AI and ML Testing Tools - DevOps Next
Perfecto by Perforce
 
Automated Code Reviews with AI and ML - DevOps Next
Automated Code Reviews with AI and ML - DevOps NextAutomated Code Reviews with AI and ML - DevOps Next
Automated Code Reviews with AI and ML - DevOps Next
Perfecto by Perforce
 
Advancing the State of The Art in AI and Testing - DevOps Next
Advancing the State of The Art in AI and Testing - DevOps NextAdvancing the State of The Art in AI and Testing - DevOps Next
Advancing the State of The Art in AI and Testing - DevOps Next
Perfecto by Perforce
 
How to Create a Risk Based Testing Strategy With Simulators, Emulators, and R...
How to Create a Risk Based Testing Strategy With Simulators, Emulators, and R...How to Create a Risk Based Testing Strategy With Simulators, Emulators, and R...
How to Create a Risk Based Testing Strategy With Simulators, Emulators, and R...
Perfecto by Perforce
 
How to Eliminate Escaped Defects With a Proven Test Automation Coverage Strategy
How to Eliminate Escaped Defects With a Proven Test Automation Coverage StrategyHow to Eliminate Escaped Defects With a Proven Test Automation Coverage Strategy
How to Eliminate Escaped Defects With a Proven Test Automation Coverage Strategy
Perfecto by Perforce
 
Accelerating Digital Transformation With API Lifecycle & Test Automation
Accelerating Digital Transformation With API Lifecycle & Test AutomationAccelerating Digital Transformation With API Lifecycle & Test Automation
Accelerating Digital Transformation With API Lifecycle & Test Automation
Perfecto by Perforce
 
Keeping Your Continuous Test Automation Suites Continuously Valuable in DevOps
Keeping Your Continuous Test Automation Suites Continuously Valuable in DevOpsKeeping Your Continuous Test Automation Suites Continuously Valuable in DevOps
Keeping Your Continuous Test Automation Suites Continuously Valuable in DevOps
Perfecto by Perforce
 
The Automation Firehose: Be Strategic & Tactical With Your Mobile & Web Testing
The Automation Firehose: Be Strategic & Tactical With Your Mobile & Web TestingThe Automation Firehose: Be Strategic & Tactical With Your Mobile & Web Testing
The Automation Firehose: Be Strategic & Tactical With Your Mobile & Web Testing
Perfecto by Perforce
 
Why Mobile and Web Testing MUST Move to the Cloud
Why Mobile and Web Testing MUST Move to the CloudWhy Mobile and Web Testing MUST Move to the Cloud
Why Mobile and Web Testing MUST Move to the Cloud
Perfecto by Perforce
 
Uncovering the unknowns of appium and beyond
Uncovering the unknowns of appium and beyondUncovering the unknowns of appium and beyond
Uncovering the unknowns of appium and beyond
Perfecto by Perforce
 
4 Testing Methods to Scale and Automate Your DevOps Pipeline
4 Testing Methods to Scale and Automate Your DevOps Pipeline4 Testing Methods to Scale and Automate Your DevOps Pipeline
4 Testing Methods to Scale and Automate Your DevOps Pipeline
Perfecto by Perforce
 
How to Guarantee Continuous Value from your Test Automation
How to Guarantee Continuous Value from your Test AutomationHow to Guarantee Continuous Value from your Test Automation
How to Guarantee Continuous Value from your Test Automation
Perfecto by Perforce
 
Ad

Recently uploaded (20)

Learn the Basics of Agile Development: Your Step-by-Step Guide
Learn the Basics of Agile Development: Your Step-by-Step GuideLearn the Basics of Agile Development: Your Step-by-Step Guide
Learn the Basics of Agile Development: Your Step-by-Step Guide
Marcel David
 
Leading AI Innovation As A Product Manager - Michael Jidael
Leading AI Innovation As A Product Manager - Michael JidaelLeading AI Innovation As A Product Manager - Michael Jidael
Leading AI Innovation As A Product Manager - Michael Jidael
Michael Jidael
 
Datastucture-Unit 4-Linked List Presentation.pptx
Datastucture-Unit 4-Linked List Presentation.pptxDatastucture-Unit 4-Linked List Presentation.pptx
Datastucture-Unit 4-Linked List Presentation.pptx
kaleeswaric3
 
Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025
Splunk
 
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPathCommunity
 
"PHP and MySQL CRUD Operations for Student Management System"
"PHP and MySQL CRUD Operations for Student Management System""PHP and MySQL CRUD Operations for Student Management System"
"PHP and MySQL CRUD Operations for Student Management System"
Jainul Musani
 
Asthma presentación en inglés abril 2025 pdf
Asthma presentación en inglés abril 2025 pdfAsthma presentación en inglés abril 2025 pdf
Asthma presentación en inglés abril 2025 pdf
VanessaRaudez
 
AI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global TrendsAI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global Trends
InData Labs
 
Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)
Ortus Solutions, Corp
 
tecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdftecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdf
fjgm517
 
Linux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdfLinux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdf
RHCSA Guru
 
Automation Dreamin' 2022: Sharing Some Gratitude with Your Users
Automation Dreamin' 2022: Sharing Some Gratitude with Your UsersAutomation Dreamin' 2022: Sharing Some Gratitude with Your Users
Automation Dreamin' 2022: Sharing Some Gratitude with Your Users
Lynda Kane
 
Cyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of securityCyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of security
riccardosl1
 
Big Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur MorganBig Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur Morgan
Arthur Morgan
 
Automation Dreamin': Capture User Feedback From Anywhere
Automation Dreamin': Capture User Feedback From AnywhereAutomation Dreamin': Capture User Feedback From Anywhere
Automation Dreamin': Capture User Feedback From Anywhere
Lynda Kane
 
Drupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy ConsumptionDrupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy Consumption
Exove
 
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
SOFTTECHHUB
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsTechnology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data Analytics
InData Labs
 
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
Alan Dix
 
Learn the Basics of Agile Development: Your Step-by-Step Guide
Learn the Basics of Agile Development: Your Step-by-Step GuideLearn the Basics of Agile Development: Your Step-by-Step Guide
Learn the Basics of Agile Development: Your Step-by-Step Guide
Marcel David
 
Leading AI Innovation As A Product Manager - Michael Jidael
Leading AI Innovation As A Product Manager - Michael JidaelLeading AI Innovation As A Product Manager - Michael Jidael
Leading AI Innovation As A Product Manager - Michael Jidael
Michael Jidael
 
Datastucture-Unit 4-Linked List Presentation.pptx
Datastucture-Unit 4-Linked List Presentation.pptxDatastucture-Unit 4-Linked List Presentation.pptx
Datastucture-Unit 4-Linked List Presentation.pptx
kaleeswaric3
 
Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025
Splunk
 
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPathCommunity
 
"PHP and MySQL CRUD Operations for Student Management System"
"PHP and MySQL CRUD Operations for Student Management System""PHP and MySQL CRUD Operations for Student Management System"
"PHP and MySQL CRUD Operations for Student Management System"
Jainul Musani
 
Asthma presentación en inglés abril 2025 pdf
Asthma presentación en inglés abril 2025 pdfAsthma presentación en inglés abril 2025 pdf
Asthma presentación en inglés abril 2025 pdf
VanessaRaudez
 
AI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global TrendsAI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global Trends
InData Labs
 
Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)
Ortus Solutions, Corp
 
tecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdftecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdf
fjgm517
 
Linux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdfLinux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdf
RHCSA Guru
 
Automation Dreamin' 2022: Sharing Some Gratitude with Your Users
Automation Dreamin' 2022: Sharing Some Gratitude with Your UsersAutomation Dreamin' 2022: Sharing Some Gratitude with Your Users
Automation Dreamin' 2022: Sharing Some Gratitude with Your Users
Lynda Kane
 
Cyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of securityCyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of security
riccardosl1
 
Big Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur MorganBig Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur Morgan
Arthur Morgan
 
Automation Dreamin': Capture User Feedback From Anywhere
Automation Dreamin': Capture User Feedback From AnywhereAutomation Dreamin': Capture User Feedback From Anywhere
Automation Dreamin': Capture User Feedback From Anywhere
Lynda Kane
 
Drupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy ConsumptionDrupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy Consumption
Exove
 
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
SOFTTECHHUB
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsTechnology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data Analytics
InData Labs
 
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
Alan Dix
 

Best Practices for Shifting Left Performance and Accessibility Testing

  • 1. Perfecto by Perforce © 2020 Perforce Software, Inc. Best Practices for Shifting Left Performance and Accessibility Testing
  • 2. perfecto.io2 | Perfecto by Perforce © 2020 Perforce Software, Inc. Today’s Speakers Dylan BarrellEran Kinsbruner Tzvika Shahaf Henrik Rexed • Chief Product Officer at Deque • 20+ years in technology development, sales, product management, product marketing, and corporate development • MBA from University of Michigan, BS from University of Witwatersrand • dylanbarrell • Chief Evangelist and author at Perfecto • Blogger and speaker • 20+ years in development & testing • Author of “The Digital Quality Handbook” and “Continuous Testing for DevOps Professionals” • ek121268 • Performance Engineer at Neotys • Extensive background and experience in software performance • Founded Performance CoE in major enterprises • henrik-rexed-a85a8315 • @hrexed • VP Product Management at Perfecto • Software professional with over 12 years in product management, development, and testing • Expert in implementing and advising on test strategies for Fortune 500 enterprises and leading tech companies • http://linkedin.com/in/tzvikashahaf/ • @Tzvika_Shahaf
  • 3. perfecto.io3 | Perfecto by Perforce © 2020 Perforce Software, Inc. Today’s Agenda 1 2 3 Setting the Stage: Agile Testing Manifesto Definitions: Shift Left Testing, Performance Testing, Accessibility Testing 5 Fundamentals of Performance Testing for Mobile and Web Apps Best Practices for Embedding Performance & Accessibility Testing in the Build Cycle 4 Fundamentals of Accessibility Testing for Mobile and Web Apps 6 Demos 7 Q&A
  • 4. Digital Engagement Reality – More Relevant Than Ever
  • 5. perfecto.io5 | Perfecto by Perforce © 2020 Perforce Software, Inc. The Agile Testing Manifesto THE DEVOPS MANIFESTO ✔ Continuous testing over testing at the end. ✔ Embracing all testing activities over only automated functional testing. ✔ Testing what gives value over testing everything. ✔ Testing across the team over testing in siloed testing departments. ✔ Product coverage over code coverage.
  • 6. perfecto.io6 | Perfecto by Perforce © 2020 Perforce Software, Inc. Valuable Test Automation to Optimize the Delivery Pipeline vs OPTIMIZED DELIVERY PIPELINE Innovation Throughput Quality of Output Time Cost
  • 7. perfecto.io7 | Perfecto by Perforce © 2020 Perforce Software, Inc. Balancing Test Automation Coverage
  • 9. perfecto.io9 | Perfecto by Perforce © 2020 Perforce Software, Inc. • Accessibility is the practice of making your apps (mobile/web) usable by as many people as possible. We traditionally think of this as being about people with disabilities, but the practice of making sites accessible also benefits other groups — such as those with slow network connections, etc. • Apps need to be accessible for everyone, including those that have vision disabilities, hearing disabilities, or otherwise impaired users (physical, cognitive, etc.). • 15% of the world population experiences some form of disability (The World Bank). • Cost of non-compliance with WCAG/508/ADA and other accessibility standards varies by jurisdiction, with an average fines of $300,000- $600,000 (this does not include additional costs — engineering, brand, etc.). • https://getadaaccessible.com/ada-compliance-law-and-penalities/ • https://www.ada.gov/civil_penalties_2014.htm • Varying levels of Accessibility Success Criteria: A, AA, AAA • https://www.w3.org/WAI/standards-guidelines/wcag/ What Is Accessibility Testing?
  • 10. perfecto.io10 | Perfecto by Perforce © 2020 Perforce Software, Inc. • Most accessibility tests are done manually or not at all, most cycles are being outsourced by enterprises. • Accessibility testing is not part of the cycle and does not occur as often as needed since it’s not automated — • Real-life examrisk of penalties due to escaped defects and lack of compliance.ple: $356,775 for an accessibility lawsuit after total cost for litigation. • Will disrupt sprint cycles and product defects are 100X more expensive to fix after the fact. Accessibility Testing — What’s the Pain Today?
  • 11. perfecto.io11 | Perfecto by Perforce © 2020 Perforce Software, Inc. • PERFORMANCE TESTING checks the speed, response time, reliability, resource usage, and scalability of a software program under their expected workload. • In performance testing, there are two types: • Load Testing • Stress Testing • The purpose of performance testing is not to find functional defects, but to eliminate performance bottlenecks in the software or device. • The focus of performance testing is checking a software program’s following KPIs: • Speed — Determines whether the application responds quickly (response time). • Scalability — Determines maximum user load the software application can handle (bandwidth). • Stability — Determines if the application is stable under varying loads. • Reliability — Measurement of software consistency to give same results repeatedly. What Is Performance Testing?
  • 13. Neotys © . All Rights Reserved. Change of Methodology Requirements Design Implementation Testing Acceptance Deployment Inception Elaboration Construction Transition Development Operations DevOps Big Bang Waterfall Incremental Rational Unified Process Agile Scrum, Kanban Continuous DevOps Digital Singularity Agile Event Horizon 6+ 4 2 1 Change of Methodology
  • 14. Neotys © . All Rights Reserved. OK, but let’s review our architecture first • From Monolithic Presentation Layer Business Layer Data Layer One application per host Having the entire business logic Let’s Review Our Architecture First
  • 15. Neotys © . All Rights Reserved. OK, but let’s review our architecture first • To New Microservices Front Service A Service B Service C Sevice D Service E Service F Service G Every service is managed by a dedicated team Let’s Review Our Architecture First
  • 16. Neotys © . All Rights Reserved. Let’s move to the cloud! • Reduce the cost. • Increase the availability of the application. • Simplify, modernize. Let’s Move to the Cloud
  • 17. Neotys © . All Rights Reserved. Efficient and realistic workload model Efficient and Realistic Workload Model
  • 18. Neotys © . All Rights Reserved. Traditional monitoring Tracking system APM Let’s Re-Use Monitoring Data
  • 19. Neotys © . All Rights Reserved. Test Performance Continuously API Testing Test a Component Application Testing Test Real World Integration Testing Test a System Continuous Testing Embedded in CI/CD Pipelines Let’s Extract Data From Our APM to Learn How Our App is Used
  • 20. Neotys © . All Rights Reserved. Architecture is based on components Architecture Is Based on Components
  • 21. Neotys © . All Rights Reserved. Error rate Throughput + response time versus objectives Resources check Test failure Process to Analyse
  • 22. Neotys © . All Rights Reserved. File defining the indicators and the objectives Quality Gate Collecting the specification Retrieving the data from the datasource Calculate the score Datasourc e Quality Gate
  • 24. perfecto.io24 | Perfecto by Perforce © 2020 Perforce Software, Inc. Most Accessibility Work Is Done Much Too Late in the Process Production Environment Most accessibility activity is conducted out here
  • 25. perfecto.io25 | Perfecto by Perforce © 2020 Perforce Software, Inc. Deque Enables You to Shift Left WorldSpace Attest WorldSpace Assure WorldSpace Comply Deque Solution Design Training and Services
  • 26. perfecto.io26 | Perfecto by Perforce © 2020 Perforce Software, Inc. Where You Find and Fix Issues Matters If issue caught during maintenance: $7,600 If issue caught during QA/testing: $960 If issue caught during build:$240 If issue caught in development $80 Good Bad Source: IBM http://www-01.ibm.com/support/docview.wss?uid=swg27048410&aid=1
  • 27. perfecto.io27 | Perfecto by Perforce © 2020 Perforce Software, Inc. • Accessibility testing cannot be automated. • Accessibility testing is usability testing. Accessibility Myths
  • 28. perfecto.io28 | Perfecto by Perforce © 2020 Perforce Software, Inc. Generic Accessibility Automation powered by Deque
  • 29. perfecto.io29 | Perfecto by Perforce © 2020 Perforce Software, Inc. No Code Merges Until #axeClean!
  • 31. perfecto.io31 | Perfecto by Perforce © 2020 Perforce Software, Inc. • Test while you develop. Interactive Testing
  • 32. perfecto.io32 | Perfecto by Perforce © 2020 Perforce Software, Inc. Encode Design Annotation in Automated Tests … // Check the edit button’s text // select the button and the heading let button = fixture.querySelector(‘button.edit’) let heading = fixture.querySelector(‘.Heading’) // get the two elements’ accessible names let headingText = axe.commons.text.accessibleText (heading) let buttonText = axe.commons.text.accessibleText(button) // compare expect(buttonText).toBe(‘Edit ‘ + headingText) …
  • 33. Best Practices & Recommendations
  • 34. perfecto.io34 | Perfecto by Perforce © 2020 Perforce Software, Inc. Pipeline Testing Coverage Example: Where Does Performance/Accessibility Fit?
  • 35. Demos
  • 36. perfecto.io36 | Perfecto by Perforce © 2020 Perforce Software, Inc. Perfecto Integrates With Both Neotys & Deque Axe Solutions
  • 38. Pipeline 1 Retrieve latest version of the Code/Test Build and launch tests 2 Build the application and launch the selenium tests Generate Junit Report 3 Generate Junit report in Jenkins Deploy load testing infrastructure 4 Deploy NeoLoad Load Generator Run Load Test 5 Run Load test with perfecto integration
  • 39. Demo
  • 40. NeoLoad : Reduce Total Cost of Ownership (TCO) • Digital, web, mobile, SAP Oracle EBS… • 5-10x faster test design: • Scriptless test design and validation — reduce errors. • Reduce time to market — spend more time on performance engineering vs. script writing. • 20x faster script maintenance — Agile/DevOps. • Reduce spend on tools: • Much higher ROI. • Flexible pricing model. “We saw an 80% reduction in costs while NeoLoad generated 1.2 million virtual users from Neotys Cloud Platform in 15 minutes to prep for our busiest day of the year, Boxing Day.”
  • 41. Neotys © . All Rights Reserved. NeoLoad’s Platform On-Prem Docker Stack RESTful APIs NeoLoad Core NeoLoad Web NeoLoad SaaS Managed/Hosted Load Generators &
  • 42. Neotys © . All Rights Reserved. NeoLoad Web Design Desktop GUI connection On- premise SaaS Runtime & Analysis NeoLoad Web
  • 43. Neotys © . All Rights Reserved. Collaboration Between Teams • Performance engineers can update the project’s build by the developers from NeoLoad GUI. • Early testing assets can be reused in system-wide testing.
  • 44. Neotys © . All Rights Reserved. One Platform for Component Testing & System Wide Testing
  • 45. Free axe Browser Extension Run automated accessibility tests against your website. It’s totally free and even has cool beta features available with sign up. ✓ Single page tests ✓ Remediation help axe Auditor Perform comprehensive WCAG audits of all content and applications. ✓ Comprehensive testing methodology ✓ Predefined issues for all content ✓ Group and filter issues for easy communication axe DevTools Integrate accessibility testing into your existing automated testing process with this toolkit. ✓ Automated testing ✓ Intelligent guided testing ✓ CI/CD integrations ✓ CLI ✓ Expert tools axe Monitor Dynamically scan, monitor, and report on the accessibility status of your site. ✓ PDFs and web pages ✓ Scan whole sites ✓ Scan behind authentication ✓ Scan behind the firewall ✓ Drill-down dashboard axe: the Standard in Accessibility Testing
  • 46. perfecto.io46 | Perfecto by Perforce © 2020 Perforce Software, Inc. Deque Enables You to Shift Left
  • 47. What Is the Difference Between the Free Extension & axe DevTools? Free extension axe DevTools Axe-core library ✓ ✓ "Learn more" remediation resources ✓ ✓ Intelligent guided tests ✓* ✓ Test record manager & user dashboard ✓* ✓ Export issues & limit test scope ✓* ✓ Managed user data and analytics ✓ CLI ✓ CI/CD integration ✓ On-prem installation option ✓ Custom rules support ✓ Enterprise support ✓ *currently in beta
  • 48. perfecto.io48 | Perfecto by Perforce © 2020 Perforce Software, Inc. Perfecto’s 4 Key Pillars of Continuous Testing in DevOps This is where money is spent (Time, Tools, Resources) This is where value is being realized, quality is improved Unified solution serves DevOps with greater effectiveness.
  • 49. Q&A
  • 50. Thank You! Visit perfecto.io or follow us @perfectomobile