Visual Validation - The missing tip of the automation pyramid @AgileIndia2020
1 like1,156 views
https://confengine.com/agile-india-2020/proposal/11065/visual-validation-the-missing-tip-of-the-automation-pyramid The top of the pyramid is our UI / end-2-end functional tests - which simulate end-user behavior and interactions with the product-under test. While Automation helps validate functionality of your product, aspects of UX validations can only be seen and captured by the human eye and is hence mostly a manual activity. This is an area where AI & ML can truly help. With everyone wanting to be Agile, make quick releases, the look & feel / UX validation, which is a slow, and error-prone activity, quickly becomes a huge bottleneck. In addition, with any UX related issues propping up cause huge brand-value and revenue loss, may lead to social-trolling and worse - dilute your user-base. In this session, using numerous examples, we will explore: Why Automated Visual Validation is essential to be part of your Test Strategy Potential solutions / options for Automated Visual Testing, with pros & cons of each How an AI-powered tool, Applitools Eyes, can solve this problem.
1 of 49
Download to read offline
Recommended
Getting started with Visual Testing using Applitools - @TPC, Feb2020
Getting started with Visual Testing using Applitools - @TPC, Feb2020Anand Bagmar Workshop on "Getting started with Visual Testing using Applitools - @TPC (Test Practitioners Club, NCR), Feb2020"
Rewrite vs Refactor (AgileIndia 2021)
Rewrite vs Refactor (AgileIndia 2021)Anand Bagmar Slides from my talk on "Rewrite Vs Refactor" given at Agile India 2021. https://confengine.com/conferences/agile-india-2021/proposal/15495/rewrite-vs-refactor
In this session, I will share various examples and experiences and as a result of being in such situations, the factors I looked at when enhancing the code-base to decide - should I refactor or rewrite the code-under-consideration to be able to move forward faster, while moving towards the long-term vision.
Though I will focus on various examples of Test Automation, this session is applicable for any role that writes / maintains code of any nature.
Measuring Coverage From E2E Tests
Measuring Coverage From E2E TestsAnand Bagmar It is easy to measure code coverage when running unit tests.
However, very frequently the following questions come up:
- How can we measure API test coverage and e2e / UI test coverage?
- Does e2e / UI test coverage add value?
- If not, what other data can we look at to know if the e2e tests have good coverage?
This session is about understanding the above questions, and finding solutions for the same.
Next Generation Functional & Visual Testing powered by AI
Next Generation Functional & Visual Testing powered by AIAnand Bagmar Slides from hands-on workshop at Agile India 2021.
Machine setup instructions are available in the proposal - https://confengine.com/conferences/agile-india-2021/proposal/15552/next-generation-functional-amp-visual-testing-powered-by-ai
In this workshop, using numerous examples, we will explore:
Why Automated Visual Validation is essential to be part of your Test Strategy
How Visual AI increases the coverage of your functional testing, while reducing the code, and increasing stability of your automated tests
Potential solutions / options for Automated Visual Testing, with pros & cons of each
How an AI-powered tool, Applitools Eyes, can solve this problem
Hands-on look at Applitools Visual AI and how to get started using it
Measuring Consumer Quality - The Missing Feedback Loop
Measuring Consumer Quality - The Missing Feedback LoopAnand Bagmar Slides from my talk on Measuring Consumer Quality - The Missing Feedback Loop - delivered at PSTC 2018
Eradicate Flaky Tests - AppiumConf 2021
Eradicate Flaky Tests - AppiumConf 2021Anand Bagmar Slides from my talk on how to Eradicate Flaky Tests from AppiumConf 2021
https://confengine.com/conferences/appium-conf-2021/proposal/15581/eradicate-flaky-tests
Selenium Deep Dive
Selenium Deep DiveAnand Bagmar This document outlines an agenda for a Selenium workshop. It covers topics like getting started with Selenium, implementing page object models and design patterns, handling test data, using assertions, and responsive web design testing. Exercises are provided to demonstrate concepts like building page objects, running tests across browsers, and using test data. The goal is to help students learn Selenium concepts and address common automation challenges.
Getting started with Appium 2.0
Getting started with Appium 2.0Anand Bagmar Slides used in workshop on "Getting started with Appium 2.0" at AppiumConf 2021
https://confengine.com/conferences/appium-conf-2021/proposal/15634/getting-started-with-appium-20
Does your functional automation really add value?
Does your functional automation really add value?Anand Bagmar We all know that automation is one of the key enablers for those on the CI-CD journey.
Most teams are:
• implementing automation
• talking about its benefits
• up-skilling themselves
• talking about tooling
• etc.
In my experience, unfortunately most of the functional automation that is built is:
• not optimal
• not fit-for-purpose
• does not run fast enough
• gives inconsistent feedback, hence unreliable
Hence, for the amount of effort invested in implementing automation, are you really getting the value from this activity?
In this talk, we will discuss these challenges and why it would lead to poor ROI of automation. More importantly, we will discuss the following techniques to make automation valuable:
• know the objective for the automation framework
• establish criteria for tests to be automated
• design your framework with proper abstraction layers
• develop using appropriate design patterns
Appium vs Appium with Perfecto
Appium vs Appium with PerfectoLizzy Guido (she/her) This document provides an agenda and overview of a tech talk comparing Appium and Appium with Perfecto for automation testing. The summary introduces Perfecto as a cloud-based quality lab for testing applications on real devices, describes how Perfecto extends Selenium and Appium to support additional capabilities, and previews a demo of creating a sample project and script using the Perfecto plugin in IntelliJ.
Visual Validation - The Missing Tip of the Automation Pyramid
Visual Validation - The Missing Tip of the Automation PyramidAnand Bagmar The Test Automation Pyramid is not a new concept. The top of the pyramid is our UI / end-2-end functional tests - which should cover the breadth of the product.
What the functional tests cannot capture though, is the aspects of UX validations that can only be seen and in some cases, captured by the human eye. This is where the new buzzwords of AI & ML can truly help.
In this session, we will explore why Visual Validation is an important cog in the wheel of Test Automation and also different tools and techniques that can help achieve this. We will also see a demo of Applitools Eyes - and how it can be a good option to close this gap in automation!
Visual AI Testing Using Applitools
Visual AI Testing Using ApplitoolsMikhail Laptev The document discusses using Applitools for visual AI testing. It provides an overview of Applitools, which allows testing user interfaces through visual assertions rather than traditional code-based assertions. This avoids issues like managing locators and adjusting assertions. The document then demonstrates how to set up and implement visual AI testing using Applitools in Java, including configuring Eyes, setting up tests, and executing visual checks on elements and full pages. It concludes that while visual AI testing has advantages, a hybrid approach combining it with traditional testing may be best to avoid false positives.
Automation of Security scanning easy or cheese?
Automation of Security scanning easy or cheese?Dmitriy Gumeniuk I will share my experience of SDLC enablement on enterprise level. Uncover pitfalls and gotchas about building of developer friendly CI enabled service using industry standard static and dynamic scanning tools, CI platforms, ReportPortal, Carrier platform and Jira integration service.
What is Agile Testing? How does Automation help?
What is Agile Testing? How does Automation help?Anand Bagmar Agile Methodology is not new. Many organisations / teams have already adopted Agile way of Software Development or are in the enablement journey for the same.
What does this mean for Testing? There is no doubt that the Testing approach and mindset also needs to change to be in tune with the Agile Development methodology.
Learn what does it mean to Test on Agile Projects. Also, learn how Test Automation approach needs to change for the team to be successful!
Also, see the skills and capabilities required to make anyone in the Quality / Testing role add tremendous value to the team!
Perils of Page-Object Pattern
Perils of Page-Object PatternAnand Bagmar This document discusses the perils of using the page object pattern for test automation frameworks. It describes the page object pattern, how it can be used to model pages in code and reduce duplication. However, it also notes limitations like tests becoming too implementation focused rather than intent focused. It then introduces a business layer page object pattern that aims to address these limitations by validating business requirements and separating concerns with abstraction layers. This allows the test pyramid to remain balanced and makes maintenance and scaling easier.
Role of Automation in Testing
Role of Automation in TestingAnand Bagmar Slides explaining the Agile process, and how Test Automation plays a key role in enabling teams to be successful in this fast moving process.
Sharing (less) Pain of using Protractor & WebDriver
Sharing (less) Pain of using Protractor & WebDriverAnand Bagmar Slides from my talk in Selenium Conference London 2016 about "Sharing (Less) Pain with Protractor & Selenium WebDriver"
See blog for more information - http://essenceoftesting.blogspot.com/2016/11/shared-relatively-less-pain-of-using.html
My blog: https://essenceoftesting.blogspot.com
Automating Web Analytics
Automating Web AnalyticsAnand Bagmar Slides from workshop conducted at ThoughtWorks, Pune in vodQA, on Sat, 27th August, 2016.
Workshop Facilitators - Anand Bagmar, Smriti Tuteja, Pallipuspa Samal, Rohit Singhal, S Ramalingam, Shilpa G
More information about vodQA, and this workshop can be found from the following links -
https://essenceoftesting.blogspot.com/2016/08/vodqa-pune-less-talk-only-action-agenda.html
https://essenceoftesting.blogspot.com/search/label/vodQA
https://essenceoftesting.blogspot.com/search/label/waat
To Deploy or Not-To-Deploy - decide using TTA's Trend & Failure Analysis
To Deploy or Not-To-Deploy - decide using TTA's Trend & Failure AnalysisAnand Bagmar Here are the slides from my recent talks on "To Deploy or Not-To-Deploy - decide using TTA's Trend and Failure Analysis"
More information available from my blog:
http://essenceoftesting.blogspot.com/search/label/tta
Client-Side Performance Testing
Client-Side Performance TestingAnand Bagmar Slides from my 4-hour workshop on Client-Side Performance Testing conducted at Phoenix, AZ in STPCon 2017 (March).
Workshop Takeaways:
Understand difference between is Performance Testing and Performance Engineering.
Hand’s on experience of some open-source tools to monitor, measure and automate Client-side Performance Testing.
Examples / code walk-through of some ways to automate Client-side Performance Testing.
See blog for more details - https://essenceoftesting.blogspot.com/2017/03/workshop-client-side-performance.html
The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)
The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)Anand Bagmar Learning Objectives:
The most used and heard about buzz words in the Software Industry today are … IoT and Big Data!
With IoT, with a creative mindset looking for opportunities and ways to add value, the possibilities are infinite. With each such opportunity, there is a huge volume of data being generated - which if analyzed and used correctly, can feed into creating more opportunities and increased value propositions.
There are 2 types of analysis that one needs to think about.
1. How is the end-user interacting with the product? This will give some level of understanding into how to re-position and focus on the true value add features for the product.
2. With the huge volume of data being generated by the end-user interactions, and the data being captured by all devices in the food-chain of the offering, it is important to identify patterns from what has happened, and find out new product / value opportunities based on usage patterns.
Learn what is Web Analytics, why is it important, and see some techniques how you can test it manually and and also automate that validation.
Colorful world-of-visual-automation-testing-latest
Colorful world-of-visual-automation-testing-latestOnur Baskirt In agile software development world, we are dealing with many test tasks such as user story testing, exploratory testing, check-list based testing, regression testing, performance testing, security testing in each sprint. Besides these testing activities, one of the test types which is considerably getting crucial is visual regression testing.
Visual regression testing focuses on to check visual contents and animations, page layout, and responsive design of a website/app. Because of the limits of human vision, human-based visual regression testing is generally error-prone and cumbersome. Hence, automation is inevitable. It enables us to run the tests much more precisely in a short time period. Also, it saves us a significant amount of time to deal with other manual test activities in each sprint.
In this talk, we will walk through well-known open-source and commercial solutions for visual test automation. We will learn which technologies they use, what type of visual tests they are suitable for, and their major differences between each other. Besides this overview, we will also make a real-life visual test automation demo by using Selenium, ImageMagick, and AShot.
Client-Side Performance Testing
Client-Side Performance TestingAnand Bagmar Slides from the workshop I conducted on "Client-side Performance Testing".
Abstract of the workshop:
In this workshop, we will see the different dimensions of Performance Testing and Performance Engineering, and focus on Client-side Performance Testing.
Before we get to doing some Client-side Performance Testing activities, we will first understand how to look at client-side performance, and putting that in the context of the product under test. We will see, using a case study, the impact of caching on performance, the good & the bad! We will then experiment with some tools like WebPageTest and Page Speed to understand how to measure client-side performance.
Lastly - just understanding the performance of the product is not sufficient. We will look at how to automate the testing for this activity - using WebPageTest (private instance setup), and experiment with yslow - as a low-cost, programatic alternative to WebPageTest.
SauceCon 2017: Testing @ the Speed of Concurrency
SauceCon 2017: Testing @ the Speed of ConcurrencySauce Labs Learn the why, what and how of testing with concurrency. In this talk, Mike will take attendees on an automation journey of in-house machine testing into cloud-based testing. He will show what worked, what didn’t and discuss things to improve as the machines are increasingly doing the work.
Patterns in Test Automation
Patterns in Test AutomationAnand Bagmar Building a Test Automation Framework is easy - there are so many resources / guides / blogs / etc. available to help you get started and help solve the issues you get along the journey.
However, building a "good" Test Automation Framework is not very easy. There are a lot of principles and practices you need to use, in the right context, with a good set of skills required to make the Test Automation Framework maintainable, scalable and reusable.
Design Patterns play a big role in helping achieve this goal of building a good and robust framework.
In this talk, we will talk about, and see examples of various types of patterns you can use for:
Build your Test Automation Framework
Test Data Management
Locators / IDs (for finding / interacting with elements in the browser / app)
Using these patterns you will be able to build a good framework, that will help keep your tests running fast, and reliably in your CI / CD setup!
Enabling CD in Enterprises with Testing
Enabling CD in Enterprises with TestingAnand Bagmar Slides from my talk in Agile India 2015, Discuss Agile 2015 on "Enabling Continuous Delivery (CD) in Enterprises with Testing"
Stop Testing (Only) The Functionality of Your Mobile Apps!
Stop Testing (Only) The Functionality of Your Mobile Apps!Applitools The document discusses different strategies for testing mobile apps, including testing functionality, usability, performance, and more extensively than just functionality. It addresses testing on real devices versus emulators, the need for accessibility testing, and tools for testing areas like contrast, text-to-speech, location services and network bandwidth. The document also discusses visual testing strategies like using AI to detect visual differences and validating user interfaces.
Say NO To (More) Selenium Tests
Say NO To (More) Selenium TestsAnand Bagmar Bhumika S, Anand Bagmar (Thoughtworks)
How many times do we test the same things at multiple layers, multiple levels, adding time to the build process and testing cycle, delaying the feedback?
We know what to test and how to test, but what is the right place to test it?
In this workshop, we will demonstrate how we, as QA’s, can identify which tests can be classified as unit tests, integration tests, and functional tests. Using a case study, we will see how each component can be tested as part of unit testing; the integration of different parts and the functioning of a software system as a whole, and how functional tests fit into this big picture. We will then bring all these tests together to understand and build the testing pyramid and how it enables us to build the right testing framework with fewer Selenium, i.e., functional tests.
Visual Validation - The missing tip of the automation pyramid @GoT2022
Visual Validation - The missing tip of the automation pyramid @GoT2022Anand Bagmar The document discusses visual validation testing as a missing piece of the automation testing pyramid. Visual testing is important but challenging as it is typically done manually, which is tedious, error-prone, and difficult to scale. Automating visual testing can help by taking screenshots of expected user interfaces and comparing them to actual screenshots. However, automating also poses challenges around false positives/negatives, maintaining baselines, and accounting for product changes. The document promotes using artificial intelligence in visual test automation to help address these challenges and advocates for including visual testing in an organization's overall quality and automation strategy.
Visual validation - The missing tip of the automation pyramid @ QA Symposium
Visual validation - The missing tip of the automation pyramid @ QA SymposiumAnand Bagmar Slides from my talk on "Visual Validation - The missing tip of the automation pyramid", given at QA Symposium, Feb 2020
More Related Content
What's hot (20)
Does your functional automation really add value?
Does your functional automation really add value?Anand Bagmar We all know that automation is one of the key enablers for those on the CI-CD journey.
Most teams are:
• implementing automation
• talking about its benefits
• up-skilling themselves
• talking about tooling
• etc.
In my experience, unfortunately most of the functional automation that is built is:
• not optimal
• not fit-for-purpose
• does not run fast enough
• gives inconsistent feedback, hence unreliable
Hence, for the amount of effort invested in implementing automation, are you really getting the value from this activity?
In this talk, we will discuss these challenges and why it would lead to poor ROI of automation. More importantly, we will discuss the following techniques to make automation valuable:
• know the objective for the automation framework
• establish criteria for tests to be automated
• design your framework with proper abstraction layers
• develop using appropriate design patterns
Appium vs Appium with Perfecto
Appium vs Appium with PerfectoLizzy Guido (she/her) This document provides an agenda and overview of a tech talk comparing Appium and Appium with Perfecto for automation testing. The summary introduces Perfecto as a cloud-based quality lab for testing applications on real devices, describes how Perfecto extends Selenium and Appium to support additional capabilities, and previews a demo of creating a sample project and script using the Perfecto plugin in IntelliJ.
Visual Validation - The Missing Tip of the Automation Pyramid
Visual Validation - The Missing Tip of the Automation PyramidAnand Bagmar The Test Automation Pyramid is not a new concept. The top of the pyramid is our UI / end-2-end functional tests - which should cover the breadth of the product.
What the functional tests cannot capture though, is the aspects of UX validations that can only be seen and in some cases, captured by the human eye. This is where the new buzzwords of AI & ML can truly help.
In this session, we will explore why Visual Validation is an important cog in the wheel of Test Automation and also different tools and techniques that can help achieve this. We will also see a demo of Applitools Eyes - and how it can be a good option to close this gap in automation!
Visual AI Testing Using Applitools
Visual AI Testing Using ApplitoolsMikhail Laptev The document discusses using Applitools for visual AI testing. It provides an overview of Applitools, which allows testing user interfaces through visual assertions rather than traditional code-based assertions. This avoids issues like managing locators and adjusting assertions. The document then demonstrates how to set up and implement visual AI testing using Applitools in Java, including configuring Eyes, setting up tests, and executing visual checks on elements and full pages. It concludes that while visual AI testing has advantages, a hybrid approach combining it with traditional testing may be best to avoid false positives.
Automation of Security scanning easy or cheese?
Automation of Security scanning easy or cheese?Dmitriy Gumeniuk I will share my experience of SDLC enablement on enterprise level. Uncover pitfalls and gotchas about building of developer friendly CI enabled service using industry standard static and dynamic scanning tools, CI platforms, ReportPortal, Carrier platform and Jira integration service.
What is Agile Testing? How does Automation help?
What is Agile Testing? How does Automation help?Anand Bagmar Agile Methodology is not new. Many organisations / teams have already adopted Agile way of Software Development or are in the enablement journey for the same.
What does this mean for Testing? There is no doubt that the Testing approach and mindset also needs to change to be in tune with the Agile Development methodology.
Learn what does it mean to Test on Agile Projects. Also, learn how Test Automation approach needs to change for the team to be successful!
Also, see the skills and capabilities required to make anyone in the Quality / Testing role add tremendous value to the team!
Perils of Page-Object Pattern
Perils of Page-Object PatternAnand Bagmar This document discusses the perils of using the page object pattern for test automation frameworks. It describes the page object pattern, how it can be used to model pages in code and reduce duplication. However, it also notes limitations like tests becoming too implementation focused rather than intent focused. It then introduces a business layer page object pattern that aims to address these limitations by validating business requirements and separating concerns with abstraction layers. This allows the test pyramid to remain balanced and makes maintenance and scaling easier.
Role of Automation in Testing
Role of Automation in TestingAnand Bagmar Slides explaining the Agile process, and how Test Automation plays a key role in enabling teams to be successful in this fast moving process.
Sharing (less) Pain of using Protractor & WebDriver
Sharing (less) Pain of using Protractor & WebDriverAnand Bagmar Slides from my talk in Selenium Conference London 2016 about "Sharing (Less) Pain with Protractor & Selenium WebDriver"
See blog for more information - http://essenceoftesting.blogspot.com/2016/11/shared-relatively-less-pain-of-using.html
My blog: https://essenceoftesting.blogspot.com
Automating Web Analytics
Automating Web AnalyticsAnand Bagmar Slides from workshop conducted at ThoughtWorks, Pune in vodQA, on Sat, 27th August, 2016.
Workshop Facilitators - Anand Bagmar, Smriti Tuteja, Pallipuspa Samal, Rohit Singhal, S Ramalingam, Shilpa G
More information about vodQA, and this workshop can be found from the following links -
https://essenceoftesting.blogspot.com/2016/08/vodqa-pune-less-talk-only-action-agenda.html
https://essenceoftesting.blogspot.com/search/label/vodQA
https://essenceoftesting.blogspot.com/search/label/waat
To Deploy or Not-To-Deploy - decide using TTA's Trend & Failure Analysis
To Deploy or Not-To-Deploy - decide using TTA's Trend & Failure AnalysisAnand Bagmar Here are the slides from my recent talks on "To Deploy or Not-To-Deploy - decide using TTA's Trend and Failure Analysis"
More information available from my blog:
http://essenceoftesting.blogspot.com/search/label/tta
Client-Side Performance Testing
Client-Side Performance TestingAnand Bagmar Slides from my 4-hour workshop on Client-Side Performance Testing conducted at Phoenix, AZ in STPCon 2017 (March).
Workshop Takeaways:
Understand difference between is Performance Testing and Performance Engineering.
Hand’s on experience of some open-source tools to monitor, measure and automate Client-side Performance Testing.
Examples / code walk-through of some ways to automate Client-side Performance Testing.
See blog for more details - https://essenceoftesting.blogspot.com/2017/03/workshop-client-side-performance.html
The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)
The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)Anand Bagmar Learning Objectives:
The most used and heard about buzz words in the Software Industry today are … IoT and Big Data!
With IoT, with a creative mindset looking for opportunities and ways to add value, the possibilities are infinite. With each such opportunity, there is a huge volume of data being generated - which if analyzed and used correctly, can feed into creating more opportunities and increased value propositions.
There are 2 types of analysis that one needs to think about.
1. How is the end-user interacting with the product? This will give some level of understanding into how to re-position and focus on the true value add features for the product.
2. With the huge volume of data being generated by the end-user interactions, and the data being captured by all devices in the food-chain of the offering, it is important to identify patterns from what has happened, and find out new product / value opportunities based on usage patterns.
Learn what is Web Analytics, why is it important, and see some techniques how you can test it manually and and also automate that validation.
Colorful world-of-visual-automation-testing-latest
Colorful world-of-visual-automation-testing-latestOnur Baskirt In agile software development world, we are dealing with many test tasks such as user story testing, exploratory testing, check-list based testing, regression testing, performance testing, security testing in each sprint. Besides these testing activities, one of the test types which is considerably getting crucial is visual regression testing.
Visual regression testing focuses on to check visual contents and animations, page layout, and responsive design of a website/app. Because of the limits of human vision, human-based visual regression testing is generally error-prone and cumbersome. Hence, automation is inevitable. It enables us to run the tests much more precisely in a short time period. Also, it saves us a significant amount of time to deal with other manual test activities in each sprint.
In this talk, we will walk through well-known open-source and commercial solutions for visual test automation. We will learn which technologies they use, what type of visual tests they are suitable for, and their major differences between each other. Besides this overview, we will also make a real-life visual test automation demo by using Selenium, ImageMagick, and AShot.
Client-Side Performance Testing
Client-Side Performance TestingAnand Bagmar Slides from the workshop I conducted on "Client-side Performance Testing".
Abstract of the workshop:
In this workshop, we will see the different dimensions of Performance Testing and Performance Engineering, and focus on Client-side Performance Testing.
Before we get to doing some Client-side Performance Testing activities, we will first understand how to look at client-side performance, and putting that in the context of the product under test. We will see, using a case study, the impact of caching on performance, the good & the bad! We will then experiment with some tools like WebPageTest and Page Speed to understand how to measure client-side performance.
Lastly - just understanding the performance of the product is not sufficient. We will look at how to automate the testing for this activity - using WebPageTest (private instance setup), and experiment with yslow - as a low-cost, programatic alternative to WebPageTest.
SauceCon 2017: Testing @ the Speed of Concurrency
SauceCon 2017: Testing @ the Speed of ConcurrencySauce Labs Learn the why, what and how of testing with concurrency. In this talk, Mike will take attendees on an automation journey of in-house machine testing into cloud-based testing. He will show what worked, what didn’t and discuss things to improve as the machines are increasingly doing the work.
Patterns in Test Automation
Patterns in Test AutomationAnand Bagmar Building a Test Automation Framework is easy - there are so many resources / guides / blogs / etc. available to help you get started and help solve the issues you get along the journey.
However, building a "good" Test Automation Framework is not very easy. There are a lot of principles and practices you need to use, in the right context, with a good set of skills required to make the Test Automation Framework maintainable, scalable and reusable.
Design Patterns play a big role in helping achieve this goal of building a good and robust framework.
In this talk, we will talk about, and see examples of various types of patterns you can use for:
Build your Test Automation Framework
Test Data Management
Locators / IDs (for finding / interacting with elements in the browser / app)
Using these patterns you will be able to build a good framework, that will help keep your tests running fast, and reliably in your CI / CD setup!
Enabling CD in Enterprises with Testing
Enabling CD in Enterprises with TestingAnand Bagmar Slides from my talk in Agile India 2015, Discuss Agile 2015 on "Enabling Continuous Delivery (CD) in Enterprises with Testing"
Stop Testing (Only) The Functionality of Your Mobile Apps!
Stop Testing (Only) The Functionality of Your Mobile Apps!Applitools The document discusses different strategies for testing mobile apps, including testing functionality, usability, performance, and more extensively than just functionality. It addresses testing on real devices versus emulators, the need for accessibility testing, and tools for testing areas like contrast, text-to-speech, location services and network bandwidth. The document also discusses visual testing strategies like using AI to detect visual differences and validating user interfaces.
Say NO To (More) Selenium Tests
Say NO To (More) Selenium TestsAnand Bagmar Bhumika S, Anand Bagmar (Thoughtworks)
How many times do we test the same things at multiple layers, multiple levels, adding time to the build process and testing cycle, delaying the feedback?
We know what to test and how to test, but what is the right place to test it?
In this workshop, we will demonstrate how we, as QA’s, can identify which tests can be classified as unit tests, integration tests, and functional tests. Using a case study, we will see how each component can be tested as part of unit testing; the integration of different parts and the functioning of a software system as a whole, and how functional tests fit into this big picture. We will then bring all these tests together to understand and build the testing pyramid and how it enables us to build the right testing framework with fewer Selenium, i.e., functional tests.
Similar to Visual Validation - The missing tip of the automation pyramid @AgileIndia2020 (20)
Visual Validation - The missing tip of the automation pyramid @GoT2022
Visual Validation - The missing tip of the automation pyramid @GoT2022Anand Bagmar The document discusses visual validation testing as a missing piece of the automation testing pyramid. Visual testing is important but challenging as it is typically done manually, which is tedious, error-prone, and difficult to scale. Automating visual testing can help by taking screenshots of expected user interfaces and comparing them to actual screenshots. However, automating also poses challenges around false positives/negatives, maintaining baselines, and accounting for product changes. The document promotes using artificial intelligence in visual test automation to help address these challenges and advocates for including visual testing in an organization's overall quality and automation strategy.
Visual validation - The missing tip of the automation pyramid @ QA Symposium
Visual validation - The missing tip of the automation pyramid @ QA SymposiumAnand Bagmar Slides from my talk on "Visual Validation - The missing tip of the automation pyramid", given at QA Symposium, Feb 2020
Getting Started with Visual Testing
Getting Started with Visual TestingApplitools Everyone wants to make quick releases, but the look-and-feel UX validation is a manual, slow, and error-prone activity. Any UX-related issues propping up cause huge brand-value and revenue loss, may lead to social-trolling, and, even worse, dilute your user base. This is an area where AI & ML can help. In this hands-on workshop, using examples, we will explore: the importance of automated visual validation how an AI-powered tool, Applitools Visual AI, can solve this problem. Integrate Applitools Visual AI in your Selenium-Java automation and learn by practice: The different AI algorithms various Applitools capabilities and features scale your automation using the Applitools Ultrafast Grid.
Automated Visual Testing at Scale : Real-life Example from Dow Jones
Automated Visual Testing at Scale : Real-life Example from Dow JonesApplitools ** Full webinar recording can be seen here: https://youtu.be/b2D8WQCOCJw **
In this session -- hosted by Sumeet Mandloi, Engineering Director @ Dow Jones (Wall Street Journal), and Eran Barlev (Sr. Customer Success Engineer @ Applitools) -- you’ll learn how you can easily avoid front-end bugs and visual regressions, as well as substantially increase coverage, by adding automated visual testing to your existing automated tests.
In addition, Mr. Mandloi shared real-life tips on how to run automated visual testing at scale, with implementation examples from Dow Jones.
Watch this session, and learn how to:
-- Successfully perform large-scale automated visual testing
-- Leverage visual testing to increase coverage, while reducing maintenance efforts
-- Run cross-browser tests with visual validation in the cloud
-- Add visual validations to your existing automated functional and unit tests
Mitigating false positives in visual testing for improved outcomes.pdf
Mitigating false positives in visual testing for improved outcomes.pdfflufftailshop Visual testing or visual regression testing is a gateway to address this, scrutinizing the user interface of a software application and helping enhance user experiences
Wrong Tool, Wrong Time: Re-Thinking Test Automation -- w/ State of Visual Tes...
Wrong Tool, Wrong Time: Re-Thinking Test Automation -- w/ State of Visual Tes...Applitools Full webinar recording:
Go through this presentation and on-demand session to learn: What Are The World’s Most Innovative Testing Teams Doing That You Are Not?
As much as we all hate to admit it, our test automation efforts are struggling. Coverage is dropping. Bugs are escaping to production. Our apps are visually complex, growing rapidly, delivered continuously, and changing constantly - so much so that our functional framework is now bloated, broken, and unable to keep up with Agile and CI-CD release best practices.
No wonder that in our latest State of Visual Testing research, the majority of companies surveyed reported that their CI-CD and automation processes are not helping them to successfully compete in today's fast-paced ecosystem, and are not effective in ensuring software quality in a scalable and robust way.
But what about those elite testing teams that got it right? What's their secret? Can we copy what they did, instead of setting ourselves to fail?
With this presentation, and on-demand session discussing it, learn how the 10% of the world’s most innovative testing teams have reinvented their test automation to support a fully automated CI-CD process, and guaranteed their company's digital transformation was a success.
Use these resources to learn:
-- Why the majority of test automation efforts are falling behind
-- How your QA and testing efforts compare to these elite teams -- via live polling results
-- 4 modern techniques that the top 10% of testing teams globally are doing every day, and that you can do too
Visual Testing: Quality and Speed -- by GIl Tayar, Applitools 
Visual Testing: Quality and Speed -- by GIl Tayar, Applitools Applitools Full webinar recording can be found here: https://youtu.be/zlRLui6WC7M
--------
Digital makes the world go ‘round, and it’s software quality on the one hand, and speed of delivery on the other, that make or break today’s business endeavours.
In the era of digital experience, where the user is king, achieving quality is crucial to a business’s success -- but speed of delivery cannot be ignored anymore, or you will feel your competition breathing down your neck. Therefore, continuous refinement of the Dev-Test-Deploy pipeline is how businesses strive to achieve both quality and speed of delivery.
In this unique session we will combine insider’s knowledge of industry trends and key shifts, alongside hands-on tools, tips, and best practices -- all of which will directly affect your day-to-day work processes, through-out the entire product release lifecycle.
Listen to guest speaker Diego Lo Giudice (Vice President, Principal Analyst at Forrester) and Gil Tayar (Sr. Architect at Applitools), and learn:
* Industry overview, importance of test automation, and where is this all going
* Importance of digital experience on the bottom line – and how companies address this in their dev-test processes
* AI-powered tools and solutions: how do they factor in to the agile and test automation equation
* Agile, Automation and CI-CD: How visual testing must too be automated with Agile and DevOps, as part of the Continuous Delivery capabilities and practices
* Real life use cases and a live demo from Applitools
Using AI-Powered Visual Tests to empower your tests
Using AI-Powered Visual Tests to empower your testsEran Barlev, ISTQB-CTFL This document discusses using AI-powered visual testing to improve test automation. It describes problems with current functional testing approaches like fragile selectors, complex validation code, and only validating expected outcomes. Visual testing is presented as a solution by replacing fragile selectors and complex code with whole-page image comparisons. Challenges with naive image diffing like anti-aliasing differences are addressed through cloud-based solutions using AI algorithms to detect meaningful visual differences like humans. The document demonstrates these concepts through a visual testing tool demo.
The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...
The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...kalichargn70th171 Visual testing plays a vital role in ensuring that software products meet the aesthetic requirements specified by clients in functional and non-functional specifications. In today's highly competitive digital landscape, users expect a seamless and visually appealing online experience. Visual testing, also known as automated UI testing or visual regression testing, verifies the accuracy of the visual elements that users interact with.
Rft courseware
Rft coursewareprakashkanamarlapudi This document provides an overview and introduction to Rational Functional Tester (RFT) software. It describes the key features and menus of RFT, including recording test scripts, replaying scripts, scripting, and creating verification points. The document also covers topics like the test object map, recording tests, context sensitive command types, and provides a sample recorded script.
Test Automation - Principles and Practices
Test Automation - Principles and PracticesAnand Bagmar This document discusses principles and practices for test automation. It covers topics like different levels of testing from unit to integration to UI, the importance of testing non-functional requirements, using a test pyramid approach with more unit and component tests than UI tests. It also discusses practices like continuous integration, test automation framework design considerations, sample framework architectures, and page object patterns. The overall goal is to provide guidance on building quality into software through effective test automation practices.
Eradicate Flaky Tests
Eradicate Flaky TestsAnand Bagmar Slides from my talk on "Techniques to Eradicate Flaky Tests" at Testing Talks - The Reunion, Melbourne, Australia on 20th Oct 2022
[webinar] Cutting-edge Functional UI Testing Techniques - w/ Adam Carmi![[webinar] Cutting-edge Functional UI Testing Techniques - w/ Adam Carmi](https://cdn.slidesharecdn.com/ss_thumbnails/20200325-functionalvisualai-200330145548-thumbnail.jpg?width=560&fit=bounds)
[webinar] Cutting-edge Functional UI Testing Techniques - w/ Adam CarmiApplitools ** Full webinar recording: **
It is no secret that many teams struggle with automated functional UI testing - some to the point where it is completely abandoned - even though the UI is the most significant interface of the system.
In this session, Adam Carmi -- Applitools CTO and Co-founder -- reviewed the main weaknesses of traditional approaches to UI testing, and how they negatively affect test stability, maintainability, coverage, execution speed, and overall ROI. He also discussed how these weaknesses become even more severe when running tests across multiple devices and browsers.
Adam demonstrated how Visual AI -- the innovative technology powering Applitools' testing engine -- can be applied on your existing pipeline to efficiently implement functional UI tests with a fraction of the effort while drastically increasing test coverage and reducing test execution time.
Adam also showed a live coding session, where he converted a traditional UI test into a Visual AI-based test in minutes, and executed it across dozens of devices and browsers in seconds using the Applitools Ultrafast Grid.
TLC2018 Justin Ison: Delivering Flawless UI - Challenges and Solutions
TLC2018 Justin Ison: Delivering Flawless UI - Challenges and SolutionsAnna Royzman Justin Ison covers different visual testing techniques; and discusses how visual test automation can increase quality, efficiency, and reduce development bottlenecks.
The Role of Visual Testing in Modern UI/UX Development
The Role of Visual Testing in Modern UI/UX DevelopmentShubham Joshi Visual consistency is crucial for delivering a seamless user experience across different devices and browsers. Visual testing helps detect layout shifts, misaligned elements, font inconsistencies, and responsiveness issues that could affect usability. Unlike functional testing, which focuses on backend logic, visual testing ensures that the UI looks and behaves as expected. By leveraging automated visual testing tools, teams can quickly identify discrepancies and maintain brand integrity. Regular visual testing helps businesses prevent UI glitches, improve accessibility, and enhance customer satisfaction by ensuring a pixel-perfect interface.
10 Lessons learned in test automation
10 Lessons learned in test automationRomania Testing Test automation is a key part of eBay's quality engineering strategy. Some lessons learned from eBay's experience with test automation include: flipping the testing triangle to focus more on end-to-end automation than manual or unit tests; treating automation as software development with processes like code reviews; and maintaining automation code for readability and ease of updating. While automation is important, manual testing remains valuable for exploring areas outside of automated test cases. The goal is to combine the benefits of both manual and automated testing for a comprehensive approach to quality.
"Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry"Applitools This document discusses software quality in the insurance industry. It introduces Joe Emison, CTO of Branch Insurance, and discusses how Branch builds software frequently in small increments using test automation. It notes challenges with traditional test automation approaches and outlines Branch's approach using unit tests, API tests, and data-driven end-to-end tests run continuously. The document also discusses how ProdPerfect and Applitools can work together to provide effortless functional and visual testing through data analysis, test case discovery, and visual AI.
Visual Regression Testing at the Speed of Unit Testing -- by Gil Tayar
Visual Regression Testing at the Speed of Unit Testing -- by Gil TayarApplitools Full webinar recording: https://youtu.be/4FIvObHfCMQ -- Listen to Gil Tayar's webinar on the new Applitools SDKs for Storybook and CypressIO, which enable developers to test and validate the visual appearance of your application across all responsive platforms.
========
Developers want their tests to run fast. In an increasingly agile world, waiting 10+ minutes for test results is a huge no-no. A new generation of browser automation tools recognize that need-for-speed and enable frontend developers to quickly automate their browser tests.
But those tests also need to check the application’s visual elements. Does the login page look OK? Does it look good in Firefox? What about mobile browsers, in 768px width? And does it still look good in 455px with a device pixel ratio of 2?
To check the visual quality of your application, across all browsers and in all those responsive widths, would necessitate a humongous grid of browsers, and an unreasonable amount of time. Far more than the 2-5 minutes usually available for a developer’s tests.
Applitools’ new Storybook and Cypress SDKs enable you to do just that: write a set of tests that run through your pages and components, and have the pages and components render in Applitools’ cloud, in parallel, on a large set of browsers and widths, and return the result in less than a minute.
Watch Gil Tayar's presentation, as he discusses the new generation of visual testing tools. Tools that move the burden of the visual work to cloud, and enable you to check what was till now impossible to check locally: the visual appearance of your application across all responsive platforms.
Testing
TestingChristian Rubiales The document discusses software testing strategies, including the testing pyramid which recommends more unit tests and fewer high-level UI tests. It notes the reverse "ice cream cone" approach and disadvantages of UI tests being slow, brittle, and giving developers less ownership. The sources of tests - business, QA, developer - are outlined, along with roles of tests that discover, describe, or demonstrate. An automated testing quadrant framework and balancing test portfolios with just enough coverage at the right levels is advised for confidence without over-testing.
Mastering Visual Testing: A Comprehensive Guide
Mastering Visual Testing: A Comprehensive Guidemorrismoses149 Ensure your digital interfaces are pixel-perfect with "Mastering Visual Testing." This essential guide for developers, QA professionals, and UX/UI designers covers the fundamentals and advanced techniques of visual testing. Learn to implement visual testing in your workflow, utilize the latest tools, manage test cases across various devices, integrate with CI/CD pipelines, and troubleshoot visual bugs. With practical tutorials and real-world examples, this book equips you with the skills to deliver visually flawless applications
More from Anand Bagmar (12)
The Path to Autonomous Testing - Anand Bagmar
The Path to Autonomous Testing - Anand BagmarAnand Bagmar Fourteen years ago, I shared my vision for the Evolution of Test Automation Frameworks in a talk titled "Future of Test Automation Tools & Infrastructure." Today, I am thrilled for two reasons: First, I've had the privilege of witnessing this evolution unfold; validating the predictions I made back then. Second, with the recent surge in AI and ML technologies within Software Testing and Test Automation, we are now closer than ever to fully realizing that vision.
In this session, I’ll take you on a journey toward achieving truly autonomous automation. We’ll delve into the evolution of the test automation lifecycle — from design, authoring, and implementation to execution and result analysis — demonstrating how AI-driven tools are transforming each phase. Effective automation is valuable and not only delivers rapid insights into product quality but also brings the team inner peace, ensuring that automated tests reliably catch issues early and enable quick, informed decisions.
We'll understand our past, examine our current position, identify the remaining gaps, and explore what's on the horizon. By adopting early feedback loops, shift-left practices, and intelligent, self-healing systems, we are forging a future where automation frameworks are not just faster and smarter, but also capable of delivering unparalleled quality and efficiency.
Join me as we navigate the path to automation nirvana, where the future of software testing is defined by autonomy, continuous improvement, and the tranquility that comes from truly valuable automation.
My Journey With Appium @AppiumConf Sept 2024
My Journey With Appium @AppiumConf Sept 2024Anand Bagmar In this session, I'll share my journey with mobile application testing using Appium, highlighting the challenges, mistakes, solutions, and insights gained from automating mobile testing since 2016. We'll delve into the intricacies of how naive I was when I started, and how I evolved to set up a robust mobile testing lab, the tools and techniques that made it possible, and the creation of Teswiz, a powerful framework to streamline mobile test automation.
https://confengine.com/conferences/appium-conf-2024/proposal/20407/my-journey-with-appium
Streamlining End-to-End Testing Automation
Streamlining End-to-End Testing AutomationAnand Bagmar Streamlining End-to-End Testing Automation with Azure DevOps Build & Release Pipelines
Automating end-to-end (e2e) test for Android and iOS native apps, and web apps, within Azure build and release pipelines, poses several challenges. This session dives into the key challenges and the repeatable solutions implemented across multiple teams at a leading Indian telecom disruptor, renowned for its affordable 4G/5G services, digital platforms, and broadband connectivity.
Challenge #1. Ensuring Test Environment Consistency: Establishing a standardized test execution environment across hundreds of Azure DevOps agents is crucial for achieving dependable testing results. This uniformity must seamlessly span from Build pipelines to various stages of the Release pipeline.
Challenge #2. Coordinated Test Execution Across Environments: Executing distinct subsets of tests using the same automation framework across diverse environments, such as the build pipeline and specific stages of the Release Pipeline, demands flexible and cohesive approaches.
Challenge #3. Testing on Linux-based Azure DevOps Agents: Conducting tests, particularly for web and native apps, on Azure DevOps Linux agents lacking browser or device connectivity presents specific challenges in attaining thorough testing coverage.
This session delves into how these challenges were addressed through:
1. Automate the setup of essential dependencies to ensure a consistent testing environment.
2. Create standardized templates for executing API tests, API workflow tests, and end-to-end tests in the Build pipeline, streamlining the testing process.
3. Implement task groups in Release pipeline stages to facilitate the execution of tests, ensuring consistency and efficiency across deployment phases.
4. Deploy browsers within Docker containers for web application testing, enhancing portability and scalability of testing environments.
5. Leverage diverse device farms dedicated to Android, iOS, and browser testing to cover a wide range of platforms and devices.
6. Integrate AI technology, such as Applitools Visual AI and Ultrafast Grid, to automate test execution and validation, improving accuracy and efficiency.
7. Utilize AI/ML-powered central test automation reporting server through platforms like reportportal.io, providing consolidated and real-time insights into test performance and issues.
These solutions not only facilitate comprehensive testing across platforms but also promote the principles of shift-left testing, enabling early feedback, implementing quality gates, and ensuring repeatability. By adopting these techniques, teams can effectively automate and execute tests, accelerating software delivery while upholding high-quality standards across Android, iOS, and web applications.
Automating the real-user scenarios across multi-apps, and multi-devices
Automating the real-user scenarios across multi-apps, and multi-devicesAnand Bagmar This document discusses teswiz, an open source framework for automating real-user scenarios across multiple apps, devices, users, and platforms. It can simulate user actions and behavior to test web, mobile web, Android, iOS, Windows, MacOS and Linux applications. Teswiz uses Cucumber, Appium, Selenium and other tools and supports features like multi-device testing, visual testing with Applitools, and generating reports with ReportPortal. The document provides instructions on getting started with teswiz and links to its GitHub page.
Design Patterns in Automation
Design Patterns in AutomationAnand Bagmar In this talk, we will talk about, and see examples of various types of patterns you can use for:
- Build your Test Automation Framework
- Test Data Management
- Locators / IDs (for finding / interacting with elements in the browser / app)
Using these patterns you will be able to build a good framework, that will help keep your tests running fast, and reliably in your CI / CD setup!
Change Tyres In A Moving Car - Make Functional Test Automation Effective Keynote
Change Tyres In A Moving Car - Make Functional Test Automation Effective KeynoteAnand Bagmar https://confengine.com/conferences/selenium-conf-2022/proposal/17141/changing-tyres-in-a-moving-car-making-functional-test-automation-effective
In my experience, I have seen teams struggle with more than one, and in many cases, all of the above statements.
On retrospection, I have realized, that most of these challenges are because of a combination of the following issues:
Lack of holistic vision, understanding, skills, and capabilities for taking on this seemingly easy activity of functional test automation
Lack of time for design, implementation, and maintenance of the automated test code
In this session, I will share, with examples, the features & capabilities that are not used right in Test Automation implementation resulting in you answering “NO” to the above statements. These are anti-patterns of functional automation implementation and have a negative impact on the quality of feedback from your automated tests.
More importantly, I will share approaches and solutions of how you can avoid these anti-patterns and evolve to answer “YES” to each of the above statements.
The Best Test Automation Framework is...
The Best Test Automation Framework is...Anand Bagmar I had the privilege of delivering the opening keynote at the recent Future Of Testing event focused on Test Automation Frameworks on 30th September 2021. My topic was “The best test automation framework is …”.
Here is the mind map I used in my keynote presentation.
https://applitools.com/future-of-testing-frameworks-north-america-2021/
Collaboration - A Taboo!
Collaboration - A Taboo!Anand Bagmar When one has fun at work, work becomes fun. However, daily pressures, metrics, KPIs, and what not, have dissolved the fun, and made work drudgery in various ways. This creates stress for individuals, in teams, and across teams, there is mistrust, unnecessary competition, blame, finger-pointing ….What better way to learn, and re-learn the basics of life, work, team-work - than to play a game, have fun, and correlate it with how life and work indeed should be treated as a game, and we should have fun in this journey. Only then can people truly succeed, and so can organisations.Here, we will play a game – “Collaboration - A Taboo!” – where you will –Re-learn collaboration techniques via a game!Learning applicable for individuals & teams, in small or big organisationsRe-live your childhood when playing this gameBe prepared for a twist which will leave you thinking!
The What, Why and How of Analytics Testing
The What, Why and How of Analytics TestingAnand Bagmar Here are slides from my talk on "What, Why and How of Analytics Testing" at Selenium Conference, Berlin 2017.
This talk focusses on Analytics related to Browser & Mobile Native apps, with impact on / of IoT (Internet of Things) and Big Data.
See my blog for more details - https://essenceoftesting.blogspot.com/2017/10/analytics-forgotten-child.html
Patterns of a “good” test automation framework
Patterns of a “good” test automation frameworkAnand Bagmar This document discusses patterns for test automation frameworks. It begins by introducing common patterns like page objects, business layer, and factories. It then provides examples of page object and business layer page object patterns. The document also discusses test data patterns and different ways to specify test data and locators. Finally, it outlines advantages of using patterns like reduced complexity, reusability, and maintenance. The key message is that the best pattern depends on the specific test automation context.
Sharing the pain using Protractor
Sharing the pain using ProtractorAnand Bagmar Slides from my talk in Selenium Conference 2016 about "Sharing the pain with Protractor & Selenium WebDriver"
See blog for more information - http://essenceoftesting.blogspot.com/2016/06/sharing-pain-using-protractor.html
My blog: http://essenceoftesting.blogspot.com
Test Data - Food for your Test Automation Framework
Test Data - Food for your Test Automation FrameworkAnand Bagmar Slides from my talk in Selenium Conference 2016, Bangalore
Blog post: http://essenceoftesting.blogspot.com/2016/06/test-data-food-for-test-automation.html
Abstract:
Building a Test Automation Framework is easy - there are so many resources / guides / blogs / etc. available to help you get started and help solve the issues you get along the journey.
Teams already building 1000s of tests of various types - UI, web service-based, integration, unit, etc. is a proof of that.
However, building a "good" Test Automation Framework is not very easy. There are a lot of principles and practices you need to use, in the right context, with a good set of skills required to make the Test Automation Framework maintainable, scalable and reusable.
In this talk, we will focus on one of the critical aspects and patterns in building the Test Automation framework - Test Data!
We will look at different data patterns as options and techniques how to create, manage, use, reuse Test Data in a way to keep the tests running in an reliable and deterministic way. We will also discuss what questions to ask, what things to think about in selecting your approach for Test Data!
This discussion will be applicable for any type of Test Automation (web / mobile / desktop), but, we will focus primarily on UI automation frameworks, ex. using Selenium.
Video & blog post will be linked soon!
Recently uploaded (20)
Daily Agile Snippets That Boost Team Focus and Flexibility
Daily Agile Snippets That Boost Team Focus and FlexibilityOrangescrum In this blog, I’ll break down the smallest, most effective Agile practices that can transform how your team operates daily. Expect real-world strategies, practical routines, and stats-backed insights to help you sprint, pivot, and win one focused day at a time.
Scaling up your Snapshot tests, without the friction
Scaling up your Snapshot tests, without the frictionarnold844201 We talk about why most companies give up on snapshot tests, and how you can improve your tooling to scale up your snapshot testing (and testing) efforts
And overview of Nasdanika Models and their applications
And overview of Nasdanika Models and their applicationsPavel Vlasov This presentation provides an overview of Nasdanika metamodels and their applications - reference documentation, analysis, code generation, use with GenAI operating on complex structures instead of text - humans don't think in text, they think in images (diagrams) - objects and their relationships. Translating human thoughts to text is an "expensive" and error prone process. And this is where diagramming, modeling, and generation of textual description from a model can help humans and GenAI to communicate better.
Skilling up your dev team - 8 things to consider when skilling-up your dev team
Skilling up your dev team - 8 things to consider when skilling-up your dev teamDerk-Jan de Grood Slides of my DevOps Pro
Europe 2025 presentation Vilnius:
Most IT organizations face challenges of being underskilled or understaffed, making it difficult to find skilled developers and manage workload efficiently. This leads to risks, dependencies, and delays, particularly when critical tasks depend on a few key developers.
Investing in employee development is crucial for improving performance and attracting talent, but it requires strategic planning and collaboration. Companies are aware of this, so why do they keep failing?
Successful upskilling involves team autonomy, leadership buy-in, and dedicated focus. This presentation outlines eight key considerations for effective upskilling: defining clear roles, identifying needed skills, conducting gap analyses, planning for future needs, exploring diverse training methods, securing leadership support, actively monitoring progress, and embedding upskilling into HR processes. By addressing these aspects, organizations can foster technical excellence and continuous improvement.
BoxLang-Dynamic-AWS-Lambda by Luis Majano.pdf
BoxLang-Dynamic-AWS-Lambda by Luis Majano.pdfOrtus Solutions, Corp Unlock the full potential of cloud computing with BoxLang! Discover how BoxLang’s modern, JVM-based language streamlines development, enhances productivity and simplifies scaling in a serverless environment.
How OnePlan & Microsoft 365 Ensure Strategic Alignment with AI-Powered Portfo...
How OnePlan & Microsoft 365 Ensure Strategic Alignment with AI-Powered Portfo...OnePlan Solutions Organizations must double down on high-impact initiatives and cut low-value efforts. In this session, see how OnePlan, built on Microsoft 365, helps organizations make informed, AI-powered prioritization decisions, optimize funding, and reallocate constrained resources for maximum impact.
Multiple Platforms of Unity Game Development.pdf
Multiple Platforms of Unity Game Development.pdfNova Carter Unity Game Development stands out for its unparalleled flexibility across multiple platforms, making it a top choice for developers aiming to reach a broad audience. With Unity, creators can build a game once and deploy it seamlessly across mobile devices, desktops, gaming consoles, web browsers, and even AR/VR systems. This multi-platform capability reduces development costs and effort while ensuring consistent performance and user experience across devices. Whether targeting casual mobile gamers or console enthusiasts, Unity empowers developers to scale their games effectively and maintain a competitive edge in today’s diverse gaming landscape.
Why-Choose-an-Authorised-Microsoft-Reseller.pptx
Why-Choose-an-Authorised-Microsoft-Reseller.pptxMichael cole Choosing an authorized Microsoft reseller ensures that your business gets authentic software, professional licensing guidance, and constant technical support.Certified resellers offer secure deployment, compliance with Microsoft standards, and tailored cloud solutions — helping businesses maximize ROI, reduce risks, and stay up to date with the latest Microsoft innovations.
Getting Started with BoxLang - CFCamp 2025.pdf
Getting Started with BoxLang - CFCamp 2025.pdfOrtus Solutions, Corp 📄 Getting Started with BoxLang – CFCamp 2025 Session with Luis Majano
Explore the foundations of BoxLang, the next-generation dynamic JVM language created by Ortus Solutions, in this introductory session led by its creator, Luis Majano, at CFCamp 2025.
This PDF contains the full slide deck from the session, walking attendees through the key concepts, syntax, and use cases of BoxLang, along with live coding examples and tips for building modern web applications. Ideal for developers seeking hands-on experience with a language designed to be modular, productive, and future-proof.
A special thank you to the CFCamp team for providing us with the space to share our vision and help the community take its first steps with BoxLang. 🌐
arvr & metaverse development services.pdf
arvr & metaverse development services.pdfmarketing810348 Flyerssoft leads the way in AR/VR and Metaverse development services, creating immersive and interactive digital experiences that transform how businesses engage with their audiences. Our expert team designs cutting-edge augmented reality apps, virtual reality games, and interconnected metaverse environments that boost user engagement, enhance training efficiency, and open new opportunities across industries such as education, entertainment, retail, and more. By leveraging advanced technologies like Unreal Engine, Unity, blockchain, and AI, Flyerssoft delivers scalable, secure, and innovative solutions tailored to your business needs. We partner with Fortune 500 companies, entrepreneurs, and brands to build next-generation virtual spaces that inspire and revolutionize digital interaction, ensuring your business stays ahead in this rapidly evolving landscape.
Kubernetes BateMetal Installation and Practice
Kubernetes BateMetal Installation and Practicewonyong hwang A hands-on exercise installing Ubuntu Linux on VirtualBox and setting up Kubernetes with a control plane and worker nodes
Practicing pod, replicas, deployment, and services (NodePort, ClusterIP), load balancer, and ingress in a bare-metal environment
Best Practices Salesforce Training & Documentation.pptx
Best Practices Salesforce Training & Documentation.pptxMichael Orias Presentation on best practices Salesforce training and documentation.
Advance Sales Commission Payments in Odoo
Advance Sales Commission Payments in OdooAxisTechnolabs ♦️Sales Commission in Odoo is really easy to use and manage commissions payment, Sales Commission Dashboard for Quick counts of Total Sales Commission, Total Invoice Commission, Total payment Commission. Save your time for individual sales commission calculation and create the invoice for any commission and many more useful features.
🔗Visit and Buy Now : https://bit.ly/4fBJ5Ok
♦️Axistehnolabs Present Manage your sales commission Payment in odoo with Sales commission dashboard, calculation of commission based on invoice, product, product categories and product margin
✅Sales Commission Odoo module includes :
👉Sales Commission Based On Sale Order
👉Sales Commission Based On Invoice
👉Sales Commission Based On Payment
👉Calculate Commission Based on Products
👉And More.....
✅Just Click on below sales commission payment odoo App link🔗 And explore more interesting features of sales commission payment odoo module
✅App download now :🔗
Odoo 18 : https://bit.ly/4fBJ5Ok
Odoo 17 : https://bit.ly/3KCDt9i
Odoo 16 : https://bit.ly/3w0iKEZ
Odoo 15 : https://bit.ly/3vAszKL
Odoo 14 : https://bit.ly/35QTVBI
Odoo 13 : https://bit.ly/3J8exDY
Odoo 12 : https://bit.ly/3shwCIO
👉Explore more odoo Apps : https://bit.ly/3oFIOCF
👉Want A Free DEMO ? :📩 [email protected]
👉Want to discuss ?: 🌐https://www.axistechnolabs.com/
👉Looking Odoo services : 👇
https://www.axistechnolabs.com/services/odoo-development
👉Contact Us : 091066 49361
#odoo #Odoo18 #odoo17 #odoo16 #odoo15 #odooerp #odooapp #Odooservices #odoodev #salescommission #odootag #odoonewfeatures #PaymentCommission #salescommissionrates #odooapps #odoomodule #odooerp #growth #businesssolution #salescommissionpayment #saleordercommission #InvoiceCommission #MonthlyCommission #odoonewfeatures #commissionspaymentModule #sales #business #commissionpayment #GenerateCommission #levelupwithodoo #socialmedia #digitalmarketing #OdooSalesCommissionmodule #odooimplementation #axistechnolabs #OdooSolutions
Menu in Android (Define,Create,Inflate and Click Handler)
Menu in Android (Define,Create,Inflate and Click Handler)Nabin Dhakal In Android, a **menu** provides options for user actions and navigation in an app. Menus can appear as **options menus** (accessed via the app bar), **context menus** (triggered by long-press), or **popup menus** (small floating lists). They are typically defined in XML using `<menu>` and `<item>` tags and inflated using `MenuInflater` in activities or fragments. Developers handle menu item clicks using `onOptionsItemSelected()` or similar methods. Menus help improve usability by grouping actions in a consistent interface. Common use cases include settings, search, and sharing options, offering a clean and accessible way to enhance app functionality.
Menus in Android offer a consistent and user-friendly way to present actions and navigation options within an app. By using options menus for global actions, context menus for specific UI elements, and popup menus for flexible interaction, developers can enhance the overall usability and functionality of their applications. Proper implementation of menus not only organizes actions effectively but also improves the user experience by making key features easily accessible.
LightBurn 1.7.0.6 + Crack Download🔓
LightBurn 1.7.0.6 + Crack Download🔓Berkeley Download Link 👇
https://techblogs.cc/dl
LightBurn Crack is a powerful and versatile software for laser engraving and cutting that is designed to work with a wide variety of ...
R12.2 Latest Feature Update for oracle release 12
R12.2 Latest Feature Update for oracle release 12Ashish Tarkar latest version for oralce to update.
Learn more
The latest Oracle Database version is Oracle Database 23ai. Oracle also has Oracle APEX 24.2 and Oracle Forms 14.1.2.0.0. Oracle Database 23ai is a long-term release with AI-centric features.
Here's a more detailed look:
Oracle Database 23ai:
This version is noted for its AI-centric capabilities, including AI Vector Search and JSON Relational Duality Views. It also includes a built-in SQL Firewall for enhanced security. Oracle Database 23ai is available for free for development and testing.
Oracle APEX 24.2:
This is the latest release of Oracle APEX, a low-code development platform for web applications.
Oracle Forms 14.1.2.0.0:
This is the latest version of Oracle Forms, a platform for creating desktop and web applications. One of the most popular database systems worldwide, Oracle, is trusted by some of the biggest businesses in operation. With many different Oracle database versions released, Oracle provides innovative capabilities in many areas, including management, performance, security, and development.
Both database administrators and developers can easily use this database system to create innovative applications for their business operations. The Oracle brand is well known for its continued dedication to paving the future development of upgraded features to better assist businesses, small and large, with their data management needs. Currently, the latest Oracle versions include Oracle Database 19c (Long Term Release), 21c (Innovation Release), and the newly released, 23c (Long Term Release).
Oracle Database 19c (Long-Term Release):
Released in January 2019 as part of the long-term release for the 12.2 product family, Oracle Database 19c brings stability and extended support until April 30, 2027. Premier support is available until April 30, 2026. Notable features include Query Quarantine for managing system resources, enhanced JSON support with simplified syntax and SODA APIs, and automatic indexing using Machine Learning algorithms for improved performance. The introduction of hybrid partitioned tables allows for efficient management both inside and outside the database.
Oracle Database 21c (Innovation Release):
Oracle Database 21c, released as an innovation release, provides early insights into enhancements and new capabilities. Premier support is available until April 30, 2024, with no extended support. While not eligible for extended support, 21c includes limited quarterly release updates (RUs). The innovation release model allows users to experience cutting-edge technologies for developing or deploying new applications.
Oracle Database 23c (Long-Term Release):
Oracle Database 23c, known by its codename "App Simple," marks the next significant leap in Oracle's commitment to simplifying the development and operation of data-driven applications. Released on September 19, 2023, this long-term release (LTR) builds upon the foundation of Oracle Database 21c's innovation
(Ethical) Alternatives to Piracy: A Quick Guide to Free and Open Source Softw...
(Ethical) Alternatives to Piracy: A Quick Guide to Free and Open Source Softw...s-m-quadri This presentation, titled "Ethical Alternatives to Piracy", originates from a scholarly effort at Deogiri Institute of Engineering and Management Studies. It addresses the urgent ethical, legal, and cybersecurity challenges posed by the widespread use of pirated software. Piracy is defined as the unauthorized use of paid digital content, and it is a practice fraught with risks—ranging from legal consequences and data breaches to malware infections, software crashes, and absence of support or updates. Alarming statistics indicate that 91% of users in India engage in piracy, a number that has surged due to increased digital dependence in the post-pandemic era.
The presentation transitions from critique to constructive solution by introducing reliable, free, and ethical alternatives via Free and Open Source Software (FOSS) and free operating systems. Emphasizing India's moral and cultural ethos, the speaker argues for a shift from piracy to integrity-driven digital usage, especially among engineering professionals. Two robust Linux-based alternatives to Windows are discussed: Ubuntu Studio, aimed at creatives with its XFCE desktop and Long Term Support (LTS) stability; and Pop!_OS, designed for STEM users, offering a GNOME desktop that balances performance with usability.
A broad selection of FOSS tools is explored as viable substitutes for expensive proprietary software. These include Blender (3D animation; alternative to Maya), Natron (compositing; alternative to After Effects), DaVinci Resolve (professional-grade editing), Kdenlive (video editing), VLC (media playback and conversion), OBS Studio (screen recording and streaming), and Audacity or Ardour (audio editing and mixing). Visual design needs are met by Inkscape and GIMP, serving as counterparts to Adobe Illustrator and Photoshop, respectively. Productivity is addressed through LibreOffice as an alternative to Microsoft Office, and tools like VS Code, Android Studio, VirtualBox, Synaptic, and Stacer round out the system management and development environment options.
The central argument is not to vilify proprietary software, but to discourage unethical use through piracy. FOSS alternatives offer a legitimate, secure, and often equally powerful path for students, professionals, and institutions. The presentation concludes by encouraging a transition to open-source ecosystems—not just as a technical decision, but as a step toward ethical, sustainable, and secure digital practice. It is a call to adopt responsible engineering values and become part of the global open-source movement.
Salesforce Experience Cloud Consulting.pdf
Salesforce Experience Cloud Consulting.pdfVALiNTRY360
VALiNTRY360’s Salesforce Experience Cloud Consulting services empower organizations to build personalized, engaging digital experiences for customers, partners, and employees. Our certified Salesforce experts help you design, implement, and optimize Experience Cloud portals tailored to your business goals. From self-service communities to partner collaboration hubs, we ensure seamless integration, enhanced user engagement, and scalable solutions. Whether you're improving customer support or streamlining partner communication, VALiNTRY360 delivers strategic consulting to maximize the value of Salesforce Experience Cloud. Trust us to transform your digital experiences into powerful tools that drive loyalty, efficiency, and growth. Partner with VALiNTRY360 to elevate every user interaction.
For more info visit us https://valintry360.com/salesforce-experience-cloud
Visual Validation - The missing tip of the automation pyramid @AgileIndia2020
- 1. Visual Validation The Missing Tip of the Automation Pyramid @BagmarAnand Anand Bagmar Software Quality Evangelist
- 3. How do you test …. @BagmarAnand
- 4. @BagmarAnand
- 5. • Pen writes properly • Cap closes properly • Looks as expected • Can hold the pen properly • … • … @BagmarAnand Typical answers
- 7. @BagmarAnand
- 9. What is missing here? @BagmarAnand
- 10. How do you ensure what was working before, is working now as well! @BagmarAnand
- 13. Unit (xUnit / JavaScript) Manual / Exploratory Web Service UI / e2e Business-facing Tests Technology-facing Tests @BagmarAnand Test Pyramid Slow More integration Expensive Fast More isolation Cheap
- 14. Unit (xUnit / JavaScript) Manual / Exploratory Web Service UI / e2e Technology-facing Tests @BagmarAnand Test Pyramid Slow More integration Expensive Fast More isolation Cheap Workflow API Contract Consumer Provide r Business-facing Tests
- 15. @BagmarAnand Test Pyramid – Includes NFRs Unit (xUnit / JavaScript) Manual / Exploratory Web Service UI / e2e Performance Security Accessibility Analytics
- 18. @BagmarAnand
- 19. @BagmarAnand
- 20. @BagmarAnand
- 21. @BagmarAnand
- 22. It happens in Software too! @BagmarAnand https://cdn.pixabay.com/photo/2013/07/12/15/58/smiley-150663_1280.png Surprise
- 23. It happens to Twitter @BagmarAnand
- 24. It happens to UPS @BagmarAnand
- 25. It happens to Financial Times @BagmarAnand
- 26. It Happens to Amazon @BagmarAnand
- 27. It happens to HDFC Bank @BagmarAnand
- 28. Bugs escape because our approach to testing is incorrect @BagmarAnand
- 30. UX / Visual Testing The Missing Piece @BagmarAnand
- 31. • Business / Revenue loss • Brand / Credibility loss • You loose your users! @BagmarAnand If Visual Testing is NOT done …..
- 32. @BagmarAnand What is Visual Testing?
- 34. • Mostly done manually done @BagmarAnand Visual Testing
- 35. • Mostly done manually done @BagmarAnand Challenges of Visual Testing • tedious • very error prone • impossible to scale and repeat • blocker for CI-CD
- 36. • Mostly done manually done • Functional Automation can help @BagmarAnand Visual Testing
- 37. • Mostly done manually done • tedious • very error prone • impossible to scale and repeat – especially in days of CD! • Functional Automation may help – a little @BagmarAnand Challenges of Visual Testing
- 39. • Create baselines by taking screenshots of expected UI • Compare screenshots • Whole page • Snippets • Update baselines as product evolves / changes @BagmarAnand How does it work?
- 40. Challenges of Automating Visual Testing @BagmarAnand
- 41. • False positives / negatives • Baseline creation and maintenance • Browsers • Devices • Resolutions / Viewports • Result analysis & identifying next steps @BagmarAnand Challenges of Automated Visual Validation
- 42. AI in Visual Test Automation @BagmarAnand
- 44. Test Automation Pyramid Unit (xUnit / JavaScript) Component Integration View Web Service UI Manual / Exploratory @BagmarAnand
- 45. @BagmarAnand Test Pyramid – Includes UX & NFRs Unit (xUnit / JavaScript) Manual / Exploratory Web Service UI / e2e Performance Security Accessibility Analytics UX
- 47. • Have a holistic Quality Strategy for your produce • Shift-Left to get quick feedback • Include Visual Testing in your Automation Strategy @BagmarAnand Summary
- 48. • The Practical Test Pyramid - https://martinfowler.com/articles/practical-test-pyramid.html • Testing Pyramids & Ice-Cream Cones - https://watirmelon.blog/testing-pyramids/ • Applitools – www.applitools.com @BagmarAnand References