QA Fest 2014. Антон Капитаненко. Web – магия qa процессов в (сверх-) высоко-нагруженных системах для продуктовой компании

Nov 4, 20141 like1,127 views

Современный, сложный, нагруженный - это короткое описание того WEB, который создается в Wargaming, и вполне возможно, в вашей компании. Для того, чтобы различные проекты пользовались лучшими практиками предшественников (и не наступали на уже 100 раз опробованные грабли), мы выработали свои процессы и подходы к созданию ПО. В этом докладе я хочу сделать обзор именно QA части в этом процессе – и я очень надеюсь, что вы сможете почерпнуть что-то полезное именно для своих проектов. Аспекты, которые будут затронуты: •пред-производственные (QA) активности • QA во время production • виды (не-функционального) тестирования • Dev / Test площадки • тестовые артефакты • выпуск продукта и post-release активности

Web-magic of QA processesin (super-) high-loaded systems for (super-) production company
Anton Kapitanenko
QA Manager at WG
Ukraine, Kiev, Web Department

Who is responsible for quality?
2Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 3
How overall process looks like (super-high level)

Pre-production
4Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company

Pre-production
5Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company
System Analyst
>> High-Level Requirements
[optional] Designer
>> Mockups
[optional] Dev and UX-designers
>> Prototypes
Product Manager
>> Product Vision

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 6
Pre-production
What about QA Lead activities?
High-Level Requirements testing
Review UX
High-Level Planning:
• Strategy
• Wetware

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 7
Production
QA Lead – create formal Master Test Plan
Strategy + Approaches
Hardware + Software + Wetware

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 8
Production
QA Lead – create formal Master Test Plan
Strategy + Approaches
Hardware + Software + Wetware
QA Team Stakeholders

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 9
QA Lead – perform Version Planning
Version
Test
Plan
Evaluate
Risks
Estimate
Activities
Prioritize
Tasks

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 10
QA Lead – perform Version Planning
Version
Test
Plan
Evaluate
Risks
Estimate
Activities
Prioritize
Tasks
Interactive
Easy to understand
Easy to
understand

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 11
QA Lead – perform Version Planning
ContinuesImprovement
Version
Test
Plan
Evaluate
Risks
Estimate
Activities
Prioritize
Tasks
Interactive Easy

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 12
How to entertain testers before code RFT?
Create
checklists
Design auto-
scripts
Design
test cases

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 13
Test Case Checklist

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 14
Auto-scripts
Robots work
– Happy
human
Some tasks
cannot be
tested by
human
Increasing
volume of
regression
testing
Frameworks ||

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 15
Production.
Testing
Functional NFT
Security testing
+ audits
Performance testing
+ audits
Integration

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 16
Production.
Testing
Functional NFT
Security testing
+ audits
Performance testing
+ audits
Integration
Demo!

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 17
Stagings
[Pre-trunk]
Trunk
Stable
[Integration]
[Common]
Production

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 18
Releases
Package
IndependentEmergency
Game

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 19

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 20
After Releases #1
Test Summary Reports
Iteration Retrospective Analysis
Release Post-mortems

Test
Summary
Report
Interactive
Contains
dates,
statuses,
environment
Easy even
to “M”
Perspective
Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 21

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 22
After Releases #1
Test Summary Reports
Iteration Retrospective Analysis
Release Post-mortems

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 23
After Releases #1
Test Summary Reports
Iteration Retrospective Analysis
Release Post-mortems

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 24
After Releases #2
We can help to:
• Support
• Make improvements
Focus on monitoring

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 25
After Releases #3
After release start pre-prod activities
QA Team is always in production phase or release phase

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 26
P.S.

Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 27
P.P.S.

… and let’s connect 
Anton Kapitanenko
QA Manager at WG
Ukraine, Kiev, Web Department
e-mail: a_kapitanenko@wargaming.net
Web-magic of QA processes: in (super-) high-loaded systems for (super-) production company 28

The document discusses how to build quality into software development from the start using Lean QA and Agile Testing. It emphasizes that quality is a team effort and should be considered from the beginning of development. Key aspects discussed include minimizing waste, risk-based testing, automating tests, traceability between requirements and tests, and integrating testing into continuous development processes.

QA in Agile WorldDr. Tathagat Varma

This document discusses quality assurance (QA) in agile software development. It explains that in agile, QA is a continuous process integrated throughout the project lifecycle. Each iteration aims to produce potentially shippable code through practices like test-driven development, refactoring, and continuous integration which help build quality in from the start. The agile lifecycle is broken into short iterative cycles in contrast to the traditional waterfall model where testing occurs in distinct phases after coding is complete.

Agile QA 2.0Matthew Philip

Shift left as first transformation step into Quality AssuranceZbyszek Mockun

Do you work in a company which has established effective testing process, which ensure high quality and support Agile methodologies? Can your testing process be used as a model for other companies? Fortunately, we were in that place a few years ago and had to ask ourselves a question about the next step. The answer was: Let’s be Quality Assurance Engineers rather than Testers. But what should we do? How can we do this transformation? At the same time, I got feedback from my colleague – Head of Java practice: “Your testers found defects in areas / scenarios which weren’t included in development scope / my devs didn’t know that should cover those edge cases. What can we do with that?” I had to agree with him. There is no sense to test scenarios which weren’t implemented. This was the starting point of our transformation. We decided to implement Shift left model as it looks like the most promising one. But when we implemented it not everything worked as smooth as we wished. New challenges appeared, but more in my presentation.

QA team transition to agile testing at Alcatel LucentAgileSparks

In this session I will outline/explore the journey of a common QA team without coding skills into Agile testing arena. Main focus on Acceptance Test Driven Development and executable specs. The session will be based on a real case study from Alcatel Lucent Haifa. At the end of the session you will understand the concept of executable specs,and ATDD, You will see real example of test implementation in ATDD tool (Cucumber) and will understand the steps required to make such transition with some do/not do tips in tool and process implementation (based on Alcatel case study). You will get (printed) the suggested implementation plan and do/not do tips of ATDD automation tools implementation

Agile testing - Testing From Day 1Kaizenko

Slides from a session presented by Fadi Stephan from Kaizenko at the 2019 Global Scrum Gathering in Austin, TX on 05/20/2019 DC. Also see the blog series on Agile Testing at https://www.kaizenko.com/agile-testing/ Abstract: Many teams struggle with fitting in testing activities inside of a Sprint. They end up doing primarily development activities in a Sprint and push testing activities to run in dedicated testing Sprints following the coding Sprints or have a coding and testing Sprint running in parallel. However, in Scrum, the output of every Sprint is a potentially shippable product increment. This means the product increment should be well tested within the Sprint and ready to be delivered. Come to this presentation to learn how to tackle testing on an Agile team, what kind of tests to execute, what to automate and what not to automate, the different test responsibilities, and when to run which tests. Leave with a testing strategy that you can start applying the next day to gradually get a team to start testing from day 1 of the Sprint and deliver a true product increment at the end of each Sprint.

Agile Testing by ExampleMikalai Alimenkou

Scrum Testing MethodologyGaya1985

The document provides an overview of agile scrum testing methodology. It describes agile testing as testing practices that follow the agile manifesto and treat development as the customer of testing. It then outlines the key aspects of scrum testing including product backlogs, sprints, daily standup meetings, sprint planning and retrospectives. It also discusses the proposed scrum testing process of identifying test scenarios, writing test cases per sprint, delayed execution, and inclusion of defects in the product backlog.

Dev opsTomas Riha

DevOps aims to integrate development and operations teams to shorten the development cycle. It builds on principles from Agile development which emphasize continuous delivery of working software and frequent feedback loops between teams. DevOps seeks to further reduce feedback times from months or weeks to hours or minutes by breaking down barriers between functions and having teams take full responsibility for software delivery from development to production support.

The DevOps Dance - Shift Left, Shift Right - Get It RightInflectra

Continuous delivery its not about the technology, its about the people. @sats...Tomas Riha

This document discusses the challenges of implementing continuous delivery at scale. It began with a small, highly productive team practicing test-driven development and continuous regression testing. However, when the team scaled up, they lost these practices and their quality dropped. The document outlines changes needed in development processes, testing approaches, and team roles to successfully adopt continuous delivery at an enterprise scale. Developers must take more responsibility for testing and quality. Testers need skills in test automation and working with developers. Teams must be cross-functional and take full ownership of delivery. Continuous delivery requires transforming the entire organization, not just the technology.

Testing in a DevOps teamLaurent PY

Agile Test AutomationWerner Keil

This document summarizes an Agile Test Automation session which covered: - The agenda included an introduction to Agile testing process and tools, a demonstration, and Q&A - Agile values like communication and feedback affect testing by making the whole team responsible for quality using test-driven development and continuous integration - Test automation tools discussed included test harnesses like JUnit and Selenium, as well as functional testing tools like Cucumber and Concordion

A confused tester in agile world finalversionAshish Kumar

This document discusses challenges faced by testers in agile environments. It begins with a story of a confused tester and presents several case studies of different organizations' approaches to testing in agile projects. It identifies common challenges such as changing requirements, lack of information, testing pace, and skills. A survey found that test automation, risk tracking, and cross-functional teams are commonly implemented agile practices. The document concludes with principles of testing being a continuous responsibility of the whole team.

Automation CICDLumban Sopian

Continuous integration (CI) and continuous delivery (CD) are practices that allow developers to integrate code changes frequently and reliably while automating the process of building, testing, and deploying the code. With CI/CD, code changes are validated through automated builds and tests before being deployed to staging environments and potentially production. The CI/CD workflow involves committing code to a repository, running automated tests, building if tests pass, deploying to staging for further testing, and deploying to production if all tests are passed, with the ability to rollback changes if needed. Tools used in CI/CD include those for version control, building, testing, and deploying code changes across environments.

Introduction to Continuous Delivery (BBWorld/DevCon 2013)Mike McGarr

This document provides an introduction and overview of continuous delivery. It discusses why releases are difficult, and proposes continuous delivery as an alternative approach where software is always in a releasable state and deployments can occur frequently through automation. It covers principles like automating everything and keeping the build and release process fast and reliable. Specific practices discussed include configuration management, continuous integration, testing, deployment pipelines, and deployment automation using tools like version control systems, build servers, and configuration management tools.

Agile QA processAshish Agrawal

Agile tour ncr test360_degree - agile testing on steroidsVipul Gupta

This document discusses challenges with product testing in agile environments and introduces an approach called "Agile Testing on Steroids" to address these challenges. It presents the philosophy behind Agile Testing on Steroids which is to take a pragmatic approach using integrated toolsets and practices to remove subjectivity from decision making. Key aspects include test automation, continuous integration, requirement and test case management, defect tracking, and metrics collection to enable fact-based prioritization, decisions and traceability between requirements, code, tests and defects. The benefits outlined are more streamlined, systematic and comprehensive testing that acts as an informal collaboration platform.

Simplifying QA Process With JiraICHOFU VICTOR

Zainab Igwe gave a presentation on simplifying QA processes using Atlassian tools like Bitbucket, Jenkins, Confluence, and Jira at Opera Payments. She discussed how Confluence is used for meeting notes, requirements analysis, test planning, and strategy documentation. Jira is used for tracking bugs, features, sprint planning, and release management. Bitbucket integrates with Jenkins for continuous integration, running automated test scripts on each code commit in the development workflow. The presentation emphasized how Atlassian tools support collaboration and help QA teams unleash their full potential.

About Agile Testing Alliance (ATA)Agile Testing Alliance

A Non-profit testing community and certification organization. A global alliance of visionary industry leaders, prominent authors, leading educational institutions and testing evangelists who are passionate about proliferation of agile in testing. The Mission: - To grow agile testing awareness, practices and acceptance. - To create a learning road-map specifically in agile testing space. - To identify the milestones that can be evaluated, certified and thus recognized.

A Concise QA Process Arslan Ali

This document summarizes a concise QA and testing process developed for a small startup. It includes protocols for building, testing, managing changes, and releasing software. The build protocol ensures testing receives builds and information about changes. The test cycle protocol defines different types of testing cycles. The change protocol establishes feature freezes and code freezes to control changes late in development. The release protocol details the release approval and packaging process.

Agile Testing Best PracticesStephen Ritchie

Have you ever bumped into a wall with your automated tests? Many developers bump into various roadblocks and hurdles when writing test code. Are your test methods starting to fail because the code-under-test uses the current date and time? Are your automated integration tests failing because the database they integrate with keeps changing? Do you have an explosion of test methods, with the ratio of test code to code-under-test way too high? Is your effort to refactor and improve code overwhelmed by the time it takes to rewrite all those failing unit tests? This presentation is about clearing away Agile testing obstacles, avoiding common pitfalls, and staying away from dangerous practices.

Optimising Quality Assurance in an Agile WorldOriginal Software

Until now there have been two camps for Application Quality Management (AQM) systems. Traditional Tools like HP QC that have proved inflexible for agile developments and maintenance heavy, or new agile tools from Version One or Rally Software, which are agile specific tools and not suitable for use outside agile environments or corporate-wide where teams are using a mix of processes. With many organisations moving to or experimenting with Agile, Original Software has been acclaimed by the analyst community as the best solution for supporting Agile. [Original Software nominated Agile Best Tool Award] Just as improvements in developer's software tools and methods have enabled a shift in development approaches, next generation technology for test automation is similarly reframing the opportunities for testers to automate earlier in the delivery cycle without incurring the heavy burden of script maintenance so often associated with traditional automation tools. This means that not only can an agile environment be adopted, application quality is maintained and the total testing time reduced. - See more at: http://www.origsoft.com/solutions/agile-software-testing/

Shift Left Testing: Going Beyond AgileTechWell

The concept of “shifting testing left” in the software development lifecycle is not new. Shifting testing from manual to automated and then upstream into engineering is a driving factor in DevOps and agile software development. However, Michael Nauman wonders why test automation, DevOps, and agile software development still frequently fail to deliver on their promises? Aligning and hardening your DevOps and test automation—along with streamlining your agile processes—is critical to your project. Michael shares how AutoCAD’s shifting testing left enabled improvements within their engineering team. Learn how the team increased engineering reliability and velocity, and forced process changes upstream into design and research all the way through to product support. Leave knowing why the concept of separation of concerns with regards to quality is as fundamental as the separation of code quality from product quality. Learn how the AutoCAD web team used process dogma and ruthless prioritization to combat metric idolatry and the host of other evils that hold teams back from fully realizing their potential and going beyond agile.

Introducing QA Into an Agile EnvironmentJoseph Beale

This document discusses introducing quality assurance (QA) processes into an agile development environment. It describes some common challenges that can arise when development and testing are not well integrated, such as business stakeholders finding bugs late in the process. The author advocates for making QA practices and results visible and incorporating QA personnel into agile ceremonies like planning and demos. With collaboration, commitment to quality, and clear communication, the QA team was able to gain trust and find bugs earlier. Their approach evolved to take on more types of testing, and they worked with business to define different testing levels and work testing around releases.

The New Gives and Takes in a testers role Agile Testing Alliance

The document discusses changes in the role of testers and quality assurance. It notes that companies like Facebook do not have dedicated testing teams, but instead rely on automation, user reports, and privileged beta testers to find bugs. However, as software increases in importance and complexity, more structured testing approaches are needed. The document advocates for testers to take a broader view, collaborate more across teams, and adapt their skills while maintaining independence. Testers are encouraged to find new areas to contribute and ways to help ensure overall product quality.

Agile Testing – embedding testing into agile software development lifecycle Kari Kakkonen

Role Of Qa And Testing In Agile 1225221397167302 8a34sharm

The document discusses the role of QA and testing in agile software development, describing key differences between traditional and agile testing approaches and outlining agile testing practices like test-driven development, continuous integration, regression testing, and exploratory testing. It also covers the role of testers in agile projects and provides an example of how one company, GlobalLogic, implements agile testing through a unique Velocity method and platform.

Neev QA OfferingNeev Technologies

The Pursuit of Perfection - Methods, techniques, and tools to achieve robust ...QA Systems

At the ASE Kongress (virtual event). Adam Mackay the Integrations Manager of QA Systems in the UK presented the paper “The Pursuit of Perfection - An Effective Embedded Unit Test Process for Efficient Testing”. In this session, Adam looked into the elements that come together to make a successful, fully tested, embedded application. Important topics discussed include requirements traceability, software metrics, testing frameworks, code coverage and automation. For more information, please refer to: https://www.qa-systems.com/

More Related Content

What's hot (20)

Dev opsTomas Riha

The DevOps Dance - Shift Left, Shift Right - Get It RightInflectra

Continuous delivery its not about the technology, its about the people. @sats...Tomas Riha

Testing in a DevOps teamLaurent PY

Agile Test AutomationWerner Keil

A confused tester in agile world finalversionAshish Kumar

Automation CICDLumban Sopian

Introduction to Continuous Delivery (BBWorld/DevCon 2013)Mike McGarr

Agile QA processAshish Agrawal

Agile tour ncr test360_degree - agile testing on steroidsVipul Gupta

Simplifying QA Process With JiraICHOFU VICTOR

About Agile Testing Alliance (ATA)Agile Testing Alliance

A Concise QA Process Arslan Ali

Agile Testing Best PracticesStephen Ritchie

Optimising Quality Assurance in an Agile WorldOriginal Software

Shift Left Testing: Going Beyond AgileTechWell

Introducing QA Into an Agile EnvironmentJoseph Beale

The New Gives and Takes in a testers role Agile Testing Alliance

Agile Testing – embedding testing into agile software development lifecycle Kari Kakkonen

Role Of Qa And Testing In Agile 1225221397167302 8a34sharm

Dev opsTomas Riha

The DevOps Dance - Shift Left, Shift Right - Get It RightInflectra

Continuous delivery its not about the technology, its about the people. @sats...Tomas Riha

Testing in a DevOps teamLaurent PY

Agile Test AutomationWerner Keil

A confused tester in agile world finalversionAshish Kumar

Automation CICDLumban Sopian

Introduction to Continuous Delivery (BBWorld/DevCon 2013)Mike McGarr

Agile QA processAshish Agrawal

Agile tour ncr test360_degree - agile testing on steroidsVipul Gupta

Simplifying QA Process With JiraICHOFU VICTOR

About Agile Testing Alliance (ATA)Agile Testing Alliance

A Concise QA Process Arslan Ali

Agile Testing Best PracticesStephen Ritchie

Optimising Quality Assurance in an Agile WorldOriginal Software

Shift Left Testing: Going Beyond AgileTechWell

Introducing QA Into an Agile EnvironmentJoseph Beale

The New Gives and Takes in a testers role Agile Testing Alliance

Agile Testing – embedding testing into agile software development lifecycle Kari Kakkonen

Role Of Qa And Testing In Agile 1225221397167302 8a34sharm

Similar to QA Fest 2014. Антон Капитаненко. Web – магия qa процессов в (сверх-) высоко-нагруженных системах для продуктовой компании (20)

Neev QA OfferingNeev Technologies

The Pursuit of Perfection - Methods, techniques, and tools to achieve robust ...QA Systems

2016 NIWeek - TI’s Continuous Delivery Machine for Accelerated Application De...Ching-Hwa Yu

Every organization wants to develop LabVIEW and TestStand applications better and faster. Learn how TI built a continuous delivery machine to accelerate overall software release cycles and deliver products in record time. Examine the concepts and tools used to deliver weekly software updates to a state-of-the-art framework developed in LabVIEW and TestStand. This resulted in a highly scalable sophisticated automated test platform that provides a uniform and robust method of semiconductor characterization to TI's validation community.

Forward5 Auxis VMwareAuxis Consulting & Outsourcing

The document summarizes key highlights from an intelligent automation center of excellence, including over 150 bots deployed, 420+ processes automated, and over 500k hours of manual effort saved. It then discusses how constant application changes were causing maintenance issues for 60% of automations. The center implemented a test suite and continuous integration/continuous delivery pipeline partnering with Auxis to improve automation quality and speed, reduce errors by 15%, and increase production deployment speed by 96%. It provides an overview of the high-level CI/CD pipeline design and concludes by discussing what's next, including expanding the use of artificial intelligence and machine learning in automations.

Continuous Performance Testing: The New StandardTechWell

In the past several years the software development lifecycle has changed significantly with high-speed software releases, shared application services, and platform virtualization. The traditional performance assurance approach of pre-release testing does not address these innovations. To maintain confidence in acceptable performance in production, pre-release testing must be augmented with in-production performance monitoring. Obbie Pet describes three types of monitors—performance, resource, and VM platform—and three critical metrics fundamental to isolating performance problems—response time, transaction rate, and error rate. Obbie reviews techniques to acquire and interpret these metrics, and describes how to develop a continuous performance monitoring process. In conjunction with pre-release testing, this monitoring can be woven into a single integrated process, offering a best bet in assuring performance in today’s development world. Take away this integrated process for consideration in your own shop.

Continuous Performance TestingGrid Dynamics

Performance issues are regularly caught too late leading to increased cost for fixing. We propose a process on how to make performance testing lightweight, execute it on early stages, reduce time and cost of fixes. Applying the same principal that we use for functional testing, performance testing could be integrated in CI/CD pipeline. Learn more about CPT in our blog: https://blog.griddynamics.com/what-is-continuous-performance-testing-and-why-it-is-needed

Gowtham_resumeGowtham Venkateshan

This document contains a summary of Gowtham's experience as a software tester. He has over 6 years of experience in manual testing and is certified in software testing. He has worked on various projects testing web services, order management systems, and supply chain management applications. His skills include testing methodologies, techniques, tools like SOAP UI, Parasoft, and HP Quality Center. He is proficient in SQL and has experience automating test cases. He is looking for a new opportunity as a software tester.

Cars.com – revolutionizing continuous integration with selenium rdRichard Darcy

Introducing Colama: virtual lab infrastructure for EnterpriseCoriolis Technologies

Ahesanali Vijapura - QA Managerahesanvijapura

This document contains the professional summary and experience of Ahesanali A Vijapura. It outlines their 10+ years of experience in software testing and quality assurance using manual testing techniques. They have experience managing testing efforts, developing test strategies, and providing reporting on testing activities. They have worked on various projects testing software in domains like high availability, disaster recovery, e-commerce, and performance testing. They have experience with tools like Jira, TFS, Mantis, and TestRail for defect management and test case management.

QA Fest 2017. Владимир Примаков. QA метрики. Взгляд на качество с разных стор...QAFest

Что такое качество продукта и процесса разработки. Как его измерять. Какие метрики гарантируют качество продукта, а какие важны для принятии решения о готовности продукта к релизу. Тренды качества, их польза в понимании улучшения качества продукты и процесса разработки. Абсолютные и относительные метрики. Инструменты.

All levels of performance testing and monitoring in web-appsAndrii Skrypnychenko

This presentation discusses test automation and performance monitoring in web applications. It provides an overview of the W3C Timing API that can be used to collect browser performance metrics in Selenium tests. It also discusses how various monitoring tools from UBS like ELK and AppDynamics can be used to monitor performance at different levels, including the database, services, and client-side. Gatling is presented as a tool for load testing backend services. It emphasizes how monitoring and load testing tools can be integrated to continuously test performance and build historical trends.

Test Automation NYC 2014Kishore Bhatia

This document discusses challenges with automated testing and test data management. It introduces service virtualization as a solution to address problems related to lack of environments, slow integration cycles, and unintended consequences of changes. The document also summarizes CA LISA's test automation and data management capabilities like functional testing, mobile testing, continuous validation, and test data warehousing to help improve testing practices.

How CapitalOne Transformed DevTest or Continuous Delivery - AppSphere16AppDynamics

Making the leap to continuous delivery is precarious for any organization, but the concerns are greatly exacerbated when your organization services approximately 45 million bank accounts. Committed to maintaining flawless user experiences while accelerating release cadence, Capital One faced a daunting challenge as it transformed culture, processes, and technical infrastructure in its evolution to continuous delivery. Join this session with Capital One's Michael Bonamassa and Parasoft's Wayne Airole and learn from their insights on what DevTest changes are critical for responding to extreme digital disruption. Key takeaways: o The changing responsibilities of DevTest in a "continuous everything" world o What skill sets software testers need to ride the wave of digital transformation o How service virtualization and continuous testing measure the risk of a release candidate o How to evolve the culture and process to support continuous delivery o What technical infrastructure is required for real-time test automation and continuous delivery maturation For more information, go to: www.appdynamics.com

This is How We Accelerate with Quality Engineering - Codacy WebinarAntoine Craske

Accelerate is becoming a standard to drive DevOps implementation on the four key metrics. We used the model to improve our pipelines over various increments, aligned with the DevOps principles. We act on various domains from methodology, organization, architecture to remove limiting factors along our software pipeline. Multiple teams are now delivering multiple times per day with stability, a game-changer compared to our previous performance across teams. This talk shares the journey we have been taking, lessons learned and takeaways to apply in your context.

Performance Metrics for your Build Pipeline - presented at Vienna WebPerf Oct...Andreas Grabner

[Rakuten TechConf2014] [Fukuoka] Technologies that underlie service deliveryRakuten Group, Inc.

Continuous performance testingSQALab

This document discusses continuous performance testing (CPT) and introduces the Jagger CPT solution. It provides an overview of why performance testing is important, outlines the principles and goals of CPT, and describes the key parts of the Jagger CPT platform including load generation, metrics collection, test data management, and environment management. It also provides an example customer success story where Jagger was used for continuous performance testing of a large ecommerce site.

Managing Continuous Delivery of Mobile Apps - for the EnterpriseSauce Labs

DevOps in Salesforce AppCloudrsg00usa

This document discusses DevOps practices at Salesforce, including: - Using continuous delivery pipelines to plan, build, test, release, deploy and monitor code changes. - Organizing teams using a Scrum model with sprints every two weeks and an average size of 7 engineers per team. - Maintaining sandbox environments like development, test, UAT and production for each project. - Following a branching strategy in version control and using continuous integration to test and deploy code changes.

Neev QA OfferingNeev Technologies

The Pursuit of Perfection - Methods, techniques, and tools to achieve robust ...QA Systems

2016 NIWeek - TI’s Continuous Delivery Machine for Accelerated Application De...Ching-Hwa Yu

Forward5 Auxis VMwareAuxis Consulting & Outsourcing

Continuous Performance Testing: The New StandardTechWell

Continuous Performance TestingGrid Dynamics

Gowtham_resumeGowtham Venkateshan

Cars.com – revolutionizing continuous integration with selenium rdRichard Darcy

Introducing Colama: virtual lab infrastructure for EnterpriseCoriolis Technologies

Ahesanali Vijapura - QA Managerahesanvijapura

QA Fest 2017. Владимир Примаков. QA метрики. Взгляд на качество с разных стор...QAFest

All levels of performance testing and monitoring in web-appsAndrii Skrypnychenko

Test Automation NYC 2014Kishore Bhatia

How CapitalOne Transformed DevTest or Continuous Delivery - AppSphere16AppDynamics

This is How We Accelerate with Quality Engineering - Codacy WebinarAntoine Craske

Performance Metrics for your Build Pipeline - presented at Vienna WebPerf Oct...Andreas Grabner

[Rakuten TechConf2014] [Fukuoka] Technologies that underlie service deliveryRakuten Group, Inc.

Continuous performance testingSQALab

Managing Continuous Delivery of Mobile Apps - for the EnterpriseSauce Labs

DevOps in Salesforce AppCloudrsg00usa

More from QAFest (20)

QA Fest 2019. Сергій Короленко. Топ веб вразливостей за 40 хвилинQAFest

QA Fest 2019. Анна Чернышова. Self-healing test automation 2.0. The FutureQAFest

Мы уже разговаривали о self-healing автоматизации, как она работает, какие есть подходы, чем они хороши, плохи и о новом инструменте, который мы разрабатываем в EPAM. Наш продукт завершает стадию POC и настало время поделиться результатами и понять, насколько self-healing автоматизация поможет вашим тестам стать стабильнее? Или наоборот, навредит?... Приходи и узнаешь!

QA Fest 2019. Doug Sillars. It's just too Slow: Testing Mobile application pe...QAFest

Mobile apps and websites are now the predominant ways that users interact with brands. Research has shown that slow sites and apps lose customer engagement. Despite this, most mobile sites and apps have performance issues that can be easily resolved once diagnosed. In this talk, we will walk through steps to diagnose network performance bottlenecks in mobile services. We'll discuss real-world examples and how they were resolved. Attendees will leave this talk armed with the tools to test, diagnose and resolve the top network performance issues that affect mobile today.

QA Fest 2019. Катерина Спринсян. Параллельное покрытие автотестами и другие и...QAFest

Раньше мы в Badoo фокусировались в основным на ручном тестировании. Получался этакий дедлок мануальной регрессии: не было времени, чтоб писать тесты, потому что много тестировали руками, а много тестировали руками, потому что не было автотестов. Но мы смогли наладить свою систему автоматизации и процессы, разорвали этот порочный круг и начали писать годные тесты. В своем докладе я расскажу, как нам удалось сократить ручную регрессию с 90% до 30% рабочего времени, при этом сохранить достойный уровень качества и профессионально вырасти!

QA Fest 2019. Никита Галкин. Как зарабатывать большеQAFest

Вам знаком термин mindshift? Именно его вы испытаете от этого доклада. Он будет не о QA процессах или инструментах, он будет о деньгах и бизнесе, о рисках и коммуникациях. Все это с примерами из Украинского и мировом IT в формате живого общения с аудиторией.

QA Fest 2019. Сергей Пирогов. Why everything is spoiledQAFest

QA Fest 2019. Сергей Новик. Между мотивацией и выгораниемQAFest

QA Fest 2019. Владимир Никонов. Код Шредингера или зачем и как мы тестируем н...QAFest

Для разработки современных программных решений необходимо обеспечить эффективную систему тестирования, которая состоит из большого количества компонентов и задает требования ко всем этапам разработки. Владимир Никонов, руководитель департамента разработки платформы в Terrasoft, эксперт в области проектирования приложений с опытом работы более 10 лет, поделится экспертным мнением с участниками QA Fest и расскажет: - об инструментах и процессах на каждом этапе создания и поставки функциональности: от unit-тестов до нефункционального тестирования; - о требования к инструментам тестирования и компетенциям команды QA-инженеров, которые необходимо выдвигать на каждом этапе тестирования; - как внедрять современные подходы в существующий проект с минимальными затратами; - как развивать команду и процессы тестирования в целом.

QA Fest 2019. Владимир Трандафилов. GUI automation of WEB application with SV...QAFest

Доклад посвящен автоматизации тестирования WEB-приложений с SVG-графикой. В 1-ой части доклада даны короткое описание процессов разрабатываемого приложения и обоснование необходимости применения SVG-графики. Во 2-ой части сделан короткий обзор SVG-графики, показаны основные преимущества/недостатки такого типа графики, сделан обзор основных SVG-поверхностей и рассмотрен процесс их трансформации с помощью матрицы преобразования с разбором ее основных типов. В 3-ей части обозначены основные проблемы автоматизации действий с SVG-графикой, такие как drag’n’drop графических объектов (SVG на SVG), их масштабирование при помощи колесика мышки и выделение ломаный линий. В 4-ой части показаны решения обозначенных проблем с использованием JavaScript.

QA Fest 2019. Иван Крутов. Bulletproof Selenium ClusterQAFest

Browser tests are known to be the flakiest ones. This is partly because browser infrastructure is complicated to maintain. But the second reason is – mainstream browser automation tools such as Selenium server are far from being efficient. A year ago I have shown Selenoid - a truly efficient replacement of the standard Selenium server. This year I would like to demonstrate how to organize a fault-tolerant and easily scalable Selenium cluster using virtual machines in the cloud. I will start by setting up several Selenoid nodes and configure them to send logs and recorded videos to S3-compatible storage. Then I will run multiple Ggr load balancer instances allowing to use all running Selenoid nodes and organize a single entry point to the cluster. Finally, we'll discuss how to work with VNC and video recording in such a cluster.

QA Fest 2019. Николай Мижигурский. Миссия /*не*/выполнима: гуманитарий собесе...QAFest

Случалось ли вам запускать автоматизацию на проекте? Испытывать непревзойденное удовольствие от необходимости собеседовать технического специалиста, когда сам не имеешь технического опыта? Если да, то этот доклад для вас. Мы научимся анализировать сеньорность кандитата, его технический уровень и способность к организации команд. Но самое главное - все это мы сможем достичь без серьезного технического опыта. Будет интересно, заходи на огонек!

QA Fest 2019. Володимир Стиран. Чим раніше – тим вигідніше, але ніколи не піз...QAFest

Це буде огляд підходів до побудови програми безпеки програмного забезпечення в команді розробки або кампанії загалом, доповнений висновками з мого власного досвіду виконання практичних та консультаційних проектів в сфері Application Security.

QA Fest 2019. Дмитрий Прокопук. Mocks and network tricks in UI automationQAFest

Веб-приложения и технологии стремительно развиваются. Мы уже вступили в эру Single Page Application и идем к Progressive Web Application. В большинстве современных проектов идет разделение команд на front-end и back-end, и не только команд, но идет раздельная релизная политика. Это требует более детальных подходов к тестированию front-end. В этом докладе мы рассмотрим кейсы, который есть на практике при тестировании задач front-end и инструменты автоматизации, которые могут решать задачи описанные в этих кейсах: чтение request/response browser network и соответственно мокирование response.

QA Fest 2019. Екатерина Дядечко. Тестирование медицинского софта — вызовы и в...QAFest

Проектирование и производство медицинских устройств — это регулируемый бизнес. Государственные органы во всем мире призваны гарантировать безопасность и эффективность медицинских устройств. Несоответствие нормативным требованиям ставит под угрозу жизнь и здоровье человека. Как медицинское регулирование влияет на рабочий процесс компании производителя? Мы поговорим о том, какие вызовы стоят перед тестировщиком медицинского софта, а также какие возможности при этом открываются.

QA Fest 2019. Катерина Черникова. Tune your P’s: the pop-art of keeping testa...QAFest

This document discusses testability and provides advice on several topics related to keeping testability under control, including problem, product, people, proactivity, productivity, pipeline, project, process, and philosophy. For each topic, common issues are identified and recommendations are provided, with an emphasis on taking a whole team approach and focusing on customers, risks, automation, decision making, and continuous improvement.

QA Fest 2019. Алиса Бойко. Какнезапутаться в коммуникативных сетях ITQAFest

Твою гениальность не замечает никто кроме мамы? Идеи и проекты нравятся только твоему коту? Одногруппники уже руководители подразделений, а ты завис между middle и senior? Пришло время найти баги не только на проекте, но и в своей голове! Прокачаем коммуникативные навыки:)

QA Fest 2019. Святослав Логин. Как найти уязвимости в мобильном приложенииQAFest

С каждым годом мобильных приложений становится все больше, но мало кто обращает внимание на безопасность этого приложения, когда оно находится в процессе разработки. Так как бизнес нацелен только на то, чтобы оторвать большую часть пользователей, которые будут использовать это приложение, они обращают внимание на конфиденциальность своих клиентов в последнюю очередь. В своем докладе я расскажу как мануал QA может проверить мобильное приложение на уязвимости и найти топовые дыры по рейтингу OWASP. В презентации будут использованы такие тулзы Santoku Linux + Genymotion.

QA Fest 2019. Катерина Шепелєва та Інна Оснач. Що українцям потрібно знати пр...QAFest

Маючи досвід роботи з іноземними замовниками і колегами, а також вивчаючи культурні особливості жителів інших країн, ми якось поставили собі за мету з'ясувати, якими українців бачать іноземці, чи потрібно їм підлаштовуватись під нашу манеру спілкування, чи є щось, що вони зовсім не можуть прийняти. Поділимося з вами результатами цієї затії, а також поговоримо про: - те, що потрібно знати українцям про свої софт скіли, - то, як відрізняються софт скіли українців і жителів кількох інших країн, - важливість софт скілів для успішних комунікацій з іноземними колегами, - важливість софт скілів для просування по кар'єрі.

QA Fest 2019. Антон Серпутько. Нагрузочное тестирование распределенных асинхр...QAFest

Обычно в процессе нагрузочного тестирование необходимые app-side метрики(response time, throughput, ..) можно получить прямо в генераторе нагрузки. Мы шлем запрос, получаем респонс и зачастую время выполнения запроса это и есть то что нам нужно. Но что если после того как сервер отдал вам ответ происходит еще ряд асинхронных операций, время выполнения которых нам необходимо проверить? Как замерить время выполнения этих запросов? Какая часть системы является узким местом в производительности? В докладе рассмотрим какие челенжи появляются в такой ситуации и как их можно решить.

QA Fest 2019. Петр Тарасенко. QA Hackathon - The Cookbook 22QAFest

Хотели бы вы, чтобы в Украине происходило больше QA ивентов? Чувствуете, что их не хватает? Знаете, кто может это изменить? - Вы! Я поделюсь подходами, которые мы использовали при организации QA хакатонов в Wix, которыми завтра вы сможете воспользоваться для создания вашего крутого ивента!