To Scale Test Automation for DevOps, Avoid These Anti-Patterns
0 likes•214 views
The document discusses key anti-patterns to avoid in scaling test automation within DevOps, highlighting common challenges and pitfalls such as inadequate testing prioritization and improper test data management. It emphasizes the need for diverse testing techniques tailored to cloud-native architectures and the importance of continuous assessment of automation strategies. Additionally, it outlines strategies for application migration and modernization, advocating for a structured approach to enhance DevOps workflows.
To Scale Test Automation for DevOps, Avoid These Anti-Patterns
- 1. © Tricentis. All rights reserved. To scale test automation for DevOps, avoid these anti-patterns Matthias Rapp, VP Strategic Partnerships – Cloud, Tricentis James Bland, Ph.D., Partner Solutions Architect – DevOps, AWS
- 2. Today’s Presenters James Bland, Ph.D. Partner Solutions Architect - DevOps AWS Matthias Rapp VP Strategic Partnerships – Cloud Tricentis
- 3. DevOps in the cloud 3
- 4. What is the modern definition of DevOps? 4
- 5. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark. Fully automated: this part should be CAREFUL Source Build alpha beta gamma Automated tests Automated integration tests Automated load/perf tests Automated integration tests Automated synthetic tests API smoke tests Automated browser tests App code Infrastructure as code Configuration OS patching … Pre-production Production Synthetic Monitoring Synthetic Monitoring Synthetic Monitoring
- 6. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark. developers services monitorreleasetestbuild delivery pipelines monitorreleasetestbuild monitorreleasetestbuild monitorreleasetestbuild monitorreleasetestbuild monitorreleasetestbuild Deployment: Microservice development lifecycle
- 7. Testing in DevOps: Common challenges 7
- 8. The #1 barrier to DevOps transformation 8 What impedes the delivery of innovative software? Source: Gitlab, Global Developer Report, 2019
- 9. Common Pitfalls 9 a. Testing gets squeezed b. Test Data gets too little thought c. Selecting the right technique d. Testing cloud-native architecture e. Automation hits a glass ceiling
- 10. Testing gets squeezed 10 Agile teams need to make testing a priority in order to optimize their pipeline. A strong handle on testing allows for fast feedback loops, quick safe releases and ultimately more throughput.
- 11. Test Data gets too little thought 11 Production Data is good for many things, but it can also be a real hindrance for testing. Create or alter data and systems to allow for more efficient testing. Powerful ways to shape data the way your test requires maximizes your automation potential and increases your coverage for edge cases.
- 12. Selecting the right technique 12 The right blend of testing techniques is key. While automation is very important, exploratory testing and different automation ideas (unit-, regression-, integration, acceptance) via different entry points (Code, API, UI) need to be carefully considered and applied.
- 13. Testing cloud-native architecture 13 Cloud native demands a new kind of tests. Infrastructure properties like elasticity are essential to provide a service and therefore former non-functional tests like load tests become functional.
- 14. Automation hits a glass ceiling 14 Automation can get extensive in favor of minimizing manual pipeline holdups. Assessing automation inventory frequently and syncing it with application functionality is critical (e.g. BDD). Parallel/Multithreaded automation and environment management is a must to reduce duration.
- 15. Tooling to streamline testing for DevOps 15
- 16. 16 • Seamless agile testing by providing manual and automated test traceability to Jira issues, bugs, and releases in real-time. • Shift quality left with open source and commercial test automation management, test script scheduling, and support for BDD. • Power Agile and DevOps workflows through out-of-the-box integrations with the most popular development tools (e.g. Jenkins, Bamboo). Agile Test Management Tricentis qTest
- 17. Questions?
- 18. Contact Us 18 tricentis.com/contact-us/ Matthias Rapp [email protected] James Bland [email protected]
- 19. Thank You 19
- 20. © 2020, Amazon Web Services, Inc. or its Affiliates. Application migration strategies Discovery Use Migration Tools Replatforming (Lift & Reshape) Transition Production Retain / Not Moving Refactoring (Re-writing/Decoupling applications) Redesign Application / Infrastructure Architecture App Code Development Repurchasing (Replace - Drop & Shop) Purchase COTS/ SaaS & licensing Rehosting (Lift and Shift) Validation Modify underlying Infrastructure Full ALM / SDLC M anual Config DeployInstall Retire / Decommission Determine Migration Path Automate Manual Install & Setup Integration Determine new platform Docker / vMotion Relocate (Containers/VMware CloudonAWS) Determine configuration Assess / Prioritize
- 21. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS customers modernize applications one at a time Assess and prioritize, one app at a time Re-host (lift-and-shift) data center à EC2 Re-platform (lift-tinker-shift) VMs à containers Re-factor monolith à microservices Re-invent (cloud-native) new serverless microservices Determine modernization path