Test Management in Agile - Agile testing Days 2018
Download as PPTX, PDF5 likes2,278 views
Yesterday Jan Jaap Cannegieter and I gave an amazing tutorial at the Agile testing days. In our full day tutorial we discussed the role of the test manager and how to add value in an agile environment. We discovered that a test manager is operation at two interfaces. One is being that of a quality ambassador that shows the business and stakeholders how testing is done and how its progressing . On the other interface the test manager is enabling the team(s) to build quality into their deliverables. During this full day tutorial we deep dived on both aspects. We discussed the agile test strategy and investigated what activities we test managers undertake, what activities we find important and what is valued most by our stakeholder. You wouldn’t be surprised if we told you that there is a gap between both. Next we practiced with defining agile test plans at MVP and sprint level. And assessed other roles that test managers can adopt. We closed the full circle by concluding that extra activities might be added to our initial brainstorm results. The topic is truly alive. Not only did we have a full rum (we had an all-time conference record with the amount of attendees), during the day we had a lot of lively discussions and answered a lot of questions from the participants. We loved the participation of all in the room and believe we all had a good day.
Ad
More Related Content
What's hot (20)
Similar to Test Management in Agile - Agile testing Days 2018 (20)
Ad
More from Derk-Jan de Grood (20)
Ad
Recently uploaded (20)
Test Management in Agile - Agile testing Days 2018
- 1. TEST MANAGEMENT IN AGILE THERE IS STILL NEED FOR TEST MANAGEMENT IN AGILE BUT IT IS DONE DIFFERENTLY DOWNLOAD WORKSHOP MATERIAL FOR HTTP://BIT.LY/DJJ2018 (DON’T READ THE EXAMPLE YET, IT IS CASE MATERIAL) DOWNLOAD WORKSHOP SLIDES FROM: HTTPS://DJDEGROOD.WORDPRESS.COM/ 9.00
- 2. IMPRESSION OF THE DAY
- 3. WELCOME Derk-Jan de Grood Jan Jaap Cannegieter Consultant – speaker – Writer Testing – requirements – Agile Consultant – Thoughtleader– Writer Testing – Agile Coach
- 4. ROADMAP
- 8. AGILE TEST STRATEGY 8 Contribute to a quality solution Ensuring that the right tests are done (at the right time, by the right team) Assuring that the testing is of sufficient quality (coaching and auditing) Provide intelligence on progress and quality
- 9. WHAT KEEPS US BUSY AT WORK 9 Assignment 1
- 10. ACTIVITIES AND PRODUCTS 10 Assignment 1 Brainstorm what activities and products you undertake and produce. Write each item on a post-it Put It on the canvas and decide where it fits best! Group the items, if you see the same or a similar item
- 11. YOUR ACTIVITIES CONTRIBUTE TO… 11 Contribute to a quality solution Ensuring that the right tests are done Assuring that testing is of sufficient quality Intelligence on progress and quality Assignment 1
- 12. WHAT ACTIVITIES DO WE RATE THE MOST IMPORTANT? 12 Assignment 2
- 13. VALUE IS IN THE EYE OF THE BEHOLDER
- 14. 14 WORKSHOP RESULTS (12 NOV 2018) ORANGE DOTS: WHAT WE TESTMANAGERS FIND IMPORTANT, BLACK DOTS: WHAT WE THINK OUR STAKEHOLDERS FIND MOST IMPORTANT
- 15. ROADMAP
- 16. TEST PLANNING AND DOCUMENTATION IN AGILE A PRACTICAL APPROACH
- 17. When working software is the true measure for progress we don’t need test plans and progress reports
- 18. WHERE CAN WE DO TEST PLANNING AND – DOCUMENTATION IN SCRUM? 18 Product vision __________ __________ __________ __________ __________ __________ __________ __________ __________ __________ ________ Product backlog Sprint 2-4 weeks 24 hours __________ __________ _______ Sprint backlog Shipable product Refinement and sprint planning Daily scrum Sprint review: • Demo • DOD Retrospective Here Here For all sprints • Non-functionals • Test levels • Documentation • Automation For one sprint • Non-functionals for that sprint • Relevant features / risks • People • Environment • Tools • Documentation
- 19. GLOBAL TEST PLAN IN SCRUM AN APPROACH THAT WORKED IN MY CONTEXT 11.25
- 20. GLOBAL TEST STRATEGY AND TEST PLANNING IN SCRUM 20 Product vision __________ __________ __________ __________ __________ __________ __________ __________ __________ __________ ________ Product backlog Sprint 2-4 weeks 24 hours __________ __________ _______ Sprint backlog Shipable product Refinement and sprint planning Daily scrum Sprint review: • Demo • DOD Retrospective Here
- 21. TEST STRATEGY AND PLANNING AT THE START Goals and main characteristics of the system are clear • Relevant non-functional requirements can be determined Agile organization and acceptance can be clear • Test levels can be determined Development and deployment approach known • Test Automation • Documentation 21
- 22. NON-FUNCTIONALS: ISO 9126 I KNOW THERE IS A NEWER VERSION (ISO 25010) BUT I LIKE THE OLD ONE MORE
- 23. ISO 9216 23
- 24. TEST LEVELS IN AGILE
- 25. TEST LEVELS IN AGILE 25 Unit test Done by the developer System test / functional test Done by the team Acceptance test Several options Non functional tests (security, end- to-end, performance Several options
- 26. ACCEPTANCE AND NON FUNCTIONAL TESTING OPTION 1 26 Sprint 1 Sprint 2 Sprint 3 ANFT ANFT ANFT (ANFT means Accaptance Testing and Non Functional Testing)
- 27. ACCEPTANCE AND NON FUNCTIONAL TESTING OPTION 2 27 ANFT Sprint 1 Sprint 2 Sprint 3 ANFT ANFT (ANFT means Accaptance Testing and Non Functional Testing)
- 28. ACCEPTANCE AND NON FUNCTIONAL TESTING OPTION 3 28 ANFT Sprint 1 Sprint 2 Sprint 3 ANFT ANFT (ANFT means Accaptance Testing and Non Functional Testing)
- 29. ACCEPTANCE AND NON FUNCTIONAL TESTING OPTION 4 29 Sprint 1 Sprint 2 Sprint 3 ANFT (ANFT means Accaptance Testing and Non Functional Testing)
- 30. OTHER ASPECTS RELEVANT FOR ALL SPRINTS
- 31. OTHER ASPECTS RELEVANT FOR ALL SPRINTS 31 Test automationto be used
- 32. CASE: GLOBAL TEST PLAN ONLINE TRAVEL AGENCY 11.45 Case 1
- 33. GLOBAL TEST STRATEGY AND PLAN • Make teams of three or four delegates • Read description case 1 • Take the empty print of the global test plan or download the template from http://bit.ly/DJJ2018 (Don’t read the example yet) • Fill in the template. You miss a lot of information, but use your imagination and make assumptions to fill in the gaps • You may also make a global test plan for your own project • 45 minutes 33 Case 1
- 34. DISCUSSION CASE ONE • Look at the example test plan • Do you have other non functionals? • Does anyone wants to organize the test levels in a different way? • Does anyone have other automated tools? • Does anybody have other documentation requirements? • Does anyone want to document other topics compared to the example? • Do you think this limited test strategy and test plan would add value in your organization / project? • How do we deal with new insights later in the project 34
- 36. SPRINT TEST PLAN IN SCRUM 36 Product vision __________ __________ __________ __________ __________ __________ __________ __________ __________ __________ ________ Product backlog Sprint 2-4 weeks 24 hours __________ __________ _______ Sprint backlog Shipable product Refinement and sprint planning Daily scrum Sprint review: • Demo • DOD Retrospective Her e
- 37. 37 What information should be on a one- page sprint test plan?
- 38. EXAMPLES Sources: https://www.ministryoftesting.com/dojo/lessons/the- one-page-test-plan and Agile testing by Lisa Crispin and Janet Gregory
- 39. WHAT I OFTEN USE 39
- 40. CASE: SPRINT PLAN PHP TRAVELS 14.30 Case 2 14.15
- 41. CASE 2 – SPRINT TEST PLAN • First we do time traveling, we are 12 months later: Demo www.phptravels.net Dubai hotel and tour • Read case 2 Description • Take the empty print of the sprint test plan or download the template from http://bit.ly/DJJ2018 (Don’t read the example yet) • Fill in the template. You miss a lot of information, for instance the priority. Use your imagination and make assumptions to fill in the gaps • You may also make a print test plan for your own project • 30 minutes 41
- 42. DISCUSS THE OUTCOME CASE 2 15.00
- 43. DISCUSSION CASE 2: SPRINT TEST PLAN • Look at the example sprint test plan • Do you agree on the scope? • Do you have other features, risks or non-functionals? • Do you have other people (roles) or environments • Do you think this sprint test plan would add value in your organization / project? 43
- 44. FEEDBACK LOOP GLOBAL TEST PLAN 1. Would you like to upscale the global test plan (add extra activities) 2. Would you like to downscale the global test plan (delete activities) 3. Would you like to organize the global test plan differently (same activities differently)
- 45. Any questions on test strategy and test plans in Agile? 45
- 46. TEST MANAGEMENT ROLES IN AGILE OR DEVOPS 16.05
- 47. TEST MANAGEMENT AND AGILE: WHAT OTHERS SAY ‘… it may feel like the need for a test manager disappears.’ Katrina Clokie - Test Manager in Agile http://katrinatester.blogspot.nl/2014/04/test-manager-in-agile.html ‘Test management is one of those hangovers from traditional waterfall development’ Goyko Adzic - Changing the role of test managers https://gojko.net/2009/10/13/changing-the-role-of-test-managers/ ‘If QA is part of the team, and the dev manager is responsible for the team, what's my job?’ Joel Bancroft-Conners - The Test Manager's Survival Guide to Going Agile https://www.stickyminds.com/article/test-managers-survival-guide-going-agile The skill set required in test leadership is different to test management’ Anne-Marie Charret - Test Leadership is here to stay http://mavericktester.com/archive/test-leadership-here-to-stay/ 47
- 48. OFFICIALLY THERE IS NO TEST MANAGEMENT ROLE IN AGILE/DEVOPS 48
- 49. TEST MANAGEMENT LIKE ROLES WE’VE SEEN Meeting compliance and regulations Coordinating between teams on the same product Responsible for acceptance Responsible for the end-to-end test Line manager of a test pool Responsible for test craftmanship development Test Automation Coach tbd 49
- 53. Contribute to a quality solution Ensuring that the right tests are done Assuring that testing is of sufficient quality Intelligence on progress and quality YOUR ACTIVITIES CONTRIBUTE TO… 53
- 54. TEST MANAGER FOR MEETING COMPLIANCE AND REGULATIONS • When applicable • In government organizations • Or organizations that have to meet different regulations (financials) • Organizations with less trust in the (test) team • Benefits • Certainty that regulations are met • No risk that license or whatsoever is withdraw • Knowledge of the regulations is centralized 54
- 55. TEST MANAGER FOR MEETING COMPLIANCE AND REGULATIONS • Activities • Determine which regulations are relevant • Stay up to date with changes in regulations • Stay in contact with teams to be informed about changes in systems • Make impact analysis when changes are designed/build • Make and maintain your own test set • Execute your own test • Make reports for management and/or regulation body 55
- 56. TEST MANAGER WHO COORDINATES BETWEEN TEAMS • When applicable • Big organizations with complex architectures • Different teams working on one application • When there are no management/coordination skills in the teams • Benefits • Teams work ‘in sink’ with each other • Less ‘double work’ (both in testing as well as development) • Less rework 56
- 57. TEST MANAGER WHO COORDINATES BETWEEN TEAMS • Activities • Stay up to date with changes from different teams • Determine impact of plans on business architecture, application architecture, data architecture and technical architecture • Negotiate which team will do which testing 57
- 58. TEST MANAGER RESPONSIBLE FOR ACCEPTANCE • When applicable • Big, complex systems • Different departments or organizations use the same system • Low confidence in the team/supplier • Benefits • Clear acceptance criteria • Different organizations don’t have to do the acceptance themselves. • One voice to the supplier 58
- 59. TEST MANAGER RESPONSIBLE FOR ACCEPTANCE • Activities • Gather acceptance criteria • Negotiate in order to make a consistent set of acceptance criteria • Determine what the supplier is testing • Determine what the clients are testing • Make sure all test activities cover all acceptance criteria • Sometimes organize acceptance testing 59
- 60. TEST MANAGER WHO IS RESPONSIBLE FOR THE INTEGRATION TEST • When applicable • Application is part of a chain of applications • Not all applications are managed by the team • Complex end-to-end test • Benefits • Overview over the chain • Less blind spots • Less end-to-end problems in production 60
- 61. TEST MANAGER WHO IS RESPONSIBLE FOR THE END-TO-END TEST • Activities • Get a (very) good insight in the business architecture, application architecture and data architecture • Stay up to date with the progress of the different systems/projects • Make an end-to-end test plan • Manage / coordinate preparation and execution of the end-to-end test • Manage issues • Report the outcome 61
- 62. TEST MANAGER AS A LINE MANAGER OF A TEST POOL • When applicable • In an organization with several (small) projects • In an organization with several testers • Matrix organization • Benefits • Resource management specific for testing • Testers don’t feel lonely in a team • Easy to incorporate development craftsmanship 62
- 63. TEST MANAGER AS A LINE MANAGER OF A TEST POOL • Activities • Hire and fire testers • Evaluate the professionally of individual testers • Develop craftsmanship • Internal contracting / lend out testers • Stay in contact with projects • Stay in contact with suppliers 63
- 64. TEST MANAGER RESPONSIBLE FOR TEST CRAFTMANSHIP • When applicable • Several testers in different teams • Craftsmanship important in the organization • An organization that takes development of knowledge and skills of own employees serious • Benefits • Testers can develop themselves • Up to date knowledge and skills of employees • Less testers leave the company 64
- 65. TEST MANAGER RESPONSIBLE FOR TEST CRAFTMANSHIP • Activities • Stay up to date with developments in testing • Stay up to date with the knowledge and skills needed for the testers in the organization • Stay up to date with the knowledge and skills of individual testers • Make personal development plans with every tester • Monitor the execution of the plan • Organize courses and intervision sessions 65
- 66. TEST AUTOMATION COACH • When applicable • When test automation is new • When test automation is complex • When it is difficult the get test automation engineers with the right knowledge • Benefits • More (good) TA engineers • Better TA • Better coordinated TA solutions 66
- 67. TEST AUTOMATION COACH • Activities • Investigate the need for test automation • Develop (together with other stakeholders) the right TA solution • Develop the test automation framework • Organize courses for TA engineers • Coach TA engineers • Monitor the work of TA engineers 67
- 68. EVEN IN AGILE, THERE ARE TEST MANAGEMENT ACTIVITIES TO BE DONE BUT THESE ACTIVITY ARE DONE DIFFERENTLY 68
- 69. WRAP UP AND EVALUATION 16.35
- 71. GOOD LUCK! (AND DON’T FORGET TO HAVE FUN) OR
Editor's Notes
- #8: Note: ad hoc testing vs strategy
- #50: Test manager for meeting compliance and regulations Test manager who coordinates between teams that work on the same project Test manager responsible for acceptance Test manager who is responsible for the end-to-end test Test manager as a line manager of a test pool Test manager responsible for the development of test craftmanship in the organization Test Automation Coach