Continuous Delivery Pipelines: Metrics, Myths, and Milestones
0 likes557 views
Join Gary Gruver as he discusses metrics and trending data needed to drive efficient release management at enterprise scale. Also, find out what over 40% of enterprise customers site as a key barrier to achieving DevOps efficiencies.
Ad
More Related Content
What's hot (20)
Similar to Continuous Delivery Pipelines: Metrics, Myths, and Milestones (20)
Ad
More from DevOps.com (20)
Ad
Recently uploaded (20)
Continuous Delivery Pipelines: Metrics, Myths, and Milestones
- 1. Managing CD pipelines within a tightly coupled architecture …metrics, myths, and milestones Gary Gruver Lenore Adam, Plutora
- 2. Agenda • Gary Gruver: Starting and Scaling DevOps in the Enterprise • About Plutora • Continuous Delivery and release management at enterprise scale • Plutora in practice: Managing CD pipelines in the enterprise • Milestones • Metrics • Myths • Q&A
- 3. Gary Gruver A Practical Approach to Large-Scale Agile Development Starting and Scaling DevOps And Leading the Transformation: Applying Agile and DevOps Principles
- 4. Starting and Scaling DevOps in the Enterprise Gary Gruver
- 5.
- 8. Gene Kim Quote This is my personal definition: I would define DevOps by the outcomes. In my mind, DevOps is those set of cultural norms and technology practices that enable the fast flow of planned work from, among others, development, through tests into operations while preserving world class reliability, operation and security. DevOps is not about what you do, but what your outcomes are. So many things that we associate with DevOps fits underneath this very broad umbrella of beliefs and practices—which of course, communication and culture are part of them. © Gruver Consulting
- 13. © Gruver Consulting Monitoring How Long Frequency Issue Source Enviro nment Testin g Develo per Busine ss Ideas Produ ction Planning Capacity Requirements Inventory % Reworking % Expected Results Deploy Time & Effort Source & Number of New Issues New Issues Cycle Time Batch Size Repeatability Branch Time Approval Times
- 14. © Gruver Consulting Scaling to CI Environment Testing Developers Business Ideas Production
- 16. © Gruver Consulting Segmenting Business Critical Non Business Critical
- 17. © Gruver Consulting Segmenting Tightly Coupled Loosely Coupled Non Business Critical
- 18. © Gruver Consulting Loosely Coupled Environment Testing Business Ideas ProductionDeveloper
- 19. © Gruver Consulting Tightly Coupled Architecture A B C E F G H I J D K L M Service Virtualization Service Virtualization
- 20. © Gruver Consulting Segment with SV A B C D E F G H I J K L M Subsyst em I Subsyst em II Subsyst em III Service Virtualization Service Virtualization
- 21. © Gruver Consulting Subsystem I Deployment Pipeline D C B AA B C D Phase 2 & 3 A B C D
- 22. Subsystem I Subsystem II Subsystem III Stage 3 Stage 4BAT Stage 6 Stage 5 Regression Production Full System Deployment Pipeline
- 23. Subsystem I Subsystem II Subsystem III Stage 3 Stage 6 Stage 4BAT Stage 5 Regression Production Full System Deployment Pipeline
- 24. © Gruver Consulting Subsystem I Subsystem II Subsystem III Stage 3 Stage 6 Stage 4BAT Stage 5 Regression Production 4 Hours 16 Hours 3 Hours 2 Weeks 18 Hours 1 Week 3 Days 1 Day to deploy 2 Days to test 3 Days Cycle Time and Batch Size Map
- 25. © Gruver Consulting Source of Issue Slide Subsystem II Stage 5 Regression Subsystem III Stage 3 Stage 6 Stage 4BAT Production Subsystem I Code Environment Test Deploy
- 26. © Gruver Consulting Source of Code Defects Subsystem I Subsystem II Subsystem III Stage 3 60% 30% 10% Stage 4BAT
- 29. Agenda • Gary Gruver: Starting and Scaling DevOps in the Enterprise • About Plutora • Continuous Delivery and release management at enterprise scale • Plutora in practice: Managing CD pipelines in the enterprise • Milestones • Metrics • Myths • Q&A
- 30. The Plutora Story in 25 words or less (…myth)
- 31. PAGE 31 Complex software runs our daily lives… • everything that delivers growth to the business incorporates some IT element • there is enormous pressure for IT to deliver business value faster than ever before The Plutora story: Founded by IT execs Launched in 2012
- 32. PAGE 32 What Happens When You Get it Wrong? “Delta's US Grounding Lifted After Latest Computer Glitch” 29 January 2017 - Bloomberg “KfW mistakenly transferred more than 5 billion euros ($5.4 billion) to four banks because of a technical glitch.” 24 March 2017 - Bloomberg “Market Data Glitch Shows Tech Companies' Stock Prices Crashing” “Woolworths online ordering crashes” “Melbourne Metro train network goes into meltdown after computer failure” 7 July 2017 - Bloomberg 10 July 2017 – IT News 13 July 2017 – The Age
- 33. PAGE 33 Enterprise Software Delivery Ecosystem Engineering Tools PLANNING DELIVERY BUSINESS MANAGERS DEVELOPERS PPM ITSM - Change Management Manual Tools
- 34. PAGE 34 Engineering Tools PLANNING DELIVERY The IT Business Operating System BUSINESS MANAGERS DEVELOPERS PPM ITSM - Change Management Plutora Environments Plutora Deploy Plutora Release Plutora Test Insights, Dashboards, Reporting, Notification & Alerts Enterprise Software Delivery Ecosystem
- 35. IT Business Operating System I N S I GH T S , A N A LY T I C S A N D R EP O RT I N G VISIBILITY COLLABORATION EFFICIENCY PREDICTABILITY Single source of truth for enterprise software innovation and execution Integration Layer BUSINESS MANAGERS INSIGHTS AND DECISIONS INSIGHTS AND DECISIONS DEVELOPERS AND OPERATIONS PLUTORA RELEASE PLUTORA ENVIRONMENTS PLUTORA TEST PLUTORA DEPLOY
- 36. The Plutora Mission: Enable predictable, high quality enterprise software delivery across the release portfolio. Proven delivery, responsiveness & customer success: Read these awesome case studies: http://www.plutora.com/resources_category /casestudies
- 37. Plutora in practice: Managing CD pipelines in a tightly coupled architecture …metrics, myths, and milestones
- 38. “The biggest inefficiencies in most large organizations exists in the large, complex, tightly coupled systems that require coordination across large numbers of people from the business all the way out to Operations.” “For these orgs, it is much more important to push the majority of testing and defect fixing into smaller, less complex test environments with quality gates to keep defects out of the bigger more complex environments. This helps to reduce the cost and complexity of the testing and also helps with the triage process because the issues are localized to the subsystem or application that created them.” Gary Gruver: Starting and Scaling DevOps
- 39. PAGE 39 Defined phases, gated code • Define phases & activities to create a well-defined release plan • Establish gating criteria to keep issues from progressing along the pipeline • Reduce triage complexity
- 40. “For large tightly coupled systems, developers often don’t understand the complexities of the production environments. Additionally, the people that understand the production environments don’t understand well the impact of the changes that developers are making. There are also frequently different end points in different test environments at each stage of the deployment pipeline. No one person understands what needs to happen all the way down the deployment pipeline. Therefore, managing environments for complex systems requires close collaboration from every group between dev and ops.” Gary Gruver: Starting and Scaling DevOps
- 41. PAGE 41 Monitor code quality as builds progress along the pipeline • Actionable reporting and analytics • Associate metrics with version controlled test environments
- 42. Work left in the system
- 43. “Any improvement before or after the bottleneck is a waste of time” Eliyahu Goldratt: The Goal
- 44. PAGE 44 Improve the partnership between dev and test • Reduce wait states by expediting the handoff from dev to test… o …receive alerts when new builds are ready for testing o …kick off a Jenkins job for on-demand deployment to test environments • Link change IDs to new builds to ensure accurate test coverage
- 45. Q&A
- 46. Offices Santa Clara, California Sydney, Australia London, United Kingdom Founded in 2011 Awards Top 20 Testing Tools Gartner Cool Vendor Red Herring Top 100 Winner www.plutora.com