Dev ops for z
- 1. DevOps for IBM Z October 2018 Sanjay Chandru Program Director, Z DevOps [email protected]
- 2. IBM Z DEVOPS Disclaimer Disclaimer: IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion. Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.
- 3. DevOps in Digital Transformation 3 People, Process, Tools DevOps is not one of these things… It’s all of them! …across the entire lifecycle …for all technologies and platforms IBM Z / © 2018 IBM Corporation
- 4. Current z/OS Application Landscape IBM Z / © 2018 IBM Corporation Applications are very complex and tightly coupled Businesses need to react faster There is a strong need for tools that can help organizations be smarter and help make decisions based on a clear understanding of the application landscape +
- 5. Modern Development Environment IBM Z / © 2018 IBM Corporation 5 Application Discovery and Delivery Intelligence (ADDI) Discover And Understand Your z/OS Assets, carry out impact analysis Make changes and test effectively using operational feedback Application Delivery Foundation for Z Development Build Artifact Repository SCM Test Environments Prod Environment • Reduce development and testing efforts 10-30% • Increase code quality by 50% • Plan and manage automation activities in 50% the time
- 6. Application Discovery and Delivery Intelligence (ADDI) Quickly and safely unlock the value of existing assets for digital transformation § Rapidly analyze and visualize relationships between application components, data, and jobs to make changes safely and efficiently § Reduce risk by reusing current assets and understanding impacts of potential changes § Increase productivity by automating documentation, enabling new workers to be effective in a fraction of the time, and optimizing tests § Accelerate your digital transformation by rapidly identifying and ensuring integrity of APIs IBM Z / © 2018 IBM Corporation
- 7. 7 Business Rule Mining in ADDI 7 • Automatically discover key artifacts of candidate business rules (e.g. business terms, implementation names, snippets) from applications. • Leverage AD static analysis and structure information to reduce the time required to produce business rules by half. • Manage supporting information of Business Rules' artifacts (e.g. implementation names, business terms and snippets) using a consistent Web interface • Export information to be used by third party tools (e.g. ODM) AD REST API & Search with AI Build a catalog for Business terms and their usage Catalog business rules and extract as API/ODM Microservices AI driven discoveryof business terms
- 8. 8 What is Application Delivery Foundation for z Systems (ADFz)? Application Delivery Foundation for z Systems Developer for z Systems Enterprise Edition Application Performance Analyzer for z/OS Fault Analyzer for z/OS File Manager for z/OS Built on IBM Explorer for z/OS Aqua IDz EE Comprehensive IDE • Code/data development • Automated test generation • Web enablement • Code Analysis • SCM Integration • Debug FM Manage your enterprise data • Create, edit, copy, browse, extract • VSAM, QSAM, DB2, IMS, CICS, MQ APA Application performance tuning • Statement-level analysis of resource consumption FA Rapidly pinpoint causes of failure • Map abends to source • Track/manage failures
- 9. Why a modern Source Code Manager matters Capability RTC/ GIT* Host SCM Cross language / cross platform support Branching / Streams – parallel development “University grad friendly” – uses standard capabilities that new developers understand Continuous Testing Support for storing test cases along side of source code Continuous Innovation Common processes across teams Open integrations Host only configuration – can be complex configuration and upgrade Host only source management Limited traditional promotion paths *Any flavor of Git – using the Rocket Software client on z/OSIBM Z / © 2018 IBM Corporation Development Build Artifact Repository SCM Test Environments Prod Environment
- 10. IBM Dependency Based Build (DBB) IBM Z / © 2018 IBM Corporation 11 IBM Dependency Based Build (DBB) - Intelligent build environment for applications stored in Git Build frame work for z/OS applications stored in Git • Consists of a Liberty application server that hosts metadata (dependency data, build results) and a build toolkit (Java API, Groovy Installation). • Groovy driven build environment for compiling, linking and processing z/OS programs and applications Dependency identification and understanding • Automatically identify program dependencies and present the information to the developer/tester Build intelligently based on dependencies • Give the tester the option to selectively and automatically build impacted artifacts Integration with any CI tooling (Jenkins etc) Development Build Artifact Repository SCM Test Environments Prod Environment
- 11. 12 Rapid Development • Identify and make changes quickly and efficiently • Build and debug application changes directly in the development environment • Using GIT and Jenkins, rapidly request a build for individual, selected or impacted programs Cost Effective development environment • Essential tools for Z development provided in a clean accessible environment without unnecessary and expensive frills Efficient and Expandable • Access to deeper specialist tools and solutions available directly from the environment Flexibility • Developers can work from the web with minimal footprint or client requirements or from an eclipse interface Currency • Easy to ensure developers have access to the latest efficient intelligent tools Z Open Development
- 12. Dependency Based Build typical setup IBM Z / © 2018 IBM Corporation 13 (Slave) DBB WebApp DBB Toolkit PDSEzFS z/OS Explorer RSE Editors + Z Open Development/IDz EE Artifact Repository Source Code + Build Scripts x86z/OS Developer ZOD/IDz EE Git and GitClient Jenkins Code and Binaries External Artifact Repos
- 13. Shift Left Testing IBM Z / © 2018 IBM Corporation 14 • Ability to automate all levels of testing - Unit, Integration, Regression • An Agile Source Code Management system that supports true parallel development to enable parallel testing • Isolated On-demand Test Environments with planned Test Data Management to support parallel development and testing. • Ability to run sub-set of Batch cycles before End-to-End Integration testing • Ability to virtualize interfaces • Ability to integrate into a DevOps Pipeline Development Build Artifact Repository SCM Test Environments Prod Environment
- 14. Unit Testing IBM Z / © 2018 IBM Corporation 15 ü Automated Unit Testing based on the X-Unit framework ü Wizard driven Test case generation based on User input and expected output ü Generated Unit Tests are COBOL/PL1 programs that can be stored in the SCM and invoked with every build – Starting point of Testing Automation and building a CICD pipeline ü Test cases can be bundled into Test Suites ü zUnit Test Runner allows assertions and Automated Fail/Pass Checks ü Integrated Code Coverage capability ü Encourage Behavior Driven Development with the use of stubs and mocks IBM Developer for z Systems Developer Requirements Analysis Design Development Testing Deployment Production Project Initiation By testing Individual units/programs, it is possible to capture coding defects much earlier in the cycle before the functional and regression testing. What is zUnit? Development Build Artifact Repository SCM Test Environments Prod Environment
- 15. Functional/Regression Testing IBM Z / © 2018 IBM Corporation 16 Automate Regression Test Packs – Run regression tests after deployment to each environment Automate Functional Testing and virtualize interfaces that are not available IBM Rational Test Workbench Enable performance, integration and functional testing, including terminal based, throughout your project lifecycle With a scriptless, wizard-driven test authoring environment and support for more than 70 technologies and protocols IBM Rational Performance Test Server Save time and effort by reusing your functional integration tests for performance testing Combine your tests to model real-world scenarios and assess the impact of load on your integrated infrastructure. IBM Rational Test Virtualization Server Model real system behavior to eliminate test dependencies and simulate production, Accelerate testing and reduce the setup and infrastructure costs of traditional testing environments. Test Workbench Functional Testing Integration Testing Performance Testing Regression Testing Test Servers Load Agents Virtualization Agents Test Lab Infrastructure QA DEV Development Build Artifact Repository SCM Test Environments Prod Environment
- 16. Test Environments IBM Z / © 2018 IBM Corporation 17 Availability of Isolated environments is a key to Early Testing Developers to perform unit tests without interference from other teams Environment for Testers to run part of Batch schedules in isolation before full batch run without impacting other teams – e.g Gain the ability to change logical dates and run more than one batch cycles in a day Enables Continuous Integration and Agile Development methodologies for z/OS Faster and Easier Provisioning of Test Environments on demand or as part of a DevOps Pipeline Elimination of shared data issues Enable developer autonomy and self-service in creating environments Supports Cloud deployments – enables easy stand up and stand down of environments Affordable off host development and test environment Cloud Infrastructure IMS DB2 CICS WAS MQ z/OS COBOL, PL/I, C++, Java, EGL, Batch, Assembler, X86 Hardware running 64-bit Linux zD&T RTC RIT UCD IDz DT Development Build Artifact Repository SCM Test Environments Prod Environment
- 17. Automate the Delivery Pipeline IBM Z / © 2018 IBM Corporation 18 IBM Rational Team Concert (RTC) / IBM Dependency Based Build with § Reduce waste by enhancing collaboration across teams, technologies and platforms through unified status and change & configuration management § Improve speed and predictability by automating build across all platforms and technologies IBM UrbanCode Deploy (UCD) § Improve speed and predictability by automating deploy & configuration across all platforms and technologies § Reduce risks, number of rollbacks and meet audit and compliance mandates with automated process enforcement Deploy Cloud Distributed Mainframe System of Engagement System of Record Mobile Device Development Build Artifact Repository SCM Test Environments Prod Environment
- 18. 19 What’s New in DevOps – Recently Launched Capabilities 19 Q4 2017 Q1 2018 Q2 2018 BRM Tech Preview Web platform to map business artifacts to IT artifacts ZD&T Intelligent Provisioning ADDI install simplification ADDI Tech Preview: PL/I parser ZD&T cloud integration with Open Stack Full set of RESTful APIs DBB integration - IDz EE only capability Code coverage/zunit test case results import into SonarQube ADFz Shift Left Testing: Record input and output from COBOL program and generate a test case Provision personal ZD&T environment IBM Z / © 2018 IBM Corporation
- 19. Development Build Artifact Repository SCM IBM Dependency Based Build Deploy & Test Automated Unit Tests Urbancode Deploy Artifactory/Nexus Urbancode Deploy Rational Test Workbench Other Testing Tools IBM Z / © 2018 IBM Corporation Environments Z Systems Development & Test Environment IBM Z IBM Developer for Z Systems EE IBM ADDI End to End Pipe Line – Integrated with Open Source Rational Team Concert Code Review
- 20. Demo IBM Z / © 2018 IBM Corporation
- 21. IBM Z / © 2018 IBM Corporation