Agile Integration with APIs and Containers Workshop
- 1. RED HAT AGILE INTEGRATION OVERVIEW Enabling your API-Centric Strategy
- 3. 8:00 - 9:00 am Registration and breakfast 9:00 - 10:00 am An introduction to agile integration Concepts, Use Cases, and Roadmap 10:00 - 11:00 am “A day in the life” hands-on developer demo 11:00 - 11:15 am Break 11:15 am - 12:00 pm Lab—Contract-first API development Choose your own adventure: Track one: API design and management Track two: API development and security 12:00 - 1:00 pm Lunch 1:00 - 3:30 pm Lab cont.—Contract-first API development Choose your own adventure: Track one: API design and management Track two: API development and security 3:30 - 4:00 pm Recap and summary Workshop Agenda
- 4. AGILE INTEGRATION WORKSHOP FRAMEWORK Developer Track OpenShift Red Hat Fuse 3scale Apicurio Microcks Introduction to Agile Integration Agile Integration Product Overview Integrator Track OpenShift Red Hat Fuse 3scale Apicurio Microcks Operations Track Coming Soon...
- 7. 7 “Fortune 500 firms in 1955 vs. 2014; 88% are gone ….” Group A: American Motors, Brown Shoe, Studebaker, Collins Radio, Detroit Steel, Zenith Electronics, and National Sugar Refining. Group B: Boeing, Campbell Soup, General Motors, Kellogg, Procter and Gamble, Deere, IBM and Whirlpool. Group C: Facebook, eBay, Home Depot, Microsoft, Office Depot and Target. Group A - GONE! Group B - STILL HERE! Group C - NEW PLAYERS! Business Evolves Source: Mark J. Perry (http://www.aei.org/)
- 8. 8 Innovation Prevails Source: Yahoo Finance (*Peak Market Value 2006)
- 9. Source: Venture Beat (https://venturebeat.com/2017/04/03/technology-has-eaten-the-world/) Meanwhile ... Software is eating the world
- 10. WE ARE LIVING IN A CONNECTED WORLD THERE WILL BE MORE THAN BY 2020 BILLION INTERCONNECTED DEVICES 26 TRILLION STABLE CONNECTIONS 215 MILLION CONNECTIONS PER SECOND 63 Source: Gartner, Building Platforms for a Digital Society: Key Insights From the 2016 Gartner Symposium/Itxpo Keynote, Nov 2016. ID#G00317081.
- 11. THE WAY WE DO BUSINESS HAS CHANGED THE NUMBERS TELL THE STORY (AND IT’S NOT OVER YET) 90% of all data was created in the last 2 years1 BIG DATA 77% of Americans own a smartphone2 MOBILE 85% of customers making a major purchase start online3 SOCIAL 41% of enterprise workloads are running on cloud4 CLOUD 29B devices connected to the internet by 20225 IoT $284B in mobile commerce in the US by 20206 API ECONOMY 4. 451 Research, Voice of the Enterprise: Cloud Transformation, September 2016. 5. Ericcson, Ericcson Mobility Report, Nov 2016. 6. Business Insider, The Rise of M-Commerce: Mobile Shopping Stats & Trends, Dec 2016. 1. IBM, 10 Key Marketing Trends for 2017, Dec 2016. 2. Pew Research Center, Mobile Fact Sheet, Jan 2017. 3. Synchrony Financial, 2016 Major Purchase Study, Dec 2016.
- 12. INTEGRATION IS CRITICAL FOR MODERN BUSINESSSUSTAINED COMPETITIVE ADVANTAGE "Only a small percentage of companies will gain competitive advantage from SMACIT* technologies. Those that do, will focus less on the individual technologies and more on how they rally all those technologies, in unison, to fulfill a distinctive purpose." Source: Jeanne W. Ross, Cynthia M. Beath, & Ina Sebastian for HBR (https://hbr.org/2015/01/why-nordstroms-digital-strategy-works-and-yours-probably-doesnt ) *SMACIT: Social, Mobile, Analytics, Cloud, and Internet of Things
- 13. People try to copy Netflix, but they can only copy what they see. They copy the results not the process. Adrian Cockroft, former Chief Cloud Architect. Netflix “ ”
- 14. AGILE + INTEGRATION = Agile Integration
- 15. CONFIDENTIAL - FOR INTERNAL USE ONLY 15 Photo by Brad Barmore on Unsplash “Agility” is the most important business capability today. a·gil·i·ty noun /əˈjilədē/ ability to move quickly and easily
- 16. Benefits of an Agile Approach ● Stakeholder Engagement ● Transparency ● Early & Predictable Delivery ● Predictable Costs & Schedule ● Adaptability ● Improves Quality Business Value Resource Utilization Strategy and Product Alignment Product Development Agility
- 17. “Integration” unlocks the true potential of modern enterprises in·te·gra·tion in(t)əˈɡrāSH(ə)n/ Noun “the process of bringing together the component sub-systems into one system”
- 18. “Integration” unlocks the true potential of modern enterprises in·te·gra·tion in(t)əˈɡrāSH(ə)n/ Noun “the process of bringing together the component sub-systems into one system”
- 19. The Value of Integration ● Cost Saving ● Time Saving ● Increased productivity & Efficiencies ● Standards compliance ● Improved reporting ● Ease of update ● Significant visibility Innovation Compliance, Security & Risk Reduce Complexity Visibility Integration
- 20. THE AGE OF AGILE INTEGRATION Trends & Use Cases
- 21. DIGITAL TRANSFORMATION NEXT-GENERATION ARCHITECTURE, CULTURE, & PROCESS I.T. OPTIMIZATION AGILE INTEGRATION HYBRID CLOUD INFRASTRUCTUR E CLOUD-NATIVE APP DEV I.T. AUTOMATION & MANAGEMENT DEVOPS SECURITY OPEN SOURCE INNOVATION DIGITAL TRANSFORMATION FRAMEWORK
- 22. WHY AGILE INTEGRATION? • “Agility” is the most important business capability today.* • Every organization has integration problems to solve. • Centralized doesn’t scale. 22 Transformational for Customers Source: BCG: Organizing for Agility in Consumer Companies https://www.bcg.com/publications/2017/people-organization-accelerating-growth-organizing-agility-consumer-companies.aspx Integration is a core competency that every business needs to master
- 23. 23 INTEGRATION IS UNDERGOING RAPID CHANGE Centralized Integration Mainframe Previous generations of Integration ● Centralize integration ● Centralize expertise ● Use proprietary connectors ● Solve the N^(N-1) complexity Impact of Distribution, Containerization and APIs ● Hundreds of apps become thousands of services ● Integration can take place anywhere in the organization ● Bottlenecks can be removed ● Integration connects front and back office systems
- 24. 24 WHAT’S NEEDED? API-CENTRIC INTEGRATION. CENTRALIZED ESB Hybrid Platform API Policies, Analytics, and Ecosystems Mainframe Centralized Hub API based Decentralized More Agility
- 25. 25 INTEGRATION DELIVERY NEEDS TO CHANGE Centralized Integration Delivery (Efficiency) Do-it-yourself or Agile Teams (Agility) RESHAPING THE INTEGRATION DELIVERY MODEL: ENABLE DIY TEAMS
- 26. 26 NEED TO INTEGRATE WHERE DEPLOYED Source: IDC InfoBrief Agile Integration for Today’s cloud-enabled enterprise, https://engage.redhat.com/agile-integration-cloud-s-201711061616 Oct 2017. There isn’t one dominant cloud 45% run bespoke applications in a private cloud or are implementing within 12 months
- 27. THE API CENTRIC INTEGRATION
- 28. All connected API-CENTRIC INTEGRATION DRIVERS STRATEGIC BUSINESS ● Faster to market ● Agility & flexibility ● Re-use ● Cost savings ● Maintainability ● Scalability ● M&A ARCHITECTURA L ● Microservices ● API-first ● Migrating from existing ESBs ● Adopt next-gen architecture ● Percentage cloud ● Hybrid cloud ● Partner programs ● SaaS integration ● Foundations for Mobile ● Citizen Integrator enablement ● Multichannel delivery ● Analytics & intelligence ● Becoming a “platform”
- 29. Common gateway & policy enforcement point for web, mobile and other channels USE CASES SUITED FOR API-CENTRIC INTEGRATION Customer loyalty programs Mobility & IoT API-driven business B2B/partner outreach M&A-related application consolidation Agile, responsive enterprise API & microservices strategies to power customer loyalty tiers (Silver, Gold, Platinum, etc.) Get beyond crude methods (FTP etc). Improve outreach, monetize, and drive smart B2B integration with partners. Common technology platform powering and servicing internal and external initiatives Use APIs to reorganize business post M&A to power application and functionality consolidation Get beyond point-to-point integration to API, service and, value-centric integration
- 30. TYPICAL AGILE API INTEGRATION USE-CASES PLATFORM NEEDS I.T. INITIATIVES STRATEGIC INITIATIVES INDUSTRY TRENDS REMAIN COMPETITIVE (DIGITAL INNOVATION) DRIVE PROFITABILITY DEEPEN CUSTOMER RELATIONSHIP Customer 360 Modernize legacy systems Improve organizational effectiveness Improve omnichannel experience Extend distribution channels Digital transformation Seamlessly integrate partners Improve predictive analytics Launch mobile apps Connect disparate systems Launch unified customer platforms Support systems of record & innovative IT simultaneously Expose legacy services with APIs Adapt & digitally transform the business Integrate hybrid IT for connectivity, management, & visibility
- 31. 31 SCHIPHOL AMSTERDAM AIRPORT Fuse and 3scale build the base, adding OpenShift completes their transition to an Agile Enterprise Red Hat OpenShift Container Platform Red Hat 3scale API Management Platform Red Hat JBoss Enterprise Application Platform Red Hat JBoss Fuse Red Hat Gluster Storage Red Hat OpenShift Dedicated SOLUTION Transform data and services into re-usable endpoints and share these with partners and mobile applications via APIs: creating a genuine partner ecosystem. Then scale up and automate software deployment with containers. WHY RED HAT Wanted to select open source software that was backed by support from a trusted vendor. Created API foundation for seamless handoff between the airport and its partners. CHALLENGE To become the best digital airport and improve passenger experience. PRODUCTS & SERVICES Provide APIs for access to all core services for internal developers and partners and cut development time for new services and APIs by 50% Red Hat Satellite Red Hat Consulting https://www.redhat.com/en/about/press-releases/amsterdam-airport-schiphol-taps-red-hat-support-goal-becoming-best-digital-airport
- 32. API-CENTRIC LIFECYCLE PROCESS Design Publish Integrate Manage Operate
- 33. Design Publish Integrate Manage Operate Building APIs (Tooling) Dev Platform Dev Tools Support Flexible service and code reuse from backend API-CENTRIC LIFECYCLE PROCESS
- 34. Design Publish Integrate Manage Operate Deploy APIs (Publish) Flexibility to scale Repository & Service Catalog Documentation (Format, Type) API-CENTRIC LIFECYCLE PROCESS
- 35. Design Publish Integrate Manage Operate Integration Standard vs. customized Transformation, Mediation, Mashup Government regulation New service launch API-CENTRIC LIFECYCLE PROCESS
- 36. Design Publish Integrate Manage Operate API Management Security & Authorization Enforce policies Reports & Analytics Community & Dev Portal Monetization API-CENTRIC LIFECYCLE PROCESS
- 37. Design Publish Integrate Manage Operate Operation DevOps Retire Update New Service Internal service re-creation Automation API-CENTRIC LIFECYCLE PROCESS
- 38. QUESTIONS?
- 39. RED HAT AGILE INTEGRATION STRATEGY
- 40. THE VALUE OF RED HAT INTEGRATION SPEED, SIMPLICITY, & COLLABORATION EVERYWHERE (FROM ANYWHERE) Open and decoupled architecture Enterprises are moving away from lock-in all- or-nothing solutions to take advantage of new agile approach. Enterprises are looking for emerging, high-traffic, critical-workload solutions with No single points of failure. Built for automation from the ground up. Enterprises are leveraging new architecture models to effectively apply cross- functional policies Scalable and cost effective No vendor lock-in, adjacent capabilities Multiple deployment options to support the new Infrastructure Paradigm: Reliable, Rapidly Deployable, Efficient Infrastructure ANYTIME, ANYWHERE. Flexible and reliable deployment model
- 41. Development Process Waterfall CI/CD Deployment Server/VM Container Infrastructure Data Center Cloud Architecture Monolith MicroservicesAPIs Webservices Service Endpoints ENTERPRISE IT IS UNDERGOING FUNDAMENTAL CHANGE To remain competitive, businesses need an integration platform capable of supporting current and next generation architectures.
- 42. ENABLING YOUR ENTERPRISE STRATEGY CONSUMERSAPI MANAGEMENT LAYER Access control and security API contracts and rate limits Analytics and reporting Developer portal and docs Billing and payments INFRASTRUCTURE Dev Tools Docs Test Tools INTEGRATION SERVICES RBDMS SAP SOAP JMS + more Accounts Orders Shipping Developers Partners Mobile Apps Affiliates Internal Projects + more APPLICATION LAYER
- 43. ENABLING YOUR ENTERPRISE STRATEGY CONSUMERSAPI MANAGEMENT LAYER Access control and security API contracts and rate limits Analytics and reporting Developer portal and docs Billing and payments Dev Tools Docs Test Tools BUILD DEPLOY & AUTOMATE INTEGRATION SERVICES RBDMS SAP SOAP JMS + more Accounts Orders Shipping Developers Partners Mobile Apps Affiliates Internal Projects + more APPLICATION LAYER INTEGRATE MANAGE CONNECT
- 44. 44 AUTOMATIONRUNTIMES DATA GRID COMPOSE AND INTEGRATE MICROSERVICES ACROSS AN ENTERPRISE SERVICE NETWORK INTEGRATION RED HAT SOLUTIONS TO BUILD OR RUN MODERN SERVICES AUTOMATE AND OPTIMIZE BUSINESS PROCESSES Develop, Deploy and Manage Across a Hybrid Cloud Integration with RH Developer, CI/CD tools & Security Services Optimized for OpenShift & Kubernetes Services CORE TOOLS TO BUILD & MIGRATE APPS AMQ BROKER
- 45. RED HAT INTEGRATION TO BUILD AND CONNECT MODERN SERVICES AUTOMATION COMPOSE AND INTEGRATE MICROSERVICES ACROSS HYBRID CLOUD INTEGRATION 45 AUTOMATE AND OPTIMIZE BUSINESS PROCESSES Connect - Mediate - Transform COMPREHENSIVE TOOLS TO BUILD & MIGRATE APPS RUNTIMES DATA GRID AMQ BROKER Integration with RH Developer, CI/CD tools & Security Services Optimized for OpenShift & Kubernetes Services
- 46. DISTRIBUTED INTEGRATION CONTAINERS APIs LIGHTWEIGHT PATTERN BASED EVENT-ORIENTED COMMUNITY-SOURCED CLOUD-NATIVE SOLUTIONS LEAN ARTIFACTS, INDIVIDUALLY DEPLOYABLE CONTAINER-BASED SCALING & HIGH AVAILABILITY WELL-DEFINED, REUSABLE, & WELL-MANAGED ENDPOINTS ECOSYSTEM LEVERAGE API SERVICES AGILE INTEGRATION STACK SECURITY, AUTHENTICATION, AUDIT (RH-SSO) RED HAT FUSE RED HAT AMQ
- 47. Microcks MOCK IMPLEMENT SECURE CONSUME API Model Canvas STRATEGY RED HAT API LIFECYCLE MANAGEMENT SINGLE SIGN-ON (SSO)
- 48. NEXT GENERATION OF RED HAT AGILE INTEGRATION StandaloneOpenShift iPaaS ● Single Product Instance ● Developer-focused ● Integration where you need it ● Classic integration ● Scale-out your Integration platform ● Replaces Fabric v1 ● Developer-focused ● Cloud-native integration ● Low / No-code UX ● 100% cloud-based ● Integration using a browser ● Ad-hoc integration
- 49. PRIVATE CLOUD HYBRID INTEGRATION PLATFORM Single platform and toolchain across cloud environments provides consistency and flexibility for current and future deployment plans. Deploy on-premise PUBLIC CLOUD Deploy on public cloud provider MANAGED CLOUD Deployed and managed by Red Hat
- 50. RED HAT AGILE INTEGRATION CONTENT WHAT IS AGILE INTEGRATION? https://middlewareblog.redhat.com/2017/09/13/what-is-agile-integration/ BLUEPRINT FOR AGILE INTEGRATION https://go.redhat.com/agile-integration-devops-containers-20180801 CONNECT APPS, APIs, DATA & DEVICES https://www.redhat.com/en/explore/agile-integration DIGITAL INNOVATION THROUGH AGILE INTEGRATION https://www.redhat.com/en/resources/innovation-through-agile-integration? sc_cid=701f2000000RXY0AAO%3Fsc_cid%3D701f2000000RXXgAAO%3F208172rhb
- 51. QUESTIONS?
- 52. AGILE INTEGRATION WORKSHOP Developer & Integrator Tracks
- 54. Agile Integration with APIs and Containers Workshop Choose your own adventure Code-free API design and management track API development and security track Lab One Design Design APIs with Apicurio Lab Five Security Add security with Red Hat SSO Lab Two Mocking Mock and test with Microcks Lab Three Implementation Develop cloud-native solution with Red Hat Fuse Lab Four Managing Manage API using 3Scale by Red Hate
- 55. 55 Hybrid Development: Two Key Personas Developer Citizen Integrator
- 56. APIS 2.0 Workshop56 In this Lab you will learn how to: Design a simple API using API design tools, Test your contract with Microcks, Implement the API in Fuse Online, Manage with 3scale, and finally Deploy your API to the OpenShift Container Management platform. Citizen Integrator Track
- 57. INSERT DESIGNATOR, IF NEEDED57 DESIGN: APICURIO (API contract specification) » Purpose: create an API contract covering technical and syntactic definition of a future API. Contract provides a clear description of API methods and custom resources that are manipulated. » Tooling: Apicurio allows you to design an API contract the easy way ! Provides an online WYSIWYG editor with compliance check on OpenAPI Spec. » Output: Specific OpenAPI contract saved into a Git repository (online version is using GitHub). » Enable: API Designer to distribute clear and concise specification of API to development and consumers. OpenAPI contract in Git API Contract Design
- 58. INTRODUCING MICROCKS58 Multi-type of Services / API support Usable by functional experts, comprehensive UI Mock support and ability to deploy at scale Ability to use specifications for running tests Misc. http://microcks.github.io TEST: MICROCKS Microservices Mocks & Testing
- 59. INTRODUCING MICROCKS IMPLEMENT: FUSE ONLINE LOW-CODE PLATFORM FOR CLOUD-NATIVE INTEGRATION, HOSTED ON OPENSHIFT
- 60. 60 MANAGE: 3SCALE API MANAGEMENT ENABLING AN API-FIRST APPROACH API visibility & control enterprise wide Security, rate limits, analytics, API keys, developer portal Manage internal and external APIs Transform internal IT into “API-first” approach Empower teams to deliver their own APIs Provide global visibility and a uniform approach
- 61. 61 SECURE: RED HAT SSO ● Based on Apache Keycloak ● Open source access and identity manager ● Identity Brokering ● User Federation with LDAP based directory services ● Client libraries for JavaEE, Spring, NodeJS, JS + more
- 62. APIS 2.0 Workshop62 In this Lab you will learn how to: Review an API contract, Test the API, Implement the API in Fuse, Manage the API using the 3scale Developer Portal and finally, Secure the API with Red Hat SSO Developer Track
- 63. INSERT DESIGNATOR, IF NEEDED63 REVIEW: APICURIO (API contract specification) » Purpose: create an API contract covering technical and syntaxic definition of a future API. Contract provides a clear description of API methods and custom resources that are manipulated. » Tooling: Apicurio allows you to design an API contract the easy way ! Provides an online WYSIWYG editor with compliance check on OpenAPI Spec. » Output: Specific OpenAPI contract saved into a Git repository (online version is using GitHub). » Enable: API Designer to distribute clear and concise specification of API to development and consumers. OpenAPI contract in Git API Contract Design
- 64. INTRODUCING MICROCKS64 Multi-type of Services / API support Usable by functional experts, comprehensive UI Mock support and ability to deploy at scale Ability to use specifications for running tests Misc. http://microcks.github.io TEST: MICROCKS Microservices Mocks & Testing
- 65. INTRODUCING MICROCKS IMPLEMENT: RED HAT FUSE Standardized Integration Platform Fuse Online OS JVM Narayana Undertow AMQ CXF Camel Karaf OS JVM Narayana Undertow AMQ CXF Camel EAP OS JVM Narayana Undertow AMQ CXF Camel Spring Boot For integrators For developers
- 66. 66 MANAGE: 3SCALE API MANAGEMENT Interactive API Documentation Your brand. Your developer experience. Your user interface
- 67. 67 SECURE: RED HAT 3SCALE & SSO Multiple authentication mechanisms Authenticate traffic Restrict by policy Drop unwelcome calls Protect backend services Generate overage alerts Impose rate limits – API Key – App ID / App Key Authenticate and restrict access to your APIs. Protect backend services. – OpenID Connect
- 70. AGILE INTEGRATION ARCHITECTURE Workshop Reference Architecture
- 71. API CENTRIC DEVELOPMENT Bounded Context Bounded Context External Gateway CONTRACT- FIRST CODE FIRSTBrown Field
- 72. Design Deploy and RunImplementation Manage & SecureMocking API LIFECYCLE in AGILE INTEGRATION INTERNATIONAL INC. DEMO
- 73. API IMPLEMENTATION FOR ALL Brown Field Green Field Swagger to REST camel-restdsl-swagger-plugin <configuration> <specificationUri>src/spec/MyCustomer.json</specificationUri> <fileName>camel-rest.xml</fileName> <outputDirectory>src/main/resources/spring</outputDirectory> </configuration> SOAP to REST cxf-codegen-plugin <configuration> <sourceRoot>${basedir}/src/main/java</sourceRoot> <wsdlOptions> <wsdlOption> <wsdl>http://localhost:8080/ws/location?wsdl</wsdl> </wsdlOption>
- 74. FROM GROUND TO CLOUD
- 75. CLOUD NATIVE JVM Karaf SpringBoot Repo Integration App s2i Push Fabric8 PluginDEV mvn fabric8:deploy
- 76. OAuth (Open Authorization) is an open standard for access delegation: ● One service can request access to resources on another service on the behalf of the user. 76 OAUTH 2.0 From 20,000 FT ResourcesClient User Accesses OwnsAuthorize
- 77. ● Built on top of the OAuth 2.0 protocol ● Allows clients to verify the identity of an end user and obtains basic profile information ● RESTful HTTP API, using JSON as a data format ● Like SAML - but not just webpage centric, easier to implement. 77 OPENID CONNECT Overview
- 78. 78 ● Signed by algo and verified by only correct key ● Contains user identity in form of claims (Private, public, reserved) ● For OIDC purpose, SSO is widely adopted in consumer/enterprise apps ● Eliminates the need to look up against a central access control list JWT (“JOT”) To The Rescue Name: John Doe Type: Employee Issued by: Company Expiration Date: 02-06-2019
- 80. Admin Portal Sync / Authorize API Gateway API Manager API Provider Administrators Mobile Apps Developer Apps Branded Dev PortalSwagger Doc Developers RH-SSO GOGS (REPO) Eclipse Che APICURIO MICROCKS Tooling 3scale API Management API Consumer RH-Fuse Integration
- 82. ENABLING YOUR ENTERPRISE STRATEGY API INTEGRATION LAYER REST API Service API REST API Service API REST API Service API CONSUMER Developers Partners Mobile App Affiliates Internal Projects + more API MANAGEMENT LAYER Access control and security API contracts and rate limits Analytics and reporting Developer portal and docs Billing and payments APPLICATION LAYER INFRASTRUCTURE LAYER Dev Tools Docs Test Tools BUILD INTEGRATE MANAGE CONNECT DEPLOY & AUTOMATE
- 83. Microcks MOCK IMPLEMENT SECURE CONSUME API Model Canvas STRATEGY RED HAT API LIFECYCLE MANAGEMENT SINGLE SIGN-ON (SSO)