SlideShare a Scribd company logo
© 2015 IBM Corporation1
IBM MQ Light :
From monolith to microservices for
speed and scale
Alan Chatt
Product Manager IBM Messaging
alan.chatt@uk.ibm.com
2 © 2015 IBM Corporation
Agenda
• Microservices : what & why
• MQ Light messaging for Microservices
• How are others doing microservices
3 © 2015 IBM Corporation
Microservices
Development teams
Delivering elastically scalable, distributed
applications with unprecedented agility
using a microservices architecture
Agility comes from :
“2 pizza” teams operating completely independently,
owning the whole technology stack, deploying on their own
schedules, writing and owning services that will scale
when demand dictates
Not without challenges :
• Fallacies of distributed computing
• Operational overhead increases with the number of services to deploy
• New skills and tooling required to cope with additional complexities
3
4 © 2015 IBM Corporation
Motivations : Rate of change
More local changes
More GitHub check-ins
Changes go all the
way to Production
5 © 2015 IBM Corporation
Motivations : Flexibility
6 © 2015 IBM Corporation
Motivations : Resilience
Communication can:
1) Re-route
2) Stored for future delivery
3) Return cached/out of date data
1
2 3
7 © 2015 IBM Corporation
Motivations : Scale
Steady state Workload increases Individual components
scale up as required
8 © 2015 IBM Corporation
Migrating from a monolith
• When & why
• Do it because you need to evolve rapidly
• Don’t just re-write
• Chip away at bits and improve
• Techniques
• Emit events from existing application
• Surround with simple service
interfaces that you can call
Monolithic
Application
9 © 2015 IBM Corporation
A few words of caution
Some wisdom shared by people in the trenches :
• Do not start a new implementation with microservices
• Master dev-ops before starting a microservices
deployment
• Cleanly separate platform services from the application
• Do not rush into creating too many microservices
10 © 2015 IBM Corporation
MQ Light
Messaging for microservices
11 © 2015 IBM Corporation
MQ Light : Software and Cloud
• Messaging that application developers will
love to use, helping them make responsive
applications that scale easily
• 3 ways to get it:
• Bluemix service
• MQ Light software download
• MQ Light API support in MQ (Beta)
• Open APIs crafted to feel natural in a growing
range of popular languages
• Tooling that makes modular app development
easy
11
12 © 2015 IBM Corporation
Messaging patterns for loose coupling
Worker offload • Image processing
• Text analytics
Multiple service instances use a shared destination
• Service scaled up by adding an instance
• MQ Light will start to distribute work to new instance
• Service scaled down by “killing” an instance
• MQ Light will stop distributing work to that instance and will re-
distribute unacknowledged messages
• Service can rate limit inbound work
• Use link credit to restrict amount of work currently being processed
13 © 2015 IBM Corporation
Messaging patterns for loose coupling
Event driven /
Fire and forget
• Posting video to multiple social
sites after transcoding
• Respond to external events
Using multiple MQ Light destinations subscribed to the same topic
• Cuts down unnecessary “polling” traffic between services
• Deploying multiple versions of a service simultaneously
• Allows duel running for a period of time
• Create new extensions driven by existing data
• New subscribers just listen to an existing topic, no need to update
publisher
• i.e. create new service which performs analytics on existing data flows
14 © 2015 IBM Corporation
Messaging for loose coupling
• Isolating your application from the availability and performance
of an external system
• Replace part of existing system by intercepting events and
running new logic
• MQ Light API support in MQ
• Subscribe to data already flowing between existing systems
Connecting external
systems
• Updating external booking system
• Running logic when existing CRM
system updates contact address
15 © 2015 IBM Corporation
Using open standards for technology freedom
• Using AMQP1.0 as standard protocol
• Open source clients from the Apache Qpid Proton
project
• Example for this for PHP :
https://developer.ibm.com/messaging/2014/07/01/using-php-mq-light-bluemix/
• Easily Integrated with microservices frameworks :
https://developer.ibm.com/messaging/2015/05/06/microservices-with-seneca-and-mq-light/
• MQ Light specific clients reduce quantity and
complexity of code
• Node.js, Java, Ruby, Python
16 © 2015 IBM Corporation
Designed for development
• MQ Light download quick and easy to run on a
laptop
• Works well with Vagrant & Docker
https://hub.docker.com/r/ibmcom/mqlight/
• No configuration : applications define behaviour
• MQ Light tooling designed for developers
17 © 2015 IBM Corporation
Deployment Options
17
MQ Light Service
for Bluemix
[Managed Service]
WebSphere MQ
[open Beta]
“MQ Light”
18 © 2015 IBM Corporation
Presence Insights
Adopting Microservices within IBM
19 © 2015 IBM Corporation
IBM Presence Insights
Bring the same personalized shopping experience you get
online to “bricks and mortar” stores
IBM SaaS offering built on the cloud using microservices
20 © 2015 IBM Corporation
Technologies used by Presence Insights
21 © 2015 IBM Corporation
Presence Insights : Today
• 22+ Microservices
• 70+ Node.js instances
• Application deployed across Bluemix and Softlayer
• Node.js (Web Tier)
• MQ Light (Messaging)
• Cloudant (Persistence)
• Redis (Caching)
• D3 (Charting)
22 © 2015 IBM Corporation
Presence Insights : Architecture
23 © 2015 IBM Corporation
Presence Insights : Use of MQ Light
• PI use the MQ Light service in Bluemix for communication
between their microservices, using both worker offload and
event driven patterns
• Wildcards : Feeding many separate streams of data to multiple services
• ClientID : Audit trail of which service instances receives which event
• Destination Sharing : Built in load balancer
• Advantage of managed MQ Light service : “…the team does not need
to manage the instances themselves (security compliance and operating system
monitoring/management)”
“MQLight as a managed service is a key element to our Presence Insights
strategy. The capabilities that are provided in the Node.js client libraries and the
MQLight service instance provides a great foundation for our messaging system
around publishing and subscribing to our location sensor events”
24 © 2015 IBM Corporation
Presence Insights : Lessons learned
• Streamlining the build & deployment pipeline is critical
• Developers need to be able to push changed and demo them in the
cloud environment
• Continuous and holistic testing combats the additional
complexities of a distributed application
• Tests run at each level act as gate for changes to be promoted
• End to end tests run every 10 minutes against all environments
• These End to end tests ensure platform services (i.e. Cloudant and
MQ Light)
• PI experiment before switching to node.js and current
technology stack
• Time boxing experimentation is essential
25 © 2015 IBM Corporation
Summary
26 © 2015 IBM Corporation
Summary
• Microservices is a great architecture for large, rapidly
evolving applications that need to scale
• Not a silver bullet that solves all problems
• Using asynchronous messaging patterns between services
supports the goals of a microservice architecture
• Provide workload balancing when scaling up and down
• Provides loose coupling, promoting resilience
• MQ Light works well in a dev-ops environment, essential for
making a microservice architecture work well
• Offline development
• Application defined behaviour, no separate configuration to manage
27 © 2015 IBM Corporation
Resources
• Bluemix PaaS :
https://console.ng.bluemix.net/
• MQ Light :
https://developer.ibm.com/messaging/mq-light/
• Redbook : Microservices from Theory to Practice
https://www.redbooks.ibm.com/redbooks.nsf/RedpieceAbstracts/sg248275.html
Ad

More Related Content

What's hot (20)

IBM MQ in Containers - Think 2018
IBM MQ in Containers - Think 2018IBM MQ in Containers - Think 2018
IBM MQ in Containers - Think 2018
Robert Parker
 
Hybrid Messaging with IBM Bluemix
Hybrid Messaging with IBM BluemixHybrid Messaging with IBM Bluemix
Hybrid Messaging with IBM Bluemix
matthew1001
 
IBM MQ Advanced - IBM InterConnect 2016
IBM MQ Advanced - IBM InterConnect 2016IBM MQ Advanced - IBM InterConnect 2016
IBM MQ Advanced - IBM InterConnect 2016
Leif Davidsen
 
3298 microservices and how they relate to esb api and messaging - inter con...
3298   microservices and how they relate to esb api and messaging - inter con...3298   microservices and how they relate to esb api and messaging - inter con...
3298 microservices and how they relate to esb api and messaging - inter con...
Kim Clark
 
Introducing MQ Light - IBM Interconnect 2015 session AME4181
Introducing MQ Light - IBM Interconnect 2015 session AME4181Introducing MQ Light - IBM Interconnect 2015 session AME4181
Introducing MQ Light - IBM Interconnect 2015 session AME4181
Robert Nicholson
 
Whats New in Integration What's New in IBM Integration Bus and IIB on Cloud
Whats New in Integration What's New in IBM Integration Bus and IIB on Cloud Whats New in Integration What's New in IBM Integration Bus and IIB on Cloud
Whats New in Integration What's New in IBM Integration Bus and IIB on Cloud
Rob Convery
 
IBM MQ Update, including 9.1.2 CD
IBM MQ Update, including 9.1.2 CDIBM MQ Update, including 9.1.2 CD
IBM MQ Update, including 9.1.2 CD
David Ware
 
Ad Hoc Automation is an Expensive Mistake
Ad Hoc Automation is an Expensive MistakeAd Hoc Automation is an Expensive Mistake
Ad Hoc Automation is an Expensive Mistake
BMC Software
 
Ios models
Ios modelsIos models
Ios models
JUDYFLAVIAB
 
SHARE2016: DevOps - IIB Administration for Continuous Delivery and DevOps
SHARE2016:  DevOps - IIB Administration for Continuous Delivery and DevOpsSHARE2016:  DevOps - IIB Administration for Continuous Delivery and DevOps
SHARE2016: DevOps - IIB Administration for Continuous Delivery and DevOps
Rob Convery
 
Bluemix Technical Overview
Bluemix Technical OverviewBluemix Technical Overview
Bluemix Technical Overview
rogerp67
 
#1922 rest-push2 ap-im-v6
#1922 rest-push2 ap-im-v6#1922 rest-push2 ap-im-v6
#1922 rest-push2 ap-im-v6
Jack Carnes
 
Session 1897 messaging in the cloud with elastic mq mq light and bluemix-impa...
Session 1897 messaging in the cloud with elastic mq mq light and bluemix-impa...Session 1897 messaging in the cloud with elastic mq mq light and bluemix-impa...
Session 1897 messaging in the cloud with elastic mq mq light and bluemix-impa...
Robert Nicholson
 
IBM Think 2018: IBM MQ High Availability
IBM Think 2018: IBM MQ High AvailabilityIBM Think 2018: IBM MQ High Availability
IBM Think 2018: IBM MQ High Availability
Jamie Squibb
 
Developing Integrations for IBM Integration Bus on Cloud
Developing Integrations for IBM Integration Bus on CloudDeveloping Integrations for IBM Integration Bus on Cloud
Developing Integrations for IBM Integration Bus on Cloud
Geza Geleji
 
CloudHub Connector With Mulesoft
CloudHub Connector With MulesoftCloudHub Connector With Mulesoft
CloudHub Connector With Mulesoft
Jitendra Bafna
 
FORUM PA 2015 - Microservices with IBM Bluemix
FORUM PA 2015 - Microservices with IBM BluemixFORUM PA 2015 - Microservices with IBM Bluemix
FORUM PA 2015 - Microservices with IBM Bluemix
gjuljo
 
MQ Guide France - IBM MQ and Containers
MQ Guide France - IBM MQ and ContainersMQ Guide France - IBM MQ and Containers
MQ Guide France - IBM MQ and Containers
Robert Parker
 
Hybrid Cloud: How to Get a Return from an Investment Made Three Decades Ago (...
Hybrid Cloud: How to Get a Return from an Investment Made Three Decades Ago (...Hybrid Cloud: How to Get a Return from an Investment Made Three Decades Ago (...
Hybrid Cloud: How to Get a Return from an Investment Made Three Decades Ago (...
Michael Elder
 
Biztalk vs mulesoft
Biztalk vs mulesoft Biztalk vs mulesoft
Biztalk vs mulesoft
Bui Kiet
 
IBM MQ in Containers - Think 2018
IBM MQ in Containers - Think 2018IBM MQ in Containers - Think 2018
IBM MQ in Containers - Think 2018
Robert Parker
 
Hybrid Messaging with IBM Bluemix
Hybrid Messaging with IBM BluemixHybrid Messaging with IBM Bluemix
Hybrid Messaging with IBM Bluemix
matthew1001
 
IBM MQ Advanced - IBM InterConnect 2016
IBM MQ Advanced - IBM InterConnect 2016IBM MQ Advanced - IBM InterConnect 2016
IBM MQ Advanced - IBM InterConnect 2016
Leif Davidsen
 
3298 microservices and how they relate to esb api and messaging - inter con...
3298   microservices and how they relate to esb api and messaging - inter con...3298   microservices and how they relate to esb api and messaging - inter con...
3298 microservices and how they relate to esb api and messaging - inter con...
Kim Clark
 
Introducing MQ Light - IBM Interconnect 2015 session AME4181
Introducing MQ Light - IBM Interconnect 2015 session AME4181Introducing MQ Light - IBM Interconnect 2015 session AME4181
Introducing MQ Light - IBM Interconnect 2015 session AME4181
Robert Nicholson
 
Whats New in Integration What's New in IBM Integration Bus and IIB on Cloud
Whats New in Integration What's New in IBM Integration Bus and IIB on Cloud Whats New in Integration What's New in IBM Integration Bus and IIB on Cloud
Whats New in Integration What's New in IBM Integration Bus and IIB on Cloud
Rob Convery
 
IBM MQ Update, including 9.1.2 CD
IBM MQ Update, including 9.1.2 CDIBM MQ Update, including 9.1.2 CD
IBM MQ Update, including 9.1.2 CD
David Ware
 
Ad Hoc Automation is an Expensive Mistake
Ad Hoc Automation is an Expensive MistakeAd Hoc Automation is an Expensive Mistake
Ad Hoc Automation is an Expensive Mistake
BMC Software
 
SHARE2016: DevOps - IIB Administration for Continuous Delivery and DevOps
SHARE2016:  DevOps - IIB Administration for Continuous Delivery and DevOpsSHARE2016:  DevOps - IIB Administration for Continuous Delivery and DevOps
SHARE2016: DevOps - IIB Administration for Continuous Delivery and DevOps
Rob Convery
 
Bluemix Technical Overview
Bluemix Technical OverviewBluemix Technical Overview
Bluemix Technical Overview
rogerp67
 
#1922 rest-push2 ap-im-v6
#1922 rest-push2 ap-im-v6#1922 rest-push2 ap-im-v6
#1922 rest-push2 ap-im-v6
Jack Carnes
 
Session 1897 messaging in the cloud with elastic mq mq light and bluemix-impa...
Session 1897 messaging in the cloud with elastic mq mq light and bluemix-impa...Session 1897 messaging in the cloud with elastic mq mq light and bluemix-impa...
Session 1897 messaging in the cloud with elastic mq mq light and bluemix-impa...
Robert Nicholson
 
IBM Think 2018: IBM MQ High Availability
IBM Think 2018: IBM MQ High AvailabilityIBM Think 2018: IBM MQ High Availability
IBM Think 2018: IBM MQ High Availability
Jamie Squibb
 
Developing Integrations for IBM Integration Bus on Cloud
Developing Integrations for IBM Integration Bus on CloudDeveloping Integrations for IBM Integration Bus on Cloud
Developing Integrations for IBM Integration Bus on Cloud
Geza Geleji
 
CloudHub Connector With Mulesoft
CloudHub Connector With MulesoftCloudHub Connector With Mulesoft
CloudHub Connector With Mulesoft
Jitendra Bafna
 
FORUM PA 2015 - Microservices with IBM Bluemix
FORUM PA 2015 - Microservices with IBM BluemixFORUM PA 2015 - Microservices with IBM Bluemix
FORUM PA 2015 - Microservices with IBM Bluemix
gjuljo
 
MQ Guide France - IBM MQ and Containers
MQ Guide France - IBM MQ and ContainersMQ Guide France - IBM MQ and Containers
MQ Guide France - IBM MQ and Containers
Robert Parker
 
Hybrid Cloud: How to Get a Return from an Investment Made Three Decades Ago (...
Hybrid Cloud: How to Get a Return from an Investment Made Three Decades Ago (...Hybrid Cloud: How to Get a Return from an Investment Made Three Decades Ago (...
Hybrid Cloud: How to Get a Return from an Investment Made Three Decades Ago (...
Michael Elder
 
Biztalk vs mulesoft
Biztalk vs mulesoft Biztalk vs mulesoft
Biztalk vs mulesoft
Bui Kiet
 

Similar to GWC : MQ Light - from monolith to Microservices for speed and scale (20)

Introducing IBM Message Hub: Cloud-scale messaging based on Apache Kafka
Introducing IBM Message Hub: Cloud-scale messaging based on Apache KafkaIntroducing IBM Message Hub: Cloud-scale messaging based on Apache Kafka
Introducing IBM Message Hub: Cloud-scale messaging based on Apache Kafka
Andrew Schofield
 
Mq light, mq, and bluemix web sphere user group july 2015
Mq light, mq, and bluemix   web sphere user group july 2015Mq light, mq, and bluemix   web sphere user group july 2015
Mq light, mq, and bluemix web sphere user group july 2015
matthew1001
 
CTU 2017 - I168 IBM MQ in the cloud
CTU 2017 - I168 IBM MQ in the cloudCTU 2017 - I168 IBM MQ in the cloud
CTU 2017 - I168 IBM MQ in the cloud
Robert Parker
 
Interconnect 2017: 6885 Deploying IBM MQ in the cloud
Interconnect 2017: 6885 Deploying IBM MQ in the cloudInterconnect 2017: 6885 Deploying IBM MQ in the cloud
Interconnect 2017: 6885 Deploying IBM MQ in the cloud
Robert Parker
 
AME-1936 : Enterprise Messaging for Next-Generation Core Banking
AME-1936 : Enterprise Messaging for Next-Generation Core BankingAME-1936 : Enterprise Messaging for Next-Generation Core Banking
AME-1936 : Enterprise Messaging for Next-Generation Core Banking
wangbo626
 
IBM MQ cloud architecture blueprint
IBM MQ cloud architecture blueprintIBM MQ cloud architecture blueprint
IBM MQ cloud architecture blueprint
Matt Roberts
 
The Overview of Microservices Architecture
The Overview of Microservices ArchitectureThe Overview of Microservices Architecture
The Overview of Microservices Architecture
Paria Heidari
 
Understanding mq deployment choices and use cases
Understanding mq deployment choices and use casesUnderstanding mq deployment choices and use cases
Understanding mq deployment choices and use cases
Leif Davidsen
 
Serverless microservices
Serverless microservicesServerless microservices
Serverless microservices
Lalit Kale
 
Cloudy with SaaS-Shine 18march2015
Cloudy with SaaS-Shine 18march2015Cloudy with SaaS-Shine 18march2015
Cloudy with SaaS-Shine 18march2015
Simon Baker
 
Microservices and IBM Bluemix meetup presentation
Microservices and IBM Bluemix meetup presentationMicroservices and IBM Bluemix meetup presentation
Microservices and IBM Bluemix meetup presentation
Carlos Ferreira
 
Reality Check: Moving From the Transformation Laboratory to Production
Reality Check: Moving From the Transformation Laboratory to ProductionReality Check: Moving From the Transformation Laboratory to Production
Reality Check: Moving From the Transformation Laboratory to Production
DevOps.com
 
IBM Message Hub service in Bluemix - Apache Kafka in a public cloud
IBM Message Hub service in Bluemix - Apache Kafka in a public cloudIBM Message Hub service in Bluemix - Apache Kafka in a public cloud
IBM Message Hub service in Bluemix - Apache Kafka in a public cloud
Andrew Schofield
 
IBM Messaging in the Cloud
IBM Messaging in the CloudIBM Messaging in the Cloud
IBM Messaging in the Cloud
matthew1001
 
Extending The Power Of Anypoint Platform Using Anypoint Service Mesh
Extending The Power Of Anypoint Platform Using Anypoint Service MeshExtending The Power Of Anypoint Platform Using Anypoint Service Mesh
Extending The Power Of Anypoint Platform Using Anypoint Service Mesh
AaronLieberman5
 
Perth meetup Oct 2019
Perth meetup Oct 2019Perth meetup Oct 2019
Perth meetup Oct 2019
Zubair Aslam
 
App Modernization
App ModernizationApp Modernization
App Modernization
PT Datacomm Diangraha
 
IBM Lightning Talk
IBM Lightning TalkIBM Lightning Talk
IBM Lightning Talk
MongoDB
 
"The Cloud Native Enterprise is Coming"
"The Cloud Native Enterprise is Coming" "The Cloud Native Enterprise is Coming"
"The Cloud Native Enterprise is Coming"
James Watters
 
Ame 4166 ibm mq appliance
Ame 4166 ibm mq applianceAme 4166 ibm mq appliance
Ame 4166 ibm mq appliance
Andrew Schofield
 
Introducing IBM Message Hub: Cloud-scale messaging based on Apache Kafka
Introducing IBM Message Hub: Cloud-scale messaging based on Apache KafkaIntroducing IBM Message Hub: Cloud-scale messaging based on Apache Kafka
Introducing IBM Message Hub: Cloud-scale messaging based on Apache Kafka
Andrew Schofield
 
Mq light, mq, and bluemix web sphere user group july 2015
Mq light, mq, and bluemix   web sphere user group july 2015Mq light, mq, and bluemix   web sphere user group july 2015
Mq light, mq, and bluemix web sphere user group july 2015
matthew1001
 
CTU 2017 - I168 IBM MQ in the cloud
CTU 2017 - I168 IBM MQ in the cloudCTU 2017 - I168 IBM MQ in the cloud
CTU 2017 - I168 IBM MQ in the cloud
Robert Parker
 
Interconnect 2017: 6885 Deploying IBM MQ in the cloud
Interconnect 2017: 6885 Deploying IBM MQ in the cloudInterconnect 2017: 6885 Deploying IBM MQ in the cloud
Interconnect 2017: 6885 Deploying IBM MQ in the cloud
Robert Parker
 
AME-1936 : Enterprise Messaging for Next-Generation Core Banking
AME-1936 : Enterprise Messaging for Next-Generation Core BankingAME-1936 : Enterprise Messaging for Next-Generation Core Banking
AME-1936 : Enterprise Messaging for Next-Generation Core Banking
wangbo626
 
IBM MQ cloud architecture blueprint
IBM MQ cloud architecture blueprintIBM MQ cloud architecture blueprint
IBM MQ cloud architecture blueprint
Matt Roberts
 
The Overview of Microservices Architecture
The Overview of Microservices ArchitectureThe Overview of Microservices Architecture
The Overview of Microservices Architecture
Paria Heidari
 
Understanding mq deployment choices and use cases
Understanding mq deployment choices and use casesUnderstanding mq deployment choices and use cases
Understanding mq deployment choices and use cases
Leif Davidsen
 
Serverless microservices
Serverless microservicesServerless microservices
Serverless microservices
Lalit Kale
 
Cloudy with SaaS-Shine 18march2015
Cloudy with SaaS-Shine 18march2015Cloudy with SaaS-Shine 18march2015
Cloudy with SaaS-Shine 18march2015
Simon Baker
 
Microservices and IBM Bluemix meetup presentation
Microservices and IBM Bluemix meetup presentationMicroservices and IBM Bluemix meetup presentation
Microservices and IBM Bluemix meetup presentation
Carlos Ferreira
 
Reality Check: Moving From the Transformation Laboratory to Production
Reality Check: Moving From the Transformation Laboratory to ProductionReality Check: Moving From the Transformation Laboratory to Production
Reality Check: Moving From the Transformation Laboratory to Production
DevOps.com
 
IBM Message Hub service in Bluemix - Apache Kafka in a public cloud
IBM Message Hub service in Bluemix - Apache Kafka in a public cloudIBM Message Hub service in Bluemix - Apache Kafka in a public cloud
IBM Message Hub service in Bluemix - Apache Kafka in a public cloud
Andrew Schofield
 
IBM Messaging in the Cloud
IBM Messaging in the CloudIBM Messaging in the Cloud
IBM Messaging in the Cloud
matthew1001
 
Extending The Power Of Anypoint Platform Using Anypoint Service Mesh
Extending The Power Of Anypoint Platform Using Anypoint Service MeshExtending The Power Of Anypoint Platform Using Anypoint Service Mesh
Extending The Power Of Anypoint Platform Using Anypoint Service Mesh
AaronLieberman5
 
Perth meetup Oct 2019
Perth meetup Oct 2019Perth meetup Oct 2019
Perth meetup Oct 2019
Zubair Aslam
 
IBM Lightning Talk
IBM Lightning TalkIBM Lightning Talk
IBM Lightning Talk
MongoDB
 
"The Cloud Native Enterprise is Coming"
"The Cloud Native Enterprise is Coming" "The Cloud Native Enterprise is Coming"
"The Cloud Native Enterprise is Coming"
James Watters
 
Ad

Recently uploaded (20)

Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsTechnology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data Analytics
InData Labs
 
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
BookNet Canada
 
2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptx2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptx
Samuele Fogagnolo
 
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul
 
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxIncreasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Anoop Ashok
 
What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...
Vishnu Singh Chundawat
 
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In FranceManifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
chb3
 
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptxSpecial Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
shyamraj55
 
ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes Partner Innovation Updates for May 2025ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes
 
Mobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi ArabiaMobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi Arabia
Steve Jonas
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Quantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur MorganQuantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur Morgan
Arthur Morgan
 
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveDesigning Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
ScyllaDB
 
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
Alan Dix
 
How analogue intelligence complements AI
How analogue intelligence complements AIHow analogue intelligence complements AI
How analogue intelligence complements AI
Paul Rowe
 
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
organizerofv
 
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Aqusag Technologies
 
Linux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded DevelopersLinux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded Developers
Toradex
 
Rusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond SparkRusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond Spark
carlyakerly1
 
Cybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure ADCybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure AD
VICTOR MAESTRE RAMIREZ
 
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsTechnology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data Analytics
InData Labs
 
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
BookNet Canada
 
2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptx2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptx
Samuele Fogagnolo
 
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul
 
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxIncreasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Anoop Ashok
 
What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...
Vishnu Singh Chundawat
 
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In FranceManifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
chb3
 
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptxSpecial Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
shyamraj55
 
ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes Partner Innovation Updates for May 2025ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes
 
Mobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi ArabiaMobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi Arabia
Steve Jonas
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Quantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur MorganQuantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur Morgan
Arthur Morgan
 
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveDesigning Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
ScyllaDB
 
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
Alan Dix
 
How analogue intelligence complements AI
How analogue intelligence complements AIHow analogue intelligence complements AI
How analogue intelligence complements AI
Paul Rowe
 
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
organizerofv
 
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...
Aqusag Technologies
 
Linux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded DevelopersLinux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded Developers
Toradex
 
Rusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond SparkRusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond Spark
carlyakerly1
 
Cybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure ADCybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure AD
VICTOR MAESTRE RAMIREZ
 
Ad

GWC : MQ Light - from monolith to Microservices for speed and scale

  • 1. © 2015 IBM Corporation1 IBM MQ Light : From monolith to microservices for speed and scale Alan Chatt Product Manager IBM Messaging [email protected]
  • 2. 2 © 2015 IBM Corporation Agenda • Microservices : what & why • MQ Light messaging for Microservices • How are others doing microservices
  • 3. 3 © 2015 IBM Corporation Microservices Development teams Delivering elastically scalable, distributed applications with unprecedented agility using a microservices architecture Agility comes from : “2 pizza” teams operating completely independently, owning the whole technology stack, deploying on their own schedules, writing and owning services that will scale when demand dictates Not without challenges : • Fallacies of distributed computing • Operational overhead increases with the number of services to deploy • New skills and tooling required to cope with additional complexities 3
  • 4. 4 © 2015 IBM Corporation Motivations : Rate of change More local changes More GitHub check-ins Changes go all the way to Production
  • 5. 5 © 2015 IBM Corporation Motivations : Flexibility
  • 6. 6 © 2015 IBM Corporation Motivations : Resilience Communication can: 1) Re-route 2) Stored for future delivery 3) Return cached/out of date data 1 2 3
  • 7. 7 © 2015 IBM Corporation Motivations : Scale Steady state Workload increases Individual components scale up as required
  • 8. 8 © 2015 IBM Corporation Migrating from a monolith • When & why • Do it because you need to evolve rapidly • Don’t just re-write • Chip away at bits and improve • Techniques • Emit events from existing application • Surround with simple service interfaces that you can call Monolithic Application
  • 9. 9 © 2015 IBM Corporation A few words of caution Some wisdom shared by people in the trenches : • Do not start a new implementation with microservices • Master dev-ops before starting a microservices deployment • Cleanly separate platform services from the application • Do not rush into creating too many microservices
  • 10. 10 © 2015 IBM Corporation MQ Light Messaging for microservices
  • 11. 11 © 2015 IBM Corporation MQ Light : Software and Cloud • Messaging that application developers will love to use, helping them make responsive applications that scale easily • 3 ways to get it: • Bluemix service • MQ Light software download • MQ Light API support in MQ (Beta) • Open APIs crafted to feel natural in a growing range of popular languages • Tooling that makes modular app development easy 11
  • 12. 12 © 2015 IBM Corporation Messaging patterns for loose coupling Worker offload • Image processing • Text analytics Multiple service instances use a shared destination • Service scaled up by adding an instance • MQ Light will start to distribute work to new instance • Service scaled down by “killing” an instance • MQ Light will stop distributing work to that instance and will re- distribute unacknowledged messages • Service can rate limit inbound work • Use link credit to restrict amount of work currently being processed
  • 13. 13 © 2015 IBM Corporation Messaging patterns for loose coupling Event driven / Fire and forget • Posting video to multiple social sites after transcoding • Respond to external events Using multiple MQ Light destinations subscribed to the same topic • Cuts down unnecessary “polling” traffic between services • Deploying multiple versions of a service simultaneously • Allows duel running for a period of time • Create new extensions driven by existing data • New subscribers just listen to an existing topic, no need to update publisher • i.e. create new service which performs analytics on existing data flows
  • 14. 14 © 2015 IBM Corporation Messaging for loose coupling • Isolating your application from the availability and performance of an external system • Replace part of existing system by intercepting events and running new logic • MQ Light API support in MQ • Subscribe to data already flowing between existing systems Connecting external systems • Updating external booking system • Running logic when existing CRM system updates contact address
  • 15. 15 © 2015 IBM Corporation Using open standards for technology freedom • Using AMQP1.0 as standard protocol • Open source clients from the Apache Qpid Proton project • Example for this for PHP : https://developer.ibm.com/messaging/2014/07/01/using-php-mq-light-bluemix/ • Easily Integrated with microservices frameworks : https://developer.ibm.com/messaging/2015/05/06/microservices-with-seneca-and-mq-light/ • MQ Light specific clients reduce quantity and complexity of code • Node.js, Java, Ruby, Python
  • 16. 16 © 2015 IBM Corporation Designed for development • MQ Light download quick and easy to run on a laptop • Works well with Vagrant & Docker https://hub.docker.com/r/ibmcom/mqlight/ • No configuration : applications define behaviour • MQ Light tooling designed for developers
  • 17. 17 © 2015 IBM Corporation Deployment Options 17 MQ Light Service for Bluemix [Managed Service] WebSphere MQ [open Beta] “MQ Light”
  • 18. 18 © 2015 IBM Corporation Presence Insights Adopting Microservices within IBM
  • 19. 19 © 2015 IBM Corporation IBM Presence Insights Bring the same personalized shopping experience you get online to “bricks and mortar” stores IBM SaaS offering built on the cloud using microservices
  • 20. 20 © 2015 IBM Corporation Technologies used by Presence Insights
  • 21. 21 © 2015 IBM Corporation Presence Insights : Today • 22+ Microservices • 70+ Node.js instances • Application deployed across Bluemix and Softlayer • Node.js (Web Tier) • MQ Light (Messaging) • Cloudant (Persistence) • Redis (Caching) • D3 (Charting)
  • 22. 22 © 2015 IBM Corporation Presence Insights : Architecture
  • 23. 23 © 2015 IBM Corporation Presence Insights : Use of MQ Light • PI use the MQ Light service in Bluemix for communication between their microservices, using both worker offload and event driven patterns • Wildcards : Feeding many separate streams of data to multiple services • ClientID : Audit trail of which service instances receives which event • Destination Sharing : Built in load balancer • Advantage of managed MQ Light service : “…the team does not need to manage the instances themselves (security compliance and operating system monitoring/management)” “MQLight as a managed service is a key element to our Presence Insights strategy. The capabilities that are provided in the Node.js client libraries and the MQLight service instance provides a great foundation for our messaging system around publishing and subscribing to our location sensor events”
  • 24. 24 © 2015 IBM Corporation Presence Insights : Lessons learned • Streamlining the build & deployment pipeline is critical • Developers need to be able to push changed and demo them in the cloud environment • Continuous and holistic testing combats the additional complexities of a distributed application • Tests run at each level act as gate for changes to be promoted • End to end tests run every 10 minutes against all environments • These End to end tests ensure platform services (i.e. Cloudant and MQ Light) • PI experiment before switching to node.js and current technology stack • Time boxing experimentation is essential
  • 25. 25 © 2015 IBM Corporation Summary
  • 26. 26 © 2015 IBM Corporation Summary • Microservices is a great architecture for large, rapidly evolving applications that need to scale • Not a silver bullet that solves all problems • Using asynchronous messaging patterns between services supports the goals of a microservice architecture • Provide workload balancing when scaling up and down • Provides loose coupling, promoting resilience • MQ Light works well in a dev-ops environment, essential for making a microservice architecture work well • Offline development • Application defined behaviour, no separate configuration to manage
  • 27. 27 © 2015 IBM Corporation Resources • Bluemix PaaS : https://console.ng.bluemix.net/ • MQ Light : https://developer.ibm.com/messaging/mq-light/ • Redbook : Microservices from Theory to Practice https://www.redbooks.ibm.com/redbooks.nsf/RedpieceAbstracts/sg248275.html