SlideShare a Scribd company logo
© 2017 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
Rule-based dispatching of events
to a serverless services armada
Daniel Buchholz
Dev Manager / Cloud Architect - Düsseldorf
@danbdo
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
GHX is all about supplier chain processes in healthcare
Hospitals
Groups
Suppliers
Mfr‘s
Distributors
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
What‘s was the problem, anyway?
Public Domain, https://commons.wikimedia.org/w/index.php?curid=868126
Individual catalog systems in all
(current) target markets
Each with different schema
All supposed to talk to each other
All doing a reasonably similar job
Operational efficiencies
Mappings / Conversions
Expandability
Catalog management
© 2017 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
Legacy systems
this
that
More
stuff
Squeezed
in...
WHOA!
add
modify
delete
Legacy catalog processing
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
The Path Forward
consume
process
report
CSV Source type A
Source type BGS1
XML
JSON
Source type C
Suppliers
Groups
Hospitals
InboundConsumers/Processing
...
...
...
...
BI BI
...
...
...
...
...
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
The Path Forward
consume
process
report
CSV Source type A
Source type BGS1
XML
JSON
Source type C
Suppliers
Groups
Hospitals
InboundConsumers/Processing
...
...
...
...
BI BI
...
...
...
...
...
ETL
Queueing / Mapping / Routing
Single Source Of Truth
events
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
Consumers/Processing
Deep dive
consume
process
report
CSV Source type A
Source type BGS1
XML
JSON
Source type C
Suppliers
Groups
Hospitals
Inbound
...
...
...
...
BI BI
...
...
...
...
...
ETL
Queueing / Mapping / Routing
Single Source Of Truth
events
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
„Each with different schema“
Catalog A
Att A: abc
Att B: def
Att C: ghi
Att D: jkl
Catalog B
Att P: 4711
Att B: blah
Att D: stuff
Catalog C
Att W: key1
Att X: key2
Att Y: foo
Att Z: bar
>> Schema-less data store
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
„Each with different schema“
Catalog A
Att A: abc
Att B: def
Att C: ghi
Att D: jkl
Pkey: hash(A)
Catalog B
Att P: 4711
Att B: blah
Att D: stuff
Pkey: hash(P)
Catalog C
Att W: key1
Att X: key2
Att Y: foo
Att Z: bar
Pkey:hash(W/X)
>> Infer internal Pkey values
>> DynamoDB
>> Schema-less data store
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
ETL
files de-dup delta
Item hash
Item
events
map
Item key
Schema
very specific very generic
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
Consumers/Processing
Deep dive
consume
process
report
CSV Source type A
Source type BGS1
XML
JSON
Source type C
Suppliers
Groups
Hospitals
Inbound
...
...
...
...
BI BI
...
...
...
...
...
ETL
Queueing / Mapping / Routing
Single Source Of Truth
events
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
Dispatching item events
catalog data
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
Don‘t want to deploy full stack for each change
Dispatching item events
catalog data
Dispatcher
Function
„All doing a reasonably similar job“
>> Migrate tasks from legacy
>> Keep it open to changes
>> Static workflows wouldn‘t work
>> need rules engine
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
Dispatcher Config
catalog data
Dispatcher
Function Dispatcher
Config Store
2 - Description
1 - Name
3 - Conditions
4 – Action(s)
success / failure
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
Dispatcher Services
catalog data
Dispatcher
Function Dispatcher
Config Store
...Svc A Svc DSvc B Svc C
Search..
Engines
A Dispatcher – not a Broker >> fire & forgetHighly de-coupled
>> limit blast radius
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
Dispatcher Endpoints
catalog data
Dispatcher
Function Dispatcher
Config Store
...Svc A Svc DSvc B Svc C
Search..
Engines
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
Audits / Traces
v4 v3/v4 v2/v3 v1/v2 v0/v1
OPS teams need visibility >> full audit / full trace
DEV probably too
live audit
Causes & Effects
Svc A trace
Svc B trace
Consumer X
Consumer Y
Svc B trace
Svc C trace
Consumer Y
Svc A trace
BI A
BI B
Consumer X
Svc A trace
Svc B trace
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
Core Services
catalog data
Dispatcher
Function
...Svc A Svc DSvc B Svc C
Search..
Engines
Audit log
Trace log
Core Services
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
Versioning/Deployment options
80/20
Svc A Svc D Svc E
Svc E2Svc A2
In your face
Svc D2
Traffic shifting Parallel / Audit
© 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute.
So...
This is our architecture
Happy to hear feedback
Ad

More Related Content

Similar to Rule-based dispatching of events to a serverless services armada (20)

Enterprise Data Lakes
Enterprise Data LakesEnterprise Data Lakes
Enterprise Data Lakes
Farid Gurbanov
 
Hortonworks Technical Workshop: What's New in HDP 2.3
Hortonworks Technical Workshop: What's New in HDP 2.3Hortonworks Technical Workshop: What's New in HDP 2.3
Hortonworks Technical Workshop: What's New in HDP 2.3
Hortonworks
 
Hive 3 a new horizon
Hive 3  a new horizonHive 3  a new horizon
Hive 3 a new horizon
Abdelkrim Hadjidj
 
MySQL Document Store (Oracle Code Warsaw 2018)
MySQL Document Store (Oracle Code Warsaw 2018)MySQL Document Store (Oracle Code Warsaw 2018)
MySQL Document Store (Oracle Code Warsaw 2018)
Vittorio Cioe
 
Hive 3 - a new horizon
Hive 3 - a new horizonHive 3 - a new horizon
Hive 3 - a new horizon
Thejas Nair
 
INV_Convergence_Webinar.pdf
INV_Convergence_Webinar.pdfINV_Convergence_Webinar.pdf
INV_Convergence_Webinar.pdf
Bala Alwar
 
Oracle Code Event - MySQL JSON Document Store
Oracle Code Event - MySQL JSON Document StoreOracle Code Event - MySQL JSON Document Store
Oracle Code Event - MySQL JSON Document Store
Mark Swarbrick
 
Industrial IoT bootcamp
Industrial IoT bootcampIndustrial IoT bootcamp
Industrial IoT bootcamp
Lothar Schubert
 
One bridge to connect them all. Oracle GoldenGate for Big Data.UKOUG Tech 2018
One bridge to connect them all. Oracle GoldenGate for Big Data.UKOUG Tech 2018One bridge to connect them all. Oracle GoldenGate for Big Data.UKOUG Tech 2018
One bridge to connect them all. Oracle GoldenGate for Big Data.UKOUG Tech 2018
Gleb Otochkin
 
Melbourne: Certus Data 2.0 Vault Meetup with Snowflake - Data Vault In The Cl...
Melbourne: Certus Data 2.0 Vault Meetup with Snowflake - Data Vault In The Cl...Melbourne: Certus Data 2.0 Vault Meetup with Snowflake - Data Vault In The Cl...
Melbourne: Certus Data 2.0 Vault Meetup with Snowflake - Data Vault In The Cl...
Certus Solutions
 
Analysis of historical movie data by BHADRA
Analysis of historical movie data by BHADRAAnalysis of historical movie data by BHADRA
Analysis of historical movie data by BHADRA
Bhadra Gowdra
 
From Mainframe to Microservices with Pivotal Platform and Kafka: Bridging the...
From Mainframe to Microservices with Pivotal Platform and Kafka: Bridging the...From Mainframe to Microservices with Pivotal Platform and Kafka: Bridging the...
From Mainframe to Microservices with Pivotal Platform and Kafka: Bridging the...
VMware Tanzu
 
Apache Flink Adoption at Shopify
Apache Flink Adoption at ShopifyApache Flink Adoption at Shopify
Apache Flink Adoption at Shopify
Yaroslav Tkachenko
 
Pivotal Big Data Suite: A Technical Overview
Pivotal Big Data Suite: A Technical OverviewPivotal Big Data Suite: A Technical Overview
Pivotal Big Data Suite: A Technical Overview
VMware Tanzu
 
The Role of Blockchain in Enterprise Commerce and Product Content Management
The Role of Blockchain in Enterprise Commerce and Product Content ManagementThe Role of Blockchain in Enterprise Commerce and Product Content Management
The Role of Blockchain in Enterprise Commerce and Product Content Management
SAP Customer Experience
 
Integration Patterns for Big Data Applications
Integration Patterns for Big Data ApplicationsIntegration Patterns for Big Data Applications
Integration Patterns for Big Data Applications
Michael Häusler
 
SAP HANA SPS10- Enterprise Information Management
SAP HANA SPS10- Enterprise Information ManagementSAP HANA SPS10- Enterprise Information Management
SAP HANA SPS10- Enterprise Information Management
SAP Technology
 
Pentaho big data camp - 5 min
Pentaho   big data camp - 5 minPentaho   big data camp - 5 min
Pentaho big data camp - 5 min
ianfyfe
 
Apache kylin 2.0: from classic olap to real-time data warehouse
Apache kylin 2.0: from classic olap to real-time data warehouseApache kylin 2.0: from classic olap to real-time data warehouse
Apache kylin 2.0: from classic olap to real-time data warehouse
Yang Li
 
Pivotal Digital Transformation Forum: Journey to Become a Data-Driven Enterprise
Pivotal Digital Transformation Forum: Journey to Become a Data-Driven EnterprisePivotal Digital Transformation Forum: Journey to Become a Data-Driven Enterprise
Pivotal Digital Transformation Forum: Journey to Become a Data-Driven Enterprise
VMware Tanzu
 
Hortonworks Technical Workshop: What's New in HDP 2.3
Hortonworks Technical Workshop: What's New in HDP 2.3Hortonworks Technical Workshop: What's New in HDP 2.3
Hortonworks Technical Workshop: What's New in HDP 2.3
Hortonworks
 
MySQL Document Store (Oracle Code Warsaw 2018)
MySQL Document Store (Oracle Code Warsaw 2018)MySQL Document Store (Oracle Code Warsaw 2018)
MySQL Document Store (Oracle Code Warsaw 2018)
Vittorio Cioe
 
Hive 3 - a new horizon
Hive 3 - a new horizonHive 3 - a new horizon
Hive 3 - a new horizon
Thejas Nair
 
INV_Convergence_Webinar.pdf
INV_Convergence_Webinar.pdfINV_Convergence_Webinar.pdf
INV_Convergence_Webinar.pdf
Bala Alwar
 
Oracle Code Event - MySQL JSON Document Store
Oracle Code Event - MySQL JSON Document StoreOracle Code Event - MySQL JSON Document Store
Oracle Code Event - MySQL JSON Document Store
Mark Swarbrick
 
One bridge to connect them all. Oracle GoldenGate for Big Data.UKOUG Tech 2018
One bridge to connect them all. Oracle GoldenGate for Big Data.UKOUG Tech 2018One bridge to connect them all. Oracle GoldenGate for Big Data.UKOUG Tech 2018
One bridge to connect them all. Oracle GoldenGate for Big Data.UKOUG Tech 2018
Gleb Otochkin
 
Melbourne: Certus Data 2.0 Vault Meetup with Snowflake - Data Vault In The Cl...
Melbourne: Certus Data 2.0 Vault Meetup with Snowflake - Data Vault In The Cl...Melbourne: Certus Data 2.0 Vault Meetup with Snowflake - Data Vault In The Cl...
Melbourne: Certus Data 2.0 Vault Meetup with Snowflake - Data Vault In The Cl...
Certus Solutions
 
Analysis of historical movie data by BHADRA
Analysis of historical movie data by BHADRAAnalysis of historical movie data by BHADRA
Analysis of historical movie data by BHADRA
Bhadra Gowdra
 
From Mainframe to Microservices with Pivotal Platform and Kafka: Bridging the...
From Mainframe to Microservices with Pivotal Platform and Kafka: Bridging the...From Mainframe to Microservices with Pivotal Platform and Kafka: Bridging the...
From Mainframe to Microservices with Pivotal Platform and Kafka: Bridging the...
VMware Tanzu
 
Apache Flink Adoption at Shopify
Apache Flink Adoption at ShopifyApache Flink Adoption at Shopify
Apache Flink Adoption at Shopify
Yaroslav Tkachenko
 
Pivotal Big Data Suite: A Technical Overview
Pivotal Big Data Suite: A Technical OverviewPivotal Big Data Suite: A Technical Overview
Pivotal Big Data Suite: A Technical Overview
VMware Tanzu
 
The Role of Blockchain in Enterprise Commerce and Product Content Management
The Role of Blockchain in Enterprise Commerce and Product Content ManagementThe Role of Blockchain in Enterprise Commerce and Product Content Management
The Role of Blockchain in Enterprise Commerce and Product Content Management
SAP Customer Experience
 
Integration Patterns for Big Data Applications
Integration Patterns for Big Data ApplicationsIntegration Patterns for Big Data Applications
Integration Patterns for Big Data Applications
Michael Häusler
 
SAP HANA SPS10- Enterprise Information Management
SAP HANA SPS10- Enterprise Information ManagementSAP HANA SPS10- Enterprise Information Management
SAP HANA SPS10- Enterprise Information Management
SAP Technology
 
Pentaho big data camp - 5 min
Pentaho   big data camp - 5 minPentaho   big data camp - 5 min
Pentaho big data camp - 5 min
ianfyfe
 
Apache kylin 2.0: from classic olap to real-time data warehouse
Apache kylin 2.0: from classic olap to real-time data warehouseApache kylin 2.0: from classic olap to real-time data warehouse
Apache kylin 2.0: from classic olap to real-time data warehouse
Yang Li
 
Pivotal Digital Transformation Forum: Journey to Become a Data-Driven Enterprise
Pivotal Digital Transformation Forum: Journey to Become a Data-Driven EnterprisePivotal Digital Transformation Forum: Journey to Become a Data-Driven Enterprise
Pivotal Digital Transformation Forum: Journey to Become a Data-Driven Enterprise
VMware Tanzu
 

Recently uploaded (20)

Solidworks Crack 2025 latest new + license code
Solidworks Crack 2025 latest new + license codeSolidworks Crack 2025 latest new + license code
Solidworks Crack 2025 latest new + license code
aneelaramzan63
 
Microsoft AI Nonprofit Use Cases and Live Demo_2025.04.30.pdf
Microsoft AI Nonprofit Use Cases and Live Demo_2025.04.30.pdfMicrosoft AI Nonprofit Use Cases and Live Demo_2025.04.30.pdf
Microsoft AI Nonprofit Use Cases and Live Demo_2025.04.30.pdf
TechSoup
 
Adobe Lightroom Classic Crack FREE Latest link 2025
Adobe Lightroom Classic Crack FREE Latest link 2025Adobe Lightroom Classic Crack FREE Latest link 2025
Adobe Lightroom Classic Crack FREE Latest link 2025
kashifyounis067
 
Secure Test Infrastructure: The Backbone of Trustworthy Software Development
Secure Test Infrastructure: The Backbone of Trustworthy Software DevelopmentSecure Test Infrastructure: The Backbone of Trustworthy Software Development
Secure Test Infrastructure: The Backbone of Trustworthy Software Development
Shubham Joshi
 
Salesforce Data Cloud- Hyperscale data platform, built for Salesforce.
Salesforce Data Cloud- Hyperscale data platform, built for Salesforce.Salesforce Data Cloud- Hyperscale data platform, built for Salesforce.
Salesforce Data Cloud- Hyperscale data platform, built for Salesforce.
Dele Amefo
 
How to Batch Export Lotus Notes NSF Emails to Outlook PST Easily?
How to Batch Export Lotus Notes NSF Emails to Outlook PST Easily?How to Batch Export Lotus Notes NSF Emails to Outlook PST Easily?
How to Batch Export Lotus Notes NSF Emails to Outlook PST Easily?
steaveroggers
 
Adobe Marketo Engage Champion Deep Dive - SFDC CRM Synch V2 & Usage Dashboards
Adobe Marketo Engage Champion Deep Dive - SFDC CRM Synch V2 & Usage DashboardsAdobe Marketo Engage Champion Deep Dive - SFDC CRM Synch V2 & Usage Dashboards
Adobe Marketo Engage Champion Deep Dive - SFDC CRM Synch V2 & Usage Dashboards
BradBedford3
 
TestMigrationsInPy: A Dataset of Test Migrations from Unittest to Pytest (MSR...
TestMigrationsInPy: A Dataset of Test Migrations from Unittest to Pytest (MSR...TestMigrationsInPy: A Dataset of Test Migrations from Unittest to Pytest (MSR...
TestMigrationsInPy: A Dataset of Test Migrations from Unittest to Pytest (MSR...
Andre Hora
 
Societal challenges of AI: biases, multilinguism and sustainability
Societal challenges of AI: biases, multilinguism and sustainabilitySocietal challenges of AI: biases, multilinguism and sustainability
Societal challenges of AI: biases, multilinguism and sustainability
Jordi Cabot
 
Explaining GitHub Actions Failures with Large Language Models Challenges, In...
Explaining GitHub Actions Failures with Large Language Models Challenges, In...Explaining GitHub Actions Failures with Large Language Models Challenges, In...
Explaining GitHub Actions Failures with Large Language Models Challenges, In...
ssuserb14185
 
EASEUS Partition Master Crack + License Code
EASEUS Partition Master Crack + License CodeEASEUS Partition Master Crack + License Code
EASEUS Partition Master Crack + License Code
aneelaramzan63
 
Meet the Agents: How AI Is Learning to Think, Plan, and Collaborate
Meet the Agents: How AI Is Learning to Think, Plan, and CollaborateMeet the Agents: How AI Is Learning to Think, Plan, and Collaborate
Meet the Agents: How AI Is Learning to Think, Plan, and Collaborate
Maxim Salnikov
 
Maxon CINEMA 4D 2025 Crack FREE Download LINK
Maxon CINEMA 4D 2025 Crack FREE Download LINKMaxon CINEMA 4D 2025 Crack FREE Download LINK
Maxon CINEMA 4D 2025 Crack FREE Download LINK
younisnoman75
 
Exploring Wayland: A Modern Display Server for the Future
Exploring Wayland: A Modern Display Server for the FutureExploring Wayland: A Modern Display Server for the Future
Exploring Wayland: A Modern Display Server for the Future
ICS
 
F-Secure Freedome VPN 2025 Crack Plus Activation New Version
F-Secure Freedome VPN 2025 Crack Plus Activation  New VersionF-Secure Freedome VPN 2025 Crack Plus Activation  New Version
F-Secure Freedome VPN 2025 Crack Plus Activation New Version
saimabibi60507
 
Download Wondershare Filmora Crack [2025] With Latest
Download Wondershare Filmora Crack [2025] With LatestDownload Wondershare Filmora Crack [2025] With Latest
Download Wondershare Filmora Crack [2025] With Latest
tahirabibi60507
 
Why Orangescrum Is a Game Changer for Construction Companies in 2025
Why Orangescrum Is a Game Changer for Construction Companies in 2025Why Orangescrum Is a Game Changer for Construction Companies in 2025
Why Orangescrum Is a Game Changer for Construction Companies in 2025
Orangescrum
 
Pixologic ZBrush Crack Plus Activation Key [Latest 2025] New Version
Pixologic ZBrush Crack Plus Activation Key [Latest 2025] New VersionPixologic ZBrush Crack Plus Activation Key [Latest 2025] New Version
Pixologic ZBrush Crack Plus Activation Key [Latest 2025] New Version
saimabibi60507
 
What Do Contribution Guidelines Say About Software Testing? (MSR 2025)
What Do Contribution Guidelines Say About Software Testing? (MSR 2025)What Do Contribution Guidelines Say About Software Testing? (MSR 2025)
What Do Contribution Guidelines Say About Software Testing? (MSR 2025)
Andre Hora
 
Requirements in Engineering AI- Enabled Systems: Open Problems and Safe AI Sy...
Requirements in Engineering AI- Enabled Systems: Open Problems and Safe AI Sy...Requirements in Engineering AI- Enabled Systems: Open Problems and Safe AI Sy...
Requirements in Engineering AI- Enabled Systems: Open Problems and Safe AI Sy...
Lionel Briand
 
Solidworks Crack 2025 latest new + license code
Solidworks Crack 2025 latest new + license codeSolidworks Crack 2025 latest new + license code
Solidworks Crack 2025 latest new + license code
aneelaramzan63
 
Microsoft AI Nonprofit Use Cases and Live Demo_2025.04.30.pdf
Microsoft AI Nonprofit Use Cases and Live Demo_2025.04.30.pdfMicrosoft AI Nonprofit Use Cases and Live Demo_2025.04.30.pdf
Microsoft AI Nonprofit Use Cases and Live Demo_2025.04.30.pdf
TechSoup
 
Adobe Lightroom Classic Crack FREE Latest link 2025
Adobe Lightroom Classic Crack FREE Latest link 2025Adobe Lightroom Classic Crack FREE Latest link 2025
Adobe Lightroom Classic Crack FREE Latest link 2025
kashifyounis067
 
Secure Test Infrastructure: The Backbone of Trustworthy Software Development
Secure Test Infrastructure: The Backbone of Trustworthy Software DevelopmentSecure Test Infrastructure: The Backbone of Trustworthy Software Development
Secure Test Infrastructure: The Backbone of Trustworthy Software Development
Shubham Joshi
 
Salesforce Data Cloud- Hyperscale data platform, built for Salesforce.
Salesforce Data Cloud- Hyperscale data platform, built for Salesforce.Salesforce Data Cloud- Hyperscale data platform, built for Salesforce.
Salesforce Data Cloud- Hyperscale data platform, built for Salesforce.
Dele Amefo
 
How to Batch Export Lotus Notes NSF Emails to Outlook PST Easily?
How to Batch Export Lotus Notes NSF Emails to Outlook PST Easily?How to Batch Export Lotus Notes NSF Emails to Outlook PST Easily?
How to Batch Export Lotus Notes NSF Emails to Outlook PST Easily?
steaveroggers
 
Adobe Marketo Engage Champion Deep Dive - SFDC CRM Synch V2 & Usage Dashboards
Adobe Marketo Engage Champion Deep Dive - SFDC CRM Synch V2 & Usage DashboardsAdobe Marketo Engage Champion Deep Dive - SFDC CRM Synch V2 & Usage Dashboards
Adobe Marketo Engage Champion Deep Dive - SFDC CRM Synch V2 & Usage Dashboards
BradBedford3
 
TestMigrationsInPy: A Dataset of Test Migrations from Unittest to Pytest (MSR...
TestMigrationsInPy: A Dataset of Test Migrations from Unittest to Pytest (MSR...TestMigrationsInPy: A Dataset of Test Migrations from Unittest to Pytest (MSR...
TestMigrationsInPy: A Dataset of Test Migrations from Unittest to Pytest (MSR...
Andre Hora
 
Societal challenges of AI: biases, multilinguism and sustainability
Societal challenges of AI: biases, multilinguism and sustainabilitySocietal challenges of AI: biases, multilinguism and sustainability
Societal challenges of AI: biases, multilinguism and sustainability
Jordi Cabot
 
Explaining GitHub Actions Failures with Large Language Models Challenges, In...
Explaining GitHub Actions Failures with Large Language Models Challenges, In...Explaining GitHub Actions Failures with Large Language Models Challenges, In...
Explaining GitHub Actions Failures with Large Language Models Challenges, In...
ssuserb14185
 
EASEUS Partition Master Crack + License Code
EASEUS Partition Master Crack + License CodeEASEUS Partition Master Crack + License Code
EASEUS Partition Master Crack + License Code
aneelaramzan63
 
Meet the Agents: How AI Is Learning to Think, Plan, and Collaborate
Meet the Agents: How AI Is Learning to Think, Plan, and CollaborateMeet the Agents: How AI Is Learning to Think, Plan, and Collaborate
Meet the Agents: How AI Is Learning to Think, Plan, and Collaborate
Maxim Salnikov
 
Maxon CINEMA 4D 2025 Crack FREE Download LINK
Maxon CINEMA 4D 2025 Crack FREE Download LINKMaxon CINEMA 4D 2025 Crack FREE Download LINK
Maxon CINEMA 4D 2025 Crack FREE Download LINK
younisnoman75
 
Exploring Wayland: A Modern Display Server for the Future
Exploring Wayland: A Modern Display Server for the FutureExploring Wayland: A Modern Display Server for the Future
Exploring Wayland: A Modern Display Server for the Future
ICS
 
F-Secure Freedome VPN 2025 Crack Plus Activation New Version
F-Secure Freedome VPN 2025 Crack Plus Activation  New VersionF-Secure Freedome VPN 2025 Crack Plus Activation  New Version
F-Secure Freedome VPN 2025 Crack Plus Activation New Version
saimabibi60507
 
Download Wondershare Filmora Crack [2025] With Latest
Download Wondershare Filmora Crack [2025] With LatestDownload Wondershare Filmora Crack [2025] With Latest
Download Wondershare Filmora Crack [2025] With Latest
tahirabibi60507
 
Why Orangescrum Is a Game Changer for Construction Companies in 2025
Why Orangescrum Is a Game Changer for Construction Companies in 2025Why Orangescrum Is a Game Changer for Construction Companies in 2025
Why Orangescrum Is a Game Changer for Construction Companies in 2025
Orangescrum
 
Pixologic ZBrush Crack Plus Activation Key [Latest 2025] New Version
Pixologic ZBrush Crack Plus Activation Key [Latest 2025] New VersionPixologic ZBrush Crack Plus Activation Key [Latest 2025] New Version
Pixologic ZBrush Crack Plus Activation Key [Latest 2025] New Version
saimabibi60507
 
What Do Contribution Guidelines Say About Software Testing? (MSR 2025)
What Do Contribution Guidelines Say About Software Testing? (MSR 2025)What Do Contribution Guidelines Say About Software Testing? (MSR 2025)
What Do Contribution Guidelines Say About Software Testing? (MSR 2025)
Andre Hora
 
Requirements in Engineering AI- Enabled Systems: Open Problems and Safe AI Sy...
Requirements in Engineering AI- Enabled Systems: Open Problems and Safe AI Sy...Requirements in Engineering AI- Enabled Systems: Open Problems and Safe AI Sy...
Requirements in Engineering AI- Enabled Systems: Open Problems and Safe AI Sy...
Lionel Briand
 
Ad

Rule-based dispatching of events to a serverless services armada

  • 1. © 2017 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. Rule-based dispatching of events to a serverless services armada Daniel Buchholz Dev Manager / Cloud Architect - Düsseldorf @danbdo
  • 2. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. GHX is all about supplier chain processes in healthcare Hospitals Groups Suppliers Mfr‘s Distributors
  • 3. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. What‘s was the problem, anyway? Public Domain, https://commons.wikimedia.org/w/index.php?curid=868126 Individual catalog systems in all (current) target markets Each with different schema All supposed to talk to each other All doing a reasonably similar job Operational efficiencies Mappings / Conversions Expandability Catalog management
  • 4. © 2017 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. Legacy systems this that More stuff Squeezed in... WHOA! add modify delete Legacy catalog processing
  • 5. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. The Path Forward consume process report CSV Source type A Source type BGS1 XML JSON Source type C Suppliers Groups Hospitals InboundConsumers/Processing ... ... ... ... BI BI ... ... ... ... ...
  • 6. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. The Path Forward consume process report CSV Source type A Source type BGS1 XML JSON Source type C Suppliers Groups Hospitals InboundConsumers/Processing ... ... ... ... BI BI ... ... ... ... ... ETL Queueing / Mapping / Routing Single Source Of Truth events
  • 7. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. Consumers/Processing Deep dive consume process report CSV Source type A Source type BGS1 XML JSON Source type C Suppliers Groups Hospitals Inbound ... ... ... ... BI BI ... ... ... ... ... ETL Queueing / Mapping / Routing Single Source Of Truth events
  • 8. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. „Each with different schema“ Catalog A Att A: abc Att B: def Att C: ghi Att D: jkl Catalog B Att P: 4711 Att B: blah Att D: stuff Catalog C Att W: key1 Att X: key2 Att Y: foo Att Z: bar >> Schema-less data store
  • 9. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. „Each with different schema“ Catalog A Att A: abc Att B: def Att C: ghi Att D: jkl Pkey: hash(A) Catalog B Att P: 4711 Att B: blah Att D: stuff Pkey: hash(P) Catalog C Att W: key1 Att X: key2 Att Y: foo Att Z: bar Pkey:hash(W/X) >> Infer internal Pkey values >> DynamoDB >> Schema-less data store
  • 10. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. ETL files de-dup delta Item hash Item events map Item key Schema very specific very generic
  • 11. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. Consumers/Processing Deep dive consume process report CSV Source type A Source type BGS1 XML JSON Source type C Suppliers Groups Hospitals Inbound ... ... ... ... BI BI ... ... ... ... ... ETL Queueing / Mapping / Routing Single Source Of Truth events
  • 12. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. Dispatching item events catalog data
  • 13. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. Don‘t want to deploy full stack for each change Dispatching item events catalog data Dispatcher Function „All doing a reasonably similar job“ >> Migrate tasks from legacy >> Keep it open to changes >> Static workflows wouldn‘t work >> need rules engine
  • 14. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. Dispatcher Config catalog data Dispatcher Function Dispatcher Config Store 2 - Description 1 - Name 3 - Conditions 4 – Action(s) success / failure
  • 15. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. Dispatcher Services catalog data Dispatcher Function Dispatcher Config Store ...Svc A Svc DSvc B Svc C Search.. Engines A Dispatcher – not a Broker >> fire & forgetHighly de-coupled >> limit blast radius
  • 16. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. Dispatcher Endpoints catalog data Dispatcher Function Dispatcher Config Store ...Svc A Svc DSvc B Svc C Search.. Engines
  • 17. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. Audits / Traces v4 v3/v4 v2/v3 v1/v2 v0/v1 OPS teams need visibility >> full audit / full trace DEV probably too live audit Causes & Effects Svc A trace Svc B trace Consumer X Consumer Y Svc B trace Svc C trace Consumer Y Svc A trace BI A BI B Consumer X Svc A trace Svc B trace
  • 18. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. Core Services catalog data Dispatcher Function ...Svc A Svc DSvc B Svc C Search.. Engines Audit log Trace log Core Services
  • 19. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. Versioning/Deployment options 80/20 Svc A Svc D Svc E Svc E2Svc A2 In your face Svc D2 Traffic shifting Parallel / Audit
  • 20. © 2018 Global Healthcare Exchange, LLC. All rights reserved. GHX proprietary information. Do not copy or distribute. So... This is our architecture Happy to hear feedback

Editor's Notes

  • #2: „This is our architecture“
  • #3: Just Context
  • #4: + theoretically have to support new(ish) GLOBAL systems that use catalog data from multiple regional CMSs
  • #6: No ZigZag of files!
  • #11: Individual services
  • #13: Thought about calling him JEFF
  • #18: CorellationIDs