SlideShare a Scribd company logo

OMG DDS Tutorial - Part I

Angelo Corsaro
Angelo Corsaro

OMG DDS Tutorial given at the OMG Real-Time Workshop 2009. The full program of the workshop is available here http://bit.ly/vcGCd

1 of 162
Downloaded 390 times
OpenSplice DDS Delivering Performance, Openness, and Freedom Angelo Corsaro, Ph.D. Product Strategy & Marketing Manager OMG DDS Tutorial - Part I OMG RTESS and DDS SIG Co-Chair angelo.corsaro@prismtech.com
Motivating Forces The Standard Agenda Architectural Principles Programming Model Concluding Remarks
The Need for Data Distribution Time Scale Geographical Scale Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Parallelism Determinism Throughput, Availability Scalability, Persistence, Security Systemic Real-Time Near Real-Time Fault- Data Complex Information Signal Information Tolerant Information Processing Processing Management Processing Processing Data Distribution Parallel Systems Distributed Systems © 2009, PrismTech. All Rights Reserved
Data Exchange / Distribution ‣ Network Centric Architectures are emerging as a key trend for next generation military and civil system of systems ‣ Efficient, scalable and QoS-enabled data dissemination is an enabling technology for Network Centric Systems Joint Forces Joint Forces Global Info Grid Global Info Grid Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Adapted from “The Future of AWACS”, by LtCol Joe Chapa The Right Information => To the Right People => At the Right Time © 2009, PrismTech. All Rights Reserved
Motivating Forces The Standard Agenda Architectural Principles Programming Model Concluding Remarks
Addressing Data Distribution Challenges DDS is standard designed to address the data-distribution challenges across The OMG DDS Standard a wide class of Defense and Aerospace Applications ‣ Introduced in 2004 to address the Data Distribution challenges faced by a wide class of Defense and Aerospace Applications Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ Key requirement for the standard were its ability to deliver very high performance while seamlessly scaling from embedded to ultra- large-scale deployments ‣ Today recommended by key administration worldwide and widely adopted across several different application domains, such as, Automated Trading, Simulations, SCADA, Telemetry, etc. © 2009, PrismTech. All Rights Reserved
The OMG Data Distribution Service (DDS) DDS v1.2 API Standard ‣ Language Independent, OS and HW architecture Application independent Object/Relational Mapping ‣ DCPS. Standard API for Data-Centric, Topic- Data Local Reconstruction Layer (DLRL) Based, Real-Time Publish/Subscribe Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Content ‣ Ownership Durability DLRL. Standard API for creating Object Views out Subscription of collection of Topics Minimum Profile Data Centric Publish/Subscribe (DCPS) DDSI/RTPS v2.1 Wire Protocol Standard ‣ Standard wire protocol allowing interoperability Real-Time Publish/Subscribe Protocol DDS Interoperability Wire Protocol between different implementations of the DDS standard UDP/IP © 2009, PrismTech. All Rights Reserved
OMG DDS Recommendations is churning… ! The infrastructure evolution cycle – New -> Emerging -> Standard -> Commodity – Middleware is emerging as Mandated/Recommended by key Administrations OS declines ! …DDS is maturing… ‣ US Navy: Open Architecture focus – OMG – Wire spec Proprietary Information - Distribution without Expressed Written Permission is Prohibited. – Tools ‣ DISR/DISA: Net-centric Systems – Enterprise integration – Multiple products fielded ‣ EuroControl: Air Traffic Control Center Operational – Deployed applications! Interoperability ! …and adoption is on the rise – Navy for VSI ‣ QinetiQ: Recommending DDS – DISR – FCS/SoSCOE – Many significant applications © 2009, PrismTech. All Rights Reserved
OMG DDS Adoptions Adopted by Most Challenging International Programs ‣ US FCS/SOSCOE Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ European Next Generation Flight Data Processor ‣ US ZUMWALT [DDG(1000)] ‣ VTID adopting DDS for the architectural demonstrator © 2009, PrismTech. All Rights Reserved
OMG DDS Applicability Adapted from NSWC-DD Open Architecture Documentation Communication Technologies Standards Web SVCs The DDS is the only technology that spans across Java RTSJ the board. Proprietary Information - Distribution without Expressed Written Permission is Prohibited. JMS It guarantees exceptional real- time behavior, CORBA RT-CORBA while providing unparalleled level OMG Data Distribution Service (DDS) of throughput ! MPI Message Passing Interface Non Real-Time Soft Real-Time Hard Real-Time Extreme Real-Time © 2009, PrismTech. All Rights Reserved
Some DDS Use Cases Defense ‣ Combat Management Systems ‣ Flycatcher system ‣ Unmanned Vehicles (Air + Land) ‣ Tactical Links Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ Radar Processing ‣ Submarine Systems ‣ Future Combat Systems ‣ Simulation SCADA/Utilities ‣ Industrial Automation ‣ Power Grids ‣ Rocket Launch Systems © 2009, PrismTech. All Rights Reserved
Some DDS Use Cases Transportation ‣ Air Traffic Management/Control ‣ Metropolitan Traffic Management ‣ Underground Metropolitan Transportation Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Financial Services ‣ Automated Trading Firms ‣ Compliance Systems ‣ Market Data Platforms © 2009, PrismTech. All Rights Reserved
Motivating Forces The Standard Agenda Architectural Principles Programming Model Concluding Remarks
OpenSplice DDS Delivering Performance, Openness, and Freedom Loosely Coupled Technology
Counting the “W’s” of Coupling Request Client Server The “4Ws” of Client/Server Reply ‣ Who+Where: Space Coupling ‣ What: Structural Coupling Client/Server ‣ When: Time Coupling CORBA, COM+, Java RMI, .Net Remoting, Web SVCs Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Subscriber Publisher Subscriber A Single “W” for DDS Publisher ‣ What: Structural Coupling Subscriber Publisher DDS Subscriber DDS features dynamic discovery and full time decoupling! © 2009, PrismTech. All Rights Reserved
DDS vs. Client-Server Server Client/Server Server Client ‣ Tight Coupling (4W) Client ‣ Complex Deployment Server ‣ Inherently One-to-One Server ‣ Fragile to Fault Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Client Client © 2009, PrismTech. All Rights Reserved
Counting the “W’s” of Coupling Server Client/Server Server Client ‣ Tight Coupling (4W) Client ‣ Complex Deployment Server ‣ Inherently One-to-One Server ‣ Fragile to Fault Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Client Client Subscriber Publisher DDS Subscriber ‣ Loosely Coupled (1W) Publisher ‣ Plug & Play ‣ Inherently Many-to-Many Subscriber ‣ Fault Resilient Publisher Subscriber © 2009, PrismTech. All Rights Reserved
OpenSplice DDS Delivering Performance, Openness, and Freedom High Performance/Availability Pub/Sub
High Performance Pub/Sub The right data, at the right place, at the right time ‣ Fully distributed, Peer-to-Peer -- All the Time. Communication ‣ No Single Point of Failure Publisher Subscriber ‣ No Single Point of Bottleneck Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ Multicast-enabled Brokers Subscriber ‣ High performance and highly Publisher scalable ‣ High availability Publisher ‣hot-swap Subscriber ‣hot-hot architecture © 2009, PrismTech. All Rights Reserved
OpenSplice DDS Delivering Performance, Openness, and Freedom Application Ownership Object/Relational Mapping Data Local Reconstruction Layer (DLRL) Durability Content Data-Centric Pub/Sub Subscription Minimum Profile Data Centric Publish/Subscribe (DCPS) Real-Time Publish/Subscribe Protocol DDS Interoperability Wire Protocol UDP/IP
Data-Centric Pub/Sub ‣ Data-Centric Features are built-in and don’t rely on an external DBMS ‣ Providing thus performance, scalability, and availability ‣ Distributed Relational Data Model Subscriber Publisher DBMS ‣ Local Queries B ‣ Continuous Queries / Content Based Proprietary Information - Distribution without Expressed Written Permission is Prohibited. m Subscriptions A F Subscriber ‣ Windows Publisher J D C ‣ Object/Relational Mapping K E ‣ Support for a subset of SQL-92 Publisher Subscriber Perfect Blend of Data-Centric and Real-Time Publish/Subscribe Technologies © 2009, PrismTech. All Rights Reserved
“Visualizing” Data-Centric Pub/Sub Subscriber Publisher B D J D C E K A B A B Proprietary Information - Distribution without Expressed Written Permission is Prohibited. m Subscriber D C Publisher A F J J A F D C K A F K E Subscriber Publisher D J D K E E © 2009, PrismTech. All Rights Reserved
Organizing Information ‣ All DDS communication is Domain Partition happens within a Domain ‣ Domain can divided into Publisher Subscriber Partitions Proprietary Information - Distribution without Expressed Written Permission is Prohibited. B ‣ Topics are published and m subscribed across on or A F Subscriber more Partitions Publisher J D C K E Publisher Subscriber © 2009, PrismTech. All Rights Reserved
Topics and Data-Centric Pub/Sub ‣ Topics. Unit of information exchanged between Publisher and Subscribers. Topic ‣ Data Types. Type associated to a Topic must be a structured type expressed in IDL struct TempSensor { long tID; Topic Type float temp; ‣ Topic Instances. Key values in a datatype Proprietary Information - Distribution without Expressed Written Permission is Prohibited. float humidity; uniquely identify a Topic Instance (like rows in }; table) #pragma keylist TempSensor tID TempSensor ‣ Content Awareness. SQL Expressions can be tID temp humidity used to do content-aware subscriptions, Instances 1 21 62 2 27 78 queries, joins, and correlate topic instances 3 25.5 72.3 y idit idit y ity SELECT * FROM TempSensor t um Samples mid h um hu 62 h 65 63 WHERE t.temp > 25 p p tem tem p tem 21 22 tID 23 tID tID temp humidity tID 1 1 1 2 27 78 3 25.5 72.3 t1 t2 t3 Time © 2009, PrismTech. All Rights Reserved
Distributed Relational Information Modeling ‣ Topic Keys can be used to identify instances as well as relationships ‣ Relationships can be navigated by relying on a subset of SQL 92 ‣ One-to-many relationships can be captured using foreign keys ‣ Many-to-many relationships need to be modeled using a topics Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ Keys can be represented by an arbitrary number of Topic fields TempSensor Room Floor tID: int rID: int fID: int temp: float width: float level: int humidity: float height: float open: int rID: int length: float fID: int © 2009, PrismTech. All Rights Reserved
Data Centric Publish/Subscribe Publishers Subscribers TempSensor TempSensor tID temp humidity tID temp humidity 1 18 60 1 18 60 2 22 75 3 21 71 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. struct TempSensor { TempSensor int tID; float temp; TempSensor tID temp humidity float humidity; tID temp humidity 2 22 75 }; 2 22 75 #pragma keylist TempSensor tID 3 21 71 SELECT * FROM TempSensor t WHERE s.temp > 20 s.t TempSensor ID == tID temp humidity Fully Distributed Global 1 TempSensor 3 21 71 Data Space tID temp humidity 1 18 60 © 2009, PrismTech. All Rights Reserved
Data Centric Publish/Subscribe Publishers Subscribers TempSensor TempSensor tID temp humidity tID temp humidity 1 21 62 1 21 62 2 22 75 3 21 71 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. struct TempSensor { TempSensor int tID; float temp; TempSensor tID temp humidity float humidity; 2 22 75 tID temp humidity }; #pragma keylist TempSensor tID 1 21 62 2 22 75 3 21 71 SELECT * FROM TempSensor t s.t WHERE s.temp > 20 TempSensor ID == tID temp humidity Fully Distributed Global 1 TempSensor 3 21 71 Data Space tID temp humidity 1 21 62 © 2009, PrismTech. All Rights Reserved
Processing Content & Structure Complex Event Processing... ‣ Local Queries DDS provides some of the most useful features found in Complex Event Processing platforms! ‣ Continuous Queries (Content-based Subscriptions) ‣ Topics Joins & Projections ‣ Events windows (via History QoS) Proprietary Information - Distribution without Expressed Written Permission is Prohibited. tID temp humidity S1 3 21.5 72.3 tID temp humidity {iID = 1} 2 20 78 tID temp humidity 1 21 62 S2 P {temp > 21 | humidity > 75} S3 { temp <16 } © 2009, PrismTech. All Rights Reserved
Processing Content & Structure Complex Event Processing... ‣ Local Queries DDS provides some of the most useful features found in Complex Event Processing platforms! ‣ Continuous Queries (Content-based Subscriptions) ‣ Topics Joins & Projections ‣ Events windows (via History QoS) Proprietary Information - Distribution without Expressed Written Permission is Prohibited. tID temp humidity 1 21 62 S1 {iID = 1} tID temp humidity 2 20 78 3 21.5 72.3 S2 P {temp > 21 | humidity > 75} S3 { temp <16 } © 2009, PrismTech. All Rights Reserved
OpenSplice DDS Delivering Performance, Openness, and Freedom Application Ownership Object/Relational Mapping Data Local Reconstruction Layer (DLRL) Durability Content Object-Oriented Pub/Sub Subscription Minimum Profile Data Centric Publish/Subscribe (DCPS) Real-Time Publish/Subscribe Protocol DDS Interoperability Wire Protocol UDP/IP
Object/Relational Mapping TempSensor temp: float humidity: float ‣ Automatically bridges the getTemp() getHumidity() * Room Floor 1 width: float level: int Object/Relational Impedance height: float length: float * open: int 1 climate: int Conditioner Mismatch temp: float humidity: float 1 climate: int set_climate(); set_status() set_climate() * ‣ Arbitrary object setTemp() get_level() Proprietary Information - Distribution without Expressed Written Permission is Prohibited. setHumidity() setFanLevel() reconstructions start() stop() ‣ Automatic Relationships pause(): Management TConditioner cID: int TTempSernsor ‣ Inheritance temp: float tID: int humidity: float temp: float fan_level: int TRoom humidity: float ‣ Local Operations status: int rID: int rID: int width: float height: float rID: int ‣ Local/Distributed State length: float fID: int TFloor fID: int level: int open: int © 2009, PrismTech. All Rights Reserved
Object/Relational Mapping Unleashing the power of Objects... Object Oriented Canvas OO Relational handle: Handle ‣ Middleware can automatically Flight RadarTrack manage the generation and FlightView call_sign: string x: float image: string route: list association between the refresh_rate: int * origin: string y: float * z: float * 1 Object-Oriented Model and the visible: bool dest: string radar_id: string Relational Model uid: GUID aircraft: string operationOne() display() operationX() operationTwo() Proprietary Information - Distribution without Expressed Written Permission is Prohibited. operationY() FlightViewTopic FlightViewAssociation FlightTopic Relational call_sign: string image: string call_sign: string route: list RadarTrackTopic refresh_rate: int uid: GUID origin: string x: float visible: bool handle: Handle dest: string y: float uid: GUID aircraft: string z: float radar_id: string radar_id: string Relational OO ‣ The Relational Model can be mapped to an Object Oriented model ‣ The mapping is under control of the architect © 2009, PrismTech. All Rights Reserved
Multiple Object/Relational Mappings Canvas FastFlightView image: string handle: Handle DLRL DLRL refresh_rate: int visible: bool Flight uid: GUID RadarTrack FlightView call_sign: string x: float x: float image: string route: list y: float y: float refresh_rate: int * * origin: string 1 * z: float z: float visible: bool dest: string call_sign: string radar_id: string uid: GUID aircraft: string display() operationOne() Proprietary Information - Distribution without Expressed Written Permission is Prohibited. display() operationX() operationTwo() operationY() FlightViewTopic FlightViewAssociation FlightTopic DCPS call_sign: string image: string call_sign: string route: list RadarTrackTopic refresh_rate: int uid: GUID origin: string x: float visible: bool handle: Handle dest: string y: float uid: GUID aircraft: string z: float radar_id: string radar_id: string Multiple Mappings ‣ Different Object/Relatioal Mappings (ORM) can be used for different subsystems ‣ The state is shared across all the local reconstruction (ORMs) © 2009, PrismTech. All Rights Reserved
An Example High-End 3D Visualization Primary Radar RadarTrack x: float y: float z: float radar_id: string operationOne() operationTwo() Proprietary Information - Distribution without Expressed Written Permission is Prohibited. FastFlightView RadarTrackTopic x: float image: string y: float refresh_rate: int FlightViewTopic image: string z: float radar_id: string visible: bool refresh_rate: int visible: bool uid: GUID uid: GUID x: float y: float RadarTrackTopic x: float z: float y: float z: float call_sign: string radar_id: string display() RadarTrackTopic x: float y: float FlightTopic call_sign: string z: float route: list radar_id: string origin: string dest: string aircraft: string radar_id: string Flight call_sign: string route: list RadarTrack origin: string RadarTrackList dest: string aircraft: string operationX() operationY() Flight Data Processor © 2009, PrismTech. All Rights Reserved
An Example High-End 3D Visualization Primary Radar RadarTrack x: float y: float z: float radar_id: string operationOne() operationTwo() Proprietary Information - Distribution without Expressed Written Permission is Prohibited. FastFlightView RadarTrackTopic x: float image: string y: float z: float refresh_rate: int FlightViewTopic image: string radar_id: string visible: bool refresh_rate: int visible: bool uid: GUID uid: GUID x: float y: float RadarTrackTopic x: float z: float y: float z: float call_sign: string radar_id: string display() RadarTrackTopic x: float y: float FlightTopic call_sign: string z: float route: list radar_id: string origin: string dest: string aircraft: string radar_id: string Flight call_sign: string route: list RadarTrack origin: string RadarTrackList dest: string aircraft: string operationX() operationY() Flight Data Processor © 2009, PrismTech. All Rights Reserved
An Example High-End 3D Visualization Primary Radar Secondary Radar RadarTrack x: float y: float z: float radar_id: string RadarTrack operationOne() x: float operationTwo() y: float Proprietary Information - Distribution without Expressed Written Permission is Prohibited. z: float radar_id: string operationOne() operationTwo() FastFlightView RadarTrackTopic RadarTrackTopic x: float x: float image: string y: float y: float refresh_rate: int FlightViewTopic image: string z: float radar_id: string z: float radar_id: string visible: bool refresh_rate: int RadarTrackTopic visible: bool x: float uid: GUID uid: GUID y: float x: float z: float radar_id: string y: float RadarTrackTopic z: float x: float call_sign: string RadarTrackTopic y: float x: float z: float display() y: float radar_id: string z: float FlightTopic call_sign: string radar_id: string route: list origin: string RadarTrack dest: string Flight aircraft: string call_sign: string radar_id: string route: list origin: string RadarTrackList dest: string aircraft: string RadarTrack operationX() operationY() Automatically Manage Flight Data Processor Relationships © 2009, PrismTech. All Rights Reserved
Custom Filter Example High-End 3D Visualization Primary Radar Secondary Radar RadarTrack x: float y: float z: float radar_id: string RadarTrack operationOne() x: float operationTwo() y: float Proprietary Information - Distribution without Expressed Written Permission is Prohibited. z: float radar_id: string operationOne() operationTwo() FastFlightView RadarTrackTopic RadarTrackTopic x: float x: float image: string y: float y: float refresh_rate: int FlightViewTopic z: float z: float SQL Filter image: string radar_id: string radar_id: string visible: bool refresh_rate: int RadarTrackTopic uid: GUID visible: bool uid: GUID x: float y: float Custom Filter x: float z: float radar_id: string y: float z: float RadarTrackTopic x: float call_sign: string y: float RadarTrackTopic z: float display() x: float radar_id: string y: float FlightTopic call_sign: string z: float route: list radar_id: string origin: string RadarTrack Flight dest: string aircraft: string call_sign: string Filter based on Region-of-interest radar_id: string route: list origin: string RadarTrackList dest: string SQL Filter aircraft: string RadarTrack Custom Filter operationX() operationY() Automatically Manage Flight Data Processor Relationships © 2009, PrismTech. All Rights Reserved
OpenSplice DDS Delivering Performance, Openness, and Freedom ...Putting it all Together
DCPS Application Application ‣ The application works directly at the DCPS level TConditioner cID: int temp: float TTempSensor tID: int temp: float Proprietary Information - Distribution without Expressed Written Permission is Prohibited. humidity: float TRoom humidity: float ‣ When using OO Programming fan_level: int rID: int rID: int status: int width: float rID: int height: float Languages the Object/Relational length: float fID: int TFloor fID: int level: int Impedance Mismatch has to be open: int manually dealt Content DDS v1.2 Ownership Durability Subscription Minimum Profile Data Centric Publish/Subscribe (DCPS) © 2009, PrismTech. All Rights Reserved
DLRL Application Application TempSensor temp: float ‣ The DLRL Layer is used to humidity: float getTemp() getHumidity() * Room Floor width: float level: int 1 height: float open: int 1 climate: int provide a Language Integrated Conditioner length: float * temp: float climate: int set_status() humidity: float 1 set_climate(); set_climate() fan_level: int * set_temp() get_level() set_humidity() access to DDS data status: int setTemp() setHumidity() setFanLevel() Proprietary Information - Distribution without Expressed Written Permission is Prohibited. start() stop() ‣ The Designer has great freedom pause(): DDS v1.2 Object/Relational Mapping in deciding how Objects have to Data Local Reconstruction Layer (DLRL) map to Topics TConditioner cID: int TTempSensor tID: int temp: float temp: float humidity: float TRoom humidity: float ‣ Different Object Reconstruction fan_level: int rID: int rID: int status: int width: float rID: int height: float length: float TFloor can be created for different fID: int fID: int level: int open: int applications Content DDS v1.2 Ownership Durability Subscription Minimum Profile Data Centric Publish/Subscribe (DCPS) © 2009, PrismTech. All Rights Reserved
Generic DDS Application Application TempSensor temp: float humidity: float getTemp() getHumidity() * Room Floor width: float level: int 1 ‣ In the most general case, different height: float open: int Conditioner length: float 1 climate: int * temp: float climate: int set_status() humidity: float 1 set_climate(); set_climate() fan_level: int * set_temp() get_level() set_humidity() portion of the application might rely on status: int setTemp() setHumidity() setFanLevel() start() Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DLRL or DCPS depending on their stop() pause(): specific needs Application Object/Relational Mapping Data Local Reconstruction Layer (DLRL) ‣ DCPS access might be required for TConditioner TTempSensor cID: int tID: int temp: float temp: float humidity: float TRoom humidity: float accessing and tuning some specific fan_level: int status: int rID: int rID: int width: float height: float rID: int length: float TFloor QoS fID: int fID: int level: int open: int Content DDS v1.2 Ownership Durability Subscription Minimum Profile Data Centric Publish/Subscribe (DCPS) © 2009, PrismTech. All Rights Reserved
OpenSplice DDS Delivering Performance, Openness, and Freedom QoS-Enabled Pub/Sub
Communicating with Topics, Partitions and Domains Topic Topic Topic Samples Samples Instances Samples Instances Instances 121 62 1 21 62 1 22 62 1 22 62 1 23 63 1 23 63 DataReader DataReader 1 21 62 2 20 61 1 22 62 2 19 60 1 23 63 DataReader DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 2 20 61 2 19 60 DataReader DataReader 2 20 61 2 19 60 DataWriter DataWriter DataReader 3 25 70 3 25 70 3 25 71 25 3 25 71 25 3 25 74 3 25 74 3 26 77 3 26 77 3 26 77 DataWriter struct TempSensor { 3 25 70 3 25 71 25 3 25 74 int tID; float temp; float humidity; }; #pragma keylist TempSensor tID © 2009, PrismTech. All Rights Reserved
Communicating with Topics, Partitions and Domains Topic Topic Topic Samples Samples Instances Samples Instances Instances 121 62 1 21 62 1 22 62 1 22 62 1 23 63 1 23 63 DataReader DataReader 1 21 62 2 20 61 1 22 62 2 19 60 1 23 63 DataReader DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 2 20 61 2 19 60 DataReader DataReader 2 20 61 2 19 60 DataWriter DataWriter DataReader 3 25 70 3 25 70 3 25 71 25 3 25 71 25 3 25 74 3 25 74 3 26 77 3 26 77 3 26 77 DataWriter struct TempSensor { 3 25 70 3 25 71 25 3 25 74 int tID; float temp; Arrows }; float humidity; show #pragma keylist TempSensor tID structural relationship s, not data- Subscriber Publisher flows Partition © 2009, PrismTech. All Rights Reserved
Communicating with Topics, Partitions and Domains Topic Topic Topic Samples Samples Instances Samples Instances Instances 121 62 1 21 62 1 22 62 1 22 62 1 23 63 1 23 63 DataReader DataReader 1 21 62 2 20 61 1 22 62 2 19 60 1 23 63 DataReader DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 2 20 61 2 19 60 DataReader DataReader 2 20 61 2 19 60 DataWriter DataWriter DataReader 3 25 70 3 25 70 3 25 71 25 3 25 71 25 3 25 74 3 25 74 3 26 77 3 26 77 3 26 77 DataWriter struct TempSensor { 3 25 70 3 25 71 25 3 25 74 int tID; float temp; Arrows }; float humidity; show #pragma keylist TempSensor tID structural relationship s, not data- Subscriber Publisher flows Partition Domain Participant Domain © 2009, PrismTech. All Rights Reserved
QoS Model ‣ QoS-Policies are used to control relevant properties of OpenSplice DDS entities, Type Matching QoS matching such as: QoS QoS QoS QoS QoS QoS QoS ‣ Temporal Properties ‣ Priority Topic Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Name Publisher Subscriber ‣ Durability ... DataWriter writes Type reads DataReader ... ... ‣ Availability DomainParticipant writes Type reads DataReader DomainParticipant DataWriter ‣ ... Name ‣ Some QoS-Policies are matched based on Topic QoS QoS QoS a Request vs. Offered Model thus QoS- enforcement ‣ Publications and Subscriptions match only if the declared vs. requested QoS are compatible ‣ e.g., it is not possible to match a publisher which delivers data unreliably with a subscriber which requires reliability © 2009, PrismTech. All Rights Reserved
Sample QoS Policies QoS Policy Applicability RxO Modifiable Type Matching QoS matching DURABILITY T, DR, DW Y N Data Availability QoS QoS QoS QoS QoS QoS QoS DURABILITY SERVICE T, DW N N Topic Name Publisher Subscriber LIFESPAN T, DW - Y ... DataWriter writes Type reads DataReader ... T, DR, DW N N ... HISTORY DomainParticipant DataWriter writes Type reads DataReader DomainParticipant PRESENTATION P, S Y N Data Delivery Name Topic RELIABILITY T, DR, DW Y N PARTITION P, S N Y QoS QoS QoS Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DESTINATION ORDER T, DR, DW Y N OWNERSHIP T, DR, DW Y N ‣ Rich set of QoS allow to configure OWNERSHIP DW - Y STRENGTH several different aspects of data DEADLINE T, DR, DW Y Y Data Timeliness availability, delivery and timeliness LATENCY BUDGET T, DR, DW Y Y TRANSPORT PRIORITY T, DW - Y ‣ QoS can be used to control and optimize network as well as TIME BASED FILTER DR - Y Resources computing resource RESOURCE LIMITS T, DR, DW N N USER_DATA DP, DR, DW N Y Configuration TOPIC_DATA T N Y GROUP_DATA P, S N Y © 2009, PrismTech. All Rights Reserved
Mapping QoS Which properties does QoS controls? TimeBasedFilter Deadline History Data Data Throughput Lifespan Durability Latency Availability Ownership LatencyBudget TransportPriority Ownership Strength Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Control over Latency/Throughput tradeoff Control over data queueing Control over data latency Control over data persistency Control over data priority Control over data sources hot-swap Reliability OpenSplice DDS provides programmatic Destination QoS-driven support for configuring the most Presentation Data Delivery Order important properties of data distribution! Control over data distribution reliability Control over data ordering Control over presentation © 2009, PrismTech. All Rights Reserved
TimeBasedFilter Deadline Data Throughput Latency LatencyBudget TransportPriority Data Timeliness QoS Policy Applicability RxO Modifiable DEADLINE T, DR, DW Y Y LATENCY T, DR, DW Y Y Data BUDGET Timeliness TRANSPORT T, DW - Y PRIORITY © 2008, PrismTech. All Rights Reserved
Deadline You can’t be later than... The DEADLINE QoS policy allows to define the maximum inter-arrival time between data samples QoS Policy Applicability RxO Modifiable QoS matching DEADLINE T, DR, DW Y Y QoS QoS QoS ‣ DataWriter indicates that the application QoS Topic Name QoS commits to write a new value at least once Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DataWriter writes Type reads DataReader Publisher ... Subscriber every deadline period ... ... ‣ writes Type reads DataReader DataReaders are notified by the DDS when DataWriter Name the DEADLINE QoS contract is violated Topic QoS QoS QoS QoS matching Publisher Subscriber Deadline Deadline Deadline Deadline Deadline Deadline Violation © 2009, PrismTech. All Rights Reserved
Latency Budget I need to get there in at most... The LATENCY_BUDGET QoS policy specifies the maximum acceptable delay from the time the data is written until the data is inserted in the receiver's application-cache QoS Policy Applicability RxO Modifiable LATENCY T, DR, DW Y Y BUDGET ‣ The default value of the duration is zero indicating that the delay should be minimized QoS matching ‣ This policy is a hint to the DDS, not something that must be QoS QoS QoS Proprietary Information - Distribution without Expressed Written Permission is Prohibited. monitored or enforced. QoS Topic QoS Name DataWriter writes Type reads DataReader Publisher ... Subscriber ... ... DataWriter writes Type reads DataReader Name TBuff Latency Budget = Latency = TBuff +T1+T2+T3 Topic QoS QoS QoS QoS matching T3 T1 T2 © 2009, PrismTech. All Rights Reserved
Transport Priority VIP Data, stay clear! QoS Policy Applicability RxO Modifiable TRANSPORT T, DW - Y QoS matching PRIORITY QoS QoS QoS QoS Topic QoS The TRANSPORT_PRIORITY QoS policy Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Name is a hint to the infrastructure as to how Publisher DataWriter writes Type reads DataReader Subscriber ... ... ... to set the priority of the underlying Type reads DataReader transport used to send the data. DataWriter writes Name Topic QoS QoS QoS QoS matching © 2009, PrismTech. All Rights Reserved
History Data Lifespan Durability Availability Ownership Ownership Strength Data Availability QoS Policy Applicability RxO Modifiable DURABILITY T, DR, DW Y N DURABILITY T, DW N N SERVICE Data Availability LIFESPAN T, DW - Y HISTORY T, DR, DW N N © 2008, PrismTech. All Rights Reserved
Durability The DURABILITY QoS controls the data availability w.r.t. late joiners, specifically the DDS provides the following variants: QoS Policy Applicability RxO Modifiable DURABILITY T, DR, DW Y N ‣ Volatile. No need to keep data instances DURABILITY SERVICE T, DW N N for late joining data readers ‣ Transient Local. Data instance availability Proprietary Information - Distribution without Expressed Written Permission is Prohibited. QoS matching for late joining data reader is tied to the QoS QoS QoS data writer availability QoS Topic QoS ‣ Transient. Data instance availability Name DataWriter writes Type reads DataReader outlives the data writer Publisher ... ... ... Subscriber ‣ Persistent. Data instance availability DataWriter writes Type reads DataReader outlives system restarts Topic Name QoS QoS QoS QoS matching The DURABILITY_SERVICE QoS provide control over configuration of the service that implements the transient and persistent durability features © 2009, PrismTech. All Rights Reserved
Lifespan For how long will this data be available? ‣ The LIFESPAN QoS policy QoS Policy Applicability RxO Modifiable LIFESPAN T, DW - Y allows to control what happens to stale data QoS matching ‣ It specifies the validity interval QoS QoS QoS Proprietary Information - Distribution without Expressed Written Permission is Prohibited. for data written by the QoS Topic Name QoS DataWriter DataWriter writes Type reads DataReader ‣ Publisher ... Subscriber ... The default validity interval is ... DataWriter writes Type reads DataReader infinite Name Topic QoS QoS QoS QoS matching © 2009, PrismTech. All Rights Reserved
History How many data samples should I keep? The HISTORY QoS policy controls whether the DDS should deliver only the most recent value, attempt to deliver all intermediate values, or do something in between. The policy can be configured to provide the following semantics: ‣ Keep Last. The DDS will only attempt to QoS Policy HISTORY Applicability T, DR, DW RxO N Modifiable N keep the most recent “depth” samples of Proprietary Information - Distribution without Expressed Written Permission is Prohibited. each instance of data identified by its key QoS matching ‣ Keep All. The DDS will attempt to keep all QoS QoS QoS the samples of each instance of data identified by its key. QoS Topic Name QoS ‣ On the DataWriter Samples are kept until DataWriter writes Type reads DataReader delivered to all known subscribers Publisher ... ... ... Subscriber ‣ On the DataReader side samples are kept DataWriter writes Type reads DataReader until the application “takes” them Topic Name QoS QoS QoS QoS matching © 2009, PrismTech. All Rights Reserved
Reliability Destination Presentation Data Delivery Order Data Delivery QoS Policy Applicability RxO Modifiable PRESENTATION P, S Y N RELIABILITY T, DR, DW Y N PARTITION P, S N Y DESTINATION T, DR, DW Y N Data Delivery ORDER OWNERSHIP T, DR, DW Y N OWNERSHIP DW - Y STRENGTH © 2008, PrismTech. All Rights Reserved
Reliability The RELIABILITY QoS indicate the level of guarantee offered by the DDS in delivering data to subscribers. Possible variants are: QoS Policy Applicability RxO Modifiable ‣ Reliable. In steady-state the RELIABILITY T, DR, DW Y N middleware guarantees that all Proprietary Information - Distribution without Expressed Written Permission is Prohibited. samples in the DataWriter history will QoS matching eventually be delivered to all the QoS QoS QoS DataReader QoS Topic QoS ‣ Best Effort. Indicates that it is DataWriter writes Type Name reads DataReader acceptable to not retry propagation of Publisher ... Subscriber ... ... any samples DataWriter writes Type reads DataReader Name Topic QoS QoS QoS QoS matching © 2009, PrismTech. All Rights Reserved
Ownership Who owns the data? The OWNERSHIP QoS specifies whether it is allowed for multiple DataWriters to write the same instance of the data and if so, how these modifications should be arbitrated. Possible choices are: ‣ Shared. Multiple writers are allowed to QoS Policy Applicability RxO Modifiable update the same instance and all the OWNERSHIP T, DR, DW Y N Proprietary Information - Distribution without Expressed Written Permission is Prohibited. updates are made available to the reader QoS matching ‣ Exclusive. Indicates that each instance can QoS QoS QoS only be owned by one DataWriter, but the Topic owner of an instance can change QoS Name QoS dynamically -- due to liveliness changes DataWriter writes Type reads DataReader Publisher ... Subscriber ... ‣ The selection of the owner is controlled by DataWriter writes ... Type reads DataReader the setting of the OWNERSHIP_STRENGTH Name QoS policy Topic QoS QoS QoS QoS matching © 2009, PrismTech. All Rights Reserved
Ownership Strength How strong are you? The OWNERSHIP_STRENGTH Specifies the value of the “strength” used to arbitrate among DataWriters that attempt to modify the same data instance ‣ Data instance are identified QoS matching by the couple (Topic, Key) QoS QoS QoS ‣ The policy applies only if the Proprietary Information - Distribution without Expressed Written Permission is Prohibited. OWNERSHIP is EXCLUSIVE QoS Topic Name QoS DataWriter writes Type reads DataReader Publisher ... Subscriber ... ... QoS Policy Applicability RxO Modifiable OWNERSHIP DW - Y DataWriter writes Type reads DataReader STRENGTH Name Topic QoS QoS QoS QoS matching © 2009, PrismTech. All Rights Reserved
Ownership @ Work ‣ A Topic can have Shared or Exclusive Ownership ‣ Exclusively owned Topics can be modified by a single writer ‣ Writer strength is used to coordinate replicated writers Proprietary Information - Distribution without Expressed Written Permission is Prohibited. StockQuote symbol: "MSFT" StockQuote StockQuote name: "Microsoft Corp." StockQuote symbol: "GOOG" symbol: "GOOG" exchange: "NASD""GOOG" symbol: name: "Google Inc." quote: 33.73 name: "Google Inc." name: "Google Inc." exchange: "NASD" exchange: "NASD" exchange: "NASD" StockQuote StockQuote StockQuote quote: 663.97 W1 quote: 663.97"AAPL" symbol: "AAPL" quote: 663.97 symbol: "AAPL" symbol: name: "Apple Inc." name: "Apple Inc." name: "Apple Inc." exchange: "NASD" exchange: "NASD" exchange: "NASD" R1 quote: 165.37 quote: 165.37 quote: 165.37 STRENGTH=3 StockQuote symbol: "AAPL" StockQuote Inc." name: "Apple symbol: "GOOG""NASD" exchange: name: quote: 165.37 "Google Inc." StockQuote "NASD" exchange: symbol: "MSFT" quote: 663.97 name: "Microsoft Corp." exchange: "NASD" quote: 33.73 W1’ R2 STRENGTH=2 StockQuote symbol: "AAPL" StockQuote Inc." name: "Apple symbol: "GOOG""NASD" exchange: name: quote: 165.37 "Google Inc." StockQuote "NASD" exchange: symbol: "MSFT" quote: 663.97 name: "Microsoft Corp." exchange: "NASD" quote: 33.73 W2’’ R3 STRENGTH=1 © 2009, PrismTech. All Rights Reserved
Managing Hot-Swap ‣ A Topic can have Shared or Exclusive Ownership ‣ Exclusively owned Topics can be modified by a single writer ‣ Writer strength is used to coordinate replicated writers Proprietary Information - Distribution without Expressed Written Permission is Prohibited. StockQuote R1 symbol: "AAPL" name: "Apple Inc." exchange: "NASD" quote: 165.37 StockQuote symbol: "GOOG" name: "Google Inc." exchange: "NASD" quote: 663.97 StockQuote symbol: "GOOG" name: "Google Inc." exchange: "NASD" quote: 663.97 StockQuote symbol: "AAPL" name: "Apple Inc." exchange: "NASD" R2 quote: 165.37 StockQuote StockQuote StockQuote StockQuote symbol: "MSFT" symbol: "MSFT" symbol: "MSFT" symbol: "GOOG" name: "Microsoft Corp." name: "Microsoft Corp." name: "Microsoft Corp." exchange: "NASD" exchange: "NASD" name: "Google Inc." exchange: "NASD" quote: 33.73 quote: 33.73 quote: 33.73 exchange: "NASD" quote: 663.97 StockQuote R3 symbol: "AAPL" W2’’ name: "Apple Inc." exchange: "NASD" quote: 165.37 STRENGTH=1 © 2009, PrismTech. All Rights Reserved
Motivating Forces The Standard Agenda Architectural Principles Programming Model Concluding Remarks
OpenSplice DDS Delivering Performance, Openness, and Freedom Shared Global Data Space
Shared Global Data Space Coordination Model ‣ DDS applications are asynchronous and communicate by reading/writing from/to a Global Data Space ‣ DDS applications communicate by simply addressing items in the Global Data Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Space and without any direct knowledge of the parties involved in the production/ consumption of data Consistency Model ‣ The Shared Global Data Space implemented by DDS, can be configured to supports at most the “Eventual Consistency Model” ‣ Under an Eventual Consistency Model we are guaranteed that eventually all application in the system will have a consistent view of the “world”s © 2009, PrismTech. All Rights Reserved
Eventual Consistency & R/W Caches DataReader DataReader 1 1 2 1 DataWriter 1 1 3 1 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 2 1 1 2 Topic DataReader 1 2 2 3 3 1 DataReader Cache 2 2 2 3 3 1 Topic 1 1 DataReader Cache 2 Topic 1 DDS DataWriter Cache 3 1 Topic DataReader Cache Under an Eventual Consistency Model, DDS guarantees that all matched Reader Caches will eventually be identical of the respective Writer Cache © 2009, PrismTech. All Rights Reserved
QoS Impacting the Consistency Model The DDS Consistency Model is a property that can be associated to Topics or further refined by Reader/Writers. The property is controlled by the following QoS Policies: ‣ DURABILITY ‣ VOLATILE | TRANSIENT_LOCAL | TRANSIENT | PERSISTENT ‣ LIFESPAN Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ RELIABILITY ‣ RELIABLE | BEST_EFFORT ‣ DESTINATION ORDER ‣ SOURCE_TIMESTAMP | DESTINATION_TIMESTAMP QoS Policy Applicability RxO Modifiable DURABILITY T, DR, DW Y N LIFESPAN T, DW - Y RELIABILITY T, DR, DW Y N DESTINATION ORDER T, DR, DW Y N © 2009, PrismTech. All Rights Reserved
QoS Impacting the Consistency Model DURABILITY RELIABILITY DESTINATION_ORDER LIFESPAN Eventual Consistency VOLATILE RELIABLE SOURCE_TIMESTAMP INF. (No Crash / Recovery) Eventual Consistency TRANSIENT_LOCAL RELIABLE SOURCE_TIMESTAMP INF. Proprietary Information - Distribution without Expressed Written Permission is Prohibited. (Reader Crash / Recovery) Eventual Consistency TRANSIENT RELIABLE SOURCE_TIMESTAMP INF. (Crash/Recovery) Eventual Consistency PERSISTENT RELIABLE SOURCE_TIMESTAMP INF. (Crash/Recovery) Weak Consistency ANY ANY DESTINATION_TIMESTAMP ANY Weak Consistency ANY BEST_EFFORT ANY ANY Weak Consistency ANY ANY ANY N © 2009, PrismTech. All Rights Reserved
Eventual Consistency @ WorK DURABILITY RELIABILITY DESTINATION_ORDER LIFESPAN Eventual Consistency (Reader TRANSIENT_LOCAL RELIABLE SOURCE_TIMESTAMP INF. Crash / Recovery) {A} Eventual Consistency TRANSIENT RELIABLE SOURCE_TIMESTAMP INF. {B} (Crash/Recovery) Weak Consistency ANY ANY ANY N {J} Proprietary Information - Distribution without Expressed Written Permission is Prohibited. S = {A, D} S1 P = {A, B} B B P1 m S= {A, B, J} BA A A F S2 J D C P = {D, C, J} P2 K E S = {A} S4 © 2009, PrismTech. All Rights Reserved
Eventual Consistency @ Work DURABILITY RELIABILITY DESTINATION_ORDER LIFESPAN Eventual Consistency (Reader TRANSIENT_LOCAL RELIABLE SOURCE_TIMESTAMP INF. Crash / Recovery) {A} Eventual Consistency TRANSIENT RELIABLE SOURCE_TIMESTAMP INF. {B} (Crash/Recovery) Weak Consistency ANY ANY ANY N {J} Proprietary Information - Distribution without Expressed Written Permission is Prohibited. S = {A, D} S1 B B A m S= {A, B, J} A F S2 J J D D C BA P = {D, C, J} S= {A, B, D, J} P2 K E S3 J S = {A} S4 © 2009, PrismTech. All Rights Reserved A
Design Guidelines ‣ For all (non-periodic) Topics for which an eventually consistent model is required use the following QoS settings: DURABILITY RELIABILITY DESTINATION_ORDER LIFESPAN Eventual Consistency TRANSIENT RELIABLE SOURCE_TIMESTAMP INF. Proprietary Information - Distribution without Expressed Written Permission is Prohibited. (Crash / Recovery) ‣ For information produced periodically, with a period P, where P is small enough to be acceptable as a consistency convergence delay, the following QoS settings will provide an approximation of the eventual consistency: DURABILITY RELIABILITY DESTINATION_ORDER LIFESPAN Eventual Consistency VOLATILE BEST_EFFORT SOURCE_TIMESTAMP INF. (Crash / Recovery) © 2009, PrismTech. All Rights Reserved
OpenSplice DDS Delivering Performance, Openness, and Freedom Topic Used in next section. Getting the Data struct Counter { int cID; int count; Read Semantics }; #pragma keylist Counter cID
Reading Samples ‣ Read iterates over the available sample instances 1 1 1 2 1 3 1 4 ‣ Samples are not removed 2 1 2 2 2 3 from the local cache as DataReader Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 4 3 5 result of a read 3 1 3 2 3 3 ‣ Read samples can be read Topic again, by accessing the Samples Read Samples not Read cache with the proper options (more later) DataReader Cache © 2009, PrismTech. All Rights Reserved
Reading Samples ‣ Read iterates over the available sample instances 1 1 1 2 1 3 1 4 ‣ Samples are not removed 2 1 2 2 2 3 from the local cache as DataReader Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 1 3 2 3 3 3 4 3 5 result of a read ‣ Read samples can be read Topic again, by accessing the Samples Read Samples not Read cache with the proper options (more later) DataReader Cache © 2009, PrismTech. All Rights Reserved
Reading Samples ‣ Read iterates over the available sample instances 1 1 1 2 1 3 1 4 ‣ Samples are not removed 2 1 2 2 2 3 from the local cache as DataReader Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 1 3 2 3 3 3 4 3 5 result of a read ‣ Read samples can be read Topic again, by accessing the Samples Read Samples not Read cache with the proper options (more later) DataReader Cache © 2009, PrismTech. All Rights Reserved
Sample, Instance and View States History Depth = 2 ‣ DataReaders are provided with data samples ane state information allowing to detect relevant transitions in the life-cycle of data as well as data writers DataReader Proprietary Information - Distribution without Expressed Written Permission is Prohibited. SampleInfo ‣ Sample State (READ | NOT_READ): Determines wether a sample has already been read by this 1 1 1 2 DataWriter or not. 2 2 2 3 ‣ Instance State (ALIVE, NOT_ALIVE, DISPOSED). 3 1 Determines wether (1) writer exist for the specific Samples instance, or (2) no matched writers are currently Topic available, or (3) the instance has been disposed DataReader Cache ‣ View State (NEW, NOT_NEW). Determines wether this is the first sample of a new (or re-born) instance © 2009, PrismTech. All Rights Reserved
Anatomy of a Read DDS::ReturnCode_t read( TSeq& samples, Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS::SampleInfoSeq& info, long max_samples, DDS::SampleStateMask samples_state, DDS::ViewStateMask views_state, DDS::InstanceStateMask instances_state) © 2009, PrismTech. All Rights Reserved
Reading Data Example 1 Example 2 TSeq samples; TSeq samples(N); SampleInfoSeq info; SampleInfoSeq info(N); reader->read(samples, reader->read(samples, info, info, DDS::LENGTH_UNLIMITED, N, Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS::NOT_READ_SAMPLE_STATE, DDS::NOT_READ_SAMPLE_STATE, DDS::ANY_VIEW_STATE, DDS::ANY_VIEW_STATE, DDS::ANY_INSTANCE_STATE); DDS::ANY_INSTANCE_STATE); // Do something // Do something reader->return_loan(samples, info); Example 3 reader->read(samples, info, N, DDS::NOT_READ_SAMPLE_STATE, DDS::NEW_VIEW_STATE, DDS::ALIVE_INSTANCE_STATE); © 2009, PrismTech. All Rights Reserved
OpenSplice DDS Delivering Performance, Openness, and Freedom Topic Used in next section. Getting the Data struct Counter { int cID; int count; Take Semantics }; #pragma keylist Counter cID
Taking Samples ‣ Take iterates over the available sample instances 1 1 1 2 1 3 1 4 ‣ Taken Samples are 2 1 2 2 2 3 removed from the local DataReader Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 4 3 5 cache as result of a take 3 1 3 2 3 3 ‣ Topic Samples not Taken DataReader Cache © 2009, PrismTech. All Rights Reserved
Taking Samples ‣ Take iterates over the available sample instances 1 2 1 3 1 4 ‣ Taken Samples are 2 2 2 3 removed from the local DataReader Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 2 3 3 3 4 3 5 cache as result of a take Topic Samples not Taken DataReader Cache © 2009, PrismTech. All Rights Reserved
Taking Samples ‣ Take iterates over the available sample instances 1 3 1 4 ‣ Taken Samples are 2 3 removed from the local DataReader Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 3 3 4 3 5 cache as result of a take Topic Samples not Taken DataReader Cache © 2009, PrismTech. All Rights Reserved
Anatomy of a take DDS::ReturnCode_t take( TSeq& samples, Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS::SampleInfoSeq& info, long max_samples, DDS::SampleStateMask samples_state, DDS::ViewStateMask views_state, DDS::InstanceStateMask instances_state) © 2009, PrismTech. All Rights Reserved
OpenSplice DDS Delivering Performance, Openness, and Freedom Topic Used in next section. Writing Data struct Counter { int cID; int count; }; #pragma keylist Counter cID
Writing Samples ‣ Samples are written in the local cache ‣ Writer control the creation 1 1 DataWriter of instances Topic Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ The DDS ensures that the local caches for the matched DataReader will be Last Sample Written eventually consistent with that of the Data Writer DataWriter Cache © 2009, PrismTech. All Rights Reserved
Writing Samples ‣ Samples are written in the local cache ‣ Writer control the creation 1 1 1 2 DataWriter of instances Topic Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ The DDS ensures that the local caches for the matched DataReader will be Last Sample Written eventually consistent with that of the Data Writer DataWriter Cache © 2009, PrismTech. All Rights Reserved
Writing Samples ‣ Samples are written in the local cache ‣ Writer control the creation 1 2 1 3 DataWriter of instances Topic Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ The DDS ensures that the local caches for the matched DataReader will be Last Sample Written eventually consistent with that of the Data Writer DataWriter Cache © 2009, PrismTech. All Rights Reserved
Anatomy of a write DDS::ReturnCode_t write(const T& sample, Proprietary Information - Distribution without Expressed Written Permission is Prohibited. InstanceHandle_t handle); © 2009, PrismTech. All Rights Reserved
Writing Data writer->write(sample, DDS::HANDLE_NIL); Proprietary Information - Distribution without Expressed Written Permission is Prohibited. InstanceHandle_t handle = writer->register_instance(sample); // ... writer->write(sample, handle); © 2009, PrismTech. All Rights Reserved
OpenSplice DDS Delivering Performance, Openness, and Freedom Topic Used in next section. Managing Data History struct Counter { int cID; int count; }; #pragma keylist Counter cID
How many samples? History Depth = 1 (DDS Default) ‣ The History QoS Controls the 1 1 number of samples-per- DataReader 2 1 instance that will be stored by 3 1 the middleware on behalf of a Topic Reader Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ Keep Last K. The History QoS can be set so to always have History Depth = 5 the latest K samples 1 1 1 2 1 3 1 4 1 5 ‣ Keep All. The History QoS can 2 1 2 2 2 3 2 4 2 5 be set so keep all samples DataReader 3 3 3 4 produced by the writer and not 3 1 3 2 3 5 yet taken, until resource limits Topic are not reached © 2009, PrismTech. All Rights Reserved
History in Action History Depth = 1 History Depth = 1 (DDS Default) (DDS Default) Network 1 1 1 2 DataReader 2 1 1 2 2 3 DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 1 2 2 2 3 3 1 Topic Topic DataReader Cache DataWriter Cache Note: The Reliability QoS controls wether data is sent reliably, or best-effort, from the DataWriter to matched DataReaders © 2009, PrismTech. All Rights Reserved
History in Action History Depth = 1 History Depth = 1 (DDS Default) (DDS Default) Network 1 2 1 2 DataReader 2 2 2 3 DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 1 2 3 3 1 Topic Topic DataReader Cache DataWriter Cache Note: The Reliability QoS controls wether data is sent reliably, or best-effort, from the DataWriter to matched DataReaders © 2009, PrismTech. All Rights Reserved
History in Action History Depth = 1 History Depth = 1 (DDS Default) (DDS Default) Network 1 2 1 2 DataReader 2 3 2 3 DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 1 3 1 Topic Topic DataReader Cache DataWriter Cache Note: The Reliability QoS controls wether data is sent reliably, or best-effort, from the DataWriter to matched DataReaders © 2009, PrismTech. All Rights Reserved
History in Action History Depth = 2 History Depth = 1 (DDS Default) Network 1 1 1 2 DataReader 2 1 1 2 2 3 DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 1 2 2 2 3 3 1 Topic Topic DataReader Cache DataWriter Cache Note: The Reliability QoS controls wether data is sent reliably, or best-effort, from the DataWriter to matched DataReaders © 2009, PrismTech. All Rights Reserved
History in Action History Depth = 2 History Depth = 1 (DDS Default) Network 1 1 1 2 1 2 DataReader 2 1 2 2 2 3 DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 1 2 3 3 1 Topic Topic DataReader Cache DataWriter Cache Note: The Reliability QoS controls wether data is sent reliably, or best-effort, from the DataWriter to matched DataReaders © 2009, PrismTech. All Rights Reserved
History in Action History Depth = 2 History Depth = 1 (DDS Default) Network 1 1 1 2 1 2 DataReader 2 2 2 3 2 3 DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 1 3 1 Topic Topic DataReader Cache DataWriter Cache Note: The Reliability QoS controls wether data is sent reliably, or best-effort, from the DataWriter to matched DataReaders © 2009, PrismTech. All Rights Reserved
OpenSplice DDS Delivering Performance, Openness, and Freedom Topic Used in next section. Application / DDS Coordination struct Counter { int cID; int count; }; #pragma keylist Counter cID
Application / DDS Coordination DDS provides three main mechanism for exchanging information with the application ‣ Polling. The application polls from time to time for new data or status changes. The interval might depend on the kind of applications as well as data Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ WaitSets. The application registers a WaitSet with DDS and waits (i.e. is suspended) until one of the specified events has happened. ‣ Listeners. The application registers a listener with a specific DDS entity to be notified when relevant events occur, such as state changes or © 2009, PrismTech. All Rights Reserved
OpenSplice DDS Delivering Performance, Openness, and Freedom Putting it All Together Writing a DDS Application
Steps for Writing a DDS Application Writing a DDS application can be decomposed in the following few simple steps: ‣ Step#1: Define Topics ‣ Step #2: Identify QoS representing key non-functional invariants for your system ‣ Transport Priority ‣ Deadline ‣ Durability Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ Step #3: Define Topics / Partition Mapping ‣ Step #4: Identify Topic Readers/Writers ‣ Step #5: Define QoS requirements for Readers/Writers ‣ History ‣ Latency Budget ‣ Auto-Dispose ‣ Transport Priority ‣ Deadline ‣ Step #6: Code-it in your favorite programming language © 2009, PrismTech. All Rights Reserved
Making the Hello DDS World Step #1: Topic definition ‣ We are going to define a simple key-less topic that will carry the name to greet. module swatch { Proprietary Information - Distribution without Expressed Written Permission is Prohibited. struct hello { string<256> name; }; #pragma keylist hello }; © 2009, PrismTech. All Rights Reserved
Making the Hello DDS World Step #2: Topic QoS ‣ Reliability QoS: RELIABLE ‣ Durability QoS: TRANSIENT Proprietary Information - Distribution without Expressed Written Permission is Prohibited. module swatch { struct hello { string<256> name; }; #pragma keylist hello }; © 2009, PrismTech. All Rights Reserved
Making the Hello DDS World Step #3: Topics/Partitions Mapping ‣ swatch::hello will be mapped into the default-partition (thus no action to take) Proprietary Information - Distribution without Expressed Written Permission is Prohibited. © 2009, PrismTech. All Rights Reserved
Making the Hello DDS World Step #4: Readers/Writers ‣ A Generic DataReader that will read the topic swatch:: hello ‣ We’ll be able to run as many of this as we want ‣ A Generic DataWriter that will read the topic swatch:: hello Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ We’ll be able to run as many of this as we want © 2009, PrismTech. All Rights Reserved
Making the Hello DDS World ‣ Step #5: Define QoS requirements for Readers/Writers ‣ Writer: ‣ Inherit TopicQoS, and ‣ No-Auto Dispose Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ History QoS: Keep Last N ‣ Reader ‣ Inherit TopicQoS, and ‣ History QoS: Keep Last N © 2009, PrismTech. All Rights Reserved
Hello World in a Conceptual Picture History Depth = 2 History Depth = 2 1 1 1 1 2 2 2 2 3 3 DataReader DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. SampleInfo SampleInfo Network 1 1 1 2 1 1 1 2 2 2 2 2 2 3 2 3 3 1 3 1 Samples Samples swatch::hello swatch::hello DataReader Cache DataWriter Cache © 2009, PrismTech. All Rights Reserved
Visualizing the Strucutre... Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Subscriber Default Partition Publisher Domain Participant Domain © 2009, PrismTech. All Rights Reserved
Step #6: Coding How many lines of code is going to take this example? Proprietary Information - Distribution without Expressed Written Permission is Prohibited. © 2009, PrismTech. All Rights Reserved
SIMple Dds == SIMD! ‣ Today we’ll write our DDS application using SIMD ‣ SIMD is a C++ library that takes advantage of C++ Template Meta- Programming to: ‣ Vastly Improve Productivity SIMD Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ Simplify Usage ‣ Automate Resource Management (All DDS Entities are Garbage Collected via Ref-Counting) ‣ Zero Overhead © 2009, PrismTech. All Rights Reserved
Hello-pub.cpp (Default QoS) int main(int argc, char* argv[]) { swatch::hello sample; if (!parse_args(argc, argv)) std::stringstream ss; return 1; for (int i = 0; i < N; ++i) { // -- init the SIMD runtime ss << i; Proprietary Information - Distribution without Expressed Written Permission is Prohibited. simd::Runtime::init(); std::string tmp = ss.str() + "." + message; ss.str(""); // -- create the DDS Topic sample.name = DDS::string_dup(tmp.c_str()); simd::Topic<swatch::hello> helloTopic("helloTopic"); std::cout << "<<= " << sample.name << std::endl; writer.write(sample); // -- create the DDS DataWriter usleep(period*1000); simd::DataWriter<swatch::hello> writer(helloTopic, } dwqos); std::cout << "[done]" << std::endl; return 0; } Only 3-lines of DDS-Specific Code Business Logic © 2009, PrismTech. All Rights Reserved
Hello-pub.cpp int main(int argc, char* argv[]) { if (!parse_args(argc, argv)) return 1; swatch::hello sample; // -- init the SIMD runtime simd::Runtime::init(); std::stringstream ss; simd::TopicQos tqos; for (int i = 0; i < N; ++i) { ss << i; tqos.set_reliable(); Proprietary Information - Distribution without Expressed Written Permission is Prohibited. tqos.set_transient(); std::string tmp = ss.str() + "." + message; ss.str(""); // -- create the DDS Topic sample.name = DDS::string_dup(tmp.c_str()); std::cout << "<<= " << sample.name << std::endl; simd::Topic<swatch::hello> helloTopic("helloTopic", tqos); writer.write(sample); usleep(period*1000); simd::DataWriterQos dwqos(tqos); dwqos.set_keep_last(history_depth); } std::cout << "[done]" << std::endl; dwqos.set_auto_dispose(false); return 0; } // -- create the DDS DataWriter Business Logic simd::DataWriter<swatch::hello> writer(helloTopic, dwqos); © 2009, PrismTech. All Rights Reserved
Hello-sub.cpp (Default QoS) int main(int argc, char* argv[]) { swatch::helloSeq samples; if (!parse_args(argc, argv)) DDS::SampleInfoSeq infos; return 1; while (true) { // -- init the SIMD runtime reader.read(samples, infos); Proprietary Information - Distribution without Expressed Written Permission is Prohibited. simd::Runtime::init(); for (int i = 0; i < samples.length(); ++i) { std::cout << "=>> " << samples[i].name // -- create the DDS Topic << std::endl; simd::Topic<swatch::hello> helloTopic("helloTopic"); } if (samples.length() > 0) // -- create the DDS DataReader std::cout << "--" << std::endl; simd::DataReader<swatch::hello> reader(helloTopic); reader.return_loan(samples, infos); usleep(period*1000); } return 0;} Only 3-lines of DDS-Specific Code Business Logic © 2009, PrismTech. All Rights Reserved
Hello-sub.cpp int main(int argc, char* argv[]) { if (!parse_args(argc, argv)) return 1; swatch::helloSeq samples; // -- init the SIMD runtime DDS::SampleInfoSeq infos; simd::Runtime::init(); while (true) { simd::TopicQos tqos; reader.read(samples, infos); Proprietary Information - Distribution without Expressed Written Permission is Prohibited. tqos.set_reliable(); for (int i = 0; i < samples.length(); ++i) { tqos.set_transient(); std::cout << "=>> " << samples[i].name << std::endl; // -- create the DDS Topic } simd::Topic<swatch::hello> helloTopic("helloTopic", if (samples.length() > 0) tqos); std::cout << "--" << std::endl; simd::DataReaderQos drqos(tqos); reader.return_loan(samples, infos); drqos.set_keep_last(history_depth); usleep(period*1000); } // -- create the DDS DataReader return 0;} simd::DataReader<swatch::hello> reader(helloTopic, drqos); Business Logic © 2009, PrismTech. All Rights Reserved
OpenSplice DDS Delivering Performance, Openness, and Freedom Demo!
Motivating Forces The Standard Agenda Architectural Principles Programming Model Concluding Remarks
Concluding Remarks State of the Art ‣ The OMG DDS Standard uniquely addresses some of the key requirements for next generation Mission Application Critical Systems ‣ The OMG DDS is one of the few middleware standard Object/Relational Mapping Data Local Reconstruction Layer (DLRL) defining both API as well as Wire-Protocol, thus Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ensuring application portability and interworking Content Ownership Durability ‣ The DDS Standard has been recommended/ Subscription mandated by key administration throughout the world Minimum Profile as well as adopted by the most challenging Defense Data Centric Publish/Subscribe (DCPS) programs Real-Time Publish/Subscribe Protocol Looking Ahead DDS Interoperability Wire Protocol ‣ The DDS Standard is swiftly moving forward to expand UDP/IP its applicability, simplify its use, and facilitate integration © 2009, PrismTech. All Rights Reserved
Online Resources http://www.opensplice.com/ http://twitter.com/acorsaro/ emailto:opensplicedds@prismtech.com Proprietary Information - Distribution without Expressed Written Permission is Prohibited. http://bit.ly/1Sreg http://opensplice.blogspot.com http://www.dds-forum.org http://www.youtube.com/OpenSpliceTube http://portals.omg.org/dds © 2009, PrismTech. All Rights Reserved
Data Access Pattern Coordination Patterns Backup
Topic Queues Context ‣ One commonly used technique for implementing distributed real-time embedded systems is to model applications as FSA, or DFSA (Distributed Finite State Automata) Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Problem ‣ One or more DDS applications are implemented as a (D)FSA whose transitions depends on the totally ordered history of updates for a specific topic ‣ How can we ensure that each application sees exactly the same set of updates in exactly the same order? © 2009, PrismTech. All Rights Reserved
Topic Queues Assumptions ‣ Single writer exists per Topic Instance Solution ‣ Represent the state transition events by means of DDS Topics Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ Topic Instances can be used to identify specific FSA ‣ Ensure that application always use the Take Semantics for getting data. ‣ Ensure that these topics have the following QoS Settings ‣ DURABILITY: TRANSIENT | PERSISTENT ‣ HISTORY: KEEP_ALL ‣ RELIABILITY: RELIABLE ‣ DESTINATION_ORDER: SOURCE_TIMESTAMP © 2009, PrismTech. All Rights Reserved
3 2 1 Topic Queues 1 1 1 DDS © 2009, PrismTech. All Rights Reserved Samples not Taken Proprietary Information - Distribution without Expressed Written Permission is Prohibited.
3 2 1 Topic Queues 1 1 11 3 2 2 DDS © 2009, PrismTech. All Rights Reserved Samples not Taken Proprietary Information - Distribution without Expressed Written Permission is Prohibited.
Topic Queues DDS Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 1 1 2 1 3 1 4 2 1 2 2 2 3 3 1 3 2 3 3 3 4 3 5 Samples not Taken © 2009, PrismTech. All Rights Reserved
Topic Queues 1 3 2 2 2 2 1 3 2 3 3 3 DDS 1 3 © 2009, PrismTech. All Rights Reserved 4 4 3 Samples not Taken 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited.
Topic K-Queues Context ‣ One commonly used technique for implementing distributed real-time embedded systems is to model applications as FSA, or DFSA (Distributed Finite State Automata) Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Problem ‣ One or more DDS applications are implemented as a (D)FSA whose transitions depends on the totally ordered history of updates for a specific topic ‣ How can we ensure that each application sees exactly the same set of updates in exactly the same order? ‣ How can we ensure that misbehaving applications consume an unbounded amount of memory? © 2009, PrismTech. All Rights Reserved
Topic K-Queues Assumptions ‣ Single writer exists per Topic Instance Solution Note ‣ Represent the state transition events by means of DDS ‣ K can be dimensioned by considering Topics the maximum burst of activity that should be tolerated along with the ‣ Topic Instances can be used to identify specific FSA Proprietary Information - Distribution without Expressed Written Permission is Prohibited. average time between state transitions ‣ Ensure that application always use the Take Semantics for ‣ e.g., if I want to tolerate 12 sec of getting data overload and state transition occur ‣ Ensure that these topics have the following QoS Settings every 4 sec then K=3 ‣ DURABILITY: TRANSIENT | PERSISTENT ‣ RELIABILITY: RELIABLE ‣ HISTORY: KEEP_LAST with DEPTH set to K ‣ DESTINATION_ORDER: SOURCE_TIMESTAMP ‣ If a FSA looses a state transition “resets the state” by some other means (e.g. DURABILITY SERVICE) © 2009, PrismTech. All Rights Reserved
3 2 1 1 1 1 Topic K-Queues DDS Samples not Taken © 2009, PrismTech. All Rights Reserved Proprietary Information - Distribution without Expressed Written Permission is Prohibited.
3 2 1 1 1 1 1 3 2 Topic K-Queues 2 2 2 DDS 1 3 Samples not Taken © 2009, PrismTech. All Rights Reserved Proprietary Information - Distribution without Expressed Written Permission is Prohibited.
Topic K-Queues DDS Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 2 1 3 1 4 2 1 2 2 2 3 3 1 3 2 3 3 Samples not Taken - One FSA has missed a sample... but does not know it yet. © 2009, PrismTech. All Rights Reserved
Topic K-Queues DDS Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 3 1 4 2 2 2 3 3 2 3 3 Samples not Taken - One FSA has missed a sample... but does not know it yet. - It detects this and gets the sample from the DURABILITY SERVICE © 2009, PrismTech. All Rights Reserved
Topic Caches Problem ‣ Distributed applications often have to deal with “Hard State”, meaning state that is conceptually shared among various elements. ‣ This “Hard State” often needs to be accesses very efficiently, likewise changes in state should Proprietary Information - Distribution without Expressed Written Permission is Prohibited. also consistently diffused in a timely manner © 2009, PrismTech. All Rights Reserved
Topic Caches Solution ‣ Represent the “Hard State” by means of DDS Topics ‣ Application should favor the use the Read Semantics for getting data. ‣ Ensure that these topics have the following QoS Settings Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ DURABILITY: TRANSIENT | PERSISTENT ‣ HISTORY: KEEP_LAST ‣ RELIABILITY: RELIABLE ‣ DESTINATION_ORDER: SOURCE_TIMESTAMP Note ‣ Notice that “Hard State” will be eventually consistent for all reader regardless of the number of writers ‣ This technique can be exploited for writing self-stabilizing applications © 2009, PrismTech. All Rights Reserved
DataReader DataReader 3 2 1 DataReader 1 1 1 3 2 1 3 2 1 1 1 1 1 1 1 Topic Caches 2 1 2 2 2 DDS 3 © 2009, PrismTech. All Rights Reserved 2 3 2 1 2 1 3 2 DataWriter DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited.
DataReader DataReader 3 2 1 DataReader 1 2 2 3 2 1 3 2 1 1 2 2 1 2 2 Topic Caches 2 DDS 3 © 2009, PrismTech. All Rights Reserved 2 3 2 1 2 1 3 2 DataWriter DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited.
Topic Caches DataReader 1 2 DataWriter 2 3 3 1 DDS 1 2 2 3 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DataReader 1 2 2 3 3 1 DataWriter 3 1 2 2 DataReader 1 2 2 3 3 1 - Notice that one Data Writer has an inconsistent state when compared to the system state. - This is not hard to cope with, and could be simply solved by matching a reader with the writer (or using a Coordination Pattern) © 2009, PrismTech. All Rights Reserved
Data Access Pattern Coordination Patterns Backup
Sequencer Problem ‣ Often occurs in a distributed system that applications need to coordinate and take turn in performing certain actions. ‣ However DDS does not provide built-in coordination / distributed synchronization Proprietary Information - Distribution without Expressed Written Permission is Prohibited. mechanisms. How can this be overcome? Solution ‣ Define a Sequencer in your system that coordinates access to resources. © 2009, PrismTech. All Rights Reserved
Sequencer Detailed Solution ‣ Define in your system the following Topics: struct TAccessRequest { struct TAccessGrant { Proprietary Information - Distribution without Expressed Written Permission is Prohibited. long resource_guid; long resource_guid; long request_guid; long request_guid; time_t timeout; time_t timeout; }; }; #pragma keylist AccessRequestTopic resource_guid #pragma keylist AccessRequestTopic resrouce_guid struct TReleaseAccessGrant { long resource_guid; long request_guid; }; #pragma keylist AccessRequestTopic resrouce_guid © 2009, PrismTech. All Rights Reserved
Sequencer Detailed Solution ‣ Make TAccessRequest and TReleaseAccessGrant Topic-Queues (with DESTINATION_ORDER set to RECEPTION_TIMESTAMP) ‣ Make TAccessGrant a Topic-Cache ‣ Use the following protocol to request/grant/release access Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Sequencer (per instance to keep it simpler) Application while (true) { bool granted = false; take next sample from TAccessRequest write TAccessRequest write TAccessGrant while (!granted) { wait on TReleaseAccessGrant wait on TAccessGrant } if TAccessGrant == myTAccessGrant granted = true; } // Do Critical Section write TReleaseAccessGrant © 2009, PrismTech. All Rights Reserved
Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest © 2009, PrismTech. All Rights Reserved
Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 10 2 5 © 2009, PrismTech. All Rights Reserved
Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 10 2 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 10 2 5 © 2009, PrismTech. All Rights Reserved
Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 10 2 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 10 2 5 © 2009, PrismTech. All Rights Reserved
Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 10 2 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 10 1 10 1 10 2 5 2 5 2 5 © 2009, PrismTech. All Rights Reserved
Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 10 2 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 10 1 10 1 10 1 10 2 5 2 5 2 5 © 2009, PrismTech. All Rights Reserved
Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 10 1 10 2 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 10 1 10 1 10 1 10 2 5 2 5 2 5 © 2009, PrismTech. All Rights Reserved
Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 -1 2 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 10 1 10 1 5 1 10 1 10 2 5 2 5 2 5 3 10 3 5 © 2009, PrismTech. All Rights Reserved
Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 5 1 -1 2 5 3 5 3 10 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 -1 1 -1 1 5 1 10 1 10 2 5 2 5 2 5 3 10 3 5 © 2009, PrismTech. All Rights Reserved
Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 5 2 5 3 10 3 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 -1 1 -1 1 5 1 10 1 10 2 5 2 5 2 5 3 10 3 5 © 2009, PrismTech. All Rights Reserved
Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 5 2 5 3 10 3 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 5 1 -1 1 5 1 10 1 10 2 5 2 5 2 5 3 10 3 5 3 5 3 5 © 2009, PrismTech. All Rights Reserved
Barriers Problem ‣ Often occurs in a distributed system that applications need to reach a common step in computation before proceeding. ‣ This is required for distributed application creating software pipelines, or even to ensure Proprietary Information - Distribution without Expressed Written Permission is Prohibited. proper state evolution of the distributed system. ‣ However DDS does not provide built-in coordination / distributed synchronization mechanisms. How can this be overcome? Solution ‣ Use Barriers in your system to coordinate application progress. © 2009, PrismTech. All Rights Reserved
Barriers Detailed Solution ‣ Define in your system the following Topics: Proprietary Information - Distribution without Expressed Written Permission is Prohibited. struct TBarrier { struct TBarrierCondition { long computation_guid; long computation_guid; long task_guid; long status; long status; long cardinality; }; }; #pragma keylist Barrier computation_guid task_guid #pragma keylist Barrier computation_guid © 2009, PrismTech. All Rights Reserved
Barriers Detailed Solution ‣ Make TBarrier and TBarrierCondition a Topic-Cache ‣ Use the following protocol to request/grant/release access Application Proprietary Information - Distribution without Expressed Written Permission is Prohibited. // Do Computation // Notify others write Barrier wait for BarrierCondition.cardinality Barrier instances to have the proper Barrier.status // Barrier has been passed... // Take next computational step © 2009, PrismTech. All Rights Reserved
Barriers @ Work App-7 Reader Coordinator TBarrierCondition TBarrier Writer 1 10 0xF1 TBarrierCondition 1 0xFF 3 1 7 0xF1 1 0xFF 3 TBarrier Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 5 0xF1 1 7 0xF1 App-10 DDS App-5 TBarrierCondition TBarrier TBarrierCondition TBarrier 1 10 0xF1 1 10 0xF1 1 0xFF 3 1 0xFF 3 1 7 0xF1 1 7 0xF1 TBarrier TBarrier 1 5 0xF1 1 5 0xF1 1 10 0xF1 1 5 0xF1 © 2009, PrismTech. All Rights Reserved
Barriers @ Work App-7 Reader Coordinator TBarrierCondition TBarrier Writer 1 10 0xF1 TBarrierCondition 1 0xFF 3 1 7 0xFF 1 0xFF 3 TBarrier Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 5 0xF1 1 7 0xFF App-10 DDS App-5 TBarrierCondition TBarrier TBarrierCondition TBarrier 1 10 0xF1 1 10 0xF1 1 0xFF 3 1 0xFF 3 1 7 0xF1 1 7 0xF1 TBarrier TBarrier 1 5 0xF1 1 5 0xF1 1 10 0xF1 1 5 0xF1 © 2009, PrismTech. All Rights Reserved
Barriers @ Work App-7 Reader Coordinator TBarrierCondition TBarrier Writer 1 10 0xF1 TBarrierCondition 1 0xFF 3 1 7 0xFF 1 0xFF 3 TBarrier Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 5 0xF1 1 7 0xFF App-10 DDS App-5 TBarrierCondition TBarrier TBarrierCondition TBarrier 1 10 0xF1 1 10 0xF1 1 0xFF 3 1 0xFF 3 1 7 0xFF 1 7 0xFF TBarrier TBarrier 1 5 0xF1 1 5 0xF1 1 10 0xF1 1 5 0xF1 © 2009, PrismTech. All Rights Reserved
Barriers @ Work App-7 Reader Coordinator TBarrierCondition TBarrier Writer 1 10 0xF1 TBarrierCondition 1 0xFF 3 1 7 0xFF 1 0xFF 3 TBarrier Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 5 0xF1 1 7 0xFF App-10 DDS App-5 TBarrierCondition TBarrier TBarrierCondition TBarrier 1 10 0xF1 1 10 0xF1 1 0xFF 3 1 0xFF 3 1 7 0xFF 1 7 0xFF TBarrier TBarrier 1 5 0xF1 1 5 0xFF 1 10 0xF1 1 5 0xFF © 2009, PrismTech. All Rights Reserved
Barriers @ Work App-7 Reader Coordinator TBarrierCondition TBarrier Writer 1 10 0xF1 TBarrierCondition 1 0xFF 3 1 7 0xFF 1 0xFF 3 TBarrier Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 5 0xFF 1 7 0xFF App-10 DDS App-5 TBarrierCondition TBarrier TBarrierCondition TBarrier 1 10 0xF1 1 10 0xF1 1 0xFF 3 1 0xFF 3 1 7 0xFF 1 7 0xFF TBarrier TBarrier 1 5 0xFF 1 5 0xFF 1 10 0xF1 1 5 0xFF © 2009, PrismTech. All Rights Reserved
Barriers @ Work App-7 Reader Coordinator TBarrierCondition TBarrier Writer 1 10 0xF1 TBarrierCondition 1 0xFF 3 1 7 0xFF 1 0xFF 3 TBarrier Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 5 0xFF 1 7 0xFF App-10 DDS App-5 TBarrierCondition TBarrier TBarrierCondition TBarrier 1 10 0xFF 1 10 0xF1 1 0xFF 3 1 0xFF 3 1 7 0xFF 1 7 0xFF TBarrier TBarrier 1 5 0xFF 1 5 0xFF 1 10 0xFF 1 5 0xFF © 2009, PrismTech. All Rights Reserved
Barriers @ Work App-7 Reader Coordinator TBarrierCondition TBarrier Writer 1 10 0xFF TBarrierCondition 1 0xFF 3 1 7 0xFF 1 0xFF 3 TBarrier Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 5 0xFF 1 7 0xFF App-10 DDS App-5 TBarrierCondition TBarrier TBarrierCondition TBarrier 1 10 0xFF 1 10 0xFF 1 0xFF 3 1 0xFF 3 1 7 0xFF 1 7 0xFF TBarrier TBarrier 1 5 0xFF 1 5 0xFF 1 10 0xFF 1 5 0xFF © 2009, PrismTech. All Rights Reserved
Leader Election Problem ‣ Several distributed algorithms require some form of leader ‣ Problems requiring a leader, can be addressed using the Sequencer Pattern ‣ However, what if the sequencer crashes? Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Solution ‣ Use the DDS OWNERSHIP_STRENGH as a mechanism to do leader election via DDS Observation ‣ The basic Leader Election functionality provided by DDS can be used to easily replicate service implementation such as those of the Sequencer ‣ If the leader is stateful, its state should be stored within DDS © 2009, PrismTech. All Rights Reserved
Ad

Recommended

BigtopでHadoopをビルドする（Open Source Conference 2021 Online/Spring 発表資料）
BigtopでHadoopをビルドする（Open Source Conference 2021 Online/Spring 発表資料）BigtopでHadoopをビルドする（Open Source Conference 2021 Online/Spring 発表資料）
BigtopでHadoopをビルドする（Open Source Conference 2021 Online/Spring 発表資料）
NTT DATA Technology & Innovation
 
Fast DDS Features & Tools
Fast DDS Features & ToolsFast DDS Features & Tools
Fast DDS Features & Tools
eProsima
 
NTTデータ流 Hadoop活用のすすめ ～インフラ構築・運用の勘所～
NTTデータ流 Hadoop活用のすすめ ～インフラ構築・運用の勘所～NTTデータ流 Hadoop活用のすすめ ～インフラ構築・運用の勘所～
NTTデータ流 Hadoop活用のすすめ ～インフラ構築・運用の勘所～
NTT DATA OSS Professional Services
 
プロセスマイニングとソースコード解析を用いたマイクロサービス分割（ソフトウェアエンジニアリングシンポジウム2021 発表資料）
プロセスマイニングとソースコード解析を用いたマイクロサービス分割（ソフトウェアエンジニアリングシンポジウム2021 発表資料）プロセスマイニングとソースコード解析を用いたマイクロサービス分割（ソフトウェアエンジニアリングシンポジウム2021 発表資料）
プロセスマイニングとソースコード解析を用いたマイクロサービス分割（ソフトウェアエンジニアリングシンポジウム2021 発表資料）
NTT DATA Technology & Innovation
 
10 Reasons for Choosing OpenSplice DDS
10 Reasons for Choosing OpenSplice DDS10 Reasons for Choosing OpenSplice DDS
10 Reasons for Choosing OpenSplice DDS
Angelo Corsaro
 
Docker Compose 徹底解説
Docker Compose 徹底解説Docker Compose 徹底解説
Docker Compose 徹底解説
Masahito Zembutsu
 
Apache spark 2.3 and beyond
Apache spark 2.3 and beyondApache spark 2.3 and beyond
Apache spark 2.3 and beyond
NTT DATA Technology & Innovation
 
Azure Database for PostgreSQL 入門 (PostgreSQL Conference Japan 2021)
Azure Database for PostgreSQL 入門 (PostgreSQL Conference Japan 2021)Azure Database for PostgreSQL 入門 (PostgreSQL Conference Japan 2021)
Azure Database for PostgreSQL 入門 (PostgreSQL Conference Japan 2021)
Keisuke Takahashi
 
0から始めるコンテナの学び方（Kubernetes Novice Tokyo #14 発表資料）
0から始めるコンテナの学び方（Kubernetes Novice Tokyo #14 発表資料）0から始めるコンテナの学び方（Kubernetes Novice Tokyo #14 発表資料）
0から始めるコンテナの学び方（Kubernetes Novice Tokyo #14 発表資料）
NTT DATA Technology & Innovation
 
40分でわかるHadoop徹底入門 （Cloudera World Tokyo 2014 講演資料）
40分でわかるHadoop徹底入門 （Cloudera World Tokyo 2014 講演資料） 40分でわかるHadoop徹底入門 （Cloudera World Tokyo 2014 講演資料）
40分でわかるHadoop徹底入門 （Cloudera World Tokyo 2014 講演資料）
hamaken
 
Docker道場オンライン#1 Docker基礎概念と用語の理解
Docker道場オンライン#1 Docker基礎概念と用語の理解Docker道場オンライン#1 Docker基礎概念と用語の理解
Docker道場オンライン#1 Docker基礎概念と用語の理解
Masahito Zembutsu
 
大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...
大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...
大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...
NTT DATA Technology & Innovation
 
Apache Hadoop YARNとマルチテナントにおけるリソース管理
Apache Hadoop YARNとマルチテナントにおけるリソース管理Apache Hadoop YARNとマルチテナントにおけるリソース管理
Apache Hadoop YARNとマルチテナントにおけるリソース管理
Cloudera Japan
 
異次元のグラフデータベースNeo4j
異次元のグラフデータベースNeo4j異次元のグラフデータベースNeo4j
異次元のグラフデータベースNeo4j
昌桓 李
 
Apache BigtopによるHadoopエコシステムのパッケージング（Open Source Conference 2021 Online/Osaka...
Apache BigtopによるHadoopエコシステムのパッケージング（Open Source Conference 2021 Online/Osaka...Apache BigtopによるHadoopエコシステムのパッケージング（Open Source Conference 2021 Online/Osaka...
Apache BigtopによるHadoopエコシステムのパッケージング（Open Source Conference 2021 Online/Osaka...
NTT DATA Technology & Innovation
 
3GPP TS 38.300-100まとめ
3GPP TS 38.300-100まとめ3GPP TS 38.300-100まとめ
3GPP TS 38.300-100まとめ
Tetsuya Hasegawa
 
Db2 v11.5.4 高可用性構成 & HADR 構成パターンご紹介
Db2 v11.5.4 高可用性構成 & HADR 構成パターンご紹介Db2 v11.5.4 高可用性構成 & HADR 構成パターンご紹介
Db2 v11.5.4 高可用性構成 & HADR 構成パターンご紹介
IBM Analytics Japan
 
[B31,32]SQL Server Internal と パフォーマンスチューニング ｂｙ Yukio Kumazawa
[B31,32]SQL Server Internal と パフォーマンスチューニング ｂｙ Yukio Kumazawa[B31,32]SQL Server Internal と パフォーマンスチューニング ｂｙ Yukio Kumazawa
[B31,32]SQL Server Internal と パフォーマンスチューニング ｂｙ Yukio Kumazawa
Insight Technology, Inc.
 
Cyclone DDS: Sharing Data in the IoT Age
Cyclone DDS: Sharing Data in the IoT AgeCyclone DDS: Sharing Data in the IoT Age
Cyclone DDS: Sharing Data in the IoT Age
Angelo Corsaro
 
オンプレ×Google Cloud PlatformなML基盤におけるRancherの活用
オンプレ×Google Cloud PlatformなML基盤におけるRancherの活用オンプレ×Google Cloud PlatformなML基盤におけるRancherの活用
オンプレ×Google Cloud PlatformなML基盤におけるRancherの活用
MicroAd, Inc.(Engineer)
 
Apache OpenWhiskで実現するプライベートFaaS環境 #tjdev
Apache OpenWhiskで実現するプライベートFaaS環境 #tjdevApache OpenWhiskで実現するプライベートFaaS環境 #tjdev
Apache OpenWhiskで実現するプライベートFaaS環境 #tjdev
Yahoo!デベロッパーネットワーク
 
Apache Bigtopによるオープンなビッグデータ処理基盤の構築（オープンデベロッパーズカンファレンス 2021 Online 発表資料）
Apache Bigtopによるオープンなビッグデータ処理基盤の構築（オープンデベロッパーズカンファレンス 2021 Online 発表資料）Apache Bigtopによるオープンなビッグデータ処理基盤の構築（オープンデベロッパーズカンファレンス 2021 Online 発表資料）
Apache Bigtopによるオープンなビッグデータ処理基盤の構築（オープンデベロッパーズカンファレンス 2021 Online 発表資料）
NTT DATA Technology & Innovation
 
PGOを用いたPostgreSQL on Kubernetes入門（Open Source Conference 2023 Online/Hokkaido...
PGOを用いたPostgreSQL on Kubernetes入門（Open Source Conference 2023 Online/Hokkaido...PGOを用いたPostgreSQL on Kubernetes入門（Open Source Conference 2023 Online/Hokkaido...
PGOを用いたPostgreSQL on Kubernetes入門（Open Source Conference 2023 Online/Hokkaido...
NTT DATA Technology & Innovation
 
Spring Cloud Data Flow で構成される IIJ IoTサービス
Spring Cloud Data Flow で構成される IIJ IoTサービスSpring Cloud Data Flow で構成される IIJ IoTサービス
Spring Cloud Data Flow で構成される IIJ IoTサービス
Kenji Kondo
 
CloudNativePGを動かしてみた！ ～PostgreSQL on Kubernetes～（第34回PostgreSQLアンカンファレンス@オンライ...
CloudNativePGを動かしてみた！ ～PostgreSQL on Kubernetes～（第34回PostgreSQLアンカンファレンス@オンライ...CloudNativePGを動かしてみた！ ～PostgreSQL on Kubernetes～（第34回PostgreSQLアンカンファレンス@オンライ...
CloudNativePGを動かしてみた！ ～PostgreSQL on Kubernetes～（第34回PostgreSQLアンカンファレンス@オンライ...
NTT DATA Technology & Innovation
 
Apache Sparkに手を出してヤケドしないための基本 ～「Apache Spark入門より」～ （デブサミ 2016 講演資料）
Apache Sparkに手を出してヤケドしないための基本 ～「Apache Spark入門より」～ （デブサミ 2016 講演資料）Apache Sparkに手を出してヤケドしないための基本 ～「Apache Spark入門より」～ （デブサミ 2016 講演資料）
Apache Sparkに手を出してヤケドしないための基本 ～「Apache Spark入門より」～ （デブサミ 2016 講演資料）
NTT DATA OSS Professional Services
 
Introduction to RTI DDS
Introduction to RTI DDSIntroduction to RTI DDS
Introduction to RTI DDS
John Breitenbach
 
Oracle Cloud Infrastructure：2022年1月度サービス・アップデート
Oracle Cloud Infrastructure：2022年1月度サービス・アップデートOracle Cloud Infrastructure：2022年1月度サービス・アップデート
Oracle Cloud Infrastructure：2022年1月度サービス・アップデート
オラクルエンジニア通信
 
Sph 107 Ch 15
Sph 107 Ch 15Sph 107 Ch 15
Sph 107 Ch 15
Bryant Hall
 
Introduction to OMG DDS (1 hour, 45 slides)
Introduction to OMG DDS (1 hour, 45 slides)Introduction to OMG DDS (1 hour, 45 slides)
Introduction to OMG DDS (1 hour, 45 slides)
Gerardo Pardo-Castellote
 
Ad

More Related Content

What's hot (20)

0から始めるコンテナの学び方（Kubernetes Novice Tokyo #14 発表資料）
0から始めるコンテナの学び方（Kubernetes Novice Tokyo #14 発表資料）0から始めるコンテナの学び方（Kubernetes Novice Tokyo #14 発表資料）
0から始めるコンテナの学び方（Kubernetes Novice Tokyo #14 発表資料）
NTT DATA Technology & Innovation
 
40分でわかるHadoop徹底入門 （Cloudera World Tokyo 2014 講演資料）
40分でわかるHadoop徹底入門 （Cloudera World Tokyo 2014 講演資料） 40分でわかるHadoop徹底入門 （Cloudera World Tokyo 2014 講演資料）
40分でわかるHadoop徹底入門 （Cloudera World Tokyo 2014 講演資料）
hamaken
 
Docker道場オンライン#1 Docker基礎概念と用語の理解
Docker道場オンライン#1 Docker基礎概念と用語の理解Docker道場オンライン#1 Docker基礎概念と用語の理解
Docker道場オンライン#1 Docker基礎概念と用語の理解
Masahito Zembutsu
 
大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...
大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...
大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...
NTT DATA Technology & Innovation
 
Apache Hadoop YARNとマルチテナントにおけるリソース管理
Apache Hadoop YARNとマルチテナントにおけるリソース管理Apache Hadoop YARNとマルチテナントにおけるリソース管理
Apache Hadoop YARNとマルチテナントにおけるリソース管理
Cloudera Japan
 
異次元のグラフデータベースNeo4j
異次元のグラフデータベースNeo4j異次元のグラフデータベースNeo4j
異次元のグラフデータベースNeo4j
昌桓 李
 
Apache BigtopによるHadoopエコシステムのパッケージング（Open Source Conference 2021 Online/Osaka...
Apache BigtopによるHadoopエコシステムのパッケージング（Open Source Conference 2021 Online/Osaka...Apache BigtopによるHadoopエコシステムのパッケージング（Open Source Conference 2021 Online/Osaka...
Apache BigtopによるHadoopエコシステムのパッケージング（Open Source Conference 2021 Online/Osaka...
NTT DATA Technology & Innovation
 
3GPP TS 38.300-100まとめ
3GPP TS 38.300-100まとめ3GPP TS 38.300-100まとめ
3GPP TS 38.300-100まとめ
Tetsuya Hasegawa
 
Db2 v11.5.4 高可用性構成 & HADR 構成パターンご紹介
Db2 v11.5.4 高可用性構成 & HADR 構成パターンご紹介Db2 v11.5.4 高可用性構成 & HADR 構成パターンご紹介
Db2 v11.5.4 高可用性構成 & HADR 構成パターンご紹介
IBM Analytics Japan
 
[B31,32]SQL Server Internal と パフォーマンスチューニング ｂｙ Yukio Kumazawa
[B31,32]SQL Server Internal と パフォーマンスチューニング ｂｙ Yukio Kumazawa[B31,32]SQL Server Internal と パフォーマンスチューニング ｂｙ Yukio Kumazawa
[B31,32]SQL Server Internal と パフォーマンスチューニング ｂｙ Yukio Kumazawa
Insight Technology, Inc.
 
Cyclone DDS: Sharing Data in the IoT Age
Cyclone DDS: Sharing Data in the IoT AgeCyclone DDS: Sharing Data in the IoT Age
Cyclone DDS: Sharing Data in the IoT Age
Angelo Corsaro
 
オンプレ×Google Cloud PlatformなML基盤におけるRancherの活用
オンプレ×Google Cloud PlatformなML基盤におけるRancherの活用オンプレ×Google Cloud PlatformなML基盤におけるRancherの活用
オンプレ×Google Cloud PlatformなML基盤におけるRancherの活用
MicroAd, Inc.(Engineer)
 
Apache OpenWhiskで実現するプライベートFaaS環境 #tjdev
Apache OpenWhiskで実現するプライベートFaaS環境 #tjdevApache OpenWhiskで実現するプライベートFaaS環境 #tjdev
Apache OpenWhiskで実現するプライベートFaaS環境 #tjdev
Yahoo!デベロッパーネットワーク
 
Apache Bigtopによるオープンなビッグデータ処理基盤の構築（オープンデベロッパーズカンファレンス 2021 Online 発表資料）
Apache Bigtopによるオープンなビッグデータ処理基盤の構築（オープンデベロッパーズカンファレンス 2021 Online 発表資料）Apache Bigtopによるオープンなビッグデータ処理基盤の構築（オープンデベロッパーズカンファレンス 2021 Online 発表資料）
Apache Bigtopによるオープンなビッグデータ処理基盤の構築（オープンデベロッパーズカンファレンス 2021 Online 発表資料）
NTT DATA Technology & Innovation
 
PGOを用いたPostgreSQL on Kubernetes入門（Open Source Conference 2023 Online/Hokkaido...
PGOを用いたPostgreSQL on Kubernetes入門（Open Source Conference 2023 Online/Hokkaido...PGOを用いたPostgreSQL on Kubernetes入門（Open Source Conference 2023 Online/Hokkaido...
PGOを用いたPostgreSQL on Kubernetes入門（Open Source Conference 2023 Online/Hokkaido...
NTT DATA Technology & Innovation
 
Spring Cloud Data Flow で構成される IIJ IoTサービス
Spring Cloud Data Flow で構成される IIJ IoTサービスSpring Cloud Data Flow で構成される IIJ IoTサービス
Spring Cloud Data Flow で構成される IIJ IoTサービス
Kenji Kondo
 
CloudNativePGを動かしてみた！ ～PostgreSQL on Kubernetes～（第34回PostgreSQLアンカンファレンス@オンライ...
CloudNativePGを動かしてみた！ ～PostgreSQL on Kubernetes～（第34回PostgreSQLアンカンファレンス@オンライ...CloudNativePGを動かしてみた！ ～PostgreSQL on Kubernetes～（第34回PostgreSQLアンカンファレンス@オンライ...
CloudNativePGを動かしてみた！ ～PostgreSQL on Kubernetes～（第34回PostgreSQLアンカンファレンス@オンライ...
NTT DATA Technology & Innovation
 
Apache Sparkに手を出してヤケドしないための基本 ～「Apache Spark入門より」～ （デブサミ 2016 講演資料）
Apache Sparkに手を出してヤケドしないための基本 ～「Apache Spark入門より」～ （デブサミ 2016 講演資料）Apache Sparkに手を出してヤケドしないための基本 ～「Apache Spark入門より」～ （デブサミ 2016 講演資料）
Apache Sparkに手を出してヤケドしないための基本 ～「Apache Spark入門より」～ （デブサミ 2016 講演資料）
NTT DATA OSS Professional Services
 
Introduction to RTI DDS
Introduction to RTI DDSIntroduction to RTI DDS
Introduction to RTI DDS
John Breitenbach
 
Oracle Cloud Infrastructure：2022年1月度サービス・アップデート
Oracle Cloud Infrastructure：2022年1月度サービス・アップデートOracle Cloud Infrastructure：2022年1月度サービス・アップデート
Oracle Cloud Infrastructure：2022年1月度サービス・アップデート
オラクルエンジニア通信
 
0から始めるコンテナの学び方（Kubernetes Novice Tokyo #14 発表資料）
0から始めるコンテナの学び方（Kubernetes Novice Tokyo #14 発表資料）0から始めるコンテナの学び方（Kubernetes Novice Tokyo #14 発表資料）
0から始めるコンテナの学び方（Kubernetes Novice Tokyo #14 発表資料）
NTT DATA Technology & Innovation
 
40分でわかるHadoop徹底入門 （Cloudera World Tokyo 2014 講演資料）
40分でわかるHadoop徹底入門 （Cloudera World Tokyo 2014 講演資料） 40分でわかるHadoop徹底入門 （Cloudera World Tokyo 2014 講演資料）
40分でわかるHadoop徹底入門 （Cloudera World Tokyo 2014 講演資料）
hamaken
 
Docker道場オンライン#1 Docker基礎概念と用語の理解
Docker道場オンライン#1 Docker基礎概念と用語の理解Docker道場オンライン#1 Docker基礎概念と用語の理解
Docker道場オンライン#1 Docker基礎概念と用語の理解
Masahito Zembutsu
 
大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...
大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...
大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...
NTT DATA Technology & Innovation
 
Apache Hadoop YARNとマルチテナントにおけるリソース管理
Apache Hadoop YARNとマルチテナントにおけるリソース管理Apache Hadoop YARNとマルチテナントにおけるリソース管理
Apache Hadoop YARNとマルチテナントにおけるリソース管理
Cloudera Japan
 
異次元のグラフデータベースNeo4j
異次元のグラフデータベースNeo4j異次元のグラフデータベースNeo4j
異次元のグラフデータベースNeo4j
昌桓 李
 
Apache BigtopによるHadoopエコシステムのパッケージング（Open Source Conference 2021 Online/Osaka...
Apache BigtopによるHadoopエコシステムのパッケージング（Open Source Conference 2021 Online/Osaka...Apache BigtopによるHadoopエコシステムのパッケージング（Open Source Conference 2021 Online/Osaka...
Apache BigtopによるHadoopエコシステムのパッケージング（Open Source Conference 2021 Online/Osaka...
NTT DATA Technology & Innovation
 
3GPP TS 38.300-100まとめ
3GPP TS 38.300-100まとめ3GPP TS 38.300-100まとめ
3GPP TS 38.300-100まとめ
Tetsuya Hasegawa
 
Db2 v11.5.4 高可用性構成 & HADR 構成パターンご紹介
Db2 v11.5.4 高可用性構成 & HADR 構成パターンご紹介Db2 v11.5.4 高可用性構成 & HADR 構成パターンご紹介
Db2 v11.5.4 高可用性構成 & HADR 構成パターンご紹介
IBM Analytics Japan
 
[B31,32]SQL Server Internal と パフォーマンスチューニング ｂｙ Yukio Kumazawa
[B31,32]SQL Server Internal と パフォーマンスチューニング ｂｙ Yukio Kumazawa[B31,32]SQL Server Internal と パフォーマンスチューニング ｂｙ Yukio Kumazawa
[B31,32]SQL Server Internal と パフォーマンスチューニング ｂｙ Yukio Kumazawa
Insight Technology, Inc.
 
Cyclone DDS: Sharing Data in the IoT Age
Cyclone DDS: Sharing Data in the IoT AgeCyclone DDS: Sharing Data in the IoT Age
Cyclone DDS: Sharing Data in the IoT Age
Angelo Corsaro
 
オンプレ×Google Cloud PlatformなML基盤におけるRancherの活用
オンプレ×Google Cloud PlatformなML基盤におけるRancherの活用オンプレ×Google Cloud PlatformなML基盤におけるRancherの活用
オンプレ×Google Cloud PlatformなML基盤におけるRancherの活用
MicroAd, Inc.(Engineer)
 
Apache OpenWhiskで実現するプライベートFaaS環境 #tjdev
Apache OpenWhiskで実現するプライベートFaaS環境 #tjdevApache OpenWhiskで実現するプライベートFaaS環境 #tjdev
Apache OpenWhiskで実現するプライベートFaaS環境 #tjdev
Yahoo!デベロッパーネットワーク
 
Apache Bigtopによるオープンなビッグデータ処理基盤の構築（オープンデベロッパーズカンファレンス 2021 Online 発表資料）
Apache Bigtopによるオープンなビッグデータ処理基盤の構築（オープンデベロッパーズカンファレンス 2021 Online 発表資料）Apache Bigtopによるオープンなビッグデータ処理基盤の構築（オープンデベロッパーズカンファレンス 2021 Online 発表資料）
Apache Bigtopによるオープンなビッグデータ処理基盤の構築（オープンデベロッパーズカンファレンス 2021 Online 発表資料）
NTT DATA Technology & Innovation
 
PGOを用いたPostgreSQL on Kubernetes入門（Open Source Conference 2023 Online/Hokkaido...
PGOを用いたPostgreSQL on Kubernetes入門（Open Source Conference 2023 Online/Hokkaido...PGOを用いたPostgreSQL on Kubernetes入門（Open Source Conference 2023 Online/Hokkaido...
PGOを用いたPostgreSQL on Kubernetes入門（Open Source Conference 2023 Online/Hokkaido...
NTT DATA Technology & Innovation
 
Spring Cloud Data Flow で構成される IIJ IoTサービス
Spring Cloud Data Flow で構成される IIJ IoTサービスSpring Cloud Data Flow で構成される IIJ IoTサービス
Spring Cloud Data Flow で構成される IIJ IoTサービス
Kenji Kondo
 
CloudNativePGを動かしてみた！ ～PostgreSQL on Kubernetes～（第34回PostgreSQLアンカンファレンス@オンライ...
CloudNativePGを動かしてみた！ ～PostgreSQL on Kubernetes～（第34回PostgreSQLアンカンファレンス@オンライ...CloudNativePGを動かしてみた！ ～PostgreSQL on Kubernetes～（第34回PostgreSQLアンカンファレンス@オンライ...
CloudNativePGを動かしてみた！ ～PostgreSQL on Kubernetes～（第34回PostgreSQLアンカンファレンス@オンライ...
NTT DATA Technology & Innovation
 
Apache Sparkに手を出してヤケドしないための基本 ～「Apache Spark入門より」～ （デブサミ 2016 講演資料）
Apache Sparkに手を出してヤケドしないための基本 ～「Apache Spark入門より」～ （デブサミ 2016 講演資料）Apache Sparkに手を出してヤケドしないための基本 ～「Apache Spark入門より」～ （デブサミ 2016 講演資料）
Apache Sparkに手を出してヤケドしないための基本 ～「Apache Spark入門より」～ （デブサミ 2016 講演資料）
NTT DATA OSS Professional Services
 
Introduction to RTI DDS
Introduction to RTI DDSIntroduction to RTI DDS
Introduction to RTI DDS
John Breitenbach
 
Oracle Cloud Infrastructure：2022年1月度サービス・アップデート
Oracle Cloud Infrastructure：2022年1月度サービス・アップデートOracle Cloud Infrastructure：2022年1月度サービス・アップデート
Oracle Cloud Infrastructure：2022年1月度サービス・アップデート
オラクルエンジニア通信
 

Viewers also liked (20)

Sph 107 Ch 15
Sph 107 Ch 15Sph 107 Ch 15
Sph 107 Ch 15
Bryant Hall
 
Introduction to OMG DDS (1 hour, 45 slides)
Introduction to OMG DDS (1 hour, 45 slides)Introduction to OMG DDS (1 hour, 45 slides)
Introduction to OMG DDS (1 hour, 45 slides)
Gerardo Pardo-Castellote
 
Embrace Change
Embrace ChangeEmbrace Change
Embrace Change
Angelo Corsaro
 
SPH 107 Ch 5
SPH 107 Ch 5SPH 107 Ch 5
SPH 107 Ch 5
Bryant Hall
 
Pintura 2 Eso
Pintura 2 EsoPintura 2 Eso
Pintura 2 Eso
Beatriz Burgos
 
CR4YR collaboration.Aug 2013, Oct Prince Rupert
CR4YR collaboration.Aug 2013, Oct Prince Rupert CR4YR collaboration.Aug 2013, Oct Prince Rupert
CR4YR collaboration.Aug 2013, Oct Prince Rupert
Faye Brownlie
 
Carols Presentation53
Carols Presentation53Carols Presentation53
Carols Presentation53
guest576d5
 
SharePoint + Silverlight - new BFF's by Wictor Wilén
SharePoint + Silverlight - new BFF's by Wictor WilénSharePoint + Silverlight - new BFF's by Wictor Wilén
SharePoint + Silverlight - new BFF's by Wictor Wilén
Wictor Wilén
 
GPA 1035: introduction
GPA 1035: introductionGPA 1035: introduction
GPA 1035: introduction
oiwan
 
How Do You Measure The Power Of Words
How Do You Measure The Power Of WordsHow Do You Measure The Power Of Words
How Do You Measure The Power Of Words
Prashant Gandhi
 
Rupert.Reading.Jan 2015
Rupert.Reading.Jan 2015 Rupert.Reading.Jan 2015
Rupert.Reading.Jan 2015
Faye Brownlie
 
ikp213-unifikasi
ikp213-unifikasiikp213-unifikasi
ikp213-unifikasi
Anung Ariwibowo
 
Rupert. 1st sessions.nov
Rupert. 1st sessions.novRupert. 1st sessions.nov
Rupert. 1st sessions.nov
Faye Brownlie
 
DDS Web Programming with dscript
DDS Web Programming with dscriptDDS Web Programming with dscript
DDS Web Programming with dscript
Angelo Corsaro
 
Belinda Love Photography
Belinda Love PhotographyBelinda Love Photography
Belinda Love Photography
Belinda Love
 
Mcm ottobre 11
Mcm ottobre 11Mcm ottobre 11
Mcm ottobre 11
Giulia Baccarin
 
Archydro
ArchydroArchydro
Archydro
abkhiz
 
Trail Of Tears
Trail Of TearsTrail Of Tears
Trail Of Tears
guest47b6d27
 
Don’t let Your Website Spread Malware – a New Approach to Web App Security
Don’t let Your Website Spread Malware – a New Approach to Web App SecurityDon’t let Your Website Spread Malware – a New Approach to Web App Security
Don’t let Your Website Spread Malware – a New Approach to Web App Security
Sasha Nunke
 
Carbonara coding
Carbonara codingCarbonara coding
Carbonara coding
Valentin Bora
 
Sph 107 Ch 15
Sph 107 Ch 15Sph 107 Ch 15
Sph 107 Ch 15
Bryant Hall
 
Introduction to OMG DDS (1 hour, 45 slides)
Introduction to OMG DDS (1 hour, 45 slides)Introduction to OMG DDS (1 hour, 45 slides)
Introduction to OMG DDS (1 hour, 45 slides)
Gerardo Pardo-Castellote
 
Embrace Change
Embrace ChangeEmbrace Change
Embrace Change
Angelo Corsaro
 
SPH 107 Ch 5
SPH 107 Ch 5SPH 107 Ch 5
SPH 107 Ch 5
Bryant Hall
 
Pintura 2 Eso
Pintura 2 EsoPintura 2 Eso
Pintura 2 Eso
Beatriz Burgos
 
CR4YR collaboration.Aug 2013, Oct Prince Rupert
CR4YR collaboration.Aug 2013, Oct Prince Rupert CR4YR collaboration.Aug 2013, Oct Prince Rupert
CR4YR collaboration.Aug 2013, Oct Prince Rupert
Faye Brownlie
 
Carols Presentation53
Carols Presentation53Carols Presentation53
Carols Presentation53
guest576d5
 
SharePoint + Silverlight - new BFF's by Wictor Wilén
SharePoint + Silverlight - new BFF's by Wictor WilénSharePoint + Silverlight - new BFF's by Wictor Wilén
SharePoint + Silverlight - new BFF's by Wictor Wilén
Wictor Wilén
 
GPA 1035: introduction
GPA 1035: introductionGPA 1035: introduction
GPA 1035: introduction
oiwan
 
How Do You Measure The Power Of Words
How Do You Measure The Power Of WordsHow Do You Measure The Power Of Words
How Do You Measure The Power Of Words
Prashant Gandhi
 
Rupert.Reading.Jan 2015
Rupert.Reading.Jan 2015 Rupert.Reading.Jan 2015
Rupert.Reading.Jan 2015
Faye Brownlie
 
ikp213-unifikasi
ikp213-unifikasiikp213-unifikasi
ikp213-unifikasi
Anung Ariwibowo
 
Rupert. 1st sessions.nov
Rupert. 1st sessions.novRupert. 1st sessions.nov
Rupert. 1st sessions.nov
Faye Brownlie
 
DDS Web Programming with dscript
DDS Web Programming with dscriptDDS Web Programming with dscript
DDS Web Programming with dscript
Angelo Corsaro
 
Belinda Love Photography
Belinda Love PhotographyBelinda Love Photography
Belinda Love Photography
Belinda Love
 
Mcm ottobre 11
Mcm ottobre 11Mcm ottobre 11
Mcm ottobre 11
Giulia Baccarin
 
Archydro
ArchydroArchydro
Archydro
abkhiz
 
Trail Of Tears
Trail Of TearsTrail Of Tears
Trail Of Tears
guest47b6d27
 
Don’t let Your Website Spread Malware – a New Approach to Web App Security
Don’t let Your Website Spread Malware – a New Approach to Web App SecurityDon’t let Your Website Spread Malware – a New Approach to Web App Security
Don’t let Your Website Spread Malware – a New Approach to Web App Security
Sasha Nunke
 
Carbonara coding
Carbonara codingCarbonara coding
Carbonara coding
Valentin Bora
 
Ad

Similar to OMG DDS Tutorial - Part I (20)

OMG DDS: The Data Distribution Service for Real-Time Systems
OMG DDS: The Data Distribution Service for Real-Time SystemsOMG DDS: The Data Distribution Service for Real-Time Systems
OMG DDS: The Data Distribution Service for Real-Time Systems
Angelo Corsaro
 
DDS in SCADA, Utilities, Smart Grid and Smart Cities
DDS in SCADA, Utilities, Smart Grid and Smart CitiesDDS in SCADA, Utilities, Smart Grid and Smart Cities
DDS in SCADA, Utilities, Smart Grid and Smart Cities
Angelo Corsaro
 
Getting Started with OpenSplice DDS Community Ed.
Getting Started with OpenSplice DDS Community Ed.Getting Started with OpenSplice DDS Community Ed.
Getting Started with OpenSplice DDS Community Ed.
Angelo Corsaro
 
A Gentle Introduction to OpenSplice DDS
A Gentle Introduction to OpenSplice DDSA Gentle Introduction to OpenSplice DDS
A Gentle Introduction to OpenSplice DDS
Angelo Corsaro
 
The Data Distribution Service
The Data Distribution ServiceThe Data Distribution Service
The Data Distribution Service
Angelo Corsaro
 
High Performance Distributed Computing with DDS and Scala
High Performance Distributed Computing with DDS and ScalaHigh Performance Distributed Computing with DDS and Scala
High Performance Distributed Computing with DDS and Scala
Angelo Corsaro
 
Introducing the OMG DDS to the Aerospace Valley
Introducing the OMG DDS to the Aerospace Valley Introducing the OMG DDS to the Aerospace Valley
Introducing the OMG DDS to the Aerospace Valley
Angelo Corsaro
 
Getting Started with DDS in C++, Java and Scala
Getting Started with DDS in C++, Java and ScalaGetting Started with DDS in C++, Java and Scala
Getting Started with DDS in C++, Java and Scala
Angelo Corsaro
 
OMG DDS and its Relation to Unmanned Vehicle Interoperability
OMG DDS and its Relation to Unmanned Vehicle InteroperabilityOMG DDS and its Relation to Unmanned Vehicle Interoperability
OMG DDS and its Relation to Unmanned Vehicle Interoperability
Gerardo Pardo-Castellote
 
RTI Data-Distribution Service (DDS) Master Class - 2010
RTI Data-Distribution Service (DDS) Master Class - 2010RTI Data-Distribution Service (DDS) Master Class - 2010
RTI Data-Distribution Service (DDS) Master Class - 2010
Gerardo Pardo-Castellote
 
The Network Enabled EOC
The Network Enabled EOCThe Network Enabled EOC
The Network Enabled EOC
Cisco Crisis Response
 
Tuning and Troubleshooting OpenSplice DDS Applications
Tuning and Troubleshooting OpenSplice DDS ApplicationsTuning and Troubleshooting OpenSplice DDS Applications
Tuning and Troubleshooting OpenSplice DDS Applications
Angelo Corsaro
 
Communication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/SubscribeCommunication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/Subscribe
Sumant Tambe
 
Communication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/SubscribeCommunication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/Subscribe
Real-Time Innovations (RTI)
 
The Promise of Interoperability
The Promise of InteroperabilityThe Promise of Interoperability
The Promise of Interoperability
Real-Time Innovations (RTI)
 
Data Center In Healthcare Presentation 02 12
Data Center In Healthcare Presentation 02 12Data Center In Healthcare Presentation 02 12
Data Center In Healthcare Presentation 02 12
todmoore
 
Network automation seminar
Network automation seminarNetwork automation seminar
Network automation seminar
patmisasi
 
Gef 2012 InduSoft Presentation
Gef 2012 InduSoft PresentationGef 2012 InduSoft Presentation
Gef 2012 InduSoft Presentation
AVEVA
 
Building and Deploying OpenSplice DDS Based Cloud Messaging
Building and Deploying OpenSplice DDS Based Cloud Messaging Building and Deploying OpenSplice DDS Based Cloud Messaging
Building and Deploying OpenSplice DDS Based Cloud Messaging
Angelo Corsaro
 
Introduction to DDS
Introduction to DDSIntroduction to DDS
Introduction to DDS
Rick Warren
 
OMG DDS: The Data Distribution Service for Real-Time Systems
OMG DDS: The Data Distribution Service for Real-Time SystemsOMG DDS: The Data Distribution Service for Real-Time Systems
OMG DDS: The Data Distribution Service for Real-Time Systems
Angelo Corsaro
 
DDS in SCADA, Utilities, Smart Grid and Smart Cities
DDS in SCADA, Utilities, Smart Grid and Smart CitiesDDS in SCADA, Utilities, Smart Grid and Smart Cities
DDS in SCADA, Utilities, Smart Grid and Smart Cities
Angelo Corsaro
 
Getting Started with OpenSplice DDS Community Ed.
Getting Started with OpenSplice DDS Community Ed.Getting Started with OpenSplice DDS Community Ed.
Getting Started with OpenSplice DDS Community Ed.
Angelo Corsaro
 
A Gentle Introduction to OpenSplice DDS
A Gentle Introduction to OpenSplice DDSA Gentle Introduction to OpenSplice DDS
A Gentle Introduction to OpenSplice DDS
Angelo Corsaro
 
The Data Distribution Service
The Data Distribution ServiceThe Data Distribution Service
The Data Distribution Service
Angelo Corsaro
 
High Performance Distributed Computing with DDS and Scala
High Performance Distributed Computing with DDS and ScalaHigh Performance Distributed Computing with DDS and Scala
High Performance Distributed Computing with DDS and Scala
Angelo Corsaro
 
Introducing the OMG DDS to the Aerospace Valley
Introducing the OMG DDS to the Aerospace Valley Introducing the OMG DDS to the Aerospace Valley
Introducing the OMG DDS to the Aerospace Valley
Angelo Corsaro
 
Getting Started with DDS in C++, Java and Scala
Getting Started with DDS in C++, Java and ScalaGetting Started with DDS in C++, Java and Scala
Getting Started with DDS in C++, Java and Scala
Angelo Corsaro
 
OMG DDS and its Relation to Unmanned Vehicle Interoperability
OMG DDS and its Relation to Unmanned Vehicle InteroperabilityOMG DDS and its Relation to Unmanned Vehicle Interoperability
OMG DDS and its Relation to Unmanned Vehicle Interoperability
Gerardo Pardo-Castellote
 
RTI Data-Distribution Service (DDS) Master Class - 2010
RTI Data-Distribution Service (DDS) Master Class - 2010RTI Data-Distribution Service (DDS) Master Class - 2010
RTI Data-Distribution Service (DDS) Master Class - 2010
Gerardo Pardo-Castellote
 
The Network Enabled EOC
The Network Enabled EOCThe Network Enabled EOC
The Network Enabled EOC
Cisco Crisis Response
 
Tuning and Troubleshooting OpenSplice DDS Applications
Tuning and Troubleshooting OpenSplice DDS ApplicationsTuning and Troubleshooting OpenSplice DDS Applications
Tuning and Troubleshooting OpenSplice DDS Applications
Angelo Corsaro
 
Communication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/SubscribeCommunication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/Subscribe
Sumant Tambe
 
Communication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/SubscribeCommunication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/Subscribe
Real-Time Innovations (RTI)
 
The Promise of Interoperability
The Promise of InteroperabilityThe Promise of Interoperability
The Promise of Interoperability
Real-Time Innovations (RTI)
 
Data Center In Healthcare Presentation 02 12
Data Center In Healthcare Presentation 02 12Data Center In Healthcare Presentation 02 12
Data Center In Healthcare Presentation 02 12
todmoore
 
Network automation seminar
Network automation seminarNetwork automation seminar
Network automation seminar
patmisasi
 
Gef 2012 InduSoft Presentation
Gef 2012 InduSoft PresentationGef 2012 InduSoft Presentation
Gef 2012 InduSoft Presentation
AVEVA
 
Building and Deploying OpenSplice DDS Based Cloud Messaging
Building and Deploying OpenSplice DDS Based Cloud Messaging Building and Deploying OpenSplice DDS Based Cloud Messaging
Building and Deploying OpenSplice DDS Based Cloud Messaging
Angelo Corsaro
 
Introduction to DDS
Introduction to DDSIntroduction to DDS
Introduction to DDS
Rick Warren
 
Ad

More from Angelo Corsaro (20)

Zenoh: The Genesis
Zenoh: The GenesisZenoh: The Genesis
Zenoh: The Genesis
Angelo Corsaro
 
zenoh: The Edge Data Fabric
zenoh: The Edge Data Fabriczenoh: The Edge Data Fabric
zenoh: The Edge Data Fabric
Angelo Corsaro
 
Zenoh Tutorial
Zenoh TutorialZenoh Tutorial
Zenoh Tutorial
Angelo Corsaro
 
Data Decentralisation: Efficiency, Privacy and Fair Monetisation
Data Decentralisation: Efficiency, Privacy and Fair MonetisationData Decentralisation: Efficiency, Privacy and Fair Monetisation
Data Decentralisation: Efficiency, Privacy and Fair Monetisation
Angelo Corsaro
 
zenoh: zero overhead pub/sub store/query compute
zenoh: zero overhead pub/sub store/query computezenoh: zero overhead pub/sub store/query compute
zenoh: zero overhead pub/sub store/query compute
Angelo Corsaro
 
zenoh -- the ZEro Network OverHead protocol
zenoh -- the ZEro Network OverHead protocolzenoh -- the ZEro Network OverHead protocol
zenoh -- the ZEro Network OverHead protocol
Angelo Corsaro
 
zenoh -- the ZEro Network OverHead protocol
zenoh -- the ZEro Network OverHead protocolzenoh -- the ZEro Network OverHead protocol
zenoh -- the ZEro Network OverHead protocol
Angelo Corsaro
 
Breaking the Edge -- A Journey Through Cloud, Edge and Fog Computing
Breaking the Edge -- A Journey Through Cloud, Edge and Fog ComputingBreaking the Edge -- A Journey Through Cloud, Edge and Fog Computing
Breaking the Edge -- A Journey Through Cloud, Edge and Fog Computing
Angelo Corsaro
 
Eastern Sicily
Eastern SicilyEastern Sicily
Eastern Sicily
Angelo Corsaro
 
fog05: The Fog Computing Infrastructure
fog05: The Fog Computing Infrastructurefog05: The Fog Computing Infrastructure
fog05: The Fog Computing Infrastructure
Angelo Corsaro
 
fog05: The Fog Computing Platform
fog05: The Fog Computing Platformfog05: The Fog Computing Platform
fog05: The Fog Computing Platform
Angelo Corsaro
 
Programming in Scala - Lecture Four
Programming in Scala - Lecture FourProgramming in Scala - Lecture Four
Programming in Scala - Lecture Four
Angelo Corsaro
 
Programming in Scala - Lecture Three
Programming in Scala - Lecture ThreeProgramming in Scala - Lecture Three
Programming in Scala - Lecture Three
Angelo Corsaro
 
Programming in Scala - Lecture Two
Programming in Scala - Lecture TwoProgramming in Scala - Lecture Two
Programming in Scala - Lecture Two
Angelo Corsaro
 
Programming in Scala - Lecture One
Programming in Scala - Lecture OneProgramming in Scala - Lecture One
Programming in Scala - Lecture One
Angelo Corsaro
 
Data Sharing in Extremely Resource Constrained Envionrments
Data Sharing in Extremely Resource Constrained EnvionrmentsData Sharing in Extremely Resource Constrained Envionrments
Data Sharing in Extremely Resource Constrained Envionrments
Angelo Corsaro
 
The DDS Security Standard
The DDS Security StandardThe DDS Security Standard
The DDS Security Standard
Angelo Corsaro
 
The Data Distribution Service
The Data Distribution ServiceThe Data Distribution Service
The Data Distribution Service
Angelo Corsaro
 
RUSTing -- Partially Ordered Rust Programming Ruminations
RUSTing -- Partially Ordered Rust Programming RuminationsRUSTing -- Partially Ordered Rust Programming Ruminations
RUSTing -- Partially Ordered Rust Programming Ruminations
Angelo Corsaro
 
Vortex II -- The Industrial IoT Connectivity Standard
Vortex II -- The Industrial IoT Connectivity StandardVortex II -- The Industrial IoT Connectivity Standard
Vortex II -- The Industrial IoT Connectivity Standard
Angelo Corsaro
 
Zenoh: The Genesis
Zenoh: The GenesisZenoh: The Genesis
Zenoh: The Genesis
Angelo Corsaro
 
zenoh: The Edge Data Fabric
zenoh: The Edge Data Fabriczenoh: The Edge Data Fabric
zenoh: The Edge Data Fabric
Angelo Corsaro
 
Zenoh Tutorial
Zenoh TutorialZenoh Tutorial
Zenoh Tutorial
Angelo Corsaro
 
Data Decentralisation: Efficiency, Privacy and Fair Monetisation
Data Decentralisation: Efficiency, Privacy and Fair MonetisationData Decentralisation: Efficiency, Privacy and Fair Monetisation
Data Decentralisation: Efficiency, Privacy and Fair Monetisation
Angelo Corsaro
 
zenoh: zero overhead pub/sub store/query compute
zenoh: zero overhead pub/sub store/query computezenoh: zero overhead pub/sub store/query compute
zenoh: zero overhead pub/sub store/query compute
Angelo Corsaro
 
zenoh -- the ZEro Network OverHead protocol
zenoh -- the ZEro Network OverHead protocolzenoh -- the ZEro Network OverHead protocol
zenoh -- the ZEro Network OverHead protocol
Angelo Corsaro
 
zenoh -- the ZEro Network OverHead protocol
zenoh -- the ZEro Network OverHead protocolzenoh -- the ZEro Network OverHead protocol
zenoh -- the ZEro Network OverHead protocol
Angelo Corsaro
 
Breaking the Edge -- A Journey Through Cloud, Edge and Fog Computing
Breaking the Edge -- A Journey Through Cloud, Edge and Fog ComputingBreaking the Edge -- A Journey Through Cloud, Edge and Fog Computing
Breaking the Edge -- A Journey Through Cloud, Edge and Fog Computing
Angelo Corsaro
 
Eastern Sicily
Eastern SicilyEastern Sicily
Eastern Sicily
Angelo Corsaro
 
fog05: The Fog Computing Infrastructure
fog05: The Fog Computing Infrastructurefog05: The Fog Computing Infrastructure
fog05: The Fog Computing Infrastructure
Angelo Corsaro
 
fog05: The Fog Computing Platform
fog05: The Fog Computing Platformfog05: The Fog Computing Platform
fog05: The Fog Computing Platform
Angelo Corsaro
 
Programming in Scala - Lecture Four
Programming in Scala - Lecture FourProgramming in Scala - Lecture Four
Programming in Scala - Lecture Four
Angelo Corsaro
 
Programming in Scala - Lecture Three
Programming in Scala - Lecture ThreeProgramming in Scala - Lecture Three
Programming in Scala - Lecture Three
Angelo Corsaro
 
Programming in Scala - Lecture Two
Programming in Scala - Lecture TwoProgramming in Scala - Lecture Two
Programming in Scala - Lecture Two
Angelo Corsaro
 
Programming in Scala - Lecture One
Programming in Scala - Lecture OneProgramming in Scala - Lecture One
Programming in Scala - Lecture One
Angelo Corsaro
 
Data Sharing in Extremely Resource Constrained Envionrments
Data Sharing in Extremely Resource Constrained EnvionrmentsData Sharing in Extremely Resource Constrained Envionrments
Data Sharing in Extremely Resource Constrained Envionrments
Angelo Corsaro
 
The DDS Security Standard
The DDS Security StandardThe DDS Security Standard
The DDS Security Standard
Angelo Corsaro
 
The Data Distribution Service
The Data Distribution ServiceThe Data Distribution Service
The Data Distribution Service
Angelo Corsaro
 
RUSTing -- Partially Ordered Rust Programming Ruminations
RUSTing -- Partially Ordered Rust Programming RuminationsRUSTing -- Partially Ordered Rust Programming Ruminations
RUSTing -- Partially Ordered Rust Programming Ruminations
Angelo Corsaro
 
Vortex II -- The Industrial IoT Connectivity Standard
Vortex II -- The Industrial IoT Connectivity StandardVortex II -- The Industrial IoT Connectivity Standard
Vortex II -- The Industrial IoT Connectivity Standard
Angelo Corsaro
 

Recently uploaded (20)

#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
BookNet Canada
 
AI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global TrendsAI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global Trends
InData Labs
 
Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)
Ortus Solutions, Corp
 
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Big Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur MorganBig Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur Morgan
Arthur Morgan
 
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxIncreasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Anoop Ashok
 
How analogue intelligence complements AI
How analogue intelligence complements AIHow analogue intelligence complements AI
How analogue intelligence complements AI
Paul Rowe
 
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptx
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxDevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptx
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptx
Justin Reock
 
How Can I use the AI Hype in my Business Context?
How Can I use the AI Hype in my Business Context?How Can I use the AI Hype in my Business Context?
How Can I use the AI Hype in my Business Context?
Daniel Lehner
 
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveDesigning Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
ScyllaDB
 
Drupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy ConsumptionDrupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy Consumption
Exove
 
HCL Nomad Web – Best Practices and Managing Multiuser Environments
HCL Nomad Web – Best Practices and Managing Multiuser EnvironmentsHCL Nomad Web – Best Practices and Managing Multiuser Environments
HCL Nomad Web – Best Practices and Managing Multiuser Environments
panagenda
 
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfSAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
Precisely
 
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfThe Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
Abi john
 
Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.
hpbmnnxrvb
 
Linux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded DevelopersLinux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded Developers
Toradex
 
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
Alan Dix
 
Heap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and DeletionHeap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and Deletion
Jaydeep Kale
 
ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes Partner Innovation Updates for May 2025ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes
 
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
BookNet Canada
 
AI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global TrendsAI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global Trends
InData Labs
 
Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)
Ortus Solutions, Corp
 
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Big Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur MorganBig Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur Morgan
Arthur Morgan
 
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxIncreasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Anoop Ashok
 
How analogue intelligence complements AI
How analogue intelligence complements AIHow analogue intelligence complements AI
How analogue intelligence complements AI
Paul Rowe
 
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptx
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxDevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptx
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptx
Justin Reock
 
How Can I use the AI Hype in my Business Context?
How Can I use the AI Hype in my Business Context?How Can I use the AI Hype in my Business Context?
How Can I use the AI Hype in my Business Context?
Daniel Lehner
 
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveDesigning Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
ScyllaDB
 
Drupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy ConsumptionDrupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy Consumption
Exove
 
HCL Nomad Web – Best Practices and Managing Multiuser Environments
HCL Nomad Web – Best Practices and Managing Multiuser EnvironmentsHCL Nomad Web – Best Practices and Managing Multiuser Environments
HCL Nomad Web – Best Practices and Managing Multiuser Environments
panagenda
 
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfSAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
Precisely
 
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfThe Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
Abi john
 
Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.
hpbmnnxrvb
 
Linux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded DevelopersLinux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded Developers
Toradex
 
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
Alan Dix
 
Heap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and DeletionHeap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and Deletion
Jaydeep Kale
 
ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes Partner Innovation Updates for May 2025ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes
 

OMG DDS Tutorial - Part I

  • 1. OpenSplice DDS Delivering Performance, Openness, and Freedom Angelo Corsaro, Ph.D. Product Strategy & Marketing Manager OMG DDS Tutorial - Part I OMG RTESS and DDS SIG Co-Chair [email protected]
  • 2. Motivating Forces The Standard Agenda Architectural Principles Programming Model Concluding Remarks
  • 3. The Need for Data Distribution Time Scale Geographical Scale Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Parallelism Determinism Throughput, Availability Scalability, Persistence, Security Systemic Real-Time Near Real-Time Fault- Data Complex Information Signal Information Tolerant Information Processing Processing Management Processing Processing Data Distribution Parallel Systems Distributed Systems © 2009, PrismTech. All Rights Reserved
  • 4. Data Exchange / Distribution ‣ Network Centric Architectures are emerging as a key trend for next generation military and civil system of systems ‣ Efficient, scalable and QoS-enabled data dissemination is an enabling technology for Network Centric Systems Joint Forces Joint Forces Global Info Grid Global Info Grid Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Adapted from “The Future of AWACS”, by LtCol Joe Chapa The Right Information => To the Right People => At the Right Time © 2009, PrismTech. All Rights Reserved
  • 5. Motivating Forces The Standard Agenda Architectural Principles Programming Model Concluding Remarks
  • 6. Addressing Data Distribution Challenges DDS is standard designed to address the data-distribution challenges across The OMG DDS Standard a wide class of Defense and Aerospace Applications ‣ Introduced in 2004 to address the Data Distribution challenges faced by a wide class of Defense and Aerospace Applications Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ Key requirement for the standard were its ability to deliver very high performance while seamlessly scaling from embedded to ultra- large-scale deployments ‣ Today recommended by key administration worldwide and widely adopted across several different application domains, such as, Automated Trading, Simulations, SCADA, Telemetry, etc. © 2009, PrismTech. All Rights Reserved
  • 7. The OMG Data Distribution Service (DDS) DDS v1.2 API Standard ‣ Language Independent, OS and HW architecture Application independent Object/Relational Mapping ‣ DCPS. Standard API for Data-Centric, Topic- Data Local Reconstruction Layer (DLRL) Based, Real-Time Publish/Subscribe Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Content ‣ Ownership Durability DLRL. Standard API for creating Object Views out Subscription of collection of Topics Minimum Profile Data Centric Publish/Subscribe (DCPS) DDSI/RTPS v2.1 Wire Protocol Standard ‣ Standard wire protocol allowing interoperability Real-Time Publish/Subscribe Protocol DDS Interoperability Wire Protocol between different implementations of the DDS standard UDP/IP © 2009, PrismTech. All Rights Reserved
  • 8. OMG DDS Recommendations is churning… ! The infrastructure evolution cycle – New -> Emerging -> Standard -> Commodity – Middleware is emerging as Mandated/Recommended by key Administrations OS declines ! …DDS is maturing… ‣ US Navy: Open Architecture focus – OMG – Wire spec Proprietary Information - Distribution without Expressed Written Permission is Prohibited. – Tools ‣ DISR/DISA: Net-centric Systems – Enterprise integration – Multiple products fielded ‣ EuroControl: Air Traffic Control Center Operational – Deployed applications! Interoperability ! …and adoption is on the rise – Navy for VSI ‣ QinetiQ: Recommending DDS – DISR – FCS/SoSCOE – Many significant applications © 2009, PrismTech. All Rights Reserved
  • 9. OMG DDS Adoptions Adopted by Most Challenging International Programs ‣ US FCS/SOSCOE Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ European Next Generation Flight Data Processor ‣ US ZUMWALT [DDG(1000)] ‣ VTID adopting DDS for the architectural demonstrator © 2009, PrismTech. All Rights Reserved
  • 10. OMG DDS Applicability Adapted from NSWC-DD Open Architecture Documentation Communication Technologies Standards Web SVCs The DDS is the only technology that spans across Java RTSJ the board. Proprietary Information - Distribution without Expressed Written Permission is Prohibited. JMS It guarantees exceptional real- time behavior, CORBA RT-CORBA while providing unparalleled level OMG Data Distribution Service (DDS) of throughput ! MPI Message Passing Interface Non Real-Time Soft Real-Time Hard Real-Time Extreme Real-Time © 2009, PrismTech. All Rights Reserved
  • 11. Some DDS Use Cases Defense ‣ Combat Management Systems ‣ Flycatcher system ‣ Unmanned Vehicles (Air + Land) ‣ Tactical Links Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ Radar Processing ‣ Submarine Systems ‣ Future Combat Systems ‣ Simulation SCADA/Utilities ‣ Industrial Automation ‣ Power Grids ‣ Rocket Launch Systems © 2009, PrismTech. All Rights Reserved
  • 12. Some DDS Use Cases Transportation ‣ Air Traffic Management/Control ‣ Metropolitan Traffic Management ‣ Underground Metropolitan Transportation Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Financial Services ‣ Automated Trading Firms ‣ Compliance Systems ‣ Market Data Platforms © 2009, PrismTech. All Rights Reserved
  • 13. Motivating Forces The Standard Agenda Architectural Principles Programming Model Concluding Remarks
  • 14. OpenSplice DDS Delivering Performance, Openness, and Freedom Loosely Coupled Technology
  • 15. Counting the “W’s” of Coupling Request Client Server The “4Ws” of Client/Server Reply ‣ Who+Where: Space Coupling ‣ What: Structural Coupling Client/Server ‣ When: Time Coupling CORBA, COM+, Java RMI, .Net Remoting, Web SVCs Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Subscriber Publisher Subscriber A Single “W” for DDS Publisher ‣ What: Structural Coupling Subscriber Publisher DDS Subscriber DDS features dynamic discovery and full time decoupling! © 2009, PrismTech. All Rights Reserved
  • 16. DDS vs. Client-Server Server Client/Server Server Client ‣ Tight Coupling (4W) Client ‣ Complex Deployment Server ‣ Inherently One-to-One Server ‣ Fragile to Fault Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Client Client © 2009, PrismTech. All Rights Reserved
  • 17. Counting the “W’s” of Coupling Server Client/Server Server Client ‣ Tight Coupling (4W) Client ‣ Complex Deployment Server ‣ Inherently One-to-One Server ‣ Fragile to Fault Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Client Client Subscriber Publisher DDS Subscriber ‣ Loosely Coupled (1W) Publisher ‣ Plug & Play ‣ Inherently Many-to-Many Subscriber ‣ Fault Resilient Publisher Subscriber © 2009, PrismTech. All Rights Reserved
  • 18. OpenSplice DDS Delivering Performance, Openness, and Freedom High Performance/Availability Pub/Sub
  • 19. High Performance Pub/Sub The right data, at the right place, at the right time ‣ Fully distributed, Peer-to-Peer -- All the Time. Communication ‣ No Single Point of Failure Publisher Subscriber ‣ No Single Point of Bottleneck Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ Multicast-enabled Brokers Subscriber ‣ High performance and highly Publisher scalable ‣ High availability Publisher ‣hot-swap Subscriber ‣hot-hot architecture © 2009, PrismTech. All Rights Reserved
  • 20. OpenSplice DDS Delivering Performance, Openness, and Freedom Application Ownership Object/Relational Mapping Data Local Reconstruction Layer (DLRL) Durability Content Data-Centric Pub/Sub Subscription Minimum Profile Data Centric Publish/Subscribe (DCPS) Real-Time Publish/Subscribe Protocol DDS Interoperability Wire Protocol UDP/IP
  • 21. Data-Centric Pub/Sub ‣ Data-Centric Features are built-in and don’t rely on an external DBMS ‣ Providing thus performance, scalability, and availability ‣ Distributed Relational Data Model Subscriber Publisher DBMS ‣ Local Queries B ‣ Continuous Queries / Content Based Proprietary Information - Distribution without Expressed Written Permission is Prohibited. m Subscriptions A F Subscriber ‣ Windows Publisher J D C ‣ Object/Relational Mapping K E ‣ Support for a subset of SQL-92 Publisher Subscriber Perfect Blend of Data-Centric and Real-Time Publish/Subscribe Technologies © 2009, PrismTech. All Rights Reserved
  • 22. “Visualizing” Data-Centric Pub/Sub Subscriber Publisher B D J D C E K A B A B Proprietary Information - Distribution without Expressed Written Permission is Prohibited. m Subscriber D C Publisher A F J J A F D C K A F K E Subscriber Publisher D J D K E E © 2009, PrismTech. All Rights Reserved
  • 23. Organizing Information ‣ All DDS communication is Domain Partition happens within a Domain ‣ Domain can divided into Publisher Subscriber Partitions Proprietary Information - Distribution without Expressed Written Permission is Prohibited. B ‣ Topics are published and m subscribed across on or A F Subscriber more Partitions Publisher J D C K E Publisher Subscriber © 2009, PrismTech. All Rights Reserved
  • 24. Topics and Data-Centric Pub/Sub ‣ Topics. Unit of information exchanged between Publisher and Subscribers. Topic ‣ Data Types. Type associated to a Topic must be a structured type expressed in IDL struct TempSensor { long tID; Topic Type float temp; ‣ Topic Instances. Key values in a datatype Proprietary Information - Distribution without Expressed Written Permission is Prohibited. float humidity; uniquely identify a Topic Instance (like rows in }; table) #pragma keylist TempSensor tID TempSensor ‣ Content Awareness. SQL Expressions can be tID temp humidity used to do content-aware subscriptions, Instances 1 21 62 2 27 78 queries, joins, and correlate topic instances 3 25.5 72.3 y idit idit y ity SELECT * FROM TempSensor t um Samples mid h um hu 62 h 65 63 WHERE t.temp > 25 p p tem tem p tem 21 22 tID 23 tID tID temp humidity tID 1 1 1 2 27 78 3 25.5 72.3 t1 t2 t3 Time © 2009, PrismTech. All Rights Reserved
  • 25. Distributed Relational Information Modeling ‣ Topic Keys can be used to identify instances as well as relationships ‣ Relationships can be navigated by relying on a subset of SQL 92 ‣ One-to-many relationships can be captured using foreign keys ‣ Many-to-many relationships need to be modeled using a topics Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ Keys can be represented by an arbitrary number of Topic fields TempSensor Room Floor tID: int rID: int fID: int temp: float width: float level: int humidity: float height: float open: int rID: int length: float fID: int © 2009, PrismTech. All Rights Reserved
  • 26. Data Centric Publish/Subscribe Publishers Subscribers TempSensor TempSensor tID temp humidity tID temp humidity 1 18 60 1 18 60 2 22 75 3 21 71 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. struct TempSensor { TempSensor int tID; float temp; TempSensor tID temp humidity float humidity; tID temp humidity 2 22 75 }; 2 22 75 #pragma keylist TempSensor tID 3 21 71 SELECT * FROM TempSensor t WHERE s.temp > 20 s.t TempSensor ID == tID temp humidity Fully Distributed Global 1 TempSensor 3 21 71 Data Space tID temp humidity 1 18 60 © 2009, PrismTech. All Rights Reserved
  • 27. Data Centric Publish/Subscribe Publishers Subscribers TempSensor TempSensor tID temp humidity tID temp humidity 1 21 62 1 21 62 2 22 75 3 21 71 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. struct TempSensor { TempSensor int tID; float temp; TempSensor tID temp humidity float humidity; 2 22 75 tID temp humidity }; #pragma keylist TempSensor tID 1 21 62 2 22 75 3 21 71 SELECT * FROM TempSensor t s.t WHERE s.temp > 20 TempSensor ID == tID temp humidity Fully Distributed Global 1 TempSensor 3 21 71 Data Space tID temp humidity 1 21 62 © 2009, PrismTech. All Rights Reserved
  • 28. Processing Content & Structure Complex Event Processing... ‣ Local Queries DDS provides some of the most useful features found in Complex Event Processing platforms! ‣ Continuous Queries (Content-based Subscriptions) ‣ Topics Joins & Projections ‣ Events windows (via History QoS) Proprietary Information - Distribution without Expressed Written Permission is Prohibited. tID temp humidity S1 3 21.5 72.3 tID temp humidity {iID = 1} 2 20 78 tID temp humidity 1 21 62 S2 P {temp > 21 | humidity > 75} S3 { temp <16 } © 2009, PrismTech. All Rights Reserved
  • 29. Processing Content & Structure Complex Event Processing... ‣ Local Queries DDS provides some of the most useful features found in Complex Event Processing platforms! ‣ Continuous Queries (Content-based Subscriptions) ‣ Topics Joins & Projections ‣ Events windows (via History QoS) Proprietary Information - Distribution without Expressed Written Permission is Prohibited. tID temp humidity 1 21 62 S1 {iID = 1} tID temp humidity 2 20 78 3 21.5 72.3 S2 P {temp > 21 | humidity > 75} S3 { temp <16 } © 2009, PrismTech. All Rights Reserved
  • 30. OpenSplice DDS Delivering Performance, Openness, and Freedom Application Ownership Object/Relational Mapping Data Local Reconstruction Layer (DLRL) Durability Content Object-Oriented Pub/Sub Subscription Minimum Profile Data Centric Publish/Subscribe (DCPS) Real-Time Publish/Subscribe Protocol DDS Interoperability Wire Protocol UDP/IP
  • 31. Object/Relational Mapping TempSensor temp: float humidity: float ‣ Automatically bridges the getTemp() getHumidity() * Room Floor 1 width: float level: int Object/Relational Impedance height: float length: float * open: int 1 climate: int Conditioner Mismatch temp: float humidity: float 1 climate: int set_climate(); set_status() set_climate() * ‣ Arbitrary object setTemp() get_level() Proprietary Information - Distribution without Expressed Written Permission is Prohibited. setHumidity() setFanLevel() reconstructions start() stop() ‣ Automatic Relationships pause(): Management TConditioner cID: int TTempSernsor ‣ Inheritance temp: float tID: int humidity: float temp: float fan_level: int TRoom humidity: float ‣ Local Operations status: int rID: int rID: int width: float height: float rID: int ‣ Local/Distributed State length: float fID: int TFloor fID: int level: int open: int © 2009, PrismTech. All Rights Reserved
  • 32. Object/Relational Mapping Unleashing the power of Objects... Object Oriented Canvas OO Relational handle: Handle ‣ Middleware can automatically Flight RadarTrack manage the generation and FlightView call_sign: string x: float image: string route: list association between the refresh_rate: int * origin: string y: float * z: float * 1 Object-Oriented Model and the visible: bool dest: string radar_id: string Relational Model uid: GUID aircraft: string operationOne() display() operationX() operationTwo() Proprietary Information - Distribution without Expressed Written Permission is Prohibited. operationY() FlightViewTopic FlightViewAssociation FlightTopic Relational call_sign: string image: string call_sign: string route: list RadarTrackTopic refresh_rate: int uid: GUID origin: string x: float visible: bool handle: Handle dest: string y: float uid: GUID aircraft: string z: float radar_id: string radar_id: string Relational OO ‣ The Relational Model can be mapped to an Object Oriented model ‣ The mapping is under control of the architect © 2009, PrismTech. All Rights Reserved
  • 33. Multiple Object/Relational Mappings Canvas FastFlightView image: string handle: Handle DLRL DLRL refresh_rate: int visible: bool Flight uid: GUID RadarTrack FlightView call_sign: string x: float x: float image: string route: list y: float y: float refresh_rate: int * * origin: string 1 * z: float z: float visible: bool dest: string call_sign: string radar_id: string uid: GUID aircraft: string display() operationOne() Proprietary Information - Distribution without Expressed Written Permission is Prohibited. display() operationX() operationTwo() operationY() FlightViewTopic FlightViewAssociation FlightTopic DCPS call_sign: string image: string call_sign: string route: list RadarTrackTopic refresh_rate: int uid: GUID origin: string x: float visible: bool handle: Handle dest: string y: float uid: GUID aircraft: string z: float radar_id: string radar_id: string Multiple Mappings ‣ Different Object/Relatioal Mappings (ORM) can be used for different subsystems ‣ The state is shared across all the local reconstruction (ORMs) © 2009, PrismTech. All Rights Reserved
  • 34. An Example High-End 3D Visualization Primary Radar RadarTrack x: float y: float z: float radar_id: string operationOne() operationTwo() Proprietary Information - Distribution without Expressed Written Permission is Prohibited. FastFlightView RadarTrackTopic x: float image: string y: float refresh_rate: int FlightViewTopic image: string z: float radar_id: string visible: bool refresh_rate: int visible: bool uid: GUID uid: GUID x: float y: float RadarTrackTopic x: float z: float y: float z: float call_sign: string radar_id: string display() RadarTrackTopic x: float y: float FlightTopic call_sign: string z: float route: list radar_id: string origin: string dest: string aircraft: string radar_id: string Flight call_sign: string route: list RadarTrack origin: string RadarTrackList dest: string aircraft: string operationX() operationY() Flight Data Processor © 2009, PrismTech. All Rights Reserved
  • 35. An Example High-End 3D Visualization Primary Radar RadarTrack x: float y: float z: float radar_id: string operationOne() operationTwo() Proprietary Information - Distribution without Expressed Written Permission is Prohibited. FastFlightView RadarTrackTopic x: float image: string y: float z: float refresh_rate: int FlightViewTopic image: string radar_id: string visible: bool refresh_rate: int visible: bool uid: GUID uid: GUID x: float y: float RadarTrackTopic x: float z: float y: float z: float call_sign: string radar_id: string display() RadarTrackTopic x: float y: float FlightTopic call_sign: string z: float route: list radar_id: string origin: string dest: string aircraft: string radar_id: string Flight call_sign: string route: list RadarTrack origin: string RadarTrackList dest: string aircraft: string operationX() operationY() Flight Data Processor © 2009, PrismTech. All Rights Reserved
  • 36. An Example High-End 3D Visualization Primary Radar Secondary Radar RadarTrack x: float y: float z: float radar_id: string RadarTrack operationOne() x: float operationTwo() y: float Proprietary Information - Distribution without Expressed Written Permission is Prohibited. z: float radar_id: string operationOne() operationTwo() FastFlightView RadarTrackTopic RadarTrackTopic x: float x: float image: string y: float y: float refresh_rate: int FlightViewTopic image: string z: float radar_id: string z: float radar_id: string visible: bool refresh_rate: int RadarTrackTopic visible: bool x: float uid: GUID uid: GUID y: float x: float z: float radar_id: string y: float RadarTrackTopic z: float x: float call_sign: string RadarTrackTopic y: float x: float z: float display() y: float radar_id: string z: float FlightTopic call_sign: string radar_id: string route: list origin: string RadarTrack dest: string Flight aircraft: string call_sign: string radar_id: string route: list origin: string RadarTrackList dest: string aircraft: string RadarTrack operationX() operationY() Automatically Manage Flight Data Processor Relationships © 2009, PrismTech. All Rights Reserved
  • 37. Custom Filter Example High-End 3D Visualization Primary Radar Secondary Radar RadarTrack x: float y: float z: float radar_id: string RadarTrack operationOne() x: float operationTwo() y: float Proprietary Information - Distribution without Expressed Written Permission is Prohibited. z: float radar_id: string operationOne() operationTwo() FastFlightView RadarTrackTopic RadarTrackTopic x: float x: float image: string y: float y: float refresh_rate: int FlightViewTopic z: float z: float SQL Filter image: string radar_id: string radar_id: string visible: bool refresh_rate: int RadarTrackTopic uid: GUID visible: bool uid: GUID x: float y: float Custom Filter x: float z: float radar_id: string y: float z: float RadarTrackTopic x: float call_sign: string y: float RadarTrackTopic z: float display() x: float radar_id: string y: float FlightTopic call_sign: string z: float route: list radar_id: string origin: string RadarTrack Flight dest: string aircraft: string call_sign: string Filter based on Region-of-interest radar_id: string route: list origin: string RadarTrackList dest: string SQL Filter aircraft: string RadarTrack Custom Filter operationX() operationY() Automatically Manage Flight Data Processor Relationships © 2009, PrismTech. All Rights Reserved
  • 38. OpenSplice DDS Delivering Performance, Openness, and Freedom ...Putting it all Together
  • 39. DCPS Application Application ‣ The application works directly at the DCPS level TConditioner cID: int temp: float TTempSensor tID: int temp: float Proprietary Information - Distribution without Expressed Written Permission is Prohibited. humidity: float TRoom humidity: float ‣ When using OO Programming fan_level: int rID: int rID: int status: int width: float rID: int height: float Languages the Object/Relational length: float fID: int TFloor fID: int level: int Impedance Mismatch has to be open: int manually dealt Content DDS v1.2 Ownership Durability Subscription Minimum Profile Data Centric Publish/Subscribe (DCPS) © 2009, PrismTech. All Rights Reserved
  • 40. DLRL Application Application TempSensor temp: float ‣ The DLRL Layer is used to humidity: float getTemp() getHumidity() * Room Floor width: float level: int 1 height: float open: int 1 climate: int provide a Language Integrated Conditioner length: float * temp: float climate: int set_status() humidity: float 1 set_climate(); set_climate() fan_level: int * set_temp() get_level() set_humidity() access to DDS data status: int setTemp() setHumidity() setFanLevel() Proprietary Information - Distribution without Expressed Written Permission is Prohibited. start() stop() ‣ The Designer has great freedom pause(): DDS v1.2 Object/Relational Mapping in deciding how Objects have to Data Local Reconstruction Layer (DLRL) map to Topics TConditioner cID: int TTempSensor tID: int temp: float temp: float humidity: float TRoom humidity: float ‣ Different Object Reconstruction fan_level: int rID: int rID: int status: int width: float rID: int height: float length: float TFloor can be created for different fID: int fID: int level: int open: int applications Content DDS v1.2 Ownership Durability Subscription Minimum Profile Data Centric Publish/Subscribe (DCPS) © 2009, PrismTech. All Rights Reserved
  • 41. Generic DDS Application Application TempSensor temp: float humidity: float getTemp() getHumidity() * Room Floor width: float level: int 1 ‣ In the most general case, different height: float open: int Conditioner length: float 1 climate: int * temp: float climate: int set_status() humidity: float 1 set_climate(); set_climate() fan_level: int * set_temp() get_level() set_humidity() portion of the application might rely on status: int setTemp() setHumidity() setFanLevel() start() Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DLRL or DCPS depending on their stop() pause(): specific needs Application Object/Relational Mapping Data Local Reconstruction Layer (DLRL) ‣ DCPS access might be required for TConditioner TTempSensor cID: int tID: int temp: float temp: float humidity: float TRoom humidity: float accessing and tuning some specific fan_level: int status: int rID: int rID: int width: float height: float rID: int length: float TFloor QoS fID: int fID: int level: int open: int Content DDS v1.2 Ownership Durability Subscription Minimum Profile Data Centric Publish/Subscribe (DCPS) © 2009, PrismTech. All Rights Reserved
  • 42. OpenSplice DDS Delivering Performance, Openness, and Freedom QoS-Enabled Pub/Sub
  • 43. Communicating with Topics, Partitions and Domains Topic Topic Topic Samples Samples Instances Samples Instances Instances 121 62 1 21 62 1 22 62 1 22 62 1 23 63 1 23 63 DataReader DataReader 1 21 62 2 20 61 1 22 62 2 19 60 1 23 63 DataReader DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 2 20 61 2 19 60 DataReader DataReader 2 20 61 2 19 60 DataWriter DataWriter DataReader 3 25 70 3 25 70 3 25 71 25 3 25 71 25 3 25 74 3 25 74 3 26 77 3 26 77 3 26 77 DataWriter struct TempSensor { 3 25 70 3 25 71 25 3 25 74 int tID; float temp; float humidity; }; #pragma keylist TempSensor tID © 2009, PrismTech. All Rights Reserved
  • 44. Communicating with Topics, Partitions and Domains Topic Topic Topic Samples Samples Instances Samples Instances Instances 121 62 1 21 62 1 22 62 1 22 62 1 23 63 1 23 63 DataReader DataReader 1 21 62 2 20 61 1 22 62 2 19 60 1 23 63 DataReader DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 2 20 61 2 19 60 DataReader DataReader 2 20 61 2 19 60 DataWriter DataWriter DataReader 3 25 70 3 25 70 3 25 71 25 3 25 71 25 3 25 74 3 25 74 3 26 77 3 26 77 3 26 77 DataWriter struct TempSensor { 3 25 70 3 25 71 25 3 25 74 int tID; float temp; Arrows }; float humidity; show #pragma keylist TempSensor tID structural relationship s, not data- Subscriber Publisher flows Partition © 2009, PrismTech. All Rights Reserved
  • 45. Communicating with Topics, Partitions and Domains Topic Topic Topic Samples Samples Instances Samples Instances Instances 121 62 1 21 62 1 22 62 1 22 62 1 23 63 1 23 63 DataReader DataReader 1 21 62 2 20 61 1 22 62 2 19 60 1 23 63 DataReader DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 2 20 61 2 19 60 DataReader DataReader 2 20 61 2 19 60 DataWriter DataWriter DataReader 3 25 70 3 25 70 3 25 71 25 3 25 71 25 3 25 74 3 25 74 3 26 77 3 26 77 3 26 77 DataWriter struct TempSensor { 3 25 70 3 25 71 25 3 25 74 int tID; float temp; Arrows }; float humidity; show #pragma keylist TempSensor tID structural relationship s, not data- Subscriber Publisher flows Partition Domain Participant Domain © 2009, PrismTech. All Rights Reserved
  • 46. QoS Model ‣ QoS-Policies are used to control relevant properties of OpenSplice DDS entities, Type Matching QoS matching such as: QoS QoS QoS QoS QoS QoS QoS ‣ Temporal Properties ‣ Priority Topic Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Name Publisher Subscriber ‣ Durability ... DataWriter writes Type reads DataReader ... ... ‣ Availability DomainParticipant writes Type reads DataReader DomainParticipant DataWriter ‣ ... Name ‣ Some QoS-Policies are matched based on Topic QoS QoS QoS a Request vs. Offered Model thus QoS- enforcement ‣ Publications and Subscriptions match only if the declared vs. requested QoS are compatible ‣ e.g., it is not possible to match a publisher which delivers data unreliably with a subscriber which requires reliability © 2009, PrismTech. All Rights Reserved
  • 47. Sample QoS Policies QoS Policy Applicability RxO Modifiable Type Matching QoS matching DURABILITY T, DR, DW Y N Data Availability QoS QoS QoS QoS QoS QoS QoS DURABILITY SERVICE T, DW N N Topic Name Publisher Subscriber LIFESPAN T, DW - Y ... DataWriter writes Type reads DataReader ... T, DR, DW N N ... HISTORY DomainParticipant DataWriter writes Type reads DataReader DomainParticipant PRESENTATION P, S Y N Data Delivery Name Topic RELIABILITY T, DR, DW Y N PARTITION P, S N Y QoS QoS QoS Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DESTINATION ORDER T, DR, DW Y N OWNERSHIP T, DR, DW Y N ‣ Rich set of QoS allow to configure OWNERSHIP DW - Y STRENGTH several different aspects of data DEADLINE T, DR, DW Y Y Data Timeliness availability, delivery and timeliness LATENCY BUDGET T, DR, DW Y Y TRANSPORT PRIORITY T, DW - Y ‣ QoS can be used to control and optimize network as well as TIME BASED FILTER DR - Y Resources computing resource RESOURCE LIMITS T, DR, DW N N USER_DATA DP, DR, DW N Y Configuration TOPIC_DATA T N Y GROUP_DATA P, S N Y © 2009, PrismTech. All Rights Reserved
  • 48. Mapping QoS Which properties does QoS controls? TimeBasedFilter Deadline History Data Data Throughput Lifespan Durability Latency Availability Ownership LatencyBudget TransportPriority Ownership Strength Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Control over Latency/Throughput tradeoff Control over data queueing Control over data latency Control over data persistency Control over data priority Control over data sources hot-swap Reliability OpenSplice DDS provides programmatic Destination QoS-driven support for configuring the most Presentation Data Delivery Order important properties of data distribution! Control over data distribution reliability Control over data ordering Control over presentation © 2009, PrismTech. All Rights Reserved
  • 49. TimeBasedFilter Deadline Data Throughput Latency LatencyBudget TransportPriority Data Timeliness QoS Policy Applicability RxO Modifiable DEADLINE T, DR, DW Y Y LATENCY T, DR, DW Y Y Data BUDGET Timeliness TRANSPORT T, DW - Y PRIORITY © 2008, PrismTech. All Rights Reserved
  • 50. Deadline You can’t be later than... The DEADLINE QoS policy allows to define the maximum inter-arrival time between data samples QoS Policy Applicability RxO Modifiable QoS matching DEADLINE T, DR, DW Y Y QoS QoS QoS ‣ DataWriter indicates that the application QoS Topic Name QoS commits to write a new value at least once Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DataWriter writes Type reads DataReader Publisher ... Subscriber every deadline period ... ... ‣ writes Type reads DataReader DataReaders are notified by the DDS when DataWriter Name the DEADLINE QoS contract is violated Topic QoS QoS QoS QoS matching Publisher Subscriber Deadline Deadline Deadline Deadline Deadline Deadline Violation © 2009, PrismTech. All Rights Reserved
  • 51. Latency Budget I need to get there in at most... The LATENCY_BUDGET QoS policy specifies the maximum acceptable delay from the time the data is written until the data is inserted in the receiver's application-cache QoS Policy Applicability RxO Modifiable LATENCY T, DR, DW Y Y BUDGET ‣ The default value of the duration is zero indicating that the delay should be minimized QoS matching ‣ This policy is a hint to the DDS, not something that must be QoS QoS QoS Proprietary Information - Distribution without Expressed Written Permission is Prohibited. monitored or enforced. QoS Topic QoS Name DataWriter writes Type reads DataReader Publisher ... Subscriber ... ... DataWriter writes Type reads DataReader Name TBuff Latency Budget = Latency = TBuff +T1+T2+T3 Topic QoS QoS QoS QoS matching T3 T1 T2 © 2009, PrismTech. All Rights Reserved
  • 52. Transport Priority VIP Data, stay clear! QoS Policy Applicability RxO Modifiable TRANSPORT T, DW - Y QoS matching PRIORITY QoS QoS QoS QoS Topic QoS The TRANSPORT_PRIORITY QoS policy Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Name is a hint to the infrastructure as to how Publisher DataWriter writes Type reads DataReader Subscriber ... ... ... to set the priority of the underlying Type reads DataReader transport used to send the data. DataWriter writes Name Topic QoS QoS QoS QoS matching © 2009, PrismTech. All Rights Reserved
  • 53. History Data Lifespan Durability Availability Ownership Ownership Strength Data Availability QoS Policy Applicability RxO Modifiable DURABILITY T, DR, DW Y N DURABILITY T, DW N N SERVICE Data Availability LIFESPAN T, DW - Y HISTORY T, DR, DW N N © 2008, PrismTech. All Rights Reserved
  • 54. Durability The DURABILITY QoS controls the data availability w.r.t. late joiners, specifically the DDS provides the following variants: QoS Policy Applicability RxO Modifiable DURABILITY T, DR, DW Y N ‣ Volatile. No need to keep data instances DURABILITY SERVICE T, DW N N for late joining data readers ‣ Transient Local. Data instance availability Proprietary Information - Distribution without Expressed Written Permission is Prohibited. QoS matching for late joining data reader is tied to the QoS QoS QoS data writer availability QoS Topic QoS ‣ Transient. Data instance availability Name DataWriter writes Type reads DataReader outlives the data writer Publisher ... ... ... Subscriber ‣ Persistent. Data instance availability DataWriter writes Type reads DataReader outlives system restarts Topic Name QoS QoS QoS QoS matching The DURABILITY_SERVICE QoS provide control over configuration of the service that implements the transient and persistent durability features © 2009, PrismTech. All Rights Reserved
  • 55. Lifespan For how long will this data be available? ‣ The LIFESPAN QoS policy QoS Policy Applicability RxO Modifiable LIFESPAN T, DW - Y allows to control what happens to stale data QoS matching ‣ It specifies the validity interval QoS QoS QoS Proprietary Information - Distribution without Expressed Written Permission is Prohibited. for data written by the QoS Topic Name QoS DataWriter DataWriter writes Type reads DataReader ‣ Publisher ... Subscriber ... The default validity interval is ... DataWriter writes Type reads DataReader infinite Name Topic QoS QoS QoS QoS matching © 2009, PrismTech. All Rights Reserved
  • 56. History How many data samples should I keep? The HISTORY QoS policy controls whether the DDS should deliver only the most recent value, attempt to deliver all intermediate values, or do something in between. The policy can be configured to provide the following semantics: ‣ Keep Last. The DDS will only attempt to QoS Policy HISTORY Applicability T, DR, DW RxO N Modifiable N keep the most recent “depth” samples of Proprietary Information - Distribution without Expressed Written Permission is Prohibited. each instance of data identified by its key QoS matching ‣ Keep All. The DDS will attempt to keep all QoS QoS QoS the samples of each instance of data identified by its key. QoS Topic Name QoS ‣ On the DataWriter Samples are kept until DataWriter writes Type reads DataReader delivered to all known subscribers Publisher ... ... ... Subscriber ‣ On the DataReader side samples are kept DataWriter writes Type reads DataReader until the application “takes” them Topic Name QoS QoS QoS QoS matching © 2009, PrismTech. All Rights Reserved
  • 57. Reliability Destination Presentation Data Delivery Order Data Delivery QoS Policy Applicability RxO Modifiable PRESENTATION P, S Y N RELIABILITY T, DR, DW Y N PARTITION P, S N Y DESTINATION T, DR, DW Y N Data Delivery ORDER OWNERSHIP T, DR, DW Y N OWNERSHIP DW - Y STRENGTH © 2008, PrismTech. All Rights Reserved
  • 58. Reliability The RELIABILITY QoS indicate the level of guarantee offered by the DDS in delivering data to subscribers. Possible variants are: QoS Policy Applicability RxO Modifiable ‣ Reliable. In steady-state the RELIABILITY T, DR, DW Y N middleware guarantees that all Proprietary Information - Distribution without Expressed Written Permission is Prohibited. samples in the DataWriter history will QoS matching eventually be delivered to all the QoS QoS QoS DataReader QoS Topic QoS ‣ Best Effort. Indicates that it is DataWriter writes Type Name reads DataReader acceptable to not retry propagation of Publisher ... Subscriber ... ... any samples DataWriter writes Type reads DataReader Name Topic QoS QoS QoS QoS matching © 2009, PrismTech. All Rights Reserved
  • 59. Ownership Who owns the data? The OWNERSHIP QoS specifies whether it is allowed for multiple DataWriters to write the same instance of the data and if so, how these modifications should be arbitrated. Possible choices are: ‣ Shared. Multiple writers are allowed to QoS Policy Applicability RxO Modifiable update the same instance and all the OWNERSHIP T, DR, DW Y N Proprietary Information - Distribution without Expressed Written Permission is Prohibited. updates are made available to the reader QoS matching ‣ Exclusive. Indicates that each instance can QoS QoS QoS only be owned by one DataWriter, but the Topic owner of an instance can change QoS Name QoS dynamically -- due to liveliness changes DataWriter writes Type reads DataReader Publisher ... Subscriber ... ‣ The selection of the owner is controlled by DataWriter writes ... Type reads DataReader the setting of the OWNERSHIP_STRENGTH Name QoS policy Topic QoS QoS QoS QoS matching © 2009, PrismTech. All Rights Reserved
  • 60. Ownership Strength How strong are you? The OWNERSHIP_STRENGTH Specifies the value of the “strength” used to arbitrate among DataWriters that attempt to modify the same data instance ‣ Data instance are identified QoS matching by the couple (Topic, Key) QoS QoS QoS ‣ The policy applies only if the Proprietary Information - Distribution without Expressed Written Permission is Prohibited. OWNERSHIP is EXCLUSIVE QoS Topic Name QoS DataWriter writes Type reads DataReader Publisher ... Subscriber ... ... QoS Policy Applicability RxO Modifiable OWNERSHIP DW - Y DataWriter writes Type reads DataReader STRENGTH Name Topic QoS QoS QoS QoS matching © 2009, PrismTech. All Rights Reserved
  • 61. Ownership @ Work ‣ A Topic can have Shared or Exclusive Ownership ‣ Exclusively owned Topics can be modified by a single writer ‣ Writer strength is used to coordinate replicated writers Proprietary Information - Distribution without Expressed Written Permission is Prohibited. StockQuote symbol: "MSFT" StockQuote StockQuote name: "Microsoft Corp." StockQuote symbol: "GOOG" symbol: "GOOG" exchange: "NASD""GOOG" symbol: name: "Google Inc." quote: 33.73 name: "Google Inc." name: "Google Inc." exchange: "NASD" exchange: "NASD" exchange: "NASD" StockQuote StockQuote StockQuote quote: 663.97 W1 quote: 663.97"AAPL" symbol: "AAPL" quote: 663.97 symbol: "AAPL" symbol: name: "Apple Inc." name: "Apple Inc." name: "Apple Inc." exchange: "NASD" exchange: "NASD" exchange: "NASD" R1 quote: 165.37 quote: 165.37 quote: 165.37 STRENGTH=3 StockQuote symbol: "AAPL" StockQuote Inc." name: "Apple symbol: "GOOG""NASD" exchange: name: quote: 165.37 "Google Inc." StockQuote "NASD" exchange: symbol: "MSFT" quote: 663.97 name: "Microsoft Corp." exchange: "NASD" quote: 33.73 W1’ R2 STRENGTH=2 StockQuote symbol: "AAPL" StockQuote Inc." name: "Apple symbol: "GOOG""NASD" exchange: name: quote: 165.37 "Google Inc." StockQuote "NASD" exchange: symbol: "MSFT" quote: 663.97 name: "Microsoft Corp." exchange: "NASD" quote: 33.73 W2’’ R3 STRENGTH=1 © 2009, PrismTech. All Rights Reserved
  • 62. Managing Hot-Swap ‣ A Topic can have Shared or Exclusive Ownership ‣ Exclusively owned Topics can be modified by a single writer ‣ Writer strength is used to coordinate replicated writers Proprietary Information - Distribution without Expressed Written Permission is Prohibited. StockQuote R1 symbol: "AAPL" name: "Apple Inc." exchange: "NASD" quote: 165.37 StockQuote symbol: "GOOG" name: "Google Inc." exchange: "NASD" quote: 663.97 StockQuote symbol: "GOOG" name: "Google Inc." exchange: "NASD" quote: 663.97 StockQuote symbol: "AAPL" name: "Apple Inc." exchange: "NASD" R2 quote: 165.37 StockQuote StockQuote StockQuote StockQuote symbol: "MSFT" symbol: "MSFT" symbol: "MSFT" symbol: "GOOG" name: "Microsoft Corp." name: "Microsoft Corp." name: "Microsoft Corp." exchange: "NASD" exchange: "NASD" name: "Google Inc." exchange: "NASD" quote: 33.73 quote: 33.73 quote: 33.73 exchange: "NASD" quote: 663.97 StockQuote R3 symbol: "AAPL" W2’’ name: "Apple Inc." exchange: "NASD" quote: 165.37 STRENGTH=1 © 2009, PrismTech. All Rights Reserved
  • 63. Motivating Forces The Standard Agenda Architectural Principles Programming Model Concluding Remarks
  • 64. OpenSplice DDS Delivering Performance, Openness, and Freedom Shared Global Data Space
  • 65. Shared Global Data Space Coordination Model ‣ DDS applications are asynchronous and communicate by reading/writing from/to a Global Data Space ‣ DDS applications communicate by simply addressing items in the Global Data Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Space and without any direct knowledge of the parties involved in the production/ consumption of data Consistency Model ‣ The Shared Global Data Space implemented by DDS, can be configured to supports at most the “Eventual Consistency Model” ‣ Under an Eventual Consistency Model we are guaranteed that eventually all application in the system will have a consistent view of the “world”s © 2009, PrismTech. All Rights Reserved
  • 66. Eventual Consistency & R/W Caches DataReader DataReader 1 1 2 1 DataWriter 1 1 3 1 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 2 1 1 2 Topic DataReader 1 2 2 3 3 1 DataReader Cache 2 2 2 3 3 1 Topic 1 1 DataReader Cache 2 Topic 1 DDS DataWriter Cache 3 1 Topic DataReader Cache Under an Eventual Consistency Model, DDS guarantees that all matched Reader Caches will eventually be identical of the respective Writer Cache © 2009, PrismTech. All Rights Reserved
  • 67. QoS Impacting the Consistency Model The DDS Consistency Model is a property that can be associated to Topics or further refined by Reader/Writers. The property is controlled by the following QoS Policies: ‣ DURABILITY ‣ VOLATILE | TRANSIENT_LOCAL | TRANSIENT | PERSISTENT ‣ LIFESPAN Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ RELIABILITY ‣ RELIABLE | BEST_EFFORT ‣ DESTINATION ORDER ‣ SOURCE_TIMESTAMP | DESTINATION_TIMESTAMP QoS Policy Applicability RxO Modifiable DURABILITY T, DR, DW Y N LIFESPAN T, DW - Y RELIABILITY T, DR, DW Y N DESTINATION ORDER T, DR, DW Y N © 2009, PrismTech. All Rights Reserved
  • 68. QoS Impacting the Consistency Model DURABILITY RELIABILITY DESTINATION_ORDER LIFESPAN Eventual Consistency VOLATILE RELIABLE SOURCE_TIMESTAMP INF. (No Crash / Recovery) Eventual Consistency TRANSIENT_LOCAL RELIABLE SOURCE_TIMESTAMP INF. Proprietary Information - Distribution without Expressed Written Permission is Prohibited. (Reader Crash / Recovery) Eventual Consistency TRANSIENT RELIABLE SOURCE_TIMESTAMP INF. (Crash/Recovery) Eventual Consistency PERSISTENT RELIABLE SOURCE_TIMESTAMP INF. (Crash/Recovery) Weak Consistency ANY ANY DESTINATION_TIMESTAMP ANY Weak Consistency ANY BEST_EFFORT ANY ANY Weak Consistency ANY ANY ANY N © 2009, PrismTech. All Rights Reserved
  • 69. Eventual Consistency @ WorK DURABILITY RELIABILITY DESTINATION_ORDER LIFESPAN Eventual Consistency (Reader TRANSIENT_LOCAL RELIABLE SOURCE_TIMESTAMP INF. Crash / Recovery) {A} Eventual Consistency TRANSIENT RELIABLE SOURCE_TIMESTAMP INF. {B} (Crash/Recovery) Weak Consistency ANY ANY ANY N {J} Proprietary Information - Distribution without Expressed Written Permission is Prohibited. S = {A, D} S1 P = {A, B} B B P1 m S= {A, B, J} BA A A F S2 J D C P = {D, C, J} P2 K E S = {A} S4 © 2009, PrismTech. All Rights Reserved
  • 70. Eventual Consistency @ Work DURABILITY RELIABILITY DESTINATION_ORDER LIFESPAN Eventual Consistency (Reader TRANSIENT_LOCAL RELIABLE SOURCE_TIMESTAMP INF. Crash / Recovery) {A} Eventual Consistency TRANSIENT RELIABLE SOURCE_TIMESTAMP INF. {B} (Crash/Recovery) Weak Consistency ANY ANY ANY N {J} Proprietary Information - Distribution without Expressed Written Permission is Prohibited. S = {A, D} S1 B B A m S= {A, B, J} A F S2 J J D D C BA P = {D, C, J} S= {A, B, D, J} P2 K E S3 J S = {A} S4 © 2009, PrismTech. All Rights Reserved A
  • 71. Design Guidelines ‣ For all (non-periodic) Topics for which an eventually consistent model is required use the following QoS settings: DURABILITY RELIABILITY DESTINATION_ORDER LIFESPAN Eventual Consistency TRANSIENT RELIABLE SOURCE_TIMESTAMP INF. Proprietary Information - Distribution without Expressed Written Permission is Prohibited. (Crash / Recovery) ‣ For information produced periodically, with a period P, where P is small enough to be acceptable as a consistency convergence delay, the following QoS settings will provide an approximation of the eventual consistency: DURABILITY RELIABILITY DESTINATION_ORDER LIFESPAN Eventual Consistency VOLATILE BEST_EFFORT SOURCE_TIMESTAMP INF. (Crash / Recovery) © 2009, PrismTech. All Rights Reserved
  • 72. OpenSplice DDS Delivering Performance, Openness, and Freedom Topic Used in next section. Getting the Data struct Counter { int cID; int count; Read Semantics }; #pragma keylist Counter cID
  • 73. Reading Samples ‣ Read iterates over the available sample instances 1 1 1 2 1 3 1 4 ‣ Samples are not removed 2 1 2 2 2 3 from the local cache as DataReader Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 4 3 5 result of a read 3 1 3 2 3 3 ‣ Read samples can be read Topic again, by accessing the Samples Read Samples not Read cache with the proper options (more later) DataReader Cache © 2009, PrismTech. All Rights Reserved
  • 74. Reading Samples ‣ Read iterates over the available sample instances 1 1 1 2 1 3 1 4 ‣ Samples are not removed 2 1 2 2 2 3 from the local cache as DataReader Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 1 3 2 3 3 3 4 3 5 result of a read ‣ Read samples can be read Topic again, by accessing the Samples Read Samples not Read cache with the proper options (more later) DataReader Cache © 2009, PrismTech. All Rights Reserved
  • 75. Reading Samples ‣ Read iterates over the available sample instances 1 1 1 2 1 3 1 4 ‣ Samples are not removed 2 1 2 2 2 3 from the local cache as DataReader Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 1 3 2 3 3 3 4 3 5 result of a read ‣ Read samples can be read Topic again, by accessing the Samples Read Samples not Read cache with the proper options (more later) DataReader Cache © 2009, PrismTech. All Rights Reserved
  • 76. Sample, Instance and View States History Depth = 2 ‣ DataReaders are provided with data samples ane state information allowing to detect relevant transitions in the life-cycle of data as well as data writers DataReader Proprietary Information - Distribution without Expressed Written Permission is Prohibited. SampleInfo ‣ Sample State (READ | NOT_READ): Determines wether a sample has already been read by this 1 1 1 2 DataWriter or not. 2 2 2 3 ‣ Instance State (ALIVE, NOT_ALIVE, DISPOSED). 3 1 Determines wether (1) writer exist for the specific Samples instance, or (2) no matched writers are currently Topic available, or (3) the instance has been disposed DataReader Cache ‣ View State (NEW, NOT_NEW). Determines wether this is the first sample of a new (or re-born) instance © 2009, PrismTech. All Rights Reserved
  • 77. Anatomy of a Read DDS::ReturnCode_t read( TSeq& samples, Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS::SampleInfoSeq& info, long max_samples, DDS::SampleStateMask samples_state, DDS::ViewStateMask views_state, DDS::InstanceStateMask instances_state) © 2009, PrismTech. All Rights Reserved
  • 78. Reading Data Example 1 Example 2 TSeq samples; TSeq samples(N); SampleInfoSeq info; SampleInfoSeq info(N); reader->read(samples, reader->read(samples, info, info, DDS::LENGTH_UNLIMITED, N, Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS::NOT_READ_SAMPLE_STATE, DDS::NOT_READ_SAMPLE_STATE, DDS::ANY_VIEW_STATE, DDS::ANY_VIEW_STATE, DDS::ANY_INSTANCE_STATE); DDS::ANY_INSTANCE_STATE); // Do something // Do something reader->return_loan(samples, info); Example 3 reader->read(samples, info, N, DDS::NOT_READ_SAMPLE_STATE, DDS::NEW_VIEW_STATE, DDS::ALIVE_INSTANCE_STATE); © 2009, PrismTech. All Rights Reserved
  • 79. OpenSplice DDS Delivering Performance, Openness, and Freedom Topic Used in next section. Getting the Data struct Counter { int cID; int count; Take Semantics }; #pragma keylist Counter cID
  • 80. Taking Samples ‣ Take iterates over the available sample instances 1 1 1 2 1 3 1 4 ‣ Taken Samples are 2 1 2 2 2 3 removed from the local DataReader Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 4 3 5 cache as result of a take 3 1 3 2 3 3 ‣ Topic Samples not Taken DataReader Cache © 2009, PrismTech. All Rights Reserved
  • 81. Taking Samples ‣ Take iterates over the available sample instances 1 2 1 3 1 4 ‣ Taken Samples are 2 2 2 3 removed from the local DataReader Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 2 3 3 3 4 3 5 cache as result of a take Topic Samples not Taken DataReader Cache © 2009, PrismTech. All Rights Reserved
  • 82. Taking Samples ‣ Take iterates over the available sample instances 1 3 1 4 ‣ Taken Samples are 2 3 removed from the local DataReader Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 3 3 4 3 5 cache as result of a take Topic Samples not Taken DataReader Cache © 2009, PrismTech. All Rights Reserved
  • 83. Anatomy of a take DDS::ReturnCode_t take( TSeq& samples, Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS::SampleInfoSeq& info, long max_samples, DDS::SampleStateMask samples_state, DDS::ViewStateMask views_state, DDS::InstanceStateMask instances_state) © 2009, PrismTech. All Rights Reserved
  • 84. OpenSplice DDS Delivering Performance, Openness, and Freedom Topic Used in next section. Writing Data struct Counter { int cID; int count; }; #pragma keylist Counter cID
  • 85. Writing Samples ‣ Samples are written in the local cache ‣ Writer control the creation 1 1 DataWriter of instances Topic Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ The DDS ensures that the local caches for the matched DataReader will be Last Sample Written eventually consistent with that of the Data Writer DataWriter Cache © 2009, PrismTech. All Rights Reserved
  • 86. Writing Samples ‣ Samples are written in the local cache ‣ Writer control the creation 1 1 1 2 DataWriter of instances Topic Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ The DDS ensures that the local caches for the matched DataReader will be Last Sample Written eventually consistent with that of the Data Writer DataWriter Cache © 2009, PrismTech. All Rights Reserved
  • 87. Writing Samples ‣ Samples are written in the local cache ‣ Writer control the creation 1 2 1 3 DataWriter of instances Topic Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ The DDS ensures that the local caches for the matched DataReader will be Last Sample Written eventually consistent with that of the Data Writer DataWriter Cache © 2009, PrismTech. All Rights Reserved
  • 88. Anatomy of a write DDS::ReturnCode_t write(const T& sample, Proprietary Information - Distribution without Expressed Written Permission is Prohibited. InstanceHandle_t handle); © 2009, PrismTech. All Rights Reserved
  • 89. Writing Data writer->write(sample, DDS::HANDLE_NIL); Proprietary Information - Distribution without Expressed Written Permission is Prohibited. InstanceHandle_t handle = writer->register_instance(sample); // ... writer->write(sample, handle); © 2009, PrismTech. All Rights Reserved
  • 90. OpenSplice DDS Delivering Performance, Openness, and Freedom Topic Used in next section. Managing Data History struct Counter { int cID; int count; }; #pragma keylist Counter cID
  • 91. How many samples? History Depth = 1 (DDS Default) ‣ The History QoS Controls the 1 1 number of samples-per- DataReader 2 1 instance that will be stored by 3 1 the middleware on behalf of a Topic Reader Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ Keep Last K. The History QoS can be set so to always have History Depth = 5 the latest K samples 1 1 1 2 1 3 1 4 1 5 ‣ Keep All. The History QoS can 2 1 2 2 2 3 2 4 2 5 be set so keep all samples DataReader 3 3 3 4 produced by the writer and not 3 1 3 2 3 5 yet taken, until resource limits Topic are not reached © 2009, PrismTech. All Rights Reserved
  • 92. History in Action History Depth = 1 History Depth = 1 (DDS Default) (DDS Default) Network 1 1 1 2 DataReader 2 1 1 2 2 3 DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 1 2 2 2 3 3 1 Topic Topic DataReader Cache DataWriter Cache Note: The Reliability QoS controls wether data is sent reliably, or best-effort, from the DataWriter to matched DataReaders © 2009, PrismTech. All Rights Reserved
  • 93. History in Action History Depth = 1 History Depth = 1 (DDS Default) (DDS Default) Network 1 2 1 2 DataReader 2 2 2 3 DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 1 2 3 3 1 Topic Topic DataReader Cache DataWriter Cache Note: The Reliability QoS controls wether data is sent reliably, or best-effort, from the DataWriter to matched DataReaders © 2009, PrismTech. All Rights Reserved
  • 94. History in Action History Depth = 1 History Depth = 1 (DDS Default) (DDS Default) Network 1 2 1 2 DataReader 2 3 2 3 DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 1 3 1 Topic Topic DataReader Cache DataWriter Cache Note: The Reliability QoS controls wether data is sent reliably, or best-effort, from the DataWriter to matched DataReaders © 2009, PrismTech. All Rights Reserved
  • 95. History in Action History Depth = 2 History Depth = 1 (DDS Default) Network 1 1 1 2 DataReader 2 1 1 2 2 3 DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 1 2 2 2 3 3 1 Topic Topic DataReader Cache DataWriter Cache Note: The Reliability QoS controls wether data is sent reliably, or best-effort, from the DataWriter to matched DataReaders © 2009, PrismTech. All Rights Reserved
  • 96. History in Action History Depth = 2 History Depth = 1 (DDS Default) Network 1 1 1 2 1 2 DataReader 2 1 2 2 2 3 DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 1 2 3 3 1 Topic Topic DataReader Cache DataWriter Cache Note: The Reliability QoS controls wether data is sent reliably, or best-effort, from the DataWriter to matched DataReaders © 2009, PrismTech. All Rights Reserved
  • 97. History in Action History Depth = 2 History Depth = 1 (DDS Default) Network 1 1 1 2 1 2 DataReader 2 2 2 3 2 3 DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 3 1 3 1 Topic Topic DataReader Cache DataWriter Cache Note: The Reliability QoS controls wether data is sent reliably, or best-effort, from the DataWriter to matched DataReaders © 2009, PrismTech. All Rights Reserved
  • 98. OpenSplice DDS Delivering Performance, Openness, and Freedom Topic Used in next section. Application / DDS Coordination struct Counter { int cID; int count; }; #pragma keylist Counter cID
  • 99. Application / DDS Coordination DDS provides three main mechanism for exchanging information with the application ‣ Polling. The application polls from time to time for new data or status changes. The interval might depend on the kind of applications as well as data Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ WaitSets. The application registers a WaitSet with DDS and waits (i.e. is suspended) until one of the specified events has happened. ‣ Listeners. The application registers a listener with a specific DDS entity to be notified when relevant events occur, such as state changes or © 2009, PrismTech. All Rights Reserved
  • 100. OpenSplice DDS Delivering Performance, Openness, and Freedom Putting it All Together Writing a DDS Application
  • 101. Steps for Writing a DDS Application Writing a DDS application can be decomposed in the following few simple steps: ‣ Step#1: Define Topics ‣ Step #2: Identify QoS representing key non-functional invariants for your system ‣ Transport Priority ‣ Deadline ‣ Durability Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ Step #3: Define Topics / Partition Mapping ‣ Step #4: Identify Topic Readers/Writers ‣ Step #5: Define QoS requirements for Readers/Writers ‣ History ‣ Latency Budget ‣ Auto-Dispose ‣ Transport Priority ‣ Deadline ‣ Step #6: Code-it in your favorite programming language © 2009, PrismTech. All Rights Reserved
  • 102. Making the Hello DDS World Step #1: Topic definition ‣ We are going to define a simple key-less topic that will carry the name to greet. module swatch { Proprietary Information - Distribution without Expressed Written Permission is Prohibited. struct hello { string<256> name; }; #pragma keylist hello }; © 2009, PrismTech. All Rights Reserved
  • 103. Making the Hello DDS World Step #2: Topic QoS ‣ Reliability QoS: RELIABLE ‣ Durability QoS: TRANSIENT Proprietary Information - Distribution without Expressed Written Permission is Prohibited. module swatch { struct hello { string<256> name; }; #pragma keylist hello }; © 2009, PrismTech. All Rights Reserved
  • 104. Making the Hello DDS World Step #3: Topics/Partitions Mapping ‣ swatch::hello will be mapped into the default-partition (thus no action to take) Proprietary Information - Distribution without Expressed Written Permission is Prohibited. © 2009, PrismTech. All Rights Reserved
  • 105. Making the Hello DDS World Step #4: Readers/Writers ‣ A Generic DataReader that will read the topic swatch:: hello ‣ We’ll be able to run as many of this as we want ‣ A Generic DataWriter that will read the topic swatch:: hello Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ We’ll be able to run as many of this as we want © 2009, PrismTech. All Rights Reserved
  • 106. Making the Hello DDS World ‣ Step #5: Define QoS requirements for Readers/Writers ‣ Writer: ‣ Inherit TopicQoS, and ‣ No-Auto Dispose Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ History QoS: Keep Last N ‣ Reader ‣ Inherit TopicQoS, and ‣ History QoS: Keep Last N © 2009, PrismTech. All Rights Reserved
  • 107. Hello World in a Conceptual Picture History Depth = 2 History Depth = 2 1 1 1 1 2 2 2 2 3 3 DataReader DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited. SampleInfo SampleInfo Network 1 1 1 2 1 1 1 2 2 2 2 2 2 3 2 3 3 1 3 1 Samples Samples swatch::hello swatch::hello DataReader Cache DataWriter Cache © 2009, PrismTech. All Rights Reserved
  • 108. Visualizing the Strucutre... Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Subscriber Default Partition Publisher Domain Participant Domain © 2009, PrismTech. All Rights Reserved
  • 109. Step #6: Coding How many lines of code is going to take this example? Proprietary Information - Distribution without Expressed Written Permission is Prohibited. © 2009, PrismTech. All Rights Reserved
  • 110. SIMple Dds == SIMD! ‣ Today we’ll write our DDS application using SIMD ‣ SIMD is a C++ library that takes advantage of C++ Template Meta- Programming to: ‣ Vastly Improve Productivity SIMD Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ Simplify Usage ‣ Automate Resource Management (All DDS Entities are Garbage Collected via Ref-Counting) ‣ Zero Overhead © 2009, PrismTech. All Rights Reserved
  • 111. Hello-pub.cpp (Default QoS) int main(int argc, char* argv[]) { swatch::hello sample; if (!parse_args(argc, argv)) std::stringstream ss; return 1; for (int i = 0; i < N; ++i) { // -- init the SIMD runtime ss << i; Proprietary Information - Distribution without Expressed Written Permission is Prohibited. simd::Runtime::init(); std::string tmp = ss.str() + "." + message; ss.str(""); // -- create the DDS Topic sample.name = DDS::string_dup(tmp.c_str()); simd::Topic<swatch::hello> helloTopic("helloTopic"); std::cout << "<<= " << sample.name << std::endl; writer.write(sample); // -- create the DDS DataWriter usleep(period*1000); simd::DataWriter<swatch::hello> writer(helloTopic, } dwqos); std::cout << "[done]" << std::endl; return 0; } Only 3-lines of DDS-Specific Code Business Logic © 2009, PrismTech. All Rights Reserved
  • 112. Hello-pub.cpp int main(int argc, char* argv[]) { if (!parse_args(argc, argv)) return 1; swatch::hello sample; // -- init the SIMD runtime simd::Runtime::init(); std::stringstream ss; simd::TopicQos tqos; for (int i = 0; i < N; ++i) { ss << i; tqos.set_reliable(); Proprietary Information - Distribution without Expressed Written Permission is Prohibited. tqos.set_transient(); std::string tmp = ss.str() + "." + message; ss.str(""); // -- create the DDS Topic sample.name = DDS::string_dup(tmp.c_str()); std::cout << "<<= " << sample.name << std::endl; simd::Topic<swatch::hello> helloTopic("helloTopic", tqos); writer.write(sample); usleep(period*1000); simd::DataWriterQos dwqos(tqos); dwqos.set_keep_last(history_depth); } std::cout << "[done]" << std::endl; dwqos.set_auto_dispose(false); return 0; } // -- create the DDS DataWriter Business Logic simd::DataWriter<swatch::hello> writer(helloTopic, dwqos); © 2009, PrismTech. All Rights Reserved
  • 113. Hello-sub.cpp (Default QoS) int main(int argc, char* argv[]) { swatch::helloSeq samples; if (!parse_args(argc, argv)) DDS::SampleInfoSeq infos; return 1; while (true) { // -- init the SIMD runtime reader.read(samples, infos); Proprietary Information - Distribution without Expressed Written Permission is Prohibited. simd::Runtime::init(); for (int i = 0; i < samples.length(); ++i) { std::cout << "=>> " << samples[i].name // -- create the DDS Topic << std::endl; simd::Topic<swatch::hello> helloTopic("helloTopic"); } if (samples.length() > 0) // -- create the DDS DataReader std::cout << "--" << std::endl; simd::DataReader<swatch::hello> reader(helloTopic); reader.return_loan(samples, infos); usleep(period*1000); } return 0;} Only 3-lines of DDS-Specific Code Business Logic © 2009, PrismTech. All Rights Reserved
  • 114. Hello-sub.cpp int main(int argc, char* argv[]) { if (!parse_args(argc, argv)) return 1; swatch::helloSeq samples; // -- init the SIMD runtime DDS::SampleInfoSeq infos; simd::Runtime::init(); while (true) { simd::TopicQos tqos; reader.read(samples, infos); Proprietary Information - Distribution without Expressed Written Permission is Prohibited. tqos.set_reliable(); for (int i = 0; i < samples.length(); ++i) { tqos.set_transient(); std::cout << "=>> " << samples[i].name << std::endl; // -- create the DDS Topic } simd::Topic<swatch::hello> helloTopic("helloTopic", if (samples.length() > 0) tqos); std::cout << "--" << std::endl; simd::DataReaderQos drqos(tqos); reader.return_loan(samples, infos); drqos.set_keep_last(history_depth); usleep(period*1000); } // -- create the DDS DataReader return 0;} simd::DataReader<swatch::hello> reader(helloTopic, drqos); Business Logic © 2009, PrismTech. All Rights Reserved
  • 115. OpenSplice DDS Delivering Performance, Openness, and Freedom Demo!
  • 116. Motivating Forces The Standard Agenda Architectural Principles Programming Model Concluding Remarks
  • 117. Concluding Remarks State of the Art ‣ The OMG DDS Standard uniquely addresses some of the key requirements for next generation Mission Application Critical Systems ‣ The OMG DDS is one of the few middleware standard Object/Relational Mapping Data Local Reconstruction Layer (DLRL) defining both API as well as Wire-Protocol, thus Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ensuring application portability and interworking Content Ownership Durability ‣ The DDS Standard has been recommended/ Subscription mandated by key administration throughout the world Minimum Profile as well as adopted by the most challenging Defense Data Centric Publish/Subscribe (DCPS) programs Real-Time Publish/Subscribe Protocol Looking Ahead DDS Interoperability Wire Protocol ‣ The DDS Standard is swiftly moving forward to expand UDP/IP its applicability, simplify its use, and facilitate integration © 2009, PrismTech. All Rights Reserved
  • 118. Online Resources http://www.opensplice.com/ http://twitter.com/acorsaro/ emailto:[email protected] Proprietary Information - Distribution without Expressed Written Permission is Prohibited. http://bit.ly/1Sreg http://opensplice.blogspot.com http://www.dds-forum.org http://www.youtube.com/OpenSpliceTube http://portals.omg.org/dds © 2009, PrismTech. All Rights Reserved
  • 119. Data Access Pattern Coordination Patterns Backup
  • 120. Topic Queues Context ‣ One commonly used technique for implementing distributed real-time embedded systems is to model applications as FSA, or DFSA (Distributed Finite State Automata) Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Problem ‣ One or more DDS applications are implemented as a (D)FSA whose transitions depends on the totally ordered history of updates for a specific topic ‣ How can we ensure that each application sees exactly the same set of updates in exactly the same order? © 2009, PrismTech. All Rights Reserved
  • 121. Topic Queues Assumptions ‣ Single writer exists per Topic Instance Solution ‣ Represent the state transition events by means of DDS Topics Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ Topic Instances can be used to identify specific FSA ‣ Ensure that application always use the Take Semantics for getting data. ‣ Ensure that these topics have the following QoS Settings ‣ DURABILITY: TRANSIENT | PERSISTENT ‣ HISTORY: KEEP_ALL ‣ RELIABILITY: RELIABLE ‣ DESTINATION_ORDER: SOURCE_TIMESTAMP © 2009, PrismTech. All Rights Reserved
  • 122. 3 2 1 Topic Queues 1 1 1 DDS © 2009, PrismTech. All Rights Reserved Samples not Taken Proprietary Information - Distribution without Expressed Written Permission is Prohibited.
  • 123. 3 2 1 Topic Queues 1 1 11 3 2 2 DDS © 2009, PrismTech. All Rights Reserved Samples not Taken Proprietary Information - Distribution without Expressed Written Permission is Prohibited.
  • 124. Topic Queues DDS Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 1 1 2 1 3 1 4 2 1 2 2 2 3 3 1 3 2 3 3 3 4 3 5 Samples not Taken © 2009, PrismTech. All Rights Reserved
  • 125. Topic Queues 1 3 2 2 2 2 1 3 2 3 3 3 DDS 1 3 © 2009, PrismTech. All Rights Reserved 4 4 3 Samples not Taken 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited.
  • 126. Topic K-Queues Context ‣ One commonly used technique for implementing distributed real-time embedded systems is to model applications as FSA, or DFSA (Distributed Finite State Automata) Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Problem ‣ One or more DDS applications are implemented as a (D)FSA whose transitions depends on the totally ordered history of updates for a specific topic ‣ How can we ensure that each application sees exactly the same set of updates in exactly the same order? ‣ How can we ensure that misbehaving applications consume an unbounded amount of memory? © 2009, PrismTech. All Rights Reserved
  • 127. Topic K-Queues Assumptions ‣ Single writer exists per Topic Instance Solution Note ‣ Represent the state transition events by means of DDS ‣ K can be dimensioned by considering Topics the maximum burst of activity that should be tolerated along with the ‣ Topic Instances can be used to identify specific FSA Proprietary Information - Distribution without Expressed Written Permission is Prohibited. average time between state transitions ‣ Ensure that application always use the Take Semantics for ‣ e.g., if I want to tolerate 12 sec of getting data overload and state transition occur ‣ Ensure that these topics have the following QoS Settings every 4 sec then K=3 ‣ DURABILITY: TRANSIENT | PERSISTENT ‣ RELIABILITY: RELIABLE ‣ HISTORY: KEEP_LAST with DEPTH set to K ‣ DESTINATION_ORDER: SOURCE_TIMESTAMP ‣ If a FSA looses a state transition “resets the state” by some other means (e.g. DURABILITY SERVICE) © 2009, PrismTech. All Rights Reserved
  • 128. 3 2 1 1 1 1 Topic K-Queues DDS Samples not Taken © 2009, PrismTech. All Rights Reserved Proprietary Information - Distribution without Expressed Written Permission is Prohibited.
  • 129. 3 2 1 1 1 1 1 3 2 Topic K-Queues 2 2 2 DDS 1 3 Samples not Taken © 2009, PrismTech. All Rights Reserved Proprietary Information - Distribution without Expressed Written Permission is Prohibited.
  • 130. Topic K-Queues DDS Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 2 1 3 1 4 2 1 2 2 2 3 3 1 3 2 3 3 Samples not Taken - One FSA has missed a sample... but does not know it yet. © 2009, PrismTech. All Rights Reserved
  • 131. Topic K-Queues DDS Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 3 1 4 2 2 2 3 3 2 3 3 Samples not Taken - One FSA has missed a sample... but does not know it yet. - It detects this and gets the sample from the DURABILITY SERVICE © 2009, PrismTech. All Rights Reserved
  • 132. Topic Caches Problem ‣ Distributed applications often have to deal with “Hard State”, meaning state that is conceptually shared among various elements. ‣ This “Hard State” often needs to be accesses very efficiently, likewise changes in state should Proprietary Information - Distribution without Expressed Written Permission is Prohibited. also consistently diffused in a timely manner © 2009, PrismTech. All Rights Reserved
  • 133. Topic Caches Solution ‣ Represent the “Hard State” by means of DDS Topics ‣ Application should favor the use the Read Semantics for getting data. ‣ Ensure that these topics have the following QoS Settings Proprietary Information - Distribution without Expressed Written Permission is Prohibited. ‣ DURABILITY: TRANSIENT | PERSISTENT ‣ HISTORY: KEEP_LAST ‣ RELIABILITY: RELIABLE ‣ DESTINATION_ORDER: SOURCE_TIMESTAMP Note ‣ Notice that “Hard State” will be eventually consistent for all reader regardless of the number of writers ‣ This technique can be exploited for writing self-stabilizing applications © 2009, PrismTech. All Rights Reserved
  • 134. DataReader DataReader 3 2 1 DataReader 1 1 1 3 2 1 3 2 1 1 1 1 1 1 1 Topic Caches 2 1 2 2 2 DDS 3 © 2009, PrismTech. All Rights Reserved 2 3 2 1 2 1 3 2 DataWriter DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited.
  • 135. DataReader DataReader 3 2 1 DataReader 1 2 2 3 2 1 3 2 1 1 2 2 1 2 2 Topic Caches 2 DDS 3 © 2009, PrismTech. All Rights Reserved 2 3 2 1 2 1 3 2 DataWriter DataWriter Proprietary Information - Distribution without Expressed Written Permission is Prohibited.
  • 136. Topic Caches DataReader 1 2 DataWriter 2 3 3 1 DDS 1 2 2 3 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DataReader 1 2 2 3 3 1 DataWriter 3 1 2 2 DataReader 1 2 2 3 3 1 - Notice that one Data Writer has an inconsistent state when compared to the system state. - This is not hard to cope with, and could be simply solved by matching a reader with the writer (or using a Coordination Pattern) © 2009, PrismTech. All Rights Reserved
  • 137. Data Access Pattern Coordination Patterns Backup
  • 138. Sequencer Problem ‣ Often occurs in a distributed system that applications need to coordinate and take turn in performing certain actions. ‣ However DDS does not provide built-in coordination / distributed synchronization Proprietary Information - Distribution without Expressed Written Permission is Prohibited. mechanisms. How can this be overcome? Solution ‣ Define a Sequencer in your system that coordinates access to resources. © 2009, PrismTech. All Rights Reserved
  • 139. Sequencer Detailed Solution ‣ Define in your system the following Topics: struct TAccessRequest { struct TAccessGrant { Proprietary Information - Distribution without Expressed Written Permission is Prohibited. long resource_guid; long resource_guid; long request_guid; long request_guid; time_t timeout; time_t timeout; }; }; #pragma keylist AccessRequestTopic resource_guid #pragma keylist AccessRequestTopic resrouce_guid struct TReleaseAccessGrant { long resource_guid; long request_guid; }; #pragma keylist AccessRequestTopic resrouce_guid © 2009, PrismTech. All Rights Reserved
  • 140. Sequencer Detailed Solution ‣ Make TAccessRequest and TReleaseAccessGrant Topic-Queues (with DESTINATION_ORDER set to RECEPTION_TIMESTAMP) ‣ Make TAccessGrant a Topic-Cache ‣ Use the following protocol to request/grant/release access Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Sequencer (per instance to keep it simpler) Application while (true) { bool granted = false; take next sample from TAccessRequest write TAccessRequest write TAccessGrant while (!granted) { wait on TReleaseAccessGrant wait on TAccessGrant } if TAccessGrant == myTAccessGrant granted = true; } // Do Critical Section write TReleaseAccessGrant © 2009, PrismTech. All Rights Reserved
  • 141. Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest © 2009, PrismTech. All Rights Reserved
  • 142. Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 10 2 5 © 2009, PrismTech. All Rights Reserved
  • 143. Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 10 2 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 10 2 5 © 2009, PrismTech. All Rights Reserved
  • 144. Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 10 2 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 10 2 5 © 2009, PrismTech. All Rights Reserved
  • 145. Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 10 2 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 10 1 10 1 10 2 5 2 5 2 5 © 2009, PrismTech. All Rights Reserved
  • 146. Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 10 2 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 10 1 10 1 10 1 10 2 5 2 5 2 5 © 2009, PrismTech. All Rights Reserved
  • 147. Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 10 1 10 2 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 10 1 10 1 10 1 10 2 5 2 5 2 5 © 2009, PrismTech. All Rights Reserved
  • 148. Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 -1 2 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 10 1 10 1 5 1 10 1 10 2 5 2 5 2 5 3 10 3 5 © 2009, PrismTech. All Rights Reserved
  • 149. Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 5 1 -1 2 5 3 5 3 10 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 -1 1 -1 1 5 1 10 1 10 2 5 2 5 2 5 3 10 3 5 © 2009, PrismTech. All Rights Reserved
  • 150. Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 5 2 5 3 10 3 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 -1 1 -1 1 5 1 10 1 10 2 5 2 5 2 5 3 10 3 5 © 2009, PrismTech. All Rights Reserved
  • 151. Sequencer @ Work Sequencer Reader TAccessRequest TAccessGrant TReleaseAccessGrant Writer 1 5 2 5 3 10 3 5 Proprietary Information - Distribution without Expressed Written Permission is Prohibited. DDS App-10 App-5 TAccessGrant TReleaseAccessGrant TAccessRequest TAccessGrant TReleaseAccessGrant TAccessRequest 1 5 1 -1 1 5 1 10 1 10 2 5 2 5 2 5 3 10 3 5 3 5 3 5 © 2009, PrismTech. All Rights Reserved
  • 152. Barriers Problem ‣ Often occurs in a distributed system that applications need to reach a common step in computation before proceeding. ‣ This is required for distributed application creating software pipelines, or even to ensure Proprietary Information - Distribution without Expressed Written Permission is Prohibited. proper state evolution of the distributed system. ‣ However DDS does not provide built-in coordination / distributed synchronization mechanisms. How can this be overcome? Solution ‣ Use Barriers in your system to coordinate application progress. © 2009, PrismTech. All Rights Reserved
  • 153. Barriers Detailed Solution ‣ Define in your system the following Topics: Proprietary Information - Distribution without Expressed Written Permission is Prohibited. struct TBarrier { struct TBarrierCondition { long computation_guid; long computation_guid; long task_guid; long status; long status; long cardinality; }; }; #pragma keylist Barrier computation_guid task_guid #pragma keylist Barrier computation_guid © 2009, PrismTech. All Rights Reserved
  • 154. Barriers Detailed Solution ‣ Make TBarrier and TBarrierCondition a Topic-Cache ‣ Use the following protocol to request/grant/release access Application Proprietary Information - Distribution without Expressed Written Permission is Prohibited. // Do Computation // Notify others write Barrier wait for BarrierCondition.cardinality Barrier instances to have the proper Barrier.status // Barrier has been passed... // Take next computational step © 2009, PrismTech. All Rights Reserved
  • 155. Barriers @ Work App-7 Reader Coordinator TBarrierCondition TBarrier Writer 1 10 0xF1 TBarrierCondition 1 0xFF 3 1 7 0xF1 1 0xFF 3 TBarrier Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 5 0xF1 1 7 0xF1 App-10 DDS App-5 TBarrierCondition TBarrier TBarrierCondition TBarrier 1 10 0xF1 1 10 0xF1 1 0xFF 3 1 0xFF 3 1 7 0xF1 1 7 0xF1 TBarrier TBarrier 1 5 0xF1 1 5 0xF1 1 10 0xF1 1 5 0xF1 © 2009, PrismTech. All Rights Reserved
  • 156. Barriers @ Work App-7 Reader Coordinator TBarrierCondition TBarrier Writer 1 10 0xF1 TBarrierCondition 1 0xFF 3 1 7 0xFF 1 0xFF 3 TBarrier Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 5 0xF1 1 7 0xFF App-10 DDS App-5 TBarrierCondition TBarrier TBarrierCondition TBarrier 1 10 0xF1 1 10 0xF1 1 0xFF 3 1 0xFF 3 1 7 0xF1 1 7 0xF1 TBarrier TBarrier 1 5 0xF1 1 5 0xF1 1 10 0xF1 1 5 0xF1 © 2009, PrismTech. All Rights Reserved
  • 157. Barriers @ Work App-7 Reader Coordinator TBarrierCondition TBarrier Writer 1 10 0xF1 TBarrierCondition 1 0xFF 3 1 7 0xFF 1 0xFF 3 TBarrier Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 5 0xF1 1 7 0xFF App-10 DDS App-5 TBarrierCondition TBarrier TBarrierCondition TBarrier 1 10 0xF1 1 10 0xF1 1 0xFF 3 1 0xFF 3 1 7 0xFF 1 7 0xFF TBarrier TBarrier 1 5 0xF1 1 5 0xF1 1 10 0xF1 1 5 0xF1 © 2009, PrismTech. All Rights Reserved
  • 158. Barriers @ Work App-7 Reader Coordinator TBarrierCondition TBarrier Writer 1 10 0xF1 TBarrierCondition 1 0xFF 3 1 7 0xFF 1 0xFF 3 TBarrier Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 5 0xF1 1 7 0xFF App-10 DDS App-5 TBarrierCondition TBarrier TBarrierCondition TBarrier 1 10 0xF1 1 10 0xF1 1 0xFF 3 1 0xFF 3 1 7 0xFF 1 7 0xFF TBarrier TBarrier 1 5 0xF1 1 5 0xFF 1 10 0xF1 1 5 0xFF © 2009, PrismTech. All Rights Reserved
  • 159. Barriers @ Work App-7 Reader Coordinator TBarrierCondition TBarrier Writer 1 10 0xF1 TBarrierCondition 1 0xFF 3 1 7 0xFF 1 0xFF 3 TBarrier Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 5 0xFF 1 7 0xFF App-10 DDS App-5 TBarrierCondition TBarrier TBarrierCondition TBarrier 1 10 0xF1 1 10 0xF1 1 0xFF 3 1 0xFF 3 1 7 0xFF 1 7 0xFF TBarrier TBarrier 1 5 0xFF 1 5 0xFF 1 10 0xF1 1 5 0xFF © 2009, PrismTech. All Rights Reserved
  • 160. Barriers @ Work App-7 Reader Coordinator TBarrierCondition TBarrier Writer 1 10 0xF1 TBarrierCondition 1 0xFF 3 1 7 0xFF 1 0xFF 3 TBarrier Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 5 0xFF 1 7 0xFF App-10 DDS App-5 TBarrierCondition TBarrier TBarrierCondition TBarrier 1 10 0xFF 1 10 0xF1 1 0xFF 3 1 0xFF 3 1 7 0xFF 1 7 0xFF TBarrier TBarrier 1 5 0xFF 1 5 0xFF 1 10 0xFF 1 5 0xFF © 2009, PrismTech. All Rights Reserved
  • 161. Barriers @ Work App-7 Reader Coordinator TBarrierCondition TBarrier Writer 1 10 0xFF TBarrierCondition 1 0xFF 3 1 7 0xFF 1 0xFF 3 TBarrier Proprietary Information - Distribution without Expressed Written Permission is Prohibited. 1 5 0xFF 1 7 0xFF App-10 DDS App-5 TBarrierCondition TBarrier TBarrierCondition TBarrier 1 10 0xFF 1 10 0xFF 1 0xFF 3 1 0xFF 3 1 7 0xFF 1 7 0xFF TBarrier TBarrier 1 5 0xFF 1 5 0xFF 1 10 0xFF 1 5 0xFF © 2009, PrismTech. All Rights Reserved
  • 162. Leader Election Problem ‣ Several distributed algorithms require some form of leader ‣ Problems requiring a leader, can be addressed using the Sequencer Pattern ‣ However, what if the sequencer crashes? Proprietary Information - Distribution without Expressed Written Permission is Prohibited. Solution ‣ Use the DDS OWNERSHIP_STRENGH as a mechanism to do leader election via DDS Observation ‣ The basic Leader Election functionality provided by DDS can be used to easily replicate service implementation such as those of the Sequencer ‣ If the leader is stateful, its state should be stored within DDS © 2009, PrismTech. All Rights Reserved