The Operational Data Store - Tactical Analysis at Your Fingertips
The Operational Data Store - Tactical Analysis at Your Fingertips
Information Feedback
Operational
Systems Meta Data Management
Information Feedback
Data
API ERP Warehouse
Business Data CIF Data Data
Data Mining
Warehouse
DSI
Operations
API Internet
Acquisition Management Delivery
OLAP Data DSI
API Legacy Operational Mart
Data Store
API Other
Business Management
TrI Oper Mart DSI
Operational
Systems Meta Data Management
Operational
Systems Meta Data Management
subject-oriented
integrated
current
volatile
Summary
Architecture
Stores
Frequency of update
Synchronous with source
Class I systems
Asynchronous with source
Class II systems
Class III Degree of integration and
transformation
Class IV Degree of summarization
Class I - Characteristics
Class I
Updated synchronously
Updates appear within 2 to 3 seconds after
entered into source system
Uses messaging middleware or enterprise
application interface (EAI)
Little – if any – integration and
transformation
High-performance, transaction dominated
environment
Limited on instantaneous summarization
Class I - Example
Airline Flight Information ODS: A flight delay
updated in the flight scheduling system in
New York shows up both in San Francisco
airport’s gate management system and on the
airline’s web site within seconds
Sophisticated middleware or EAI makes this feasible
Resource intensive
High maintenance overhead
Difficult to get initially synchronized
Difficult and complex to maintain
An expensive system!
Copyright © 2003 Intelligent Solutions, Inc. All Rights Reserved 18
Classes of
ODS
Class II - Characteristics
Data is stored and forwarded later Class II
Refreshment multiple times a day
Anywhere from 15 minutes to several hours
Class II - Example
Bank Consolidated Accounts ODS: Consolidated
information on bank’s corporate customers with
numerous dispersed accounts
Consolidation is needed!
ODS will contain relatively simple data
structures and integration
Copyright © 2003 Intelligent Solutions, Inc. All Rights Reserved 20
Classes of
ODS
Class IV - Characteristics
Analysis (profiling) completed in
the data warehouse Class IV
Via Feedback loop knowledge is
applied to current list on the ODS
Data movement at
regular/irregular intervals
A Class I, II, or III can become a
Class IV
Requires the data warehouse to
be in place
Class Comparisons
Class I Class II Class III Class IV
Summary
Classes of ODS
Different technologies and purposes
Based on different refresh needs and strategies
Class I is instantaneous updates
Class II has a frequency of 15 minutes to
several hours
Class III is updated once a day
Class IV feeds information from the data
warehouse to any class of ODS
Operational
Systems Meta Data Management
Messaging Products
IBM MQSeries
Tibco
Neon
Tuxedo
EAI Vendors
BizTalk –Microsoft
Data Junction –
Integration Architect
iWay – IBI
SeeBeyond
Virtuoso – OpenLink
Vitria
WebMethods
WebSphere - IBM
Operational
Systems Meta Data Management
to ODS
Library & Toolbox Information Workshop Workbench
Information Feedback
Operational
Systems Meta Data Management
Transactional Interface
InterfaceInformation
Library & Toolbox
The Transactional Workshop
is an easy-to-use and Workbench
Information Feedback
The Decision Support Interface is an easy-to-use,
intuitive tool to enable end user capabilities such
External Exploration DSI
as exploration, data mining, OLAP, query, and Warehouse
Data
reporting
API ERP to distill information from data.
Warehouse Data Mining
DSI
Warehouse
Internet
Data CIF Data Data
API
Acquisition Management Delivery
OLAP Data DSI
API Legacy Operational Mart
Data Store
TrI Oper Mart
API Other DSI
Operational
Systems Meta Data Management
Summary
Interfaces will need to be created:
From the operational systems to the ODS (and back)
From the ODS to the oper-mart
From the ODS to the data warehouse
From the data warehouse or data mart to the ODS
Transactional interface
Middleware software – a very useful where frequency
of update is extremely important
ETL tools (with meta data) – a large part of work
effort
ODS First
Complex operational systems
Summary
An organization builds an ODS for various
reasons, one of the most important is an
integrated customer database.
The ODS plays an important role in CRM for
customer integration.
An integrated corporate operational data
store can become crucial for day to day
business in every industry.
Books
Mastering Data Warehouse Design - Relational and
Dimensional Techniques, by Claudia Imhoff, Nicholas
Galemmo, and Jonathan G. Geiger (John Wiley & Sons, 2003)
Claudia Imhoff, Nicholas Galemmo, and Jonathan Geiger
Books
Data Warehousing for e-Business
W. H. Inmon, R. H. Terdeman, Joyce Norris-Montanari, Dan
Meers
John Wiley & Sons – ISBN 0-471-41579-0
Books
The Data Warehouse Lifecycle Toolkit
Ralph Kimball, L. Reeves, M. Ross, W. Thornthwaite
Books
The Data Model Resource Book (Volumes 1 and 2)
Len Silverston