DESIGNMIND

ARCHITECTING A DATA WAREHOUSE

A CASE STUDY
Project: zBis
Carl Zeiss Vision North America

ELIZABETH DIAMOND
DATA WAREHOUSE ARCHITECT, DESIGNMIND

SAN FRANCISCO SQL SERVER USER GROUP

SEPTEMBER 9, 2009
Tonight’s Speaker

Elizabeth Diamond

Senior Data Warehousing and BI Consultant

DesignMind in Emeryville, CA

Specialist in Enterprise Data Management Systems

Lead Data Warehouse Architect and ETL Developer

Author and Speaker

Building the Connection Between Your Business and Your IT
Infrastructure

Developing Your Enterprise Data Warehouse Using Business
Processes

Tonight’s Topic: Architecting a Data Warehouse

The Journey

Determined Need for Enterprise Data Warehouse

Worked with Business Users to Understand Business
Requirements

Determined Software Requirements

MS SQL Server 2005 & 2008

MS SSIS (ETL Tool)

MS SSAS (Analytic Cube Tool)

MS SSRS & Excel (Reporting Tools)

SharePoint for Deploying Reports over Company
Intranet

Designed and Developed zBis Data Warehouse
Z BIS = What We Will Deliver

This project team will deliver the following:

X

Consolidated reporting for Carl Zeiss Vision
North America
X

Reporting that is consistent and from one
data warehouse
X

Reporting that is easy to use and easy to
access
X

Toolset will be flexible and able to grow and
change with our business
X Phase I rock solid download from ERP/Manf


– Providing ability to review lab information
as a lab network – not individual silos – with
accurate reporting across all products and
services
We will deliver the best product possible based on the information we
can place in our data warehouse!
• Reporting from cubes – off source systems only –
No data warehouse

• Disparate data systems with different results from

each

• Most systems not balanced to GL

• Reporting for each business unit only

• No reporting across all business units

 Transactional Cube of Approach
Sales Queries Other Reports Sales Reports

Corporate

Download
Data Mart Data Mart Data Mart
Finance Inventory Sales & Marketing

ETL Loads

ETL Load

ODS/Staging
Operational Data Store

ETL Load

ERP Manufacturing Other

 BI Tools/Analytics Active
Excel Static Reports
Reports

PerformancePoint Server

SharePoint

SQL
SQL Analytics
Reporting
Server (SSAS)
Server

Aggregated Finance Inventory

Sales
Data Mart Data Mart Data Mart
Data Mart
TBD

ETL Load (SSIS)

Data Warehouse

ETL Load (SSIS)

ODS/Staging
Operational Data Store

ETL Load (SSIS)

ERP Manufacturing SW Other Data Sources

Introduction to Data Warehousing

What is a Data Warehouse System

Why a Data Warehouse Vs. Cubes on Source Systems

Star Schema Vs. Transactional Data Warehouses

Star Schemas ease of system integrating

Star Schemas provide substantial performance gains

Star Schemas hierarchy capabilities or Drill Down
Capabilities

Ralph Kimball Developed Current Industry Standards for Star
Schema – Dimensions and Facts
 Data Warehouse Project Lifecycle
Technical Product
Architecture Selection &
Design Installation
Project
Business Data Staging Testing
Planning Dimensional Physical
Requirement Design & ETL & Deployment Maintenance
Modeling Design
Definition Development DW/DM

Report Report Report

Specifications Development Testing

Project Management
4 + 1 – Steps
Dimensional Design Process
Ralph Kimball’s Process for Developing Star Schemas
1. Determine Business Process

Model business Processes

Each Process will determine 1 or more Facts

Design DW by Business Process Not Business Unit
2. Identify the Grain of the Fact
• What does 1 row in Fact table represent
• Transactional or Summary
3. Design the DW Dimensions
4. Design the DW Facts
+1 Determine Hierarchies
Business Driven vs. Data Driven

Design DW/BI System via Business Process

Develop DW/BI System via Data from Source Systems

Profile Data as early as possible

Understand data and design DW using existing data

Design & Develop using both Business Process and available

Data if possible
Understanding Your Business

Identify key business sponsors for DW project

Use Corporate Org Chart

Setup initial interviews with key sponsors

Develop Business Process diagrams

Develop high level Use Case Diagrams

Determine Business Hierarchies

The Business Executive Interview
• What are the objectives of your organization?

• What Business goals do you want to accomplish with the

development of zBis data warehouse System?

• How do you measure success? How do you know you are doing
well? How often do you measure your corporate performance?

• What are your key business issues that you are trying to solve
from the zBis system? If these issues are not justified what is the
impact to your department and organization?
The Business Executive Interview
• How do you identify problems or know when you might be
headed for trouble?

• How do you spot exceptions in your business? What

opportunities exist to dramatically impact your business based
on improved access to information? What is the financial
impact

• If you could….., What would it mean to your business?

• What is your vision to better leverage information within your

organization?

• How do you anticipate that your staff will interact directly with
this information?
The Business Manager Interview
• What are the objectives of your department?

• What are you trying to accomplish? How would do you go

about achieving your objectives?
• What are your success metrics?

• How do you know you are doing well?

• How often do you measure your department/team?

• How do you anticipate that your staff will interact directly with
this information?
Business Process Diagrams

Understand Business Requirements for building
DW/BI system.

Defines the Measures and Dimensions for data

warehouse
Determine Hierarchies

Customer Hierarchies – Sales Channels

Distribution Channels

Business Channels

Customer Channels

Product Divisions

Sales Organizations

Sales Office

Buy Groups/Directly Purchase
Determine Hierarchies

Product Hierarchy

Manufacturer

Brand

Product Type – Each product type had own Hierarchy

Lens

Service

Equipment

etc…

Design

Make/Model
Determine Hierarchies

Geo Hierarchy

Sales Division

Sales Region

Sales Territory
Conformed Dimensions

Standardized dimensions across data warehouse

Dimensions are associated with multiple business
processes

Determine by using Bus Matrix & enforced in ETL

Conformed Dimensions are shared and consistent
across fact tables
Use Data Warehouse BUS Matrix

Use Data Warehouse BUS Matrix for

Understanding & mapping of Business Processes and
Dimensions

Ongoing DW/BI planning efforts

Team & Management Communications

Understand Business Process unions across the enterprise
Data Warehouse BUS Matrix
Date Company Customer Product Geo Dist Ctr Promo
Company X X X X X X
Sales
Customer X X X X X X
Discounts
Product X X X X X X X
Cost
Company X X X
Inventory
Dist Ctr X X X
Inventory
Develop Dimensional Schema
Slow Changing Dimensions

Type 1 – Overwrite existing Dimension Row

Use when don’t need to keep history data row

Can be used to correct bad data

Type 2 – Create a new Dimension Row

Use date and/or active non-active fields to identify current
and inactive data rows

Type 3 – Keep old and add new attributes in Dimension Row

Allow Alternate realities to exist simultaneously in one
Dimension Row

Slow Changing Dimensions are handled in the ETL
Type of Dimensions

Mini-Dimension

Junk Dimensions

Outrigger Dimensions

Small Static Dimensions

Lookup tables
Type of Facts

Transaction Fact Tables

Snapshot Fact Tables

Accumulating Snapshot Fact Tables

Consolidated or Aggregated Fact Tables
Bridge Tables
Bridge Tables
Recommended Reading list

The Data Warehouse Toolkit: The Complete Guide to Dimensional
Modeling (Second Edition) by Ralph Kimball and Margy Ross

The MicrosoftData Warehouse Toolkit: With SQL Server2005 and the

MicrosoftBusiness Intelligence Toolset by Joy Mundy, Warren
Thornthwaite, and Ralph Kimball

Building a Data Warehouse: With Examples in SQL Server (Expert's Voice)

by Vincent Rainardi

The Data Warehouse Lifecycle Toolkit by Ralph Kimball, Margy Ross,

Warren Thornthwaite, and Joy Mundy

The Data Warehouse ETL Toolkit: Practical Techniques for Extracting,

Cleanin by Ralph Kimball and Joe Caserta
Elizabeth Diamond
Senior Data Warehouse Architect

DesignMind
Emeryville, CA
www.designmind.com
 www.bayareasql.org

To attend our meetings or inquire about speaking opportunities,

please contact:

Mark Ginnebaugh, User Group Leader [email protected]