Scribd
Upload
31 views

Lecture 2

This document provides an introduction and background on data warehousing. It discusses the growing need for data warehousing due to the vast amounts of data being collected by organizations. Historical data storage methods are outlined from the 1960s to present. The reasons for implementing a data warehouse are then described. Key points include using a data warehouse to gain a total view of an organization from integrated historical data in order to enable intelligent decision making. A data warehouse is defined as a complete repository of extracted historical transaction data available for ad-hoc access to support knowledge workers.

Uploaded by

za6372571
Copyright
© © All Rights Reserved
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
31 views

Lecture 2

This document provides an introduction and background on data warehousing. It discusses the growing need for data warehousing due to the vast amounts of data being collected by organizations. Historical data storage methods are outlined from the 1960s to present. The reasons for implementing a data warehouse are then described. Key points include using a data warehouse to gain a total view of an organization from integrated historical data in order to enable intelligent decision making. A data warehouse is defined as a complete repository of extracted historical transaction data available for ad-hoc access to support knowledge workers.

Uploaded by

za6372571
Copyright
© © All Rights Reserved
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 20

Lecture-2

Introduction and Background

1
The need

“Drowning in data and starving


for information”
Knowledge is power, Intelligence
is absolute power!

2
The need
$
POWER

INTELLIGENCE

KNOWLEDGE

INFORMATION

DATA

3
Historical overview

1960
Master Files & Reports

1965
Lots of Master files!

1970
Direct Access Memory & DBMS

1975
Online high performance transaction processing 

4
Historical overview

1980
PCs and 4GL Technology (MIS/DSS) 
1985 & 1990 
Extract programs, extract processing,
The legacy system’s web

5
Historical overview: Crisis of Credibility
What is the financial health of our company?


??

 

-10%

+10%



6
Why a Data Warehouse (DWH)?
 Data recording and storage is growing.

 History is excellent predictor of the future.

 Gives total view of the organization.

 Intelligent decision-support is required for


decision-making.

7
Reason-1: Why a Data Warehouse?
 Data Sets are growing.

How Much Data is that?


1 MB 220 or 106 bytes Small novel – 31/2 Disk
Paper rims that could fill the back of
1 GB 230 or 109 bytes
a pickup van
50,000 trees chopped and converted
1 TB 240 or 1012 bytes
into paper and printed
Academic research libraries across
2 PB 1 PB = 250 or 1015 bytes
the U.S.
All words ever spoken by human
5 EB 1 EB = 260 or 1018 bytes
beings

8
Reason-1: Why a Data Warehouse?
 Size of Data Sets are going up .
 Cost of data storage is coming down .
 The amount of data average business collects and
stores is doubling every year

 Total hardware and software cost to store and


manage 1 Mbyte of data
 1990: ~ $15
 2002: ~ ¢15 (Down 100 times)
 By 2007: < ¢1 (Down 150 times)

9
Reason-1: Why a Data Warehouse?
 A Few Examples
 WalMart: 24 TB
 France Telecom: ~ 100 TB
 CERN: Up to 20 PB by 2006
 Stanford Linear Accelerator Center (SLAC):
500TB

10
Caution!

A Warehouse of Data
is NOT a
Data Warehouse

11
Caution!

Size
is NOT
Everything

12
Reason-2: Why a Data Warehouse?

 Businesses demand Intelligence (BI).


 Complex questions from integrated data.
 “Intelligent Enterprise”

13
Reason-2: Why a Data Warehouse?
DBMS Approach
List of all items that were sold last
month?

List of all items purchased by Tariq


Majeed?

The total sales of the last month


grouped by branch?

How many sales transactions


occurred during the month of
January?

14
Reason-2: Why a Data Warehouse?
Intelligent Enterprise
Which items sell together? Which
items to stock?

Where and how to place the items?


What discounts to offer?

How best to target customers to


increase sales at a branch?

Which customers are most likely to


respond to my next promotional
campaign, and why?

15
Reason-3: Why a Data Warehouse?
 Businesses want much more…

 What happened?
 Why it happened? Stages of
Data
 What will happen? Warehouse

 What is happening?
 What do you want to happen?

16
What is a Data Warehouse?

A complete repository of historical


corporate data extracted from
transaction systems that is available
for ad-hoc access by knowledge
workers.

17
What is a Data Warehouse?
Complete repository
History
Transaction System
Ad-Hoc access
Knowledge workers

18
What is a Data Warehouse?
Transaction System
 Management Information System (MIS)
 Could be typed sheets (NOT transaction system)

Ad-Hoc access
 Dose not have a certain access pattern.
 Queries not known in advance.
 Difficult to write SQL in advance.

Knowledge workers
 Typically NOT IT literate (Executives, Analysts, Managers).
 NOT clerical workers.
 Decision makers.
19
Another View of a DWH

Subject
Oriented

Integrated

Time
Variant

Non
Volatile

20

You might also like