Scribd
Upload
159 views

Data Warehousing, OLAP, and Data Mining

OLAP and OLTP are different types of systems used for data analysis. OLTP systems handle transactional data in real-time, while OLAP systems analyze historical data to help with management decision making. OLAP uses multidimensional data models called cubes to enable interactive exploration of data through slicing, dicing, drilling, and pivoting. It allows for ad-hoc querying across multiple dimensions like products, time periods, and geographies. Common OLAP architectures include MOLAP, ROLAP, and HOLAP.

Uploaded by

Monica Rajora
Copyright
© Attribution Non-Commercial (BY-NC)
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
159 views

Data Warehousing, OLAP, and Data Mining

OLAP and OLTP are different types of systems used for data analysis. OLTP systems handle transactional data in real-time, while OLAP systems analyze historical data to help with management decision making. OLAP uses multidimensional data models called cubes to enable interactive exploration of data through slicing, dicing, drilling, and pivoting. It allows for ad-hoc querying across multiple dimensions like products, time periods, and geographies. Common OLAP architectures include MOLAP, ROLAP, and HOLAP.

Uploaded by

Monica Rajora
Copyright
© Attribution Non-Commercial (BY-NC)
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 28

OLAP, and OLTP

Introduction
Data, data, dataeverywhere! Informationthats another story! Especially, the right information @ the right time! Data ware housing's goal is to make the right information available @ the right time Data warehousing is a data store (eg., a database of some sort) and a process for bringing together disparate data from throughout an organization for decision-support purposes
2

Different Goal
Aggregation, summarization and exploration Of historical data To help management make informed decisions
Product Coke (0.5 gallon) Pepsi (0.5 gallon) Coke (1 gallon) Altoids Branch Convoy Street UTC UTC Costa Verde Time 2006-03-01 09:00:01 2006-03-01 09:00:01 2006-03-01 09:00:02 2006-03-01 09:01:33 Price $1.00 $1.03 $1.50 $0.30

...

Find the total sales for each product and month Find the percentage change in the total monthly sales for each product
3

OLAP and OLTP


OLTP-Online Transaction processing system (relies on solely on relational databases) record at time OLAP-Online analytical processing system (class of technologies that are designed for adhoc data access and analysis) deals with summarized data

Different Requirements
OLTP On-Line Transaction Processing OLAP On-Line Analytical Processing
OLTP Tasks Size of database Time span Size of working set Day to day operation Gigabytes Recent, up-to-date OLAP High level decision support Terabytes Spanning over months / years

Tens of records, accessed Consolidated data from through primary keys multiple databases Structured / repetitive Transaction throughput Ad-hoc, exploratory queries Query latency

Workload Performance

Data Warehouse
Enterprise Database
Customers

Orders

Transactions
Vendors Etc Data Miners: Farmers they know Explorers - unpredictable

Etc
Copied, organized summarized

Data Warehouse

Data Mining

General Architecture for Data Warehousing


Source systems Extraction, (Clean), Transformation, & Load (ETL) Central repository Metadata repository Data marts Operational feedback End users (business)
8

Where does OLAP fit in?

OLAP Overview
Interactive, exploratory analysis of multidimensional data to discover patterns

gender

age

ac

s nt e id c

10

OLAP Architecture

11

Server Options
Single processor Symmetric multiprocessor (SMP) Massively parallel processor (MPP)

12

OLAP Server Options


Multi-dimensional OLAP (MOLAP)
A k-dimensional matrix based on a non relational storage structure. [Agrawal et al]

Relational OLAP (ROLAP)


A relational back-end wherein operations of the data are translated to relational queries. [Agrawal et al]

Hybrid OLAP (HOLAP)


Integration of MOLAP with ROLAP.

Desktop OLAP (DOLAP)


Simplified versions of MOLAP or ROLAP.

ZOLAP
Speak with your chemist (normally only prescribed for death march victims)

13

OLAP Online Analytical Processing


A definition:

Data representation is in the form of a CUBE OLAP goes beyond SQL with its analysis capabilities Key feature of OLAP: Relevant multi-dimensional views such as products, time, geography

14

OLAP Cube - 1

15

OLAP Cube - 2

16

OLAP Cube - 3
Star Structure (quite common)
Product Model Type Color Facts Product Region Time Channel Revenue Expenses Units Region Nation District Dealer

Channel

Time Week Year

17

A Sample Data Cube


Pr od uc t
TV PC VCR sum 1Qtr 2Qtr

Date

3Qtr

4Qtr

sum

Total annual sales of TV in U.S.A. U.S.A Canada Mexico sum

Country

18

OLAP Cube - 5
ThreeDimensional Cube Display
Pag e R e g io n : N orth Red b lo b Row s Y ear 1996 1997 T otal B lu e b lo b C o lu m n s S a le s

T ota l

19

OLAP Cube - 6
Dimension Brand Store Customer segment Product group Period Variable Example Mt. Airy Atlanta Business Desks January Units sold

SixDimensional Cube

20

Rotation (Pivot Table)

21

Drill Down

22

OLAP Examples

http://perso.wanadoo.fr/bernard.lupin/english/example.htm

Excel Pivot Table example (similar to OLAP cube)

23

Sample of OLAP products

Just a snippet from http://www.olapreport.com/ProductsIndex.htm ; not an endorsement


24

Data Mining versus OLAP

25

Data Mining versus OLAP


OLAP - Online Analytical Processing
Provides you with a very good view of what is happening, but can not predict what will happen in the future or why it is happening

26

Results of Data Mining Include:


Forecasting what may happen in the future Classifying people or things into groups by recognizing patterns Clustering people or things into groups based on their attributes Associating what events are likely to occur together Sequencing what events are likely to lead to later events

27

Thanks for listening.

28

You might also like