Scribd
Upload
87 views

DWM Mod 1

The document provides an overview of key concepts in data warehousing including: 1. It defines a data warehouse as a centralized database that collects, organizes, and stores data from different sources in a structured way. 2. It describes common data warehouse architectures like star schemas that organize data around fact and dimension tables. 3. It explains important processes like ETL which extracts, transforms and loads data from source systems into the data warehouse.

Uploaded by

Janvi Waghmode
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
87 views

DWM Mod 1

The document provides an overview of key concepts in data warehousing including: 1. It defines a data warehouse as a centralized database that collects, organizes, and stores data from different sources in a structured way. 2. It describes common data warehouse architectures like star schemas that organize data around fact and dimension tables. 3. It explains important processes like ETL which extracts, transforms and loads data from source systems into the data warehouse.

Uploaded by

Janvi Waghmode
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 17

1.

DATA WAREHOUSE FUNDAMENTALS

• Introduction to Data Warehouse


A data warehouse is like a big storage space for all the important
information and data of a company. It's a centralized database where data
from different sources is collected, organized, and stored in a structured
way.

• Data Warehouse Architecture: Basic

Operational System

An operational system is a method used in data warehousing to refer to


a system that is used to process the day-to-day transactions of an
organization.

Flat Files

A Flat file system is a system of files in which transactional data is stored,


and every file in the system must have a different name.
Meta Data

A set of data that defines and gives information about other data. Meta
Data used in Data Warehouse for a variety of purpose, including:

Meta Data summarizes necessary information about data, which can make
finding and work with particular instances of data more accessible. For
example, author, data build, and data changed, and file size are examples
of very basic document metadata.

Lightly and highly summarized data

The area of the data warehouse saves all the predefined lightly and highly
summarized (aggregated) data generated by the warehouse manager.

The goals of the summarized information are to speed up query


performance. The summarized record is updated continuously as new
information is loaded into the warehouse.

End-User access Tools

The principal purpose of a data warehouse is to provide information to


the business managers for strategic decision-making. These customers
interact with the warehouse using end-client access tools.

The examples of some of the end-user access tools can be:

o Reporting and Query Tools


o Application Development Tools
o Executive Information Systems Tools
o Online Analytical Processing Tools
o Data Mining Tools
• Data warehouse versus Data Marts
• E-R Modeling versus Dimensional Modeling
• Information Package Diagram

• Data Warehouse Schemas

Schema is a logical description of the entire database. It includes the


name and description of records of all record types including all
associated data-items and aggregates.

Much like a database, a data warehouse also requires to maintain a


schema.

A database uses relational model, while a data warehouse uses Star,


Snowflake, and Fact Constellation schema. In this chapter, we will
discuss the schemas used in a data warehouse.
• Star Schema

A star schema is a type of data modelling technique used in data


warehousing to represent data in a structured and intuitive way.

In a star schema, data is organized into a central fact table that contains
the measures of interest, surrounded by dimension tables that describe
the attributes of the measures.

In a star schema, each dimension table is joined to the fact table


through a foreign key relationship.

Characteristics of Star Schema


The star schema is intensely suitable for data warehouse database design
because of the following features:

o It creates a DE-normalized database that can quickly provide query


responses.
o It provides a flexible design that can be changed easily or added to
throughout the development cycle, and as the database grows.
o It provides a parallel in design to how end-users typically think of
and use the data.
o It reduces the complexity of metadata for both developers and end-
users.
Fact Tables
The fact table in a star schema contains the measures or metrics that are
of interest to the user or organization. For example, in a sales data
warehouse, the fact table might contain sales revenue, units sold, and
profit margins.

Dimension Table
The dimension tables in a star schema contain the descriptive attributes
of the measures in the fact table. These attributes are used to slice and
dice the data in the fact table, allowing users to analyze the data from
different perspectives.

Fact less Facts

We have also a transaction fact tables which contain no measures. We call


it as fact less fact tables. These tables are used to capture the action of the
business process. For example, a criminal case is a simple fact with no
measures but can have a lot of dimensional attributes associated with the
fact.
• Snowflake Schema

The snowflake schema is a variant of the star schema. Here, the


centralized fact table is connected to multiple dimensions

In a snowflake schema, the fact table is still located at the centre of the
schema, surrounded by the dimension tables.

However, each dimension table is further broken down into multiple


related tables, creating a hierarchical structure that resembles a
snowflake.

Characteristics of Snowflake Schema


1. The primary advantage of the snowflake schema is the development
in query performance due to minimized disk storage requirements
and joining smaller lookup tables.
2. It provides greater scalability in the interrelationship between
dimension levels and components.
3. No redundancy, so it is easier to maintain.
• Fact Constellation Schema

Fact Constellation is a schema for representing multidimensional


model. It is a collection of multiple fact tables having some common
dimension tables.

It can be viewed as a collection of several star schemas and hence,


also known as Galaxy schema.

It is one of the widely used schema for Data warehouse designing and
it is much more complex than star and snowflake schema. For
complex systems, we require fact constellations.

• Update to the dimension tables

• Major steps in ETL process

ETL stands for Extract, Transform, Load and it is a process used in data
warehousing to extract data from various sources, transform it into a
format suitable for loading into a data warehouse, and then load it into
the warehouse. The process of ETL can be broken down into the
following three stages:

Extract: The first stage in the ETL process is to extract data from various
sources such as transactional systems, spreadsheets, and flat files. This
step involves reading data from the source systems and storing it in a
staging area.

Transform: In this stage, the extracted data is transformed into a format


that is suitable for loading into the data warehouse. This may involve
cleaning and validating the data, converting data types, combining
data from multiple sources, and creating new data fields.

Load: After the data is transformed, it is loaded into the data


warehouse. This step involves creating the physical data structures and
loading the data into the warehouse.

The ETL process is an iterative process that is repeated as new data is


added to the warehouse. The process is important because it ensures
that the data in the data warehouse is accurate, complete, and up-to-
date. It also helps to ensure that the data is in the format required for
data mining and reporting.
• OLTP versus OLAP
• OLAP operations:

OLAP stands for Online Analytical Processing Server. It is a software


technology that allows users to analyse information from multiple
database systems at the same time.

There are five basic analytical operations that can be performed on an


OLAP cube:

1. Drill down: In drill-down operation, the less detailed data is


converted into highly detailed data. It can be done by:
Moving down in the concept hierarchy
Adding a new dimension

In the cube given in overview section, the drill down operation is


performed by moving down in the concept hierarchy of Time
dimension (Quarter -> Month).
2. Roll up: It is just opposite of the drill-down operation. It performs
aggregation on the OLAP cube. It can be done by:
Climbing up in the concept hierarchy
Reducing the dimensions

In the cube given in the overview section, the roll-up operation is


performed by climbing up in the concept hierarchy of Location
dimension (City -> Country).

3. Dice: It selects a sub-cube from the OLAP cube by selecting two or


more dimensions. In the cube given in the overview section, a sub-
cube is selected by selecting following dimensions with criteria:
Location = “Delhi” or “Kolkata”

Time = “Q1” or “Q2”

Item = “Car” or “Bus”

4. Slice: It selects a single dimension from the OLAP cube which


results in a new sub-cube creation. In the cube given in the
overview section, Slice is performed on the dimension Time = “Q1”.

5. Pivot: It is also known as rotation operation as it rotates the current


view to get a new view of the representation. In the sub-cube
obtained after the slice operation, performing pivot operation
gives a new view of it.

You might also like