Scribd
Upload
66 views

Blocks of Data Warehouse: Components or Building

The document discusses the various components that make up a typical data warehouse architecture, including sources of data, extraction and transformation processes, metadata management, data storage in a data mart or multidimensional database, and delivery of information through reporting and online analytical processing. It also explains the need to maintain a separate data warehouse from operational databases in order to integrate both internal and external sources of historical, archived, and production data for analysis.

Uploaded by

Firoj Firoj
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
66 views

Blocks of Data Warehouse: Components or Building

The document discusses the various components that make up a typical data warehouse architecture, including sources of data, extraction and transformation processes, metadata management, data storage in a data mart or multidimensional database, and delivery of information through reporting and online analytical processing. It also explains the need to maintain a separate data warehouse from operational databases in order to integrate both internal and external sources of historical, archived, and production data for analysis.

Uploaded by

Firoj Firoj
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 12

0.

04

Components or Building
Blocks of Data
Warehouse
Architecture is the proper arrangement of the
elements. We build a data warehouse with
software and hardwarecomponents. To suit
the requirements of our organizations, we
arrange these building we may want to boost
up another part with extra tools and services.
All of these depends on our circumstances.

Source data
External

Management and control

Metadata
Data mining

Data Warehouse Multi-


DBMS dimensional
Database OLAP

Datastorage
Data marts

Data staging Report/Query

Components or Building Blocks Of Data Warehouse

O
1) Data Extraction: This method has to deal
with numerous data sources. We have to
employ the appropriate techniques for each
data source.

2) Data Transformation: As we know, data for a


data warehouse comes from many different
sources. If data extraction for a data
warehouse posture big challenges, data
transformation present even significant
challenges. We perform several individual
tasks as part of data transformation.

First, we clean the data extracted from each


source. Cleaning may be the correction of
misspellings or may deal with providing default
values for missing data elements, or
elimination of duplicates when we bring in the
same data from various source systems.

O
Information Delivery Component

Lab Analytics - Real Time Quality Management

dpspa.com Visit Site

The information delivery element is used to


enable the process of subscribing for data
warehouse files and having it transferred to
one or more destinations according to some
customer-specified scheduling algorithm.

Data
AD hoc reports
warehouse
Online
Complex queries

Intranet MD Analysis

Statistical Analysis
Internet

O
12:47

javatpoint.com/data-war 29

Metadata Component

GeeksforGeeks

Perseveranceand skillscan
get you a job even on Mars.
Make PLACEMENTS easy
withGeeksforGeeks

Get Ready For Your Dream Job

ee GeeksforGeeks Sign Up

Metadata in a data warehouse is equal to the


data dictionary or the data catalog in a
database management system. In the data
dictionary, we keep the data about the logical
data structures, the data about the records and
addresses, the information about the indexes,
and so on.

Data Marts

O
Management and Control
Component
The management and control elements
coordinate the services and functions within
the data warehouse. These components
control the data transformation and the data
transfer into the data warehouse storage. On
the other hand, it moderates the data delivery
to the clients. Its work with the database
management systems and authorizes data to
be correctly saved in the repositories. It
monitors the movement of information into the
staging method and from there into the data
warehouses storage itself.

Why we need a separate Data


Warehouse?

GeeksforGeeks

Perseveranceand skillscan
get you a job even on Mars.
Source data coming into the data warehouses
may be grouped into four broad categories:

Production Data: This type of data comes from


the different operating systems of the
enterprise. Based on the data requirements in
the data warehouse, we choose segments of
the data from the various operational modes.

Internal Data: In each organization, the client


keeps their "private" spreadsheets, reports,
0.17

Internal Data: In each organization, the client


keeps their "private" spreadsheets, reports,
customer profiles, and sometimes even
department databases. This is the internal
data, part of which could be useful in a data
warehouse.
Archived Data: Operational systems are mainly
intended to run the current business. In every
operational system, we periodically take the old
data and store it in achieved files.
External Data: Most executives depend on
information from external sources for a large
percentage of the information they use. They
use statistics associating to their industry
produced by the external department.
Data Staging Component

After we have been extracted data from various


operational systems and external sources, we
have to prepare the files for storing in the data
warehouse. The extracted data coming from
several different sources need to be changed,
converted, and made ready in a format that is
relevant to be saved for querying and analysis.

We will now discuss the three primary


functions that take place in the staging area.
3) Data Loading: Two distinct categories of
tasks form data loading functions. When we
complete the structure and construction of the
data warehouse and go live for the first time,
we do the initial loading of the information into
the data warehouse storage. The initial load
moves high volumes of data using up a
substantial amount of time.
Data Storage Components

GeeksforGeeks

perseverance and skillscan


get you a job even on Mars.
Make PLACEMENTS easy
withGeeksforGeeks

Get Ready For Your Dream Job

ee GeeksforGeeks Sign Up

Data storage for the data warehousing is a split


repository. The data repositories for the
operational systems generally include only the
current data. Also, these data repositories
include the data structured in highly normalized
for fast and efficient processing.

You might also like