Scribd
Upload
40 views

Big Data

This document provides an overview of big data including its definition, characteristics, and challenges. It defines big data as data that requires new techniques to manage and extract value due to its large scale, diversity, and complexity. The key characteristics are described as the 3Vs - volume, variety, and velocity. It notes various sources that are generating big data from social media to sensors. Challenges in handling big data are also discussed including the need for new architectures and algorithms as well as skills to work with the large and complex datasets.

Uploaded by

JEEVA BHARATHI
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
40 views

Big Data

This document provides an overview of big data including its definition, characteristics, and challenges. It defines big data as data that requires new techniques to manage and extract value due to its large scale, diversity, and complexity. The key characteristics are described as the 3Vs - volume, variety, and velocity. It notes various sources that are generating big data from social media to sensors. Challenges in handling big data are also discussed including the need for new architectures and algorithms as well as skills to work with the large and complex datasets.

Uploaded by

JEEVA BHARATHI
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 16

Frontier Area Awareness

Department of Electronics and Communication Engineering

Mentor Name
M. Dinesh kumar /AP

Topic

Big Data
PRESENTED BY:
JEEVABHARATHI R
Big Data Definition

 No single standard definition…

“Big Data” is data whose scale, diversity, and complexity


require new architecture, techniques, algorithms, and
analytics to manage it and extract value and hidden
knowledge from it…
Characteristics of Big Data: 1-Scale (Volume)
 Data Volume
 44x increase from 2009 2020
 From 0.8 zettabytes to 35zb
 Data volume is increasing exponentially
Characteristics of Big Data: Complexity (Varity)
 Various formats, types, and structures
 Text, numerical, images, audio, video,
sequences, time series, social media data,
multi-dim arrays, etc…
 Static data vs. streaming data
 A single application can be
generating/collecting many types of data

To extract knowledge all these types


of data need to linked together
Characteristics of Big Data: Speed (Velocity)

 Data is begin generated fast and need to be processed fast


 Online Data Analytics
 Late decisions missing opportunities
Examples
 E-Promotions: Based on your current location, your purchase history, what you
like send promotions right now for store next to you

 Healthcare monitoring: sensors monitoring your activities and body any


abnormal measurements require immediate reaction
Big Data: 3V’s
Some Make it 4V’s
Harnessing Big Data

 OLTP: Online Transaction


Processing (DBMSs)
 OLAP: Online Analytical
Processing (Data Warehousing)
 RTAP: Real-Time Analytics
Processing (Big Data
Architecture & technology)
Who’s Generating Big Data ?

Social media and Scientific instruments Mobile devices


networks (collecting all sorts of data) (tracking all objects Sensor technology
(all of us are all the time) and networks
generating data) (measuring all kinds
of data)
• The progress and innovation is no longer hindered by the ability to collect data

• But, by the ability to manage, analyze, summarize, visualize, and discover knowledge from the collected
data in a timely manner and in a scalable fashion
The Model Has Changed…
 The Model of Generating/Consuming Data has Changed
Old Model: Few companies are generating data, all others are consuming data

New Model: all of us are generating data, and all of us are consuming data
What’s driving Big Data ?

- Optimizations and predictive analytics


- Complex statistical analysis
- All types of data, and many sources
- Very large datasets
- More of a real-time

- Ad-hoc querying and reporting


- Data mining techniques
- Structured data, typical sources
- Small to mid-size datasets
Value of Big Data Analytics

 Big data is more real-time in


nature than traditional DW
applications
 Traditional DW architectures (e.g.
Exadata, Teradata) are not well-
suited for big data apps
 Shared nothing, massively
parallel processing, scale out
architectures are well-suited for
big data apps
Challenges in Handling Big Data

 The Bottleneck is in technology


 New architecture, algorithms, techniques are needed
 Also in technical skills
 Experts in using the new technology and dealing with big data
Thank You

You might also like