0% found this document useful (0 votes)
7 views

Big Data What Is Big Data?

Big data refers to tools and techniques for managing large, diverse datasets in high volumes and velocities. It is characterized by its size, structure including both structured and unstructured data, and streaming nature. Big data can be used in business operations, transactions, customer and product information, websites, and unstructured data from sources like GPS and social media. Traditional databases face challenges with rapidly growing data, including issues with scalability, performance, and adapting to new requirements. Big data in education can analyze and correlate student and social media data from various sources to gain insights. It uses approaches involving scalable hardware, different processing models, and software frameworks and tools.
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOC, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
7 views

Big Data What Is Big Data?

Big data refers to tools and techniques for managing large, diverse datasets in high volumes and velocities. It is characterized by its size, structure including both structured and unstructured data, and streaming nature. Big data can be used in business operations, transactions, customer and product information, websites, and unstructured data from sources like GPS and social media. Traditional databases face challenges with rapidly growing data, including issues with scalability, performance, and adapting to new requirements. Big data in education can analyze and correlate student and social media data from various sources to gain insights. It uses approaches involving scalable hardware, different processing models, and software frameworks and tools.
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOC, PDF, TXT or read online on Scribd
You are on page 1/ 3

Resume Topsus Tekkom

2014

Jumat 26 September

BIG DATA

What is big data?

Big data: Tools and technique to manage different type of data, in high volume, in
high velocity,with varied requirement

Characteristics

Size

Structure : structured, unstructured : audio, video, text, geospatial, schema


less structure

Stream : torrent of realtime info (cctv, tv, satellite, feeds)

Operation : massively parallel processing

: scale up and scale out

Whats on?
Big data in term of size 90%
Big data in term of variety, relational databse , spreadsheet
Youtube (application wich use database) receives 24 hours of video
everyminutes

Where big data can be used?

Business operations

Transaction: Registers,Gate aways

Customer information: CRM

Product information: Barcodes, Rfid

Web: Pages,Web repositories

Unstructured information: GPS, social media, signal , mobile etc

Traditional DBMS

Legacy
Faster retrieval, efficient storage, divide and acces, data consolidation,
broader tables , access all as row, fine grain (acces, security, rules and
policies)
Problem in database
Data growth

Scalability issues
Performance issues
New type of requirements
Deciding what to analyze, when and how
Cost of chage in the subject area to analyze

Big data in Education


Big data can be used for education to analyze and correlate student and social
media data. Big data integrate data from some different sources , ex:
-

Student administration system


Student attendance system
Project system
Equipment loan management
E-learning
Social media
Virtual learning platform

Big data in curriculum


can be used for education to analyze and correlate student and social media data
Data discovery and mining
Uncover hidden treasure / secrets within the data, data is fed into machine
learning algorithm. Algorithm learns the data and procedurs model future data is
fed into the model and used to classify for perfect values.
Data virtualization
ways to view data
Grapichal best
Very important for decision making no time for going throught
Big data Approach:
1. Hardware ex: commodity hardware, appliance, dynamic scaling, fault
tolerant, highly available, cloud
2. Processing models ex : in memory , in database, interface/ adapters,
workload management
3. Software frame works, open source, proprietary
HDFS architechture

Hadoop Data Flow Example:


NETWORK
STORAGE

SCRIBE

WEB SERVERS

Oracle,
MySQL,
apps

Hadoop hive
DWH

MySQL,
Oracle, feeds

You might also like