0% found this document useful (0 votes)
16 views

Big Data Assignment 3

Uploaded by

aditparashar26
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
16 views

Big Data Assignment 3

Uploaded by

aditparashar26
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 5

Hive Archidecne and ouery tor Teloco m DA

Hives Archilectue is ideal ox handling


lage -scale dataike custames call zerds
dçe do i s Camponends
Metastre
Compilex
Ex ecahorn Engine
Hofs

Benehs foy Telecom Data : Hie can manage,


stere,and analyze he telecam company's Jage
Valumes od call iecords. By using HireL Analys
Can retne ve insights an usegepatt ns and
Lpopulay al timeswwh simpl saL-like que ies
HixeQl Queg
SELECT loco hon COUNT (*) ASCall-count
cOUNT AS
EROM call_xccords
wheRE all-dade BETWEEN 2424- 10-dt! AND
2024-10-31!
GROUp Y lacaton
GRDER BY call-C0und DESC
LIMIT O

This query idenhhes the top jo docahions with


dhe hiyhes numbez od calle in he pasd manth
PAGE

Hive Data Types and uerg t0 E-ammArCe


key HËve Data Types
INT Represents inogers ideal fos
nunehcal data.
STRINoi Stors textdada ,used tor
productcategornies
EL0AT/200BLE : Represe Hds decimal yalues.
suitable fos puschase amausds.
9ATE: Stoses_ date inamah anusehl fes
puschasE dates

Puschase Date: Stored as DATE


Praduct Categanies i stored as STRTNA
Puxehase Amaurds : Stoned as FLOAT 0Y DUBLE
HivegL oue
SELECT product caegog, suM (purchase amaud) A5
total-amount
PROMpurchose-data
WHERE purchase-data BETJEEN a24-10-ol' AND
2624 --10-3
|aRoup Y pradud ca cgory
Role ot Pig in ETL Processing_and Scopt
for Healhcame Data
avga4e As
patients
ge) ANG diugnesis qraup
As
qroupdy-diag
tesis FoREACH ageaverage
ag10ss, di
isrs diag Coch
oage avevsgcalculate
e diqrosis
and yraup
age OY
is0 >patictdata flLIER patiets== eldeny
nay): ieatmerdti chaianag dignss
rggeind2hderi CAs Storage Piq
USTNG
'patiet_dat.csy' LOAD
paient-data=
data patent
-Loadthe
Scipt fy
data sdoage
ax wareheuses.
indo pracesaed
dada gruping aLoadnd
ing fl opesatiehs
like wih Tionstorm
daa
SaaxÇeS multipe taam, dada Exdract
toahon 0gana healtcare heallws T
apsegmatis tomplex
acds which latin, Janguage velhigh-Je a
ETL:Rigsimplites
tasks ETL inPia otPole
Pig 2ada Tps Qnd and. Evechian Madeltoy
Weathe Data
Ans LMain Data Tysi
Atm: Repesents a single sadue
float tox demperae
Tuple.; Ordered Get ot ields ,repre;exhig multip
weathey readings Cemperare, håmdi ct]
ueatheg data tam mubioke locathS.
lap key value airs,, haugh less con nly
used
USed in weahex
weahex dat
Execution Mede of Piy: Pig's enecuton male
comples 5Cnpts inta a atguence ot MapReduce
Ljahs which are hen procaised in paalel.
weahex afency (an praccss The
humidita,and wind speed data empeane
nodes eticiently acrassdistibdel
Q.s key Pig Operators FunctioS, ahd
Hnancial Dada Analyis Scat to
Ans. keg Opexaors :
1EILTER:Selects records based anondiions
eq. hltenin rahsachions aver fi000
2akoUP: Ag
rgates data ,
data y emsg saphis. ushl tor analyzig
jcsuls the Displag
tonamautDAS
e SuMge-up, 910upAS CoENERATE
y-age 0&ped=faREACA
gr tahsachan.
amaurt toal
agegTup BY
ns yalue high hROUP y-qge= 9Tuped
greup an
ac tor aunttrarsachay
olal calculate q4eANaup
and daay oYoup |--
amau
nt cHon ansa
dat
Yransaction
1000j tansachias
FllIER value high
tleoo ansactens
ovey Elkr
dable amausdhansachion-
: icharany
int
agCCushmerid
e As torage Pig5 USING
on-dota.
csv tansachon-dota
LOAD ==
ansactiordatd Load
analyais demgaphic
aveage he Congudes
he 2AVG):
amauds tansaction asSuch
Funchons Ke
Helds speriha daass
hlwi nuscIrating
column. doa Used_Co£NERATE: 3ORLACH

You might also like