Scribd
Upload
71 views1 page

BDSCP Module 08 Mindmap

Uploaded by

pietropes
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
71 views1 page

BDSCP Module 08 Mindmap

Uploaded by

pietropes
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 1

data transfer engine (file/relational) data transfer engine (event/file/relational)

on-disk storage device storage device (on-disk/in-memory)


processing engine (batch) simple example Big Data Solutions complex example processing engine (batch/realtime)
query engine analytics engine
workflow engine serialization engine
compression engine
workflow engine
Advanced Mechanisms serialization engine
compression engine

read-through in-memory data grid (IMDG)


write-through In-Memory Storage Devices
write-behind in-memory database (IMDB)
Realtime Big Data Processing event stream processing (ESP)
refresh-ahead
complex event processing (CEP)

speed
SCV consistency
Module 8 volume
associative property Advanced MapReduce Advanced Big Data Engineering
commutative property
1. establish and evaluate data inputs and outputs
2. determine data wrangling requirements
Big Data Solutions Design Process 3. select data representation format
4. assess processing engine suitability
5. develop data processing routines
data collection
6. develop visualizations
data refinement stages Big Data Pipeline extract-load-transform (ELT)
7. automate solution execution
data consumption

local processing
aggregators Bulk Synchronous Parallel (BSP) Processing Engine superstep stages communication
combiners barrier synchronization

cyclic graph
acyclic graph graph types weighted graph
unweighted graph

uni-directed graph directed graph


bi-directed graph undirected graph

Module 8: Advanced Big Data Engineering Big Data Science Certified Professional (BDSCP) Program
Official Mind Map Supplement Copyright © Arcitura Education Inc. www.arcitura.com

You might also like