SlideShare a Scribd company logo
Internet OfThings & Big Data
As Service
About me
Sriram Reddy
Architect
www.Ammeon.com
Software Architect with a passion for
• Linked Devices
• Device Multi Tenancy
• Low Power Wide Area Networks
• Distributed Device Management
• Low Power Device Security
• Distributed Data Persistence
• Distributed Data Processing
• Analytics
Index
1. Introduction
2. Internet Of Things
• Micro Controller & Processor
• Power Management
3. IOT Networks
• Long Range
• Short Range
4. IOT Data Types
• Binary (MQTT & Proto buff)
• Jason
5. IOT Data Acquisition
• MQTT
• CoAP
• Kafka
5. IOT Data processing
• Spark
• Nifi
• StreamSets
6. Data Persistence
• Hadoop
• Cassandra
• OrentDB
• Titan
• Mongo
7.Reporting
• BIRT Reporting
• Eclipse RCP
8. Analytics
9. Market Vertices
10. Q&A
Introduction
Nothing is new.
There are devices, there is network and there is data.
Challenge is Lot Of Devices, Network Everywhere, Lot Of Data
IOTTriad
Enablement
HW-Clinet
Container
Modeling
Dashboard
Ethernet
GSM/3G/4G/MB-IOT
BLE/LORA /WIFI
AVR/PIC/Psoc (MCU)
SOC(MCP)
Boards (Pis)
MQTT
CoAP
HTTP
KAFKA
Hadoop
Cassandra
Ignite
Kafka
Spark/Flink/Drill
NIFI/Streamsets/Camel
An IOT deployment architecture demands right device design, right
communications and data management & analytics.
IOT Devices
Microprocessor Based Devices
Microcontroller Based Devices
Raspberry Pi, Orange Pi, Banana Pi, Nano Pi,
Bagel Bone, Panda board, Onion, Chip etc.
• SOCs from Boradcom, Rock chip, All winner, Intel etc
• Runs full Linux/Windows
• Powerful
• Power-hungry
Arduino, Wiring, Sypris etc
• Micro-chip, Atmel, Nordic etc
• SOC with memory and other peripherals
• Low power
• Less power consumption
IOT Communications
Long Range
Short Range
Networks to span full metros to countries
• Traditional operator provided 2G/3G/4G
• LORA
• SIGFOX
With in 100 meter range
• WIFI
• BLE
IOT DataTypes
Binary Data
JSON
Binary data provides size advantage but adds more
processing.
• MQTT
• Protobuffs
JSON or any markup payloads offer human readability
and existing processing infrastructure.
IOT Data Acquisition
MQTT
CoAP
Kafka
• Lot of queues (millions)
• Light Weight
• Open source brokers
• Well Integrated
• Well supported
• HTTP like
• Matured with telco industry
• Human readable
• Light server
• Not very heavy client
• Client controlled
• Fast
• Easy to scale
• Easy to replicate
IOT Data Processing
Spark Ignite
Nifi
StreamSets
Beam
IOT Data Persistence
Hadoop Cassandra
Oriented DB
IOT Market
IOT Market
Q&A
Ad

More Related Content

What's hot (19)

Logicalis IoT & Smart Cities (Use Case)
Logicalis IoT & Smart Cities (Use Case)Logicalis IoT & Smart Cities (Use Case)
Logicalis IoT & Smart Cities (Use Case)
Cloudera, Inc.
 
Internet of Things (IoT) is a King, Big data is a Queen and Cloud is a Palace
Internet of Things (IoT) is a King, Big data is a Queen and Cloud is a PalaceInternet of Things (IoT) is a King, Big data is a Queen and Cloud is a Palace
Internet of Things (IoT) is a King, Big data is a Queen and Cloud is a Palace
Dr.-Ing Abdur Rahim Biswas
 
Introduction to Microsoft Azure IoT
Introduction to Microsoft Azure IoTIntroduction to Microsoft Azure IoT
Introduction to Microsoft Azure IoT
Altoros
 
Watson IoT Platform Sizing & Pricing - Sept 2016
Watson IoT Platform Sizing & Pricing - Sept 2016Watson IoT Platform Sizing & Pricing - Sept 2016
Watson IoT Platform Sizing & Pricing - Sept 2016
Jason Lu
 
Intro to Big Data and Apache Hadoop by Dr. Amr Awadallah at CLOUD WEEKEND '13...
Intro to Big Data and Apache Hadoop by Dr. Amr Awadallah at CLOUD WEEKEND '13...Intro to Big Data and Apache Hadoop by Dr. Amr Awadallah at CLOUD WEEKEND '13...
Intro to Big Data and Apache Hadoop by Dr. Amr Awadallah at CLOUD WEEKEND '13...
TheInevitableCloud
 
Architect Your IoT Platform for Success
Architect Your IoT Platform for SuccessArchitect Your IoT Platform for Success
Architect Your IoT Platform for Success
Solace
 
IoT and Big Data - Iot Asia 2014
IoT and Big Data - Iot Asia 2014IoT and Big Data - Iot Asia 2014
IoT and Big Data - Iot Asia 2014
John Berns
 
AI as a Catalyst for IoT
AI as a Catalyst for IoTAI as a Catalyst for IoT
AI as a Catalyst for IoT
marina romanovich
 
Internet of Things (IoT) and Big Data
Internet of Things (IoT) and Big DataInternet of Things (IoT) and Big Data
Internet of Things (IoT) and Big Data
Guido Schmutz
 
CL2015 - Datacenter and Cloud Strategy and Planning
CL2015 - Datacenter and Cloud Strategy and PlanningCL2015 - Datacenter and Cloud Strategy and Planning
CL2015 - Datacenter and Cloud Strategy and Planning
Cisco
 
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Mark Goldstein
 
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big DataPowering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
DataWorks Summit
 
AIoT and edge computing solutions
AIoT and edge computing solutionsAIoT and edge computing solutions
AIoT and edge computing solutions
湯米吳 Tommy Wu
 
Xanadu for Big Data + Deep Learning + Cloud + IoT Integration Strategy
Xanadu for Big Data + Deep Learning + Cloud + IoT Integration StrategyXanadu for Big Data + Deep Learning + Cloud + IoT Integration Strategy
Xanadu for Big Data + Deep Learning + Cloud + IoT Integration Strategy
Alex G. Lee, Ph.D. Esq. CLP
 
Cloud Computing, SDN, Big Data and Internet of Everything - Lew Tucker
Cloud Computing, SDN, Big Data and Internet of Everything - Lew TuckerCloud Computing, SDN, Big Data and Internet of Everything - Lew Tucker
Cloud Computing, SDN, Big Data and Internet of Everything - Lew Tucker
Lew Tucker
 
Internet of Things and Big Data
Internet of Things and Big DataInternet of Things and Big Data
Internet of Things and Big Data
Swiss Data Forum Swiss Data Forum
 
Operational information processing: lightning-fast, delightfully simple
Operational information processing: lightning-fast, delightfully simpleOperational information processing: lightning-fast, delightfully simple
Operational information processing: lightning-fast, delightfully simple
Xylos
 
IoT – The reality of real world solutions
IoT – The reality of real world solutions IoT – The reality of real world solutions
IoT – The reality of real world solutions
Swiss Data Forum Swiss Data Forum
 
Cloudera - IoT & Smart Cities
Cloudera - IoT & Smart CitiesCloudera - IoT & Smart Cities
Cloudera - IoT & Smart Cities
Cloudera, Inc.
 
Logicalis IoT & Smart Cities (Use Case)
Logicalis IoT & Smart Cities (Use Case)Logicalis IoT & Smart Cities (Use Case)
Logicalis IoT & Smart Cities (Use Case)
Cloudera, Inc.
 
Internet of Things (IoT) is a King, Big data is a Queen and Cloud is a Palace
Internet of Things (IoT) is a King, Big data is a Queen and Cloud is a PalaceInternet of Things (IoT) is a King, Big data is a Queen and Cloud is a Palace
Internet of Things (IoT) is a King, Big data is a Queen and Cloud is a Palace
Dr.-Ing Abdur Rahim Biswas
 
Introduction to Microsoft Azure IoT
Introduction to Microsoft Azure IoTIntroduction to Microsoft Azure IoT
Introduction to Microsoft Azure IoT
Altoros
 
Watson IoT Platform Sizing & Pricing - Sept 2016
Watson IoT Platform Sizing & Pricing - Sept 2016Watson IoT Platform Sizing & Pricing - Sept 2016
Watson IoT Platform Sizing & Pricing - Sept 2016
Jason Lu
 
Intro to Big Data and Apache Hadoop by Dr. Amr Awadallah at CLOUD WEEKEND '13...
Intro to Big Data and Apache Hadoop by Dr. Amr Awadallah at CLOUD WEEKEND '13...Intro to Big Data and Apache Hadoop by Dr. Amr Awadallah at CLOUD WEEKEND '13...
Intro to Big Data and Apache Hadoop by Dr. Amr Awadallah at CLOUD WEEKEND '13...
TheInevitableCloud
 
Architect Your IoT Platform for Success
Architect Your IoT Platform for SuccessArchitect Your IoT Platform for Success
Architect Your IoT Platform for Success
Solace
 
IoT and Big Data - Iot Asia 2014
IoT and Big Data - Iot Asia 2014IoT and Big Data - Iot Asia 2014
IoT and Big Data - Iot Asia 2014
John Berns
 
Internet of Things (IoT) and Big Data
Internet of Things (IoT) and Big DataInternet of Things (IoT) and Big Data
Internet of Things (IoT) and Big Data
Guido Schmutz
 
CL2015 - Datacenter and Cloud Strategy and Planning
CL2015 - Datacenter and Cloud Strategy and PlanningCL2015 - Datacenter and Cloud Strategy and Planning
CL2015 - Datacenter and Cloud Strategy and Planning
Cisco
 
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Mark Goldstein
 
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big DataPowering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
DataWorks Summit
 
AIoT and edge computing solutions
AIoT and edge computing solutionsAIoT and edge computing solutions
AIoT and edge computing solutions
湯米吳 Tommy Wu
 
Xanadu for Big Data + Deep Learning + Cloud + IoT Integration Strategy
Xanadu for Big Data + Deep Learning + Cloud + IoT Integration StrategyXanadu for Big Data + Deep Learning + Cloud + IoT Integration Strategy
Xanadu for Big Data + Deep Learning + Cloud + IoT Integration Strategy
Alex G. Lee, Ph.D. Esq. CLP
 
Cloud Computing, SDN, Big Data and Internet of Everything - Lew Tucker
Cloud Computing, SDN, Big Data and Internet of Everything - Lew TuckerCloud Computing, SDN, Big Data and Internet of Everything - Lew Tucker
Cloud Computing, SDN, Big Data and Internet of Everything - Lew Tucker
Lew Tucker
 
Operational information processing: lightning-fast, delightfully simple
Operational information processing: lightning-fast, delightfully simpleOperational information processing: lightning-fast, delightfully simple
Operational information processing: lightning-fast, delightfully simple
Xylos
 
Cloudera - IoT & Smart Cities
Cloudera - IoT & Smart CitiesCloudera - IoT & Smart Cities
Cloudera - IoT & Smart Cities
Cloudera, Inc.
 

Viewers also liked (7)

Hadoop Self-Service Data Prep Fuels Analytics
Hadoop Self-Service Data Prep Fuels AnalyticsHadoop Self-Service Data Prep Fuels Analytics
Hadoop Self-Service Data Prep Fuels Analytics
Senturus
 
Introduction to Kafka
Introduction to KafkaIntroduction to Kafka
Introduction to Kafka
Akash Vacher
 
Change Data Capture using Kafka
Change Data Capture using KafkaChange Data Capture using Kafka
Change Data Capture using Kafka
Akash Vacher
 
Python in telecommunications (in 7 minutes)
Python in telecommunications (in 7 minutes)Python in telecommunications (in 7 minutes)
Python in telecommunications (in 7 minutes)
iMasters
 
Ericsson commond list, BSS+NSS=OSS
Ericsson commond list, BSS+NSS=OSSEricsson commond list, BSS+NSS=OSS
Ericsson commond list, BSS+NSS=OSS
Md Shameem
 
The Business Advantage of Hadoop: Lessons from the Field – Cloudera Summer We...
The Business Advantage of Hadoop: Lessons from the Field – Cloudera Summer We...The Business Advantage of Hadoop: Lessons from the Field – Cloudera Summer We...
The Business Advantage of Hadoop: Lessons from the Field – Cloudera Summer We...
Cloudera, Inc.
 
Distributed Computing with Apache Hadoop: Technology Overview
Distributed Computing with Apache Hadoop: Technology OverviewDistributed Computing with Apache Hadoop: Technology Overview
Distributed Computing with Apache Hadoop: Technology Overview
Konstantin V. Shvachko
 
Hadoop Self-Service Data Prep Fuels Analytics
Hadoop Self-Service Data Prep Fuels AnalyticsHadoop Self-Service Data Prep Fuels Analytics
Hadoop Self-Service Data Prep Fuels Analytics
Senturus
 
Introduction to Kafka
Introduction to KafkaIntroduction to Kafka
Introduction to Kafka
Akash Vacher
 
Change Data Capture using Kafka
Change Data Capture using KafkaChange Data Capture using Kafka
Change Data Capture using Kafka
Akash Vacher
 
Python in telecommunications (in 7 minutes)
Python in telecommunications (in 7 minutes)Python in telecommunications (in 7 minutes)
Python in telecommunications (in 7 minutes)
iMasters
 
Ericsson commond list, BSS+NSS=OSS
Ericsson commond list, BSS+NSS=OSSEricsson commond list, BSS+NSS=OSS
Ericsson commond list, BSS+NSS=OSS
Md Shameem
 
The Business Advantage of Hadoop: Lessons from the Field – Cloudera Summer We...
The Business Advantage of Hadoop: Lessons from the Field – Cloudera Summer We...The Business Advantage of Hadoop: Lessons from the Field – Cloudera Summer We...
The Business Advantage of Hadoop: Lessons from the Field – Cloudera Summer We...
Cloudera, Inc.
 
Distributed Computing with Apache Hadoop: Technology Overview
Distributed Computing with Apache Hadoop: Technology OverviewDistributed Computing with Apache Hadoop: Technology Overview
Distributed Computing with Apache Hadoop: Technology Overview
Konstantin V. Shvachko
 
Ad

Similar to IoT Data as Service with Hadoop (20)

Nodemcu and IOT.pptx
Nodemcu and IOT.pptxNodemcu and IOT.pptx
Nodemcu and IOT.pptx
DixonSunny2
 
the connection of iot with lora pan which enable
the connection of iot with lora pan which enablethe connection of iot with lora pan which enable
the connection of iot with lora pan which enable
neelamsanjeevkumar
 
IoT and Its Application
IoT and Its ApplicationIoT and Its Application
IoT and Its Application
Dun Automation Academy
 
GDG Meetup Jakarta - Low Power IoT
GDG Meetup Jakarta - Low Power IoTGDG Meetup Jakarta - Low Power IoT
GDG Meetup Jakarta - Low Power IoT
Alwin Arrasyid
 
Internet Of Things is Fully Networked and Connected Devices sending analytics...
Internet Of Things is Fully Networked and Connected Devices sending analytics...Internet Of Things is Fully Networked and Connected Devices sending analytics...
Internet Of Things is Fully Networked and Connected Devices sending analytics...
moaminmarey2001
 
Unit 4 Internet of Things communication models.pdf
Unit 4 Internet of Things  communication models.pdfUnit 4 Internet of Things  communication models.pdf
Unit 4 Internet of Things communication models.pdf
sayalee7
 
Introduction to IoT Technologies - The need to know basics
Introduction to IoT Technologies - The need to know basicsIntroduction to IoT Technologies - The need to know basics
Introduction to IoT Technologies - The need to know basics
Jaco Bester
 
Unit 4 Introduction to internet of Things.pptx
Unit 4 Introduction to internet of Things.pptxUnit 4 Introduction to internet of Things.pptx
Unit 4 Introduction to internet of Things.pptx
sayalee7
 
Internet of Things Architecture / Topology
Internet of Things Architecture / TopologyInternet of Things Architecture / Topology
Internet of Things Architecture / Topology
NEEVEE Technologies
 
Global Azure boot camp 2015 - Microsoft IoT Solutions with Azure
Global Azure boot camp 2015 - Microsoft IoT Solutions with AzureGlobal Azure boot camp 2015 - Microsoft IoT Solutions with Azure
Global Azure boot camp 2015 - Microsoft IoT Solutions with Azure
Vinoth Rajagopalan
 
Internet of things
Internet of thingsInternet of things
Internet of things
Selvaraj Kesavan
 
Atal io t introduction
Atal io t introductionAtal io t introduction
Atal io t introduction
Yadvendra bedi
 
IoT RF Protocols
IoT RF ProtocolsIoT RF Protocols
IoT RF Protocols
APNIC
 
ch5-Fog Networks and Cloud Computing
ch5-Fog Networks and Cloud Computingch5-Fog Networks and Cloud Computing
ch5-Fog Networks and Cloud Computing
ssuser06ea42
 
Null mumbai-iot-workshop
Null mumbai-iot-workshopNull mumbai-iot-workshop
Null mumbai-iot-workshop
Nitesh Malviya
 
IoT Control Units and Communication Models
IoT Control Units and Communication ModelsIoT Control Units and Communication Models
IoT Control Units and Communication Models
National Institute of Technology Karnataka, Surathkal
 
An infrastructual secure wireless sensing and actuating solution
An infrastructual secure wireless sensing and actuating solutionAn infrastructual secure wireless sensing and actuating solution
An infrastructual secure wireless sensing and actuating solution
usman sarwar
 
INTERNET OF THINGS.pptx
INTERNET OF THINGS.pptxINTERNET OF THINGS.pptx
INTERNET OF THINGS.pptx
Manikandan Kandasamy
 
Building the Internet of Things with Thingsquare and Contiki - day 1, part 1
Building the Internet of Things with Thingsquare and Contiki - day 1, part 1Building the Internet of Things with Thingsquare and Contiki - day 1, part 1
Building the Internet of Things with Thingsquare and Contiki - day 1, part 1
Adam Dunkels
 
Building a Citizen IoT Network on Microsoft Azure
Building a Citizen IoT Network on Microsoft AzureBuilding a Citizen IoT Network on Microsoft Azure
Building a Citizen IoT Network on Microsoft Azure
Richard Conway
 
Nodemcu and IOT.pptx
Nodemcu and IOT.pptxNodemcu and IOT.pptx
Nodemcu and IOT.pptx
DixonSunny2
 
the connection of iot with lora pan which enable
the connection of iot with lora pan which enablethe connection of iot with lora pan which enable
the connection of iot with lora pan which enable
neelamsanjeevkumar
 
GDG Meetup Jakarta - Low Power IoT
GDG Meetup Jakarta - Low Power IoTGDG Meetup Jakarta - Low Power IoT
GDG Meetup Jakarta - Low Power IoT
Alwin Arrasyid
 
Internet Of Things is Fully Networked and Connected Devices sending analytics...
Internet Of Things is Fully Networked and Connected Devices sending analytics...Internet Of Things is Fully Networked and Connected Devices sending analytics...
Internet Of Things is Fully Networked and Connected Devices sending analytics...
moaminmarey2001
 
Unit 4 Internet of Things communication models.pdf
Unit 4 Internet of Things  communication models.pdfUnit 4 Internet of Things  communication models.pdf
Unit 4 Internet of Things communication models.pdf
sayalee7
 
Introduction to IoT Technologies - The need to know basics
Introduction to IoT Technologies - The need to know basicsIntroduction to IoT Technologies - The need to know basics
Introduction to IoT Technologies - The need to know basics
Jaco Bester
 
Unit 4 Introduction to internet of Things.pptx
Unit 4 Introduction to internet of Things.pptxUnit 4 Introduction to internet of Things.pptx
Unit 4 Introduction to internet of Things.pptx
sayalee7
 
Internet of Things Architecture / Topology
Internet of Things Architecture / TopologyInternet of Things Architecture / Topology
Internet of Things Architecture / Topology
NEEVEE Technologies
 
Global Azure boot camp 2015 - Microsoft IoT Solutions with Azure
Global Azure boot camp 2015 - Microsoft IoT Solutions with AzureGlobal Azure boot camp 2015 - Microsoft IoT Solutions with Azure
Global Azure boot camp 2015 - Microsoft IoT Solutions with Azure
Vinoth Rajagopalan
 
Atal io t introduction
Atal io t introductionAtal io t introduction
Atal io t introduction
Yadvendra bedi
 
IoT RF Protocols
IoT RF ProtocolsIoT RF Protocols
IoT RF Protocols
APNIC
 
ch5-Fog Networks and Cloud Computing
ch5-Fog Networks and Cloud Computingch5-Fog Networks and Cloud Computing
ch5-Fog Networks and Cloud Computing
ssuser06ea42
 
Null mumbai-iot-workshop
Null mumbai-iot-workshopNull mumbai-iot-workshop
Null mumbai-iot-workshop
Nitesh Malviya
 
An infrastructual secure wireless sensing and actuating solution
An infrastructual secure wireless sensing and actuating solutionAn infrastructual secure wireless sensing and actuating solution
An infrastructual secure wireless sensing and actuating solution
usman sarwar
 
Building the Internet of Things with Thingsquare and Contiki - day 1, part 1
Building the Internet of Things with Thingsquare and Contiki - day 1, part 1Building the Internet of Things with Thingsquare and Contiki - day 1, part 1
Building the Internet of Things with Thingsquare and Contiki - day 1, part 1
Adam Dunkels
 
Building a Citizen IoT Network on Microsoft Azure
Building a Citizen IoT Network on Microsoft AzureBuilding a Citizen IoT Network on Microsoft Azure
Building a Citizen IoT Network on Microsoft Azure
Richard Conway
 
Ad

More from Quantified Self Dublin (20)

Quantified Wellness and Assisted Living
Quantified Wellness and Assisted LivingQuantified Wellness and Assisted Living
Quantified Wellness and Assisted Living
Quantified Self Dublin
 
Quantified Brain Health
Quantified Brain HealthQuantified Brain Health
Quantified Brain Health
Quantified Self Dublin
 
Nutrigenomics, Biomarkers & Health
Nutrigenomics, Biomarkers & HealthNutrigenomics, Biomarkers & Health
Nutrigenomics, Biomarkers & Health
Quantified Self Dublin
 
Gut hormones - Appetite, Mood and Health
Gut hormones - Appetite, Mood and HealthGut hormones - Appetite, Mood and Health
Gut hormones - Appetite, Mood and Health
Quantified Self Dublin
 
Self Quantifying Health
Self Quantifying HealthSelf Quantifying Health
Self Quantifying Health
Quantified Self Dublin
 
Biohacking Sleep
Biohacking SleepBiohacking Sleep
Biohacking Sleep
Quantified Self Dublin
 
Data Mining Sleep Data
Data Mining Sleep DataData Mining Sleep Data
Data Mining Sleep Data
Quantified Self Dublin
 
Quantified Sleep - Science behind the sleep trackers
Quantified Sleep - Science behind the sleep trackersQuantified Sleep - Science behind the sleep trackers
Quantified Sleep - Science behind the sleep trackers
Quantified Self Dublin
 
Future Trends in Wearables & Big Data
Future Trends in Wearables & Big DataFuture Trends in Wearables & Big Data
Future Trends in Wearables & Big Data
Quantified Self Dublin
 
Quantifying and Treating Stress
Quantifying and Treating StressQuantifying and Treating Stress
Quantifying and Treating Stress
Quantified Self Dublin
 
Evolution of Wearables - Past, Present, Future
Evolution of Wearables - Past, Present, FutureEvolution of Wearables - Past, Present, Future
Evolution of Wearables - Past, Present, Future
Quantified Self Dublin
 
The Future of Quantified Self in Healthcare
The Future of Quantified Self in HealthcareThe Future of Quantified Self in Healthcare
The Future of Quantified Self in Healthcare
Quantified Self Dublin
 
Quantified Self & Personal Healthcare
Quantified Self & Personal HealthcareQuantified Self & Personal Healthcare
Quantified Self & Personal Healthcare
Quantified Self Dublin
 
Kenkodo Quantified Self Dublin June 2016
Kenkodo Quantified Self Dublin June 2016Kenkodo Quantified Self Dublin June 2016
Kenkodo Quantified Self Dublin June 2016
Quantified Self Dublin
 
Food and Activity Detection in Life Logging Images
Food and Activity Detection in Life Logging ImagesFood and Activity Detection in Life Logging Images
Food and Activity Detection in Life Logging Images
Quantified Self Dublin
 
Food and Activity Detection in Life Logging Images
Food and Activity Detection in Life Logging ImagesFood and Activity Detection in Life Logging Images
Food and Activity Detection in Life Logging Images
Quantified Self Dublin
 
Improving Mental Focus
Improving Mental Focus Improving Mental Focus
Improving Mental Focus
Quantified Self Dublin
 
Introduction to HRV
Introduction to HRVIntroduction to HRV
Introduction to HRV
Quantified Self Dublin
 
Introduction to Google Fit
Introduction to Google FitIntroduction to Google Fit
Introduction to Google Fit
Quantified Self Dublin
 
How Lightbulbs Made Alarm Clocks
How Lightbulbs Made Alarm ClocksHow Lightbulbs Made Alarm Clocks
How Lightbulbs Made Alarm Clocks
Quantified Self Dublin
 
Quantified Wellness and Assisted Living
Quantified Wellness and Assisted LivingQuantified Wellness and Assisted Living
Quantified Wellness and Assisted Living
Quantified Self Dublin
 
Gut hormones - Appetite, Mood and Health
Gut hormones - Appetite, Mood and HealthGut hormones - Appetite, Mood and Health
Gut hormones - Appetite, Mood and Health
Quantified Self Dublin
 
Quantified Sleep - Science behind the sleep trackers
Quantified Sleep - Science behind the sleep trackersQuantified Sleep - Science behind the sleep trackers
Quantified Sleep - Science behind the sleep trackers
Quantified Self Dublin
 
Evolution of Wearables - Past, Present, Future
Evolution of Wearables - Past, Present, FutureEvolution of Wearables - Past, Present, Future
Evolution of Wearables - Past, Present, Future
Quantified Self Dublin
 
The Future of Quantified Self in Healthcare
The Future of Quantified Self in HealthcareThe Future of Quantified Self in Healthcare
The Future of Quantified Self in Healthcare
Quantified Self Dublin
 
Kenkodo Quantified Self Dublin June 2016
Kenkodo Quantified Self Dublin June 2016Kenkodo Quantified Self Dublin June 2016
Kenkodo Quantified Self Dublin June 2016
Quantified Self Dublin
 
Food and Activity Detection in Life Logging Images
Food and Activity Detection in Life Logging ImagesFood and Activity Detection in Life Logging Images
Food and Activity Detection in Life Logging Images
Quantified Self Dublin
 
Food and Activity Detection in Life Logging Images
Food and Activity Detection in Life Logging ImagesFood and Activity Detection in Life Logging Images
Food and Activity Detection in Life Logging Images
Quantified Self Dublin
 

Recently uploaded (20)

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxIncreasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Anoop Ashok
 
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-UmgebungenHCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
panagenda
 
tecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdftecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdf
fjgm517
 
Linux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdfLinux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdf
RHCSA Guru
 
Social Media App Development Company-EmizenTech
Social Media App Development Company-EmizenTechSocial Media App Development Company-EmizenTech
Social Media App Development Company-EmizenTech
Steve Jonas
 
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPathCommunity
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Semantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AISemantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AI
artmondano
 
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath MaestroDev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
UiPathCommunity
 
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsTechnology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data Analytics
InData Labs
 
Big Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur MorganBig Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur Morgan
Arthur Morgan
 
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
organizerofv
 
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In FranceManifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
chb3
 
Top 10 IT Help Desk Outsourcing Services
Top 10 IT Help Desk Outsourcing ServicesTop 10 IT Help Desk Outsourcing Services
Top 10 IT Help Desk Outsourcing Services
Infrassist Technologies Pvt. Ltd.
 
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptxSpecial Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
shyamraj55
 
Quantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur MorganQuantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur Morgan
Arthur Morgan
 
Cybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure ADCybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure AD
VICTOR MAESTRE RAMIREZ
 
Heap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and DeletionHeap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and Deletion
Jaydeep Kale
 
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
BookNet Canada
 
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
BookNet Canada
 
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxIncreasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Anoop Ashok
 
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-UmgebungenHCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
panagenda
 
tecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdftecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdf
fjgm517
 
Linux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdfLinux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdf
RHCSA Guru
 
Social Media App Development Company-EmizenTech
Social Media App Development Company-EmizenTechSocial Media App Development Company-EmizenTech
Social Media App Development Company-EmizenTech
Steve Jonas
 
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPathCommunity
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Semantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AISemantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AI
artmondano
 
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath MaestroDev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
UiPathCommunity
 
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsTechnology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data Analytics
InData Labs
 
Big Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur MorganBig Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur Morgan
Arthur Morgan
 
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
organizerofv
 
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In FranceManifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
chb3
 
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptxSpecial Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
shyamraj55
 
Quantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur MorganQuantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur Morgan
Arthur Morgan
 
Cybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure ADCybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure AD
VICTOR MAESTRE RAMIREZ
 
Heap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and DeletionHeap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and Deletion
Jaydeep Kale
 
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
BookNet Canada
 
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
BookNet Canada
 

IoT Data as Service with Hadoop

  • 1. Internet OfThings & Big Data As Service
  • 2. About me Sriram Reddy Architect www.Ammeon.com Software Architect with a passion for • Linked Devices • Device Multi Tenancy • Low Power Wide Area Networks • Distributed Device Management • Low Power Device Security • Distributed Data Persistence • Distributed Data Processing • Analytics
  • 3. Index 1. Introduction 2. Internet Of Things • Micro Controller & Processor • Power Management 3. IOT Networks • Long Range • Short Range 4. IOT Data Types • Binary (MQTT & Proto buff) • Jason 5. IOT Data Acquisition • MQTT • CoAP • Kafka 5. IOT Data processing • Spark • Nifi • StreamSets 6. Data Persistence • Hadoop • Cassandra • OrentDB • Titan • Mongo 7.Reporting • BIRT Reporting • Eclipse RCP 8. Analytics 9. Market Vertices 10. Q&A
  • 4. Introduction Nothing is new. There are devices, there is network and there is data. Challenge is Lot Of Devices, Network Everywhere, Lot Of Data
  • 5. IOTTriad Enablement HW-Clinet Container Modeling Dashboard Ethernet GSM/3G/4G/MB-IOT BLE/LORA /WIFI AVR/PIC/Psoc (MCU) SOC(MCP) Boards (Pis) MQTT CoAP HTTP KAFKA Hadoop Cassandra Ignite Kafka Spark/Flink/Drill NIFI/Streamsets/Camel An IOT deployment architecture demands right device design, right communications and data management & analytics.
  • 6. IOT Devices Microprocessor Based Devices Microcontroller Based Devices Raspberry Pi, Orange Pi, Banana Pi, Nano Pi, Bagel Bone, Panda board, Onion, Chip etc. • SOCs from Boradcom, Rock chip, All winner, Intel etc • Runs full Linux/Windows • Powerful • Power-hungry Arduino, Wiring, Sypris etc • Micro-chip, Atmel, Nordic etc • SOC with memory and other peripherals • Low power • Less power consumption
  • 7. IOT Communications Long Range Short Range Networks to span full metros to countries • Traditional operator provided 2G/3G/4G • LORA • SIGFOX With in 100 meter range • WIFI • BLE
  • 8. IOT DataTypes Binary Data JSON Binary data provides size advantage but adds more processing. • MQTT • Protobuffs JSON or any markup payloads offer human readability and existing processing infrastructure.
  • 9. IOT Data Acquisition MQTT CoAP Kafka • Lot of queues (millions) • Light Weight • Open source brokers • Well Integrated • Well supported • HTTP like • Matured with telco industry • Human readable • Light server • Not very heavy client • Client controlled • Fast • Easy to scale • Easy to replicate
  • 10. IOT Data Processing Spark Ignite Nifi StreamSets Beam
  • 11. IOT Data Persistence Hadoop Cassandra Oriented DB
  • 14. Q&A