SlideShare a Scribd company logo
Hadoop Conference Japan
       2011 Fall




               2011/09/26
              @ryu_kobayashi
•
•
    •                         ...

•                               ...

•       MapReduce    ......
               100
Hadoop Conference Japan 2011 Fall
Web
Web
Web

•
Web

•
•   Web
Web

•
•   Web


•
Hadoop Conference Japan 2011 Fall
•
•
•
Log
Log

      A
Log

      A
Log

      A




      B
Hadoop Conference Japan 2011 Fall
Google
Google
Google




38%
Google




38%            32%
Google




38%            32%   17%
Google




38%            32%   17%
API

           API

Hadoop

         ××TB
API




REST API
API




REST API
API




REST API



           XML
Hadoop Conference Japan 2011 Fall
Hadoop Conference Japan 2011 Fall
AWS EMR



Elastic MapReduce
AWS EMR



Elastic MapReduce


      OR
AWS EMR



 Elastic MapReduce


       OR


Hadoop MR Job
AWS EMR



 Elastic MapReduce


       OR


Hadoop MR Job
AWS EMR



 Elastic MapReduce


       OR


Hadoop MR Job
API




REST API
API




REST API
API




REST API
Hadoop Conference Japan 2011 Fall
MapReduce
Java MapReduce
MapReduce
       Java MapReduce
Hive Pig
MapReduce
       Java MapReduce
Hive Pig
MapReduce
       Java MapReduce
Hive Pig


  MR
MapReduce
       Java MapReduce
Hive Pig


  MR
MapReduce
       Java MapReduce
Hive Pig


  MR
Hadoop Conference Japan 2011 Fall
Hive, Pig Asakusa
        FW
Hive, Pig Asakusa
        FW
Hive, Pig Asakusa
        FW



       OSS
Hive, Pig Asakusa
        FW



       OSS
 MapReduce2


              MR2
Hadoop Conference Japan 2011 Fall
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•   etc...
•
•
•
•
•
•
•   etc...
•
•
•
•
•
•
•   etc...


•        Job
•
•
•
•
•
•
•   etc...


•        Job
•        Job   Kill
•
•
•
•
•
•
•   etc...


•        Job
•        Job   Kill
•   etc...
SaaS
I will die
Hadoop
Hadoop Conference Japan 2011 Fall

More Related Content

PDF
Akka PersistenceのJournalのライフサイクル管理
PDF
Fast, Scalable Graph Processing: Apache Giraph on YARN
PDF
AWS Black Belt Techシリーズ Amazon EMR
PDF
Hw09 Making Hadoop Easy On Amazon Web Services
PDF
Hadoop Conference Japan 2011 Fallに行ってきました
PDF
Hadoop入門とクラウド利用
PPT
Brust hadoopecosystem
PDF
Hadoop on Azure, Blue elephants
Akka PersistenceのJournalのライフサイクル管理
Fast, Scalable Graph Processing: Apache Giraph on YARN
AWS Black Belt Techシリーズ Amazon EMR
Hw09 Making Hadoop Easy On Amazon Web Services
Hadoop Conference Japan 2011 Fallに行ってきました
Hadoop入門とクラウド利用
Brust hadoopecosystem
Hadoop on Azure, Blue elephants

Similar to Hadoop Conference Japan 2011 Fall (20)

PPTX
The Evolution of the Hadoop Ecosystem
PDF
Realtime Analytics with Hadoop and HBase
PPTX
Big data, just an introduction to Hadoop and Scripting Languages
PPTX
Big data ppt
PDF
Big Data Analytics with Amazon Web Services
PDF
Apachecon Euro 2012: Elastic, Multi-tenant Hadoop on Demand
PDF
Chicago Data Summit: Keynote - Data Processing with Hadoop: Scalable and Cost...
PDF
Hadoop Overview kdd2011
PPTX
Introduction to Apache Hadoop
PDF
Architecting the Future of Big Data & Search - Eric Baldeschwieler
PDF
Hadoop Overview & Architecture
 
PPTX
Apache Spark - San Diego Big Data Meetup Jan 14th 2015
PPTX
Big Data Cloud Meetup - Jan 24 2013 - Zettaset
PDF
Hadoop, Taming Elephants
PPT
Hadoop ecosystem framework n hadoop in live environment
PPTX
Hadoop Ecosystem | Hadoop Ecosystem Tutorial | Hadoop Tutorial For Beginners ...
KEY
961万人の食卓を支えるデータ解析
PPTX
Big Data in the Microsoft Platform
KEY
Hadoop本 輪読会 1章〜2章
KEY
The Evolution of the Hadoop Ecosystem
Realtime Analytics with Hadoop and HBase
Big data, just an introduction to Hadoop and Scripting Languages
Big data ppt
Big Data Analytics with Amazon Web Services
Apachecon Euro 2012: Elastic, Multi-tenant Hadoop on Demand
Chicago Data Summit: Keynote - Data Processing with Hadoop: Scalable and Cost...
Hadoop Overview kdd2011
Introduction to Apache Hadoop
Architecting the Future of Big Data & Search - Eric Baldeschwieler
Hadoop Overview & Architecture
 
Apache Spark - San Diego Big Data Meetup Jan 14th 2015
Big Data Cloud Meetup - Jan 24 2013 - Zettaset
Hadoop, Taming Elephants
Hadoop ecosystem framework n hadoop in live environment
Hadoop Ecosystem | Hadoop Ecosystem Tutorial | Hadoop Tutorial For Beginners ...
961万人の食卓を支えるデータ解析
Big Data in the Microsoft Platform
Hadoop本 輪読会 1章〜2章
Ad

More from Ryu Kobayashi (7)

PDF
PLAZMA TD Tech Talk 2018 at Shibuya: Hive2 as a new td hadoop core engine
PDF
Treasure Data on The YARN - Hadoop Conference Japan 2014
PDF
Huahin Framework for Hadoop, Hadoop Conference Japan 2013 Winter
KEY
Developers summit cassandraで見るNoSQL
KEY
Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra
KEY
AWSを使ったトラッキングログ収集
KEY
Hadoopソースコードリーディング MapReduce障害時のフロー
PLAZMA TD Tech Talk 2018 at Shibuya: Hive2 as a new td hadoop core engine
Treasure Data on The YARN - Hadoop Conference Japan 2014
Huahin Framework for Hadoop, Hadoop Conference Japan 2013 Winter
Developers summit cassandraで見るNoSQL
Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra
AWSを使ったトラッキングログ収集
Hadoopソースコードリーディング MapReduce障害時のフロー
Ad

Recently uploaded (20)

PDF
madgavkar20181017ppt McKinsey Presentation.pdf
PDF
Cloud-Migration-Best-Practices-A-Practical-Guide-to-AWS-Azure-and-Google-Clou...
PDF
BLW VOCATIONAL TRAINING SUMMER INTERNSHIP REPORT
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PPTX
CroxyProxy Instagram Access id login.pptx
PDF
Automating ArcGIS Content Discovery with FME: A Real World Use Case
PPTX
Comunidade Salesforce São Paulo - Desmistificando o Omnistudio (Vlocity)
PPTX
Telecom Fraud Prevention Guide | Hyperlink InfoSystem
PPTX
Web Security: Login Bypass, SQLi, CSRF & XSS.pptx
PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
PDF
creating-agentic-ai-solutions-leveraging-aws.pdf
PDF
AI And Its Effect On The Evolving IT Sector In Australia - Elevate
PDF
REPORT: Heating appliances market in Poland 2024
PPTX
Belt and Road Supply Chain Finance Blockchain Solution
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
DevOps & Developer Experience Summer BBQ
PDF
Building High-Performance Oracle Teams: Strategic Staffing for Database Manag...
PPTX
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
PDF
How AI Agents Improve Data Accuracy and Consistency in Due Diligence.pdf
PDF
ai-archetype-understanding-the-personality-of-agentic-ai.pdf
madgavkar20181017ppt McKinsey Presentation.pdf
Cloud-Migration-Best-Practices-A-Practical-Guide-to-AWS-Azure-and-Google-Clou...
BLW VOCATIONAL TRAINING SUMMER INTERNSHIP REPORT
NewMind AI Weekly Chronicles - August'25 Week I
CroxyProxy Instagram Access id login.pptx
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Comunidade Salesforce São Paulo - Desmistificando o Omnistudio (Vlocity)
Telecom Fraud Prevention Guide | Hyperlink InfoSystem
Web Security: Login Bypass, SQLi, CSRF & XSS.pptx
CIFDAQ's Market Insight: SEC Turns Pro Crypto
creating-agentic-ai-solutions-leveraging-aws.pdf
AI And Its Effect On The Evolving IT Sector In Australia - Elevate
REPORT: Heating appliances market in Poland 2024
Belt and Road Supply Chain Finance Blockchain Solution
Chapter 3 Spatial Domain Image Processing.pdf
DevOps & Developer Experience Summer BBQ
Building High-Performance Oracle Teams: Strategic Staffing for Database Manag...
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
How AI Agents Improve Data Accuracy and Consistency in Due Diligence.pdf
ai-archetype-understanding-the-personality-of-agentic-ai.pdf

Hadoop Conference Japan 2011 Fall

Editor's Notes