SlideShare a Scribd company logo
Supermicro cloudera hadoop
Enterprise and Data Center
  Hadoop Infrastructure




                             © Supermicro 2012
Building Block Platforms for Hadoop


 1U 815 Name Nodes
        Dual Quad Core Xeon
        4, 3.5” 15k HDD spindles per node
        Hot Swap HDD, PSUs
        Common Components
        On Board IPMI Remote Management
        93% Efficiency PMBus PSUs


 2UTwin 827 Hadoop Nodes
        Dual Quad Core Xeon
        6, 3.5” HDD spindles per node
        2 Nodes in 2U = 6 HDD per U
        On Board IPMI Remote Management
        Hot Swap Nodes, HDD, PSUs
        94% Efficiency PMBus PSUs
Building Block Platforms for Hadoop



 2U 825 Balanced Hadoop Nodes
         Dual Quad Core Xeon
         8, 3.5” HDD
         On Board IPMI Remote Management
         Common Components
         Hot Swap HDD, PSUs
         93% Efficiency PMBus PSUs

 2U 826 Flex Hadoop Nodes
         Dual Quad Core Xeon
         12, 3.5” HDD
         On Board IPMI Remote Management
         Hot Swap HDD, PSUs
         Up to 24TB per 2U
         Common Components
         93% Efficiency PMBus PSUs
Cloudera Certified Technology
Optimized Hadoop Nodes - Cloudera Ready
Name Node / Job Tracker:


                815 Name Node – 4 x 15K 48GB
                PIO-HNU0-15056248-HADP



Data Nodes:               1TB SATA Drives                     2TB SATA Drives


                815 Data Node – 4 x 1TB 24GB        815 Data Node – 4 x 2TB 24GB
                PIO-HDU0-15156224-HADP    1U        PIO-HDU0-15256224-HADP    1U




                 827 Data Node – 6 x 1TB 24GB       827 Data Node – 6 x 2TB 24GB
                 PIO-HDT0-27156224-HADP 2UTwin      PIO-HDT0-27256224-HADP 2UTwin




                 825 Data Node – 8 x 1TB 24GB       825 Data Node – 8 x 2TB 24GB
                 PIO-HDU0-25156224-HADP    2U       PIO-HDU0-25256224-HADP    2U




                 826 Data Node – 12 x 1TB 24GB      826 Data Node – 12 x 2TB 24GB
                 PIO-HDU0-26156224-HADP        2U   PIO-HDU0-26256224-HADP    2U
Turn Key Certified Pilot Cluster Kits

Pilot Kit - Configuration:                             11 Node Pilot
                                                       •48 TB
                                                       •3.5” SATA
 Ethernet Switch:      1G Ethernet Switch
   (10G Uplink         SSE-G24-TG4   1U 24 port
                                                       •64 Cores
    Capability)        SSE-G48-TG4   1U 48 port

                                                       •48 Spindles
                       Name Node – 48GB
   Name Node:          PIO-HNU0-15056248-HADP          •288 GB Memory
   Secondary           Name Node – 48GB                •Occupy 14U
Name/Job Tracker:      PIO-HNU0-15056248-HADP


  2 Data Nodes:        Data Node – 6 x 1TB 24GB
                       PIO-HDT0-27156224-HADP 2UTwin

  2 Data Nodes:        Data Node – 6 x 1TB 24GB
                       PIO-HDT0-27156224-HADP 2UTwin

  2 Data Nodes:        Data Node – 6 x 1TB 24GB
                       PIO-HDT0-27156224-HADP 2UTwin

  2 Data Nodes:        Data Node – 6 x 1TB 24GB
                       PIO-HDT0-27156224-HADP 2UTwin




                                                       Hadoop Kit # SRS-14UL63-HADP-GM
Hadoop Series Naming Convention
                 PIO-HDU0-26156224-HADP

H = Hadoop
                                             24 = GB Memory
 D = Data Node                               48 = GB Memory
 N = Name Node
  U = X8DTU-F                               562 = Xeon E5620
  T = X8DTT-HF
    0 = Intel
    1 = AMD                                  0 = OS HDD x 4
                                             1 = 1TB HDD
      15 = 815 - 2U - 4 HDD                  2 = 2TB HDD
      25 = 825 - 2U - 8 HDD
      26 = 826 - 2U - 12 HDD
      27 = 827 - 2UTwin - 2x6 HDD
Hadoop Series Naming Convention


Model/Part #             Description / Functionality
PIO-HNU0-15056248-HADP   1U Hadoop 815 Name E5620 48GB MEM

PIO-HDU0-15156224-HADP   1U Hadoop 815 4 1TB 4C E5620 2.4G 12M 5.86GT 80W 24GB MEM
PIO-HDU0-15256224-HADP   1U Hadoop 815 4 2TB 4C E5620 2.4G 12M 5.86GT 80W 24GB MEM

PIO-HDT0-27156224-HADP   2U Hadoop 827 6 1TB 4C E5620 2.4G 12M 5.86GT 80W 24GB MEM
PIO-HDT0-27256224-HADP   2U Hadoop 827 6 2TB 4C E5620 2.4G 12M 5.86GT 80W 24GB MEM

PIO-HDU0-25156224-HADP   2U Hadoop 825 8 1TB 4C E5620 2.4G 12M 5.86GT 80W 24GB MEM
PIO-HDU0-25256224-HADP   2U Hadoop 825 8 2TB 4C E5620 2.4G 12M 5.86GT 80W 24GB MEM

PIO-HDU0-26156224-HADP   2U Hadoop 826 12 1TB 4C E5620 2.4G 12M 5.86GT 80W 24GB MEM
PIO-HDU0-26256224-HADP   2U Hadoop 826 12 2TB 4C E5620 2.4G 12M 5.86GT 80W 24GB MEM
Turn Key Hadoop Cluster Racks




+               +             +           =      ROB
                                              Return on Byte$




    Optimized
     Nodes      Integration       Delivered
1G Turn Key Hadoop Pilot Rack

                          1 x Management Node for
                               Cloudera SCM Express
                          2 x Name/Job Tracker Nodes
                          34 x Data Nodes
          +            =  1Gbps Networking
                                1 x 48 Port Switch
                                           Data Network
                                1 x 48 Port Switch
                                           IPMI Management Network
                           204-408 TB Rack Capacity


Integration   Delivered
Focused on Improving TCO on all Slices
http://www.supermicro.com
http://www.supermicro.com/hadoop

More Related Content

What's hot (20)

PDF
GPU/SSD Accelerates PostgreSQL - challenge towards query processing throughpu...
Kohei KaiGai
 
PDF
20170602_OSSummit_an_intelligent_storage
Kohei KaiGai
 
PDF
20201128_OSC_Fukuoka_Online_GPUPostGIS
Kohei KaiGai
 
PDF
GIST AI-X Computing Cluster
Jax Jargalsaikhan
 
PDF
PG-Strom - GPGPU meets PostgreSQL, PGcon2015
Kohei KaiGai
 
PDF
GPGPU Accelerates PostgreSQL (English)
Kohei KaiGai
 
PDF
20171206 PGconf.ASIA LT gstore_fdw
Kohei KaiGai
 
PDF
Gruter_TECHDAY_2014_04_TajoCloudHandsOn (in Korean)
Gruter
 
PDF
NSCC Training - Introductory Class
National Supercomputing Centre Singapore
 
PPTX
NSCC Training Introductory Class
National Supercomputing Centre Singapore
 
ODP
Hadoop Installation and basic configuration
Gerrit van Vuuren
 
PDF
pgconfasia2016 plcuda en
Kohei KaiGai
 
PDF
NSCC Training Introductory Class
National Supercomputing Centre Singapore
 
PDF
SQL+GPU+SSD=∞ (English)
Kohei KaiGai
 
PDF
PG-Strom
Kohei KaiGai
 
PDF
PL/CUDA - Fusion of HPC Grade Power with In-Database Analytics
Kohei KaiGai
 
PDF
20150318-SFPUG-Meetup-PGStrom
Kohei KaiGai
 
PDF
20160407_GTC2016_PgSQL_In_Place
Kohei KaiGai
 
PDF
Bloat and Fragmentation in PostgreSQL
Masahiko Sawada
 
PDF
GPGPU Accelerates PostgreSQL ~Unlock the power of multi-thousand cores~
Kohei KaiGai
 
GPU/SSD Accelerates PostgreSQL - challenge towards query processing throughpu...
Kohei KaiGai
 
20170602_OSSummit_an_intelligent_storage
Kohei KaiGai
 
20201128_OSC_Fukuoka_Online_GPUPostGIS
Kohei KaiGai
 
GIST AI-X Computing Cluster
Jax Jargalsaikhan
 
PG-Strom - GPGPU meets PostgreSQL, PGcon2015
Kohei KaiGai
 
GPGPU Accelerates PostgreSQL (English)
Kohei KaiGai
 
20171206 PGconf.ASIA LT gstore_fdw
Kohei KaiGai
 
Gruter_TECHDAY_2014_04_TajoCloudHandsOn (in Korean)
Gruter
 
NSCC Training - Introductory Class
National Supercomputing Centre Singapore
 
NSCC Training Introductory Class
National Supercomputing Centre Singapore
 
Hadoop Installation and basic configuration
Gerrit van Vuuren
 
pgconfasia2016 plcuda en
Kohei KaiGai
 
NSCC Training Introductory Class
National Supercomputing Centre Singapore
 
SQL+GPU+SSD=∞ (English)
Kohei KaiGai
 
PG-Strom
Kohei KaiGai
 
PL/CUDA - Fusion of HPC Grade Power with In-Database Analytics
Kohei KaiGai
 
20150318-SFPUG-Meetup-PGStrom
Kohei KaiGai
 
20160407_GTC2016_PgSQL_In_Place
Kohei KaiGai
 
Bloat and Fragmentation in PostgreSQL
Masahiko Sawada
 
GPGPU Accelerates PostgreSQL ~Unlock the power of multi-thousand cores~
Kohei KaiGai
 

Viewers also liked (6)

PDF
Blue Line Supermicro Aplus
Blue Line
 
PDF
101 ab 1415-1445
Chiou-Nan Chen
 
PDF
Globeteam presenation hybrid apps
Blue Line
 
PPTX
Red Hat Storage Day LA - Supermicro SuperStorage
Red_Hat_Storage
 
PDF
Introduction to JIRA & Agile Project Management
Dan Chuparkoff
 
PDF
The Minimum Loveable Product
The Happy Startup School
 
Blue Line Supermicro Aplus
Blue Line
 
101 ab 1415-1445
Chiou-Nan Chen
 
Globeteam presenation hybrid apps
Blue Line
 
Red Hat Storage Day LA - Supermicro SuperStorage
Red_Hat_Storage
 
Introduction to JIRA & Agile Project Management
Dan Chuparkoff
 
The Minimum Loveable Product
The Happy Startup School
 
Ad

Similar to Supermicro cloudera hadoop (20)

PDF
April 2014 IBM announcement webcast
HELP400
 
PDF
Pilot Hadoop Towards 2500 Nodes and Cluster Redundancy
Stuart Pook
 
PPT
11540800.ppt
ssuser648a17
 
PPTX
Red Hat Storage Day Seattle: Supermicro Solutions for Red Hat Ceph and Red Ha...
Red_Hat_Storage
 
PDF
BURA Supercomputer
SIMTEC Software and Services
 
PDF
AI Accelerators for Cloud Datacenters
CastLabKAIST
 
PPTX
PLNOG 13: Maciej Grabowski: HP Moonshot
PROIDEA
 
PDF
Evolution of Supermicro GPU Server Solution
NVIDIA Taiwan
 
PDF
Yeni Nesil Sunucular ile Veritabanınız
MSHOWTO Bilisim Toplulugu
 
PDF
Dell Technologies Dell EMC Data Protection Solutions On One Single Page - POS...
Smarter.World
 
PDF
Optimizing Hadoop Deployments with AMD/SeaMicro SM15000 Fabric Servers
Satheesh Nanniyur
 
PDF
CC-4009, "Optimizing Hadoop Deployments with SeaMicro SM15000" by Satheesh Na...
AMD Developer Central
 
PPTX
The Power of HPC with Next Generation Supermicro Systems
Rebekah Rodriguez
 
PDF
Hortonworks on IBM POWER Analytics / AI
DataWorks Summit
 
PDF
High Performance Computing in a Nutshell
MohanArumugam24
 
PPTX
TDS-16489U - Dual Processor
Fernando Barrientos
 
PDF
Hpe Proliant DL325 Gen10 Server Datasheet
美兰 曾
 
PDF
HPE Solutions for Challenges in AI and Big Data
Lviv Startup Club
 
PDF
Saviak lviv ai-2019-e-mail (1)
Lviv Startup Club
 
PDF
4 p9 architecture overview japan meetup
Yutaka Kawai
 
April 2014 IBM announcement webcast
HELP400
 
Pilot Hadoop Towards 2500 Nodes and Cluster Redundancy
Stuart Pook
 
11540800.ppt
ssuser648a17
 
Red Hat Storage Day Seattle: Supermicro Solutions for Red Hat Ceph and Red Ha...
Red_Hat_Storage
 
BURA Supercomputer
SIMTEC Software and Services
 
AI Accelerators for Cloud Datacenters
CastLabKAIST
 
PLNOG 13: Maciej Grabowski: HP Moonshot
PROIDEA
 
Evolution of Supermicro GPU Server Solution
NVIDIA Taiwan
 
Yeni Nesil Sunucular ile Veritabanınız
MSHOWTO Bilisim Toplulugu
 
Dell Technologies Dell EMC Data Protection Solutions On One Single Page - POS...
Smarter.World
 
Optimizing Hadoop Deployments with AMD/SeaMicro SM15000 Fabric Servers
Satheesh Nanniyur
 
CC-4009, "Optimizing Hadoop Deployments with SeaMicro SM15000" by Satheesh Na...
AMD Developer Central
 
The Power of HPC with Next Generation Supermicro Systems
Rebekah Rodriguez
 
Hortonworks on IBM POWER Analytics / AI
DataWorks Summit
 
High Performance Computing in a Nutshell
MohanArumugam24
 
TDS-16489U - Dual Processor
Fernando Barrientos
 
Hpe Proliant DL325 Gen10 Server Datasheet
美兰 曾
 
HPE Solutions for Challenges in AI and Big Data
Lviv Startup Club
 
Saviak lviv ai-2019-e-mail (1)
Lviv Startup Club
 
4 p9 architecture overview japan meetup
Yutaka Kawai
 
Ad

Recently uploaded (20)

PDF
TrustArc Webinar - Data Privacy Trends 2025: Mid-Year Insights & Program Stra...
TrustArc
 
PPTX
Earn Agentblazer Status with Slack Community Patna.pptx
SanjeetMishra29
 
PDF
OpenInfra ID 2025 - Are Containers Dying? Rethinking Isolation with MicroVMs.pdf
Muhammad Yuga Nugraha
 
PPTX
Machine Learning Benefits Across Industries
SynapseIndia
 
PDF
Trading Volume Explained by CIFDAQ- Secret Of Market Trends
CIFDAQ
 
PDF
Novus Safe Lite- What is Novus Safe Lite.pdf
Novus Hi-Tech
 
PDF
Apache CloudStack 201: Let's Design & Build an IaaS Cloud
ShapeBlue
 
PDF
Lecture A - AI Workflows for Banking.pdf
Dr. LAM Yat-fai (林日辉)
 
PDF
Ampere Offers Energy-Efficient Future For AI And Cloud
ShapeBlue
 
PDF
Empowering Cloud Providers with Apache CloudStack and Stackbill
ShapeBlue
 
PDF
Arcee AI - building and working with small language models (06/25)
Julien SIMON
 
PPT
Interview paper part 3, It is based on Interview Prep
SoumyadeepGhosh39
 
PDF
UiPath vs Other Automation Tools Meeting Presentation.pdf
Tracy Dixon
 
PDF
Novus-Safe Pro: Brochure-What is Novus Safe Pro?.pdf
Novus Hi-Tech
 
PPTX
✨Unleashing Collaboration: Salesforce Channels & Community Power in Patna!✨
SanjeetMishra29
 
PDF
HR agent at Mediq: Lessons learned on Agent Builder & Maestro by Tacstone Tec...
UiPathCommunity
 
PDF
Human-centred design in online workplace learning and relationship to engagem...
Tracy Tang
 
DOCX
TLE9 COOKERY DLL WEEK3 technology and li
jamierha cabaero
 
PDF
Market Wrap for 18th July 2025 by CIFDAQ
CIFDAQ
 
PPTX
Building a Production-Ready Barts Health Secure Data Environment Tooling, Acc...
Barts Health
 
TrustArc Webinar - Data Privacy Trends 2025: Mid-Year Insights & Program Stra...
TrustArc
 
Earn Agentblazer Status with Slack Community Patna.pptx
SanjeetMishra29
 
OpenInfra ID 2025 - Are Containers Dying? Rethinking Isolation with MicroVMs.pdf
Muhammad Yuga Nugraha
 
Machine Learning Benefits Across Industries
SynapseIndia
 
Trading Volume Explained by CIFDAQ- Secret Of Market Trends
CIFDAQ
 
Novus Safe Lite- What is Novus Safe Lite.pdf
Novus Hi-Tech
 
Apache CloudStack 201: Let's Design & Build an IaaS Cloud
ShapeBlue
 
Lecture A - AI Workflows for Banking.pdf
Dr. LAM Yat-fai (林日辉)
 
Ampere Offers Energy-Efficient Future For AI And Cloud
ShapeBlue
 
Empowering Cloud Providers with Apache CloudStack and Stackbill
ShapeBlue
 
Arcee AI - building and working with small language models (06/25)
Julien SIMON
 
Interview paper part 3, It is based on Interview Prep
SoumyadeepGhosh39
 
UiPath vs Other Automation Tools Meeting Presentation.pdf
Tracy Dixon
 
Novus-Safe Pro: Brochure-What is Novus Safe Pro?.pdf
Novus Hi-Tech
 
✨Unleashing Collaboration: Salesforce Channels & Community Power in Patna!✨
SanjeetMishra29
 
HR agent at Mediq: Lessons learned on Agent Builder & Maestro by Tacstone Tec...
UiPathCommunity
 
Human-centred design in online workplace learning and relationship to engagem...
Tracy Tang
 
TLE9 COOKERY DLL WEEK3 technology and li
jamierha cabaero
 
Market Wrap for 18th July 2025 by CIFDAQ
CIFDAQ
 
Building a Production-Ready Barts Health Secure Data Environment Tooling, Acc...
Barts Health
 

Supermicro cloudera hadoop

  • 2. Enterprise and Data Center Hadoop Infrastructure © Supermicro 2012
  • 3. Building Block Platforms for Hadoop  1U 815 Name Nodes  Dual Quad Core Xeon  4, 3.5” 15k HDD spindles per node  Hot Swap HDD, PSUs  Common Components  On Board IPMI Remote Management  93% Efficiency PMBus PSUs  2UTwin 827 Hadoop Nodes  Dual Quad Core Xeon  6, 3.5” HDD spindles per node  2 Nodes in 2U = 6 HDD per U  On Board IPMI Remote Management  Hot Swap Nodes, HDD, PSUs  94% Efficiency PMBus PSUs
  • 4. Building Block Platforms for Hadoop  2U 825 Balanced Hadoop Nodes  Dual Quad Core Xeon  8, 3.5” HDD  On Board IPMI Remote Management  Common Components  Hot Swap HDD, PSUs  93% Efficiency PMBus PSUs  2U 826 Flex Hadoop Nodes  Dual Quad Core Xeon  12, 3.5” HDD  On Board IPMI Remote Management  Hot Swap HDD, PSUs  Up to 24TB per 2U  Common Components  93% Efficiency PMBus PSUs
  • 6. Optimized Hadoop Nodes - Cloudera Ready Name Node / Job Tracker: 815 Name Node – 4 x 15K 48GB PIO-HNU0-15056248-HADP Data Nodes: 1TB SATA Drives 2TB SATA Drives 815 Data Node – 4 x 1TB 24GB 815 Data Node – 4 x 2TB 24GB PIO-HDU0-15156224-HADP 1U PIO-HDU0-15256224-HADP 1U 827 Data Node – 6 x 1TB 24GB 827 Data Node – 6 x 2TB 24GB PIO-HDT0-27156224-HADP 2UTwin PIO-HDT0-27256224-HADP 2UTwin 825 Data Node – 8 x 1TB 24GB 825 Data Node – 8 x 2TB 24GB PIO-HDU0-25156224-HADP 2U PIO-HDU0-25256224-HADP 2U 826 Data Node – 12 x 1TB 24GB 826 Data Node – 12 x 2TB 24GB PIO-HDU0-26156224-HADP 2U PIO-HDU0-26256224-HADP 2U
  • 7. Turn Key Certified Pilot Cluster Kits Pilot Kit - Configuration: 11 Node Pilot •48 TB •3.5” SATA Ethernet Switch: 1G Ethernet Switch (10G Uplink SSE-G24-TG4 1U 24 port •64 Cores Capability) SSE-G48-TG4 1U 48 port •48 Spindles Name Node – 48GB Name Node: PIO-HNU0-15056248-HADP •288 GB Memory Secondary Name Node – 48GB •Occupy 14U Name/Job Tracker: PIO-HNU0-15056248-HADP 2 Data Nodes: Data Node – 6 x 1TB 24GB PIO-HDT0-27156224-HADP 2UTwin 2 Data Nodes: Data Node – 6 x 1TB 24GB PIO-HDT0-27156224-HADP 2UTwin 2 Data Nodes: Data Node – 6 x 1TB 24GB PIO-HDT0-27156224-HADP 2UTwin 2 Data Nodes: Data Node – 6 x 1TB 24GB PIO-HDT0-27156224-HADP 2UTwin Hadoop Kit # SRS-14UL63-HADP-GM
  • 8. Hadoop Series Naming Convention PIO-HDU0-26156224-HADP H = Hadoop 24 = GB Memory D = Data Node 48 = GB Memory N = Name Node U = X8DTU-F 562 = Xeon E5620 T = X8DTT-HF 0 = Intel 1 = AMD 0 = OS HDD x 4 1 = 1TB HDD 15 = 815 - 2U - 4 HDD 2 = 2TB HDD 25 = 825 - 2U - 8 HDD 26 = 826 - 2U - 12 HDD 27 = 827 - 2UTwin - 2x6 HDD
  • 9. Hadoop Series Naming Convention Model/Part # Description / Functionality PIO-HNU0-15056248-HADP 1U Hadoop 815 Name E5620 48GB MEM PIO-HDU0-15156224-HADP 1U Hadoop 815 4 1TB 4C E5620 2.4G 12M 5.86GT 80W 24GB MEM PIO-HDU0-15256224-HADP 1U Hadoop 815 4 2TB 4C E5620 2.4G 12M 5.86GT 80W 24GB MEM PIO-HDT0-27156224-HADP 2U Hadoop 827 6 1TB 4C E5620 2.4G 12M 5.86GT 80W 24GB MEM PIO-HDT0-27256224-HADP 2U Hadoop 827 6 2TB 4C E5620 2.4G 12M 5.86GT 80W 24GB MEM PIO-HDU0-25156224-HADP 2U Hadoop 825 8 1TB 4C E5620 2.4G 12M 5.86GT 80W 24GB MEM PIO-HDU0-25256224-HADP 2U Hadoop 825 8 2TB 4C E5620 2.4G 12M 5.86GT 80W 24GB MEM PIO-HDU0-26156224-HADP 2U Hadoop 826 12 1TB 4C E5620 2.4G 12M 5.86GT 80W 24GB MEM PIO-HDU0-26256224-HADP 2U Hadoop 826 12 2TB 4C E5620 2.4G 12M 5.86GT 80W 24GB MEM
  • 10. Turn Key Hadoop Cluster Racks + + + = ROB Return on Byte$ Optimized Nodes Integration Delivered
  • 11. 1G Turn Key Hadoop Pilot Rack  1 x Management Node for Cloudera SCM Express  2 x Name/Job Tracker Nodes  34 x Data Nodes + =  1Gbps Networking  1 x 48 Port Switch  Data Network  1 x 48 Port Switch  IPMI Management Network  204-408 TB Rack Capacity Integration Delivered
  • 12. Focused on Improving TCO on all Slices