SlideShare a Scribd company logo
May 11, 2015
SERC Petascale
System
SERC
 Providing computing facility to Institute
users from 1970.
 State-of-the-art facility for parallel
computing with high performance storage
along with a range of software application
domains.
 Balance between capacity and capability
computing to meet diverse requirements
of users.
SERC Petascale System
 Cray-XC40, an MPP class machine
 Petascale compute capability with
◦ CPU Clusters with 33024 Intel-Haswell processor
cores achieving more than 900 TFLOPS
◦ 44 node GPU clusters
with Intel Ivybridge
processor and Tesla K40
GPU, delivering 52
TFLOPS
◦ 48 node Intel Xeon Phi
Cluster (5120D) giving
28 TFLOPS
Compute
Blade :
Each
having 4
nodes or
96 cores
Chassis :
16 blades;
64 nodes;
No cables
Group:
6 Chassis
and 384
nodes
Electrical
network
cables
System
4 Groups
Active
Optical
cables
SYSTEM BUILDING BLOCKS
Aries NOC
Connects
nodes on a
blade
128Gbps
Rank 1
Network
Backplane
connection
through blade
Connects nodes
on a chassis
157.6Gbps
Rank 2
Network
Passive Electrical
cables
Connect
multiple chassis
All-to-all chassis
connection
157.6Gbps
Rank 3
Network
Optical cable
connection to
multiple
cabinets
All-to-all
cabinet
connection on
a Dragonfly
topology
43Gbps
SYSTEM INTERCONNECT
XC40 SOFTWARE
ENVIRONMENT
Parallel File System
2 Peta Byte of Direct Attached parallel
storage with RAID6 from DDN
Cray’s Parallel Lustre File System
28 GBps Read and 32 GBps Write
performance
Installation & Commissioning
of the Petascale System
Petascale System: Status
 Operational from Jan. 15, 2015
 System Acceptance by Feb. 19, 2015
 60+ users
 A few show case capability applications
Unsteady Aerodynamic
Simulation
 Dynamic Ground Effect: Unsteady simulation of entire
landing sequence of a high lift wing
 Problem size: 36 Million volume grid & simulation of 11
secs of the landing sequence
 System : 8 days on XC40 using 10000 Xeon cores (for a time
step of .001 sec)
 Observation: A critical number of supernovae
required to maintain an over-pressured bubble
for 10s of Myr, for a given density and spatial
separation between supernovae. These
superbubbles should break out of galaxies and
suppress global star formation.
 PLUTO hydrodynamics code to simulate
supernovae using 5123 and 10243 simulations.
 Application scales upto 12,000 cores.
Simulating Overlapping
Supernovae
Thank You!
Ad

More Related Content

What's hot (20)

UberCloud Webinar Abaqus and cloud computing
UberCloud Webinar Abaqus and cloud computingUberCloud Webinar Abaqus and cloud computing
UberCloud Webinar Abaqus and cloud computing
Thomas Francis
 
Reconfigurable network on chip
Reconfigurable network on chipReconfigurable network on chip
Reconfigurable network on chip
AngelinaRoyappa1
 
Advanced spark deep learning
Advanced spark deep learningAdvanced spark deep learning
Advanced spark deep learning
Adam Gibson
 
Fast
FastFast
Fast
lodingthepage440
 
Mellanox Announces HDR 200 Gb/s InfiniBand Solutions
Mellanox Announces HDR 200 Gb/s InfiniBand SolutionsMellanox Announces HDR 200 Gb/s InfiniBand Solutions
Mellanox Announces HDR 200 Gb/s InfiniBand Solutions
inside-BigData.com
 
Drive into calico architecture
Drive into calico architectureDrive into calico architecture
Drive into calico architecture
Anirban Sen Chowdhary
 
Fpga computing 14 03 2013
Fpga computing 14 03 2013Fpga computing 14 03 2013
Fpga computing 14 03 2013
Eurotech Aurora
 
OpenPOWER Latest Updates
OpenPOWER Latest UpdatesOpenPOWER Latest Updates
OpenPOWER Latest Updates
Ganesan Narayanasamy
 
Emerging Networking Technologies for Industrial Applications
Emerging Networking Technologies for Industrial ApplicationsEmerging Networking Technologies for Industrial Applications
Emerging Networking Technologies for Industrial Applications
Prasant Misra
 
OpenPOWER System Marconi100
OpenPOWER System Marconi100OpenPOWER System Marconi100
OpenPOWER System Marconi100
Ganesan Narayanasamy
 
Energy Efficient GPS Acquisition with Sparse-GPS
Energy Efficient GPS Acquisition with Sparse-GPSEnergy Efficient GPS Acquisition with Sparse-GPS
Energy Efficient GPS Acquisition with Sparse-GPS
Prasant Misra
 
ARM-based Supercomputer from Fujitsu and RIKEN - "Post-K"
ARM-based Supercomputer from Fujitsu and RIKEN - "Post-K"ARM-based Supercomputer from Fujitsu and RIKEN - "Post-K"
ARM-based Supercomputer from Fujitsu and RIKEN - "Post-K"
Phil Hughes
 
HPC Midlands - Supercomputing for Research and Industry (Hartree Centre prese...
HPC Midlands - Supercomputing for Research and Industry (Hartree Centre prese...HPC Midlands - Supercomputing for Research and Industry (Hartree Centre prese...
HPC Midlands - Supercomputing for Research and Industry (Hartree Centre prese...
Martin Hamilton
 
HPC Midlands - E.ON Supercomputing Case Study
HPC Midlands - E.ON Supercomputing Case StudyHPC Midlands - E.ON Supercomputing Case Study
HPC Midlands - E.ON Supercomputing Case Study
Martin Hamilton
 
Fme goes nuclear (part 2)
Fme goes nuclear (part 2)Fme goes nuclear (part 2)
Fme goes nuclear (part 2)
Safe Software
 
Data path-acceleration-techniques-in-a-nfv-world
Data path-acceleration-techniques-in-a-nfv-worldData path-acceleration-techniques-in-a-nfv-world
Data path-acceleration-techniques-in-a-nfv-world
Happiest Minds Technologies
 
High Performance Interconnects: Assessment & Rankings
High Performance Interconnects: Assessment & RankingsHigh Performance Interconnects: Assessment & Rankings
High Performance Interconnects: Assessment & Rankings
inside-BigData.com
 
RISC-V and OpenPOWER open-ISA and open-HW - a swiss army knife for HPC
RISC-V  and OpenPOWER open-ISA and open-HW - a swiss army knife for HPCRISC-V  and OpenPOWER open-ISA and open-HW - a swiss army knife for HPC
RISC-V and OpenPOWER open-ISA and open-HW - a swiss army knife for HPC
Ganesan Narayanasamy
 
PosterIT410-2
PosterIT410-2PosterIT410-2
PosterIT410-2
Chanon Luke
 
Ef35745749
Ef35745749Ef35745749
Ef35745749
IJERA Editor
 
UberCloud Webinar Abaqus and cloud computing
UberCloud Webinar Abaqus and cloud computingUberCloud Webinar Abaqus and cloud computing
UberCloud Webinar Abaqus and cloud computing
Thomas Francis
 
Reconfigurable network on chip
Reconfigurable network on chipReconfigurable network on chip
Reconfigurable network on chip
AngelinaRoyappa1
 
Advanced spark deep learning
Advanced spark deep learningAdvanced spark deep learning
Advanced spark deep learning
Adam Gibson
 
Mellanox Announces HDR 200 Gb/s InfiniBand Solutions
Mellanox Announces HDR 200 Gb/s InfiniBand SolutionsMellanox Announces HDR 200 Gb/s InfiniBand Solutions
Mellanox Announces HDR 200 Gb/s InfiniBand Solutions
inside-BigData.com
 
Fpga computing 14 03 2013
Fpga computing 14 03 2013Fpga computing 14 03 2013
Fpga computing 14 03 2013
Eurotech Aurora
 
Emerging Networking Technologies for Industrial Applications
Emerging Networking Technologies for Industrial ApplicationsEmerging Networking Technologies for Industrial Applications
Emerging Networking Technologies for Industrial Applications
Prasant Misra
 
Energy Efficient GPS Acquisition with Sparse-GPS
Energy Efficient GPS Acquisition with Sparse-GPSEnergy Efficient GPS Acquisition with Sparse-GPS
Energy Efficient GPS Acquisition with Sparse-GPS
Prasant Misra
 
ARM-based Supercomputer from Fujitsu and RIKEN - "Post-K"
ARM-based Supercomputer from Fujitsu and RIKEN - "Post-K"ARM-based Supercomputer from Fujitsu and RIKEN - "Post-K"
ARM-based Supercomputer from Fujitsu and RIKEN - "Post-K"
Phil Hughes
 
HPC Midlands - Supercomputing for Research and Industry (Hartree Centre prese...
HPC Midlands - Supercomputing for Research and Industry (Hartree Centre prese...HPC Midlands - Supercomputing for Research and Industry (Hartree Centre prese...
HPC Midlands - Supercomputing for Research and Industry (Hartree Centre prese...
Martin Hamilton
 
HPC Midlands - E.ON Supercomputing Case Study
HPC Midlands - E.ON Supercomputing Case StudyHPC Midlands - E.ON Supercomputing Case Study
HPC Midlands - E.ON Supercomputing Case Study
Martin Hamilton
 
Fme goes nuclear (part 2)
Fme goes nuclear (part 2)Fme goes nuclear (part 2)
Fme goes nuclear (part 2)
Safe Software
 
Data path-acceleration-techniques-in-a-nfv-world
Data path-acceleration-techniques-in-a-nfv-worldData path-acceleration-techniques-in-a-nfv-world
Data path-acceleration-techniques-in-a-nfv-world
Happiest Minds Technologies
 
High Performance Interconnects: Assessment & Rankings
High Performance Interconnects: Assessment & RankingsHigh Performance Interconnects: Assessment & Rankings
High Performance Interconnects: Assessment & Rankings
inside-BigData.com
 
RISC-V and OpenPOWER open-ISA and open-HW - a swiss army knife for HPC
RISC-V  and OpenPOWER open-ISA and open-HW - a swiss army knife for HPCRISC-V  and OpenPOWER open-ISA and open-HW - a swiss army knife for HPC
RISC-V and OpenPOWER open-ISA and open-HW - a swiss army knife for HPC
Ganesan Narayanasamy
 

Viewers also liked (18)

Petascale Storage -- Do It Yourself!
Petascale Storage -- Do It Yourself!Petascale Storage -- Do It Yourself!
Petascale Storage -- Do It Yourself!
Tim Lossen
 
Future of cloud storage
Future of cloud storageFuture of cloud storage
Future of cloud storage
GlusterFS
 
Cycle Computing Record-breaking Petascale HPC Run
Cycle Computing Record-breaking Petascale HPC RunCycle Computing Record-breaking Petascale HPC Run
Cycle Computing Record-breaking Petascale HPC Run
inside-BigData.com
 
many-task computing
many-task computingmany-task computing
many-task computing
Harry Sunarsa
 
The Explosion of Petascale in the Race to Exascale
The Explosion of Petascale in the Race to ExascaleThe Explosion of Petascale in the Race to Exascale
The Explosion of Petascale in the Race to Exascale
Intel IT Center
 
Search algorithms for discrete optimization
Search algorithms for discrete optimizationSearch algorithms for discrete optimization
Search algorithms for discrete optimization
Sally Salem
 
SIA „ILY” pieredzes stāsts
SIA „ILY” pieredzes stāstsSIA „ILY” pieredzes stāsts
SIA „ILY” pieredzes stāsts
Ekonomikas ministrija
 
Petascale Cloud Storage with GlusterFS
Petascale Cloud Storage with GlusterFSPetascale Cloud Storage with GlusterFS
Petascale Cloud Storage with GlusterFS
The Linux Foundation
 
Distributed Shared Memory Systems
Distributed Shared Memory SystemsDistributed Shared Memory Systems
Distributed Shared Memory Systems
Ankit Gupta
 
Nanotechnology by sanchit sharma
Nanotechnology by sanchit sharmaNanotechnology by sanchit sharma
Nanotechnology by sanchit sharma
Sanchit Sharma
 
Opticalcomputing final
Opticalcomputing finalOpticalcomputing final
Opticalcomputing final
VISHNU K NARAYANAN
 
Distributed shared memory shyam soni
Distributed shared memory shyam soniDistributed shared memory shyam soni
Distributed shared memory shyam soni
Shyam Soni
 
Optical Computing Technology
Optical Computing TechnologyOptical Computing Technology
Optical Computing Technology
Kanchan Shinde
 
Synchronization in distributed systems
Synchronization in distributed systems Synchronization in distributed systems
Synchronization in distributed systems
SHATHAN
 
Distributed Shared Memory Systems
Distributed Shared Memory SystemsDistributed Shared Memory Systems
Distributed Shared Memory Systems
Arush Nagpal
 
Quantum Computers
Quantum ComputersQuantum Computers
Quantum Computers
Deepti.B
 
Quantum computer ppt
Quantum computer pptQuantum computer ppt
Quantum computer ppt
Nisarg Bhagavantanavar
 
Super computer
Super computerSuper computer
Super computer
Vivek Kandhagatla
 
Petascale Storage -- Do It Yourself!
Petascale Storage -- Do It Yourself!Petascale Storage -- Do It Yourself!
Petascale Storage -- Do It Yourself!
Tim Lossen
 
Future of cloud storage
Future of cloud storageFuture of cloud storage
Future of cloud storage
GlusterFS
 
Cycle Computing Record-breaking Petascale HPC Run
Cycle Computing Record-breaking Petascale HPC RunCycle Computing Record-breaking Petascale HPC Run
Cycle Computing Record-breaking Petascale HPC Run
inside-BigData.com
 
The Explosion of Petascale in the Race to Exascale
The Explosion of Petascale in the Race to ExascaleThe Explosion of Petascale in the Race to Exascale
The Explosion of Petascale in the Race to Exascale
Intel IT Center
 
Search algorithms for discrete optimization
Search algorithms for discrete optimizationSearch algorithms for discrete optimization
Search algorithms for discrete optimization
Sally Salem
 
Petascale Cloud Storage with GlusterFS
Petascale Cloud Storage with GlusterFSPetascale Cloud Storage with GlusterFS
Petascale Cloud Storage with GlusterFS
The Linux Foundation
 
Distributed Shared Memory Systems
Distributed Shared Memory SystemsDistributed Shared Memory Systems
Distributed Shared Memory Systems
Ankit Gupta
 
Nanotechnology by sanchit sharma
Nanotechnology by sanchit sharmaNanotechnology by sanchit sharma
Nanotechnology by sanchit sharma
Sanchit Sharma
 
Distributed shared memory shyam soni
Distributed shared memory shyam soniDistributed shared memory shyam soni
Distributed shared memory shyam soni
Shyam Soni
 
Optical Computing Technology
Optical Computing TechnologyOptical Computing Technology
Optical Computing Technology
Kanchan Shinde
 
Synchronization in distributed systems
Synchronization in distributed systems Synchronization in distributed systems
Synchronization in distributed systems
SHATHAN
 
Distributed Shared Memory Systems
Distributed Shared Memory SystemsDistributed Shared Memory Systems
Distributed Shared Memory Systems
Arush Nagpal
 
Quantum Computers
Quantum ComputersQuantum Computers
Quantum Computers
Deepti.B
 
Ad

Similar to SERC, IISc CRAY PetaFLOPS System (20)

Tesla Accelerated Computing Platform
Tesla Accelerated Computing PlatformTesla Accelerated Computing Platform
Tesla Accelerated Computing Platform
inside-BigData.com
 
HPC Infrastructure To Solve The CFD Grand Challenge
HPC Infrastructure To Solve The CFD Grand ChallengeHPC Infrastructure To Solve The CFD Grand Challenge
HPC Infrastructure To Solve The CFD Grand Challenge
Anand Haridass
 
PLNOG 17 - Nicolai van der Smagt - Building and connecting the eBay Classifie...
PLNOG 17 - Nicolai van der Smagt - Building and connecting the eBay Classifie...PLNOG 17 - Nicolai van der Smagt - Building and connecting the eBay Classifie...
PLNOG 17 - Nicolai van der Smagt - Building and connecting the eBay Classifie...
PROIDEA
 
Assisting User’s Transition to Titan’s Accelerated Architecture
Assisting User’s Transition to Titan’s Accelerated ArchitectureAssisting User’s Transition to Titan’s Accelerated Architecture
Assisting User’s Transition to Titan’s Accelerated Architecture
inside-BigData.com
 
2. Seamless Surveillance with Juniper networks.pdf
2. Seamless Surveillance with Juniper networks.pdf2. Seamless Surveillance with Juniper networks.pdf
2. Seamless Surveillance with Juniper networks.pdf
PawachMetharattanara
 
The new cisco catalyst 4500 e supervisor engine 9 e
The new cisco catalyst 4500 e supervisor engine 9 eThe new cisco catalyst 4500 e supervisor engine 9 e
The new cisco catalyst 4500 e supervisor engine 9 e
IT Tech
 
qfx5100-ethernet-switch-datasheet.pdfqfx5100-ethernet
qfx5100-ethernet-switch-datasheet.pdfqfx5100-ethernetqfx5100-ethernet-switch-datasheet.pdfqfx5100-ethernet
qfx5100-ethernet-switch-datasheet.pdfqfx5100-ethernet
ChristianSilva166877
 
cisco-c9200l-48p-4x-e-datasheet.pdf
cisco-c9200l-48p-4x-e-datasheet.pdfcisco-c9200l-48p-4x-e-datasheet.pdf
cisco-c9200l-48p-4x-e-datasheet.pdf
Hi-Network.com
 
knoSYS_Hardware
knoSYS_HardwareknoSYS_Hardware
knoSYS_Hardware
Benjamin Salisbury
 
CSCfi Computing Services 12/2014
CSCfi Computing Services 12/2014CSCfi Computing Services 12/2014
CSCfi Computing Services 12/2014
Olli-Pekka Lehto
 
Hardware architecture of Summit Supercomputer
 Hardware architecture of Summit Supercomputer Hardware architecture of Summit Supercomputer
Hardware architecture of Summit Supercomputer
VigneshwarRamaswamy
 
Cilium - Fast IPv6 Container Networking with BPF and XDP
Cilium - Fast IPv6 Container Networking with BPF and XDPCilium - Fast IPv6 Container Networking with BPF and XDP
Cilium - Fast IPv6 Container Networking with BPF and XDP
Thomas Graf
 
PCCC24(第24回PCクラスタシンポジウム):筑波大学計算科学研究センター テーマ2「スーパーコンピュータCygnus / Pegasus」
PCCC24(第24回PCクラスタシンポジウム):筑波大学計算科学研究センター テーマ2「スーパーコンピュータCygnus / Pegasus」PCCC24(第24回PCクラスタシンポジウム):筑波大学計算科学研究センター テーマ2「スーパーコンピュータCygnus / Pegasus」
PCCC24(第24回PCクラスタシンポジウム):筑波大学計算科学研究センター テーマ2「スーパーコンピュータCygnus / Pegasus」
PC Cluster Consortium
 
Inside the Volta GPU Architecture and CUDA 9
Inside the Volta GPU Architecture and CUDA 9Inside the Volta GPU Architecture and CUDA 9
Inside the Volta GPU Architecture and CUDA 9
inside-BigData.com
 
cisco-c9200l-48t-4x-e-datasheet.pdf
cisco-c9200l-48t-4x-e-datasheet.pdfcisco-c9200l-48t-4x-e-datasheet.pdf
cisco-c9200l-48t-4x-e-datasheet.pdf
Hi-Network.com
 
A Library for Emerging High-Performance Computing Clusters
A Library for Emerging High-Performance Computing ClustersA Library for Emerging High-Performance Computing Clusters
A Library for Emerging High-Performance Computing Clusters
Intel® Software
 
How to Design Scalable HPC, Deep Learning, and Cloud Middleware for Exascale ...
How to Design Scalable HPC, Deep Learning, and Cloud Middleware for Exascale ...How to Design Scalable HPC, Deep Learning, and Cloud Middleware for Exascale ...
How to Design Scalable HPC, Deep Learning, and Cloud Middleware for Exascale ...
inside-BigData.com
 
Accelerating TensorFlow with RDMA for high-performance deep learning
Accelerating TensorFlow with RDMA for high-performance deep learningAccelerating TensorFlow with RDMA for high-performance deep learning
Accelerating TensorFlow with RDMA for high-performance deep learning
DataWorks Summit
 
PLNOG 8: Ivan Pepelnjak - Data Center Fabrics - What Really Matters
PLNOG 8: Ivan Pepelnjak - Data Center Fabrics - What Really Matters PLNOG 8: Ivan Pepelnjak - Data Center Fabrics - What Really Matters
PLNOG 8: Ivan Pepelnjak - Data Center Fabrics - What Really Matters
PROIDEA
 
Seminar Accelerating Business Using Microservices Architecture in Digital Age...
Seminar Accelerating Business Using Microservices Architecture in Digital Age...Seminar Accelerating Business Using Microservices Architecture in Digital Age...
Seminar Accelerating Business Using Microservices Architecture in Digital Age...
PT Datacomm Diangraha
 
Tesla Accelerated Computing Platform
Tesla Accelerated Computing PlatformTesla Accelerated Computing Platform
Tesla Accelerated Computing Platform
inside-BigData.com
 
HPC Infrastructure To Solve The CFD Grand Challenge
HPC Infrastructure To Solve The CFD Grand ChallengeHPC Infrastructure To Solve The CFD Grand Challenge
HPC Infrastructure To Solve The CFD Grand Challenge
Anand Haridass
 
PLNOG 17 - Nicolai van der Smagt - Building and connecting the eBay Classifie...
PLNOG 17 - Nicolai van der Smagt - Building and connecting the eBay Classifie...PLNOG 17 - Nicolai van der Smagt - Building and connecting the eBay Classifie...
PLNOG 17 - Nicolai van der Smagt - Building and connecting the eBay Classifie...
PROIDEA
 
Assisting User’s Transition to Titan’s Accelerated Architecture
Assisting User’s Transition to Titan’s Accelerated ArchitectureAssisting User’s Transition to Titan’s Accelerated Architecture
Assisting User’s Transition to Titan’s Accelerated Architecture
inside-BigData.com
 
2. Seamless Surveillance with Juniper networks.pdf
2. Seamless Surveillance with Juniper networks.pdf2. Seamless Surveillance with Juniper networks.pdf
2. Seamless Surveillance with Juniper networks.pdf
PawachMetharattanara
 
The new cisco catalyst 4500 e supervisor engine 9 e
The new cisco catalyst 4500 e supervisor engine 9 eThe new cisco catalyst 4500 e supervisor engine 9 e
The new cisco catalyst 4500 e supervisor engine 9 e
IT Tech
 
qfx5100-ethernet-switch-datasheet.pdfqfx5100-ethernet
qfx5100-ethernet-switch-datasheet.pdfqfx5100-ethernetqfx5100-ethernet-switch-datasheet.pdfqfx5100-ethernet
qfx5100-ethernet-switch-datasheet.pdfqfx5100-ethernet
ChristianSilva166877
 
cisco-c9200l-48p-4x-e-datasheet.pdf
cisco-c9200l-48p-4x-e-datasheet.pdfcisco-c9200l-48p-4x-e-datasheet.pdf
cisco-c9200l-48p-4x-e-datasheet.pdf
Hi-Network.com
 
CSCfi Computing Services 12/2014
CSCfi Computing Services 12/2014CSCfi Computing Services 12/2014
CSCfi Computing Services 12/2014
Olli-Pekka Lehto
 
Hardware architecture of Summit Supercomputer
 Hardware architecture of Summit Supercomputer Hardware architecture of Summit Supercomputer
Hardware architecture of Summit Supercomputer
VigneshwarRamaswamy
 
Cilium - Fast IPv6 Container Networking with BPF and XDP
Cilium - Fast IPv6 Container Networking with BPF and XDPCilium - Fast IPv6 Container Networking with BPF and XDP
Cilium - Fast IPv6 Container Networking with BPF and XDP
Thomas Graf
 
PCCC24(第24回PCクラスタシンポジウム):筑波大学計算科学研究センター テーマ2「スーパーコンピュータCygnus / Pegasus」
PCCC24(第24回PCクラスタシンポジウム):筑波大学計算科学研究センター テーマ2「スーパーコンピュータCygnus / Pegasus」PCCC24(第24回PCクラスタシンポジウム):筑波大学計算科学研究センター テーマ2「スーパーコンピュータCygnus / Pegasus」
PCCC24(第24回PCクラスタシンポジウム):筑波大学計算科学研究センター テーマ2「スーパーコンピュータCygnus / Pegasus」
PC Cluster Consortium
 
Inside the Volta GPU Architecture and CUDA 9
Inside the Volta GPU Architecture and CUDA 9Inside the Volta GPU Architecture and CUDA 9
Inside the Volta GPU Architecture and CUDA 9
inside-BigData.com
 
cisco-c9200l-48t-4x-e-datasheet.pdf
cisco-c9200l-48t-4x-e-datasheet.pdfcisco-c9200l-48t-4x-e-datasheet.pdf
cisco-c9200l-48t-4x-e-datasheet.pdf
Hi-Network.com
 
A Library for Emerging High-Performance Computing Clusters
A Library for Emerging High-Performance Computing ClustersA Library for Emerging High-Performance Computing Clusters
A Library for Emerging High-Performance Computing Clusters
Intel® Software
 
How to Design Scalable HPC, Deep Learning, and Cloud Middleware for Exascale ...
How to Design Scalable HPC, Deep Learning, and Cloud Middleware for Exascale ...How to Design Scalable HPC, Deep Learning, and Cloud Middleware for Exascale ...
How to Design Scalable HPC, Deep Learning, and Cloud Middleware for Exascale ...
inside-BigData.com
 
Accelerating TensorFlow with RDMA for high-performance deep learning
Accelerating TensorFlow with RDMA for high-performance deep learningAccelerating TensorFlow with RDMA for high-performance deep learning
Accelerating TensorFlow with RDMA for high-performance deep learning
DataWorks Summit
 
PLNOG 8: Ivan Pepelnjak - Data Center Fabrics - What Really Matters
PLNOG 8: Ivan Pepelnjak - Data Center Fabrics - What Really Matters PLNOG 8: Ivan Pepelnjak - Data Center Fabrics - What Really Matters
PLNOG 8: Ivan Pepelnjak - Data Center Fabrics - What Really Matters
PROIDEA
 
Seminar Accelerating Business Using Microservices Architecture in Digital Age...
Seminar Accelerating Business Using Microservices Architecture in Digital Age...Seminar Accelerating Business Using Microservices Architecture in Digital Age...
Seminar Accelerating Business Using Microservices Architecture in Digital Age...
PT Datacomm Diangraha
 
Ad

Recently uploaded (20)

Linux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded DevelopersLinux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded Developers
Toradex
 
Mobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi ArabiaMobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi Arabia
Steve Jonas
 
Build Your Own Copilot & Agents For Devs
Build Your Own Copilot & Agents For DevsBuild Your Own Copilot & Agents For Devs
Build Your Own Copilot & Agents For Devs
Brian McKeiver
 
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfSAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
Precisely
 
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-UmgebungenHCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
panagenda
 
Electronic_Mail_Attacks-1-35.pdf by xploit
Electronic_Mail_Attacks-1-35.pdf by xploitElectronic_Mail_Attacks-1-35.pdf by xploit
Electronic_Mail_Attacks-1-35.pdf by xploit
niftliyevhuseyn
 
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Impelsys Inc.
 
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell
 
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxIncreasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Anoop Ashok
 
What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...
Vishnu Singh Chundawat
 
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In FranceManifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
chb3
 
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsTechnology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data Analytics
InData Labs
 
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
SOFTTECHHUB
 
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfThe Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
Abi john
 
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath MaestroDev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
UiPathCommunity
 
Procurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptxProcurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptx
Jon Hansen
 
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveDesigning Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
ScyllaDB
 
How Can I use the AI Hype in my Business Context?
How Can I use the AI Hype in my Business Context?How Can I use the AI Hype in my Business Context?
How Can I use the AI Hype in my Business Context?
Daniel Lehner
 
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPathCommunity
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Linux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded DevelopersLinux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded Developers
Toradex
 
Mobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi ArabiaMobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi Arabia
Steve Jonas
 
Build Your Own Copilot & Agents For Devs
Build Your Own Copilot & Agents For DevsBuild Your Own Copilot & Agents For Devs
Build Your Own Copilot & Agents For Devs
Brian McKeiver
 
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfSAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
Precisely
 
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-UmgebungenHCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
panagenda
 
Electronic_Mail_Attacks-1-35.pdf by xploit
Electronic_Mail_Attacks-1-35.pdf by xploitElectronic_Mail_Attacks-1-35.pdf by xploit
Electronic_Mail_Attacks-1-35.pdf by xploit
niftliyevhuseyn
 
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Impelsys Inc.
 
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell
 
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxIncreasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptx
Anoop Ashok
 
What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...
Vishnu Singh Chundawat
 
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In FranceManifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
chb3
 
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsTechnology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data Analytics
InData Labs
 
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
SOFTTECHHUB
 
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfThe Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
Abi john
 
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath MaestroDev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
UiPathCommunity
 
Procurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptxProcurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptx
Jon Hansen
 
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveDesigning Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
ScyllaDB
 
How Can I use the AI Hype in my Business Context?
How Can I use the AI Hype in my Business Context?How Can I use the AI Hype in my Business Context?
How Can I use the AI Hype in my Business Context?
Daniel Lehner
 
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPathCommunity
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 

SERC, IISc CRAY PetaFLOPS System

  • 1. May 11, 2015 SERC Petascale System
  • 2. SERC  Providing computing facility to Institute users from 1970.  State-of-the-art facility for parallel computing with high performance storage along with a range of software application domains.  Balance between capacity and capability computing to meet diverse requirements of users.
  • 3. SERC Petascale System  Cray-XC40, an MPP class machine  Petascale compute capability with ◦ CPU Clusters with 33024 Intel-Haswell processor cores achieving more than 900 TFLOPS ◦ 44 node GPU clusters with Intel Ivybridge processor and Tesla K40 GPU, delivering 52 TFLOPS ◦ 48 node Intel Xeon Phi Cluster (5120D) giving 28 TFLOPS
  • 4. Compute Blade : Each having 4 nodes or 96 cores Chassis : 16 blades; 64 nodes; No cables Group: 6 Chassis and 384 nodes Electrical network cables System 4 Groups Active Optical cables SYSTEM BUILDING BLOCKS
  • 5. Aries NOC Connects nodes on a blade 128Gbps Rank 1 Network Backplane connection through blade Connects nodes on a chassis 157.6Gbps Rank 2 Network Passive Electrical cables Connect multiple chassis All-to-all chassis connection 157.6Gbps Rank 3 Network Optical cable connection to multiple cabinets All-to-all cabinet connection on a Dragonfly topology 43Gbps SYSTEM INTERCONNECT
  • 7. Parallel File System 2 Peta Byte of Direct Attached parallel storage with RAID6 from DDN Cray’s Parallel Lustre File System 28 GBps Read and 32 GBps Write performance
  • 8. Installation & Commissioning of the Petascale System
  • 9. Petascale System: Status  Operational from Jan. 15, 2015  System Acceptance by Feb. 19, 2015  60+ users  A few show case capability applications
  • 10. Unsteady Aerodynamic Simulation  Dynamic Ground Effect: Unsteady simulation of entire landing sequence of a high lift wing  Problem size: 36 Million volume grid & simulation of 11 secs of the landing sequence  System : 8 days on XC40 using 10000 Xeon cores (for a time step of .001 sec)
  • 11.  Observation: A critical number of supernovae required to maintain an over-pressured bubble for 10s of Myr, for a given density and spatial separation between supernovae. These superbubbles should break out of galaxies and suppress global star formation.  PLUTO hydrodynamics code to simulate supernovae using 5123 and 10243 simulations.  Application scales upto 12,000 cores. Simulating Overlapping Supernovae

Editor's Notes

  • #3: SERC has been providing the state-of-art computing facility to the Institute community. The facility enables users to access specialized parallel computing systems with high performance storage, using wide-range of application software. SERC strives to meet the varied computing demands ranging from capability to capacity needs. The facility is operated round-the-clock, 365 days and is supported by uninterrupted power and air-conditioning.
  • #4: In its endeavor to bring the best-in-class computing, SERC has recently procured the Cray-XC40 system consisting of pure CPU or accelerator based computing. This system has three major computing clusters, namely Intel-Haswell processor based CPU cluster with sustained HPL performance of around 950 TFLOPS from 1376 nodes. Nvidia K40 GPU card based accelerator nodes with a sustained performance of 52TFLOPS from 44 nodes. Intel Xeon-Phi co-processor based accelerator nodes with a sustained performance of 28TFLOPS from 48 nodes. These put-together deliver a performance of more than 1000 TeraFLOPS. The cluster components are seamlessly tied with the Aries interconnection fabric on a dragonfly topology, delivering the fastest bisection bandwidth to applications.
  • #5: The XC40 system is built using scalable system building blocks. The basic unit of the system is called a compute blade that is composed of four compute nodes. Sixteen compute blades integrate on a back plane to compose a system Chassis. Three chassis units form a cabinet. SERC’s petascale system is built using eight cabinets.
  • #6: The system building blocks are tied up using the 48-tiled Aries network-on-chip interconnect. One Aries NOC connects the four compute nodes on a blade. These blades are the connected using the same Aries NOC onto a backplane forming the Rank-I communication layer within a chassis. Two cabinets chassis’ are inter-connected on an all-to-all basis using passive electrical cables on the Rank-II communication layer. Two cabinets form a group and multiple groups are interconnected on an all-to-all mode using optical cables. The system uses dragonfly inter-connection topology.
  • #7: The system software is built on Cray’s customized Linux operating system The XC40 systems hosts a whole range of parallel program development tools and architecture specific compilers and parallel scientific and mathematical libraries.
  • #8: The machine also hosts the largest directly attached high-speed parallel storage of 2PB.
  • #9: Lets look at some images in the journey of the installation and commissioning of CRAY at SERC between the 13 and 15th december
  • #10: The machine is operational from January 15 of this year. It has got more that 60 users currently; We will demonstrate a few show case applications that exploit the capability of this large system;
  • #11: This user group simulates the entire landing sequence of a high life wing, which requires simulation of complex physics for large grids. They have simulated 36 million volume grid for more than 11 simulation seconds of landing, at a granularity of 1 millisecond, using 10000 cores. The three distinct phases -- gliding and flaring where the wind incidence increases & post-touch down phase where the wind incidence is lost while on ground roll. The movie depicts trailing vortices off the wing-tip and part-span flap end. One can notice the vortex intensifying during the flaring operation.
  • #12: In this work the user group has simulated the overlap of supernovae that forms a hot, over-pressured Bubble using the public domain PLUTO hydrodynamics code using large machine configuration, Currently upto 12,000 cores, which is roughly one-third of the system.