Benefits of an Agile Data Fabric for Business Intelligence
Download as PPTX, PDF1 like917 views
An agile data fabric powered by Brocade networking solutions provides benefits for business intelligence initiatives. It allows data and applications to be deployed flexibly across distributed infrastructure in a way that is automated, intelligent, and optimized for performance. Case studies demonstrate how Brocade fabrics have enabled multi-tenant data lakes and analytics platforms by integrating diverse storage, computing, and networking resources.
Benefits of an Agile Data Fabric for Business Intelligence
- 1. Benefits of an Agile Data Fabric for Business Intelligence © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC.
- 2. We are the Data Interconnect for the worlds top Datacenters © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. IP Fabric AutomationGen6Mobility RoutingSoftware 2
- 3. Leading from Data Center to Network Edge Positioned where the world is going • New mobile edge • New telco edge • New enterprise edge • Public/private cloud • 5G • IoT © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. 3 # 1Hospitality Wi-Fi # 2 Data Center Networking # 3 Enterprise Wireless LAN # 3 Enterprise edge networking in the U.S. & EMEA # 1Storage Area Networking # 1Service Provider Wi-Fi
- 4. Brocade Is Building a New Networking Company To enable businesses to thrive in the Digital Business Era © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. 4 Switching & Routing Software-based Virtualization & Control Analytics Mobile Networking Wireless EDGE DATA CENTER Fabrics Storage Networking IP Fabrics Campus Products vRouter vADC SDN Controller Network Automation Machine Learning NVA AMP Security vEPC MEC WLAN Small-cell
- 5. Innovative Always optimized IT-as-a-Service Automated Optimized for application and cloud access Today Build the network you need Agile Optimized for spend, speed, and efficiency Intelligent Optimized for opportunity STORAGE FOUNDATION FABRICS ANALYTICS NFV SDN CONTROLLER MACHINE LEARNING SECURITY BOLTED ON PERVASIVE SECURITY Helping Our Customers on This Journey to the Agile Data Fabric © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. 5 Hyperscale cloud
- 6. Benefits of an Agile Data Fabric for Business Intelligence © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC.
- 7. An Industry in Transition © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. 7 MapReduce HDFS, Reliable Storage platform Hadoop 1.0 Yarn and Container management. Rapid ecosystem growth Multi-Purpose Platform Real Time Processing Explosive Ecosytem Interactive, Streaming Delivery IT Relevance Gap Expectations 2013 2016 IoT > $1.7T Cloud spending > $500B Mobile phones > 2.1B > 1.5B people affected by data hacks By 2020 The biggest risk is to do nothing! 2011
- 8. The Ecosystem Customer Considerations • Existing + New systems • Partnerships • Connectivity – Scale – Performance – Automation – Local, multi-site & external -aaS © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. 8
- 9. The Data Silo Lifecycle Agile Data Fabric to Break the Cycle © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. Strategic vision Proof of Concept Execution Vision Focused BI Goals Data Silo
- 10. The Data Silo Lifecycle Agile Data Fabric to Break the Cycle © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. Execution Vision BI based on a Agile Data Fabric
- 11. © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. 11 Innovation & Intelligence Intelligent large dataset mobility • Real time network visibility • Arizona State use case Flexible, Agile, Open at Scale Joint CSC design and architecture • Multi-datacenter Solution • Open Scalable Flexible Architecture Modular Multipurpose Multi-Purpose Data lake • Hitachi Data Systems HSP • EMC Federated Datalake Data Fabric Case Studies
- 12. • Hitachi Data Systems HSP • EMC Federated DataLake Modular & Multipurpose © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. 12
- 13. Enterprise Data Lake HSP - Most flexible and efficient on-premise architecture - Persistent and managed data layer - Fast direct data ingest - Ready-to-go data refinery appliance - Run multiple applications concurrently in VMs - Data-in-place analytics reduces copies Faster time-to-value, flexible and secure Hitachi Data Systems HSP Comparing Big Data Infrastructure Choices © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. 13 Bare-Metal DIY Hadoop - Inexpensive whitebox hardware - OpenSource software - DIY projects can be complicated - Test case is small - Underestimate effort - Management and data protection overhead - Projects often fail DIY project on a tight budget – often fails! Public Cloud - Fastest way to get up and running for specific workloads - Easy-to-use and provision - Transparent Hardware and Software costs - Fine for specific applications, but not flexible - Network bottleneck Fast TTV and initially cheaper, but not flexible Integrated Brocade ICX
- 14. Big Picture: The HDS Big Data Infrastructure Portfolio Data Lake PDI PDI PDI PDI Enterprise Hyper-Converged Scale-out PDI in KVMs Archive Regulatory Compliance Analytics Hadoop/Spark NoSQL Elastic SearchPBA
- 15. 15 Hitachi’s HSP with ICX 7750 Top of Rack • 2 Brocade ToR per rack ‒ 40G QSFP • 20 nodes per rack ‒ (cluster 5 -100 nodes) Standard PDUs ▪ 10/40 GbE Distributed switch ▪ Industry leading port-density ▪ Leading price/performance ▪ Low latency ▪ Cut-through ▪ Reliable, scalable, HA, efficient Start small ..and scale as you go
- 16. 16 • 2 Brocade ToR per rack ‒ 40G QSFP • 20 nodes per rack ‒ (cluster 5 -100 nodes) • Up to 5 racks Start small ..and scale as you go HSP: The Network Matters for Hyper Scale-out Standard PDUs Network Layout with Brocade ToR
- 17. The ICX Family 17 • 48-Port SFP+ 10 GbE • 6+6-Port QSFP+/40 GbE ICX7750-48FKey Highlights & Differentiators • Unprecedented port density: 96×10 GbE /32×40 GbE per unit or 48×10 GbE with up to 12×40 GbE uplinks/stack ports • Market-leading stacking scalability up to 12 units per stack • Longer stacking distance: 40 GbE (QSFP-LR) • Chassis performance (~ 5.7 Tbps aggregate stacking bandwidth) • Hitless Failover within the stack • SDN- Openflow 1.0 and 1.3 with hybrid mode • Full IPv4 and IPv6 routing support, includes BGP and VRF • Extended operating temp (up to 50°C) • Common Criteria and FIPs certification • 48-Port RJ-45 10 GbE • 6+6-Port QSFP+ (six optional) ICX7750-48C • 26 to 40 GbE ports QSFP+ • 32 to 40 GbE with optional module ICX7750-26Q • Quad-core 1.5 GHz CPU 8 GB system memory, 2 G Flash, USB storage • Optional 6×40 GbE QSFP • Redundant power supplies and fans with front-to-back or back-to-front airflow All Brocade ICX7750 Models
- 18. 18 ISILON ECS © Copyright 2015 EMC Corporation. All rights reserved. EMC Data Lake Foundation
- 19. IP Networks for Data Lakes • Deliver predictable performance and unmatched resiliency for business-critical applications • Provision network capacity with minimal intervention and virtually no learning curve • Configure and manage multiple switches in the fabric as a single logical element • Provide storage-class resiliency with non- disruptive failover after a path or link failure © 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. CONFIDENTIAL 19 NAS iSCSI Flash
- 20. Federation Business Data Lake Fully Engineered Solution © 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. COMPANY PROPRIETARY INFORMATION 20 ISILON ECS DSSD D A T A L A K E S T O R A G E F O U N D A T I O N VNXXTREMIO D A T A M A N A G E R D A T A I N D E X I N G E N G I N ED A T A I N G E S T E N G I N E S T O R A G E W O R K F L O W S & A U T O M A T I O N P I V O T A L B I G D A T A S U I T E A N A L Y T I C S M A N A G E R A N A L Y T I C S A N D D A T A L A Y E R I N T E R F A C E A N A L Y T I C S W O R K L O W S & A U T O M A T I O N V M W A R E V C L O U D S U I T E P I V O T A L C L O U D F O U N D R Y D A T A & A N A L Y T I C S C A T A L O G A P P S A P P S Connectrix VDX-6740B
- 21. • Multi-Site Secure Solution with CSC • Fabric Design options Flexible, Agile & Open © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. 21
- 22. Solution Overview Key Drivers • End customer data collection and analysis • Integrated Applications • Hadoop, VMware, PostgresDB, Flume • Open infrastructure • SAN, Load balancing, Checkpoint, Scale out network Design Considerations • Fabric & IP Overview • Storage Services • Management Overview • Multi-Tenant Deployment • Futures Design Options for multi- multi-tenant growth • Virtual Fabrics • L3 VRFs • Virtual Firewalls • Virtual Load Balancers • Storage © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. 22
- 23. SYSTEM INTEGRATOR: DC2SYSTEM INTEGRATOR: DC1 Familiar Design :: Big Data Objective © 2015 Brocade Communications Systems, Inc. Company Proprietary Information 23 Internet Secure MGT Access 175Mb/s Protected Internet Router Checkpoint 4800 Perimeter Instance 4Mb/s 1Gb/s User Cell Phone (Internet Connected) CUSTOMER DC Existing Apps & Infrastructure TRUSTED NETWORK tcServer Farm Physical/Virtual Hadoop Farm Physical/Virtual SQL Farm Physical/Virtual Rabbit/MQ Farm Physical/Virtual F5 LTM Load Balancers TRUSTED NETWORK tcServer Farm Physical/Virtual Hadoop Farm Physical/Virtual SQL Farm Physical/Virtual Rabbit/MQ Farm Physical/Virtual F5 LTM Load Balancers DMZ Trusted Network Segments MGT Network DMZ Replication WAN MPLS 175Mb/s 4Mb/s 1Gb/s Checkpoint 4800 Protected Internet Instance Brocade 6610 Out of Band MGT Checkpoint 4800 WAN Instance (FW & UPSEC Tunnel) Brocade 8770 Core/Agg Trusted Network Segments Checkpoint 4800 WAN Instance (FW & UPSEC Tunnel) Brocade 8770 Core/Agg Checkpoint 4800 Protected Internet Instance Brocade 6610 Out of Band MGT Protected Internet Router Checkpoint 4800 Perimeter Instance • Redundant Datacenters (replication) • BI in both • Trusted zones • Integrated with customer datacenter
- 24. Designing for Flexibility © 2014 Brocade Communications Systems, Inc. CONFIDENTIAL—For Internal Use Only 24
- 25. Brocade Data Center Fabrics and Network Virtualization Options All Built on Brocade VDX Switches and Network Operating System Architectural Flexibility: DC Fabrics VDX 6740 VDX 6940 VDX 8770-4 VDX 8770-8 Layer 2 Scale-out: up to 10,000 Servers VDX VDX Automatic self forming fabric without spanning tree.. Topology agnostic with up to 8K virtual fabrics.. Entire fabric managed from a single IP address. VDX VDX VDX VDX Layer 3 Scale-out: up to 500,000 Servers VDX VDX VDX VDX VDX VDX VDXVDX Controller-less Network Virtualization using industry standard BGP-EVPN, and VxLAN. Includes ZTP, programmatic APIs.
- 26. LEAFSPINE 1 GbE/10 GbE/10 GBASE-T optimized with 40 GbE uplinks Brocade VDX Switches Complete breadth of portfolio © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. COMPANY PROPRIETARY INFORMATION Brocade VDX 6740 Family • 24MB on chip buffer • 750 nSec latency Brocade VDX 6940 Family • 25MB on chip buffer • 750 nSec latency Brocade VDX 8770 Family 10 GbE/40 GbE optimized with 100 GbE uplinks 10 GbE/10 GBASE-T/40 GbE/100 GbE optimized modular system Brocade VDX 6940-36Q Brocade VDX 6940-144S Brocade VDX 6740 Brocade VDX 6740T Brocade VDX 6740T-1G SCALABILITY Brocade VDX 8770-4 Brocade VDX 8770-8 Ultra deep buffers 3.5 uSec latency
- 27. Brocade VCS Fabrics Evolve Data Centers Continual evolution with VCS fabrics © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. COMPANY PROPRIETARY INFORMATION Lower OpEx Greater network utilization Faster time to application deployment Efficient Automated Cloud-Optimized • All links fully active • Multipathing at all layers: Layers 1, 2, and 3 • IP storage-aware • Low latency • Automatic provisioning • Zero-touch VM discovery, Layer 2/Layer 3 configuration, and mobility • Self-forming trunks • Manage many switches as a single logical device • Multitenancy at scale with Brocade VCS Virtual Fabric and VMware NSX • Scale out non-disruptively • Orchestrated via OpenStack • DevOps support
- 28. 33% 33% 33% Brocade VCS Multipathing at Multiple Layers Dramatic increases in network utilization and reliability Feature Layer 3: Fabric load balancing across multiple Layer 3 gateways Improved scalability and resiliency Benefit Layer 1: Trunking with frame striping Near-perfect load balancing across all links in a trunk group Layer 2: Equal Cost Multi-Path (ECMP) All links utilized with flow-based load balancing © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. COMPANY PROPRIETARY INFORMATION Layer 3 Core Brocade VCS Fabric
- 29. Big Data Design Topology © 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 29 LEAF COMPUTE IP Routing Core Start Small and Scale Out LAG
- 30. Big Data Design Topology © 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 30 LEAF COMPUTE IP Routing Core Start Small and Scale Out LAG LAG
- 31. Big Data Design Topology © 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 31 LEAF COMPUTE IP Routing CoreStart Small and Scale Out LAG LAGLAG LAG SPINE Edge services rack
- 32. IP/MPLS Connectivity Data Center 1 LEF BGP-EVPN OVERLAY EDGE LEAF Data Center 2 BGP-EVPN OVERLAY EDGE LEAF Data Center3 BGP-EVPN OVERLAY EDGE LEAF Simplified DCI Solution • Independent of DC Fabric Underlays • Extend VLANs between DC or between fabrics within a DC • High Performance across the WAN • Offloads core router processer cycles Brocade BGP-EVPN Data Center Interconnect (DCI) Simplified DCI across multi-vendor and multi-fabric underlay networks
- 33. Getting more out of the network • Arizona State University, United States Innovation & Intelligence © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. 33
- 35. • Improved Operational Efficiency • Increased Agility / Dynamic Elasticity • Programmable, Pluggable Architectures • Low Latency / High Bandwidth / High Availability • Hybridized Cloud Model (Software Defined Datacenter - SDN) • Improved Time to Research! Key University Needs
- 36. Brocade Flow Optimizer Enables Research Environment Based on Industry-Leading SDN Capabilities • SDN to support high- performance research innovation • A research network environment as foundation to attract new development opportunities ASU Needs Brocade Solution • Complete, scalable HPC and L2 firewall bypass solution: – MLXe, SDN Controller and Flow Optimizer • High Availability and Resiliency, IPv4, IPv6 and OpenFlow 1.3 • Open networking: – OpenDayLight Why Brocade Brocade SDN Controller Brocade Flow Optimizer sFlow Inband Internet 2 100G Connections ESNet DTN 40G Connection ASU Campus Network 10G Connections Fortinet FW 100G Connections 40G 10G 10G 100G 100G 100G 100G 100G 100G MLXeMLXe MLXe MLXe MLXe Science DMZ L2 FW Bypass 40G Fortinet FW 40G Connections http://www.brocade.com/content/dam/common/documents/content-types/success-story/brocade-arizona-state-university-ss.pdf
- 37. © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. 37 Innovation & Intelligence It’s the information age and research institutions processing massive datasets need solutions to move more efficiently. Selective SDN acceleration of good flows makes Big Data analytics possible. Flexible, Agile, Open at Scale Planned users are as important as planned uses. Data is distributed and large scale automation may be needed. Some customers design Open, Scalable Data Fabrics and develop their own automation. Modular Multipurpose Lessons learned tell us to plan the growth, be extensible, and build for changing needs. Recap: Data Fabric Case Studies
- 38. Thank You © 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. INTERNAL USE ONLY AD 38