Brkarc 3465
Brkarc 3465
Mahesh Nagireddy
Technical Marketing Engineer
CCIE R&S
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 3
BRKARC-3465
Mahesh Nagireddy
Technical Marketing Engineer
CCIE R&S
Cisco Spark
Questions?
Use Cisco Spark to communicate
with the speaker after the session
How
1. Find this session in the Cisco Live Mobile App
2. Click “Join the Discussion”
3. Install Spark or go directly to the space
4. Enter messages/questions in the space
cs.co/ciscolivebot#BRKARC-3465
© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
Session Objectives
What we will cover…
• Catalyst 6807-XL
• Catalyst 6880-X
• Catalyst 6840-X
• Chassis Architectures
• Supervisor Engines
• Ethernet LAN Modules
• Basic Packet Walks
We will NOT cover…
• C6K Service Modules
• Virtual Switching System
• Instant Access
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 6
Agenda
Background
History of C6K
Evolution of Catalyst 6800
The 4 Basic Elements
C6807-XL
C6880-X
C6840-X
Packet Walks
Cisco Catalyst 6500/6800 Series
A history of Innovation & Investment Protection
Years of C6800-SUP6T
Innovation MSFC6
VS-S2T-10G PFC4-E
MSFC5 6T Fabric
WS-SUP720/ VS-S720-10G
PFC4
WS-SUP32 MSFC3
2T Fabric
MSFC3/MSFC2A PFC3C
WS-SUP2 PFC3A/B 720G Fabric
MSFC2 720G Fabric
2016
WS-SUP1/1A PFC2 or 32G Bus
2015
MSFC1/2
256G SFM 2013
PFC1
or 32G Bus 2011
32G Bus
2007
2005
2003
2001
1999
• 4 Fixed Form Factor Models • Semi Modular 5-Slot Chassis • Fully Modular 7-Slot Chassis
• Only 2 RU height (smaller than 6503-E) • Only 4.5 RU height (smaller than 6504-E) • Only 10 RU height (smaller than 6506-E)
• 16 or 32 x 1/10GE Base Models • 80 to 220Gbps per Half Slot capable • 80 to 440Gbps per Slot capable
• 24 or 40 x 1/10GE + 2 x 40GE Models • 16 to 80 x 1/10GE Port Density • Supports all Sup2T enabled Modules
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 9
Catalyst 6800 Series
The 4 Basic Elements
Catalyst 6800
Series
The Back-Plane (Fabric), Data-Plane ASICs for Ports,
where Packets are transferred receives and transmits Packets
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 10
Catalyst 6800 Series
4000+ Catalyst 6500 Features
MPLS, VPLS & EVN Next-Gen Solutions Security & QoS
15 Year MPLS Maturity Instant Access Controller MacSec & NDAC DHCP Snooping
L2 VPN L3 Campus LISP
SGT & SGACL Dynamic ARP Inspection
L3 VPN Software Defined Access
L2/L3 VPN over mGRE SDN - OpenFlow/APIC Ingress/Egress ACL SPAN with ACL
MPLS TE Smart Install Director
Time-Based ACL Identity 2.0
VPLS/A-VPLS/H-VPLS
Label Switch Multicast VSS & HA ACL Statistics ACLQoS Classification
MACsec over EoMPLS
10 Year VSS Maturity
MPLS at Access with I-Sat MACsec over VSL
Catalyst 6800 Port Security Marking (DSCP/COS)
VRF-Lite
1G/10G/40G VSL Series IPv6 FH Security Microflow Policing
EVN SSO / NSF & NSR ACL Atomic Commit/Dry Run Advanced CoPP
VRF-Aware Multicast BGP PIC & IP FRR
VRF-Aware NetFlow BFD on SVI & MEC IPv6 uRPF IPv6 VLAN ACL
Management &
IPV4 Unicast IPV4 Multicast Large Tables & Scalability Rich Media
Services
OSPFv2/v3 IGMPv3 & MLDv2 Snooping in HW IPv4 Routing Capability 256K-2M Flexible NetFlow WCCPv3
OSPFv3 VRF-Lite PIM-SM “Dual-RPF” in HW
VRF-Aware Unicast PIM-DM, PIM-Bidir Multicast Routes (IPv4) 64K
Egress NetfFow PBR IPv4/IPv6
IP Tunnel HA L3 PIM Snooping
Number of Adjacencies 1M
BFD SVI-GRE PIM Register in HW Sampled NetFlow NAT/PAT
BGP PIC mVPN, MSR, mcast BFD MAC Addresses 128K
NDE (Full & Sampled) GRE/mGRE
IPV6 Features ECMP (v4 and v6) 16
Video Monitoring ERSPAN
Security & QoS ACL 64K-256K
IPv6 in IPv4 Tunnels,
IPv6 - IPv4 HW Parity Mediatrace GOLD
VRF-Aware IPv6 Tunnels
Flexible Netflow 128K-1M
OSPFv3 VRF PE-CE BGPv6, IS-ISv6
Metadata QoS Cisco ISE
MPLS Label Push/Pop in 1pass 5/3
MLD, MLD Snooping 6VPE and 6PE
Aggregate Policers 8K Multicast Service Reflect (MSR) Cisco Prime
IPv6 Mcast HA PIM Sparse Mode (PIM-SM)
IPv6 SLA, TCL, LLDP IPv6 QoS, PACL, RACL Number of VPNs 16K Multicast VPN (MVPN) Mini Protocol Analyzer
© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
C6807-XL
Chassis & Power
Catalyst 6807-XL For Your
Information
Up to 4 (N+1)
3000 Watt PSU 4 x 220VAC
Redundancy Power Inputs
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 13
Catalyst 6807-XL For Your
Information
Mechanical View
Power Power
Supplies Inputs
*SUP Only
**SUP/Service Module
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 14
Catalyst 6807-XL
Environmental Overview Height
17.5 in (10RU)
High Efficiency
4500 RPM
Redundant Fans
Depth
18.10 in
Platinum Efficient
3000W
Power Supplies
Width
17.36 in
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 15
Catalyst 6807-XL Air Flow:
Side to Side
Fan Redundancy & Air Flow
New
Locking
Mechanism
Fan-Tray LEDs
Individual Fans
(3 columns of 3) Fan-Tray Handle
Front-Service
Fan-Tray
Fan-Tray Highlights:
• Has 9 variable-speed High-Efficiency Fans (850 CFM)
LED Color Status Description
• Supports 4 speeds between 3000 & 4500 RPM per Fan FAN Solid Fan-Tray OK
• Capable of cooling Slots operating up to 800W per Slot FAN Solid Fan-Tray Fault
• Can still operate with up to 3 individual Fan failures ID Solid Identifies Fan-Tray
Dual Variable
Speed Fans
AC
Power Supply ONLY
Status LEDs
Power Switch
PSU 4 AC Input 3
PSU Lock
PSU 3 AC Input 4
& Ejector
PSU 1 AC Input 2
PSU 2 AC Input 1
Power Supply Highlights:
LED Color Status Description
• Max output is 3000W @ 220V (or 1300W @ 110V)
IN Solid Input OK
• Up to 92% Power Efficiency @ 50-100% of load
IN Blinking Under-Current
• Power Hold-up Time is ~20 msec @ 100% load OUT Solid Output OK
• Dual “Front to Back” Variable-Speed Cooling Fans OUT Blinking Over-Current
• Supports Combined or Redundant (N+1) mode Fault Solid Malfunction
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 17
Power Supply Redundancy For Your
Information
Catalyst 6807-XL
Catalyst 6807-XL Can Utilize Four Power Supplies in Either Redundant or Combined Mode
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 18
C6807-XL
Supervisor Architectures
Supervisor Engine 2T
Bridging the Catalyst 6500 & 6800
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 20
Supervisor 2T
Block Diagram
Shared Bus Connector
Local-Bus
Fabric Connector
PFC4 (XL)
2Tbps 20G Fabric Bus
ASIC 1 Layer 3 Engine
Fabric ASIC Replication
ASIC Layer 2 Engine MAC
28 x 40G Channels 20G Fabric
ASIC 0
Fabric
Bootdisk MSFC5 Replication ASIC
DRAM 1GE FDX
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 21
NEW
Supervisor Engine 6T Scalability &
Taking Catalyst 6800 to the Next Level Performance
SUP2T SUP6T
6Tbps
Switch Fabric PFC4-E (XL) 6807-XL Bandwidth 220G /Slot 440G /Slot
Forwarding Engine
6500-E Bandwidth 80G /Slot 80G /Slot
1.5Ghz 2.5Ghz
RP CPU MPC8572 X86 Dual Core
2 - 4GB 4 GB
Memory DDR2 667Mhz DDR3 1333Mhz
2 x 20G 2 x 20G
Bootdisk
eUSB
Inband
PFC4E Inband
(XL)
D
D
DD
DD R Control-Plane
R3
DD
R33 CPU 2.5 GHz FIRE D D FIRE
R3 D D
ASIC 0 R
3
R
3 ASIC 1
4GB
2GB 2GB
RTC
1GE Inband
40G 40G
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 23
MSFC = Multilayer Switch Feature Card
The “Software” Control Plane for the System, where IOS runs…
MSFC – Control-Plane Processor
The combined Control-Plane Processor combines all L2 & L3+ system functions
Bootdisk
Processor Run Layer 3 & User Interface functions:
• System management via Console,
SP RP Telnet/SSH, SNMP, TCL, etc.
DRAM Functions Functions • L3 features like HSRP, OSPF, BGP,
MPLS, PIM, etc.
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 25
Multilayer Switch Feature Card
Sup2T - MSFC5 Recap
• MSFC5 Control-Plane
• Combines functionalities of
the Switch Processor (SP) and
the Router Processor (RP)
• 1.5GHz Dual Core PPC CPU
• 2 - 4GB DDR2 DRAM
• Internal Bootdisk & External Disk0
Compact Flash File System
• Built-in Connectivity Management
Processor (CMP) RJ45 Port
• Serial Console via RJ45 or USB
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 26
NEW
Multilayer Switch Feature Card
Sup6T - MSFC6 Introduction
• MSFC6 Control-Plane
• Integrated onto Baseboard
• Same behavior as MSFC5
• Higher Performance & Scale
• 2.5GHz Dual Core IBC CPU
• 4GB DDR3 DRAM
• Internal Bootdisk & External Disk0
USB File System
• Built-in Out-of-band Management
RJ45 / SFP Port
• Serial Console via RJ45 or USB
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 27
For Your
MSFC3 vs. MSFC5 vs. MSFC6 Information
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 28
PFC = Policy Feature Card
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 30
NEW
Policy Feature Card 4 Also applies to DFC4
Sup6T - PFC4-E Introduction
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 31
Policy Feature Card 4
Block Diagram
Contains CEF IPV4, IPV6 Contains location of
prefixes & MPLS entries flow in Netflow Table
FIB TCAM Netflow TCAM
Contains several key
Contains Layer 2 rewrite
Netflow Table packet fields for flow
information & pointers
Adjacency Table
Collection of NF
Collection of ADJ Netflow Statistics
statistics for each
Adjacency Statistics
Layer 3+ statistics for each
active flow
active flow
Forwarding LIF Map Table Contains Logical
Interface Mapping info
Exception Table Engine
Contains table of RPF Map Table Table of Src-Port info
“Exception” cases for Multicast & uRPF
& action to take
Classification ACL Classification ACL
Table #1 Table #2
Contains the Ingress Contains the Egress
ACL entries (128K) Contains the actual LIF ACL entries (128K)
Database entries
128K CAM contains
MAC address table
CAM Table LIF Table
Layer 2
ACE Counters
Forwarding Engine
LIF Statistics
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 32
*also applies to each DFC4
STEP 2 - The Header is merged with IFE result and passed to the “OFE” pipeline, which does Egress Security, QoS & NetFlow
processing
IFE Process
OFE Process
Headers 8: Rewrite 7: Egress 6. Egress 5: Egress
To L2 Engine Result QoS NetFlow ACL
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 33
For Your
Information
Up to 1M (XL)
Netflow Table Up to 256K (XL) Up to 256K (XL)
(Ingress 512K : Egress 512K)
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 34
For Your
Information
RPF Interfaces 2 2 16
Native VPLS No No Yes
VSS No Yes Yes
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 35
Switch Fabric = Hardware Data Plane
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 37
Catalyst 6807-XL Supports For Your
Information
How Sup2T operates up to 220G
per slot
Supervisor2T:
• Using the same XBAR Fabric ASIC
• Supports 1 to 4 channels (per Slot)
• Increased per Channel bandwidth 28 x 55G Channels
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 38
NEW
6T Switch Fabric
Introduction
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 39
Crossbar Switch Fabric
A Closer Look
The Catalyst 6500 & 6800 series eliminated the earlier Bus-based
limits by creating a new “Crossbar” Switch Fabric for its backplane.
A Crossbar Architecture is essentially 2*N busses (where N is the number
of ASICs connected to the Switch Fabric) connected by N*N cross-points.
0
1
2
3
4
5
6
7
0 1 2 3 4 5 6 7
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 40
Crossbar Switch Fabric For Your
Information
More Details
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 41
Crossbar Switch Fabric
Logical Architecture
20G
20G
Supervisor 20G
6800 Series
20G
40G
20G
Service Module Switch 6900 Series
Fabric 40G
40G
20G
40G
New 10G Series
6700 Series
(C6800)
20G 40G
40G
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 42
Switch Fabric Redundancy For Your
Information
High Availability
• When using a redundant Supervisor, 2 fabric channels are connected "back to back" *
• Standby Supervisor uplink connection to Active Supervisor
• Active Supervisor bus connection to Standby Supervisor
• The Standby Supervisor is connected in DFC Mode, with its bus connection disabled
• The redundant Standby Supervisor enables it’s fabric channels to dCEF2T or newer modules for ~50ms failover...
Line Card
Standby
Slot 13 Fabric
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 43
720G vs 2T vs. 6T Fabric For Your
Information
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 44
Catalyst 6807-XL
Fabric Channel Distribution
1 1
2 2
3 Slot 1 3 Current Fabric Channels
4 4
Sup (HA) Fabric Channels
1 1
2 2
3 Slot 2 3 Extra Fabric Channels
4 4
(for future use)
1 1
2 2
3 Slot 3 3
4 4
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 45
C6807-XL
Module Architectures
Catalyst 6500-E & 6807-XL Line Cards
C6800 1G Series
with DFC4-E
* No Support on 6500-E Chassis BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
For Your
Information
All L2 / L3 Forwarding
“decisions” are made by
the PFC and “results” are
returned on the RBUS
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 49
6700 Series (with CFC) For Your
Information
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 50
DFC = Distributed Forwarding Card
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 53
For Your
WS-X6704-10G Information
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 54
For Your
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 55
For Your
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 56
For Your
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 57
For Your
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 58
6700/6800 Series Cards For Your
Information
WS-X6716-10G/T or 6816-10G/T
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 59
For Your
WS-X6908-10G Information
X2-10G-SR/LR CVR-SFP10G
(OneX)
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 60
6900 Series Cards For Your
Information
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 61
For Your
WS-X6904-40G Information
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 62
6900 Series Cards For Your
Information
Fabric Interface Fabric Interface 20G 20G Fabric Interface Fabric Interface
ASIC ASIC ASIC ASIC
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 63
For Your
Catalyst 6500-E & 6807-XL Information
© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
SNMP, Netflow,
Network Analysis with NAM-3 NMAR, Packet Capture
WS-SVC-NAM3-6G-K9
20G Fabric Connector
Memory (24 GB)
SAS Controller
Internal
Hard Disk
(600 GB SAS)
WS-SVC-ASA-SM1-K9
Multi-Gigabit Fabric
• 20G Connection
Multiple Contexts (250)
• High Capacity
• Virtualized interfaces
• Memory for high session counts
• Module-to-module
communications • 24 GB of memory
Dual-Crypto Accelerators
• Hardware Processing Security Service Processors
• Accelerated Virtual Private Networking
• Multi-Services Capable
• Unified Communications Encryption
• Dedicated 64-bit multi-core Processors
• Future-proof Hardware
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 67
C6800-48P-TX Based on
WS-X6848-TX
48 ports of RJ45
• 40Gbps Capacity per Slot
• Single DFC4 for 60Mpps
• Integrated DFC-4A (XL)
• Updated Port ASICs
• New Hardware RFID
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 68
C6800-48P-TX
Block Diagram FIRE = Fabric Interface & Replication Engine
Fabric Fabric
• Improved FIRE & Fabric ASICs ASIC
BACKPLANE INTF
ASIC
• 20Gbps per Fabric Channel 20G
FPGA FPGA 20G
FIRE FIRE
• 20Gbps per FIRE ASIC ASIC ASIC
• 1.2:1 Oversubscribed @ Port ASIC 10G 10G DFC4 10G 10G
Port
• New Port ASIC Port
ASIC
Port
ASIC ASIC
Port
ASIC
PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY
Front
Panel
01-04 05-08 09-12 13-16 17-20 21-24 25-28 29-32 33-36 37-40 41-44 45-48
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 69
C6800-48P-SFP
Based on
WS-X6848-SFP
48 ports of SFP
• 40Gbps Capacity per Slot
• Single DFC4 for 60Mpps
• Integrated DFC-4A (XL)
• Updated Port ASICs
• New Hardware RFID
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 70
C6800-48P-SFP
Block Diagram FIRE = Fabric Interface & Replication Engine
Fabric Fabric
• Improved FIRE & Fabric ASICs ASIC
BACKPLANE INTF
ASIC
• 20Gbps per Fabric Channel 20G
FPGA FPGA
20G
FIRE FIRE
• 20Gbps per FIRE ASIC ASIC ASIC
• 1.2:1 Oversubscribed @ Port ASIC 10G 10G DFC4 10G 10G
Port
• New Port ASIC with more Buffers Port
ASIC
Port
ASIC ASIC
Port
ASIC
PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY
Front
Panel
ODD ODD ODD ODD ODD ODD EVEN EVEN EVEN EVEN EVEN EVEN
01-07 09-15 17-23 25-31 33-39 41-47 02-08 10-16 18-24 26-32 34-40 42-48
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 71
C6800-32P10G
Based on
WS-X6904-40G
32 ports of SFP/SFP+
Up to 4 ports of QSFP*
• 160Gbps Capacity per Slot
• Dual DFC4 for 120Mpps
• 2 x Integrated DFC-4E (XL)
• Support for 1/10GE or 40GE*
• 250 / 500MB Per Port TX Buffers
• VSL and IA capable on all ports
• New Hardware RFID
* with new CVR-4SFP-QSFP adapter cable
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 72
C6800-32P10G
Block Diagram FIRE = Fabric Interface & Replication Engine
4 x 8 SFP+ Port-Groups 40G 40G 40G 40G 40G 40G 40G Backplane
4
• 40Gbps per Fabric Channel Inband
DFC
Inband
4
• 40Gbps per FIRE ASIC
FIRE FIRE
• 2:1 Oversubscribed @ Port ASIC ASIC FIRE FIRE ASIC
ASIC ASIC
• Performance Mode per Port-Group
40G 40G 40G 40G
• 1/10 or 40GE Mode per Port-Group* Port ASIC Port ASIC Port ASIC Port ASIC
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 73
Based on
C6800-16P10G WS-X6904-40G
16 ports of SFP/SFP+
Up to 2 Ports of QSFP*
• 80Gbps Capacity per Slot
• Single DFC4 for 60Mpps
• Integrated DFC-4E (XL)
• Support for 1 / 10GE or 40GE*
• 250 / 500MB Per Port TX Buffers
• VSL and IA capable on all ports
• New Hardware RFID
* with new CVR-4SFP-QSFP adapter cable
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 74
C6800-16P10G
Block Diagram FIRE = Fabric Interface & Replication Engine
FIRE = Fabric Interface & Replication Engine
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 75
C6800-8P10G
Based on
WS-X6904-40G
8 ports of SFP/SFP+
Up to 2 Ports of QSFP*
• 80Gbps Capacity per Slot
• Single DFC4 for 60Mpps
• Integrated DFC-4E (XL)
• 500MB Per Port TX Buffers
• Support for 1 / 10GE or 40GE*
• VSL and IA capable on all ports
• New Hardware RFID
* with new CVR-4SFP-QSFP adapter cable
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 76
C6800-8P10G
Block Diagram FIRE = Fabric Interface & Replication Engine
2 x 4 SFP+ Port-Groups 40G 40G 40G 40G 40G 40G 40G 40G Backplane
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 77
Port ASIC
C6800 10G Modules PHY PHY
For Your
Information
Port-Groups & Performance Mode SFP
01-04
SFP
05-08
C6800-32P10G
Port-Group 1 Port-Group 3
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31
2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32
Port-Group 2 Port-Group 4
C6800-16P10G
Port-Group 1 Port-Group 2
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
C6800-8P10G
Port-Group 1 Port-Group 2
1 2 3 4 5 6 7 8
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 78
Future Proofing with 10G to 40G Adapter
Phase I - 15.3(1)SY w Sup6T
Phase II - 15.3(1)SY1 w Sup2T
C6800-32P-10G
QSFP-40G-SR4
40G Adapter QSFP-40G-CSR4
QSFP-40G-SR-BD
QSFP-40G-LR4
C6800-16P-10G
QSFP-40G-ER4
C6800-8P-10G SFP+
QSFP
Reverse SFP to QSFP Adapter Can Upgrade Your 10G Ports to 40G
© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
Continued Investments Target
June 2017
Introducing New 40G Line Card – 8Px40G for Catalyst 6K 15.5(1)SY
QSFP/40G Optics
QSFP-40G-SR4 QSFP-H40G-AOC3M
QSFP-40G-CSR4 QSFP-H40G-AOC5M
QSFP-40G-LR4 QSFP-H40G-AOC7M
QSFP-40G-ER4 QSFP-H40G-AOC10M
QSFP-40G-SR-BD QSFP-H40G-AOC15M
QSFP-H40G-ACU7M QSFP-40G-SR4-S
QSFP-H40G-ACU10M QSFP-40G-LR4-S
QSFP-H40G-AOC1M QSFP-40G-LR4L
QSFP-H40G-AOC2M
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 81
C6800-8P40G
New High Density 40GE Line Card
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 82
C6800-8P40G
New High Density 40GE Line Card
8 ports of QSFP
• 160Gbps Capacity per Slot
• Dual DFC4 for 120Mpps
• Integrated DFC-4E (XL) x 2
• Supports 40GE only @ FCS
• 1GB / 2GB Per Port TX Buffers
• VSL capable on all ports
• New Hardware RFID
Based on
WS-X6904-40G
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 83
C6800-8P40G FIRE = Fabric Interface & Replication Engine
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 84
C6880-X
Agenda
Background
C6807-XL
C6880-X
Chassis & Power
Fixed Supervisor
Modular Port Card
C6840-X
Packet Walks
For Your
Catalyst 6880-X Information
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 87
For Your
Catalyst 6880-X Information
Mechanical View
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 88
Catalyst 6880-X
Environmental Overview
Selectable
Height In-Reach Depth
8.5” (5RU) 21.4” to 11.7”
High Efficiency
4500 RPM
Redundant Fans
Depth
23.0”
Fan-Tray
Thumb-Screws
Individual
Fan-Tray Handle
Fans
(1 column of 4) Front-Serviced
Fan-Tray Card
Fan-Tray Highlights:
• Has 4 variable-speed High-Efficiency Fans (250 CFM) LED Color Status Description
• Supports 4 speeds between 3000 & 4500 RPM per Fan FAN Solid Fan-Tray OK
• Capable of cooling Slots operating up to 800W per Slot FAN Solid Fan-Tray Fault
Power Supply
Status LEDs AC Input
AC
Power Switch or DC
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 91
For Your
Power Supply Redundancy Information
Catalyst 6880-X
The Catalyst 6880-X Utilizes Two Power Supplies in Either Redundant or Combined Mode
• Each PSU provides ~50% of power needs • Each PSU provides up to 90% of its capacity
• Neither PSU operates at >60% or <40% capacity • Total power available is 180% of a single supply
• Either PSU can power the system on its own • A single PSU may not have power for the system
• This mode is Recommended (Default) • This mode is NOT Recommended
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 92
Catalyst 6880-X
Based on
WS-X6904-40G
Enhanced Control-Plane Scale with new X86 2GHz RP CPU © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
Catalyst 6880-X:
Fixed Supervisor Design
3 Main Components:
• RP Complex
• Baseboard
• Switch Fabric
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 94
Catalyst 6880-X
C6880X-SUP - RP Complex
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 95
Catalyst 6880-X FIRE = Fabric Interface & Replication Engine
C6880-X-SUP – Uplink Ports
20Gbps 20Gbps 20Gbps 20Gbps
SFP SFP Front SFP SFP • 24 or 48MB TX per Port (192MB per MUX FPGA)
01-04 05-08 Panel 09-12 13-16
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 96
Catalyst 6880-X:
Fabric Channel Distribution
Slot 1 Slot 2
1 2 3 4 1 2 3 4 Current Fabric Channels
Extra Fabric Channels
(for future use)
Slot 4
Slot 3
3
3
Clock Frequencies:
Fabric
2
• 6.25 GHz for 40 Gbps
2
1
1
• 7.50 GHz for 55 Gbps
4
1 2 3 4
Slot 5
Baseboard
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 97
Catalyst 6880-X
Based on
WS-X6904-40G
Two Versions Standard (LE) Large Tables Port Speed & Type Number of Ports
FIB Table v4/v6 256K/128K 2M/1M 10/100/1000 Mb/s Copper 16 (GLC-T)
NetFlow Table 512K 1M 1 Gb/s Fiber 16 (SFP)
Security ACL Table 64K 256K 10 Gb/s Fiber 16 (SFP+)
Port Buffering 48MB / Port 48MB / Port 40 Gb/s Fiber 4 (SFP-QSFP)
MacSec, FEX, VSS, LISP, SGT, 1588 Capable on Every Port © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
Catalyst 6880-X FIRE = Fabric Interface & Replication Engine
C6880-X-16P10G Architecture
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 99
C6840-X
For Your
Catalyst 6840-X Chassis Information
High-Level Overview
Catalyst 6000 2 RU 4 Models with
Feature Set (Fixed Chassis)
up to 48 x 10G
(e.g. MPLS/VPLS, Low-Power & Noise
LISP, Multicast, IPv6, High-Efficiency Fans and 12 x 40G
CTS, VSS, FEX)
Powerful X86
Up to 256K FIB 750/1100W (AC/DC)
2.0GHz CPU
Up to 1.5M NetFlow Power Supplies
& 4GB DRAM
Up to 64K ACL
1:1 Redundant PS
(Front Serviceable)
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 101
Catalyst 6840-X For Your
Information
Mechanical View
1 3 5 7 9 11 13 15 17 19 21 23 41 42
Power Supplies
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 102
NEW
Catalyst 6840-X
Environmental Overview
Height
High Efficiency 3.5 in (2RU)
6500 RPM
Redundant Fans
Depth
Width 21.8 in
Platinum Efficient 17.35 in
750 / 1100W
Power Supplies
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 103
Catalyst 6840-X Air Flow:
Front to Back
Fan Redundancy & Air Flow
Fan-Tray
Thumb-Screws
Individual
Fans Fan-Tray Handle
(2 set of 2) Airflow
Intake Vents
Fan-Tray Highlights:
• Has 4 variable-speed High-Efficiency Fans (200 CFM) LED Color Status Description
• Supports 4 speeds between 6500 & 11000 RPM per Fan FAN Solid Fan-Tray OK
• Capable of cooling of ALL 4 C6804-X chassis models FAN Solid Fan-Tray Fault
Power Supply
Status LEDs AC Input
Catalyst 6840-X
The Catalyst 6840-X Utilizes Two Power Supplies in Either Redundant or Combined Mode
90% 90%
50% 50%
• Each PSU provides ~50% of power needs • Each PSU provides up to 90% of its capacity
• Neither PSU operates at >60% or <40% capacity • Total power available is 180% of a single supply
• Either PSU can power the system on its own • A single PSU may not have power for the system
• This mode is Recommended (Default) • This mode is NOT Recommended
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 106
NEW
Catalyst 6840-X Series
Fixed Chassis Portfolio
15.2(1)SY 15.2(1)SY
C6816-X-LE C6832-X-LE
Q4CY2014 C6824-X-LE-40G
Q4CY2014 C6840-X-LE-40G
Native Optics SFP/SFP+ SFP/SFP+ SFP/SFP+ and QSFP SFP/SFP+ and QSFP
# of 10G Ports 16 32 24 40
+8 using breakout cable +8 using breakout cable
# of 40G Ports 2 2
+4 using reverse adapter +8 using reverse adapter +6 using reverse adapter +10 using reverse adapter
IPv4 / v6 Routes 256K / 128K 256K / 128K 256K / 128K 256K / 128K
Multicast Routes 128K / 64K 128K / 64K 128K / 64K 128K / 64K
MPLS Labels 256K 256K 256K 256K
MAC Addresses 128K 128K 128K 128K
Security ACL 64K (Shared) 64K (Shared) 64K (Shared) 64K (Shared)
QoS ACL 64K (Shared) 64K (Shared) 64K (Shared) 64K (Shared)
Flexible NetFlow 512K 1M 1M 1.5M
Enhanced Control-Plane Scale with X86 2GHz RP CPU © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
Catalyst 6840-X:
Fixed Chassis Design
3 Main Components:
• RP Complex
• Baseboard
• Switch Fabric
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 108
Catalyst 6840-X
Fixed Chassis - RP Complex
Based on C6880-X-SUP
• 2.0GHz X86 IBC CPU
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 109
Catalyst 6840-X:
Fabric Channel Distribution
Fabric Channels
2
1
PG 4-5
PG 3-4
Switch
Each “Channel” uses
Fabric the following Clock
Frequency:
1
2
1 2
PG 1-2
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 110
NEW
Catalyst 6840-X
FIRE = Fabric Interface & Replication Engine
C6816-X-LE
Port ASIC Port ASIC • Combines FIRE ASIC & MUX FPGA of 6880-X
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 111
NEW
Catalyst 6840-X
FIRE = Fabric Interface & Replication Engine
C6832-X-LE32-X-LE
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 112
NEW
Catalyst 6840-X
FIRE = Fabric Interface & Replication Engine
C6824-X-LE-40G
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 113
NEW
Catalyst 6840-X
FIRE = Fabric Interface & Replication Engine
C6840-X-LE-40G
Local Fabric ASIC 2x20G
2x20G
Inband Inband
2x20G
Based on C6800-32P10G
DFC4
Inband
DFC4
Inband
• 40 ports of 1/10G SFP+, 2 ports of 40G QSFP
FIRE FIRE
ASIC FIRE FIRE ASIC • 5 x 8 SFP+ Port-Groups, 1 x 2 QSFP Port-Group
ASIC ASIC
40G 40G 40G 40G
• 3 x DFC4-E Forwarding Engines
Port ASIC Port ASIC Port ASIC Port ASIC
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 114
Agenda
Background
C6807-XL
C6880-X
C6840-X
Packet Walks
Layer 2 Switching For Your
Information
L2 Forwarding Steps
Frame received
1
L2 Table Source MAC Destination MAC L2 Table
Lookup Lookup
2
Learn New MAC? Router MAC? L3 forwarding
Yes Yes
L2 Table
No No
3
Update entry Known MAC? L2 forwarding
Yes
L2 Table
No
L2 flooding
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 116
Layer 2 Switching
Layer 2 MAC Table
32
PFC Pages 4096
Rows
MAC Table
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 119
For Your
Understanding EtherChannels
Frame 1 2 3 4 5 6 7 8
Frame 1 2 3 4 … 256
EtherChannel Uses a Hash Algorithm to Determine which Link in the Bundle to Use -
The Inputs to the Algorithm Are a Combination of L2, L3 and / or L4 addresses
dst-ip Dst IP Addr
dst-mac Dst Mac Addr
dst-mixed-ip-port Dst IP Addr and TCP/UDP Port
dst-port Dst TCP/UDP Port
mpls Load Balancing for MPLS packets
src-dst-ip Src XOR Dst IP Addr
src-dst-mac Src XOR Dst Mac Addr
src-dst-mixed-ip-port Src XOR Dst IP Addr and TCP/UDP Port
src-dst-port Src XOR Dst TCP/UDP Port
src-ip Src IP Addr
src-mac Src Mac Addr
src-mixed-ip-port Src IP Addr and TCP/UDP Port
src-port Src TCP/UDP Port
vlan-dst-ip Vlan, Dst IP Addr
vlan-dst-mixed-ip-port Vlan, Dst IP Addr and TCP/UDP Port
vlan-src-dst-ip Vlan, Src XOR Dst IP Addr
vlan-src-dst-mixed-ip-port Vlan, Src XOR Dst IP Addr and TCP/UDP Port
vlan-src-ip Vlan, Src IP Addr
vlan-src-mixed-ip-port Vlan Src IP Addr and TCP/UDP Port
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 123
Agenda
Background
C6807-XL
C6880-X
C6840-X
L2 Forwarding
L3 Forwarding
Packet Walks
For Your
L3 Forwarding Information
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 126
L3 Forwarding
FIB & Adjacency Overview
Each PFC/DFC stores a copy of the “FIB” & “Adjacency Table”… 172.20.45.1 IF1, MAC, MTU
FIB contains: 10.1.1.100
IF2, MAC, MTU
MASK (/32)
CEF entries from MOST to LEAST specific … IF3, MAC, MTU
based on /Mask
10.1.3.0 IF4, MAC, MTU
FIB TCAM shared by: 10.1.2.0
…
– IPv4 Unicast MASK (/24)
– IPv4 Multicast … …
FIB TCAM
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 127
L3 Forwarding
FIB & ADJ Lookup in PFC/DFC
Lets assume a lookup needs to be performed for a packet with
a destination of 10.1.5.2 /24, then the following would occur…
1 Packet 172.20.45.1
10.1.1.100
MASK (/32)
IF1, MAC, MTU
2 Key Gen …
10.1.3.0 IF2, MAC, MTU
10.1.2.0
7
Load-Sharing 6 IF3, MAC, MTU
3 Lookup Key MASK (/24) Hash
… 4
IF4, MAC, MTU
HIT! 10.1.0.0 …
172.16.0.0 5 …
MASK (/16)
… Adjacency
0.0.0.0 Table
MASK (/0)
FIB TCAM
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 128
For Your
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 129
For Your
Displaying IPv4 Forwarding Summary Information
IPv6 1 1%
IPv4 mcast 3 1%
IPv6 mcast 3 1%
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 130
For Your
Displaying Hardware IPv4 Prefix Entries Information
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 131
For Your
Finding the Longest-Match Prefix Entry Information
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 132
Agenda
Background
C6807-XL
C6880-X
C6840-X
L2 Forwarding
L3 Forwarding
NetFlow
Access Control
Packet Walks
Catalyst Hardware NetFlow
Cisco NetFlow is a process designed to collect information about traffic “flows” that pass through a switch
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 134
For Your
Catalyst Hardware NetFlow Information
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 135
For Your
Supervisor 2T Enhancements
Increased customization and scale by
selecting the fields to Match and
Optimal CPU Utilization with Collect for both IPv4 and IPv6
Yielding NDE & Direct Export Flexible
from a Line Card NetFlow
Bigger tables mean
Up to 13M MORE entries per
CPU Friendly Flows per system, giving you
Export better visibility into
System your network (up to
13 million NF entries
with a 13 slot chassis)
Allow to use Netflow after
ingress lookup is done Sampled
(NetFlow on CoPP) Egress
Netflow in
Allow to account for Netflow Optimize the Netflow
Hardware Tables utilization and
IP Multicast traffic per
destination instead of per group minimize load on Analyzers
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 136
Hardware NetFlow
TCAM Lookup on PFC4
DST IP SRC IP Proto DST Port SRC Port
1 10.1.2.11 10.1.1.10 0x6 80 33992
DataKey
Data Key Index
Index Flow Data Statistics
Data
Data Key
Key Index
Index
DataKey
Data Key Index
Index Flow Data Statistics
2 Data
Data Key
Key Index
Index
Data Key
DataKey
Key Index
Index Flow Data Statistics
Data
Data Key Index
Index
DataKey
Data Key Index
Index Flow Data Statistics
Flow
Flow Key
Key Data
Data Key
Key Index
Index Compare
DataKey
Data Key Index
Index Flow Data Flow Data Statistics
Data
Data Key
Key Index
Index
Data Key
DataKey
Key Index
Index Flow Data Statistics
Data
Data Key Index
Index 7
DataKey
HIT!
Data Key Index
Index Flow
HIT! Data 8 Statistics
Data
Data Key
Key Index
Index
3 DataKey
Data Key Index
Index Flow Data Statistics
Data
Data Key
Key Index
Index 6 Update
DataKey
Data Key Index
Index Flow Data Statistics
Hash Function Compare Data
Data Key
Key Index
Index
Stats
all pages Data Key
DataKey
Key Index
Index Index to Flow Data Statistics
Data
Data Key Index
Index
5 Data Key
DataKey
Key Index
Index
NF Data Flow Data Statistics
Data
Data Key Index
Index Table
512K
entries
4 Indexes row in Lookup Table
NetFlow Data Table NetFlow Statistics
NetFlow Lookup Table
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 137
Hardware NetFlow For Your
Information
… … …
Interfaces BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 138
Hardware NetFlow
NetFlow Data Export Process
VS-S2T-10G
Netflow
Export Netflow
Data
Netflow Collector
WS-X6848-TX-2T
Netflow Direct Export with Sup2T:
Data
EOBC • C6800-32P10G
• C6800-16P10G
WS-X6908-10G-2T • C6800-8P10G
• WS-X6904-40G
Netflow Direct
Data
Export • WS-X6908-10G
• WS-X6816-10X
• WS-X6716-10X (DFC4-E)
Also supported on C6880-X:
• C6880-X-16P10G
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 139
For Your
Yielding NDE
70% CPU threshold
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 140
For Your
Displaying NetFlow Utilization Information
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 141
For Your
Information
PFC3 vs. PFC4 - Flexible Netflow
Feature PFC3 PFC4
Netflow Entries 256 K (Ingress Only) 512 K Ingress – 512 K Egress
Shared Netflow Policers N/A 512
Netflow Samplers N/A 1K
Class Maps per Policy Map 1K 4K
Aggregate Policers 1K 6K
Distributed Policers N/A 4K
Microflow Policers 63 128
Flexible Netflow N/A Yes
Egress Netflow N/A Yes
VRF-aware Netflow N/A Yes*
Direct Export,
Netflow Export Enhancements Direct Export
CPU Yield, EEM
Packet or Byte Policing Byte-based Packet or Byte-based
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 144
Access Control Lists For Your
Information
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 145
Access Control Lists
ACL Order of Processing
3 4
Input RACL Output RACL
2 5
VACL VACL
1
Input PACL Note: NO
Output PACL
exists
Destination
Source
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 146
Access Control Lists
PFC4 TCAM Lookup
TCAM A TCAM B PFC4 / DFC4
BANK 0 BANK 1 BANK 2 BANK 3
VACL
Forwarding Engine
QoS RACL
SGACL
PACL RACL
3 ACE
Counters
TCAM Controller (L2 ASIC)
4X
2 2X
Results 4 7
Lookup Keys
4 X Results
& Priority Final Result
Packet Header Information ACL ACL to Netflow
Labels LOUs 6
8
Classification Module 1 Classification Module 2
1 5
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 147
For Your
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 149
For Your
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 150
For Your
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 151
For Your
Information
PFC3 vs. PFC4 - Security
Feature PFC3 PFC4
ACL TCAM Size 64K or 256K
32K
(Programmable)
ACL Labels 4K 16K
ACE Mask Ratio 8:1 1:1
ACL LOU’s 64 208
Port ACL’s 2K 8K
MAC ACL Support Software Hardware
Per-Port Per-VLAN ACL’s N/A Yes
Security Group ACL’s N/A 32K
Security Group Tagging (SGT) CTS 1.5 (SXP) CTS 2.0
802.1ae Encryption Support N/A Yes (Line-Rate)
Unicast RPF IPv4 (2 paths) IPv4 & IPv6 (16 paths)
Layer3: 8 Layer3: 31
Hardware Rate Limiters
Layer2: 4 Layer2: 26
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 152
Agenda
Background
C6807-XL
C6880-X
C6840-X
L2 Forwarding
L3 Forwarding
Packet Walks
6700/6800 & 6900
C6800 1G Series
C6800 10G Series
C6880-X Series
C6840-X Series
For Your
Information
6700 to 6700 - Centralized Forwarding
1
Slot 1 Slot 2
Port ASIC A Port ASIC B Port ASIC A Port ASIC B
R CFC CFC 7
2
P
FIRE ASIC AH FIRE ASIC B FIRE ASIC A FIRE ASIC B
6 3 Dbus
Rbus
2 4 10 10
5
FIRE ASIC A 3 FIRE ASIC B
11 13
5 E-DBUS
10 E-RBUS
12
Switch Fabric
10 6
5
9
Port ASIC
6
Fabric / Bus
Layer 2 Engine 7 P
10 Interface &
Replication ASIC F
CPU (MSFC) Layer 3 Engine 8
C
Supervisor Engine © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
For Your
6800 to 6800 - Distributed Forwarding (DFC) Information
1
Slot 1 Slot 2
Port ASIC A Port ASIC B Port ASIC A Port ASIC B
3
DFC4 L L DFC4 L L
R 2 3 2 3 6
2
4
P
FIRE ASIC A H FIRE ASIC B FIRE ASIC A FIRE ASIC B
5 Dbus
Rbus
3 4 6 10 11
FIRE ASIC A FIRE ASIC B
7 9
E-DBUS
E-RBUS
8
Switch Fabric
5 Dbus
Rbus
E-DBUS
E-RBUS
8
Switch Fabric
1 RE 3 4 RE Host
2 Host
Host
RE Host
Host Host Host Host
Ingress Replication Engine (RE) responsible Replicates for each egress linecard
for replication to ALL OIF’s
Switch Fabric sends copies for each OIF
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 160
For Your
Information
Host
RE Host
Host Host Host Host
Ingress Replication Engine responsible Switch Fabric replicates for each OIF
for replication to local OIF’s
Replicates a SINGLE copy to Fabric Local Linecard RE replicates for local OIF’s
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 161
Catalyst 6800
Packet Walks
Agenda
Background
C6807-XL
C6880-X
C6840-X
Packet Walks
6700/6800 & 6900
C6800 1G Series
C6800 10G Series
C6880-X Series
C6840-X Series
C6800 1G - Packet Walks
Remote Forwarding (Ingress) Step 9: Fabric ASIC uses
Fabric Header to determine
Supervisor Switch Fabric Egress Fabric Port and then it
sends to Switch Fabric
20G 20G
EOBC
Step 8: Ingress FIRE ASIC uses
lookup result to determine
Step 4: FIRE ASIC stores data the Fabric Port mapped to Egress
payload in local buffer, and then it FABRIC BACKPLANE INTF FABRIC
Port, and converts Internal Header
sends only the Internal Header to INTF INTF
to Fabric Header.
Forwarding Engine for Lookup Then it sends to Fabric ASIC
20G 20G
FPGA FPGA
Step 3: Port ASIC parses packet FIRE FIRE Step 5: Inband FPGA parses
to derive VLAN, CoS, etc. and ASIC ASIC Internal Header, and then it sends
perform Ingress QoS. to Forwarding Engine
10G 10G 10G 10G
Then it applies Internal Header DFC4
and sends to FIRE ASIC Step 6-7: Forwarding Engine
PORT PORT PORT PORT performs L2, L3, ACL and
ASIC ASIC ASIC ASIC Netflow IFE & OFE processing
Step 2: PHY converts the signal to determine the Egress Port &
& serializes the bits, and then it Rewrite Info.
sends to Port ASIC Then it returns result to FIRE ASIC
(via Inband FPGA)
PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY
Step 1: Packet Arrives
@ Ingress Port 13 01-04 05-08 09-12 13-16 17-20 21-24 25-28 29-32 33-36 37-40 41-44 45-48
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 164
C6800 1G Packet Walks
Remote Forwarding (Egress)
Step 10: Switch Fabric transmits
frame to Egress Fabric ASIC, which Supervisor Switch Fabric
sends to Egress FIRE ASIC
20G 20G
EOBC
Step 11: FIRE ASIC uses Fabric
Header to derive new Internal header,
which it sends to Forwarding Engine FABRIC BACKPLANE INTF FABRIC
(Egress Lookup) Step 14: FIRE ASIC uses
INTF INTF
Internal Header to determine Egress
20G
FPGA FPGA
20G Port and reassemble the packet.
Then it sends to Port ASIC
Step 12: Inband FPGA parses FIRE FIRE
Internal Header, and then it sends ASIC ASIC Step 15: Port ASIC removes
to Forwarding Engine Internal Header and rewrites VLAN,
10G 10G 10G 10G CoS, etc. and perform Egress QoS.
DFC4 Then it sends to PHY
Step 13: Forwarding Engine PORT PORT PORT PORT
performs an Egress (L2) Lookup ASIC ASIC ASIC ASIC
to learn SRC MAC address. Step 16: PHY serializes the bits
Then it returns Internal Header to & converts signal, and then
FIRE ASIC (via Inband FPGA) transmits the packet
PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY Step 17: Packet Leaves
@ Egress Port 36
01-04 05-08 09-12 13-16 17-20 21-24 25-28 29-32 33-36 37-40 41-44 45-48
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 165
C6800 10G - Packet Walks
Remote Forwarding (Ingress) Step 9: Fabric ASIC uses
Fabric ASIC of Active Sup Fabric ASIC of Standby Sup Fabric Header to determine
Egress Fabric Port and then it
40G 40G 40G 40G 40G 40G 40G 40G sends to Switch Fabric
@ Ingress Port 17 SFP SFP SFP SFP Front SFP SFP SFP SFP
01,03,05,07 09,11,13,15 17,19,21,23 25,27,29,31 02,04,06,08 10,12,14,16 18,20,22,24 26,28,30,32
Panel
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 166
C6800 10G Packet Walks
Remote Forwarding (Egress)
Step 10: Switch Fabric transmits
frame to Egress Fabric ASIC, which Fabric ASIC of Active Sup Fabric ASIC of Standby Sup
sends to Egress FIRE ASIC 40G 40G 40G 40G 40G 40G 40G 40G
© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
C6880-X & C6840-X Packet Walk
Remote Forwarding (Egress)
Step 11: FIRE ASIC uses Fabric
Step 10: Fabric ASIC transmits frame Header to derive new Internal header,
to Egress Fabric Port, which is which it sends to Forwarding Engine
received by Egress FIRE ASIC (egress lookup)
© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
Catalyst 6840-X
Packet Walks
Agenda
Background
C6807-XL
C6880-X
C6840-X
Packet Walks
C6800-10G Series
C6880-X Series
C6840-X Series
C6840-X - Packet Walks
Same as C6800 10G Series
C6832-X-LE C6800-32P10G
Fabric ASIC of Active
Fabric ASIC of Standby Sup
Sup
40G 40G 40G 40G 40G 40G 40G 40G
PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY
SFP SFP SFP SFP Front SFP SFP SFP SFP SFP SFP SFP SFP Front SFP SFP SFP SFP
01-04 05-08 09-12 13-16 Panel 17-20 21-24 25-28 29-32 01,03,05,07 09,11,13,15 17,19,21,23 25,27,29,31 Panel 02,04,06,08 10,12,14,16 18,20,22,24 26,28,30,32
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 174
15.5(1)SY
Onwards
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 175
Summary
Innovation & Investment Protection
The Catalyst 6800 Series are based on the “Gold Standard”
Catalyst 6500 Series, leveraging the same ASICs and IOS
Software, while providing a foundation for the next-generation.
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 176
Cisco Spark
Questions?
Use Cisco Spark to communicate
with the speaker after the session
How
1. Find this session in the Cisco Live Mobile App
2. Click “Join the Discussion”
3. Install Spark or go directly to the space
4. Enter messages/questions in the space
cs.co/ciscolivebot#BRKARC-3465
© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
• Please complete your Online Complete Your Online
Session Evaluations after each
session
Session Evaluation
• Complete 4 Session Evaluations
& the Overall Conference
Evaluation (available from
Thursday) to receive your Cisco
Live T-shirt
• All surveys can be completed via
the Cisco Live Mobile App or the
Communication Stations
Don’t forget: Cisco Live sessions will be available
for viewing on-demand after the event at
www.ciscolive.com/global/on-demand-library/.
© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
Continue Your Education
• Demos in the Cisco campus
• Walk-in Self-Paced Labs
• Tech Circle
• Meet the Engineer 1:1 meetings
• Related sessions
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 179
BRKARC-3465 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 180
Thank you