BEST Case Study About Virtualziation
BEST Case Study About Virtualziation
Presenting this case study will be Dave Zacks, a Technical Solution Architect
with Cisco Systems. Attendees at this session will learn about virtualized
network deployments, and how these can be used to provide unique and
compelling architectural solutions, addressing both business and technical
requirements.
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 3
#CNSF2011
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 4
Groups and services
are logically separated …
Resources Internet
Guest / partner access
Departmental separation
Regulatory compliance (HIPPA, PCI …)
Building controls, video surveillance
Non-Virtualized Network
Mergers, acquisitions … and many others
Service differentiation
is configured per group / service …
Dept A Dept B Partner Guest The same application
can be unique per group / service
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 5
One physical network
supports many virtual networks
Separate Departments Separate Functions Guests / Partners
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 6
Service Access Control Path Isolation Services Edge
Branch – Campus WAN – MAN – Campus Data Center – Internet Edge – Campus
GRE MPLS
VRFs
Internet
(VRF-Lite End-to-End)
IP
Multi-Hop –
(VRF-Lite+GRE, MPLS VPN)
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 9
iBGP requires a full mesh of neighbors
172.16.5.0/24 172.16.8.0/24
N * (N-1) / 2 = 8 * 7 / 2 = 28
S2 S3 S4
R1S1 R4
172.17.6.0/24 172.17.9.0/24
172.18.7.0/24 172.18.10.0/24
For Your
Reference
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 10
Route Reflector Route Reflector
172.16.5.0/24 172.16.8.0/24
S2 S3 S4
R1S1 R4
172.17.6.0/24 172.17.9.0/24
172.18.7.0/24 172.18.10.0/24
For Your
Reference
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 11
Firewall contexts in transparent mode Shared Services
act as L2 bridges E-mail
Fusion router establishes routing Storage
Web
peering with the various VRFs …
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 13
Shared Services Global Table
The global table is considered as another The global table is treated as a shared
VPN (in fact can be usually considered service – access to the global table
the “default VPN”) and it is front-ended from each VPN is subject to the policy
by its own security device enforcement provided by the Services Edge
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 14
#CNSF2011
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 15
UBC is one of the largest
Universities in Canada.
Clock Tower,
I.K Barber
adjacent to the I.K Barber
Learning Centre
Learning Centre,
University of
University of BC
BC
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 17
50,332 students – 4,669 faculty – 8,953 staff
Source: www.ubc.ca (as of November, 2008)
Inner Core
Additional
Buildings
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 21
Statement of the Problem –
Nineteen faculties – and over 200 departments.
Several thousand subnets, Campus-wide.
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 22
Proliferation of
different firewall
types
Performance issues
as the Campus
scales to 10GE
Difficult to support
and troubleshoot
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 23
Technically, it would be possible to
bridge VLANs across the core UBC network –
This has often been requested historically.
Between VRFs
Traffic flows across Virtual Firewalls, hosted on UBC’s
Catalyst 6500-based Firewall Services Modules (FWSMs).
Each Virtual Firewall can be managed separately
by the department / faculty involved
(aids in scaling manageability).
www.cisco.com/go/designzone
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 28
MPLS VPN uses Multi-Protocol BGP (MP-BGP)
for exchanging MPLS tags (for creating isolated domains).
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 29
The next step was determining where to place the
P (Provider) and PE (Provider Edge) routers.
UBC uses
Catalyst 6509
switches, which
support MPLS.
The Inner Core
6509s are the
P routers.
The Outer Core
6509s are the
PE routers.
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 30
After determining the P and PE router locations,
it was necessary to set up the appropriate routing.
VLANs terminate
at the Outer Core
layer, and are
mapped into
VRFs using SVIs.
HSRP is used
across the PE
router pair for
first-hop redundancy.
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 32
VLAN and VRF definitions at the PE routers …
Note – VRFs are only defined on the PE routers where the VRFs need
to terminate … not all VRFs are defined on all PE routers …
vlan 627
name VLAN-627-MED-ADMIN VLAN definition – Layer 2
ip vrf MED-ADMIN
rd 65111:521
route-target export 65111:521
route-target import 65111:521
VRF definition – Layer 3
Outer Core (PE), VLANs and VRFs Outer Core (PE), SVI configuration
OUTER-2# show run int Vlan 627
vlan 627
!
name VLAN-627-MED-ADMIN
interface Vlan627
description VLAN-627-MED-ADMIN
mtu 8500
ip vrf MED-ADMIN
ip vrf forwarding MED-ADMIN
rd 65111:521
ip address 172.16.10.253 255.255.255.0
route-target export 65111:521
route-target import 65111:521 ip helper-address 10.10.5.1
ip helper-address 10.10.6.1
standby ip 172.16.10.254
standby priority 105
For DHCP forwarding standby preempt
standby authentication md5 key-string 7 <secret>
(within the VRF)
For HSRP
(within the VRF)
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 34
VLANs are mapped into VRFs via definitions on SVIs.
“show ip vrf” shows all VLAN-to-VRF mappings …
Outer Core (PE), VLANs and VRFs Outer Core (PE), SVI configuration
OUTER-2# show run int Vlan 627
vlan 627
!
name VLAN-627-MED-ADMIN
interface Vlan627
description VLAN-627-MED-ADMIN
mtu 8500
ip vrf MED-ADMIN
ip vrf forwarding MED-ADMIN
rd 65111:521
ip address 172.16.10.253 255.255.255.0
route-target export 65111:521
route-target import 65111:521 ip helper-address 10.10.5.1
ip helper-address 10.10.6.1
standby ip 172.16.10.254
standby priority 105
OUTER-2# show ip vrf
standby preempt
Name Default RD Interfaces
standby authentication md5 key-string 7 <secret>
MED-ADMIN 65111:521 Vl185
Vl431 VLANs mapped into the VRF
Vl627
Vl2199
(in this example, 4 VLANs total
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Publicin this VRF, on this PE) 35
Connected routes and static routes within the VRF
are redistributed into MP-BGP …
making these routes available on other PEs
that also host this VRF …
Outer Core (PE), Connected / Static
interface Vlan185 Connected routes within the VRF
ip vrf forwarding MED-ADMIN (local SVIs on this PE router)
ip address 172.16.2.253 255.255.255.248
interface Vlan431
ip vrf forwarding MED-ADMIN
ip address 172.16.5.253 255.255.255.128
interface Vlan627
ip vrf forwarding MED-ADMIN Static route to virtual firewall
ip address 172.16.10.253 255.255.255.0 (in this example, co-located
interface Vlan2199 on this PE router, via VLAN 185)
ip vrf forwarding MED-ADMIN Named
ip address 172.16.33.253 255.255.255.192 Static
Routes
ip route vrf MED-ADMIN 0.0.0.0 0.0.0.0 172.16.2.249 name DEFAULT-ROUTE=MED-ADMIN
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 36
Connected routes and static routes within the VRF
are redistributed into MP-BGP …
making these routes available on other PEs
that also host this VRF …
Outer Core (PE), Connected / Static Outer Core (PE), Redistribution
interface Vlan185 router bgp 65111
ip vrf forwarding MED-ADMIN !
ip address 172.16.2.253 255.255.255.248 address-family ipv4 vrf MED-ADMIN
redistribute connected
interface Vlan431 redistribute static
ip vrf forwarding MED-ADMIN no synchronization
ip address 172.16.5.253 255.255.255.128 network 0.0.0.0
interface Vlan627 exit-address-family
ip vrf forwarding MED-ADMIN
ip address 172.16.10.253 255.255.255.0
Redistribution of routes
interface Vlan2199
to other PEs (via MP-BGP)
ip vrf forwarding MED-ADMIN
ip address 172.16.33.253 255.255.255.192
ip route vrf MED-ADMIN 0.0.0.0 0.0.0.0 172.16.2.249 name DEFAULT-ROUTE=MED-ADMIN
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 37
Now that we have done all of our VLAN and VRF definitions,
SVI configuration, and route redistribution …
… let’s see the results …
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 38
Now we have Campus-wide “virtual networks”
for departments and faculties, on demand!
To this …
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 40
Network maintenance and troubleshooting tasks
are readily adapted into a multi-VRF environment …
OUTER-2# OUTER-2#
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 41
Network maintenance and troubleshooting tasks
are readily adapted into a multi-VRF environment …
. . .
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 42
Logical Network Flow
PE
P
RED = traffic within the Red VRF
GOLD = MPLS-encapsulated traffic
PE
UBC operates
multiple FWSMs,
distributed around
Campus.
The default route in
each departmental VRF
points to that VRF’s OUTER-2# show ip route vrf MED-ADMIN
redundant Virtual Routing Table: MED-ADMIN
PE
Virtual FW
Policy
RED = traffic within the Red VRF
PURPLE = IP routed traffic (via OSPF)
PE
GREEN = traffic within the Green VRF
PE
Virtual FW
Policy
PE
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 45
Logical Network Flow
Border
P
RED = traffic within the Red VRF
PURPLE = IP routed traffic (via OSPF)
PE
Virtual FW
Policy
PE
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 46
Previously, UBC did not provide Campus-wide multicast –
… inability to securely limit multicast use.
Catalyst 6500
core switches
offer support
for 6VPE
capability.
http://www.cisco.com/en/US/prod/collateral/switches/ps5718/ps708/solution_overview_c22-531339.html
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 51
Response from UBC Faculties and Departments –
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 52
UBC has derived many technical benefits
from their Network Virtualization deployment …
Scalable deployment for departmental / faculty segmentation.
End-to-end high performance –
High-performance IP / MPLS routing within a VRF.
Ability to consolidate and scale virtualized
firewalls, for traffic moving between VRFs.
www.cisco.com/en/US/prod/collateral/switches/ps5718/ps708/case_study_c36-609342.html
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. 55
Cisco Public
www.cisco.com/go/networkvirtualization
CNSF - May, 2011 © 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public 56
#CNSF2011
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 57
#CNSF2011
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 58
Thank you.
#CNSF2011