Release Notes For Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
Release Notes For Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
This release note gives an overview of the features for the Cisco IOS XE Everest 16.6.x software on
Cisco Catalyst 3650 Series Switches.
Unless otherwise noted, the terms switch and device refer to a standalone switch and to a switch stack.
Note - For information about unsupported features, see Important Notes, page 9.
- For information about software and hardware restrictions and limitations, see Limitations and
Restrictions, page 52.
- For information about open issues with the software and past opens that are resolved, see
Caveats, page 53.
Introduction
Cisco Catalyst 3650 Series Switches are the next generation of enterprise class stackable access layer
switches, with the new and improved 160-Gbps StackWise-160. Security and application visibility and
control are natively built into the switch.
Cisco Catalyst 3650 Series Switches also support full IEEE 802.3 at Power over Ethernet Plus (PoE+),
modular and field replaceable network modules, redundant fans, and power supplies. The Cisco Catalyst
3650 Series Switches enhance productivity by enabling applications such as IP telephony and video for
a true borderless network experience.
Cisco IOS XE, Cisco IOS XE Denali 16.x.x, and now Cisco IOS XE Everest 16.x.x, represent the
continuing evolution of the preeminent Cisco IOS operating system. The Cisco IOS XE architecture and
well-defined set of APIs extend the Cisco IOS software to improve portability across platforms and
extensibility outside the Cisco IOS environment. The Cisco IOS XE software retains the same look and
feel of the Cisco IOS software, while providing enhanced future-proofing and improved functionality.
Americas Headquarters:
Cisco Systems, Inc., 170 West Tasman Drive, San Jose, CA 95134-1706 USA
Whats New in Cisco IOS XE Everest 16.6.2
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
2
Whats New in Cisco IOS XE Everest 16.6.1
Cisco Nonstop Forwarding (NSF) Cisco NSF is now supported for IPv6 traffic.
Support for IPv6
Cisco NSF works with the Stateful switchover (SSO) feature to
minimize the amount of time a network is unavailable to its users
following a switchover.
See Stack Manager and High Availability -> Configuring Cisco
NSF with SSO.
(IP Services)
High Availability: (1:1) Determines the active and standby role for a specific switch in a
Redundancy stack, based on the flash rommon variable.
See Stack Manager and High Availability -> Configuring 1:1
Redundancy.
(LAN Base, IP Base, and IP Services)
Internet Group Management Enables a multicast device to explicitly track the membership of
Protocol (IGMP) Explicit all multicast hosts in a particular multiaccess network. The
Tracking explicit racking of hosts, groups, and channels enables the device
to keep track of each individual host that is joined to a particular
group or channel.
See IP Multicast Routing -> IGMP Explicit Tracking.
(LAN Base, IP Base, and IP Services)
IP-Prefix and SGT-Based SXP Provides a filtering mechanism to solve the high IP-Scalable
Filtering Group Tag (SGT) bindings scale issue. When bindings are
exported or imported, filters are provided on a per-peer basis or
globally (applicable to all SXP connections) with an option to
filter either as a listener or a speaker. The filtering can also be done
based on IP prefixes or SGT.
See Cisco TrustSec Switch Configuration Guide -> IP-Prefix and
SGT-Based SXP Filtering.
(IP Services)
LAN Base enhancements for These protocols are now available at the LAN Base license level,
routing protocols with IPv4 and IPv6:
• Routing Information Protocol (RIP)
• Open Shortest Path First (OSPF)
• Policy-Based Routing (PBR)
• Protocol Independent Multicast Stub Routing (PIM Stub
Routing)
Routed access is supported at the LAN Base license level, with
IPv4 and IPv6:
• OSPF — up to 1000 routes
• Multicast — up to 1000 routes
See IP Multicast Routing and Routing.
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
3
Whats New in Cisco IOS XE Everest 16.6.1
IPv6 Multicast with Virtual Allows a service provider to support two or more VPNs with
Private Networks (VPN) Routing overlapping IP addresses using one interface. VRF-Lite uses input
Forwarding Table (VRF-Lite) interfaces to distinguish routes for different VPNs and forms
virtual packet-forwarding tables by associating one or more Layer
3 interfaces with each VRF.
See IP Multicast Routing -> Configuring VRF-lite.
(IP Services)
Locator ID Separator Protocol • LISP Extranet Support—Refers to subscriber to provider
(LISP) Extranet Support and communication across instance IDs in a LISP network. With
Source Group Access Control List LISP Extranet support, hosts in VRF “A”, for example, can
(SGACL) Cell Statistics access shared resources in VRF “B”.
• SGACL Cell Statistics—An enhancement in the show cts
role-based counters ipv4 command, to display all SGACL
enforcement statistics for IPv4, providing visibility at the cell
level.
See Campus Fabric.
(IP Services)
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
4
Whats New in Cisco IOS XE Everest 16.6.1
Multiprotocol Label Switching The following MPLS features are introduced in this release:
• Ethernet over MPLS • EoMPLS—One of the Any Transport over MPLS (AToM)
(EoMPLS) transport types. EoMPLS provides a tunneling mechanism for
Ethernet traffic through an MPLS-enabled Layer 3 core. It
• Virtual Private LAN Services
encapsulates Ethernet protocol data units (PDUs) inside
(VPLS)
MPLS packets and uses label stacking to forward them across
• EIGRP MPLS VPN PE-CE the MPLS network.
Site of Origin (SoO)
• VPLS—A class of VPN that supports the connection of
• Route Target Rewrite multiple sites in a single bridged domain over a managed
• external BGP (eBGP) and IP/MPLS network. VPLS uses the provider core to join
internal BGP (iBGP) OR multiple attachment circuits together, to simulate a virtual
eiBGP bridge that connects the multiple attachment circuits together.
• IPv6 Provider Edge over • EIGRP MPLS VPN PE-CE SoO—Introduces the capability to
MPLS (6PE) filter MPLS Virtual Private Network (VPN) traffic on a
per-site basis for Enhanced Interior Gateway Routing
• IPv6 VPN Provider Edge over Protocol (EIGRP) networks. SoO filtering is configured at the
MPLS (6VPE) interface level and is used to manage MPLS VPN traffic, and
to prevent transient routing loops from occurring in complex
and mixed network topologies.
• Route Target Rewrite—Allows the replacement of route
targets on incoming and outgoing Border Gateway Protocol
(BGP) updates. Route targets are carried as extended
community attributes in BGP Virtual Private Network IP
Version 4 (VPNv4) updates. Route target extended
community attributes are used to identify a set of sites and
VPN routing and forwarding (VRF) instances that can receive
routes with a configured route target.
• eiBGP— Enables you to configure multipath load balancing
with both eBGP and iBGP paths in Border Gateway Protocol
(BGP) networks that are configured to use MPLS VPNs. The
feature provides improved load balancing deployment and
service offering capabilities and is useful for multi-homed
autonomous systems and Provider Edge (PE) routers that
import both eBGP and iBGP paths from multihomed and stub
networks.
• 6PE—A technique that provides global IPv6 reachability over
IPv4 MPLS. It allows one shared routing table for all other
devices. 6PE allows IPv6 domains to communicate with one
another over the IPv4 without an explicit tunnel setup,
requiring only one IPv4 address per IPv6 domain.
• 6VPE—A mechanism to use the IPv4 backbone to provide
VPN IPv6 services. 6VPE is like a regular IPv4 MPLS-VPN
provider edge, with an addition of IPv6 support within VRF.
It provides logically separate routing table entries for VPN
member devices.
See Multiprotocol Label Switching.
(IP Services)
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
5
Whats New in Cisco IOS XE Everest 16.6.1
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
6
Whats New in Cisco IOS XE Everest 16.6.1
Trustworthy Systems: Simplified Removes all the customer specific data that has been added to the
Factory Reset device since the time of its shipping.
Enter the factory-reset all command to erase all the content from
the NVRAM, all Cisco IOS images including the current boot
image, boot variables, startup and running configuration data, and
user data. The Onboard Failure Logging (OBFL) logs and the
crash information are also deleted.
No system configuration is required to use the factory reset
command. Use the command with all options enabled.
Do not unplug the power or interrupt the factory reset operation.
The system reloads to perform the Factory Reset. Note that after
this operation, you can load the IOS image either through a USB
or TFTP.
Use cases for the feature:
• Return Material Authorization (RMA) for a device—If you
have to return a device to Cisco for RMA, remove all
customer-specific data before obtaining a RMA certificate for
the device.
• Recovering the compromised device—If the key material or
credentials stored on a device is compromised, reset the
device to factory configuration and then reconfigure the
device.
(LAN Base, IP Base, and IP Services)(LAN Base, IP Base, and IP
Services)
Virtual Private Network Routing Enables you to configure the source and destination of a GRE IP
and Forwarding- Aware tunnel to belong to any VRF table.
(VRF-Aware) Generic Routing
See Routing -> Configuring Generic Routing Encapsulation
Encapsulation (GRE)
(GRE) Tunnel IP Source and Destination VRF Membership.
(IP Base and IP Services)
New in Software-Defined Access Wireless
Software-Defined Access The Enterprise Fabric provides end-to-end enterprise-wide
Wireless (SD-Wireless) segmentation, flexible subnet addressing, and controller-based
networking with uniform enterprise-wide policy and mobility. It
moves the enterprise network from current VLAN-centric
architecture to a user group-based enterprise architecture, with
flexible Layer 2 extensions within and across sites.
See Campus Fabric -> Software-Defined Access Wireless.
(IP Services)
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
7
Whats New in Cisco IOS XE Everest 16.6.1
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
8
Important Notes
Important Notes
• Converged Access (CA) is not supported beyond Cisco IOS XE Denali 16.3.x.
On the Cisco Catalyst 3650 Series Switches, CA is supported in the Cisco IOS XE Denali 16.3.x
software release, which has extended support for 40 months.
• Starting with Cisco IOS XE Denali 16.3.x, Secure Shell (SSH) Version 1 is deprecated. Use SSH
Version 2 instead.
• A switch stack containing a mix of Cisco Catalyst 3650 Series Switches and Cisco Catalyst 3850
Series Switches is not supported.
• Cisco Plug-In for OpenFlow (OpenFlow 1.0 and 1.3) is available in Cisco IOS XE Release 3.7.3E,
but is not supported in Cisco IOS XE Everest 16.6.x.
• 256-bit AES MACsec (IEEE 802.1AE) host link encryption with MACsec Key Agreement (MKA)
is available in the Cisco IOS XE Denali 16.3.x release train, starting with Cisco IOS XE Denali
16.3.1, but the feature is not supported in Cisco IOS XE Everest 16.6.1.
• The following features are not supported in Cisco IOS XE Everest 16.5.1a:
– 802.1x Configurable username and password for MAB
– AAA: TACACS over IPv6 Transport
– Auto QoS for Video endpoints
– Cisco Group Management Protocol (CGMP)
– Cisco TrustSec 802.1x
– Cisco TrustSec Critical Auth
– Cisco TrustSec for IPv6
– CNS Config Agent
– Command Switch Redundancy
– Device classifier for ASP
– DHCP snooping ASCII circuit ID
– DHCPv6 Relay Source Configuration
– DVMRP Tunneling
– Dynamic Access Ports
– EX SFP Support (GLC-EX-SMD)
– Fallback bridging for non-IP traffic
– Fast SSID support for guest access WLANs
– IEEE 802.1X-2010 with 802.1AE support
– Improvements in QoS policing rates
– Ingress Strict Priority Queuing (Expedite)
– Stack ports buffer is not shared as part of the shared pool. The dedicated buffer for stack ports
can only be used by stack ports.
– IP-in-IP (IPIP) Tunneling
– IPSLA Media Operation
– IPv6 IKEv2 / IPSecv3
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
9
Supported Hardware
Supported Hardware
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
10
Supported Hardware
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
11
Supported Hardware
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
12
Supported Hardware
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
13
Supported Hardware
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
14
Supported Hardware
Optics Modules
Catalyst switches support a wide range of optics. Because the list of supported optics is updated on a
regular basis, consult the tables at this URL for the latest (SFP) compatibility information:
http://www.cisco.com/en/US/products/hw/modules/ps5455/products_device_support_tables_list.html
Compatibility Matrix
Table 2 lists the software compatibility matrix.
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
15
Supported Hardware
Denali 16.2.1 03.07.03E 8.1.0, 8.2.0 CMX 10.2.2 1.3 Patch 5 5.3 3.1.0 (Wired)
03.06.03E (Wired and 5.4
4 3.1.0, 3.0.23 + Device Pack 4 + PI 3.0
Wireless)
Technology Pack (Wireless)
Denali 16.1.3 03.07.02E 8.1.0 CMX 10.2.0 1.3 Patch 3 5.3 3.0.2 + Device Pack 5+ PI 3.0
03.06.03E (Wired) 5.4 Technology Pack
4
1.4 (Wireless)
Denali 16.1.2 03.07.02E 8.1.0 CMX 10.2.0 1.3 Patch 3 5.3 3.0.2 + Device Pack 4 + PI 3.0
03.06.03E (Wired) 5.4 Technology Pack
4
1.4 (Wireless)
Denali 16.1.1 03.07.02E 8.1.0 CMX 10.2.0 1.3 Patch 3 5.3 3.0.2 + PI 3.0 Device Pack 2 + PI 3.0
03.06.03E (Wired) 5.4 Technology Pack
4
1.4 (Wireless)
03.07.03E 03.07.03E 8.0 8.0 1.3 5.2 2.2
03.07.02E 03.07.02E 8.0 8.05 1.3 5.2
03.07.01E 03.07.01E 8.0
03.07.00E 03.07.00E 7.6 5.3
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
16
Web UI System Requirements
Hardware Requirements
Table 3 Minimum Hardware Requirements
Software Requirements
• Operating Systems
– Windows 7
– Mac OS X 10.9.5
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
17
Finding the Software Version and Feature Set
• Browsers
– Google Chrome—Version 38 and later (On Windows)
– Microsoft Internet Explorer—Version 11 or later (On Windows 7 and Windows XP), and
Microsoft Edge (On Windows 10)
– Mozilla Firefox—Version 33 and later (On Windows and Mac)
– Safari—Version 7 and later (On Mac)
Note Although the show version output always shows the software image running on the switch, the model
name shown at the end of this display is the factory configuration and does not change if you upgrade
the software license.
You can also use the dir filesystem: privileged EXEC command to see the directory names of other
software images that you might have stored in flash memory.
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
18
Upgrading the Switch Software
Note You cannot use the Web UI to install, upgrade to, or downgrade from Cisco IOS XE Denali 16.x.x or
Cisco IOS XE Everest 16.x.x.
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
19
Upgrading the Switch Software
For subsequent IOS XE 16.x.x releases, if there is a new bootloader in that release, it may be
automatically upgraded based on the hardware version of the switch when you boot up your switch with
the new image for the first time.
If the automatic boot loader upgrade occurs, while booting Cisco IOS XE Everest 16.6.2,
you will see the following on the console:
%IOSXEBOOT-Tue-###: (rp/0): Oct 17 13:07:19 Universal 2017 PLEASE DO NOT
POWER CYCLE ### BOOT LOADER UPGRADING 4
%IOSXEBOOT-loader-boot: (rp/0): upgrade successful 4
If you boot Cisco IOS XE Everest The boot loader may be upgraded to version 4.56. For example:
16.6.1 the first time BOOTLDR: CAT3K_CAA Boot Loader (CAT3K_CAA-HBOOT-M) Version 4.56, RELEASE
SOFTWARE (P)
If the automatic boot loader upgrade occurs, while booting Cisco IOS XE Everest
16.5.1a, you will see the following on the console:
%IOSXEBOOT-Sat-###: (rp/0): May 27 00:22:16 Universal 2017 PLEASE DO NOT
POWER CYCLE ### BOOT LOADER UPGRADING 4
%IOSXEBOOT-loader-boot: (rp/0): upgrade successful 4
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
20
Upgrading the Switch Software
..10%......................................................................20%........
.
.............................................................30%......................
..................................................40%.................................
......................................50%.............................................
.........................60%..........................................................
............70%.
........................................................................80%...........
...........................................................90%........................
..............................................100%
Front-end Microcode IMG MGR: Preparing to program device[0]...25166 bytes.
Front-end Microcode IMG MGR: Programming device
0...rrrrrrw..0%....10%....20%......30%...40%......50%....60%......70%...80%......90%..
..100%
Front-end Microcode IMG MGR: Microcode programming complete for device 0.
Front-end Microcode IMG MGR: Preparing to program device[0]...86370 bytes....
Skipped[3].
Front-end Microcode IMG MGR: Microcode programming complete in 237 seconds
Upgrading from Cisco IOS XE 3.xE to Cisco IOS XE Denali 16.x.x, or Cisco IOS XE
Everest 16.6.x in Install Mode
Follow these instructions to upgrade from Cisco IOS XE 3.xE to Cisco IOS XE Denali 16.x.x or Cisco
IOS XE Everest 16.6.x in install mode:
Step 1 Make sure your tftp server is reachable from IOS via GigabitEthernet0/0.
Switch# show run | i tftp
ip tftp source-interface GigabitEthernet0/0
ip tftp blocksize 8192
Switch#
Switch# show run | i ip route vrf
ip route vrf Mgmt-vrf 5.0.0.0 255.0.0.0 5.30.0.1
Switch#
Switch# show run int GigabitEthernet0/0
Building configuration...
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
21
Upgrading the Switch Software
Step 3 Use the dir flash command to confirm that the image has been successfully copied to flash.
Switch# dir flash:*.bin
Directory of flash:/
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
22
Upgrading the Switch Software
Removed cat3k_caa-infra.SPA.03.07.03E.pkg
Removed cat3k_caa-iosd-universalk9.SPA.152-3.E3.pkg
Removed cat3k_caa-platform.SPA.03.07.03E.pkg
Removed cat3k_caa-wcm.SPA.10.3.130.0.pkg
[4]: Old files list:
Removed cat3k_caa-base.SPA.03.07.03E.pkg
Removed cat3k_caa-drivers.SPA.03.07.03E.pkg
Removed cat3k_caa-infra.SPA.03.07.03E.pkg
Removed cat3k_caa-iosd-universalk9.SPA.152-3.E3.pkg
Removed cat3k_caa-platform.SPA.03.07.03E.pkg
Removed cat3k_caa-wcm.SPA.10.3.130.0.pkg
[1]: New files list:
Added cat3k_caa-rpbase.16.06.01.SPA.pkg
Added cat3k_caa-rpcore.16.06.01.SPA.pkg
Added cat3k_caa-srdriver.16.06.01.SPA.pkg
Added cat3k_caa-guestshell.16.05.01a.SPA.pkg
Added cat3k_caa-webui.16.06.01.SPA.pkg
[2]: New files list:
Added cat3k_caa-rpbase.16.06.01.SPA.pkg
Added cat3k_caa-rpcore.16.06.01.SPA.pkg
Added cat3k_caa-srdriver.16.06.01.SPA.pkg
Added cat3k_caa-guestshell.16.06.01.SPA.pkg
Added cat3k_caa-webui.16.06.01.SPA.pkg
[3]: New files list:
Added cat3k_caa-rpbase.16.06.01.SPA.pkg
Added cat3k_caa-rpcore.16.06.01.SPA.pkg
Added cat3k_caa-srdriver.16.06.01.SPA.pkg
Added cat3k_caa-guestshell.16.06.01.SPA.pkg
Added cat3k_caa-webui.16.06.01.SPA.pkg
[4]: New files list:
Added cat3k_caa-rpbase.16.06.01.SPA.pkg
Added cat3k_caa-rpcore.16.06.01.SPA.pkg
Added cat3k_caa-srdriver.16.06.01.SPA.pkg
Added cat3k_caa-guestshell.16.06.01.SPA.pkg
Added cat3k_caa-webui.16.06.01.SPA.pkg
[1 2 3 4]: Creating pending provisioning file
[1 2 3 4]: Finished installing software. New software will load on reboot.
[1 2 3 4]: Committing provisioning file
Switch#
Note Old files listed in the logs should be removed using the request platform software package clean
switch all command, after reload
Reload
Step 5 If you said ‘Yes’ to the prompt in software install and your switches are configured with auto boot, the
stack will automatically boot up with the new image. If not, you can manually boot flash:packages.conf
switch: boot flash:packages.conf
Note When you boot the new image, it will automatically update the boot loader.
Step 6 When the new image boots up, you can verify the version of the new image, by checking show version
Switch# show version
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
23
Upgrading the Switch Software
Step 7 After you have successfully installed the image, you no longer need the .bin image and the file can be
deleted from flash of each switch if it was copied to flash.
Switch#delete flash:cat3k_caa-universalk9.16.06.01.SPA.bin
Delete filename [cat3k_caa-universalk9.16.06.01.SPA.bin]?
Delete flash:/cat3k_caa-universalk9.16.06.01.SPA.bin? [confirm]
Switch#
Upgrading from Cisco IOS XE 3.xE to Cisco IOS XE Denali 16.x.x, or Cisco IOS XE
Everest 16.6.x in Bundle Mode
Follow these instructions to upgrade from Cisco IOS XE 3.xE to Cisco IOS XE Denali 16.x.x, or Cisco
IOS XE Everest 16.6.x in bundle mode:
Note You cannot boot Cisco IOS XE Denali 16.x.x or Cisco IOS XE Everest 16.x.x via TFTP for the first time
with a Cisco IOS XE 3.xE boot loader. The Cisco IOS XE 3.xE boot loaders have a limitation, which
prevents the booting of an image larger than 400MB via the TFTP server. Since Cisco IOS XE Denali
16.x.x and Cisco IOS XE Everest 16.x.x images are larger than 400MB, you must boot the image via
flash.
Step 1 Make sure your TFTP server is reachable from IOS via GigabitEthernet0/0.
Switch# show run | i tftp
ip tftp source-interface GigabitEthernet0/0
ip tftp blocksize 8192
Switch#
Switch# show run | i ip route vrf
ip route vrf Mgmt-vrf 5.0.0.0 255.0.0.0 5.30.0.1
Switch#
Switch#show run int GigabitEthernet0/0
Building configuration...
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
24
Upgrading the Switch Software
Note If you have a stack, you must copy the image to the flash of each switch in your stack.
Step 3 Use the dir flash command to confirm that the image has been successfully copied to flash.
Switch#dir flash:*.bin
Directory of flash:/
Step 6 Use the write memory command to save the configuration change.
Switch# write memory
Step 7 Use the show boot command to confirm that your boot variable is pointing to the new image
Switch#show boot
---------------------------
Switch 1
---------------------------
Current Boot Variables:
BOOT variable = flash:cat3k_caa-universalk9.16.06.01.SPA.bin;
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
25
Upgrading the Switch Software
Reload
Step 8 Reload the switch
Switch# reload
Step 9 If your switches are configured with auto boot, the stack will automatically boot up with the new image.
If not, you can manually boot flash: cat3k_caa-universalk9.16.06.01a.SPA.bin
switch:boot flash:cat3k_caa-universalk9.16.06.01.SPA.bin
Note When you boot the new image, it will automatically update the boot loader.
Step 10 When the new image boots up, you can verify the version of the new image, by checking show version
Switch# show version
Cisco IOS XE Software, Version 16.06.01
Cisco IOS Software [Everest], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M),
Version 16.6.1, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2017 by Cisco Systems, Inc.
Compiled Sat 22-Jul-17 03:00 by mcpre
Move from Cisco IOS XE Everest 16.x.x Bundle Mode to Install Mode
Step 11 Ensure you have enough space in flash to expand a new image by cleaning up old installation files. This
command will erase your Cisco IOS XE Everest 16.x.x bin image file, so ensure that you copy it to your
Active again.
Note Use the switch all option to clean up all switches in your stack.
Switch# request platform software package clean switch all file flash:
Running command on switch 1
Cleaning up unnecessary package files
Scanning boot directory for packages ... done.
Preparing packages list to delete ...
done.
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
26
Upgrading the Switch Software
[1]:
/flash/cat3k_caa-base.SPA.03.07.02E.pkg
/flash/cat3k_caa-drivers.SPA.03.07.02E.pkg
/flash/cat3k_caa-infra.SPA.03.07.02E.pkg
/flash/cat3k_caa-iosd-universalk9.SPA.152-3.E2.pkg
/flash/cat3k_caa-platform.SPA.03.07.02E.pkg
/flash/cat3k_caa-universalk9.16.01.01.SPA.bin
/flash/cat3k_caa-wcm.SPA.10.3.120.0.pkg
/flash/packages.conf
[2]:
/flash/cat3k_caa-base.SPA.03.07.02E.pkg
/flash/cat3k_caa-drivers.SPA.03.07.02E.pkg
/flash/cat3k_caa-infra.SPA.03.07.02E.pkg
/flash/cat3k_caa-iosd-universalk9.SPA.152-3.E2.pkg
/flash/cat3k_caa-platform.SPA.03.07.02E.pkg
/flash/cat3k_caa-universalk9.16.01.01.SPA.bin
/flash/cat3k_caa-wcm.SPA.10.3.120.0.pkg
/flash/packages.conf
[3]:
/flash/cat3k_caa-base.SPA.03.07.02E.pkg
/flash/cat3k_caa-drivers.SPA.03.07.02E.pkg
/flash/cat3k_caa-infra.SPA.03.07.02E.pkg
/flash/cat3k_caa-iosd-universalk9.SPA.152-3.E2.pkg
/flash/cat3k_caa-platform.SPA.03.07.02E.pkg
/flash/cat3k_caa-universalk9.16.01.01.SPA.bin
/flash/cat3k_caa-wcm.SPA.10.3.120.0.pkg
/flash/packages.conf
[4]:
/flash/cat3k_caa-base.SPA.03.07.02E.pkg
/flash/cat3k_caa-drivers.SPA.03.07.02E.pkg
/flash/cat3k_caa-infra.SPA.03.07.02E.pkg
/flash/cat3k_caa-iosd-universalk9.SPA.152-3.E2.pkg
/flash/cat3k_caa-platform.SPA.03.07.02E.pkg
/flash/cat3k_caa-universalk9.16.01.01.SPA.bin
/flash/cat3k_caa-wcm.SPA.10.3.120.0.pkg
/flash/packages.conf
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
27
Upgrading the Switch Software
Step 13 Use the request platform software package expand switch all file flash:image.bin auto-copy
command to expand the target image to flash and move from bundle mode to install mode. You can point
to the source image on your TFTP server or in flash if you have it copied to flash.
Note Use the switch all option to upgrade all switches in your stack
Use the auto-copy option to copy the .bin image from flash: to all other switches in your stack
Step 16 Use the write memory command to save the configuration change.
Switch# write memory
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
28
Upgrading the Switch Software
Step 17 Use the show boot command to confirm that your boot variable is pointing to the new image
Switch# show boot
---------------------------
Switch 1
---------------------------
Current Boot Variables:
BOOT variable = flash:packages.conf;
Reload
Step 18 Reload the switch
Switch# reload
Step 19 If your switches are configured with auto boot, the stack will automatically boot up with the new image.
If not, you can manually boot flash:packages.conf
switch:boot flash:packages.conf
Step 20 When the new image boots up, you can verify the version of the new image, by checking show version
Switch#show version
Cisco IOS XE Software, Version 16.06.01
Cisco IOS Software [Everest], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M),
Version 16.6.1, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2017 by Cisco Systems, Inc.
Compiled Sat 22-Jul-17 03:00 by mcpre
Upgrading from Cisco IOS XE Denali 16.x.x to Cisco IOS XE Everest 16.6.x in
Install Mode
Follow these instructions to upgrade from Cisco IOS XE Denali 16.x.x to Cisco IOS XE Everest 16.6.x
in install mode. In order to do a software image upgrade, you must be booted into IOS using the boot
flash:packages.conf.
Clean Up
Step 1 Ensure you have enough space in flash to expand a new image by cleaning up old installation files.
Note Use the switch all option to clean up all switches in your stack.
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
29
Upgrading the Switch Software
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
30
Upgrading the Switch Software
Step 3 Use the dir flash command to confirm that the image has been successfully copied to flash.
Switch# dir flash:*.bin
Directory of flash:/
Note Use the switch all option to upgrade all switches in your stack
You must use the new option when you upgrade from Cisco IOS XE Denali 16.1.x, 16.2.x or
16.3.1 to Cisco IOS XE Everest 16.5.1a. (There are packaging changes in the different 16.x.x
releases.)
Use the auto-copy option to copy the .bin image from flash: to all other switches in your stack
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
31
Upgrading the Switch Software
Note When you execute the command, the following message is displayed:
Unknown package type 21
This is expected and does not affect the upgrade. See CSCux82059
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
32
Upgrading the Switch Software
Removed cat3k_caa-webui.16.01.01E.SPA.pkg
New files list:
Added cat3k_caa-rpbase.16.06.01.SPA.pkg
Added cat3k_caa-rpcore.16.06.01.SPA.pkg
Added cat3k_caa-srdriver.16.06.01.SPA.pkg
Added cat3k_caa-guestshell.16.06.01.SPA.pkg
Added cat3k_caa-webui.16.06.01.SPA.pkg
Finished list of software package changes
SUCCESS: Software provisioned. New software will load on reboot.
[3]: Finished install successful on switch 3
[4]: install package(s) on switch 4
--- Starting list of software package changes ---
Old files list:
Removed cat3k_caa-rpbase.16.01.01E.SPA.pkg
Removed cat3k_caa-srdriver.16.01.01E.SPA.pkg
Removed cat3k_caa-wcm.16.01.01E.SPA.pkg
Removed cat3k_caa-webui.16.01.01E.SPA.pkg
New files list:
Added cat3k_caa-rpbase.16.06.01.SPA.pkg
Added cat3k_caa-rpcore.16.06.01.SPA.pkg
Added cat3k_caa-srdriver.16.06.01.SPA.pkg
Added cat3k_caa-guestshell.16.06.01.SPA.pkg
Added cat3k_caa-webui.16.06.01.SPA.pkg
Finished list of software package changes
SUCCESS: Software provisioned. New software will load on reboot.
[4]: Finished install successful on switch 4
Checking status of install on [1 2 3 4]
[1 2 3 4]: Finished install in switch 1 2 3 4
SUCCESS: Finished install: Success on [1 2 3 4]
Switch#
Note Old files listed in the logs will not be removed from flash.
Step 5 After you have successfully installed the software, verify that the flash partition has five new .pkg files
and one updated packages.conf file. See sample output below:
Switch# dir flash:*.pkg
Directory of flash:/*.pkg
Directory of flash:/
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
33
Upgrading the Switch Software
Step 6 After you have successfully installed the image, you no longer need the.bin image. If you copied the file
to flash
1. Enter the dir flash:*.bin command to check if it is still saved in the the flash of each switch.
2. If an image is still saved, you can delete it, if not, it has been deleted as part of the install
operation and you can skip this step.
Switch# dir flash:*.bin
Directory of flash:/
Switch#
Switch# delete flash:cat3k_caa-universalk9.16.06.01.SPA.bin
Delete filename [cat3k_caa-universalk9.16.06.01.SPA.bin]?
Delete flash:/ cat3k_caa-universalk9.16.06.01.SPA.bin? [confirm]
Switch#
Reload
Step 7 Reload the switch.
Switch# reload
Step 8 If the switch is configured with auto boot, then the stack automatically boots up with the new image. If
not, you can manually boot flash:packages.conf
switch:boot flash:packages.conf
Step 9 When the new image boots up, you can verify the version of the new image, by using the show version
command:
Switch# show version
Cisco IOS XE Software, Version 16.06.01
Cisco IOS Software [Everest], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M),
Version 16.6.1, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2017 by Cisco Systems, Inc.
Compiled Sat 22-Jul-17 03:00 by mcpre
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
34
Upgrading the Switch Software
Upgrading from Cisco IOS XE Everest 16.6.x to Cisco IOS XE 16.x.x in Install
Mode
Follow these instructions to upgrade from Cisco IOS XE Everest 16.6.x to a future IOS XE 16.x.x release
in Install mode. In order to do a software image upgrade, you must be booted into IOS via “boot
flash:packages.conf.”
Clean Up
Step 1 Ensure you have enough space in flash to expand a new image by cleaning up old installation files.
Note Use the switch all option to clean up all switches in your stack.
Switch# request platform software package clean switch all file flash:
Running command on switch 1
Cleaning up unnecessary package files
Scanning boot directory for packages ... done.
Preparing packages list to delete ...
packages.conf
File is in use, will not delete.
cat3k_caa-rpbase.16.06.01.SPA.pkg
File is in use, will not delete.
cat3k_caa-rpcore.16.06.01.SPA.pkg
File is in use, will not delete.
cat3k_caa-srdriver.16.06.01.SPA.pkg
File is in use, will not delete.
cat3k_caa-guestshell.16.06.01.SPA.pkg
File is in use, will not delete.
cat3k_caa-webui.16.06.01.SPA.pkg
File is in use, will not delete.
done.
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
35
Upgrading the Switch Software
Step 3 Use the dir flash command to confirm that the image has been successfully copied to flash.
Switch# dir flash:*.bin
Directory of flash:/*.bin
Directory of flash:/
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
36
Upgrading the Switch Software
Switch#
Note Use the switch all option to upgrade all switches in your stack
Use the auto-copy option to copy the .bin image from flash: to all other switches in your stack
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
37
Upgrading the Switch Software
Added cat3k_caa-rpbase.16.08.01.SPA.pkg
Added cat3k_caa-rpcore.16.08.01.SPA.pkg
Added cat3k_caa-srdriver.16.08.01.SPA.pkg
Added cat3k_caa-guestshell.16.08.01.SPA.pkg
Added cat3k_caa-webui.16.08.01.SPA.pkg
Finished list of software package changes
SUCCESS: Software provisioned. New software will load on reboot.
[2]: Finished install successful on switch 2
[3]: install package(s) on switch 3
--- Starting list of software package changes ---
Old files list:
Removed cat3k_caa-rpbase.16.06.01.SPA.pkg
Removed cat3k_caa-rpcore.16.06.01.SPA.pkg
Removed cat3k_caa-srdriver.16.06.01.SPA.pkg
Removed cat3k_caa-guestshell.16.06.01.SPA.pkg
Removed cat3k_caa-webui.16.06.01.SPA.pkg
New files list:
Added cat3k_caa-rpbase.16.08.01.SPA.pkg
Added cat3k_caa-rpcore.16.08.01.SPA.pkg
Added cat3k_caa-srdriver.16.08.01.SPA.pkg
Added cat3k_caa-guestshell.16.08.01.SPA.pkg
Added cat3k_caa-webui.16.08.01.SPA.pkg
Finished list of software package changes
SUCCESS: Software provisioned. New software will load on reboot.
[3]: Finished install successful on switch 3
[4]: install package(s) on switch 4
--- Starting list of software package changes ---
Old files list:
Removed cat3k_caa-rpbase.16.06.01.SPA.pkg
Removed cat3k_caa-rpcore.16.06.01.SPA.pkg
Removed cat3k_caa-srdriver.16.06.01.SPA.pkg
Removed cat3k_caa-guestshell.16.06.01.SPA.pkg
Removed cat3k_caa-webui.16.06.01.SPA.pkg
New files list:
Added cat3k_caa-rpbase.16.08.01.SPA.pkg
Added cat3k_caa-rpcore.16.08.01.SPA.pkg
Added cat3k_caa-srdriver.16.08.01.SPA.pkg
Added cat3k_caa-guestshell.16.08.01.SPA A.pkg
Added cat3k_caa-webui.16.08.01.SPA.pkg
Finished list of software package changes
SUCCESS: Software provisioned. New software will load on reboot.
[4]: Finished install successful on switch 4
Checking status of install on [1 2 3 4]
[1 2 3 4]: Finished install in switch 1 2 3 4
SUCCESS: Finished install: Success on [1 2 3 4]
Switch#
Note Old files listed in the logs will not be removed from flash.
Step 5 After the software has been successfully installed, verify that the flash partition has five new .pkg files
and 1 updated packages.conf file. See sample output below.
Switch# dir flash:*.pkg
Directory of flash:/*.pkg
Directory of flash:/
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
38
Upgrading the Switch Software
Directory of flash:/
Reload
Step 6 Reload the switch
Switch# reload
Step 7 If your switches are configured with auto boot, then the stack will automatically boot up with the new
image. If not, you can manually boot flash:packages.conf
switch: boot flash:packages.conf
Note When you boot the new image, it will automatically update the boot loader.
Step 8 When the new image boots up, you can verify the version of the new image, using the show version
command.
Downgrade from Cisco IOS XE 16.x.x to Cisco IOS XE 3.xE in Install Mode
Follow these instructions to downgrade from Cisco IOS XE 16.x.x to older Cisco IOS XE 3.xE releases
in Install Mode.
Clean Up
Step 1 Ensure you have enough space in flash to expand a new image by cleaning up old installation files.
Note Use the switch all option to clean up all switches in your stack.
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
39
Upgrading the Switch Software
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
40
Upgrading the Switch Software
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
41
Upgrading the Switch Software
Step 3 Use the dir flash command to confirm that the image has been successfully copied to flash.
Switch# dir flash:*.bin
Directory of flash:/*.bin
Directory of flash:/
Note Use the switch all option is needed to upgrade all switches in your stack.
Use the auto-copy option to copy the .bin image from flash: to all other switches in your stack.
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
42
Upgrading the Switch Software
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
43
Upgrading the Switch Software
Note The old files listed in the logs should be removed using the software clean command, after reload
Step 5 After you have successfully installed the image, you no longer need the .bin image and the file can be
deleted from flash of each switch if you copied it to flash.
Switch# delete flash: cat3k_caa-universalk9.SPA.03.07.02.E.152-3.E2.bin
Delete filename [cat3k_caa-universalk9.SPA.03.07.02.E.152-3.E2.bin]?
Delete flash:/ cat3k_caa-universalk9.SPA.03.07.02.E.152-3.E2.bin? [confirm]
Switch#
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
44
Upgrading the Switch Software
Reload
Step 6 Reload the switch
Switch# reload
Step 7 If your switches are configured with auto boot, then the stack will automatically boot up with the new
image. If not, you can manually boot flash:packages.conf
Switch: boot flash:packages.conf
Note When you downgrade to a Cisco IOS XE 3.xE image, your boot loader will not automatically
downgrade. It will remain updated. The new boot loader can support booting both Cisco IOS XE 3.xE
releases as well as Cisco IOS XE Denali 16.x.x and Cisco IOS XE Everest 16.x.x releases.
Downgrade from Cisco IOS XE 16.x.x to Cisco IOS XE 3.xE in Bundle Mode
Follow these instructions to downgrade from Cisco IOS XE 16.x.x in Bundle mode to an older Cisco IOS
XE 3.xE release in Bundle mode.
Step 1 Make sure your TFTP server is reachable from IOS via GigabitEthernet0/0.
Switch# show run | i tftp
ip tftp source-interface GigabitEthernet0/0
ip tftp blocksize 8192
Switch#
Switch# show run | i ip route vrf
ip route vrf Mgmt-vrf 5.0.0.0 255.0.0.0 5.30.0.1
Switch#
Switch#show run int GigabitEthernet0/0
Building configuration...
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
45
Upgrading the Switch Software
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!O!!!!!!!!!!
!
!!!!!!!!!!!!!!
[OK - 311154824 bytes]
Note If you have a stack, you must copy the image to the flash of each switch in your stack.
Step 3 Use the dir flash command to confirm that the image has been successfully copied to flash.
Switch# dir flash:*.bin
Directory of flash:/*.bin
Directory of flash:/
Step 6 Use the write memory command to save the configuration change.
Switch# write memory
Step 7 Use the show boot command to confirm that your boot variable is pointing to the new image
Switch# show boot
---------------------------
Switch 1
---------------------------
Current Boot Variables:
BOOT variable = flash:cat3k_caa-universalk9.SPA.03.07.02.E.152-3.E2.bin;
Reload
Step 8 Reload the switch
switch# reload
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
46
Upgrading the Switch Software
Step 9 If your switches are configured with auto boot, the stack will automatically boot up with the new image.
If not, you can manually boot flash:cat3k_caa-universalk9.SPA.03.07.02.E.152-3.E2.bin
switch:boot flash:cat3k_caa-universalk9.SPA.03.07.02.E.152-3.E2.bin
Note When you downgrade to a Cisco IOS XE 3.xE image, your boot loader will remain updated, and will
automatically be downgraded. The new boot loader can support booting both Cisco IOS XE 3.x releases
as well as Cisco IOS XE Denali 16.x.x and Cisco IOS XE Everest 16.x.x releases..
Step 10 When the new image boots up, you can verify the version of the new image, by checking show version
Switch# show version
Cisco IOS Software, IOS-XE Software, Catalyst L3 Switch Software
(CAT3K_CAA-UNIVERSALK9-M), Version 03.07.02E RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2015 by Cisco Systems, Inc.
Compiled Tue 21-Jul-15 12:51 by prod_rel_team
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
47
Upgrading the Switch Software
Step 13 Use the software expand command to expand the target image to flash and move from bundle mode to
install mode. You can point to the source image on your TFTP server or in flash if you have it copied to
flash.
Switch# software expand file flash:cat3k_caa-universalk9.SPA.03.07.02.E.152-3.E2.bin
Preparing expand operation ...
[1]: Copying software from active switch 1 to switches 2,3,4
[1]: Finished copying software to switches 2,3,4
[1 2 3 4]: Expanding bundle flash:cat3k_caa-universalk9.SPA.03.07.02.E.152-3.E2.bin
[1 2 3 4]: Copying package files
[1 2 3 4]: Package files copied
[1 2 3 4]: Finished expanding bundle
flash:cat3k_caa-universalk9.SPA.03.07.02.E.152-3.E2.bin
Switch#
Step 16 Use the write memory command to save the configuration change.
Switch# write memory
Step 17 Use the show boot command to confirm that your boot variable is pointing to the new image
Switch# show boot
---------------------------
Switch 1
---------------------------
Current Boot Variables:
BOOT variable = flash:packages.conf;
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
48
Upgrading the Switch Software
Reload
Step 18 Reload the switch
Switch#reload
Step 19 If your switches are configured with auto boot, the stack will automatically boot up with the new image.
If not, you can manually boot flash:packages.conf
switch:boot flash:packages.conf
Step 20 When the new image boots up, you can verify the version of the new image, by checking show version
Switch# show version
Cisco IOS Software, IOS-XE Software, Catalyst L3 Switch Software
(CAT3K_CAA-UNIVERSALK9-M), Version 03.07.02E RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2015 by Cisco Systems, Inc.
Compiled Tue 21-Jul-15 12:51 by prod_rel_team
Step 21 After you have successfully installed the image, you no longer need the .bin image and the file can be
deleted from the flash of each switch if you had copied to flash.
Switch# delete flash:cat3k_caa-universalk9.SPA.03.07.02.E.152-3.E2.bin
Delete filename [cat3k_caa-universalk9.SPA.03.07.02.E.152-3.E2.bin]?
Delete flash:/cat3k_caa-universalk9.SPA.03.07.02.E.152-3.E2.bin? [confirm]
Switch#
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
49
Upgrading the Switch Software
Changing the License Level of License Mismatch Switch from Active’s Console
If the license mismatch switch has a lower license level than other switches in the stack, and the stack is
running at IP Services and the mismatch switch is booted with IP Base license.
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
50
Feature Sets
If the license mismatch switch has a higher license level than other switches in the stack, and the stack
is running at IP Base and the mismatch switch is booted with IP Services license.
Feature Sets
The Cisco Catalyst 3650 Series Switches supports three different feature sets:
• LAN Base feature set—Provides basic Layer 2+ features, including access control lists (ACLs) and
quality of service (QoS), up to 255 VLANs, support for routing protocols (Routing Information
Protocol (RIP), Open Shortest Path First (OSPF), Policy-Based Routing (PBR), Protocol
Independent Multicast Stub Routing (PIM Stub Routing) with IPv4 and IPv6, and routed access with
IPv4 and IPv6 (OSPF — up to 1000 routes, Multicast — up to 1000 routes).
• IP Base feature set—Provides Layer 2+ and basic Layer 3 features (enterprise-class intelligent
services). These features include access control lists (ACLs), quality of service (QoS), static routing,
Enhanced Interior Gateway Routing Protocol (EIGRP) stub routing, IP multicast routing, RIP, basic
IPv6 management, the OSPF Protocol (for routed access only). The license supports up to 4094
VLANs.
• IP Services feature set—Provides a richer set of enterprise-class intelligent services and full IPv6
support. It includes all IP Base features plus full Layer 3 routing (IP unicast routing, IP multicast
routing, and fallback bridging for only IP traffic). The IP Services feature set includes protocols such
as the EIGRP, OSPF Protocol. The license supports up to 4094 VLANs.
For more information about the features, see the product data sheet at this URL:
http://www.cisco.com/en/US/products/ps13133/products_data_sheets_list.html
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
51
Scaling Guidelines
Scaling Guidelines
Table 6 Scaling Guidelines
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
52
Caveats
• When a logging discriminator is configured and applied to a device, memory leak is seen under
heavy syslog or debug output. The rate of the leak is dependent on the quantity of logs produced. In
extreme cases, the device may crash. As a workaround, disable the logging discriminator on the
device.
• When the device is running SCP (Secure Copy Protocol) and SSH cryptographic operations, expect
high CPU until the SCP read process is completed. SCP supports file transfers between hosts on a
network and uses SSH for the transfer.
Since SCP and SSH operations are currently not supported on the hardware crypto engine, running
encryption and decryption process in software causes high CPU. The SCP and SSH processes can
show as much as 40 or 50 percent CPU usage, but they do not cause the device to shutdown.
Caveats
Caveats describe unexpected behavior in Cisco IOS releases. Caveats listed as open in a prior release are
carried forward to the next release as either open or resolved.
• Cisco Bug Search Tool, page 53
• Open Caveats in Cisco IOS XE Everest 16.6.x, page 53
• Resolved Caveats in Cisco IOS XE Everest 16.6.1, page 54
Identifier Description
CSCve03476 DHCP relayed packets not forwarded when DHCP snooping is enabled on the switch.
Identifier Description
CSCvd47737 Catalyst 3650 -missing/not able to poll- dot1dStaticTable within BRIDGE-MIB.
CSCve48888 Catalyst 3650 switch getting noisy after few weeks.
CSCve88714 Stack member crash on disconnecting one stack cable.
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
53
Caveats
Identifier Description
CSCvf33073 WS-C3650-24PD: Traffic does not resume after SFP OIR.
CSCvf39197 Mac not learn for VLAN 325 with port security enabled.
CSCvf47917 [ECA-SIT] Ping failed between wired and wireless client for above 140 bytes.
CSCvf75518 Controller port error interface.
CSCvf99697 WS-C3650-48FQM-E running Cisco IOS XE Denali 16.3.3 keeps generating FRU
alarms.
Identifier Description
CSCuw59595 Cannot get expected packet rate for PQ in output QoS policy
CSCva90016 Rx/Tx LPI Status on the verification of EEE is none instead of Low Power
CSCvb91970 3850 Switch Crash in the FED Process
CSCvc20807 16.3.3: MPLS over Macsec is not working
CSCvc63975 Ping fails with RSPAN configured when SRC and DEST (remote-span) vlans are
allowed on the same trunk
CSCvc72794 16.3.3: SV: SV stack split to dual active randomly
CSCvc83011 WDAVC: Cisco-jabber-audio & ms-lync protocol becomes unknown on WS-C3850
CSCvc85100 3850 Should not install Policy Map that has a Table-map action in police used with
priority feature
CSCvc96706 Denali 16.3.2 not providing PoE after bouncing the port.
CSCvc97252 PTP neighbor p-delay values are fluctuating b/w nano seconds to hours with Audio
science MINI
CSCvd01545 MSTP is blocked on trunk when native vlan does not exist
CSCvd03465 Switch prevents updating MAC address in multi-host mode
CSCvd05280 DBM Crash on Active Switch while changing DCA channels
CSCvd20857 3850 Stack may reload when making config changes
CSCvd21642 SIT [FED2.0 2/16 image]: MKA-128: 3850CR-CSR traffic failing after rekey
CSCvd33197 Denali: 3850 Uplink port goes down after reload due to udld err-Disable on remote
end
CSCvd33716 16.3.3 REP: multicast flooding seen with node reload and link flap on the REP ring
CSCvd42535 "mtu 17892" is automatically created under LISP0 interface with system mtu cfg
CSCvd70351 MVPN: Traffic not resumed after switchover
CSCvd71236 LISP: PIM-SM_ Registration Process was not Successful between RP and Source of
Multicast
CSCve29218 4X10G Uplink interface in 3850-48P switch doesn't come up during boot, happens
very infrequently.
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
54
Caveats
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
55
Troubleshooting
Troubleshooting
For the most up-to-date, detailed troubleshooting information, see the Cisco TAC website at this URL:
http://www.cisco.com/en/US/support/index.html
Choose Product Support > Switches. Then choose your product and click Troubleshoot and Alerts to
find information for the problem that you are experiencing.
Related Documentation
• Cisco IOS XE Denali 16.x.x documentation at this URL:
http://www.cisco.com/c/en/us/products/ios-nx-os-software/ios-xe/index.html
• Catalyst 3650 switch documentation at this URL:
http://www.cisco.com/go/cat3650_docs
• Error Message Decoder at this URL:
https://www.cisco.com/cgi-bin/Support/Errordecoder/index.cgi
Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of
Cisco trademarks, go to this URL: www.cisco.com/go/trademarks. Third-party trademarks mentioned are the property of their respective owners. The
use of the word partner does not imply a partnership relationship between Cisco and any other company. (1721R)
Any Internet Protocol (IP) addresses and phone numbers used in this document are not intended to be actual addresses and phone numbers. Any
examples, command display output, network topology diagrams, and other figures included in the document are shown for illustrative purposes only.
Any use of actual IP addresses or phone numbers in illustrative content is unintentional and coincidental.
Release Notes for Cisco Catalyst 3650 Series Switches, Cisco IOS XE Everest 16.6.x
56