San Migration Guide
San Migration Guide
Version 1.1
Asia-Pacific Headquarters
Shiroyama JT Trust Tower 36th Floor
4-3-1 Toranomon, Minato-ku
Tokyo, Japan 105-6036
T: +81 35402 5300
F: +81 35402 5399
Email: [email protected]
European Headquarters
29, route de l’Aeroport
Case Postale 105
CH-1211 Geneva 15,
Switzerland
T: +41 22 799 56 40
F: +41 22 799 56 41
Email: [email protected]
Preface
Appendix C Glossary
Terms and Definitions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . C-1
Intended Audience
This document is intended for use by systems administrators and technicians experienced with networking, Fibre Channel, and
SAN technologies.
Scope
The purpose of this document is to assist in planning a successful migration path that will either completely avoid or minimize
the fabric disruption and downtime. The following issues are addressed:
• Minimizing or eliminating fabric operation and I/O interruption during migration
• Understanding the current fabric environment
• Impact to fabric operation impact
• Core PID Format considerations
• Operational requirements
• Managing Hard zoning based on PID
• Persistent bindings based on PID
The following is not included in the scope of this document:
• Fabric Manager
• Third-party software
• Case studies
Core PID format The 24-bit Switch Fabric Port Identification (PID) also known as SID consists of Domain ID,
Area and AL_PA fields.
Fabric One or more interconnected Fibre Channel switches. The term “Fabric” only refers to the
interconnected switches, not to nodes or devices connected to the fabric.
Fabric build The build fabric Switch Fabric Internal Link Service requests a non-disruptive configuration to
the entire fabric. A BF process shall not cause the Domain ID list to be cleared. This preserves
(BF)
existing node port addresses and allows open exchanges to be completed.
Impact: Fabric build is a non-disruptive process.
Fabric re-configuration Fabric reconfiguration is a disruptive fabric operation during which Domain IDs may change. If
(RCF) the Domain ID changes, all attached node ports must re-log in with the fabric and be assigned new
N-Ports identifiers reflecting the change in Domain IDs.
Impact: Reconfigure causes Class-n frames (1,2,3,4 or 6) to be discarded and class 1 connection
to be abnormally removed.
Fabric Segmentation A fabric is unable to resolve the switch configuration parameters during the rebuild process with
one or more switches, and may isolate them from the fabric, causing fabric segmentation.
Impact: I/O operations are ceased only on those devices losing their access due to
segmentation.
Fabric topology A topology is “the logical layout of the components of a computer system or network and their
interconnections.” A fabric topology is the layout of the switches that form a fabric.
Online Fabric A functional stable state of a fabric performing reliable I/O fabric operations.
PID bindings Static mapping between physical and logical devices on a host accomplished via Port_ID (PID).
Redundant Fabric A SAN composed of two or more independent fabrics The multiple fabric architecture makes dual
fabric SANs redundant.
Impact: SAN topology configured to provide two or more alternate paths for high
availability.
SAN A Storage Area Network (SAN) can consist of one or more related fabrics and the connected
nodes.
SAN Architecture The overall design or structure of a storage area network solution. This includes one or more
related fabrics, each of which has a topology. Other components may also be included, such as
host, storage, and other SAN devices.
Single Fabric A SAN composed of a single fabric may be configured to provide one or more paths via different
switches of the fabric.
Impact: Offers no Protection at fabric level. All paths are closed when fabric is offline,
completely stopping I/Os.
Formatting
The following table describes the formatting conventions that are used in this book:
Convention Purpose
Brocade Documentation
The following related publications are provided on the Brocade Documentation CD-ROM and on the Brocade Partner
web site. To access Brocade Partner web site go to www.brocade.com and click on the partner login link.
• Brocade Fabric OS documentation
- Brocade Fabric OS Procedures Guide
- Brocade Fabric OS Reference
• Brocade Fabric OS optional features documentation
- Brocade Performance Monitoring User's Guide
- Brocade Zoning User's Guide
- Brocade Web Tools User's Guide
- Brocade Distributed Fabrics User's Guide
- Brocade Fabric Watch User’s Guide
- Brocade ISL Trunking User's Guide
- Brocade Secure Fabric OS® User's Guide
- Brocade QuickLoop User's Guide (v 3.1 only)
• Brocade Hardware documentation
- Brocade SilkWorm 12000 Hardware Reference
- Brocade SilkWorm 3900 Hardware Reference
- Brocade SilkWorm 3800 Hardware Reference
1.1. Introduction
Brocade’s high speed (2 Gbit/sec) SilkWorm 3800, 3900, and 12000 switches are enhanced with rich management,
availability, and security features that are fundamental building blocks of today’s SAN. The benefits of upgrading an existing
1 Gbit/sec 2000 series switch to high bandwidth 2 Gbit/sec technology, or upgrading lower port count switches (such as the
SilkWorm 2000 series, 3200, and 3800) to higher port count switches, are significant. One of the major advantages of using a
Brocade switch fabric is backward compatibility across all Brocade platforms. New models of Brocade switches can be
introduced in a seamless fashion into an existing environment while preserving the investment in existing switches.
Migrating from an existing operational SAN requires careful consideration to ensure a seamless migration with minimum or
no impact to ongoing SAN operations. It is crucial to obtain a clear understanding of the existing SAN and application
environment. This information is required to develop a successful migration strategy. With proper planning, an existing fabric
can be replaced or incrementally upgraded with Brocade’s 2 Gbit/sec SilkWorm switches without adversely affecting fabric
operations and I/O.
Table 1-1
Migrating From TO
1 Gbit/sec 2000 SilkWorm Series Model 2 Gbit/sec SilkWorm 3800, 3900, 12000
Brocade Fabric OS V2.x Brocade Fabric OS V3.x/4.x
Note: The migration procedures detailed in this document are applicable to both 1 Gbit/sec switches (SilkWorm 2000 series)
and lower port count 2 Gbit/sec switches (SilkWorm 3800, 3200).
SAN Migration
PROCESS OVERVIEW
SAN Architecture
Assess the SAN
targeted for Logistics- Rack space. Power and Cable
migration Host rebooting consideration
(Chapter 2) Existing Switch configuration
yes
Prepare SAN to perform one or more of
the following steps if required.
Perform the FOS upgrade
necessary Core PID Format Update
migration
pre-requisites
Persistent binding PID method
(Chapter 5) Host reboot
FabricAssessm ent
Is auto-
Is FOS Any plan Name, IP
negotiation
to upgrade Enough
suf f icient ? upgrade Domain. setup
HBA to power? consideration
required?
2Gbit/sec?
What is
Any other Is Host
trunking Necessary
conf iguration, reboot
strategy ? cables
parameters acceptable if
ready ?
update? required? = Critical items
What is the
zone import
strategy to the
2 Gbit f abric?
Host Host
Storage
Storage
SingleFabric,Resilient
SingleFabricConfiguration Configuration
Host
Fabric-A Fabric-B
Storage
RedundantFabricConfiguration
2.2.3. Trunking
Trunking is a 2 Gbit/sec switch feature that offers to increase the inter-switch link (ISL) bandwidth up to 8 Gbit/sec, depending
on the number of configured ISLs in trunk. Each ASIC supports four fabric ports, therefore, a trunk can be constructed using
two or more ports with in a single ASIC. The trunking group is identified by the trunk master that represents the entire group.
The rest of the group members are referred to as slave links that help the trunking master direct traffic across ISLs, allowing
efficient and balanced in-order communication.
• All trunking group ports must be running on same speed (2Gbit/sec)
• All trunking group ports must have the same “deskew timer” which can be effectively controlled by keeping the
difference in connecting cable lengths to less that 30 meters.
• Port Trunking is enabled between adjacent switches that support trunking.
The advantage of trunking is the increase in bandwidth by utilizing the entire trunk group as a single ISL. If your existing
fabric is approaching a bandwidth limit, this is a good time to plan your trunking strategy.
Note: Trunking is not supported in Fabric OS 2.x, therefore a trunk cannot be constructed between 1 Gbit/sec and 2 Gbit/sec
switches.
Note: Reference the Core Switch PID Format Update Best Practices (publication number: 53-0001626-01) for detail about
Core PID settings.
The PID format on switches running Fabric OS v2.x and V3.x could originally only support a maximum of 16 ports in one
switch. The 24-bit port address format consists of three bytes defining the Domain identifier, Area address and AL_PA fields
respectively. Each field can provide 00-FF addressing. The Domain ID field byte provides Domain addressing 1-132. The
three byte fields of the old PID format were defined as XX1YZZ, where “Y” was a hexadecimal number that specified a
particular port on a switch and “1” was a constant. When Brocade developed the ASIC for the SilkWorm 2000 series switch,
the largest switch had 16 ports, so only half of the second byte in the Area field of PID was required to specify ports. In
addition, the interpretation of the standard by Brocade was that a non-zero value for the address byte was required, so one bit
of the unused nibble of that byte was set to “1”.
To support the increased port count on the higher port count products, based on Brocade Fabric OS V4.x, the new format
XXYYZZ has been adopted as per standard, where byte “YY” represents a port. Using the entire middle byte for the port
allows Brocade switches to scale up to the Fibre Channel standard maximum of 256 ports per switch.
To ensure inter-operability between Fabric OS v4.x based products and Fabric OS v2.x and v3.x based products, while
maintaining compatibility with older firmware versions, a setting was created to enable the PID format to be set to use either
the new format or the old format. This is commonly known as the Core Switch PID Format setting.
Guideline: In a redundant fabric environment, it is possible to perform a Core PID upgrade without interruption to
I/O as long as no changes to the host HBA bindings is necessary.
Note: The default Core PID setting for SilkWorm 3900 and 12000 switches is a Core PID format of 1. To prevent the fabric
from segmenting, it is necessary to set the Core PID Format setting to 1 on the SilkWorm 3800, 3200, or 2000 Series
switches in a fabric with a SilkWorm 3900 or 12000.
Note: The default Core PID setting for SilkWorm 3800, 3200,and 2000 Series switches is Core PID Format-0.
Verify the Core PID Format from the configshow output by referring to the “fabric.ops.mode.pidFormat” parameter.
Refer to the Core PID Upgrade Procedure on page 5-1 for the procedure to change the Core PID Format to 1.
Note: The persistent binding entry of the HBA configuration file must be manually updated to the new PID. The HBA
configuration file update becomes effective only after a host reboot. Some versions of host Operating Systems have a
relationship with the PID and it is necessary to issue host OS commands to recognize a new PID. Under these
circumstances, a reboot usually is not required.
Note: Moving a port connection from a 16-port switch to a 32-port, or higher port count switch, with an offset of 16 will
eliminate the need to reboot the host.
Ports 16-31 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
Physical Slot 0 / 0/0 0/1 0/2 0/3 0/4 0/5 0/6 0/7 0/8 0/9 0/10 0/11 0/12 0/13 0/14 0/15
Port
Area field 00 01 02 03 04 05 06 07 08 09 0a 0b 0c 0d 0e 0f
Slot1 / Port 1/0 1/1 1/2 1/3 1/4 1/5 1/6 1/7 1/8 1/9 1/10 1/11 1/12 1/13 1/14 1/15
Area field 10 11 12 13 14 15 16 17 18 19 1a 1b 1c 1d 1e 1f
2.5. Logistics
Power Requirements:
The power supplies are universal and capable of functioning worldwide without voltage jumpers or switches. They meet
IEC-61000-4-5 surge voltage requirements and are auto ranging in terms of accommodating input voltage and line
frequencies.
• Ensure the input line voltage range and additional wattage required for the SilkWorm 3900/12000 is available and
does not exceed power limit of the rack.
• Ensure all equipment installed in the rack has a reliable branch circuit Ground connection.
Table 2-6 Power requirement comparison
2.5.2. Cabling
The mounting position of the new switch must be considered based on the available cable length, for the ease of porting device
cable connections from the existing switch. A short cable, unable to reach the destination port, may result in unnecessary delay
and additional work. This problem can be resolved either by replacing the cable with appropriate length or repositioning the
switch in close proximity of the switch being replaced. Cost and time should be taken into consideration and planned
accordingly.
Table 2-7
Core Diameter 2 Gbit 1 Gbit
The migration process can be simplified by laying out the migration plan in advance. Besides cabling, rack space, and power
requirements, other factors discussed in Logistics on page 2-8 may significantly impact the SAN operations. The current
configuration and operational requirement of a target SAN may impose additional constraints. The key to a successful
migration is to minimize fabric interruption or to completely eliminate downtime whenever possible, by identifying issues in
advance.
The preliminary groundwork in the evaluation phase lays out the foundation for the migration process. The flowchart in Figure
3-1 on page 3-2 will assist you in determining the best migration strategy for you. After carefully answering the questions that
apply to your unique situation, the process will fall into one of the following categories:
• Single Fabric Online Migration
• Redundant Fabric Online Migration
• Offline Fabric Migration
Migration Strategy
Is
No there a No
Redundant No Is Host reboot
window
Fabric ? allowed?
f or SAN
downtime?
y es y es y es
Conf igured
No No Is CorePID
redundant
f ormat already
paths f or all
updated?
dev ices?
y es y es
Is the
Is multi-pathing No Fabric OS
No
sof tware used already
f or all dev ices ? updated ?
y es
y es
No Is multi-
Is path sof tware
No perf ormance used f or all
degradation dev ices ?
acceptable ?
y es
y es
No Is the f abric
Are both resilient ?
No redundant I/O
paths open to all
dev ices? y es
Is
y es perf ormance
No
degradation
Is acceptable?
Follow the steps f or
downtime f or a
Redundant Fabric
single path
Migration
dev ice y es
(page 4-9)
acceptable? Are
Follow the steps f or f requent
No an Of f line Fabric No f abric
Migration interruptions
(page 4-5) acceptable?
y es
Multi-pathing Software is installed and active on each fabric device and downtime for single yes
attach devices is acceptable?
Note: It is possible that some devices may be singly attached into a redundant fabric. If it is permissible for these devices to
go offline, it is not necessary to have multipathing software and redundant paths for all devices.
Configured redundant paths for each device via the fabric or if the device is single pathed, yes
downtime for that device is acceptable?
Multi-pathing Software installed and active on each fabric’s devices that require it? yes
Both redundant paths are open to devices that require multipathing? yes
Performance degradation is acceptable during the upgrade. This performance degradation yes
results from one path to the fabric being temporarily unavailable and where the host and
storage implement active/active pathing.
Guideline: Rebooting a host will completely cease I/Os on all active paths. If the Host Bus Adapter (HBA) configuration file
storage persistent binding is done via PID, consider an alternate method of avoiding host reboot as described in
Chapter 5, Prepare to Migrate.
SAN Topology
Single Fabric
Redundant Fabric
Hosts configuration
Single or multi-path to storage
Logistics
Rack space availability (switch mounting proximity)
Power
Switch configuration and switch port connectivity information obtained. (ex. switch Name,
IP address, Licensing, and switch port-device connectivity information)
Assessment Completed
Plan accepted
Power requirement
Preparation completed
Zoning update
Does this
No switch have an
active I/O path
open?
y es
Failover to alternate
open path on other
switch(s).
y es
Note: This procedure is for a single fabric that has been previously assessed for an online migration.
Guideline: To minimize downtime during the migration process prepare the new switch in advance. Refer to
2 Gbit/sec Switch Preparation on page 5-5.
Guideline: The recommended method in this case is to clear all zone configurations on the switch that is being
added, prior to joining the existing fabric.
10. The new switch is now ready to join the existing fabric. Disable the switch with the command switchDisable. Add
one or more Interswitch Links (ISL) as per the fabric configuration.
Note: In a mixed environment that contains SilkWorm 2000 Series switches, an Interswitch Link (ISL) Fibre Channel cable
with an SC connector on one end and an LC connector on other end may be required.
11. Move each device connection from the disabled switch port to its respective port on the new switch, to keep the PID
consistent when hard zoning (port, domain) is utilized. Worldwide Name (WWN) based zoning is more flexible and does
not impose the same restriction.
12. Enable the new switch by issuing the command switchEnable.
13. Verify that the new switch has joined the fabric successfully by examining the entry of the new switch in the
FabricShow command output.
14. Verify the zone configuration on the new switch is propagated during the fabric build process, by examining the output of
the cfgShow command and compare to the zoning configuration in the existing fabric.
15. Make sure all devices successfully logon to the new switch fabric ports by executing the nsShow and switchShow
commands.
16. Verify host access to the storage device via newly established switch fabric ports by examining the host Operating System
(OS) mapping of the target. In some cases, this step may require device re-scanning.
17. If necessary, restore the previously closed path from multi-pathing software console.
18. Repeat step 1-15 until all switches targeted for replacement have been successfully replaced.
19. Validate the entire new switch fabric by executing the fabricShow, nsAllshow, and/or nsShow commands.
• fabricshow command output displays fabric membership information
• nsallshow command output displays global name server information
• nsshow command output displays local name server information
20. Restore I/O operations.
Guidelines
Offline Fabric 1) The fabric remains segmented unless the Core PID
Migration Format is changed on all switches in the existing fabric
Planning No
Incremental
Migration?
yes
Prepare 2 Gbit/sec
switch parameters ,
set Domain ID
(page 5-5)
See Guideline 3
Import/Update
Zoning
yes
When all switches in the fabric are being replaced at once, there is no need to upgrade the Fabric OS and Core PID since the
existing switches will be removed from the fabric. However, in a large complex fabric environment, an incremental migration
process may be more manageable and less prone to errors. Based on your assessment of the fabric, proceed with the migration
using one of the following procedures:
• Incremental Fabric Upgrade Procedure on page 4-6
• Fabric Replacement Procedure on page 4-7
Before proceeding, ensure there are no active I/Os running on the fabric. The device may also be prevented from logging into
the switch by disabling the switch.
Guideline: This procedure requires the fabric to be offline for the duration of the migration process, therefore, a downtime
must be scheduled in advance.
Note: Clearing all zone configurations on the new switch prior to joining the existing fabric is the recommended method in
this case.
9. The new switch is now ready to join the existing fabric. Add one or more Interswitch Links (ISLs) as per the Fabric
configuration.
Guideline: In a mixed environment that contains SilkWorm 2000 Series switches, an Interswitch Link (ISL) Fibre Channel
cable with an SC connector on one end and an LC connector on other end, may be required.
10. Verify that the new switch has joined the fabric successfully by examining the entry of the new switch in the
FabricShow command output.
11. Verify the zone configuration on the new switch is propagated correctly during the fabric build process, by examining the
output of the cfgShow command and compare to the zoning configuration in the existing fabric.
12. If host binding is effective, make sure the persistent binding on host is done via WWN. If the method of Storage port
persistent binding is PID, please follow the procedure described in Port ID Persistent Binding Procedure on page 5-3.
13. Move each device connection from the disabled switch port to its respective port on the new switch, to keep the PID
consistent when port based zoning is effective.
Note: Worldwide Name (WWN) based zoning is more flexible and does not impose the same restriction.
Guideline: Connectors may need to be converted from SC to LC before connecting to the new switch. When positioning and
securing the new switch, make sure cable length is adequate.
14. Make sure all devices are successfully logged on to the new switch fabric ports by executing the nsShow and
switchShow commands.
15. Verify host access to the storage devices via the newly established switch fabric ports by examining the Operating System
(OS) mapping of the target. In some cases this may require device re-scanning.
16. Repeat steps 1-15 for until all switches targeted for replacement have been successfully replaced.
17. Validate the entire new switch fabric by executing the fabricShow, nsAllshow, and/or nsShow commands.
• fabricshow command output displays fabric membership information
• nsallshow command output displays global name server information
• nsshow command output displays local name server information
18. Restore I/O operations.
Note: Replacing all switches in the fabric imposes the additional step of managing and tracking the device connectivity
during the migration process. Before the switches are disabled and devices have been disconnected, a connectivity
profile must be created. It is extremely important that consistency be maintained, especially, in the case of port ID
based zoning implementation. Device cables must be labeled properly identifying Switch Domain ID and port number
and a label for the identifying the connecting device.
1. Save the existing fabric zoning configuration in a text file format, on a server, by administering the configupload
command from a telnet session. Refer to Propagating an Existing Zone Configuration on page 5-7.
2. The new switch can be configured in advance with identical parameters of the existing switch, for the purpose of
minimizing SAN downtime. Please refer to 2 Gbit/sec Switch Preparation on page 5-5.
3. Disable all existing switches in the fabric and replace each switch with an identically configured new switch.
Guideline: When positioning and securing the new switches, make sure the cable length is adequate.
6. Establish a telnet session and verify the Switch Name, Domain ID, and IP address are identical to the switch being
replaced. Each switch must have a unique Domain ID.
7. Make sure all zone configurations, if any, have been cleared from the new switches. Refer to the Brocade Zoning v3.1/4.1
User’s Guide for more information.
8. Import the zone configuration that was saved in Step 1 to a new switch by downloading the saved text file. Refer to the
Propagating an Existing Zone Configuration on page 5-7 for more information.
9. Examine the currently effective zone configuration by executing the cfgshow command.
10. The Fabric is ready to be formed. When all switches are on-line, add one or more Interswitch Links (ISLs) as per the
Fabric configuration. You may plan your ISL connections to benefit from the high performance Trunking feature available
on switches running Fabric OS 3.x or 4.x.
11. Verify that the new fabric is formed and in stable condition by examining the entry of the new switches in the
FabricShow command output display.
12. Before moving device connections make sure the persistent binding on the host is done via WWN. Move each device
connection from the disabled switch port to its respective port on the new switch
13. If the PID persistent binding is used, follow the procedure described in Port ID Persistent Binding Procedure on page 5-3.
Note: Worldwide Name (WWN) based zoning is more flexible and does not impose the same restriction.
Guideline: Connectors may need to be converted from SC to LC before connecting to the new switch. When positioning and
securing the new switch, make sure cable length is adequate.
14. Make sure all devices are successfully logged on to the new switch fabric ports by executing nsShow, switchShow,
and nsAllShow command.
15. Verify host access to the storage devices via the newly established switch fabric ports by examining the host Operating
System (OS) mapping of the target. In some cases, this step may require device re-scanning.
16. Validate the entire new switch fabric by executing the fabricShow, nsAllshow, and/or nsShow commands.
• fabricshow command output displays fabric membership information
• nsallshow command output displays global name server information
• nsshow command output displays local name server information
17. Restore I/O operations.
Redundant Fabric
Online Migration
Ensuref rom
multi-pathing sof tware,
that all paths are open to Are both
all dev ices that must No redundant I/O
remain online during the
paths open to all
migration dev ices?
y es
Prepare dev ices with a
single path f or
downtime
Select a f abric f or
migration. Redirect all
activ e I/Os f rom this
f abric to an alternate
open f abric
y es
Guideline: Recommended minimum Fabric OS versions are 2.6.0c and 3.0.2c or higher.
2. Once the Fabric OS has been upgraded to a recommended level the Core PID format can be changed.
a. Disable the switch using the switchdisable command.
b. Issue the Configure command. A list of configurable parameters will become available.
c. Change the Core Switch PID Format from default 0 to 1, accept all other parameters as default.
d. Enable switch using the switchenable command.
Security126: admin> switchDisable
Security126: admin> configure
Configure...
Fabric parameters (yes, y, no, n): [no] y
y es
Optional step
( Strongly recommend
to upgrade to latest Disable switch and
acceptable FOS lev el) upgrade to the latest
Fabric OS
on all existing f abric
switches
Return
Host HBA
No conf ig.f ile update &
reboot
allowed ?
y es
Return
No
Replacing an
existing switch ?
All existing
switches No
replaced f or
Non-incremental
Migration?
y es
Return
security43:admin> cfgdisable
Updating flash...
security43:admin> cfgclear
Do you really want to clear all configurations? (yes, y, no, n): [no] y
security43:admin> cfgsave
Updating flash...
security43:admin> cfgshow
Defined configuration:
no configuration defined
Effective configuration:
no configuration in effect
Note: This method is appropriate when an entire 1 Gbit/sec fabric is being replaced at the same time.
The active zone configuration of the fabric must be imported to at least one of the switches of the newly constructed 2 Gbit/sec
fabric. The active zone configuration is propagated to the remaining fabric switches. This method requires the active zone
configuration of the fabric be saved on a server as a text file, edited, and then downloaded on to a 2 Gbit/sec switch.
The following is an example of importing a Zone configuration from a 1 Gbit/sec switch (switch name=int94) to a 2 Gbit/sec
switch (switch name=security43).
1. Save the effective configuration to a server.
int194:admin> cfgshow
Defined configuration:
cfg: Left_cfg173
Left_zone_int173
zone: Left_zone_int173
Solaris_int173_HBA0; Hba0_sym_p5ba
alias: Hba0_sym_p5ba
5,20
alias: Solaris_int173_HBA0
3,4
Effective configuration:
cfg: Left_cfg173
zone: Left_zone_int173
3,4
5,20
int194:admin> configupload
Server Name or IP Address [host]: 192.168.162.173
User Name [user]: root
File Name [config.txt]: left_cfg173.txt
Protocol (RSHD or FTP) [rshd]: ftp
Password:
upload complete
2. Edit the saved file. Delete all but zoning related entries as shown.
Example:Edited file
zoning.check.nodeNameDisabled:0
zoning.defaultZone:1
zoning.inactive.access:1
[Zoning]
cfg.Left_cfg173:Left_zone_int173
zone.Left_zone_int173:Solaris_int173_HBA0;Hba0_sym_p5ba
alias.Hba0_sym_p5ba:5,20
alias.Solaris_int173_HBA0:3,4
enable:Left_cfg173
[End]
3. Download the edited zone configuration text file to the new switch.
security43:admin> cfgshow
Defined configuration:
no configuration defined
Effective configuration:
no configuration in effect
security43:admin> switchdisable
security43:admin> configdownload
Server Name or IP Address [host]: 192.168.162.173
User Name [user]: root
File Name [config.txt]: left_cfg173.txt
Password
download complete
security43:admin> cfgshow
Defined configuration:
cfg: Left_cfg173
Left_zone_int173
zone: Left_zone_int173
Solaris_int173_HBA0; Hba0_sym_p5ba
alias: Hba0_sym_p5ba
5,20
alias: Solaris_int173_HBA0
3,4
Effective configuration:
cfg: Left_cfg173
zone: Left_zone_int173
3,4
5,20
snmp.authentTraps:0
snmp.mibCap:103
snmp.swEventTrapLevel:0
snmp.sysContact:Field Support.
snmp.sysDescription:Fibre Channel Switch.
snmp.sysLocation:End User Premise
snmp.sysObjectID:1588.2.1.1.1
switch.interopMode:0
switch.largeEntry.cap:0
switch.status.policy.Fans.down:2
switch.status.policy.Fans.marginal:1
switch.status.policy.FaultyPorts.down:2
switch.status.policy.FaultyPorts.marginal:1
switch.status.policy.ISLStatus.down:0
switch.status.policy.ISLStatus.marginal:0
switch.status.policy.MissingSFPs.down:0
switch.status.policy.MissingSFPs.marginal:0
switch.status.policy.PortStatus.down:0
switch.status.policy.PortStatus.marginal:0
switch.status.policy.PowerSupplies.down:2
switch.status.policy.PowerSupplies.marginal:1
switch.status.policy.Temperatures.down:2
switch.status.policy.Temperatures.marginal:1
thresh.thad:1
xlativeModeDisable:0
zoning.check.nodeNameDisabled:0
zoning.defaultZone:1
zoning.inactive.access:1
zoning.standardMode:0
zoning.transactionFlag:0
:
Licenses:
S9RecRyd9ShASfdW
(END)
This Chapter provides comprehensive case studies of migration from Brocade SilkWorm 1 Gbit/sec switches to SilkWorm
2 Gbit/sec switches. The case studies use four different OS platforms. The platforms, and associated configurations, are
detailed in Appendix A, Operating System Platforms.
In order for a host to access storage, the host adapter driver for the Fiber Channel controller must be installed and configuration
file must be set up specifying storage links. For the purpose of this illustration UNIX and Windows based servers were
configured using EMC hardware and the software compatibility matrix for Symmetrix storage as described Appendix A,
Operating System Platforms. A compatible version of Powerpath, a multi-pathing software from EMC is installed on each
host.
In theory the migration process should be transparent to the Operating System platform as long as the fabric path remains
consistent with the persistent binding entry of the host HBA configuration setup file. The storage binding implementation
method varies on all UNIX OS platforms. Solaris OS persistent binding can be configured either by WWN or Port ID. HP-UX
OS uses Port ID, and Windows persistent binding is always done by WWN. Therefore, for a successful migration it is
extremely important to understand the current binding implementation on each configured OS platform. Port ID Persistent
Binding Procedure on page 5-3 discusses persistent binding and its impact in depth.
Note: These fabrics are for example purposes only and do not truly represent a typical core/edge fabric.
Fabric A is consists of five SilkWorm switches in a core/edge topology. Switch name Domain_01 is the core switch in the
fabric and the edge switches are providing host and storage port connectivity. It is worth to note that neither Fabric A or B is
resilient. Fabric A has host and storage connectivity distributed across edge switches. This configuration is selected to
illustrate fabric migration as well as lower port count switch consolidation into a single higher port count switch. In a large
fabric environment, you should also consider replacing the core switch with a high performance, high port count switch.
Fabric A is used to illustrate the following cases:
• Case 4: Collapsing Two 1 Gbit/sec Lower Port Count Switches Providing Storage Connectivity into a Single SilkWorm
3900
• Case 5: Collapsing Two 1 Gbit/sec Lower Port Count Switches Providing Host Connectivity into a Single SilkWorm 3900
• Case 6: Replacing a Lower Port Count Core Switch with High Performance SilkWorm 12000
Fabric-A Fabric-B
8
5 6 4 6 2
7
D
S D
S
4
Domain_ 03 Domain_ 04 Domain_ 05
i klW rm
S o 2 8
0 0 i klW rm
S o 2 8
0 0
0 2 4 6 8 1 0 2
1 1 4 0 2 4 6 8 1 0 2
1 1 4
1
1 3 5 7 9 1 1 3
1 1 5 1 3 5 7 9 1 1 3
1 1 5
Domain_ 01 Domain_ 02
D
S
D
S D
S
1 3 5 7
1 3 5 7
lS
i kWo
rm21
0
lS rm21
i kWo 0 0 2 4 6
0 2 4 6
4 6 (SW-2400)
(SW-2400) 5 Domain_ 02
0 0 (Core SW-3900)
1 D
S
D
S
Domain_ 06 Domain_ 09
D
S
Domain_ 07
i klW rm
S o 2 8
0 0
1 3 5 7
lS
i kWo
rm21
0
0 2 4 6
0 2 4 6 8 1 0 2
1 1 4
1 3 5 7 9 1 1 3
1 1 5
(SW-3200) 3 (SW-2400) 15 6 8 4
6 (SW-2250)
Domain_ 07
7 (Edge SW-3900)
5
EMC Sy mmetrix-8430
Fabric A
The Fabric A configuration, as shown by the output of the fabricshow command, consists of five switches with pre-assigned
Domain ID of 01, 03, 04, 06, and 09. Each switch is assigned a name based on its Domain ID (i.e., a switch with Domain ID of
01 is named “Domain_01”). The far right field of the output lists switch model.
Example: Domain_03:admin> fabricshow
Switch ID Worldwide Name Enet IP Addr FC IP Addr Name
------------------------------------------------------------------------
1: fffc01 10:00:00:60:69:20:3a:66 192.168.162.55 0.0.0.0 "Domain_01"(SW-2400)
3: fffc03 10:00:00:60:69:10:92:b3 192.168.162.59 0.0.0.0 "Domain_03"(SW-2250)
4: fffc04 10:00:00:60:69:10:38:3e 192.168.156.1260.0.0.0 "Domain_04" (SW-2800)
6: fffc06 10:00:00:60:69:c0:06:ec 192.168.172.1270.0.0.0 "Domain_06" (SW-3200)
9: fffc09 10:00:00:60:69:20:1a:b0 192.168.162.58 0.0.0.0 "Domain_09" (SW-2400)
The Fabric has 5 switches
Fabric B
Fabric B consists of three switches with Domain ID 02, 05, and 07. Each switch is named based on its Domain ID.
Example: Domain_05:admin> fabricshow
zone: Portzone_HPUX_hba01
4,4
9,3
zone: Portzone_Solaris_hba0
3,7
6,7
zone: portzone_AIX22_hba0
4,6
6,6
zone: portzone_w2k_hba0
3,5
6,5 switch port number
switch Domain
zone: Portzone_HPUX_hba00
7,4
5,2
zone: Portzone_Solaris_hba1
5,6
7,6
zone: portzone_AIX22_hba1
5,8
7,8
zone: portzone_w2k_hba1
5,4
7,15
OS Specifics
• Windows 2000 storage binding is done via “World Wide Port Name” instead of 24-bit port ID and therefore requires
no configuration update in this case. It also does not require the recommended port offset of 16 on the SilkWorm
3900. The storage port connection can be moved to any port of the SilkWorm 3900 switch as long as the port based
fabric Zoning reflects the correct port. WWPN based zoning does not require any modification.
• Solaris host storage port bindings can be accomplished either by WWPN or PID. If the persistent binding is done via
WWPN, there is no need to offset the port count. The storage port connection can be moved to any port of the
SilkWorm 3900. If zoning is WWPN based, there is no need to modify zone configuration. Port ID based Zoning
must be modified to reflect the correct port.
• AIX and HP-UX both configure hardware path to a storage device using Switch Domain and Port ID. If port count
offset is not used, the host configuration update procedure is required. If Zoning is WWPN based, the zone
configuration does not need to be updated. Port ID based fabric zoning must be modified to reflect the correct port ID.
HP-UX also requires that the path link be removed from a volume prior to any change either in Domain ID or Port
number of the switch.
6.2.7. Checklist
1. Topology - Redundant fabric, multipathing software, online migration possible
2. Zoning - Port ID based zoning modification is required
3. Fabric OS upgrade recommended to the most recent release
4. Core PID Format setting required
5. Persistent binding by PID method except Windows host
6. System reboot is not an acceptable option (online Migration)
7. Enabling Trunking, no topology change planned
Warning: DO NOT DISABLE or DISCONNECT HP-UX HOST or STORAGE PORT. HPUX requires removal of physical
link to volumes while it is still active. Please refer to Step 6: Restoring the Closed Path on the Brocade Fabric on
page 7-21. First perform steps 1-3 to remove the previously configured hardware link on Fabric B for all configured
volumes from their respective volume groups. Then disable the port and move the connection to the new port.
Follow the remaining steps when you are ready to restore the new link.
• HP_UX host path - port 2 (HPUX moved to port 2 after removing old physical links to the close path)
• Windows-2000 host path - port 4
• Solaris-8 host path - port 6
• AIX 4.3 Host path - port 8
Figure 6-3 shows output from the switchshow command output showing the disable port status for all host ports.
Powerpath detects the disabled port, ceases IO operations and updates the port status to failed. All IOs are redirected to open
path.
6. Verify that the storage ports of Fabric B, switch “Domain_07”, have no IO activity after disabling the host ports.
Example: Storage ports 4, 6, 8, and 15 of switch Domain_07 are associated with the Fabric B host ports disabled in step 5.
Domain_07:admin> switchshow
switchName: Domain_07
switchType: 5.4
switchState: Online
switchMode: Native
switchRole: Subordinate
switchDomain: 7
switchId: fffc07
switchWwn: 10:00:00:60:69:12:05:fa
switchBeacon: OFF
Zoning: ON (Migration_B)
port 0: id No_Light
port 1: id Online E-Port 10:00:00:60:69:20:3e:71 "Domain_02" (upstream)
port 2: -- No_Module
port 3: -- No_Module
port 4: id Online F-Port 50:06:04:82:c3:a0:75:a2
port 5: -- No_Module
port 6: id Online F-Port 50:06:04:82:c3:a0:75:b2
port 7: -- No_Module
port 8: id Online F-Port 50:06:04:82:c3:a0:75:8c
port 9: -- No_Module
port 10: -- No_Module
port 11: sw No_Light
port 12: -- No_Module
port 13: -- No_Module
port 14: -- No_Module
port 15: id Online F-Port 50:06:04:82:c3:a0:75:84
7. After verifying there is no activity on the storage ports, disable the ports and remove the storage port physical connections
from the respective port by removing cable connections. Pull out the GBIC/SFP partially from its slot to maintain an
orderly transition. Make sure these cables are tagged with proper identification before removal.
Domain05:admin> configure
Configure...
Fabric parameters (yes, y, no, n): [no] y
Domain_05:admin> fabricshow
Switch ID Worldwide Name Enet IP Addr FC IP Addr Name
-------------------------------------------------------------------------
5: fffc05 10:00:00:60:69:50:05:d3 192.168.162.253 0.0.0.0 >"Domain_05"
Note: The fabric will remain segmented until the Core PID format on all switches of the Fabric B is set.
Repeat this step for the remaining switches of the SAN Fabric B. After all the switches are updated verify Fabric B is intact.
Domain05:admin> fabricshow
HP_UX 2 12 02 none
Windows 2000 4 14 04 none
Solaris 6 16 06 none
AIX 8 18 (hex) 08 none
Table 6-5 PID Change on switch Storage “Domain_07” ports providing storage connectivity
If you are replacing a 1 Gbit/sec 16-port switch (SilkWorm 2800) with a 2 Gbit/sec 16-port switch (SilkWorm 3800) and Port
ID binding is utilized, then you must update the host configuration to re-define the hardware path to the storage device. In the
case of a Solaris host, rebooting is also required. An alternate to Solaris host rebooting is available only if an existing 16-port
switch is being replaced with higher port count SilkWorm 3900/12000 switch. In this case, the current persistent bindings
entry consistency can be maintained by moving storage port of SilkWorm 2000 series port 0-15 to the matching address of
upper port 16-31 of the SilkWorm 3900/12000 with an offset of 16 (see When Host Reboot Is Not An Option on page 2-7).
The following example shows that the current port binding entries for UNIX hosts connected to switch “Domain_07” physical
ports 4, 6, and 8 are 071400, 071600 and 071800. When a 1 Gbit/sec switch is replaced with the 32-port SilkWorm 3900 with
the same Domain ID of 07, these entries match with the upper ports 20 (14 hex), 22 (16 hex) and 24 (18 hex). Thus moving
connections from the older 1 Gbit/sec switch ports 4, 6, and 8, to SilkWorm 3900 ports 20, 22, and 24 respectively, will
eliminate the need of host configuration update.
Table 6-6
Domain_07 (1Gbit) 1 Gbit switch offset SilkWorm 3900
Persistent binding port # matching
24 bit Port_ID Persistent
binding Port #
HP-UX Storage: 071400 4 +16 20
Solaris Storage: 071600 6 +16 22
AIX Storage: 071800 8 +16 24
1. Setting up the IP address from Terminal port. Make the appropriate connection to terminal port and access via properly
configured Terminal.
Note: If assigning the SilkWorm 3900 the same IP address as the SilkWorm 2250, there will be two switches with the same
IP address. In order to access the SilkWorm 3900 via Ethernet, the Ethernet connection on existing SilkWorm 2250
must be disconnected. A temporary unused interim IP address may assigned to the SilkWorm 2250 in the interim.
2. After an IP address is assigned to a switch, open a telnet session on the SilkWorm 3900 switch, name “swd41”. Set the
name, password, Domain ID, and switch configuration identical to the switch being replaced.
Example: Setting Switch Name, Password, and Configuration
swd41:admin> switchname "Domain_D7"
Committing configuration...
Done.
Domain_D7:admin> passwd
Changing password for admin
Enter new password:
Re-type new password:
Domain_D7:admin> licenseshow
bQeRbRbRQRqRfSc1:
Web license
Zoning license
Fabric license
Remote Switch license
Extended Fabric license
Fabric Watch license
Performance Monitor license
Trunking license * Please note the new Trunking feature
licenseing requirement
3. Verify the version of Fabric OS on the SilkWorm 3900, it must be Fabric OS v4.0.2b or later. It is recommended to
upgrade the Fabric OS to the most recent available Fabric OS version.
Example: Verifying Fabric OS version
Domain_D7:admin> version
Kernel: 2.4.2
Fabric OS: v4.0.2b
Made on: Wed Oct 30 01:43:49 2002
Flash: Thu Oct 31 21:12:44 2002
BootProm: 3.1.18
4. Setup switch Domain ID and verify rest of the switch configuration parameters.
Note: When SilkWorm 3900 is being prepared to displace an existing 1 Gbit/sec switch, the displaced switch Domain ID is
assigned to the SilkWorm 3900. When adding a new switch to an existing fabric, make sure the new switch is assigned
a unique Domain ID (duplicate Domain IDs are not permitted in a fabric).
Configure...
5. Check the SilkWorm 3900 port configuration setup. They are setup for Auto-Negotiation (AN) by default but the ports
can be setup to a specific speed.
Example: Checking SilkWorm 3900 Port Configuration
Domain_D7:admin> portcfgshow
Port 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
----------------+--+--+--+--+----+--+--+--+----+--+--+--+----+--+--+--
Speed AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN
Trunk Port ON ON ON ON ON ON ON ON ON ON ON ON ON ON ON ON
Long Distance .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. ..
C Link Init .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. ..
Locked L_Port .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. ..
Locked G_Port .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. ..
Disabled E_Port .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. ..
cast LoopBack .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. ..
Delay Flogi .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. ..
Port 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
----------------+--+--+--+--+----+--+--+--+----+--+--+--+----+--+--+--
Speed AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN
Trunk Port ON ON ON ON ON ON ON ON ON ON ON ON ON ON ON ON
Long Distance .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. ..
C Link Init .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. ..
Locked L_Port .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. ..
Locked G_Port .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. ..
Disabled E_Port .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. ..
cast LoopBack .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. ..
Delay Flogi .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. ..
Guideline: Switch ports can be locked for a specific speed if required. The default is Auto-Negotiation.
7. Verify the switch error/fault policies and make changes if required, using the command SwitchstatusPolicySet.
Example: Verifying Switch Error and Fault Policies
Domain_D7:admin> switchStatusPolicyShow
Down Marginal
--------------------------------------------------------------
FaultyPorts 2 1
MissingSFPs 0 0
PowerSupplies 2 1
Temperatures 2 1
Fans 2 1
PortStatus 0 0
ISLStatus 0 0
8. Verify the SNMP settings and modify if required, using the command agtcfgSet.
Example: Verify SNMP Settings
Domain_D7:admin> agtcfgshow
sysDescr = Fibre Channel Switch.
sysLocation = End User Premise
sysContact = Field Support.
swEventTrapLevel = 0
authTraps = 0 (OFF)
SNMPv1 community and trap recipient configuration:
Community 1: Secret C0de (rw)
No trap recipient configured yet
Community 2: OrigEquipMfr (rw)
No trap recipient configured yet
Community 3: private (rw)
No trap recipient configured yet
Community 4: public (ro)
No trap recipient configured yet
Community 5: common (ro)
No trap recipient configured yet
Community 6: FibreChannel (ro)
No trap recipient configured yet
9. The Configshow command provides the entire switch parameter configuration listing which can be saved and retrieved on
a server.
Example: Configshow Output
Domain_D7:admin> configshow
RSCN.end-device.TransmissionMode:0
alpaList:1
diag.loopID:125
diag.mode.burnin:0
diag.mode.esd:0
diag.mode.lab:0
diag.mode.mfg:0
diag.postDisable:0
diag.retryDisable:0
diag.script.SWITCH.BURNIN:switchburnin.sh
diag.script.SWITCH.POST1:switchpost1.sh
diag.script.SWITCH.POST2:switchpost2.sh
diag.test.crossPort.passes:5000
diag.test.passes:0
diag.test.portLoopback.passes:1000
diag.test.silkScreen.passes:180
diag.test.spinSilk.passes:120
ether.link.mode:AUTO
fabric.domain:7
fabric.ops.BBCredit:16
fabric.ops.E_D_TOV:2000
fabric.ops.R_A_TOV:10000
fabric.ops.dataFieldSize:2112
fabric.ops.mode.fcpProbeDisable:0
fabric.ops.mode.isolate:0
fabric.ops.mode.longDistance:0
fabric.ops.mode.noClassF:0
fabric.ops.mode.tachyonCompat:0
fabric.ops.mode.unicastOnly:0
fabric.ops.mode.useCsCtl:0
fabric.ops.mode.vcEncode:0
fabric.ops.vc.class.2:2
fabric.ops.vc.class.3:3
fabric.ops.vc.config:0xc0
fabric.ops.vc.linkCtrl:0
fabric.ops.vc.multicast:7
fc4.fcIp.address:0.0.0.0
fc4.fcIp.mask:0.0.0.0
fc4.fcp.productId:FC Switch
fc4.fcp.vendorId:BROCADE
fcAL.alwaysSendRSCN:0
fcAL.fanFrameDisable:1
fcAL.openSendCLS:0
fcAL.useAltBBCredit:0
flannel.ops.frameColMethod:piling
flannel.ops.openBBCredit:4
gen.fabos:0
gen.zone:0
http.javaplugin.homeURL:http://java.sun.com/products/plugin
http.javaplugin.version:1,2,2
lcdContrast:128
lcdContrast.orange:208
ms.PlatEnable:1
ms.TDEnable:0
ns.prezonemode:0
oemLogo:0
portCfg:0, 0x10000000; 1, 0x10000000; 2, 0x10000000; 3, 0x10000000; 4, 0x1000000
0; 5, 0x10000000; 6, 0x10000000; 7, 0x10000000; 8, 0x10000000; 9, 0x10000000; 10
, 0x10000000; 11, 0x10000000; 12, 0x10000000; 13, 0x10000000; 14, 0x10000000; 15
, 0x10000000; 16, 0x10000000; 17, 0x10000000; 18, 0x10000000; 19, 0x10000000; 20
, 0x10000000; 21, 0x10000000; 22, 0x10000000; 23, 0x10000000; 24, 0x10000000; 25
, 0x10000000; 26, 0x10000000; 27, 0x10000000; 28, 0x10000000; 29, 0x10000000; 30
, 0x10000000; 31, 0x10000000; 32, 0x10000000; 33, 0x10000000; 34, 0x10000000; 35
, 0x10000000; 36, 0x10000000; 37, 0x10000000; 38, 0x10000000; 39, 0x10000000; 40
, 0x10000000; 41, 0x10000000; 42, 0x10000000; 43, 0x10000000; 44, 0x10000000; 45
, 0x10000000; 46, 0x10000000; 47, 0x10000000; 48, 0x10000000; 49, 0x10000000; 50
, 0x10000000; 51, 0x10000000; 52, 0x10000000; 53, 0x10000000; 54, 0x10000000; 55
, 0x10000000; 56, 0x10000000; 57, 0x10000000; 58, 0x10000000; 59, 0x10000000; 60
, 0x10000000; 61, 0x10000000; 62, 0x10000000; 63, 0x10000000;
quickLoop.holdOpenInit:0
quickLoop.noAlpaZero:0
quickLoop.peerWWN:00:00:00:00:00:00:00:00
quickLoop.portBitmap:0x0000000000000000
quickLoop.softInit:0
rlsDisable:1
route.delayReroute:0
route.embeddedPortBcast:1
route.stickyRoutes:0
rpc.rapid:1
rpc.rstatd:0
rpc.rusersd:0
shell.delete:0
shell.quiet:0
snmp.accessList.0.address:0.0.0.0
snmp.accessList.0.rw:1
snmp.accessList.1.address:0.0.0.0
snmp.accessList.1.rw:1
snmp.accessList.2.address:0.0.0.0
snmp.accessList.2.rw:1
snmp.accessList.3.address:0.0.0.0
snmp.accessList.3.rw:1
snmp.accessList.4.address:0.0.0.0
snmp.accessList.4.rw:1
snmp.accessList.5.address:0.0.0.0
snmp.accessList.5.rw:1
snmp.agtParty.0.address:0.0.0.0
snmp.agtParty.0.authPrivSecret:Secret C0de
snmp.agtParty.0.index:1
snmp.agtParty.0.port:162
snmp.agtParty.1.address:0.0.0.0
snmp.agtParty.1.authPrivSecret:OrigEquipMfr
snmp.agtParty.1.index:2
snmp.agtParty.1.port:162
snmp.agtParty.2.address:0.0.0.0
snmp.agtParty.2.authPrivSecret:private
snmp.agtParty.2.index:3
snmp.agtParty.2.port:162
snmp.agtParty.3.address:0.0.0.0
snmp.agtParty.3.authPrivSecret:public
snmp.agtParty.3.index:4
snmp.agtParty.3.port:162
snmp.agtParty.4.address:0.0.0.0
snmp.agtParty.4.authPrivSecret:common
snmp.agtParty.4.index:5
snmp.agtParty.4.port:162
snmp.agtParty.5.address:0.0.0.0
snmp.agtParty.5.authPrivSecret:FibreChannel
snmp.agtParty.5.index:6
snmp.agtParty.5.port:162
snmp.authentTraps:0
snmp.mibCap:103
snmp.swEventTrapLevel:0
snmp.sysContact:Field Support.
snmp.sysDescription:Fibre Channel Switch.
snmp.sysLocation:End User Premise
snmp.sysObjectID:1588.2.1.1.1
switch.interopMode:0
switch.largeEntry.cap:0
switch.status.policy.Fans.down:2
switch.status.policy.Fans.marginal:1
switch.status.policy.FaultyPorts.down:2
switch.status.policy.FaultyPorts.marginal:1
switch.status.policy.ISLStatus.down:0
switch.status.policy.ISLStatus.marginal:0
switch.status.policy.MissingSFPs.down:0
switch.status.policy.MissingSFPs.marginal:0
switch.status.policy.PortStatus.down:0
switch.status.policy.PortStatus.marginal:0
switch.status.policy.PowerSupplies.down:2
switch.status.policy.PowerSupplies.marginal:1
switch.status.policy.Temperatures.down:2
switch.status.policy.Temperatures.marginal:1
thresh.thad:1
xlativeModeDisable:0
zoning.check.nodeNameDisabled:0
zoning.standardMode:0
zoning.transactionFlag:0
:
Licenses:
bQeRbRbRQRqRfSc1
(END)
Note: This step is necessary for successful fabric re-build. If any zone configuration is left on the SilkWorm 3900, the failure
to merge zones between two different zone configurations during the fabric rebuild process could result in a fabric
segmentation or a confusing zone configuration.
Effective configuration:
no configuration in effect
Fabric-B
2
Domain_ 02 Domain_ 02
D
S D
S
1 3 5 7
lS rm21
i kWo 0
0 2 4 6
5 (SW-3900 32 port)
1
i klW rm
S o2 8
0 0
D
S
Domain_ 07
0 2 4 6 8 1 0 2
1 1 4
1 3 5 7 9 1 1 3
1 1 5
(SW-3900, 32 port )
(SW-2250 ,16 port)
Figure 6-6 Replacing existing SilkWorm 2250 with SilkWorm 3900 “Domain_07”
5. Mount the newly prepared SilkWorm 3900 switch in the vicinity of the older switch, considering the length of the
existing cable.
Note: The length of cables must be adequate to reach the SilkWorm 3900 ports. A short cable will result in unnecessary delay
and cable replacement cost.
Note: The SilkWorm 3900 has SFP based ports that require an LC type mating cable connector. When moving a GBIC based
SilkWorm 2000 series switch, a conversion from SC to LC is required.
Note: Extending an Inter Link Switch (ISL) between a SilkWorm 3900 and a SilkWorm 2000 series switch also requires an
SC-LC type cable until all Fabric B switches are migrated to SFP based 2 Gbit/sec ports.
Guideline: The SilkWorm 3900 may not be able join the existing Fabric B for one or more reasons listed below:
- Zone configuration conflict – the zone configuration on the SilkWorm 3900 is not cleared
- The Core PID on the existing Fabric B is not upgraded
- The Fabric OS version is incompatible
- The switch fabric parameter setting on SilkWorm 3900 is incorrect
- The cable is faulty
13. Modify port based Zoning to reflect the correct switch port.
2. Examine Zone sets of existing Configuration name “Migration_B” from the Config tab.
3. Select the appropriate zone from the Zone tab and modify the zone by adding or removing members of that zone as
required.
zone: Portzone_HPUX_hba00 – remove Domain 7, port 4 and add Doamin 7, port 20
zone: Portzone_Solaris_hba1- remove Domain 7, port 6 and add Doamin 7, port 22
zone: portzone_AIX22_hba1- remove Domain 7, port 8 and add Doamin 7, port 24
zone: portzone_w2k_hba1- remove Domain 7, port 15 and add Doamin 7, port 31
4. From the Config tab – First save, then enable the configuration to make the change effective.
8 -- N2 No_Module
9 -- N2 No_Module
10 -- N2 No_Module
11 -- N2 No_Module
12 id N2 No_Light
13 id N2 No_Light
14 id N2 No_Light
15 id N2 No_Light
16 id N2 No_Light
17 id N2 No_Light
18 id N2 No_Light
19 id N2 No_Light
20 id N1 Online F-Port 50:06:04:82:c3:a0:75:a2 HPUX Symmetrix port
21 id N2 No_Light
22 id N1 Online F-Port 50:06:04:82:c3:a0:75:b2 Solaris Symmetrix port
23 id N2 No_Light
24 id N2 Online F-Port 50:06:04:82:c3:a0:75:8c AIX Symmetrix port
25 -- N2 No_Module
26 -- N2 No_Module
27 -- N2 No_Module
28 id N2 No_Light
29 id N2 No_Light
30 id N2 No_Light
31 id N1 Online F-Port 50:06:04:82:c3:a0:75:84 Windows Symmetrix port
Guideline: A switch providing host port connectivity requires port based zoning changes only if moved to a different
Domain and port other than already specified in the current Fabric zone configuration.
2. Restoring Powerpath. Upon detecting path availability, EMC Powerpath automatically restores the path and IO activity.
3. At this point, paths on Fabric A and Fabric B are fully operational. Once the Fabric B Migration is complete and verified
to a satisfactory level, Fabric A can be migrated off-line, following the same procedure.
2
Domain_ 02 (SW-3900 32 port)
5
1 (SW-3900 32 port)
Domain_ 07
Fabric B
After 2 Gbit Migration
Fabric-B
Domain_ 05
1
2
Domain_ 02 swd42
5 (SW-3900 32 port )
1
Domain_ 07
Figure 6-12
After extending an Inter Link Switch (ISL) from switch name “swd42”, fabric reconfiguration takes place and the new switch
joins the existing fabric.
Example: Fabric B - After Migration
swd42:admin> fabric: Reconfiguration due to Fabric Merge(port 0)
fabric: Reconfiguring at Mon Apr 28 16:09:20 2003
5 4 3 2 1
10
fabric: Subordinate switch
fabric: Domain 42
swd42:admin> fabricshow
Switch ID Worldwide Name Enet IP Addr FC IP Addr Name
+
D
S
lS
i kWo
rm21
0
0
1
2
3
4
5
6
7
D
S
Collapsing “Domain_06” into switch “Domain_09” will impact AIX, Solaris and Windows, a total of three hosts. Solaris, AIX
and HP-UX Operating Systems use both Domain ID and Port ID to define the hardware path to a physical storage device. Any
change in the cabling route between the host bus adapter and the storage device will require a configuration update to reflect
the change.
+
D
S
lS
i kWo
rm21
0
0
1
2
3
4
5
6
7
D
S
Guideline: The cable length must be adequate to reach the ports on the SilkWorm 3900. A short cable will result
in unnecessary delay and cable replacement cost.
Guideline: The SilkWorm 3900 has SFP based ports that require an LC type mating cable connector. When moving
GBIC based SilkWorm 2000 series, a connector conversion from SC-to-LC is required.
Guideline: Extending an Inter Link Switch (ISL) between the SilkWorm 3900 and the SilkWorm 2000 series switch
also requires an SC-LC type cable until all switches in Fabric B have been migrated.
HP-UX requires the removal of the physical link to volumes while it is still active. Please refer to the Restoring close Path on
HPUX on page 7-25. First perform steps 1-3 to remove the previously configured hardware link on Fabric B for all configured
volumes from their respective volume group. Then disable the port and move the connection to the new port. Follow the
remaining steps when you are ready to restore the new link.
At this point all storage ports must be logged into the SilkWorm 3900, assuming the identity of switch name “Domain_06”.
HP-UX PID Domain is changing from 09 to 06 that requires configuration update, any available port on SilkWorm can be
assigned to HP-UX storage port.
N 061500; 3;50:06:04:82:c3:a0:75:bb;50:06:04:82:c3:a0:75:bb; na
FC4s: FCP [EMC SYMMETRIX 5568]
Fabric Port Name: 20:15:00:60:69:90:04:35
N 061600; 3;50:06:04:82:c3:a0:75:b3;50:06:04:82:c3:a0:75:b3; na
FC4s: FCP [EMC SYMMETRIX 5568]
Fabric Port Name: 20:16:00:60:69:90:04:35
N 061700; 3;50:06:04:82:c3:a0:75:8d;50:06:04:82:c3:a0:75:8d; na
FC4s: FCP [EMC SYMMETRIX 5568]
Fabric Port Name: 20:17:00:60:69:90:04:35
Fabric-A
Domain_ 03 i klW rm
S o 2 8
00
D
S
i klWrm
S o 2 8
0 0
D
S
Domain_ 04
(SW-2250) 0
1
2
3
4
5
6
7
8
9
1 0
1 1
2
1
3
1
14
15
0
1
2
3
4
5
6
7
8
9
1 0
1 1
2
1
3
1
1 4
1 5
(SW-2800)
0 0
0 1
Domain_ 01 D
S
lS rm21
i kWo 0 1 3 5 7
D
S
0 2 4 6
(SW-2400) 4
0
Domain_ 06
(SW-3900)
Step 5: Restore closed EMC Powerpath on AIX, Solaris and Windows 2000
Powerpath should resume IOs on all systems except HP-UX.
Note: The HP-UX host configuration update procedure is described in Step 6: Restoring the Closed Path on the Brocade
Fabric on page 7-21. The steps may differ depending upon fabric configuration and multi-pathing software in use.
Figure 6-16 Powermt path status: Older hardware path 8/4/1/0.9.19.0.0 – Domain_09, port =3*) on Fabric A. (*Core PID =0)
Replaced
by new link
Figure 6-17 The new hardware path = 8/4/1/0.6.10.0.0 Domain ID 06; port =10 * (* Core PID format=1)
Fabric-A
Domain_ 03 i klW rm
S o 2 8
00
D
S
i klWrm
S o 2 8
0 0
D
S
Domain_ 04
(SW-2250) 0
1
2
3
4
5
6
7
8
9
1 0
1 1
2
1
3
1
14
15
0
1
2
3
4
5
6
7
8
9
1 0
1 1
2
1
3
1
1 4
1 5
(SW-2800)
0 0
0 1
Domain_ 01 D
S
lS rm21
i kWo 0 1 3 5 7
D
S
0 2 4 6
(SW-2400)
5
0 Domain_ 09
(SW-3900)
Figure 6-18
2. Update the zone configuration for Fabric A to reflect the port ID change. For more information, refer to Port ID Persistent
Binding Procedure on page 5-3.
Example: Zoning configuration on storage ports for AIX, Solaris, and Windows on switch “Domain_06” prior to migration.
Domain_06:admin> switchshow (older switch SW-3200)
switchName: Domain_06
switchType: 16.2
switchState: Online
switchMode: Native
switchRole: Principal
switchDomain: 6
switchId: fffc06
switchWwn: 10:00:00:60:69:c0:06:ec
switchBeacon: OFF
Zoning: ON (Migration_A)
port 0: -- N2 No_Module
port 1: -- N2 No_Module
port 2: id N2 No_Light
port 3: -- N2 No_Module
port 4: id N2 No_Light
port 5: id N1 Online F-Port 50:06:04:82:c3:a0:75:bb
port 6: id N2 Online F-Port 50:06:04:82:c3:a0:75:b3
port 7: id N1 Online F-Port 50:06:04:82:c3:a0:75:8d
Domain_06:admin> cfgShow
Fabric Zone Configuration
cfg: Migration_A
zone: Portzone_HPUX_hba01
4,4
9,3
zone: Portzone_Solaris_hba0
3,7
6,7
zone: portzone_AIX22_hba0
4,6
6,6
zone: portzone_w2k_hba0
3,5
6,5
4. Move Windows 2000, AIX, Solaris storage ports to pre-assigned ports 5, 6, and 7 on SilkWorm 3900 switch name
“Domain_09”.
Example: Move the storage ports and validate
Domian_09:admin> switchshow
switchName: Domian_09
switchType: 12.1
switchState: Online
switchRole: Principal
switchDomain: 9
switchId: fffc09
switchWwn: 10:00:00:60:69:90:04:35
switchBeacon: OFF
6. At this point the Symmetrix storage device ports for all hosts must be logged into the new SilkWorm 3900 switch
“Domain_09”.
Domian_09:admin> nsallshow
8 Nx_Ports in the Fabric {
030500 030700 040400 040600 090300 090500 090600 090700}
Domian_09:admin> nsShow
The Local Name Server has 8 entries {
Type Pid COS PortName NodeName TTL(sec)
*N 030500; 2,3;10:00:00:00:c9:24:4e:b1;20:00:00:00:c9:21:9c:79; 480
FC4s: FCP
Fabric Port Name: 20:05:00:60:69:10:92:b3
*N 030700; 2,3;10:00:00:00:c9:2f:20:71;20:00:00:00:c9:2f:20:71; 480
FC4s: FCP
Fabric Port Name: 20:07:00:60:69:10:92:b3
*N 040400; 3;50:06:0b:00:00:08:fe:34;50:06:0b:00:00:08:fe:35; 480
FC4s: FCP
Fabric Port Name: 20:04:00:60:69:10:38:3e
*N 040600; 2,3;10:00:00:00:c9:2f:1d:1d;20:00:00:00:c9:2f:1d:1d; 480
Fabric Port Name: 20:06:00:60:69:10:38:3e
N 090300; 3;50:06:04:82:c3:a0:75:9d;50:06:04:82:c3:a0:75:9d; na
FC4s: FCP [EMC SYMMETRIX 5568]
Fabric Port Name: 20:03:00:60:69:90:04:35
N 090500; 3;50:06:04:82:c3:a0:75:bb;50:06:04:82:c3:a0:75:bb; na
FC4s: FCP [EMC SYMMETRIX 5568]
Fabric Port Name: 20:05:00:60:69:90:04:35
N 090600; 3;50:06:04:82:c3:a0:75:b3;50:06:04:82:c3:a0:75:b3; na
FC4s: FCP [EMC SYMMETRIX 5568]
Fabric Port Name: 20:06:00:60:69:90:04:35
N 090700; 3;50:06:04:82:c3:a0:75:8d;50:06:04:82:c3:a0:75:8d; na
FC4s: FCP [EMC SYMMETRIX 5568]
Fabric Port Name: 20:07:00:60:69:90:04:35
7. When trying to restore closed paths of Fabric A from EMC Powerpath on AIX, Solaris and Windows 2000, the paths on
Solaris and AIX remain closed.
Warning: After updating the host configuration file, a host reboot is required for the change to be effective. A system reboot
will completely cease IOs for the duration of boot time. Thus, it is a disruptive procedure even in a redundant fabric
environment and must be proceeded with caution. Before re-booting the host, all IO operations must be stopped on the
open path of Fabric B. File systems on Symmetrix volumes must be unmounted.
Example: EMC Powerpath Storage port =14aa is closed because of change in Port ID
# powermt display dev=all
Pseudo name=emcpower1a
Symmetrix frame ID=000185500118; volume ID=001
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
=========================================================================
------------- Host Devices ------------ - Symm - --- Path ---- -- Stats ---
### HW-path device director mode state q-IOs errors
==============================================================================
1 pci@1f,4000/lpfc@4 c2t1d1s0 FA 3bB active open 0 0
0 pci@1f,2000/lpfc@1 c3t2d1s0 FA 14aA active closed 0 6
Pseudo name=emcpower2a
Symmetrix frame ID=000185500118; volume ID=002
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
Modify lpfc.conf file from directory /kernel/drv using vi command line editor or by running Emulex lputil scripts from
/usr/sbin/lpfc/lputil directory.
Example: Modifying the lpfc.conf file
#cd /kerenel/drv
# vi lpfc.conf ( lpfc.conf = Emulex HBA file)
Modify the following entries of the lpfc.conf file for the failed HBA “lpfc1t2” attached to Fabric-A EMC Symmetrix storage
port.
Example: Modifying Entries in the lpfc.conf File
# BEGIN: LPUTIL-managed Persistent Bindings
fcp-bind-DID="071600:lpfc0t1",
"061700:lpfc1t2";
The 061700 Domian_ID=06 , Port=17x Port id =07 (Core PID format-0)
Port Id =0x17=23 Decimal (Core PID format-1)
This storage port is moved from switch “Domain_06” to switch “Domain_09” and port=7 that translates to a 24-bit Port ID =
090700 (Domain ID=09; Port=07 Core PID format-1)
Update this 24-bit Port ID entry for HBA lpfc1t2 from 061700 to 090700 and save the lpfc.conf.file
Example: Update 24-bit PID Entry
# BEGIN: LPUTIL-managed Persistent Bindings
fcp-bind-DID="071600:lpfc0t1",
"090700:lpfc1t2";
Figure 6-20 After rebooting the host, the failed path is recovered.
+
D
S D
S
=
klS
i W
o rm 2
8 0 i klW rm
S o 28
0 0
0 2 4 6 8 0
1 2
1 1 4 0 2 4 6 8 1 0 2
1 1 4
1 3 5 7 9 1 3
1 1 5 1 3 5 7 9 11 3
1 1 5
Domain_ 04
Domain_ 03 Domain_ 04 (SW-3900 , 32 port)
(SW-2250) (SW-2800)
Figure 6-21 Consolidating two 16 ports switches Domain_03 and Domain_04 to a single SilkWorm 3900
In this case, configure Solaris and Windows 2000 on the SilkWorm 3900 with “Domain_04”. HP-UX and AIX hosts are
previously configured for switch “Domain_04”. Unless you would like to reassign the ports, no zone update is required for
AIX and HP-UX.
Example:
Effective configuration:
cfg: Migration_A
zone: Portzone_HPUX_hba01
4,4*HP-UX host
9,3
zone: Portzone_Solaris_hba0
9,7
4,7 * Solaris host
zone: portzone_AIX22_hba0
4,6*AIX host
9,6
zone: portzone_w2k_hba0
9,5
4,5 * Windows 2000 host
3. Move Windows 2000, AIX, Solaris and HP-UX host port connections to SilkWorm 3900 ports 5, 6, 7and 4 respectively.
Domain_ 04
(SW-3900 , 32 port)
0 1
Domain_ 01
D
S D
S
1 3 5 7
lS
i kWo
rm21
0
0 2 4 6
(SW-2400) 4 6
0
Domain_ 09
(SW-3900)
5. Resume IO operations on all hosts on Fabric A via SilkWorm 3900 switch “Domain_04”.
Conclusion
The Domain ID or port ID change on SilkWorm fabric switches providing host connectivity requires only port based zone
configuration change. A World Wide Port Name based fabric zone configuration does not require any update.
Fabric-A
Domain_ 04
(SW-3900 , 32 port)
Domain_ 01 0 1
(SW-2400) D
S
c
D
S
1 3 5 7
C
lS
i kWo
rm21
0
0 2 4 6
4 6
P p
0 1
0
Domain_ 09
(SW-3900)
SW-12000 , 64 port
In previous cases, we have successfully upgraded the fabric edge switches providing storage and host connectivity to higher
port count 2 Gbit/sec SilkWorm 3900. The Core switch of redundant Fabric A is still a SilkWorm 2400 switch. In the previous
example of Fabric B, the Core switch is upgraded to SilkWorm 3900. This case demonstrates the ease of upgrading the Core
switch with high port count Brocade director class SilkWorm 12000. This will complete the 2 Gbit Migration of Fabric A
recommended Core /Edge topology for large fabrics with SilkWorm 12000 as a Core and SilkWorm 3900 as edge switches.
2. Please refer to SilkWorm 12000 User’s Guide. You may also be required additional IP addresses depending on the
number of switches per chassis. A SilkWorm chassis can house one or two 64-port switches providing a total of 128-ports.
Set Switch Name, IP address, Domain ID, Switch policy and the user specific parameters as specified in the SilkWorm 12000
installation guide. The SilkWorm 12000 is a director class switch that can be deployed in many different configurations
depending on the application environment. The Brocade SilkWorm 12000 is a blade based director class switch. Each blade
provides 16 ports, 2 Gbit/sec connectivity. The ports are addressed with slot #/port 0-15 convention when executing switch
commands.
A port based zoning use port _ID = 0-64.
Table 6-10
Logical Switch 00
Physical Slots Port Number Area Number
(decimal)
1 0-15 0-15
2 0-15 16-31
3 0-15 32-47
4 0-15 48-63
5 CP 1
6 CP 2
Logical Switch 01
7 0-15 0-15
8 0-15 16-31
9 0-15 32-47
10 0-15 48-63
3. Open a telnet session to SW 0 of a properly configured SilkWorm 12000. If SilkWorm 12000 chassis is fully populated,
open telnet session to both switches. Clear the zone configuration on the SilkWorm 12000.
4. If replacing the existing core switch of the fabric, prepare the SilkWorm 12000 switch, transferring existing switch
parameters. Please note that this step is necessary only for the purpose of fabric management. It has no barrier on Core
switch functionality with proper brocade software licensing. The only other requirement is that each switch of the fabric
must have a unique Domain ID.
Example: Changing switchname from “poc178” to “Domain_01”
poc178:root> switchname "Domain_01"
Committing configuration...
Done.
Warning: The Domain ID is changed. The port level zoning may be affected Domain_01:root> switchdisable
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
=======================================================
slot 1: 0 10m 0 0 10m 0 0 0 0 0 0 0 0 0 0 0
7. Brocade Fabric OS v4.x offers the Advanced Trunking feature which can be enabled with proper licensing on SilkWorm
3800, 3900, and 12000 switches. The trunking group is defined by “quads”. Create ISL trunks at this, time if planned.
For instance on a 16-port switch or SilkWorm 12000 blade, quads are defined as ports 0-3, 4-7, 8-11and 12-15.
Trunking commands
switchCfgTrunk Configure all ports on the switch for trunking
portCfgTrunkPort Configure a port for trunking
Example: Trunking example: Adding a second ISL to group 0 and 1 and enabling the Trunking feature.
Slot 1 /Port 1 ISL goes to switch Doamin_03, port 1 of SilkWorm 3900
Slot1 /Port 4 ISL goes to switch Doamin_09 port 1 of SilkWorm 3900
The example below shows IO Operations distributed across trunk ports after Migration.
Example: portperfshow Showing Trunking Performance
Domain_01:root> portperfshow
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
===================================================
slot 1: 0 5.5m 5.1m 0 5.8m 4.3m 0 0 0 0 0 0 0 0 0 0
Topology
Redundant Fabric A and B, core/edge Configuration.
McData Fabric A
• ES-3016 Edge switch providing host connectivity firmware version 05.01.00.17
• ED-6064 switch providing storage connectivity firmware version 05.01.00.17
• Management tool: Web based SANpilot, Telnet CLI
Brocade Fabric A
• SilkWorm 3900 Edge switch - Fabric OS version 4.0.2c or later
• SilkWorm 12000 Core switch - Fabric OS version 4.0.2c or later
• Management tool - Brocade Web Tools, Telnet, Brocade “Zone_convert.exe” utility*
McDataFabric
W2k Solaris AIX HP-UX
BrocadeFabric
SilkWorm McData
3900 3016
B
A A
B
C C
P P McData
0 6064
0
SilkWorm
12000
12bb 5aa 14aa 3bb 4bb 13aa 14ba 3ab
Symmetrix Storage
Figure 7-1 Diagram of Migration from McData switches to Brocade SilkWorm switches
Figure 7-2 Windows 2000 host fabric port A and B IO processing status
Figure 7-3 Solaris host fabric port A and B I/O processing status
Figure 7-4 AIX host fabric port A and B I/O processing status
Figure 7-5 HPUX host fabric port A and B I/O processing status
SANpilot Topology and Fabric view screens are helpful to determine the total number of switches in the fabric, their model
type, Domain ID and IP address by simply logging on to a single switch of the fabric.
The Operating Parameter tab shows the current configuration setting of the Mcdata switch parameters. This information is
crucial to set up Brocade SilkWorm switch operating parameters identical or very close to displacing McData switch.
Figure 7-7 McData Switch Operating parameters (Telnet command: > config switch Show)
The Port Status Monitoring tab shows the device connectivity map, the current status and configuration of the fabric port. The
following screen shows ED-6064 is providing connectivity to Symmetrix storage on specific ports for the listed number of
hosts. This information is important if hardware zoning and persistent binding is enforced.
Figure 7-8 Port online status and configuration type - (ED-6064 storage ports)
Figure 7-9 similar to the one above, showing the host port connectivity on edge switch ES-3016 and current switch port status.
Again this connectivity map is important if hardware zoning is enforced.
Figure 7-9 Port online status and configuration type - (ES-3016 host ports)
This information can be viewed either from ZoneSet tab of the SANpilot or executing the Configzoning Show Active command
from a telnet window as shown below. The output of the command determines if the World Wide Port Name or port ID based
zoning is enforced.
Based on this information, an identical zoning configuration for Brocade fabric can be build in advance.
Example: The Active zone set “McData_cfg_A” (Telnet command: Config zoning ShowActive)
Username: Administrator
Password:
2. Click on Admin view next to the switch icon (middle button). Switch parameters can be verified or setup from the
appropriate tab.
Here is an example of obtaining Brocade fabric topology information showing fabric is consists of two switches named
“domain_01” and “domain_09” with Domain ID 1 and 9 respectively.
Below is an example of obtaining configuration details using the telnet Command Line Interface.
Example: Fabricshow Output
domain_01:root> fabricshow (Telnet CLI)
2. Unzip the utility file and make sure the required .dll files are present.
3. Obtain the IP Address, user login, and password for both McData and Brocade switches.
4. Run the zone_convert.exe and enter the required information (IP Address, User name, and password).
W2k_zone_A:
10:00:00:00:C9:24:4E:B1
50:06:04:82:C3:A0:75:BB
HPUX_zone_A:
50:06:04:82:C3:A0:75:9D
50:06:0B:00:00:08:FE:34
Solaris_zone_A:
10:00:00:00:C9:2F:20:71
50:06:04:82:C3:A0:75:8D
AIX_zone_A:
10:00:00:00:C9:2F:1D:1D
50:06:04:82:C3:A0:75:B3
Example: Enter info for the Brocade switch to import zoning data.
Hostname: 192.168.173.178
Username [admin]:
Password [password]:
Logging into 192.168.173.178... done.
Creating zones...
…..done
5. Determine how the zones will be created. Decide if it will be done by merging the imported zones to an existing Brocade
zone configuration or creating a new configuration.
6. Open Brocade Web Tools using Internet Explorer and select WWN level zoning from the Zone Admin tab.
Note: WWN level zoning tab is selected here because imported McData zone sets are based on WWN. For a port ID based
imported zone configuration select the Port based zoning tab.
7. From the WWN Config tab either select an existing configuration and add imported zones or create a new Zone
configuration (cfg).
The following screen shows an example of creating a new zone configuration name “Brocade_cfg_A” from imported
zone sets.
8. Save zone configuration selecting Apply (saving zone configuration to flash).
9. Select Enable config and click Apply (activating the zone).
Brocade Fabric A Zone configuration name “Brocade_cfg_A” is created with imported McData zones.
Example: Cfgshow showing imported McData Zones
domain_01> cfgshow
Effective configuration:
cfg: Brocade_cfg_A
zone: AIX_zone_A
10:00:00:00:c9:2f:1d:1d
50:06:04:82:c3:a0:75:b3
zone: HPUX_zone_A
50:06:04:82:c3:a0:75:9d
50:06:0b:00:00:08:fe:34
zone: Solaris_zone_A
10:00:00:00:c9:2f:20:71
50:06:04:82:c3:a0:75:8d
zone: W2k_zone_A
10:00:00:00:c9:24:4e:b1
50:06:04:82:c3:a0:75:bb
2. Open a telnet session on the Brocade switch and create identical zones and add the World Wide Port Name of the
members.
Example: Creating Zones on a SilkWorm Switch
zoneCreate "Solaris_zone_A","10:00:00:00:c9:2f:20:71;50:06:04:82:c3:a0:75:8d"
zoneCreate "AIX_zone_A',"10:00:00:00:c9:2f:1d:1d;50:06:04:82:c3:a0:75:b3"
zoneCreate "W2k_zone_A","10:00:00:00:c9:24:4e:b1;50:06:04:82:c3:a0:75:bb"
ZoneCreate "HPUX_zone_A","50:06:04:82:c3:a0:75:9d;50:06:0b:00:00:08:fe:34"
3. Create a Zone Configuration and add member zones, save and enable the Zone configuration.
Example: Adding Members and Enabling a Zone Configuration
cfgCreate "Brocade_cfg_A","solaris_zone_A;AIX_zone_A;w2k_zone_A;HPUX_zone_A"
domain_01:root> cfgsave
updating flash ...
domain_01:root> cfgEnable "Brocade_cfg_A"
zone config "Brocade_cfg_A" is in effect
Updating flash ...
domain_01:root> cfgshow
Effective configuration:
cfg: Brocade_cfg_A
zone: AIX_zone_A
10:00:00:00:c9:2f:1d:1d
50:06:04:82:c3:a0:75:b3
zone: HPUX_zone_A
50:06:04:82:c3:a0:75:9d
50:06:0b:00:00:08:fe:34
zone: Solaris_zone_A
10:00:00:00:c9:2f:20:71
50:06:04:82:c3:a0:75:8d
zone: W2k_zone_A
10:00:00:00:c9:24:4e:b1
50:06:04:82:c3:a0:75:bb
Figure 7-15 Creating new zone name “W2k_zone_A” and adding member’s WWN.
5. From the WWN Config tab, either select an existing zone Configuration and modify it by including newly created
zones or create a new Brocade Fabric A zone configuration “Brocade_cfg_A” and include the newly created zones.
6. Save the zone configuration by clicking the Apply tab. (Saving zone configuration to flash.)
7. Click the Enable config button and click Apply. (Activating the zone configuration.)
Figure 7-16 Creating a WWN Configuration name “Brocade_cfg_A”, saving and enabling the configuration
Warning: DO NOT DISABLE or DISCONNECT HP-UX HOST and STORAGE PORT on McData Fabric A.
HPUX requires removal of physical link to a volume while it is still active. Please refer to Step 6: Restoring the Closed Path
on the Brocade Fabric on page 7-21. First perform steps 1-3 to remove the hardware link of Mcdata Fabric A for each volume
from their respective volume group. Failure to follow the exact procedure step by step will result in an un-recovered path on
Brocade fabric A.
Powerpath will detect the closed port status and after a time-out period redirect all IOs to an available open port. Monitor the
path status on the Powerpath “Powermt display” window. After the path is declared closed /failed /degraded, move the host
connection on all other OS platforms except HPUX.
HP-UX host on port 4* see Windows 2000 AIX host port 6 Solaris host on
warning above host on port 5 port 7
Figure 7-17 Verify host port online status on Brocade SilkWorm 3900
Moving storage ports from McData ED-6064 to the Brocade SilkWorm 12000.
HPUX storage on
Solaris storage on AIX Storage on Windows 2000 port 08* see Warning
port 05* port 06 Storage on port 07 above.
Figure 7-18
Monitoring Fibre Channel port open/close status from Powermt display window
(Command > powermt display every=10)
Figure 7-19 EMC storage path FA-14aA is closed for Solaris host
Figure 7-20 All IOs are redirected to alternate open path FA-3bB
Figure 7-21 EMC storage path FA-14aA is closed for AIX host.
Figure 7-23 EMC storage path is closed for the Windows 2000 host. All IOs are directed to the open port.
Figure 7-24 EMC storage path FA-14ba is closed for HPUX host. (Primary path is closed)
Note: In case Persistent binding is done by Port ID, the HBA configuration file binding entry must be updated to reflect
the correct 24-bit port ID followed by a Solaris host reboot.
Figure 7-26 EMC storage path FA-14aA is auto-restored for Solaris host.
Figure 7-27 IOs are restored on recovered path FA-14aA for Solaris host
Figure 7-29 IOs are restored on recovered path FA-13aA for AIX host
Figure 7-30 EMC Powerpath restores fail path upon detecting its open status and restore IOs.
Note: Restoring a Close Path on Windows 2000 may require a rescan disks action from Disk Management menu or
physically resetting the storage port link.
Example: A physical port 0 of a switch Domain ID 1 24-bit logical Fibre Channel Port ID for McData Switch =610413;
Brocade switch=010000
Table 7-1
61 04 13 610413 0
05 13 610513 1
06 13 610613 2
07 13 610713 3
08 13 610813 4
09 13 610913 5
0A 13 610A13 6
0B 13 610B13 7
0C 13 610C13 8
0D 13 610D13 9
0E 13 610E13 10
0F 13 610F13 11
10 13 611013 12
11 13 611113 13
12 13 611213 14
13 13 611313 15
Table 7-2
01 00 00 010000 0
01 00 010100 1
02 00 010200 2
03 00 010300 3
04 00 010400 4
05 00 010500 5
06 00 010600 6
07 00 010700 7
08 00 010800 8
09 00 010900 9
0A 00 010A00 10
0B 00 010B00 11
0C 00 010C00 12
0D 00 010D00 13
0E 00 010E00 14
0F 00 010f00 15
Procedure
1. lssf /dev/dsk/Cxtxdx
2. vgdisplay –v (To find out the device Volume Group(vg) of device Cxtxdx)
3. vgreduce /dev/vg01 /dev/dsk/C29t1d5
(ex: Remove link from volume group vg01 for device c29t1d5)
*Repeat Step-3 for all volume groups and devices with in a group
4. Move cable connections from McData to Brocade switch
5. ioscan –fC disk (Discover new devices)
6. insf –e (Install files for devices)
7. ioscan –fknC disk (get the newly discovered device Address Cxtxdx)
8. vgextend /dev/vg01 /dev/dsk/c37t1d5
Example
The following screen shows that Symmetrix Port FA-14ba path is configured for volume C29t1d5 and C29t1d6 on McData
Fabric A which is about to change after the connections are moved to Brocade Fabric A.
Figure 7-31 Device hardware path configured via the McData switch for device for C29t1d5 and C29t1d6
# lssf /dev/dsk/c29t1d6
sdisk card instance 29 SCSI target 1 SCSI LUN 6 section 0 at address 8/4/1/04.19.0.1.6
/dev/dsk/c29t1d6
2. Determine the volume group name of Device C29t1d5 and C29t1d6. from the output of the vgdisplay -v command.
Device c29t1d5 belongs to volume group vg01
Device C29t1d6 belongs to volume group vg02
Example: Output of the vgdisplay -v command
# vgdisplay -v
--- Volume groups ---
VG Name /dev/vg01
VG Write Access read/write
VG Status available
:
--- Logical volumes ---
LV Name /dev/vg01/vol01
LV Status available/syncd
LV Size (Mbytes) 4096
Current LE 1024
Allocated PE 1024
Used PV 1
VG Name /dev/vg02
VG Write Access read/write
VG Status available
:
:
--- Logical volumes ---
LV Name /dev/vg02/vol02
LV Status available/syncd
LV Size (Mbytes) 4096
Current LE 1024
Allocated PE 1024
Used PV 1
3. Remove the PV link for both devices C29t1d5 and C29t1d6 before moving the physical connection from McData switch.
Example:
# vgreduce /dev/vg01 /dev/dsk/c29t1d5
Device file path "/dev/dsk/c29t1d5" is an alternate path.
Volume group "/dev/vg01" has been successfully reduced.
Volume Group configuration for /dev/vg01 has been saved in /etc/lvmconf/vg01.conf
4. Close Port on McData switch and then move HPUX host and Storage port to the Brocade fabric.
6. The command insf –e re-installs the special files for pseudo-drivers and existing devices. This is useful for restoring
special files when one or more have been removed.
Example: The insf –e Command
# insf -e -C disk
insf: Installing special files for sdisk instance 50 address 8/0/1/0.3.3.0.0.0.0
insf: Installing special files for sdisk instance 51 address 8/0/1/0.3.3.0.0.1.5
insf: Installing special files for sdisk instance 52 address 8/0/1/0.3.3.0.0.1.6
insf: Installing special files for sdisk instance 53 address 8/4/1/0.1.8.0.0.0.0 *vcm
insf: Installing special files for sdisk instance 54 address 8/4/1/0.1.8.0.0.1.5
insf: Installing special files for sdisk instance 55 address 8/4/1/0.1.8.0.0.1.6
insf: Installing special files for sdisk instance 41 address 8/4/1/0.97.4.19.0.0.0
insf: Installing special files for sdisk instance 42 address 8/4/1/0.97.4.19.0.1.5
insf: Installing special files for sdisk instance 43 address 8/4/1/0.97.4.19.0.1.6
insf: Installing special files for sdisk instance 0 address 8/16/5.2.0
insf: Installing special files for sdisk instance 1 address 8/16/5.6.0
7. Get the device address Cxtxdx of newly configured devices to restore the path. The new devices configured on Brocade
Fabric A are C37t1d5 and C37t1d6 (Please note that third device C37t0d0 is Symmetrix VCM database).
Example: Device Addresses
# ioscan -fknC disk
Figure 7-34
The McData link 8/4/1/0.97.4.19.0.1.5 is successfully replaced by the Brocade link8/4/1/0.1.0.1.5. The McData link
8/4/1/0.97.4.19.0.1.6 is successfully replaced by the Brocade link 8/4/1/0.1.0.1.6.
9. Powermt check (Powermt command)
Warning: Symmetrix device path c29t1d5 is currently dead.
Do you want to remove it (y/n/a/q)? y
Warning: Symmetrix device path c29t1d6 is currently dead.
Do you want to remove it (y/n/a/q)? y
Figure 7-35 Failed path is removed and new link is established on EMC Storage port_14ba
10. Powermt config (Powermt command) Update the Powerpath config file.
The following sections describe host setup for Sun Solaris-8, IBM AIX -4.3, HP-UX -11i and Windows-2000 platforms. All
hosts are configured with a minimum of two hba accessing EMC Symmterix storage volumes, configured for redundant access
using EMC host based Powerpath software package. Thus, an application running on a host can access storage via either path
providing a fault tolerance in case a path actively processing IO operations is disrupted. During the entire migration process a
script is executing Read and Write IO operations continuously comparing the readback data to verify data integrity
The operating system platforms used in the following case studies include:
• Sun Solaris-8 on page A-1.
• IBM AIX 4.3 on page A-5.
• HP-UX 11i on page A-7.
• MS Windows 2000 Server on page A-12.
The Sun Solaris host may be configured to discover storage on boot using one of the two persistent binding methods that can
be verified either examining “lpfc.conf” file in /kernel/drv directory or running an Emulex provided “lputil” script from
/usr/sbin/lpfc directory.
The lpfc.conf file entry shows that the World wide Name method is used to bind Symmetrix data volumes.
Example: Persistent bindings by methods by PID
1. Adapter: 0, Target: 1, D_ID: 071600 * Switch Domain 07, port =06
2. Adapter: 1, Target: 2, D_ID: 061700 * Switch Domain 06, port=07
A format command discovers pre-assigned two Symmetrix data volumes and VCM (Volume Logix database volume) on each
FC host adapter C2 and C3. Powerpath configures these volumes emcpower1a and emcpower2a pseudo devices.
Example: Format command output after installing Powerpath:
AVAILABLE DISK SELECTIONS:
0. c0t0d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>
/pci@1f,4000/scsi@3/sd@0,0
1. c0t1d0 <SUN36G cyl 24620 alt 2 hd 27 sec 107>
/pci@1f,4000/scsi@3/sd@1,0
2. c2t1d0 <EMC-SYMMETRIX-5568 cyl 14 alt 2 hd 15 sec 64>
/pci@1f,4000/lpfc@4/sd@1,0
3. c2t1d1 <EMC-SYMMETRIX-5567 cyl 9158 alt 2 hd 15 sec 64>
/pci@1f,4000/lpfc@4/sd@1,1
4. c2t1d2 <EMC-SYMMETRIX-5567 cyl 9158 alt 2 hd 15 sec 64>
/pci@1f,4000/lpfc@4/sd@1,2
5. c3t2d0 <EMC-SYMMETRIX-5568 cyl 14 alt 2 hd 15 sec 64>
/pci@1f,2000/lpfc@1/sd@2,0
6. c3t2d1 <EMC-SYMMETRIX-5567 cyl 9158 alt 2 hd 15 sec 64>
/pci@1f,2000/lpfc@1/sd@2,1
7. c3t2d2 <EMC-SYMMETRIX-5567 cyl 9158 alt 2 hd 15 sec 64>
/pci@1f,2000/lpfc@1/sd@2,2
8. emcpower1a <EMC-SYMMETRIX-5567 cyl 9158 alt 2 hd 15 sec 64>
/pseudo/emcp@1
9. emcpower2a <EMC-SYMMETRIX-5567 cyl 9158 alt 2 hd 15 sec 64>
/pseudo/emcp@2
EMC Powerpath software operations are configured and monitor via “powermt” commands. A “powermt display” command
with appropriate option can be used to monitor link status.
The two data volumes 01 and 02 volume access is configured via Symmetrix ports FA-3bB and FA-14aA. Powerpath has
configured both HBAs in active mode meaning both paths are open for IO operations.
Example: EMC Powerpath Status Monitoring
# powermt display dev=all
Pseudo name=emcpower1a
Symmetrix frame ID=000185500118; volume ID=001
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
=========================================================================
------------- Host Devices ------------ - Symm - --- Path ---- -- Stats ---
### HW-path device director mode state q-IOs errors
=========================================================================
1 pci@1f,4000/lpfc@4 c2t1d1s0 FA 3bB active open 0 2
0 pci@1f,2000/lpfc@1 c3t2d1s0 FA 14aA active open 0 0
Pseudo name=emcpower2a
Symmetrix frame ID=000185500118; volume ID=002
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
=========================================================================
------------- Host Devices ------------ - Symm - --- Path ---- -- Stats ---
### HW-path device director mode state q-IOs errors
=========================================================================
1 pci@1f,4000/lpfc@4 c2t1d2s0 FA 3bB active open 0 2
0 pci@1f,2000/lpfc@1 c3t2d2s0 FA 14aA active open 0 0
The “df “command output showing the partition emcpower1c and emcpower2c mounting points.
Example:
# df
/ (/dev/dsk/c0t0d0s0 ):23252864 blocks 1624422 files
/proc (/proc ): 0 blocks 15831 files
/dev/fd (fd ): 0 blocks 0 files
/etc/mnttab (mnttab ): 0 blocks 0 files
/var/run (swap ): 3597232 blocks 107764 files
/tmp (swap ): 3597232 blocks 107764 files
/export/home (/dev/dsk/c0t0d0s7 ): 75868 blocks 35324 files
/symlun01 (/dev/dsk/emcpower1c): 7013170 blocks 512061 files
/symlun02 (/dev/dsk/emcpower2c): 8651034 blocks 549436 files
Powerpath “Powermt display every=5” command displaying current Path and IO status continuously at a specified time
interval. Both ports are shown actively processing IOs.
Example: IO Gen: Script copying all files of user directory to mounted volume Symlun01
“lsdev -Cc adapter | grep fc” command lists available Fibre Channel host bus adapters fcs0 and fcs1 prior to Symmetrix
volume assignment.
Example: Listing Adapters
# lsdev -Cc adapter |grep fc
Device drivers for Fc=C adapters Lp-9002L = IBM fcs0 driver =df1000f9
IBM provides a GUI based SMIT interface to list and configure device parameters. The following is an example of obtaining a
detail information on an available hba using SMIT utility.
Example: Adapter Configuration: (SMIT output)
FC Adapter fcs0
Description FC Adapter
Statuss0 Available 31-08 FC Adapter Available
Location Available 34-08 FC Adapter 31-08
Maximum number of COMMANDS to queue to the adapter [200]
Maximum Transfer Size F2=Refresh F[0x100000]
Preferred AL_PA [0x1]
Apply change to DATABASE only no
“lsdev -Cc disk “command initiates device discovery, filters the output an lists only “disk” class devices.
Example: Each FC adapter discovers the Symmetrix data volume 06 = hdisk3 and hdisk6. The pseudo Powerpath device name
for volume 06 is hdiskpower1.
(Similarly Data volume 05= hdisk2 and hdisk5. The pseudo Powerpath device name for volume 05 is hdiskpower0.)
Example:
# lsdev -Cc disk
hdisk0 Available 40-60-00-4,0 16 Bit LVD SCSI Disk Drive
hdisk1 Available 31-08-01 EMC Symmetrix FCP Raid1
hdisk2 Available 34-08-01 EMC Symmetrix FCP Raid1
hdisk3 Available 34-08-01 EMC Symmetrix FCP Raid1
hdisk4 Available 34-08-01 EMC Symmetrix FCP Raid1
hdisk5 Available 31-08-01 EMC Symmetrix FCP Raid1
hdisk6 Available 31-08-01 EMC Symmetrix FCP Raid1
hdiskpower0 Available 34-08-01 PowerPath Device
hdiskpower1 Available 34-08-01 PowerPath Device
A Powerpath “powermt display dev=all” command showing the path alive (Open) status of Symmetrix storage ports FA-13aA
and 4bB for data volumes.
Example:
# powermt display dev=all
Pseudo name=hdiskpower0
Symmetrix ID=000185500118
Logical device ID=0005
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
==============================================================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
0 fscsi1 hdisk2 FA 4bB active alive 0 0
1 fscsi0 hdisk5 FA 13aA active alive 0 0
Pseudo name=hdiskpower1
Symmetrix ID=000185500118
Logical device ID=0006
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
==============================================================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
0 fscsi1 hdisk3 FA 4bB active alive 0 0
1 fscsi0 hdisk6 FA 13aA active alive 0 0
The “df “command output showing the mounted partitions and mounting points.
Example: Logical volumes mounting directories (\pwrvol10 and \pwrvol11)
# df -k
Filesystem 1024-blocks Free %Used Iused %Iused Mounted on
/dev/hd4 16384 4152 75% 1467 18% /
/dev/hd2 950272 9464 100% 32817 14% /usr
/dev/hd9var 16384 12956 21% 580 15% /var
/dev/hd3 32768 31624 4% 43 1% /tmp
/dev/hd1 16384 14624 11% 21 1% /home
/dev/lv00 1015808 132284 87% 906 1% /usr/sys/inst.images
/dev/lv01 1048576 982704 7% 17 1% /pwrvol0
/dev/lv02 1048576 1015612 4% 17 1% /pwrvol1
Powerpath “Powermt display every=5” command output screen showing current path and IO status. The status is continuously
updated at specified intervals.
Warning: DO NOT DISABLE or DISCONNECT HP-UX HOST or STORAGE PORT without removing the existing
hardware path link to the storage volume.
HPUX requires removal of configured link to volumes while it is still active. Please refer to Step 6: Restoring the Closed Path
on the Brocade Fabric on page 7-21. First perform Steps 1-3 to remove the previously configured hardware link on Fabric B
for all configured volume from their respective volume group. Then disable the port and move the connection to new port.
Follow the remaining steps when you are ready to restore the new link.
Consider removing path links while it is still active for the following occasions:
• before Core PID format change
• before moving to a new switch if the Domain ID or Port ID is changing for the link
Example: “ioscan -FNCc fc” showing the claimed FC adpater0 and adapter1 and configured paths.
# ioscan -FnC fc
pci:fcms:F:T:F:-1:26:4294967295:fc:td:8/0/1/0:16 60 16 40 0 255 240 0 :0:root.cc
io.GSCtoPCI.td:td:CLAIMED:INTERFACE:HP Tachyon TL/TS Fibre Channel Mass Storage
Adapter:0
/dev/td0
“ioscan -FnC disk” command discovers and shows pre-assigned two Symmetrix data volumes 05, 06 and VCM (Symmetrix
Volume logix database) on each adapter.
Example:
# ioscan -FnC disk (Disk discovery)
csi:wsio:T:T:F:31:188:131072:disk:sdisk:8/0/1/0.7.20.0.0.0.0:0 0 2 18 0 0 0 0 1
7 152 137 45 136 18 23 176 :2:root.ccio.GSCtoPCI.td.fcp.fcparray.tgt.sdisk:sdis
:CLAIMED:DEVICE:EMC SYMMETRIX:2
/dev/dsk/c2t0d0 /dev/rdsk/c2t0d0 Symmetrix VCM volume
csi:wsio:T:T:F:31:188:136448:disk:sdisk:8/0/1/0.7.20.0.0.1.5:0 0 2 18 0 0 0 0 1
7 152 137 45 246 30 26 5 :4:root.ccio.GSCtoPCI.td.fcp.fcparray.tgt.sdisk:sdisk:
LAIMED:DEVICE:EMC SYMMETRIX:2
/dev/dsk/c2t1d5 /dev/rdsk/c2t1d5 Symmetrix Data volume
csi:wsio:T:T:F:31:188:136704:disk:sdisk:8/0/1/0.7.20.0.0.1.6:0 0 2 18 0 0 0 0 1
7 152 137 45 110 147 236 51 :5:root.ccio.GSCtoPCI.td.fcp.fcparray.tgt.sdisk:sdi
k:CLAIMED:DEVICE:EMC SYMMETRIX:2
/dev/dsk/c2t1d6 /dev/rdsk/c2t1d6 Symmetrix Data volume
csi:wsio:T:T:F:31:188:786432:disk:sdisk:8/4/1/0.9.19.0.0.0.0:0 0 2 18 0 0 0 0 1
7 152 137 45 136 18 23 176 :17:root.ccio.GSCtoPCI.td.fcp.fcparray.tgt.sdisk:sdi
k:CLAIMED:DEVICE:EMC SYMMETRIX:12
/dev/dsk/c12t0d0 /dev/rdsk/c12t0d0
csi:wsio:T:T:F:31:188:791808:disk:sdisk:8/4/1/0.9.19.0.0.1.5:0 0 2 18 0 0 0 0 1
7 152 137 45 246 30 26 5 :18:root.ccio.GSCtoPCI.td.fcp.fcparray.tgt.sdisk:sdisk
CLAIMED:DEVICE:EMC SYMMETRIX:12
/dev/dsk/c12t1d5 /dev/rdsk/c12t1d5
csi:wsio:T:T:F:31:188:792064:disk:sdisk:8/4/1/0.9.19.0.0.1.6:0 0 2 18 0 0 0 0 1
7 152 137 45 110 147 236 51 :19:root.ccio.GSCtoPCI.td.fcp.fcparray.tgt.sdisk:sd
sk:CLAIMED:DEVICE:EMC SYMMETRIX:12
/dev/dsk/c12t1d6 /dev/rdsk/c12t1d6
csi:wsio:T:T:F:31:188:8192:disk:sdisk:8/16/5.2.0:5 128 2 66 0 0 0 0 204 34 187
7 0 0 0 0 :0:root.ccio.bus_adapter.c720.tgt.sdisk:sdisk:CLAIMED:DEVICE:HP
VD-ROM 304:0
/dev/dsk/c0t2d0 /dev/rdsk/c0t2d0
csi:wsio:T:T:F:31:188:24576:disk:sdisk:8/16/5.6.0:0 0 3 18 0 0 0 0 237 219 162
23 41 54 6 82 :1:root.ccio.bus_adapter.c720.tgt.sdisk:sdisk:CLAIMED:DEVICE:SEAG
TE ST39216N:0
/dev/dsk/c0t6d0 /dev/rdsk/c0t6d0
Example: “Ioscan -C disk” command showing only the hardware path link for disk class devices. A 24-bit address of the
Fibre Channel switch port where the disk storage is connected to also embedded in the hardware path. HP-UX applies a Port
ID based storage binding.
# ioscan -C disk
H/W Path Class Description
===============================================================
8/0/1/0.7.20.0.0.0.0 disk EMC SYMMETRIX
8/0/1/0.7.20.0.0.1.5 disk EMC SYMMETRIX
8/0/1/0.7.20.0.0.1.6 disk EMC SYMMETRIX
8/4/1/0.9.19.0.0.0.0 disk EMC SYMMETRIX
8/4/1/0.9.19.0.0.1.5 disk EMC SYMMETRIX
8/4/1/0.9.19.0.0.1.6 disk EMC SYMMETRIX
8/16/5.2.0 disk HP DVD-ROM 304
8/16/5.6.0 disk SEAGATE ST39216N
SAM utility can be used to create logical volume (lvm), volume group (vg), installing file system and creating a mounting
point.
The following SAM screen shows the current symmetrix volume configuration. For example: a logical volume (lvm)
symvol01 belongs to a volume group (vg) symgrp00. Installed file system type is vxFS and mounting point is /gs/mntvol1
Example:
------------------------------------------------------------
Logical Volumes 0 of 10 selected
------------------------------------------------------------
Total Mirror Mou
Logical Volume Volume Group Type Use Mbytes Copies Dir
+-----------------------------------------------------------
lvol1 vg00 LVM HFS 300 0 /sta ^
lvol2 vg00 LVM Swap/Dump256 0
lvol3 vg00 LVM VxFS 200 0 /
lvol4 vg00 LVM VxFS 200 0 /tmp
lvol5 vg00 LVM VxFS 20 0 /hom
lvol6 vg00 LVM VxFS 808 0 /opt
lvol7 vg00 LVM VxFS 1036 0 /usr
lvol8 vg00 LVM VxFS 756 0 /var
symvol01 symgrp00 LVM VxFS 4096 0 /gs/
symvol02 symgrp01 LVM VxFS 4096 0 /gs/
Example: Powerpath “powermt display dev=all” command showing the current status of data volume paths.
# powermt display dev=all
Symmetrix frame ID=000185500118; volume ID=0d
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
=========================================================================
------------- Host Devices ------------ - Symm - --- Path ---- -- Stats ---
### HW-path device director mode state q-IOs errors
==============================================================================
12 8/4/1/0.9.19.0.0.1.5 c12t1d5 FA 14bA active open 0 0
2 8/0/1/0.7.20.0.0.1.5 c2t1d5 FA 3aB active open 0 0
Symmetrix frame ID=000185500118; volume ID=0e
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
=========================================================================
------------- Host Devices ------------ - Symm - --- Path ---- -- Stats ---
### HW-path device director mode state q-IOs errors
=========================================================================
12 8/4/1/0.9.19.0.0.1.6 c12t1d6 FA 14bA active open 0 0
2 8/0/1/0.7.20.0.0.1.6 c2t1d6 FA 3aB active open 0 0
Powerpath “Powermt display every=5” command showing current path and IO processing status. The status is continuously
updated at specified interval.
After connecting a Brocade switch with a Domain ID of 8 to a HP-UX N-class server, the following error message occurred on
the console:
td_create_domain_node: hw_path=for backwards compatibility domain 8 is not allowed. configure the
switch to assign a domain value other than 8. Domain > 8 will not be recognized.
RESOLUTION:
Domain = 8 is a reserved number for HP-UX systems. Domain 8 coincides with the same value used to
designate mass storage private loop devices. i.e. 8/12.8.0.255.0.0.0
The .8 is the same field where the Domain value goes into. In x/x.8.0.x.x.x.x the .8.0 means mass storage private loop in
HP-UX.
Figure A-4 Emulex-LP8000 - Windows 2000 LUN mapping screen two Symmetrix storage ports presented
as SCSI Target 0 and 1
Topology and speed control is setup as shown for fabric operations. (LP-8000 supports only 1 Gbit/sec link speed)
The new disk volume on Windows host is discovered after a host reboot while previously installed and mounted volumes can
be re-discovered by initiating disk management scan process. The two assigned Symmetrix volumes name Symvol 91 and
Symvol92 are partitioned and mounted as shown.
Figure A-6 Disk management scan showing the installed Symmetrix Powerpath disks
Powerpath Administrator screen for Windows platform is equivalent to Powerpath powermt CLI. The Path and IO status is
displayed for Symmetrix volumes.
The IOMeter disk exerciser generating read /write IO traffic on both symmetrix volumes.
v4.0.2 and CLI and Web Tools FirmwareDownload on active CP SilkWorm 12000 and 3900
greater
To obtain the v4.x Firmware Download Support utility go to www.Brocade.com and click on Brocade Connect. This utility
will help determine the recommended firmware processes for the firmware/hardware installation.
Note: Please contact Brocade Technical Support if your CP part number is not on this list.
9. Read the End user software license agreement screen read and click ACCEPT to proceed.
10. Select the appropriate file from the list of Firmware and related files.
11. Unzip the v4.1.0 file into a directory where it can be accessed from a SilkWorm Telnet session.
Note: A firmwaredownload -s command option lets you control the process steps interactively. For example you can delay
firmware commitment until you are satisfied with the functionality of the new firmware. Since one partition always
keep a copy of the older version until the new firmware is committed, it can easily revert back to the previous version.
A step by step manual procedure is described for the purpose of understanding the download process, however the
recommended command line method which does not require intervention is shown in Example-5B (page B-9).
domain_01:admin> version
Kernel: 2.4.2
Fabric OS: v4.0.0c
Made on: Mon Jun 14 17:20:34 2002
Flash: Tue Jun 17 15:11:06 2003
BootProm: 3.1.18
domain_01:admin> firmwareshow
Local CP (Slot 5, CP0): Active
Primary partition: v4.0.0c
Secondary Partition: v4.0.0c
Remote CP (Slot 6, CP1): Standby
Primary partition: v4.0.0c
Secondary Partition: v4.0.0c
3. Determine the CP blade Slot 5 and 6 compatibility by Brocade Part number (See Minimum Level of CP Hardware
Requirement on page B-2) CP Blade P/N 60-0001624-04 is on the eligibility list.
domain_01:admin> chassisshow
CP BLADE Slot: 5
Header Version: 2
Power Consume Factor: -40
Brocade Part Num: 60-0001624-04
Brocade Serial Num: FP01X6046AE
Manufacture: Day: 28 Month: 1 Year: 2003
Update: Day: 16 Month: 6 Year: 2003
CP BLADE Slot: 6
Header Version: 2
Power Consume Factor: -40
Brocade Part Num: 60-0001624-04
Brocade Serial Num: FP01X60469A
Manufacture: Day: 28 Month: 1 Year: 2003
Update: Day: 16 Month: 6 Year: 2003
Time Alive: 51 days
Time Awake: 0 days
4. (Optional) Save the current switch configuration by executing the configupload command.
It is always a good practice to save the existing switch configuration on a server prior to initiating an upgrade or downgrade
process. A successful download process preserves the existing switch configuration parameters. This file can be used either to
verify the post download switch configuration or restore the switch configuration by using the complementary configdownload
command.
domain_01:admin> configupload
Server Name or IP Address [host]: 192.168.162.204
User Name [user]: root
File Name [config.txt]: domian01.txt
Password:
Upload complete
5. Determine the IP address for Switch and CP blades.
domain_01:admin> ipaddrshow 4
SWITCH0
Ethernet IP Address: 192.168.173.178
Ethernet Subnetmask: 255.255.255.0
Fibre Channel IP Address: 0.0.0.0
Fibre Channel Subnetmask: 0.0.0.0
SWITCH1
Ethernet IP Address: 192.168.173.179
Ethernet Subnetmask: 255.255.255.0
Fibre Channel IP Address: 0.0.0.0
Fibre Channel Subnetmask: 0.0.0.0
CP0
Ethernet IP Address: 192.168.173.180
Ethernet Subnetmask: 255.255.255.0
HostName: cp0
Gateway Address: 192.168.173.1
CP1
Ethernet IP Address: 192.168.173.181
Ethernet Subnetmask: 255.255.255.0
HostName: cp1
Gateway Address: 192.168.173.1
7. Log in to the Standby CP (Standby CP1 slot #6 and IP address=192.168.173.181) and verify the exiting Fabric OS version
by executing firmwareshow command.
domain_01:admin> firmwaredownload
Server Name or IP Address: 192.168.163.32 [Server IP address where firmware file resides]
User Name: root [User login to server]
File Name: /fw/v4.1.0/release.plist [Directory path on server]
Password:
Full Install (Otherwise upgrade only) [Y]: Y (Always answer “Y”)
Do Auto-Commit after Reboot [Y]: N
Reboot system after download [N]: N
FirmwareDownload has started.
Removing obsolete packages...
Removing hex-1.2-1
Removing tcpdump-3.6.2-1
Start to install packages......
dir ##################################################
setup warning: /etc/passwd created as /etc/passwd.rpmnew
warning: /etc/passwd.upgrade created as /etc/passwd.upgrade.rpmnew
##################################################
Output has been truncated for clarity.
...
Write kernel image into flash.
.............
Verification SUCCEEDED
Firmwaredownload completes successfully.
FirmwareDownload has completed successfully.
Note: The release.plist file is not located in the root of the firmware directory (/fw/v4.1.0), but the firmware download
process will automatically use the appropriate release.plist file in the child directory, based on the switch type (i.e.
3900, 12000, etc).
9. Once firmwaredownload has been successfully completed, use the reboot command to reboot the standby CP.
10. Log in to the active logical switch again (in this case IP=192.168.173.178) and verify the firmware has been installed with
the firmwareshow command.
domain_01:admin> firmwareshow
Local CP (Slot 5, CP0): Active
Primary partition: v4.0.0c
Secondary Partition: v4.0.0c
Remote CP (Slot 6, CP1): Standby
Primary partition: v4.1.0
Secondary Partition: v4.0.0c
11. Verify the CPs are redundant with the haShow command.
domain_01:admin> hashow
Local CP (Slot 5, CP0): Active
Remote CP (Slot 6, CP1): Standby
HA Enabled, Heartbeat Up
12. Execute the hafailover command to failover the active CP0 to standby CP1 in order to perform firmwaredownload on the
second CP0:
domain_01:admin> hafailover
based system and will cause the active CP to reset. This will
cause disruption to devices attached to both switch 0 and switch 1
and will require that existing telnet sessions be restarted.
To just reboot a logical switch on this system, use command
switchreboot(1M) on the logical switch you intend to reboot.
15. Once firmwaredownload has been successfully completed, use the reboot command to reboot the standby CP.
16. Wait three minutes to allow both CPs to come online and synchronize. Then log in to an active logical switch again (in this
case 192.168.173.178) and verify both primary partitions have Fabric OS v4.1.0 loaded, and both secondary partitions
have the original V4.0.0c firmware loaded:
domain_01:admin> hashow
Local CP (Slot 6, CP1): Active
Remote CP (Slot 5, CP0): Standby, Healthy
HA enabled, Heartbeat Up, HA State synchronized
domain_01:admin> version
Kernel: 2.4.19
Fabric OS: v4.1.0
Made on: Thu May 1 18:43:13 2003
Flash: Tue Jun 17 16:41:53 2003
BootProm: 3.2.4
domain_01:admin> firmwareshow
Local CP (Slot 6, CP1): Active
Primary partition: v4.1.0
Secondary Partition: v4.0.0c
Remote CP (Slot 5, CP0): Standby
Primary partition: v4.1.0
Secondary Partition: v4.0.0c
17. At this point both CPs are running Fabric OS version 4.1.0. After verifying switch functionality under Fabric OS v4.1.0,
continue the process.
18. Log in to each CP (both the active and the standby) and execute the firmwarecommit command to copy the Fabric OS
v4.1.0 firmware to the secondary partition (writing over the Fabric OS v4.0.0c version). You DO NOT need to execute
hafailover.
domain_01:admin> firmwarecommit
Removing obsolete packages
Removing hex-1.2-1
Removing tcpdump-3.6.2-1
Doing firmwarecommit now.
Please wait...
........................................
........................................
Replicating kernel image.
................
Firmwarecommit completes successfully.
Note: If Local CP and Remote CP have different versions of firmware, please retry firmwaredownload command.
Note: The release.plist file is not located in the root of the firmware directory (/fw/v4.1.0), but the firmware download
process will automatically use the appropriate release.plist file in the child directory, based on the switch type (i.e.
3900, 12000, etc).
domain_01:root> firmwaredownloadstatus
domain_01:root> version
Kernel: 2.4.19
Fabric OS: v4.1.0
Made on: Thu May 1 18:43:13 2003
Flash: Wed Jun 18 18:49:27 2003
BootProm: 3.2.4
domain_01:root> hashow
Local CP (Slot 6, CP1): Active
Remote CP (Slot 5, CP0): Standby, Healthy
HA enabled, Heartbeat Up, HA State synchronized
domain_01:root> firmwareshow
Local CP (Slot 6, CP1): Active
Primary partition: v4.1.0
Secondary Partition: v4.1.0
Remote CP (Slot 5, CP0): Standby
Primary partition: v4.1.0
Secondary Partition: v4.1.0
Note: If the Local CP and Remote CP have different versions of firmware, please retry the firmwaredownload command.
1. Open a Web Tools session by providing http address (active switch IP Address) and click Admin view. Find the current
Fabric OS version and upgrade eligibility (see Table 2-1 on page B-1).
2. Select the Firmware Download button from Upload/Download tab and enter the User name, password, server IP
address, and complete path for Fabric OS v4.1.0 directory appended by the release.plist file.
Note: The release.plist file is not located in the root of the firmware directory (/fw/v4.1.0), but the firmware will use the
appropriate release.plist file in the child directory, based on its type.
3. After providing the information, click Apply or OK to start the firmware download process. The firmware download
process is similar as described in Upgrading to Fabric OS 4.1 from Fabric OS 4.0.0d or Greater on page 9.
4. Monitor the Firmware Download status bar and message window for process updates or error messages, until the
firmware download is completed successfully on both CPs.
5. Close the Web Tools session and re-open a new session and verify the new firmware version and switch functionality.
6. Click the Info button on each switch to view switch online status. Additional verification can be done from a telnet
session as described in Upgrading to Fabric OS 4.1 from Fabric OS 4.0.0d or Greater on page 9.
Note: The SilkWorm 3900 firmware download procedure is invoked with firmwaredownload command providing reboot and
auto-commit capability or using Brocade Fabric Manager and Web Tools GUI interface. The SilkWorm 3900 requires
self-rebooting to activate new firmware, therefore the firmware download process in this case is disruptive. (The IO
path is restored after self-diagnostic test is completed by the switch following a re-boot).
The glossary should be modified to include terms that are used in the document. This means terms may have to be deleted and
others added.
Blocking The inability of one device to connect to another device. The Brocade Virtual Channel
implementation of Fibre Channel does not block. The term blocking is often confused
with the term congestion.
Congestion If two or more sources contend for the same destination, performance for each source
may decrease; however, available bandwidth is shared fairly by all sources contending
for the same destination. Congestion is the realization of the potential of
over-subscription. Congestion may be due to contention for a shared storage port or host
port, or an ISL.
Control Processor The term control processor is associated with a SilkWorm 12000 component/FRU (field
replacable unit). The SilkWorm 2000, 3200, 3800, and 3900 switches do not have a
FRU specifically associated with it and when CP is used in the context of other
SilkWorm switches, the reference is to the switch CPU and not a FRU.
Core PID Format The 24-bit Switch Fabric Port Identification (PID) also known as SID consists of
Domain ID, Area and AL_PA fields.
Core Switch Also known as a “core fabric switch.” This is one of the switches at the logical center of
a Core/Edge fabric. There are generally at least two core switches per Core/Edge fabric
to enable resiliency within the fabric. Ports on a core switch are normally used for ISLs.
Edge Switch This is one of the switches on the logical outside edge of a Core/Edge fabric. There are
generally many more edge switches than core switches. Ports on edge switches are used
for SAN device connections.
Fabric One or more interconnected Fibre Channel switches. The term “Fabric” only refers to
the interconnected switches, not to nodes or devices connected to the fabric.
Fabric build The build fabric Switch Fabric Internal Link Service requests a non-disruptive
(BF) configuration to the entire fabric. A BF process shall not cause the Domain ID list to be
cleared. This preserves existing node port addresses and allows open exchanges to be
completed.
Impact: Fabric build is a non-disruptive process to I/O.
Fabric Port Count The number of ports available to connect SAN devices in a fabric. ISLs ports (E-ports)
are not included in this count. (Also known as user port count.)
Fabric Re-Configura- Fabric re-configuration is a disruptive fabric operation during which Domain IDs may
tion (RCF) change. If the Domain ID changes, all attached node ports must re-login with the fabric
and be assigned new N-Ports identifiers reflecting the change in Domain IDs.
Impact: Reconfigure causes Class-n frames (1,2,3,4 or 6) to be discarded and class 1
connection to be abnormally removed.
Fabric Segmentation A fabric is unable to resolve the switch configuration parameters during the rebuild
process with one or more switches, and may isolate them from the fabric, causing fabric
segmentation.
Impact: I/O operations are ceased only on those devices losing their access due to
segmentation.
Fabric Topology A topology is “the logical layout of the components of a computer system or network
and their interconnections.” A fabric topology is the layout of the switches that form a
fabric.
FSPF Fabric Shortest Path First protocol. The FSPF protocol was developed by Brocade and
subsequently adopted by the Fibre Channel standards community for allowing switches
to discover the fabric topology and route frames correctly. It is now the industry
standard routing protocol for Fibre Channel networks.
HA High Availability
High Locality If devices that communicate with each other are connected to the same switch or groups
of switches then these devices have high locality. The higher the locality, the less traffic
crosses ISLs/trunks and therefore, fewer ISLs/trunks are needed.
Hop Count For evaluating SAN designs, the hop count is identical to the number of ISLs that a
frame must traverse to reach its destination.
Host Edge Switch Edge switch with host device connections only.
ISL Over-Subscription In networks where all ports operate at the same speed, the over-subscription ratio for an
Ratio ISL is the number of different ports that could contend for the use of its bandwidth. If
there are 14 node ports on a switch and two ISLs, the ratio is 14:2, or 7:1. When there is
a mixture of port speeds, the exact calculation is not as simple. The rule of thumb is that
the lower the ratio is, the better performance is likely to be.
Latency The time it takes for a frame to traverse from its source to its destination is referred to as
the latency of the link. Sometimes a frame is switched from source to destination on a
single switch and other times a frames must traverse several hops between switches
before it reaches its destination.
Locality The degree that I/O is confined to a particular switch or segment of a fabric. If two
devices that need to communicate with each other are located on the same switch or
fabric segment, then these two devices are said to have high locality. If these same
devices are located on different switches or segments of a fabric and these two devices
need to communicate with each other, then these devices are said to have low locality.
Logical Switch The SilkWorm 12000 can contain up to 128 ports in a 14U chassis, configured as two
64-port switches. Each switch is known as a logical switch and may also be referred to
as a Domain.
Low Locality If two devices must cross an ISL/Trunk to communicate, then these devices have low
locality. The lower the locality, the more traffic crosses ISLs/trunks and therefore, more
ISLs/trunks are needed.
Node Any SAN device – usually either a host or storage device – that attaches to a fabric.
Octet An octet is a group of two adjacent quads. The SilkWorm 3900 is the only SilkWorm
switch that implements octets. Octets are used primarily to define boundaries for
performance tuning purposes.
Online Fabric A functional stable state of a fabric performing reliable I/O fabric operations.
Over-Subscription A condition where more nodes could potentially contend for the use of a resource – such
as an ISL – than that resource could simultaneously support, that resource is said to be
over-subscribed.
PID bindings Static mapping between physical and logical devices on a host accomplished via
Port_ID (PID).
Radius The greatest “distance” in hops between any edge switch and the center of a fabric can
be thought of at that fabric’s radius. Low radius networks have lower hop counts and
latency than high radius fabrics. The unit of measurement for a fabric radius is hops.
Redundant Fabric A SAN composed of two or more independent fabrics The multiple fabric architecture
makes dual fabric SANs redundant.
Impact: SAN topology configured to provide two or more alternate paths for high
availability.
SAN A Storage Area Network (SAN) can consist of one or more related fabrics and the
connected SAN devices.
SAN Architecture The overall design or structure of a storage area network solution. This includes one or
more related fabrics, each of which has a topology. Other components may also be
included, such as host, storage, and other SAN devices.
SAN Port Count The number of ports available for connection by nodes in the entire SAN. The SAN Port
Count equals the fabric port count in a single fabric SAN and is equal to the sum of each
fabric’s port count in a multi-fabric SAN.
Scalability The ease with which a particular design can grow and adapt without requiring a
significant change in SAN architecture or requiring a substantial re-layout of existing
SAN devices.
Secure Mode Disabled An operating mode where all switches that participate in the fabric are unable to
successfully execute the command secModeEnable or if the command
secModeDisable is successfully executed in the fabric.
Secure Mode Enabled An operating mode where all switches that participate in the fabric are running a version
of Fabric OS that supports the security feature, have licenses to run security, and the
command secModeEnable has been successfully executed.
Single Fabric A SAN composed of a single fabric may be configured to provide one or more paths via
different switches of the fabric.
Impact: Offers no Protection at fabric level. All paths are closed when fabric is offline,
completely stopping I/Os.
SPOF A single point of failure. A SPOF in a SAN is any component – either hardware or
software – that could cause a fabric or a SAN to fail.
Storage Edge Switch Edge switch with storage device connections only.
Tiering The process of grouping particular SAN devices by function and then attaching these
devices to particular switches or groups of switches based on that function
Total Ports The total number of ports of all the switches in the SAN
User Ports Total number of switch ports less ports used for ISLs/trunks