FICON Native Implementation and Reference Guide
FICON Native Implementation and Reference Guide
Implementation and
Reference Guide
Architecture, terminology, and
topology concepts
Bill White
Margaret Beal
Bernard Filhol
Manfred Lindenau
Ken Trowell
ibm.com/redbooks
SG24-6266-00
International Technical Support Organization
August 2001
Take Note!
Before using this information and the products it supports, be sure to read the general information in Appendix E,
“Special notices” on page 265.
This edition applies to FICON channel adaptors installed and running in FICON native (FC) mode in the IBM zSeries
900 procressors (at hardware driver level 38) and the IBM 9672 Generation 5 and Generation 6 processors (at
hardware driver level 26).
When you send information to IBM, you grant IBM a non-exclusive right to use or distribute the information in any
way it believes appropriate without incurring any obligation to you.
Chapter 1. Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . .. . . . . .1
1.1 How to use this redbook . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . .. . . . . .1
1.2 Introduction to FICON . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . .. . . . . .2
1.3 zSeries 900 and S/390 9672 G5/G6 I/O connectivity . . . . . .. . . . . .. . . . . .3
1.4 zSeries and S/390 FICON channel benefits . . . . . . . . . . . .. . . . . .. . . . . .4
v
Chapter 12. FICON - Fibre Channel cabling . . . . .. . . . .. . . . . .. . . . . .. 153
12.1 Basic implementation options . . . . . . . . . . . . .. . . . .. . . . . .. . . . . .. 153
12.2 Basic FICON cabling terminology . . . . . . . . . .. . . . .. . . . . .. . . . . .. 153
12.3 Key items for fiber cable planning . . . . . . . . . .. . . . .. . . . . .. . . . . .. 155
12.3.1 FOSA types and fiber modes . . . . . . . . . .. . . . .. . . . . .. . . . . .. 156
12.3.2 Link loss budget. . . . . . . . . . . . . . . . . . . .. . . . .. . . . . .. . . . . .. 157
12.3.3 Distance considerations . . . . . . . . . . . . . .. . . . .. . . . . .. . . . . .. 157
12.4 Fiber extender and fiber repeater. . . . . . . . . . .. . . . .. . . . . .. . . . . .. 160
12.5 Reusing of existing cables and trunks . . . . . . .. . . . .. . . . . .. . . . . .. 162
12.6 Mixed cabling implementation example . . . . . .. . . . .. . . . . .. . . . . .. 165
Glossary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .271
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .279
vii
viii FICON Native Implementation and Reference Guide
Preface
This IBM Redbook covers the planning and implementation of FICON channels,
operating in FICON native (FC) mode for the IBM zSeries 900 and 9672
Generation 5 (G5) and Generation 6 (G6) processors. It discusses the FICON
and Fibre Channel architectures, terminology, and supported topologies.
This book provides information about the available FICON native products,
system and I/O device setup, availability and recovery considerations, and
migration recommendations. It focuses on installing the new FICON Directors
and FICON native control units in both a new and existing ESCON and FICON
channel environment. Helpful information for monitoring and managing a FICON
native (FC) environment is also included.
In this document you will find examples of the z/OS and OS/390 definitions
required to support FICON native control units and FICON Directors, as well as
migration scenarios for control units using ESCON (CNC) channels or FICON
Bridge (FCV) mode channels to FICON native (FC) mode channels.
Margaret Beal is a z/OS and OS/390 Level 2 support specialist, based in Sydney,
Australia. She has 25 years of experience in OS/390 software support and her
areas of expertise include I/O Supervisor and HCD.
Ken Trowell is a S/390 and zSeries specialist who has worked both in the field in
IBM Australia (and many other countries) and in the IBM Development Lab in
Poughkeepsie. He has worked with FICON Design and has an extensive
background in both the design and implementation of I/O channel subsystems
and I/O configurations.
Robert Haimowitz
International Technical Support Organization, Poughkeepsie Center
Alfred Schwab
Editor
International Technical Support Organization, Poughkeepsie Center
Jim Horton
IBM MPM Sevice Planning
Kirby Dahman
IBM Tape Architecture/Performance
Phillip Mills
IBM San Jose
Larry Steele
IBM Tucson
Petra Scherer
IBM Germany
Paulus Usong
IBM ATS Storage Systems
Harry Yudenfriend
IBM z/OS IOS Design
Mario Almeida
IBM Brazil
Wolfgang Fries
IBM Germany
Kuno Kern
IBM Germany
Comments welcome
Your comments are important to us!
xi
xii FICON Native Implementation and Reference Guide
Chapter 1. Overview
This redbook discusses the planning and implementation of FICON channels
operating in FICON native (FC) mode, in new or existing zSeries 900 or S/390
9672 Generation 5 (G5) and Generation 6 (G6) environments.
In this chapter, there is a guide to referencing the other chapters in the redbook
according to task. There is also an introduction to FICON, including an overview
of the benefits of a FICON environment.
Use Table 1 as a guide for referencing the material required for a specific task.
FICON awareness is required at various levels to carry out each task.
Table 1. Task roadmap
Task Chapter
FICON implementation
FICON support
The zSeries 900 and S/390 9672 G5/G6 processors’ support of the FICON
channel allows the FICON channel to operate in one of two modes:
• A FICON channel in FICON Bridge (FCV) mode allows access to S/390
ESCON control units with ESCON interfaces by the FICON channel in FICON
Bridge (FCV) mode that is connected to a 9032-5 ESCON Director FICON
Bridge adapter.
• A FICON channel in FICON native (FC) mode allows access to FICON native
interface control units either directly by a FICON channel in FICON native
(FC) mode (FICON native point-to-point), or from a FICON channel in FICON
native (FC) mode connected through a Fibre Channel FICON Director (FC
switch), also known as FICON native (FC) mode switched point-to-point. The
architecture that describes the FICON operation when the FICON channel is
operating in FICON native (FC) mode is the FC-SB-2 architecture.
The term FC when used in the phrase FICON native (FC) mode refers to the
mode that the FICON channel is defined to operate in, and in this book it also
A FICON channel in FICON native (FC) mode and a FICON channel in FICON
Bridge (FCV) mode support different topologies and have different support
requirements. This redbook covers planning and implementation for FICON
channels in FICON native (FC) mode. It does not cover the operation of the
FICON channel operating in FICON Bridge (FCV) mode. Refer to FICON (FCV
Mode) Planning Guide, SG24-5445 for information about FICON operation in
FCV mode.
The terms (FC) and FC is used throughout this book when referring to either the
mode of operation of the channel or parts of the Fibre Channel architecture.
Examples of the use of (FC) and FC are:
• FICON native (FC) mode - the zSeries and 9672 G5 and G6 processor
definition of a FICON channel defined to operate in the FC-SB-2 architecture
mode
• FC-2 - the Fibre Channel (FC-FS) level 2
• FC-4 - the Fibre Channel (FC-FS) level 4
• FC-FS - Fibre Channel - Framing and Signalling architecture
• FC-PI - Fibre Channel - Physical Interface architecture
Chapter 1. Overview 3
zSeries 900 (2064)
and S/390 9672 G5/G6 CF01
ISC 2064 - 100
3590
(Fiber re-use) TapeCU
ISC ICB FICON
Switched 2105
Point-to-Point Point-to-Point
FICON ESS CU
IC FC
Channel FICON Switch
Printer
Native FICON
CU
FICON Bridge
(Fiber re-use)
ESCON ESCD ESCON Control
FICON
(CTC)
Bridge Unit
ESCON ESCD ESCON Control
ESCON
Unit
9034 Parallel
Converter
ESCON Control
Unit
Parallel Parallel
ESCON ESCON
Figure 1. zSeries 900 (2064) and S/390 9672 G5/G6 I/O connectivity
Increased distance
With FICON, the distance from the channel to control unit or channel to switch or
switch to CU link is increased using dark fiber. The distance for ESCON of 3 km is
The benefits of FICON channels operating in FICON native (FC) mode are the
result of exploiting features of both the Fibre Channel infrastructure and the
FICON (FC-SB-2) architecture. The Fibre Channel provides for higher link
utilization through frame multiplexing and link pacing.
The link pacing is made possible through the use of buffer credits (this prevents
the overrunning of the port capabilities at both ends of a link). The Fibre Channel
switch introduces frame packet switching (frame multiplexing), which provides
better utilization of the links than circuit switching does. The ESCON director
uses circuit switching.
The FICON channel in FICON native (FC) mode offers benefits through the use
of CCW and data prefetching and pipelining, which leads to a reduction in
required communication and communication interlock hand-shaking. The pacing
of operations between the channel and the control unit is controlled by channel IU
pacing support.
Each of these concepts is explained in more detail in the chapters that follow.
Chapter 1. Overview 5
6 FICON Native Implementation and Reference Guide
Chapter 2. FICON topology and terminology
This chapter describes the topology supported by a FICON channel when in
FICON native (FC) mode and the terminology used for describing components
used in the Fibre Channel topology in the FICON channel-to-CU path, and the
terminology that is used for certain communication actions by the FICON
channel. There are a number of topologies associated with Fibre Channel and
FICON channel configurations, although not all are currently supported by
zSeries 900 or the 9672 G5/G6 processors. The topologies include:
Point-to-point (a FICON and Fibre Channel fabric term)
Switched point-to-point (a FICON term)
Switched fabric (a FICON Multi-switch cascade switching term and a Fibre
Channel fabric term)
This chapter describes the topologies that are supported by the zSeries 900 and
9672 G5/G6 processors.
FICON
Channel FICON
FC Link
CU
zSeries and FICON Full Dynamic Switching of
9672 G5/G6 FC Links Switch
FICON Control Units
Servers FICON
FC Link CU
FICON
Channel
With a FICON channel in FICON Bridge (FCV) mode, the connectivity is from a
zSeries 900 or a 9672 G5/G6 processor FICON channel to an ESCON control
unit. The FICON channel connection is always to an ESCON Director that has a
FICON Bridge card installed, for example the 9032-5. The connection is then
from the ESCON Director to an ESCON interface at the control unit. There can be
up to eight concurrent connections (concurrent I/O operations) between the
zSeries or 9672 G5/G6 FICON channel (in FCV mode) and ESCON control units.
Each of the concurrent connections would be to different ESCON Director
destination ports, and to different control units attached to the ports.
With a FICON channel in FICON native (FC) mode, the connectivity is from a
zSeries 900 or a 9672 G5/G6 processor FICON channel to a FICON capable
control unit. The connection is from the FICON native (FC) mode channel to
either an FC switch (Fibre Channel Switch) and then onto a FICON control unit
(switched point-to-point connectivity), or directly to a FICON capable control unit
with a FICON adapter installed (point-to-point connectivity).
The FICON channel in FICON native (FC) mode supports multiple concurrent I/O
connections. Each of the concurrent I/O operations can be to the same FICON
control unit (but to different devices) or to different FICON control units.
Note that this publication refers to both a FICON-capable Fibre Channel switch
(FICON switch) and a FICON Director. FICON switch is a generic term for a
The following major items and areas are required to establish connectivity
between a processor’s FICON channel and the control unit FICON adapter:
• Fibre Channel cables
- 9 micron single-mode fiber cables (9 um SM)
- 50 micron multimode fiber cables (50 um MM)
- 62.5 micron multimode fiber cables (62.5 um MM)
• Transmission types
- Short wavelength Laser 850 nano meters (SW laser 850 nm)
- Long wavelength Laser 1300 nano meters (LW laser 1300 nm)
• Fibre Channel standard interface
- FC-PI physical interface architecture
• Fibre Channel standard protocol
- FC-FS Protocol architecture
- FC-SB-2 Protocol architecture
• Point-to-point (Node_Port to Node_Port)
- Fabric Login (FLOGI) - Node_Port to Fabric_Port login
- Port Login (PLOGI) - Node_Port to Node_Port login
• Switched point-to-point (Node_Port to Fabric_Port to Node_Port)
- Fabric Login (FLOGI)
- Node_Port Login (PLOGI)
• Channel to CU communication
- Command and data prefetching (z/Architecture)
- CCW and Data pipelining (FC-SB-2 architecture)
In a point-to-point connection the Fibre Channel (FC) links are between the
processor FICON channel card FICON port (N_Port) and the FICON adapter card
FICON port (N_Port) in the control unit.
In a switched point-to-point connection there are two Fibre Channel (FC) links.
One is between the FICON channel card FICON port (N_Port) and the Fibre
Channel switch (FC Switch) Fibre Channel adapter card FC port (F_Port), then
internally within the switch to another Fibre Channel adapter card FC port
(F_Port), and then to a FICON adapter card FICON port in the Control Unit
(N_Port).
The channel N_Port and the control unit N_Port are responsible for managing the
access to the link among the logical images.
Server Storage
Channels and control unit links can be attached to the Fibre Channel switch in
any combination, depending on configuration requirements and on available
resources in the Fibre Channel switch.
Sharing a control unit through a Fibre Channel switch means that communication
from a number of channels to the control unit can take place either over one
switch to CU link (in the case where a control unit has only one link to the Fibre
Channel switch), or over multiple link interfaces in the case where a control unit
has more than one link to the Fibre Channel switch.
Just one Fibre Channel link is attached to the FICON channel in a FICON
switched point-to-point configuration, but from the switch the FICON channel can
communicate with (address) a number of FICON CUs on different switch ports.
Once at the control unit, the same control unit and device addressing capability
exists as for the point-to-point configuration. However, the communication and
addressing capability is greatly increased for the channel when the channel is
connected to a Fibre Channel switch with the ability to use the domain and port
address portion of the 24-bit N_Port address (8 bits for the domain and 8 bits for
the port) to access multiple control units.
Note that the domain address portion of the FC 24-bit port address would be
different if there were more than one switch (cascade switching) in the
channel-to-control unit path. Cascade switching is currently not supported by the
zSeries 900 or 9672 G5/G6 processors.
Fibre Channel
Fibre Channel support and the FICON channel using the FC-SB-2 protocol
introduce the following topologies:
• Point-to-point - no switch between the channel (server) and the CU (storage
device), supported by a FICON channel in FICON native (FC) mode
• Switched point-to-point - a single switch between the channel (server) and the
CU (storage device), supported by a FICON channel in FICON native (FC)
mode
• Cascade switching - with two switches in the channel-to-CU path
• Cascade switching - with multiple switches in the channel-to-CU path
• FC fabric - consists of one or more Fibre Channel switches with
interconnection switching routes
In the current zSeries and 9672 G5/G6 implementation, only FICON (SB-2 mode)
point-to-point (no FC switch) and FICON (SB-2 mode) switched point-to-point
(one FC switch in the channel-to-CU path) topologies are supported, therefore
only those terms that apply to these two supported topologies are used in this
chapter.
Figure 5 introduces the new FICON native terms, which are used in a switched
point-to-point topology.
Optical Link The optical link is the physical link between 2 Fiber Optic
Subassembly(FOSAs) of the same wavelength and type (LW
laser or SW Laser), in general the wavelengths used by the
FOSAs must match. The fibre cable connecting the FOSAs can
be a single-mode (9um) or a multimode (50 um or 62.5 um) cable
depending on the type of FOSA in the FICON adapter card. The
maximum distance for the optical link depends on the type of
FOSAs used (LW or SW) and on the type of fiber cables (SM or
MM, MCP) used to connect the FOSAs. Refer to “FICON - Fibre
Channel cabling” on page 153 for physical planning of the optical
link.
Fibre Channel Link (FC Link)
In a FICON native (FC) mode switched point-to-point connection,
the Fibre Channel link (FC link) is a communication link between
a FICON adapter in the processor (server) and a Fibre Channel
switch port (N_Port-to-F_Port), also between a Fibre Channel
switch port and a FICON adapter in a Control Unit (storage
device) (F_Port-to-N_Port). This includes any optical fiber
extenders that may be in the FC link. The maximum distance for
an FC link depends on the Buffer-to-Buffer credits provided by the
FC adaptors at each end of the FC link, the N_Ports and the
F_Ports.
Optical Link The optical link is the physical link between 2 FOSAs of the same
Type (LW or SW Laser). The fiber cable connecting both FOSAs
can be an SM (9 um) or an MM (50 um or 62.5 um) cable
depending on the type of FOSA in the FICON adapter card. The
maximum distance for the optical link depends on the type of
FOSAs used (LW or SW) and on the type of fiber cables used to
build the link (SM or MM, MCP). Refer to “FICON - Fibre Channel
cabling” on page 153 for physical planning the optical link.
Fibre Channel Link (FC Link)
In a point-to-point connection the Fibre Channel link (FC link) is
the Link between the two N_Ports. This may also include Fibre
Extenders. The maximum distance for the FC link depends on the
buffer-to-buffer credits provided by both N_Ports.
Fabric Login Both ports connected by the FC Link have to do a Fabric Login
(FLOGI) as described in the FC-FS architecture. Fabric Login
determines the presence or absence of a fabric. If a fabric is not
present, an Accept with the specification of N_Port in Common
Service Parameters indicates that the requesting N_Port is
attached in a point-to-point topology. Refer to “Fabric Login
(FLOGI)” on page 24 for further details.
N_Port Login If a fabric is not present, as determined by performing the Fabric
Login procedure, one of the two N_Ports proceeds with
destination N_Port Login (PLOGI). This returns the Service
These architectures are used by the zSeries 900 and 9672 G5 and G6
processors supporting FICON channels in FICON native (FC) mode and the
FICON Architecture (FC-SB-2).
The zSeries processors support the z/Architecture, which provides the instruction
and operation details for the start and subsequent completion of an I/O operation.
The z/Architecture I/O operation consists of channel commands and data (data
that is associated with the commands). The commands and data (Write
operation) are transferred from the zSeries processor storage to the channel and
then to the Storage Device (Control Unit). For Read operations the data is
transferred from the Storage Device to the zSeries channel and then to processor
storage.
This chapter covers the use of the zSeries and 9672 G5/G6 FICON channel in
FICON native (FC) mode using the Fibre Channel architecture to support the
zSeries I/O operations; see Figure 7.
z/Architecture CU/Device
Channel Programs Architecture
Commands and Data
FICON FICON
FC-SB-2 FC-SB-2
Fibre Channel
Server
zSeries 900 or IBM ESS Model F20 (2105)
9672 G5/G6 Storage Control Unit/Device
LP1 CU Device
Device
z/OS Image Device
FICON FICON
LP2 FC-SB-2 FC FC-SB-2 CU Device
Device
OS/390 FC-FS Switch FC-FS Image Device
FC-PI FC-PI
LP3 CU Device
Device
z/OS Image Device
The scope of each of the Fibre Channel architectures, and other Fibre Channel
FC-4 level architectures, plus the z/Architecture and S/390, and the CU/Device
LP1 CU Device
Device
z/OS Image Device
FICON N_Port F_Port F_Port N_Port FICON
LP2 FC-SB-2 FC FC-SB-2 CU Device
Switch Device
OS/390 FC-FS FC-FS Image Device
FC-PI FC-PI
LP3 FC Switch (FC-SW) CU Device
z/OS Device
Image Device
FICON (FC-SB-2)
z/Architecture CU/Device
Channel Programs Architecture
Commands and Data
Note that this list includes those Fibre Channel architectures that are used during
an I/O request for a FICON channel in FICON native (FC) mode.
Channel CU
N_Port N_Port
The FICON channel in FICON native (FC) mode provides connectivity to FICON
control units and does not require a 9032-5 bridge card (which is required when
the FICON channel is defined in FICON Bridge (FCV) mode). Connectivity to a
FICON control unit can be by a switched point-to-point topology, or a
point-to-point topology.
The FICON channel in FICON native (FC) mode supports multiple concurrent I/O
operations between the FICON channel and the FICON control unit (but to
different device addresses or device numbers), or between the FICON channel
and multiple different FICON control units (to devices in those control units). The
number of concurrent I/O operations between the FICON channel in FICON
native (FC) mode and FICON control units (control unit devices) depends on the
processor model (Server), FICON Director, configuration definition, and the
control unit (Storage Device) operation and performance.
Channel
Fibre Channel Link
CU
N_Port N_Port
Channel CU
N_Port N_Port
The FC-FS and FC-SB-2 initialization steps between the nodes and ports are:
• Channel/Switch FC link initialization (FC-FS)
• Channel to the Switch ELSs- (FC-FS)
• Switch to the Channel ELS - (FC-FS)
• Control Unit/Switch FC link initialization (FC-FS)
• Control Unit to the Switch ELSs - (FC-FS)
• Switch to Control Unit ELS - (FC-FS)
• Channel to Control Unit ELS and FC-4 Device Level (FC-FS and FC-SB-2)
Figure 12 on page 23 shows the overall steps that are performed during the
initialization process.
Figure 12. FICON channel and FICON Control Unit initialization steps
FLOGI FLOGI
ACC (F_Port) + (D_ID) ACC (F_Port) + (D_ID) Control Unit
FICON
Channel FICON Port
N_Port N_Port
FC
F_Port F_Port
FC Links Switch FC Links
N_Port N_Port
FICON F_Port F_Port
Control Unit
Channel FLOGI FLOGI FICON Port
ACC (F_Port) + (D_ID) ACC (F_Port) + (D_ID)
Fibre Channel
Figure 13. FICON native (FC) mode fabric login (FLOGI) - switched point-to-point
Login with the fabric (FLOGI) is required for all Node Ports (N_Ports).
Communication with other N_Ports is not allowed until the N_Port Fabric Login
(FLOGI) procedure is complete. Also each Server N_Port is required to login
(PLOGI) with each Storage N_Port with which it intends to communicate; see
“N_Port Login (PLOGI)” on page 26.
The fabric login and port login are methods by which an N_Port establishes its
operating environment with a fabric, if present, and other destination N_Ports
with which it communicates.
Later, when communication is required from the FICON channel port to the
FICON CU port, the FICON channel (using FC-SB-2 and FC-FS protocol
information) will provide both the address of its port: the source port address
identifier (S_ID), and the address of the CU port: the destination port address
identifier (D_ID) (when the communication is from the channel N_Port to the CU
N_Port).
It is important to understand that the Fibre Channel architecture does not specify
how a Server N_Port determines the destination port address of the Storage
Device N_Port it needs to communicate to. This is Node and N_Port
implementation dependent. Basically, there are two ways that a server can
determine the address of the N_Port that it wishes to communicate to:
• The “discovery” method, by knowing the World Wide Name (WWN) of the
target Node N_Port and then requesting a WWN for the N_Port port address
from a Fibre Channel Fabric Service called the fabric Name Server.
• The “defined” method, by the Server (Processor channel) N_Port having a
known predefined port address of the Storage Device (CU) N_Port that it
requires to communicate to.
This latter approach is referred to as the “port address definition approach”,
and is the approach that is implemented for the FICON channel in FICON
native (FC) mode by the zSeries 900 and the 9672 G5/G6, using either the
z/OS HCD function or an IOCP program to define a 1-byte switch port (1-byte
FC “area” field of the 3-byte fiber channel N_Port port address).
Logging into the fabric (FLOGI) provides the N_Port with fabric characteristics for
the entire fabric as defined in the fabric’s service parameters. The service
parameters specified by the N_Port provide the fabric with information regarding
the type of support the N_Port requests.
The Fabric Login (FLOGI) and a successful ACC (accept) response accomplish
five functions:
• It determines the presence or absence of a fabric.
• If a fabric is present, the ACC (accept) response provides a specific set of
operating characteristics associated with the entire fabric.
• If a fabric is present, the fabric optionally assigns or confirms the native
N_Port identifier (N_Port 24-bit FC port address) of the N_Port which initiated
the Login.
• If a fabric is present, it initializes the buffer-to-buffer credit.
The buffer-to-buffer credit represents the number of receive buffers supported
by a port (N_Port or F_Port) for receiving frames. The minimum value of
buffer-to-buffer credits is one. The buffer-to-buffer credit value is used as a
F ibre Channel
Figure 14. FICON native (FC) mode fabric login (FLOGI) - point-to-point
The same initial action (FLOGI), logging in to the fabric, is also required for an
N_Port in a point-to-point topology, but that action will make the N_Port aware
that it is connected in a point-to-point topology and then perform a different action
to determine the two N_Port port addresses. For a FICON channel in FICON
native (FC) mode point-to-point configuration, no N_Port port addresses are
defined for the attached CU N_Port. The actual port address to use for this
configuration is obtained by the channel.
Control Unit
FICON
Channel
FICON Port
N_Port FC N_Port
FC Links Switch FC Links
N_Port N_Port
FICON Control Unit
Channel FICON Port
Fibre Channel
Figure 15. FICON native (FC) mode N_Port login (PLOGI) - switched point-to-point
If a fabric is not present, the N_Port Login procedure provides the service
parameters of the responding N_Port.
For the FICON channel in FICON native (FC) mode, the Accept (ACC ELS)
response to the Fabric Login (FLOGI), in a switched point-to-point topology,
provides the channel with the 24-bit FC N_Port address that the channel is
connected to. This N_Port address is in the ACC destination address field (D_ID)
of the FC-2 header.
The FICON CU port will also perform a fabric login to obtain its 24-bit FC port
address.
zS eries and 967 2 G 5/G 6 a ddre ssin g us age for fabric po rts
D o m a in P o rt @ C o n s ta n t
C U L in k @
Figure 16 shows the FC-FS 24-bit FC port address identifier is divided into three
fields:
• Domain
• Area
• AL Port
It shows the FC-FS 24-bit port address and the definition usage of that 24-bit
address in a zSeries and 9672 G5/G6 environment. Only the 8 bits making up the
FC port address are defined for the zSeries and 9672 G5/G6 to access a FICON
CU. This is the CU 1-byte Link address. The FICON channel in FICON native
(FC) mode working with a switched point-to-point FC topology (single switch)
The zSeries and 9672 G5/G6 processors, when working with a single switch,
switched point-to-point topology, require that the Domain and the AL_Port
(Arbitrated Loop) field values be the same for all the FC F_Ports in the switch.
Only the “area” field value will be different for each of the switch F_Ports.
For the zSeries and 9672 G5/G6 the “area” field is referred to as the F_Port’s
“port address” field. It is just a 1-byte value, and when defining access to a CU
that is attached to this port (using the zSeries HCD or IOCP), the port address is
referred to as the CU Link address.
As shown in Figure 17, the 8 bits for the domain address and the 8-bit constant
field are provided from the Fabric Login initialization result, while the 8 bits (1
byte) for the port address (1-byte CU Link address) are provided from the zSeries
or 9672 G5/G6 CU link definition (using HCD and/or IOCP).
FC-Switch
Obtained from the ACC
response to the FLOGI for
the zSeries and S/390 zSeries and S/390
Configuration Design
and Definition
CU Link @
FICON Control Unit
Channel FICON Port
S_ID D_ID
Channel to CU communication
The frame contains two parts, the FC-FS FC-2 header part plus the payload part
(the FC-SB-2 parts). The FC-2 header part of the frame holds the source FC port
address (S_ID) and the destination FC port address (D_ID). See “Fibre Channel
FC-2 header format” on page 34 for more details on the FC-2 Header content.
The FC-SB-2 header part of the frame holds the channel image address, the
Control Unit Image address, and the Device Unit Address (UA). See “Fibre
Channel FC-SB-2 frame format” on page 35 for more details on the FC-SB-2
header content.
Figure 19. FICON native (FC) mode N_Port and device addressing
The D_ID is used by the FC switch fabric to route the FC frame to its final N_Port
destination. The S_ID allows the destination port to know the source port address
of the incoming frame.
Channel CU
N_Port N_Port
Channel to CU communication
Control Unit
FICON
Channel FICON Port
N_Port FC N_Port
F_Port F_Port
FC Links Switch FC Links
N_Port N_Port
FICON
F_Port F_Port
Control Unit
Channel FICON Port
zSeries and S/390 Node Image to Control Unit Node CU Image/Device communication
Processor (Node) Control Unit (Node)
Channel (N_Port) Control Unit (N_Port)
FC Port Address FC Port Address
Channel Image (LPAR) Control Unit image (CUADD)
Subchannel (UA) Device Address (UA)
The addressing structure for supporting FC-SB-2 (FICON) communiction from the
channel N_port to a Control Unit N_Port consists of:
• The source and destination N_port addresses that are part of the FC-FS FC-2
header
The destination N_Port address is what is used by the fabric to route the FC-2
frame through the fabric. It is checked at the receiving N_Port to see that it
has been delivered to the correct N_Port.
The source N_Port address is used by the destination N_Port to be aware of
where the source of the frame is, so that, for example, it knows where to
communicate back to.
• The Channel image identifier and the Control Unit image identifier, which are
part of the SB-2 header
Going from the channel to the CU, the Channel image identifier allows the CU
to know which Channel image the frame was from; and allows the CU image
identifier to know who the frame is for.
Going from the CU to the channel, the CU image identifier allows the channel
to know who the frame is from; and allows the Channel image identifier who
the frame is for.
• The device unit address
The source information that the FICON channel uses for building the FC-2 frame
is shown in Figure 22.
FICON Channel Channel S_ID (ddaapp) D_ID (ddAApp) Channel Image CU Image UA
FC-2 and SB-2
Protocol Obtained from
Initial Channel
Link Initialization
(FLOGI-ACCEPT)
24 4
4 Bytes 0 to 2112 Bytes Bytes 4
Bytes Bytes
24 24
Bytes Frame Content Bytes
36 to 2148 Bytes
Figure 23 shows the frame format of an FC-2 frame. The frame content is
composed of a frame header, data field, and CRC. When the FC-2 header
controls indicate that the frame is an FC-4 frame, the content of the data field is
the FC-4 layer (FC-SB-2). This field is aligned on a word boundary and must be
equal to multiples of 4 bytes. The format of an FC-SB-2 data field is shown in
Figure 25.
SOF EOF
Idles Header Optional Header + Payload CRC Idles
xx xx
bit 31
Frame Header bit 0
Start of Frame (SOF)
Word 0 * R_CTL Destination ID (D_ID)
1 CS_CTL Source ID (S_ID)
2 * TYPE * Frame Control (F_CTL)
3 SEQ_ID DF_CTL SEQ_CNT
4 OX_ID RX_ID
5 Parameter Field (PARM)
When FC frame communication is from the channel to the CU, the S_ID is the
24-bit FC port address of the Channel N_Port, and the D_ID is the 24-bit FC port
address of the Control Unit N_Port.
When FC frame communication is from the CU to the channel, the S_ID is the
24-bit FC port address of the Control Unit N_Port, and the D_ID is the 24-bit FC
port address of the Channel N_Port.
SOF EOF
Idles Header Optional Header + Payload CRC Idles
xx xx
(0 to 2080 bytes)
The FC-SB-2 frame contents are composed of an SB-2 header, the IU header,
the DIB header, and the DIB data field. These fields provide all required
information for addressing and control of the data transfer. The DIB data field is a
variable-length field of up to 2080 bytes.
Multi-system environment
Figure 26 shows the frame process in a multi-system environment. FICON
(FC-SB-2) architecture provides the protocol for CCW and Data pipelining. This
eliminates the interlocked interface communication that exists in Parallel and
ESCON channels.
zSeries or
S/390 Server FICON native (FC mode) frame transfer
in a multi-system environment
FICON FIC
ON
Channel Fra
me
s
FIC
ON
Fra
zSeries or me
FC Switch
s
S/390 Server
FICON Frames FICON Frames
FICON
FICON Control
Channel Unit
FICON Frames FICON Frames
s
me
Fra
zSeries or O N
FIC
S/390 Server
s
me
Fra
ON
FICON FIC
Full duplex max. of 100MB/sec data transfer in each direction
Channel Multiple systems performing I/O operations concurrently
Multiple operations at a time to/from each system to the CU Port
FC Frames from each system may be multiplexed with other
system frames when they arrive at the FICON CU destination port
Each system transfers its frames, containing commands and/or data (Write
operation) to the FC Switch. The FC Switch then routes the incoming frames from
each system to the CU’s destination port by multiplexing the frames on the switch
to the CU FC link.
When the CU responds to multiple Read request I/O operations, the CU data
frames are transferred to the FC Switch port where the frames are de-multiplexed
to the destination ports (the ports the requesting systems are connected to).
m es
zSeries and Fra
N
FC Switch FI CO
S/390 Server
FICON Frames FICON Frames
FICON
FICON
Control
Channel
Unit
FICON Frames FICON Frames
FIC
ON
Fr a
me
s
FIC
ON
Fra
m es FICON
Control
Full duplex maximum of 100 MB/sec data transfer in each direction Unit
Single system performing multiple I/O operations concurrently
Multiple operations at a time to/from each CU Port
FC frames from each CU are multiplexed at the destination port (FICON channel switch port)
Multiple I/O operations to different Control Units can be transferred at the same
time from a single system through the FC link to the FC Switch. Each frame is
routed to its destination port by the switch and transferred to the destination
Control Unit.
In a response to the I/O request, each Control Unit can transfer its frames at the
same time to the switch, where they are multiplexed to the destination port
(requestor) before being transferred to the system. Figure 28 on page 38 shows
another view of the frame process between multiple S/390 servers and multiple
Control Units.
Payload (FC4) Payload (FC4) Payload (FC4) Payload (FC4) Payload (FC4) Payload (FC4)
Control Unit
FICON Port
100 MB
Full Duplex 100 MB
FC Full Duplex
Link Switch Link
Control Unit
FICON Port
FICON
Channel
Payload (FC4) Payload (FC4) Payload (FC4) Payload (FC4) Payload (FC4) Payload (FC4)
CE/DE End
CCW3 CCW3 CCW3 CCW3
CE/DE End
Figure 30 shows a CCW operation for a FICON native (FC) mode channel, which
exploits CCW and data pipelining.
With a FICON channel, all CCWs (up to the FICON channel IU pacing limit) are
transferred to the Control Unit without waiting for CE/DE after each I/O operation.
The device presents an end to the Control Unit after each CCW execution. Once
the last CCW of the CCW chain has been executed by the CU/device, the Control
Unit presents CE/DE to the channel.
Open exchange,
Buffer Credits CU-D
IU transfers and
R_RDY Frames Buffer Buffer
IU multiplexing Credits Credits
R_RDY R_RDY
FC Link flow control
FC Frame FC Frame
SB-2 IU multiplexing SB-2 IU multiplexing
multiplexing multiplexing
IU pacing (set CRR) for channel CMR response to CRR
to CU/Device flow control SB-2 channe-to-CU/Device end-to-end flow control
Figure 32. zSeries and S/390 processors with FICON native (FC) mode channels
The FICON channel can be installed in the zSeries 900 and the 9672 G5/G6
processors, and can be connected to a FICON-capable control unit either
point-to-point, or switched point-to-point through a Fibre Channel switch.
• Up to 24 FICON channels can be installed in a 9672 G5 processor.
• Up to 36 FICON channels can be installed in the 9672 G6 processor.
• Up to 96 FICON channels can be installed in the zSeries 900.
• The link bandwidth of the FICON link is 100 MBps, whereas the link bandwidth
of the ESCON link is 20 MBps.
There are two FICON channel fiber optic subassemblies (FOSA) supported on
the zSeries and two on the 9672 G5/G6 processors: a long wave laser version
and a short wave laser version.
• zSeries 900 - FICON channel long wave laser, FC 2315 (two ports per
adapter)
• zSeries 900 - FICON channel short wave laser, FC 2318 (two ports per
adapter)
• 9672 G5/G6 - FICON channel long wave laser, FC 2314 (one port per adapter)
The preferred fiber cabling for a long wavelength laser FICON channel is 9
micron single-mode fiber. While 62.5 micron multimode or 50.0 micron multimode
fiber cable may be used for a long wavelength laser FICON channel, the use of
these multimode cables requires the use of mode conditioner patch (MCP)
cables, one at each end of the fiber link, or between optical ports in the link. Use
of the single-mode to multimode MCP cables reduces the supported optical
distance.
The short wavelength laser FICON channel supports the use of both 62.5 micron
and 50.0 micron multimode fiber channels.
Chapter 12, “FICON - Fibre Channel cabling” on page 153 discusses the fiber
cabling requirements in detail.
Whereas the FICON Bridge (FCV) mode channel provided eight concurrent I/O
operation connections (compared to one for an ESCON channel), the FICON
channel in FICON native (FC) mode can provide up to 16 or more concurrent I/O
operation connections by exploiting the FICON channel’s Information Unit (IU)
operation multiplexing and FC frame multiplexing capability. However, the
capability for concurrent I/O operation connectivity should not be confused with
bandwidth capacity. The FICON channel bandwidth utilization depends entirely
E SC O N o nly E S C O N and F IC O N (F C )
1 - 24 FIC O N
2 56 ES C O N 1 68 or 25 2 19 2+ ES C O N
c ha nn els E SC O N ch an ne ls co nn ec tiv ity
eq uiv ale nc e
Figure 33. 9672 G5 ESCON and FICON combined channel connectivity equivalence
1 - 24 or 36 FICON
192+ or 288+
256 ESCON 120 or 168 or 252 ESCON
channels ESCON channels connectivity
equivalence
Figure 34. 9672 G6 ESCON and FICON combined channel connectivity equivalence
1 - 96 FICON
160 768+ ESCON
256 ESCON
ESCON channels connectivity
channels
equivalence
Figure 35. zSeries ESCON and FICON combined channel connectivity equivalence
Distance support
The maximum unrepeated fiber connectivity distance for an ESCON CNC LED
channel link using 62.5 micron multimode fiber is 3 km (or 2 km for 50 micron
fiber). These same distances apply for ESCON Director to control unit links for
ESCON Director LED ports.
For either the FICON LW or SW feature using repeaters, the end-to-end distance
between the FICON channel and the FICON Director port can be up to 100 km.
The same end-to-end distance is also available between the FICON Director port
and the FICON control unit port. However, the overall end-to-end distance
between the FICON channel and FICON control unit should not exceed 100 km.
The extended distance requires that each fiber channel port (F_Port and N_Port)
support 60 buffer credits to avoid a data droop problem.
Certain 9672 G5/G6 channel cards in the 9672 G5/G6 I/O cage can be moved
from an existing 9672 G5/G6 to a zSeries when upgrading the 9672 G5/G6 to a
Table 2 shows the maximum installable FICON channels in relation to the number
of installed zSeries new style I/O cages and G5/G6-like old stye I/O cages. In a
zSeries processor FICON channel adapter cards are installed in the new style I/O
cages only.
Table 2. FICON channels installable in the zSeries processor I/O cages
1 0 32
1 1 32
1 2 32
2 0 64
2 1 64
3 0 96
Each zSeries new style I/O cage supports up to 16 FICON channel adapter
cards. Each FICON channel card has two ports (two channels), so a maximum of
32 FICON channels can be installed in each zSeries new style I/O cage.
Any CHPID number can be assigned to any channel for any channel type card in
any I/O slot in either of the two zSeries processor I/O cage styles. FICON
channels are installed in the zSeries processor without the loss of CHPID
numbers (CHPID numbers may be lost when FICON channels are installed in the
9672 G5/G6 processors), which allows the zSeries processor to have a larger
number of ESCON and FICON channel cards installed. Therefore, a larger
number of concurrent I/O connections can be maintained when FICON channels
are installed, as compared to when FICON channels were installed on the 9672
G5/G6 processors.
O = G5/G5 style I/O cage - feature code 2022 in the zSeries processor
N = zSeries new style I/O cage - feature code 2023 in the zSeries processor
Figure 36. Comparison of ESCON and FICON concurrent I/O - G5/G6 and 2064
Parallel channels are only supported in the zSeries old style I/O cages in the
zSeries processor. Both the three-port (MES upgrade only) and four-port Parallel
channel cards are supported. Those customers who already have Parallel
channels installed in a S/390 9672 G5/G6 Server can keep up to 88 Parallel
channels (requiring one I/O cage FC 2022), or with an RPQ they can keep up to
96 Parallel channels (requiring two I/O cages, FC 2022) when MES upgrading the
9672 G5/G6 to a zSeries 900. In addition to Parallel channels being installed in
the zSeries old style I/O cage (FC 2022), 4-port ESCON channels, and OSA-2
(EN/TR and FDDI) can also be installed in the zSeries I/O cage FC 2022). The
zSeries 900 I/O cage FC 2022 (one or two) is installed in the second zSeries
I/O type New style I/O cage Old style I/O cage
FC 2023 FC 2022
- FICON Yes No
- ATM Yes No
OSA-2 No -
- FDDI - Yes
Also be aware that vendor-written UIMs may need to be upgraded for FICON
support. Refer to “Vendor UIMs” on page 191 for more information.
There is no unique PSP bucket for FICON. For both z/OS and OS/390, the
FICON support information is contained in the PSP buckets for the processor and
control units, listed in Table 4.
Table 4. Processor/CU PSP buckets for z/OS and OS/390 FICON support
ESS 2105device
3590 3590device
a. Although the PSP upgrade name for the Inrange FI-
CON Director is 2042device, this device and the McDA-
TA FICON Director are both defined as device type 2032
in HCD and IOCP. Refer to “FICON Director (2032)” on
page 180 for definition information.
Component APAR
IPL/NIP OW38549
JES2 OW34568
ICKDSF PQ20391
ASM OW38547
JES3 OW31828
IEWFETCH OW34234
DSS OW34111
OAM OW34112
RMF OW35586
OW46170, OW46825 (FICON Management
Server Feature)
SRM OW38548
GTF OW37986
RACF OW34103
IMS PQ26718
5.2 HCD
HCD support for the zSeries 900 processor, including FICON native (FC)
channels, is provided with APAR OW43131. The PTFs that implement APAR
OW43131 for the different releases of HCD are listed in Table 6.
Table 6. HCD support for FICON native (FC) channels on zSeries processors
R051 UW99341
R053 UW99342
R054 UW99343
R091 UW99344
R094 UW99345
APAR OW43132 provides HCD support for FICON native (FC) channel paths
starting with OS/390 R5 HCD on 9672 G5 and G6 machines. The PTFs that
implement APAR OW43132 for the different releases of HCD are listed in Table 7.
Table 7. HCD support for FICON native (FC) channels on 9672 G5/G6 processors
R501 UW99287
R521 UW99288
R031 UW99289
R051 UW99290
R053 UW99291
R054 UW99292
R091 UW99293
R094 UW99294
5.2.1 HCM
No specific maintenance is required for FICON native (FC) support in HCM. From
HCM’s perspective, a FICON native (FC) channel is just like any other channel.
HCM uses HCD as a server on the host side, and any change in HCM that
concerns the logic, or structure of the configuration, such as creating, deleting, or
changing an object, is validated by HCD. Also, the configuration diagram support
does not need to be changed as connections between FC channels look exactly
the same as ESCON channel connections. To summarize, HCM supports FICON
native (FC) channels but does not require additional maintenance for FC support;
the support for FC channels is provided through HCD.
Two HCM APARs in the FICON area should be discussed in order to avoid
confusion. They are APARs IR39712 and IR42956.
APAR IR42956 introduces HCM support for the generic Open Fibre Switch (FCS),
with the following characteristics:
• FCS switches do not support switch control units and devices, and port FE is
not an internal port for FCS.
• No minimal port range needs to be installed.
• Control units and channel paths can be connected to all ports.
• Ports 00-FF are supported.
Neither the Inrange nor the McDATA switches are FCS switches; they are defined
as 2032 FICON Directors, which includes support for a control unit port (CUP).
5.3 IOCP
This section describes the IOCP software requirements for the zSeries 900
processor and the 9672 G5/G6 processors.
FICON native (FC) channel support on the zSeries 900 processor is provided in
an MCL for driver 38. The EC level of the CPC can be determined from the
Hardware Management Console or Support Element by following the procedure
described in Appendix A, “Determining the EC level of the CPC” on page 255.
FICON native (FC) channel support on the 9672 G5/G6 processors is provided in
an MCL for driver 26. The EC level of the CPC can be determined from the
Hardware Management Console or Support Element by following the procedure
described in Appendix A, “Determining the EC level of the CPC” on page 255.
SA I/O-Ops V2.1 includes support for FICON Native (FC) channels and FICON
Directors. An additional APAR, OW47972, is required to correct problems with the
FICON Director support.
SA I/O-Ops V1.3 adds support for FICON Native (FC) channels and FICON
Directors with APAR OW40040 (PTFs UW69057 for RA30 and UW69058 for
RA3U). APAR OW48434 is also recommended.
APAR OW49278 describes a problem with the I/O-Ops interface to the McDATA
ED-5000 FICON Director. Before using I/O-Ops with a FICON configuration,
check the latest maintenance recommendations in the product’s PSP buckets:
Table 8. SA OS/390 I/O-Ops PSP buckets
Upgrade Subset
HKYS100 HKYS100
JKYS103 JKYS103
Note that there are few changes to I/O-Ops for FICON Native (FC) support. There
are no new commands, and the existing commands CONNECT/DISCONNECT and
CHAIN/UNCHAIN are not allowed with FICON Directors because they do not support
dedicated connections.
5.5 RMF
RMF has been changed to support FICON channels. With APAR OW35586, RMF
extended the information in the Channel Path Activity reports of all monitors by
reporting about data transfer rates and bus utilization values for FICON Bridge
(FCV) and FICON native (FC) channels. RMF reports five new measurements in
a FICON channel environment:
• Bus utilization
• Read bandwidth for a partition in MB/sec
• Read bandwidth total (all logical partitions on the processor) in MB/sec
• Write bandwidth for a partition in MB/sec
• Write bandwidth total in MB/sec
More information about the new fields reported by RMF for FICON channels can
be found in “FICON performance considerations” on page 222. Details of the
changes to SMF records are listed in “SMF record changes for FICON” on
page 259.
RMF also provides the FICON Director Activity report when the APARs in support
of ESCON Director Device support APAR OW44428 are applied, and the FICON
Directors provide measurements. Note that this function is not available if the
FICON Director is not defined as a device in HCD and IOCP.
5.6 DFSMS
FICON device support for the ESS 2105 is provided with DFSMS APARs
OW47935 and OW47937.
APAR Description
This list of APARs may be incomplete. The latest copy of the PSP bucket for the
processor or control unit should always be reviewed prior to installation. Table 10
shows the PSP buckets.
Table 10. Processor PSP buckets for z/VM and VM/ESA FICON support
5.8 VSE/ESA
VSE/ESA 2.3 contains support for FICON. Table 11 lists the recommended
APARs.
Table 11. z/VM and VM/ESA APARs for FICON support
APAR Description
This list of APARs may be incomplete. The latest copy of the PSP bucket for the
processor or control unit should always be reviewed prior to installation. Table 12
shows the PSP buckets.
Table 12. Processor PSP buckets for z/VM and VM/ESA FICON support
5.9 TPF
TPF Version 4 Release 1 and subsequent releases contain support for FICON.
For information on how to define the McDATA FICON Director, refer to 13.5,
“FICON Director (2032)” on page 180.
IBM 2032 model 001 and IBM 2032 model C36 are the device types and models
used, respectively, under the reseller agreement for the McDATA ED-5000 and
McDATA FC-512 cabinet.
If a backup CTP card is installed, each card must have a separate Ethernet
connection to the EFC Server.
Each port card provides four SC Duplex receptacles for attaching fiber optic
jumper cables. Ports use short wave laser transceivers for transmitting data
through multimode cables, or long wave transceivers for transmitting data
through single-mode cables. Port cards use non-OFC Class 1 lasers.
Port cards are labeled GLS, GSM, or GXX. See Table 13 for details.
Table 13. ED-5000 port card specifications
GSM Four short wave laser ports (850 50/125 micron multimode fiber 2 to 500 m
nm), non-open fiber control (OFC) with SC duplex connectors.
GLS Four long wave laser ports (1310 9/125 micron single mode fiber 2 m to
nm), non OFC with SC duplex connectors 20 km
GXX Three short wave laser ports (850 50/125 micron multimode fiber 2 to 500 m
nm), non-OFC with SC duplex connectors
One long wave laser port (1310 9/125 micron single mode fiber 2 m to
nm), non-OFC with SC duplex connectors 20 km
The ED-5000 FICON Director provides chassis slots for up to eight port cards (32
ports total). A port card is a concurrent FRU and can be added or replaced while
the ED-5000 is powered on and operating.
The port address information shown in Figure 40 is the value that must be
defined as CU link addresses using HCD or IOCP if the attached N_Port is a
control unit. For example, port number 19 is port address 17 for HCD and IOCP
definitions. Refer to 13.2, “FICON control unit” on page 176 for FICON HCD/IOCP
definition information.
A port number may have a different port address assigned if a port swap has
been performed.
P7 P6 P5 P4
23 31 1F 27 1B 23 17 19
22 30 1E 26 1A 22 16 18
Port Number
21 29 1D 25 19 21 15 17
MPC-0
MPC-1
20 28 1C 24 18 20
CMM-1
14 16
CTP-1
CMM-0
CTP-0
13 15 0F 11 0B07 07 03
12 14 0E 10 0A06 06 02 Port Address
11 13 0D 09 09 05 05 01
10 12 0C 08 08 04 04 00 Card Slot
P3 P2 P1 P0
Number
Figure 40. ED-5000 FICON Director port number-to-port address mapping
Facility AC power is supplied to the ED-5000 through the two power connectors
at the rear of the unit. The single-phase connections are input rated at 90 to 264
volts alternating current (VAC).
To support all of these functions the FICON Director must be defined as a control
unit in the IOCP with a CUP port address of FE, the same as the ESCON
Director. See 13.5, “FICON Director (2032)” on page 180 for HCD/IOCP definition
information.
Extended distance support: There can be up to 60 buffer credits per port for
10-100 km extended distance buffering. See Chapter 3, “FICON architecture” on
page 17 for more details on Buffer-to-Buffer credits information. This can be
configured on a port basis using the ED-5000 Product Manager.
Any unused FICON port or entire card can be used as a spare, to take over the
operation for a failed port or card. To continue operation, fiber cables from failed
ports have to be reconnected to the unused operating ports.
The McDATA ED-6064 FICON Director requires only 9U of rack space for 64
ports. This is twice the ports in half the space required by the ED-5000.
IBM 2032 Model 064 and IBM 2032 Model C36 are the device types and models
used under the reseller agreement, respectively, for the McDATA ED-6064 and
McDATA FC-512 cabinets.
Ethernet Hub
ED-6064
Directors
EFC Server
ED-6064
Directors
CTP Cards
Power and
System Error
LEDs
Front
Bezel
Power Supplies
Cable Management
Assembly
Front
Frontview
view
The major hardware components on the rear side of the ED-6064 FICON Director
are:
• Power module assembly
• Fan modules
• Serial crossbar (SBAR) assemblies
• Radio Frequency interference (RFI) assemblies (not shown in Figure 44)
• Backplane (not shown in Figure 44)
See Figure 44 on page 66 for the physical location of these components on the
rear side.
SBAR
Assemblies
Power Module
Assembly
Rear view
Rear view
The system error LED glows when the Director detects an event requiring
immediate operator attention, such as a FRU failure. The LED remains lit as long
as an event is active. It goes out when the Clear System Error Light function is
selected from the Product Manager application. A lit system error LED (indicating
a failure) takes precedence over unit beaconing.
Each CTP card also provides a 10/100 megabit per second (Mbps) RJ-45 twisted
pair connector on the faceplate that attaches to an Ethernet LAN to communicate
with the EFC Server or a simple network management protocol (SNMP)
management station.
The backup CTP card takes over operation if the active card fails. Failover from a
faulty card to the backup card is transparent to attached devices.
Each CTP card must have a separate Ethernet connection to the EFC Server.
Each card faceplate contains a green LED that glows if the card is operational
and active, and an amber LED that glows if the card fails. Both these LEDs are
not lit on an operational backup card. The amber LED blinks if FRU beaconing is
enabled.
Single-mode or multimode fiber optic cables attach to FPM cards through small
form factor (SFF) pluggable optic transceivers also known as Gigabit Interface
Converters (GBIC). The fiber optic transceivers provide duplex LC connectors,
and can be detached from the FPM cards (through a 10-pin interface) for easy
replacement. Two fiber optic transceiver types are available:
• Short wave laser - SW GBIC provides connection for transferring data over
short distances (2 to 500 m) through 50 micron or 62.5 micron multimode fiber.
• Long wave laser - LW GBIC provides connections for transferring data over
long distances (up to 20 km) through 9 micron single-mode fiber.
Port LEDs
The ED-6064 FICON Director provides chassis slots for up to 16 FPM cards (64
ports total). An FPM card is a concurrent FRU and can be added or replaced
while the ED-6064 is powered on and operating.
FPM Four short wave laser ports (850 50/125 micron multimode fiber 2 to 500 m
(F/C 6010) nm), non-open fiber control (OFC) with LC Duplex connectorsa
FPM Four long wave laser ports (1310 9/125 micron single mode fiber 2 m to
(F/C 6011) nm), non OFC with LC Duplex connectors 20 km
FPM Three short wave laser ports (850 50/125 micron multimode fiber 2 to 500 m
(F/C 6012) nm), non-OFC with LC Duplex connectorsa
One long wave laser port (1310 9/125 micron single mode fiber 2 m to
nm), non-OFC with LC Duplex connectorsa 20 km
a. Connectivity to SC Duplex is possible using fiber optic multimode (50 micron) cable with LC Du-
plex and SC Duplex connectors and SC Duplex-to-SC Duplex coupler. These parts can be ordered
with the ED-6064. See 6.4.11, “McDATA ED-6064 FICON Director configurations” on page 72.
For example, port number 35 is port address 27 for HCD and IOCP definitions.
Refer to 13.2, “FICON control unit” on page 176 for HCD/IOCP definition
information.
A port number may have a different port address assigned if a port swap has
been performed.
CTP CTP
1 0
FPM FPM FPM FPM FPM FPM FPM FPM FPM FPM FPM FPM FPM FPM FPM FPM
43 3F 3B 37 33 2F 2B 27 23 1F 1B 17 13 0F 0B 07
63 59 55 51 47 43 39 35 31 27 23 19 15 11 07 03
42 3E 3A 36 32 2E 2A 26 22 1E 1A 16 12 0E 0A 06
62 58 54 50 46 42 38 34 30 26 22 18 14 10 06 02
41 3D 39 35 31 2D 29 25 21 1D 19 15 11 0D 09 05
61 57 53 49 45 41 37 33 29 25 21 17 13 09 05 01
40 3C 38 34 30 2C 28 24 20 1C 18 14 10 0C 08 04
60 56 52 48 44 40 36 32 28 24 20 16 12 08 04 00
15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0
Slot Number
Each power supply has a separate backplane connection to allow for different AC
power sources. The power supplies are input rated at 85 to 264 volts alternating
current (VAC). The faceplate of each power supply provides the following status
LEDs:
• A green PWR OK LED glows if the power supply is operational and receiving
AC power.
• An amber FAULT LED glows if the power supply fails.
• An amber TEMP LED glows if the power supply shuts down due to an
over-temperature condition.
• An amber I LIM LED glows if the power supply is overloaded and operating at
the current limit (15.6 amperes).
A fan module can be replaced while the Director is powered on and operating,
provided the module is replaced within ten minutes (after which software powers
off the Director). An amber LED for each fan module glows if one or more fans fail
or rotate at insufficient angular velocity.
SBAR assembly
The Director is delivered with two SBAR assemblies. The active SBAR is
responsible for Fibre Channel frame transmission from any Director port to any
other Director port. Connections are established without software intervention.
The assembly accepts a connection request from a port, determines if a
connection can be established, and establishes the connection if the destination
port is available. The assembly also stores busy, source connection, and error
status for each Director port.
Each backup SBAR takes over operation if the active assembly fails, and
provides the ability to maintain connectivity and data frame transmission without
interruption. Failover to the backup assembly is transparent to attached devices.
Each SBAR assembly mounts flush on the backplane, and the FRU comprises
the card and a steel carriage. The carriage provides protection for the back of the
card, distributes cooling airflow, and assists in aligning the assembly during
installation. The rear of the carriage contains a green LED that glows if the
assembly is operational and active, and an amber LED that lights up if the
assembly fails. Both LEDs turn off on an operational backup assembly. The
amber LED blinks if FRU beaconing is enabled.
To support all of these functions, the FICON Director must be defined as a control
unit in the HCD and IOCP with a CUP port address of FE, the same as the
ESCON Director. See 13.5, “FICON Director (2032)” on page 180 for HCD/IOCP
definition information.
The ED-6064 comes standard with all high-availability features in the base unit.
You need only to select the number and type of ports, up to 16 port cards, the
mounting brackets (for factory or field installation in an FC-512 cabinet), and
power cord.
ED-60664 Directors are ordered using e.config selecting Storage and Storage
Area Network. The Fibre Port modules can be ordered using the following
Feature codes (F/C):
6010 Fibre 4-Port Module w/4-SW Transceivers (LC SFF GBIC)
6011 Fibre 4-Port Module w/4-LW Transceivers (LC SFF GBIC)
6012 Fibre 4-Port Module w/3-SW, 1-LW Transceivers (LC SFF GBIC)
Fiber Optic Multimode (50 micron) cables (10 m) with LC Duplex and SC Duplex
connectors can be ordered to adapt an existing SC Duplex cabling infrastructure
using F/C 1810.
Any unused FICON port or entire card can be used as a spare, to take over
operation for a failed port or card. To continue operation, fiber cables from failed
ports have to be reconnected to the unused operating ports.
Extended distance support: There can be up to 60 buffer credits per port for
10-100 km extended distance buffering. This can be configured on a port basis
using the ED-6064 Product Manager.
The EFC Manager and Product Managers are separate applications; however,
the Product Managers are only accessible through the EFC Manager.
The EFC Manager, Fabric Manager, and Product Managers are installed on the
EFC Server to provide local access to managed products. These applications can
also be installed on remote user workstations to provide remote access to
managed products. A maximum of four concurrent remote users (in addition to
the local EFC Server user) can log in to the EFC Manager application.
The following security features are provided by the Directors and the EFC Server:
• Users’ access control through user name and password
• Remote access enable/disable or restrict to specific IP address
• Configuration changes recorded in an audit log
The EFC Server and external modem are mounted in a slide-out drawer in the
Fabricenter cabinet. The server supports up to 48 Directors or other managed
McDATA products.
The EFC Server and managed Directors connect through a 10/100 Base-T
Ethernet hub. A 24-port hub is installed at the top front of the Fabricenter cabinet.
A variety of methods for reporting problems and failure conditions are available:
• Remote diagnostics and event notification through the EFC Server modem.
• Automatic notifications through e-mail messages to administrators.
• FRU LEDs provide visual indicators.
• SNMP traps messages.
• Malfunctions reported by Control Unit Port (CUP) to host operating system.
Remote workstations must have access to the LAN segment on which the EFC
Server is installed. Director administrative functions are accessed through the
LAN and EFC Server. The LAN interface can be:
• Part of a dedicated 10/100 Mbps LAN segment that provides access to
managed Directors. This Director-to-EFC Server Ethernet connection is part
of the equipment cabinet installation and is required. Connection of remote
workstations through the hub is optional. This type of network configuration
using one Ethernet connection through the EFC Server is shown in Figure 48
on page 76.
Support
EFC-Server Center
(SNMP agent)
Remote Workstation 1
(SNMP traps) Customer Intranet
(10/100 Mbps)
(SNMP Manager)
)
ps
tra (S
P NM
NM P
(S tra
ps
)
Note that remote workstations are not supported on the secondary adapter
(Ethernet adapter 2 - EFC Server adapter card), and must always connect to
the primary adapter (Ethernet adapter 1—built-in on the EFC Server mother
board).
Both CTP cards in a high-availability ED-5000 configuration or in all ED-6064s
must be connected to the customer’s intranet to insure continuous EFC Server
connection availability.
• Part of a second EFC Server interface that connects to a customer intranet
and allows operation of the Product Manager and Fabric Manager applications
from remote user PCs or workstations. The customer intranet can be a 10 or
100 Mbps LAN segment. Connection to this LAN segment is optional and
depends on customer requirements. This type of network configuration using
both Ethernet connections is shown in Figure 49 on page 77.
Customer Intranet
(10/100 Mbps)
(SNMP traps) 1
s)
trap
NMP
(S
2
10/100 Mbps
Remote Workstation Ethernet Hub
(SNMP Manager)
s)
P trap
(SNM
Note that if dual Ethernet adapters are to be used on the EFC Server, remote
workstations must use the adapter connected to the customer’s intranet, and
this must be the primary adapter (Ethernet adapter 1—built-in on the EFC
Server mother board).
Both CTP cards in a high-availability ED-5000 configuration or in all ED-6064s
must be connected to the internal EFC Server LAN (10/100 Mbps Ethernet
hub) to insure continuous EFC Server connection availability.
An SNMP agent runs on the EFC Server and can be configured through the EFC
Manager application. Refer to the McDATA Enterprise Fabric Connectivity
Manager User Manual. This agent can be configured to send SNMP trap
messages to up to 12 recipients.
A separate SNMP agent runs on each Director that is configured through the
Product Manager application. Refer to the ED-5000 or ED-6064 User Manual.
The following sections list and summarize the various options available to
monitor, manage and configure a McDATA FICON Director using the Product
Manager. Refer to the McDATA ED-500 or ED-6064 User Manual for a more
detailed description of these functions.
From the Hardware View, the following options are available by clicking View:
Hardware View
Using this graphical view of the Director (Figure 51), you can view alert symbols
and LED indicators, display data, and use mouse functions to monitor status and
obtain vital product information for the Director and its hardware components.
By slowly sliding the mouse cursor over the Director parts, you can easily identify
the selected part name, slot number, and port numbers, if applicable.
In this Hardware View (Figure 52), click a port card to see a detailed view of it. In
the Port Card View, colored indicators reflect functions of the actual LEDs on the
card. The table in the Port Card View displays the port operating state and vital
product information.
The Fibre Channel Address field in the Port Properties displays the 24-bit FC port
address. For a control unit port, the second byte of the 24-bit FC port address
must match the zSeries or 9672 G5/G6 CU link definition (HCD and/or IOCP).
Refer to Fabric address support in Chapter 3, “FICON architecture” on page 17
and to Chapter 13, “FICON I/O definition” on page 167.
The Port List View displays the following information on all ports that can be
installed on the Director:
• Port number (#)
• Port Address (Addr)
• Port Name (Name)
• Blocked/Unblocked Port State (Block Config)
• Port State (State), Port Type (Type)
The Port Address displayed in the Node Properties panel must correspond to the
CU link address defined in HCD and/or IOCP if this F_Port connects to a CU
N_Port.
Configure Identification
Use the Identification option to configure Director Name, Description, Location,
and Contact Name.
Ordinarily, you do not need to change these values from their defaults. The only
exception is the Preferred Domain ID.
Note:
The McDATA EFC Product Manager translates Preferred Domain ID field
values into Domain ID (first byte of the 24 -bit FC port address) as shown in
Table 15 on page 87. For example, if you want to set the domain ID (first byte of
the 24-bit FC port address) to 26, you need to enter 6 in the Preferred Domain
ID field. The same switch is defined with switch number 26 in HCD/IOCP.
The FICON Director must be set offline from the EFC Product Manager in order to
change the domain ID.
If you want to perform this task concurrently with customer operations, all FICON
channel paths communicating through this FICON Director must be configured
offline from the Operating System console.
30 16
21 1 31 17
22 2 32 18
23 3 33 19
24 4 34 20
25 5 35 21
26 6 36 22
27 7 37 23
28 8 38 24
29 9 39 25
2A 10 3A 26
2B 11 3B 27
2C 12 3C 28
2D 13 3D 29
2E 14 3E 30
2F 15 3F 31
This panel lists the ports using port numbers. By checking the 10-100 box for a
specific F_Port, the user allows it to communicate with a remote N_Port at an
extended distance of 10 to 100 km. The BB_Credit value for this specific port is
then set to 60.
Figure 59. The McDATA FICON Director Configure Active Addresses panel
In this panel, the ports are listed using Port Addresses. CU port address values
match the LINK keyword values defined in HCD and IOCP for this control unit
link.
This option can also be used to view, activate, modify, delete, or copy address
configurations through the Address Configuration Library.
For information on defining the Inrange FICON Director, refer to “FICON Director
(2032)” on page 180.
I N R A N G E F C / 9 0 0 0 D ir e c t o r s
6 4 - p o rt s in a 4 0 U c a b in e t
6 4 -p o r ts in a 2 5 U c a b in e t
R e a r V ie w 1 2 8 - p o rt in a 4 0 U c a b in e t
1 2 8 -p o r ts in a 4 0 U c a b in e t
The FIO Module has eight 1.0625 Gb/ps ports, which terminate at a Gigabit
Interface Converter (GBIC) to provide a user fiber interface connection. It also
supports up to eight credits per port allowing connection up to 10 km.
New Extended Credit and Addressing Facility (XCAF) FIO cards are available to
support up to 64 credits per port for distances of 100 km, and further distances
with optical repeaters. Three XCAF modules is the minimum configuration per
FC/9000 chassis. There can be from three to eight XCAF modules installed
depending on the FC/9000 Director configuration.
Each FIO Module has two redundant backplane paths through the backplane to
the redundant FSW cross-connect module. The FIO logic manages the
synchronized switch-over to the spare module. Each backplane FIO port has
redundant I/O, which is routed to a spare FSW module. The crosspoint chip is
then configured to bypass a failed FSW module and switches the connectivity
through the spare FSW.
There are some important LED indicators on the front panel of each FIO card:
• OT LED glows red to indicate that the temperature of the module is higher
than the acceptable operating temperature ranges.
• PWR OK LED glows green to indicate DC power to this module is good.
• L - A (Logged in - Activity) LEDs indicate the port status. L glows green to
indicate when a fibre channel device is logged into the port. The A LED glows
yellow to indicate data is passing.
• HEART BEAT LED glows yellow and is toggled on and off every second
indicating that the FIO Module is executing its flash code and functioning
correctly. Error conditions are indicated by a distinctive blink pattern.
FCM (Upper)
FIO Modules
FSW Modules
FCM (Lower)
j202
(Upper j204 (Upper
Lower Lower left fan) right fan)
Left Right
Fan Fan
Rear Panel in
Place Backplane
DIP Switch DSW1
Rear Panel
Removed
Cables Installed only when a two
chassis configuration is used.
Otherwise, loop back plugs are
installed.
The FC/9000-64 FICON Director offers multiple configuration options for FICON
connectivity. The FIO ports are served by optic GigaBit Interface Converters
(GBICs). A GBIC contains a transmitter and a receiver that can send and receive
optical signals from other switches or devices. The signals are converted by the
GBIC into electrical signals that are processed by the unit. Electrical signals
coming from the unit are converted into optical signals. Two different GBICs are
available, which can be plugged into FIO ports to meet the following configuration
options:
• LW - Longwave laser (1300 nm), single-mode fiber (9/125)
Uses a Duplex SC connector.
Distance:
- 2 m to 10 km using 9 micron fiber
• SW - Shortwave laser (850 nm), multimode fiber (50/125 or 62.5/125)
Uses a Duplex SC connector.
Distance:
- 500 m maximum using 50 micron fiber
- 300 m maximum using 62.5 micron fiber
GBIC CONNECTOR
SC FIBER OPTIC
CONNECTOR
GBIC KEYWAY
RX (ONE ON EACH SIDE
OF THE GBIC)
TX GBIC LATCH
SC CONNECTOR KEYWAYS
To support all of these functions, the FICON Director must be defined as a control
unit in the IOCP with a CUP port address of FE, the same as the ESCON
Director.
There is an offset of 1 between port numbers and the FC Address (port address)
on the Inrange FC/9000-64 FICON Director.
P
FIO FIO FIO FIO FIO FIO FIO FIO
O 1 2 3 4 5 6 7 8
R
T
F F F F F
1 00 08 10 18
S S S S S
20 28 30 38
2 01 09 11 19 W W W W W 21 29 31 39
3 02 0A 12 1A 22 2A 32 3A
S
4 03 0B 13 1B p 23 2B 33 3B
a
5 04 0C 14 1C r 24 2C 34 3C
e
6 05 0D 15 1D 25 2D 35 3D
7 06 0E 16 1E 26 2E 36 3E
8 07 0F 17 1F 27 2F 37 3F
P
FIO FIO FIO FIO FIO FIO FIO FIO
O 1 2 3 4 5 6 7 8
R
T
F F F F F
1 40 48 50 58
S S S S S
60 68 70 78
2 41 49 51 59 W W W W W 61 69 71 79
3 42 4A 52 5A 62 6A 72 7A
S
4 43 4B 53 5B p 63 6B 73 7B
a
5 44 4C 54 5C r 64 6C 74 7C
e
6 45 4D 55 5D 65 6D 75 7D
7 46 4E 56 5E 66 6E 76 7E
8 47 4F 57 5F 67 6F 77 7F
“FICON Director port configuration worksheet” on page 263 can be used to assist
in planning and installing FICON Directors.
F
C
M
FC/9000-128
FC/9000-64
FC/9000-64
A total of four fabrics (where each fabric can have a maximum of 32 switches)
can be monitored and controlled by the same IN-VSN Enterprise Manager
software.
Figure 68 shows the Configuration Tab active for a fabric, which allows you to
type in all necessary entries needed for the connection to the Enterprise
Manager. This type of configuration must be done for each FC/9000-64 present in
the fabric to be able to communicate with the Enterprise Manager.
The first window that the application displays following login is the Main Display
screen. From this screen you can navigate to other screens that allow you to
configure and control any FC/9000-64 switch to which you have access.
The window shown in Figure 70 is the first one that comes up after the initial
logon window of the Enterprise Manager and shows all the fabrics configured to
and controlled by this Enterprise Manager.
Selecting Fabrics will open a window showing all the fabrics by the names
controlled by this Enterprise Manager.
Select the fabric that you are interested to work with by clicking the desired
switch; see Figure 72 on page 102.
FC-128
All switches defined for this selected fabric are displayed. In this example, there
are three switches defined; other fabrics may have one or even more switches.
Clicking the switch symbol will open the general switch view with all the boards
associated with it and the configuration for this specific switch.
This “General” screen is the default view (see Figure 73 on page 103). It shows
the face view of the switch together with all installed boards and components of it,
and also presents failure information about the main components, if there is any.
The temperature is displayed as well.
For a description of the other tabs on this screen refer to IN-VSN Enterprise
Manager Software Installation and Operation Manual, 9110509-203-00.
Figure 74 on page 104 shows the configuration for the selected switch, which has
eight FIO cards installed as well as an FCM-1 and an FCM-2 card. By default, the
first FIO card is selected and the status of this card is displayed, which is
ONLINE.
This display has to be used in case of FIO maintenance to set the whole card
offline to be able to remove the card and install a new one. For additional
information refer to the available onsite documentation.
To get information about the ports on this card, either click the card graphic or
select it by clicking FIO-1 (or any other FIO card you are interested in).
Figure 75. Display of all ports for the selected FIO card
Note
This change will be disruptive to the FICON Director.
Port - 0 58
W W N : 10000000c922bd7e F IO
8
P hysical A ddress: 11:39:00
G BIC : O ptical LW , 100-S M -LC -L
38
39
3A
3B
3C
3D
3E
3F
P h ysical A ddress: 11 : 39 : 00
D om ain A ddress C onstant (AL_port address)
In this example, port 2 of the FIO-8 card was selected, which actually has the
physical address (port address) of 39, which could be compared to the link
address for the CU in IOCP (see Figure 65 on page 96 for port mapping
reference).
The Domain ID for this Director is 11 and should correspond to the logical switch
number used in IOCP.
8.1.1 Topology
The IBM ESS supports the following topologies:
zSeries Processor
FICON native (FC) Channels
E8 F8 E9 F9 EA FA EB FB
0C 1C 0C 1C 0C 1C 0C 1C
LSN 08 LSN 09 LSN 0A LSN0 B
FICON Directors
09 19 09 19 09 19 09 19
FICON Adapters
Figure 80. ESS 2105 FICON (FC mode) switched point-to-point configuration
The 16 fiber channel host adapters support the FICON native (FC) channel
attachment. Each adapter has a single host port. The ESS supports up to 16
FICON long-wave (9 micron) host adapters or FICON short-wave (50 or 62.5
micron) host adapters.
When ordering an IBM ESS 2105, the following Fibre Channel feature codes can
be selected:
3021 Fibre Channel Longwave (LW) Host Adapter supporting FCP and
FICON protocols. This feature code includes a 31 meter, longwave
fibre optic (9 micron) cable with SC-Duplex connectors.
3023 Fibre Channel shortwave (SW) Host Adapter supporting FCP and
FICON protocols. This feature code includes a 31 meter, short wave
fibre optic (50 micron) cable with SC-Duplex connectors.
8.1.4 Devices
The maximum number of devices configurable on the ESS Model F20 is 4096,
which includes both base and alias PAV devices.
8.3.1 Distance
The maximum FC link unrepeated distance between the ESS longwave (LW)
FICON host adapter port and either the z900 or G5/G6 FICON channel
(point-to-point) or the FICON Director port (switched point-to-point) is 10 km.
Processor RPQ 8P1984 is available to extend this distance to 20 km.
The IBM ESS 2105 FICON control unit can support a maximum distance of 100
km from a processor FICON channel without experiencing data droop. Using
longwave technology, Dense Wavelength Division Multiplexers (DWDM) and
Optical amplifiers, a single FICON FC link can be extended to 100 km.
The maximum FC link unrepeated distance between the ESS shortwave (SW)
FICON host adapter port and either the z900 or G5/G6 FICON channel
(point-to-point) or the FICON Director port (switched point-to-point) is 300 m if
using a 62.5 micron fiber optic cable, or 500 m if using a 50 micron fiber optic
cable.
Table 17 summarizes the maximum distance options that are available with ESS
2105 FICON adapters installed.
Table 17. FICON Host adapters maximum distances supported
Refer to “FICON - Fibre Channel cabling” on page 153 for a detailed description
of the available cabling options.
Refer to 8.1, “FICON resources” on page 109 for a description of the definition
requirements for the ESS 2105 with FICON adapters.
The 3590 Model A60 tape control units attach to the FICON channels on a 9672
Enterprise G5 or G6 server or zSeries server.
The minimum required micro code level for 3590 Model A60 is 1.12.4.6 to support
native FICON.
Adapters 1 to 4 1 or 2
1C 0C 1C 0C
08 08
FICON Adapters
CU 6000
(LCU 0)
The 3590 Model A60 provides one Fabric Login (FLOGI) per port and up to 64
N_Port Logins per port (PLOGI).
Both FICON and ESCON paths may be a part of a single path group. So a given
host image may have simultaneously active FICON and ESCON connectivity to
the same device.
To use this accessibility for OS/390 or z/OS, through ESCON and FICON,
requires configuring the same device address for both path types.
If four hosts each have 16 LPARS (using EMIF) that attach to a given 3590 Model
A60 port (via a switch port), then four PLOGIs will occur and 64 logical paths will
be established.
In general, there is one PLOGI for each physical host port connecting to the 3590
Model A60.
9.1.3 Devices
Currently the 3590 Model A60 presents only a single Logical Control Unit (LCU 0)
and supports up to 12 devices.
Some confusion in RMF interpretations is introduced with the mix, although the
new queue time and defer time reported should help alleviate some of this.
Dynamic CHPID support is not currently available for the 3590 Model A60, but
when it is, it will not apply to mixed configurations.
Where FICON is isolated to one set of host images and ESCON to another set,
none of the above mentioned concerns apply.
9.3.1 Distance
The FICON attachment is available via either shortwave or longwave. The 3590
Model A60 controller is directly attachable to host systems for up to 10 km or up
to 20 km with RPQ8P1984. The 3590 Model A60 is also directly attachable up to
100 km away with a FICON/Fibre Channel Director with appropriate repeaters.
With the FICON short wavelength attachment, the 3590 Model A60 controller is
directly attachable to a host system or FICON/Fibre Channel Director at a
distance up to 500 m.
The 3170 Infoprint Color 130 Plus printer supports FICON channel attachment on
one interface adapter.
The FICON resource information for the FICON 3170 is summarized in Table 19.
Table 19. FICON 3170 resources
10.1.3 Devices
The 3170 has only one device per printer.
PSF 3.2.0 automatically exploits the enhanced FICON native (FC) channel
performance by specifying CCW and data pipelining. No external user controls
are required.
Figure 84 shows a sample FICON configuration for the 3170 Infoprint Color 130
Plus.
1C 0C 54
73
FICON ESCON
LSN 09 Director Director LSN 0A
05 ESCON Adapter 95
FICON Adapter
CU 4100
(LCU 0)
3170
Infoprint Colour 130 Plus Device 4100
Although FICON channels operate very differently from ESCON channels (as
discussed in Chapter 15, “FICON channel operation and performance” on
page 205 ), from the configuration design point of view (topologies) they are
similar. The most important differences are:
• In the initial FICON switched point-to-point topology implementation, only one
FICON switch can be used between a FICON channel and a FICON control
unit adapter. ESCON allows two switches in a path from a channel to a control
unit.
• All FICON switch connections are dynamic. ESCON allows static connections
in a switch.
• FICON channels can have multiple I/O operations concurrently for each
control unit port, even to the same logical control unit. ESCON allows only one
actively communicating I/O operation at a time.
• A FICON channel can receive multiplexed I/O frames from different control
units in a switched point-to-point topology.
• FICON channels support greater link distances than ESCON channels and the
FICON link data droop effect occurs at greater distances than for ESCON.
• Intermixing control unit types with different characteristics like disk and tape
on the same FICON channel does not cause the same communications
lockout impact as can occur on ESCON.
• The channel-to-channel (CTC) function is not initially implemented in FICON
channels. So, CTC connections must use an ESCON (CTC) channel, which
can be connected either to another ESCON (CNC) channel or to a FICON
Bridge (FCV) channel through an ESCON Director with a FICON Bridge card.
Topologies:
• Point-to-point
• Switched point-to-point
81 85 A1 A5 15 19 21 25
8 concurrent
ESCON Links I/O operations
(1 per channel)
Disk
Devices
The ESCON configuration shown in Figure 85 on page 123 has the following I/O
concurrency:
• Eight concurrent I/O operations are supported by the control unit.
• Eight control unit ESCON interfaces are used and these in total support eight
concurrent I/O operations.
• Eight ESCON channels are used and these in total support eight concurrent
I/O operations. Note that an ESCON channel can do only one I/O operation at
a time.
multiple concurrent
FICON Links I/O operations
(can be up to 16 or more
per channel)
multiple concurrent
FICON Adapters FICON Adapters I/O operations
(CU-dependent)
Disk CU CU 1000
Storage Cluster 0 Storage Cluster 1
Disk
Devices
With the same number of processor channels (eight) and control unit adapters
(eight), the I/O concurrency can be higher. Because one FICON channel is
capable of doing up to 16 or more I/O operations at a time, even for the same
logical control unit, now the same configuration has the capability of producing
more concurrent I/Os, using a higher bandwidth. The number of concurrent I/O
operations depends on the control unit characteristics.
The control unit vendor should be asked to provide all the control unit addressing
and connectivity characteristics, as these affect how the control unit can be
configured in a S/390 environment.
So, if the control unit and its adapters can do multiple I/O operations concurrently:
• For the same I/O workload and throughput, fewer FICON channels and control
unit adapters are required.
• Using the same number of resources (channels and adapters), a higher I/O
workload and throughput can be sustained.
This topology allows a much more flexible and dynamic environment and is
required to exploit the I/O frame multiplexing capability of FICON channels.
All FICON switch connections are dynamic. So static connections, which are
possible in an ESCON Director, are not supported in a FICON Director.
FICON protocol initially keeps its channel-to-CU path definition approach, which
provides controlled access. It does not use a fabric port address discovery
(N_Port) approach and requires a known fabric port address, which is the switch
destination port.
The zSeries and S/390 processor channel path to control unit configuration
architecture rules include:
• A logical CU and device cannot be accessed more than once from the same
channel path (CHPID). This applies to both ESCON (CNC) channels and
FICON channels.
• A physical control unit that has multiple logical control units (uses CUADD
addressing) may be accessed more than once from the same FICON channel
path, but to different logical control units (different CUADDs) within the
physical control unit subsystem.
Invalid configuration -
violating CU/device
single channel path to CU rule
SW 1
00 0F
08 0C
CU 1000
Storage Cluster 0 Storage Cluster 1
A3 C3 A3 C3 A3 C3 A3 C3
ESCON Links 8 concurrent
I/O operations
ESCON Adapters ESCON Adapters
8 concurrent
Disk CU 1000 CU 1001 I/O operations
CU Storage Cluster 0 Storage Cluster 1
(CU-dependent)
Disk
Devices
Figure 88 shows:
• The need to determine from the control unit vendor the maximum number of
concurrent I/O operations that are supported by the physical control unit. Also
determine whether the physical control unit supports one or more logical
control units (CUADD - CU addressing). The control unit vendor should be
asked to provide all the control unit addressing and connectivity
characteristics, as these affect how the control unit can be configured into a
S/390 environment.
• The number of ESCON interfaces that the control unit supports.
• The connection of channel paths from a single processor image (these can be
shared if the control unit supports shared channel paths) to up to eight
interfaces on a multi-interface control unit.
Most ESCON-interfaced control units support connection to shared channels.
• The use of eight ESCON channels.
The ESCON configuration shown in Figure 88 has the following I/O concurrency:
• Eight concurrent I/O operations are supported by the control unit.
• Eight control unit ESCON interfaces are used and these in total will support
eight concurrent I/O operations.
Figure 89 shows the connectivity for a single ESCON channel. This channel uses
dynamic connections in the ESCON Director, which provide access to this control
unit and others. But this single ESCON channel can address up to only 1024
devices and can have only one I/O operation at a time.
1 I/O operation
(addressing up to
36 1024 devices)
ESCON Links ESCD
1 I/O operation
C3 (addressing up to
1024 devices)
Disk
Devices
The ESCON adapter of this control unit can address up to 1024 devices and this
ESCON link supports only one I/O operation at a time.
Disk
Devices
The FICON Bridge (FCV) configuration shown in Figure 90 has the following I/O
concurrency:
• Eight concurrent I/O operations are supported by the control unit.
• Eight control unit ESCON interfaces are used and these in total support eight
concurrent I/O operations.
• Eight FICON Bridge (FCV) channels are used and these support 64
concurrent I/O operations in total. Eight of these concurrent I/O operations are
to the two control units numbered 1000 and 1001 (which make up one IOCP
logical control unit), and 56 of the 64 possible concurrent I/O operations are to
other control units.
FICON Bridge (FCV) channels can also be shared, so multiple images running in
the same processor can use the same FICON Bridge (FCV) channel
simultaneously. ESCON-interfaced control units should support the connection of
shared channels.
Figure 91 on page 131 shows the connectivity for a single FICON Bridge (FCV)
channel. This channel can use a dynamic connection in the ESCON Director, via
the FICON Bridge card, which provides access to up to eight control units. So this
single FICON Bridge (FCV) channel can address up to 16,384 devices and can
support up to eight I/O operations at a time.
ESCD up to 7 other
control units
C3
1 I/O operation
ESCON Link (addressing up to
4096 devices)
Disk
Devices
The ESCON adapter of this control unit can address up to 4,096 devices, and this
ESCON link can have only one I/O operation at a time.
Disk
Devices
Figure 92. FICON switched point-to-point channel configuration with eight paths
Because one FICON channel is capable of doing more than one I/O operation at
a time, even for the same logical control unit, now the same configuration has the
capability of producing more concurrent I/Os, using a higher bandwidth.
This configuration also exploits the I/O frame multiplexing capability of FICON
channels, which is shown by the SW-4 switch in Figure 92 on page 131. The
FICON channel CHPID FA can send and receive intermixed sequence-frames to
and from multiple control units.
Note that FICON channels do not limit the maximum concurrent I/Os to eight per
channel as a FICON Bridge FCV channel does, and that one control unit FICON
adapter can also do multiple I/O operations at a time, even for the same logical
control unit (FICON Bridge FCV uses ESCON links to the control unit, meaning
only one I/O operation at a time).
FICON channels can also be shared so multiple images running on the same
processor can use the same FICON channel simultaneously. This function is
even more beneficial in this environment as FICON channels have the capability
of doing multiple I/O operations simultaneously. FICON-interfaced control units
should support connections to shared channels.
Figure 93 on page 133 shows the connectivity for a single FICON channel. This
channel uses a dynamic connection in the FICON switch, which provides access
to this control units and others. So this single FICON channel can have I/O
operations to many logical control units at the same time by using the FICON
protocol frame multiplexing. This FICON channel can address up to 16,384
devices.
CU CU 1000 to CU 1F00
Cluster 1 Cluster 2
Disk
Devices
The FICON adapter of this control unit can address up to 16,384 devices (control
unit dependent) and this FC link can have multiple concurrent I/O operations.
FICON’s CCW and data prefetching and pipelining, and frame multiplexing also
allow multiple I/O operations to the same logical control unit. As a result, multiple
I/O operations can be done concurrently to any logical control unit, even within
the same control unit. By using IBM ESS’s Parallel Access Volumes (PAV)
function, multiple I/O operations are possible even to the same volume.
Disk CU CU Characteristics
1 to 16 CU 1000 to CU 1F00
Logical CUs
Cluster 1 Cluster 2
Disk
Devices
In ESCON architecture, up to 253 control unit links per channel can be defined,
but only up to 120 are implemented on ESCON, only up to 240 on FICON Bridge
(FCV), and only up to 128 on FICON native (FC). The implementation is
processor dependent.
The ESCON configuration shown in Figure 95 has the following I/O concurrency:
• Each of the eight ESCON paths can address all four of the logical control units
shown in the configuration. This is the ESCON maximum addressability; an
ESCON path can have up to 1024 device addresses (4 x 256 = 1024).
• Eight concurrent I/O operations are supported by any one of the four logical
control units.
Only eight concurrent I/O operations in total are supported by the physical
control unit (this is the I/O concurrency characteristic of the control unit shown
in this example).
• Eight control unit ESCON interfaces are used and these in total support eight
concurrent I/O operations.
• Eight ESCON channels are used and these in total support eight concurrent
I/O operations.
It is possible to install and define more than eight paths to any physical control
unit (from the same S/390 processor image) when the physical control unit has
two or more logical control units. A maximum of only eight channel paths may be
defined to any one logical control unit. This approach can be used for physical
A3 C3 A3 C3 A3 C3 A3 C3 Actual concurrent
I/O operations
8
CU 1000 Disk Devices CU 1001 CU concurrent
(CUADD 0) 1000 - 10FF (CUADD 0) I/O capability
(CU-dependent)
CU 1100 Disk Devices CU 1101 8
(CUADD 1) 1100 - 11FF (CUADD 1)
Figure 96. FICON Bridge (FCV) channel configuration - 8 channel paths to 4 LCUs
The FICON Bridge (FCV) configuration shown in Figure 96 has the following I/O
concurrency:
• The exploitation of the possible I/O concurrency is dependent on the control
unit characteristics. When a control unit supports more than eight concurrent
I/O operations and the physical control unit has multiple logical control units, it
would take more than eight ESCON channels to take advantage of this. It
would take only eight FICON Bridge (FCV) channels to exploit this greater I/O
concurrency (up to a limit of 64 concurrent I/O operations to the one physical
control unit by the eight FICON Bridge (FCV) channels). A later example
shows the exploitation by using fewer FICON Bridge (FCV) channels.
• Each of the eight FICON Bridge (FCV) paths are used to address all four
logical control units.
• Eight concurrent I/O operations are supported by any one of the four logical
control units.
Only eight concurrent I/O operations in total are supported by the physical
control unit (this is an I/O concurrency characteristic of the control unit shown
in this example).
• Eight control unit ESCON interfaces are used and these in total support eight
concurrent I/O operations.
• Eight FICON Bridge (FCV) channels are used and these support 64
concurrent I/O operations in total. Eight of these concurrent I/O operations can
be to any of the defined (and configured) logical control units shown in
Figure 96, and 56 of the 64 possible concurrent I/O operations may be to other
control units.
The advantage in FICON operation is the capacity for multiple concurrent I/O
operations on FICON channels and on FICON adapters, allowing a much higher
I/O concurrency:
• A single FICON channel can have I/O operations to multiple logical control
units at the same time, by using the FICON protocol frame multiplexing.
• FICON’s CCW and data prefetching and pipelining, and protocol frame
multiplexing also allows multiple I/O operations to the same logical control
unit. As a result, multiple I/O operations can be done concurrently to any
logical control unit, even within the same control unit. By using IBM ESS’s
Parallel Access Volumes (PAV) function, multiple I/O operations are possible
even to the same volume.
The FICON configuration shown in Figure 97, using the IBM ESS (2105) as an
example, has the following I/O concurrency:
• The exploitation of the I/O concurrency is dependent on the control unit
characteristics. When a control unit supports more than eight concurrent I/O
operations and the physical control unit has multiple logical control units, more
than eight ESCON channels would be required to take advantage of this. It
takes fewer FICON channels to exploit this greater I/O concurrency.
• Each of the eight FICON paths are used to address all eight logical control
units. This is possible because each FICON path can address up to 16,384
device addresses.
Access to any ESCON interface control unit from a processor image may be from
ESCON and/or FICON Bridge (FCV) channels. Intermixing ESCON (CNC)
channels, FICON Bridge (FCV) channels and FICON native (FC) channels to the
same control unit from the same processor image is also supported, either using
point-to-point, switched point-to-point or both. IBM recommends that FICON
native (FC) channel paths only be mixed with CNC and FCV channel paths to
ease migration from ESCON channels to FICON channels using dynamic I/O
configuration.
The coexistence is very useful during the transition period from ESCON to FICON
channels. The mixture allows you to dynamically add FICON native channel
paths to a control unit while keeping its devices operational. A second dynamic
I/O configuration change can then remove the CNC and FCV channels while
keeping devices operational. The mixing of FICON native channel paths with
CNC and FCV channel paths should only be for the duration of the migration to
FICON.
In the case where a control unit can support more than eight concurrent I/O
transfers, more than eight ESCON (CNC) paths would be required to exploit this,
but it would require only eight FICON Bridge (FCV) paths and probably fewer
FICON (FC) paths.
FICON
05 0C
Switch 0B 0B 0C
0C
to other to other ESCON to other
FICON FICON ESCON
Director Adapters
Adapters Adapters
08 10 A3 C3 A3 C3 ESCON
FICON ESCON
Adapters Adapters Director
Figure 98 shows two ESCON channel paths, two FICON Bridge (FCV) channel
paths and four FICON native (FC) channel paths from the same operating system
image to the same control unit images.
Using fewer ESCON (CNC) channel connections than the supported I/O
concurrency of the control unit means that the I/O concurrency achieved between
the processor and the control unit drops. It would be equal to up to the number of
channel path connections.
FICON channels potentially reduce the number of required channels, while still
providing the required bandwidth and I/O concurrency.
Another benefit of FICON channels is their ability to reach long distances, which
is very useful for remote site connections.
Also important is that FICON channels can go up to 100 km before the effect of
data droop. ESCON channels are affected by data droop at 9 km.
FICON (FC-SB-2)
Fibre Channel
FC Switch
Matching Matching Fabric
LP1 LW or SW LW or SW Matching
FOSAs FOSAs LW or SW
OS/390 FOSAs
Fiber Single FC Switch
Optical Extenders
LP2 FICON Link Optical Link FC Optical Link FICON
OS/390 Channel Fiber Cable Switch Fiber Cable CU/Device
N_Port F_Port F_Port N_Port
2029 OCI
adapters
LP3 Buffer Buffer Buffer Buffer
OS/390 Credits Credits Credits Credits
FOSA
The IBM 2029 supports OCI optical link Optical link distance of
FC distances of up to 500 meters up to 10 km supported
N_Port
FC
F_Port Total supported distance of up to approx 100
km, requires an x_Port buffer credit of 64
Any FC link reaches up to 100 km, but the end-to-end distance (processor to
control unit) cannot exceed 100 km. To achieve that distance:
• Fiber extenders must be used, as the FICON optical links can operate up to 10
km, or up to 20 km via RPQ, with no repeaters.
• For the FC link from the FICON channel to the FICON switch, both FICON
channel and switch port should have enough buffer credits to avoid
performance degradation at the link distance.
• For the FC link from the FICON switch port to the control unit FICON adapter,
both the FICON channel and theFICON switch port should have enough buffer
credits to avoid performance degradation at the link distance.
Note that ESCON channels start having data droop effect at 9 km, so the
effective bandwidth is dramatically reduced after this distance.
ESCD
n
n links
links
CEC 2 CU 2
Site 1 up to 3 km
Site 2
(Control unit dependent)
Figure 100. Remote site with ESCON channels - ESCD at remote site
Figure 100 shows a remote site with two control units accessed by two CECs
from the primary site, all connected via an ESCON Director at the remote site.
Multi-mode
ESCON links
Multi-mode (up to 3 km) Multi-mode
ESCON links ESCON links
or
(up to 3 km) (up to 3 km)
CEC 1 Single-mode CU 1
n ESCON XDF links n
links (up to 20 km) links
ESCD ESCD
n
1 2
links
n
n
links
links
CEC 2 CU 2
Site 1 Site 2
up to 20 km
(Control unit dependent)
Figure 101. Remote site with ESCON channels - ESCDs at both sites
Figure 101 shows a remote site with two control units accessed by two CECs
from the primary site through two ESCON Directors, one at each site. This design
allows a greater distance between sites, as ESCON XDF ports can be used on
Multi-mode
Multi-mode
ESCON links
ESCON links
(up to 3 km)
(up to 3 km)
CEC 1 CU 1
n
links n
2 2 links
0 0 ESCD
2 2 single-mode 2 2
9 fiber pairs 9
n
links
n
n
CEC 2 links CU 2
links
Site 1 Site 2
up to 50 km
(Control unit dependent)
Figure 102 shows a remote site with two control units accessed by two CECs
from the primary site through one ESCON Director, using fiber extenders (IBM
Fiber Saver - 2029). This design allows even a greater distance between sites, as
the 2029s can extend and multiplex ESCON channels.
Switch
n
n
links
links
CEC 2 CU 2
Site 1 Site 2
up to 10 km
(or 20 km with RPQ)
(Control unit dependent)
Figure 103. Remote site with FICON channels - switch at remote site
Figure 103 shows a remote site with two control units accessed by two CECs
from the primary site, all connected via a FICON switch at the remote site. In this
case, the maximum distance between both sites is 10 km, or 20 km with an RPQ
(device dependent), and requires fewer FICON channels (and fiber pairs).
FICON links
FICON links
CEC 1 CU 1
n
links n
2 2 links
0 0 Switch
2 2 singlemode 2
9 fiber pairs 9
n
links
n
CEC 2 n links CU 2
links
Site 1 Site 2
up to 50 km or 70 km with RPQ
(Control Unit dependent)
Figure 104 shows a remote site having two control units being accessed by two
CECs from the primary site through one FICON switch, using fiber extenders
(IBM Fiber Saver - 2029).
Fewer 2029 ports are required, as fewer FICON channels than ESCON channels
are required.
SM SM Sysplex Sysplex SM
SM
Timer Timer
FC FC FC FC
Fabric Fabric Fabric Fabric
(1) (2) (3) (4)
OS/390 OS/390
Console Console
CU CU CU CU CU CU CU CU
Figure 105 shows a GDPS environment using FICON native (FC) channels. The
maximum distance between sites in this case remains the same (40 km), since it
is limited by Sysplex Timer connections and not by the channels.
The benefits of using FICON native (FC) channels in this case are:
• For the same I/O workload and throughput, fewer 2029 ports are required for
FICON channels than for ESCON channels. Using the same number of
channels (and 2029 ports) the total bandwidth is increased, allowing a higher
I/O workload and throughput.
• FICON channels operating at 40 km do not experience data droop effect, as
occurs with ESCON channels at 9 km.
The CHPID Report is provided to the customers for each of their zSeries or 9672
G5/G6 processors. From this report the customer can see:
• What channel types and quantities are installed
• The location of each channel and the assigned CHPID number
• The channel adapter (CHA) used to support the channel (not all channel types
need to be supported by a CHA)
• The STI connection used to support the channel
This approach can be better evaluated during migration time, when FICON native
(FC) channels are added to an existing control unit with ESCON adapters. Having
both channel types operating at the same time on the same control unit should
provide valuable information regarding the capabilities for that specific
configuration and I/O workload.
So, in summary, the control unit vendor is the correct source for precise
connectivity recommendations for the control unit’s maximum I/O concurrency
exploitation in a FICON environment.
You can use this approach for physical control units that support greater than
eight concurrent I/O transfers and that have a customer requirement for a high
I/O rate when using ESCON channels.
Using FICON channels, it is possible to have more than eight concurrent I/O
transfers even for the same logical control unit.
An example of this type of control unit is the IBM 2105 Enterprise Storage Server
(ESS).
The following figures show an IBM ESS disk control unit configuration that
supports eight or more concurrent channel I/O operations to any logical control
unit within the physical control unit, and 16 or more concurrent channel I/O
operations to the physical control unit. Figure 107 shows that ESCON (CNC)
requires 16 channels to exploit 16 concurrent I/O transfers, while Figure 108 on
page 151 shows that it requires only eight FICON channels to support greater
exploitation of the control unit’s concurrent I/O transfer capabilities.
Some newer disk control unit Unit Information Modules (UIMs) only support the
connection of a device to one control unit definition. Therefore, only one control
unit definition is used in the IBM ESS configuration examples for ESCON and
FICON.
With this configuration, the 16 ESCON (CNC) channel paths can support up to 16
concurrent I/O transfers to the one physical control unit. Eight of the concurrent
I/O transfers can be from any of the even-addressed LCUs, and the other eight
concurrent I/O transfers can be from any of the odd-addressed LCUs.
05 08 05 08 05 08 05 08 Actual concurrent
SW-1 SW-2 SW-3 SW-4 I/O operations
CHANs CU LCU
10 1F 10 1F 10 1F 10 1F 16 or more multiple 8+
Actual concurrent
CU 2000 Disk 2000-20xx (LCU 0)
I/O Operations
CU 2100 Disk 2100-21xx (LCU 1)
multiple
CU 2200 Disk 2200-22xx (LCU 2)
CU 2300 Disk 2300-23xx (LCU 3) CU concurrent
CU 2400 Disk 2400-24xx (LCU 4) I/O capability
(CU-dependent)
CU 2500 Disk 2500-25xx (LCU 5)
multiple
CU 2600 Disk 2600-26xx (LCU 6)
CU 2700 Disk 2700-27xx (LCU 7) LCU concurrent
I/O capability
(CU-dependent)
8+
In Figure 108 there are eight FICON channel paths configured to access all eight
LCUs (CUADDs), as each one has the capability to address up to 16,384 device
addresses.
With this configuration, the eight FICON channel paths can support multiple
concurrent I/O transfers to any and all logical control unit to this physical control
unit, as well as more I/O transfers to other physical and logical control units,
using FICON frame multiplexing capability.
Historically, it has been recommended not to intermix control units that you do not
want to be locked out for periods of time with other control units (and their
operations) that can cause lockout for certain types of channel operations.
Although FICON channels do not have the ESCON interlock problems, some
performance characteristics should be taken into account. Tape control units
normally transfer large data blocks, and this may interfere with the response time
of some control units requiring the best possible response time, such as disk
control units.
So, response time sensitive control units should not be configured to use the
same FICON channel as tape control units.
Currently only ESCON channels have the CTC function available. So, any CTC
connection must use an ESCON (CTC) channel, which can be connected either
to another ESCON (CNC) channel or to a FICON Bridge (FCV) channel through
an ESCON Director with FICON Bridge card.
CEC 1
CTC CNC
CTC Function
ESCD
FICON Bridge
Card
CTC Function
FCV CTC
CEC 2
These two FOSA types (LW and SW), combined with the different fiber cable
modes, provide five implementation options, shown in Table 21.
Table 21. Fiber channel cabling implementation options
Long wavelength X Xa Xa
Short wavelength X X
a. Mode Conditioner Patch (MCP) cables are required
The recommended and most flexible fiber cable option is based on 9 micron
single-mode fiber cables with long wavelength FOSAs. However, the optimum
cabling implementation option for any given installation depends on the
environment and configuration requirements.
FOSA FOSA
Outbound Outbound
Tx Tx
Inbound Inbound
Rx Rx
Optical Link
Fiber Cabling
FC-0 Link
Figure 111 on page 155 introduces the basic terminology of a fiber channel from
a cabling point of view.
FC Optical Link
(FOSA and Fiber Cable Optical Link
FOSA Characteristics) (Characteristics)
FC
N_Port Fibre Channel Link Fibre Channel Link
(FC Port to FC Port) (FC Port to FC Port)
FC
F_Port
Fibre Channel Path
N_Port to N_Port
Note
Keep in mind that the FOSA types (LW or SW) at the end of each optical link
must match.
Figure 112 on page 157 illustrates the four cabling options in conjunction with the
FOSA types, such as:
1. LW FOSA - single-mode 9 um fiber cable
2. LW FOSA - MCP and multimode fiber cable (either 62.5 um or 50 um)
3. SW FOSA - multimode 50 um fiber cable
4. SW FOSA - multimode 62.5 um fiber cable
FC Link
Tx Tx
2 LW FOSA
B
A
B
A LW FOSA
Rx Rx
The optical link will not function properly if too many of these factors, in
combination, attenuate the signal. It is important that the fibers do not have a link
loss that exceeds the link budget of optical link. The signal strength loss is
measured in decibels (dB).
The maximum supported link loss budget between two LW FOSAs connected via
single-mode cables is 7 dB.
For SW FOSAs, either 62.5 micron or 50 micron multimode fiber cables are
required. The main difference between the options is the maximum supported
distance. For 62.5 um the maximum distance is 300 m and for 50 um the
maximum distance is 500 m.
The maximum supported link loss budget between two SW FOSAs is 6 dB.
For example, an SW FOSA does not support FC links over kilometer distances,
whereas an LW FOSA does. Or if an FC product is selected that supports less
than 60 buffer credits per FC port, performance will be impacted at a distance of
100 km. In addition, it should be noted that light takes time to travel over 100 km.
At least a 2 ms response time increase should be assumed for each I/O
operation, if the distance is at 100 km.
Figure 113 on page 159 illustrates the maximum distance dependencies based
on the FOSA type and fiber cable type. Along with the FOSA type and fiber cable
type, the diagram also indicates which connector types are supported.
Long wave laser - re-use 62.5 um fiber + MCP - up to 550 meters ESCON duplex
Long wave laser - re-use 50 um fiber + MCP - up to 550 meters ESCON duplex
Figure 114 illustrates the distance and buffer credit dependencies for the optical
link and the FC link.
FICON (FC-SB-2)
Fibre Channel
FICON (1.063 Gb) LW Laser Multimode: 62.5 um SC-Duplex (SM) 550 m 5 dB All Fiber between
1300 nm Mode Conditioner and mode conditioners
LW FOSA ESCON must be 62.5 um.
Patch cable Requires matching
(Trunk Fiber reuse)
Mode Conditioner LW FOSA optics.
Cable (FC 0106)
FICON (1.063 Gb) LW Laser Multimode: 50 um SC-Duplex (SM) 550 m 5 dB All Fiber between
1300 nm Mode Conditioner and mode conditioners
LW FOSA ESCON must be 50 um.
Patch cable
Requires matching
(Trunk Fiber reuse)
Mode Conditioner LW FOSA optics.
Cable (FC 0103)
FICON (1.063 Gb) SW Laser Multimode: 50 um SC-Duplex (MM) 500 m 3.8 dB Requires matching
850 nm SW FOSA optics.
SW FOSA
** Note that the distance shown is always dependent on the specification and
quality of the fiber cable. Specifications for the fiber cable standards are
documented in the Fibre Channel - Physical Interface (FC-PI) ANSI document
ANSI NCITS xxx-200x FC-PI T11/Project 1235D. This document can be obtained
from the following Web site:
www.t11.org
Note that when using a fiber extender, the short haul optical link distance
between the attaching FICON FOSA N_Port (Channel Switch Port or FICON CU
Port) and the fiber extender optical channel interface may be limited.
Optical Optical
Link Link Optical Link Optical Link
FOSA
Short Haul Long Haul Short Haul
FC Optical link distance of
N_Port The IBM 2029 supports OCI optical link up to 10 km supported
short haul distances of 500 m or 1 km
FC
F_Port FC Link FC Link
Figure 115. Switched point-to-point distances, using IBM Fiber Saver (2029)
Figure 115 shows an example of an FC link using IBM Fiber Savers. The
connection between the Fiber Saver and the FC port (FICON channel FC port, or
Switch FC port) is referred to as the “short haul” distance.
The short haul distance for the Finisar repeater is 200 m, and the short haul
distances for the Fiber Saver are limited to 500 m for MM fiber and 1000 m for SM
fiber.
The maximum long haul distance for FICON channels supported by the Finisar
repeater is 120 km compared to 50 km (70 km RPQ) for the Fiber Saver.
However, it is possible to cascade two IBM Fiber Saver networks to extend the
maximum end-to-end distance to 100 km.
The Finisar product and the IBM Fiber Saver support both FOSA types (LW and
SW) for their short haul connection.
Figure 116 on page 162 shows an example of an FC link using a single FICON
repeater, like the product available from Finisar Corporation.
Matching Matching
LP1 LW or SW LW or SW
z/OS FOSAs Optical Optical FOSAs
Link Link
Optical Extender Extender Optical
Link Link
LP2 FICON FICON
z/OS Channel CU/Device
N_Port N_Port
FOSA Optical link Extender optical link Optical link Extender optical link
FC distances of up to 200 meters distances of up to 200 meters
N_Port
Fibre Channel Link
When the MCP cables are used, there is a reduced link loss budget of 5 dB
versus 7 dB for normal use of single-mode fiber.
Two MCP cables are required per multimode optic link (a link as stated here is the
connection between two fiber optical ports).
The construction of the MCP cable is shown in Figure 117 on page 163.
Existing
2 Meters 50 or 62.5um MM 2 Meters
FOSA Fiber FOSA
TX TX
RCV RCV
Figure 117. Mode Conditioner Patch cables for reusing ESCON multimode fiber
An MCP cable is 2 m in length and consists of three pieces of fiber cabling (fiber
stands), an FCS Duplex connector, an MCP offset ferrule, and ESCON Duplex
connector.
The purpose of the single-mode to multimode fiber offset ferrule is to allow the
transit of a laser signal from a single-mode fiber to a multimode fiber. For this to
happen, the two fibers are offset to one another where they join inside the
encapsulated ferrule.
As the laser signal travels through the multimode fiber, there is a dispersion of the
signal and therefore effectively an attenuation of the signal. Because of this
attenuation, the supported distance between the two LW FOSAs is reduced to
550 m as shown in Figure 118 on page 164.
CNC CU
FC 0106 62.5 um FC 0106 62.5 um
zSeries
PROCESSOR Note:
CABINETS and PATCH PANELS Complete "single-mode" link must be of same fiber
(for Fiber Cables) size - 62.5 um used in this example
Be sure that the XMIT to RCV connection is
maintained with an ODD number of fiber swaps
(twists) between both LW-FOSAs
Note that the patch panels may still be used in a multimode fiber cabling
infrastructure. The conditions that must be observed are:
• The correct MCP cable (50 or 62.5) must be used to connect to the multimode
fiber infrastructure.
• Only two MCP cables are ever required in the FICON fibre channel link.
• The same fiber size (62.5 micron or 50 micron) must be used all the way
between the two MCP cables in the fibre channel link.
• Correct connectors at the MCP cable end (ESCON Duplex connector).
• There must still be an odd number of cable twists between the two FOSAs.
• The same size of fiber all the way through the FICON channel link (62.5 of 50
micron) between the two MCP cables.
Problem: Problem:
No light collecting lens
No light collecting lens for Poor transition of the
for MM-to-SM transition
MM-to-SM transition Laser signal from the Tx
FOSA to the MM fiber
When MCP cables are used, they must be plugged directly into the LW-FOSA. No
other fiber cable must be placed between the MCP and the FOSA, as shown in
Figure 119.
If a 9 micron single-mode fiber cable is incorrectly placed between the MCP and
the FOSA, then the incoming receive signal will not pass successfully between
the end of the MCP and the 9 micron single-mode fiber. Normally the MCP is
plugged into the FOSA, which has a receive signal lens, and it can collect most of
the incoming signal, whereas most of the signal is lost when passing between the
MCP and a single-mode fiber cable.
If a 62.5 multimode fiber cable is incorrectly placed between the MCP and the
FOSA, then the outgoing transmit signal will not pass successfully between the
FOSA and the end of the incorrectly placed multimode fiber cable. This is
because a laser signal is trying to transit from a single-mode fiber cable to a
multimode fiber cable without an offset between the two fibers.
Note:
in this example.
zSeries FICON Directorport and FICON CU
PROCESSOR adapter shown uses a short
wavelength LASER. 500m (50micron)
(FOSA = Fiber Optic Subassembly)
LW=LongWave , SW=ShortWave
300m (62.5micron)
max unrepeated cabling distance
Repeaters can be used to extend the distance between the FICON channel and the
FICON control unit up to 100 km.
FICON links can also be extended via the IBM Fiber Saver (2029), a dense
wavelength division multiplexer which can run up to 64 protocol-independent data
channels over two pairs of optical fibers to distances of 50 km and more upon RPQ
request and cascading. This is described in IBM Fiber Saver (2029) Implementation
Guide, SG24-5608.
Definition information for specific control units and devices that attach to FICON
native (FC) channels, such as the IBM ESS 2105 Model F20, is also presented.
Requires -
For zSeries 900, IYPIOCP 1.1.0 PTF UW90695 for OW46633
For 9672 G5/G6, IZPIOCP 1.8.2 PTF UW72160 for OW45473
Figure 121. IOCP CHPID macroinstruction - FICON native (FC) CHPID definition
PATH keyword
The PATH keyword is used to specify up to eight two-digit hexadecimal numbers
for the FICON CHPID numbers. The CHPID numbers that can be specified for
FICON channels are predetermined, based on the number and types of channels
ordered for the specific processor.
Note that the zSeries processor provides a new function called Flexible CHPID
Number Assignment. This function allows the customer to change a default
CHPID number for a channel to any other CHPID number.
TYPE keyword
As shown in the figure above, the CHPID type for FICON channels in FICON
native (FC) mode is specified as TYPE=FC. This indicates that the FICON
channel will operate in FICON native (FC) mode, as opposed to TYPE=FCV
which specifies that the FICON channel will operate in FICON conversion mode
attached to a 9032-5 ESCON Director FICON Bridge adapter.
SWITCH keyword
If the FICON channel is connected to a FICON Director, the SWITCH keyword
must also be specified. Note that for a FICON native (FC) channel, the switch
number specified is the logical switch number of the entry switch. In the future,
with cascading FICON switches, the switch number specification may be different
to the case of an ESCON channel, where for ESCON the SWITCH keyword
specifies the logical switch number of the ESCON dynamic switch.
Refer to Figure 122 on page 169 for a review of the terminology used for
describing the ESCON Director in an ESCON environment.
A switch must have a logical switch number, or LSN, which is a unique arbitrary 2
hex-digit number in the range 00 to FF. This number is specified by the systems
A switch can also have a device number, a 3 to 4 hex-digit number in the range
000 to FFFF. Although defining the switch as a device is optional, it is
recommended so that the switch can report switch-related errors to the operating
system, and note that it is required if SA I/O-Ops or ESCON Manager is used.
The switch device number is also specified by the systems programmer in IOCP
and/or HCD.
zSeries Processor
ESCON (CNC) Channels v F003,online
A8 A0 88 80 28 20 18 10 05
Figure 122 shows an example of four ESCON Directors that have been assigned
logical switch numbers (LSN) 01, 02, 03 and 04. The LSN is used in the
IOCP/HCD definition to assign a CHPID to its associated ESCON dynamic switch
(that is, the switch where the CHPID’s dynamic connections occur). So, even
though CHPID 80 is physically connected to LSN 02, switch 02 is chained to
switch 01, and the connection through switch 02 for CHPID 80 is static. The
dynamic connections for the paths over CHPID 80 are in switch 01, which is
defined as its dynamic switch on the SWITCH keyword in the IOCP.
The diagram also demonstrates the use of the switch device number. Each switch
has been defined as an IODEVICE with two paths for availability. For example,
switch 03 has two paths defined to the control unit port (CUP, internal port FE)
over CHPIDs 20 and 28, which are also used to support paths to the disk devices.
The IOCP definition for this configuration is shown in Figure 123 on page 170.
In addition, if the FICON native (FC) channel is connected to a FICON switch, the
FLOGI response also identifies the attached 24-bit port address. The switch
returns a 24-bit port address which, in the FICON implementation, is interpreted
to include an 8-bit switch address
FLOGI
PLOGI
Switch Port Constant
Address Address
Figure 124 shows how the switch address portion of the full 24-bit port address is
determined by the FICON native (FC) channel during the FLOGI process. In
response to the FLOGI, the switch returns an Accept (ACC) with a non-zero
destination ID (D_ID) which the FICON native (FC) channel interprets as 24 bits
of information that includes an 8-bit switch address, an 8-bit port address, and an
8-bit constant.
The switch address and constant obtained are then used to construct the 24-bit
destination fabric port address for the target control unit used in the PLOGI and
for normal commands and data transfer. The 8-bit port address for the destination
port is obtained from the definition (IOCP).
0C 1C 0C 1C 0C 1C 0C 1C
LSN 08 LSN 09 LSN 0A LSN 0B
02 12 FICON 02 12 02 12 FICON 02 12
Directors Directors
CHPID PATH=(E8,F8),SHARED,PARTITION=((LP1,LP2,LP3),(LP1,LP2,LP3)),
TYPE=FC,SWITCH=08
CHPID PATH=(E9,F9),SHARED,PARTITION=((LP1,LP2,LP3),(LP1,LP2,LP3)),
TYPE=FC,SWITCH=09
CHPID PATH=(EA,FA),SHARED,PARTITION=((LP1,LP2,LP3),(LP1,LP2,LP3)),
TYPE=FC,SWITCH=0A
CHPID PATH=(EB,FB),SHARED,PARTITION=((LP1,LP2,LP3),(LP1,LP2,LP3)),
TYPE=FC,SWITCH=0B
CHPID PATH=(F0,F1,F2,F3),SHARED,PARTITION=((LP1,LP2,LP3)),TYPE=FC
Figure 125. Sample IOCP coding for FICON native (FC) channels
The SWITCH keyword is required for FC CHPIDs E8-EB and F8-FB because they
are physically connected to FICON Directors.
IOCP also polices the resources defined for a FICON native (FC) channel.
The rules checked by IYPIOCP for the zSeries processors are shown in Table 23.
Table 23. IOCP resource checking - FICON channel - zSeries processors
IOCP publication
For the zSeries 900 processor, reference zSeries 900 Input/Output Configuration
Program User’s Guide for IYP IOCP, order number SB10-7029-00.
The description of the support level for the 9672 G5/G6 processor is:
FICON, OSD, OSE, IC, ICB, CF, OSA, ESCON, 288K MAX HSA
The processor support level is selected via the HCD processor change option, or
on the HCD Add Processor panel. At this time, there is only one support level
available for the zSeries processor and it is automatically assigned when the
processor is defined. An example of support level selection for a 9672 G5/G6
processor definition is shown in Figure 126 on page 174.
Select one.
Support Level
FCV, OSD, OSE, IC, ICB, CF, OSA, ESCON, Parallel
#
FICON, OSD, OSE, IC, ICB, CF, OSA, ESCON, 288K MAX HSA
#
***************************** Bottom of data *****************************
Once the correct processor support level has been selected, the HCD Add
Channel Path panel is used to define a FICON native (FC) channel. A FICON
native (FC) channel can be connected point-to-point or switched point-to-point (to
a FICON Director). The sample configuration shown in Figure 127 is used to
demonstrate the HCD definition.
zSeries Processor
FICON (FC) Channels
E8 F8 E9 F9 F0 F1 F2 F3 EA FA EB FB
0C 1C 0C 1C 0C 1C 0C 1C
LSN 08 LSN 09 LSN 0A LSN 0B
02 12 FICON 02 12 02 12 FICON 02 12
Directors Directors
FICON FICON
CU CU
FICON FICON
CU CU
Figure 127. Sample configuration for HCD FICON native (FC) channel definition
An example of the HCD Add Channel Path panel for a point-to-point FICON
native (FC) channel connection is shown in Figure 128 on page 175, using
CHPID F0 as an example.
Processor ID . . . : Z900PROC
Configuration mode : LPAR
Channel path ID . . . . F0 +
Number of CHPIDs . . . . 4
Channel path type . . . FC_ +
Operation mode . . . . . SHR +
Managed . . . . . . . . No (Yes or No) I/O Cluster ________ +
Description . . . . . . ________________________________
Figure 128. HCD Add Channel Path panel - FC channel point-to-point connection
In this example, four FICON native (FC) channels are defined with consecutive
CHPID numbers starting with F0. The CHPIDs are defined as shared. Because
the CHPIDs are connected point-to-point, no switch information is coded.
Processor ID . . . : Z900PROC
Configuration mode : LPAR
Channel path ID . . . . F8 +
Number of CHPIDs . . . . 1
Channel path type . . . FC_ +
Operation mode . . . . . shr +
Entry port . . . . . . . 1C +
F1=Help F2=Split F3=Exit F4=Prompt F5=Reset F9=Swap
F12=Cancel
Figure 129. HCD Add Channel Path panel - FC switched point-to-point connection
If the FICON native channel path is not assigned to a FICON Director, the
channel path can only be configured to support one control unit unless the control
unit has multiple logical addresses.
Intermixing
IBM control units support the intermixing of FICON native (FC) channel paths with
ESCON (CNC) and FICON Bridge (FCV) channel paths, up to a maximum of 8,
attached to the zSeries processor and the 9672 G5 and G6 processors. However,
it is recommended that the FICON native (FC) channel paths only be mixed with
ESCON (CNC) and FICON Bridge (FCV) channel paths to ease the migration
from ESCON channels to FICON native (FC) channels using dynamic I/O
reconfiguration. Intermixing means it is possible to dynamically add FICON native
(FC) channel paths to a control unit while keeping its devices operational. A
second dynamic I/O reconfiguration change can then remove the ESCON and
FICON Bridge (FCV) channels while keeping the devices operational. Intermixing
should not be considered a long-term configuration option. An example of a
configuration with intermixed FICON native (FC), ESCON and FICON Bridge
(FCV) channels is shown in Figure 130 on page 177.
FICON
ESCON FICON FICON
Director FICON
Director Bridge Director
FICON Director
0B Bridge 0B 0C 0C 0C
0C 0B 0B
FICON
A3 C3 23 13 A3 C3 23 13
ESCON ESCON ESCON Adapters
Adapters Adapters Adapters
Not all FICON control units support logical addressing. This characteristic is
discussed in more detail in the definition section of this chapter for each specific
FICON control unit, such as the ESS 2105 in “FICON ESS (2105)” on page 183.
The rules checked by IYPIOCP for a zSeries processor are shown in Table 25.
Table 25. IOCP resource checking - FICON control unit - zSeries processors
The rules checked by IZPIOCP for 9672 G5 and G6 processors are shown in
Table 26.
Table 26. IOCP resource checking - FICON control unit - 9672 G5/G6 processors
There are no specific definition requirements in IOCP and HCD for a FICON
device, but it should be noted that a FICON native (FC) channel path can support
attachment of more devices (16,384) than an ESCON channel path (1,024).
The rules checked by IYPIOCP for a zSeries 900 processor are shown in
Table 27.
Table 27. IOCP resource checking - FICON device - zSeries 900 processor
The rules checked by IZPIOCP for 9672 G5 and G6 processors are shown in
Table 28.
Table 28. IOCP resource checking - FICON device - 9672 G5/G6 processor
CHPIDs LA CUADD UA
FICON Channel
FC-2 and SB-2 Channel S_ID (ddaapp) D_ID (ddAApp) Channel Image CU Image UA
Protocol
Obtained from
Initial Channel
Link Initialization
(FLOGI-ACCEPT)
Figure 131. Mapping of HCD definition to FICON native (FC) frame contents
Like the ESCON Director, the 2032 FICON Director supports one device
(UA=x’00’) to address the control unit port, or CUP. It has a single logical control
unit that supports up to 256 logical paths. This information is summarized in
Table 29.
Table 29. 2032 FICON Director (CUP) resources
Resource Number
For the ESCON Director, the definition of the CUP to IOCP and HCD remains
optional for the FICON Director. That is, it is not necessary to define the FICON
zSeries Processor
FICON (FC) Channels
E8 F8 E9 F9 EA FA EB FB
2032
0C 1C 0C 1C 0C 1C 0C 1C
FICON Directors
LSN 08 LSN 09 LSN 0A LSN 0B
09 19 09 19 09 19 09 19
FICON Adapters
The FICON Director must be defined as UNIT=2032. It attaches device type 2032
or SWCH.
As with the ESCON Director, the 2032 FICON Director provides a control unit port
(CUP) function. The CUP is identified as (internal) port number ’FE’. The
definition of this control unit port is optional.
The IOCP coding for the sample 2032 FICON Director configuration is shown in
Figure 133.
The sample configuration is shown for a zSeries 900 processor with FICON
native (FC) channels connected to four FICON Directors with logical switch
numbers (LSN) 08, 09, 0A, and 0B. Two of these FICON CHPIDs, E8 and F8,
zSeries Processor
FICON (FC) Channels
E8 F8 E9 F9 EA FA EB FB
0C 1C 0C 1C 0C 1C 0C 1C
LSN 08 LSN 09 LSN 0A LSN0 B
FICON Directors
09 19 09 19 09 19 09 19
FICON Adapters
Figure 135. IOCP definition for a FICON ESS 2105 subsystem with eight LCUs
1C0 UW57198
1D0 UW57199
1E0 UW57200
1C 0C 1C 0C
08 08
FICON Adapters
CU 6000
(LCU 0)
The diagram in Figure 136 shows a sample configuration for 3590 with FICON
attachment.
Figure 138 shows a sample FICON configuration for the 3170 Infoprint Color 130
Plus. The 3170 is accessed by two different images.
1C 0C 1C 0C
05 05
FICON Adapters
CU 4100
(LCU 0)
3170
Infoprint Color 130
Device 4100
ID MSG1='2064-112', x
MSG2='Native FICON 3170 Printer Installation', x
SYSTEM=(2064,1)
RESOURCE PARTITION=((LP1,1),(LP2,2),(LP3,3))
. . .
CHPID PATH=(E9),TYPE=FC,SHARED,SWITCH=09, x
PARTITION=((LP1,LP2,LP3),(LP1,LP2,LP3))
CHPID PATH=(F9),TYPE=FC,SHARED,SWITCH=0A, x
PARTITION=((LP1,LP2,LP3),(LP1,LP2,LP3))
. . .
*******************************************************************
** Printer CU 4100 and Devices 4100, 4101
*******************************************************************
CNTLUNIT CUNUMBR=4100,PATH=(E9,F9),UNIT=3170, x
UNITADD=((40,2)),LINK=(05,05)
IODEVICE ADDRESS=(4100,2),UNITADD=40,CUNUMBR=(4100), x
UNIT=3170
Figure 140 shows the HCD Add Device panel for defining the FICON 3170 printer.
Add Device
Connected to CUs . . ____ ____ ____ ____ ____ ____ ____ ____ +
Figure 140. HCD Add Device panel - FICON 3170-3A printer definition
The device is defined as device type 3170. Figure 141 on page 188 shows the
association of device number 4100 with control unit number 4100, defined as type
AFP1, during the HCD device definition process. Defining the control unit as type
AFP1 is recommended because it is a generic type.
Figure 141. HCD Available Control Units panel - FICON 3170-3A printer definition
Figure 142 shows the default device parameters selected for the FICON 3170 on
the HCD View Device Parameter/Feature Definition panel.
ENTER to continue.
Parameter/
Feature Value Req. Description
OFFLINE No Device considered online or offline at IPL
DYNAMIC Yes Device supports dynamic configuration
BURSTER No Burster-Trimmer-Stacker
***************************** Bottom of data ******************************
Figure 142. HCD View Device panel - FICON 3170 printer definition
For more information on the FICON channel operation and the software controls,
refer to “CCW and data prefetch and pipelining” on page 208.
For more information on the FICON channel synchronization and the software
controls, refer to “Synchronization of read-to-write transition” on page 211.
PCI synchronization
The FICON channel performs PCI synchronization on CCWs that specify a PCI
(Program Controlled Interrupt). This is known as modification control. When the
FICON channel executes a command with the PCI and command-chain flags set
to one in the CCW, command synchronization is forced for the subsequent
command by setting the “Synchronize Send Status” (SSS) flag. The channel
subsystem temporarily suspends command chaining and does not fetch the next
command-chained CCW until after normal ending status is received from the
device for the last command that had been sent.
For more information on the FICON channel operation and synchronization, refer
to “PCI synchronization” on page 213.
ESCON FICON
Interfaces Interfaces
Figure 143 shows a valid migration from ESCON (CNC) channels to FICON
native (FC) channels. There are four paths from the operating system image to
the disk subsystem in both the ESCON configuration and the FICON
configuration, but the advantages of the FICON configuration include:
• more concurrent I/Os to the same control unit
• concurrent I/Os with other control units
Migration
ESCON Invalid FICON
Director Configuration Director
xx xx
ESCON FICON
Interfaces Interfaces
x x x x
Disk Disk Disk Disk
Subsystem Subsystem Subsystem Subsystem
As Figure 144 shows, when migrating access to a control unit from ESCON
(CNC) channels to FICON native (FC) channels, it is not possible to aggregate
two or more ESCON channel paths that access the same logical control unit into
only one FICON native (FC) channel path. This rule applies to ESCON, FICON
Bridge (FCV) and FICON native (FC) channels.
In this ESCON configuration, each image on each of the four CECs has eight
paths to each logical control unit (LCU) on two ESS D/T2105 subsystems. The
paths are configured through four ESCON Directors, each with 248 ports. This
configuration requires the following resources:
• 32 ESCON (CNC) channels per CEC
• 40 ESCON Director ports per ESCON Director (32 for channels, eight for CU
adapters)
• 16 ESCON adapters per control unit. Only eight of the 16 adapters can be
used to access a specific logical control unit from any logical partition, and
there are eight logical control units per physical control unit.
LP1 LP2 LP3 LP1 LP2 LP3 LP1 LP2 LP3 LP1 LP2 LP3
8 8 8 8 8 8
8 8 8 8
8 8 8 8
248 8 248 248 8 248
ESCD 1 ESCD 2 ESCD 3 ESCD 4
Ports Ports Ports Ports
ESCON ESCON
Ports Ports
The maximum I/O connectivity for a single ESCON channel in this configuration
includes only one control unit link with its 1,024 device address limitation. Each
control unit adapter can access four logical control units, each with 256 volumes
(4 x 256 = 1,024).
A single ESCON channel can do only one active I/O operation to one of the four
logical control units at a time.
LP1 LP2 LP3 LP1 LP2 LP3 LP1 LP2 LP3 LP1 LP2 LP3
4 4 4 4
4 4 4
FICON 64 4 64 FICON
Director #1 Ports Ports Director #2
FICON FICON
Ports Ports
There are two control units, each with eight FICON adapters and eight logical
control units configured. All adapters can be used by all logical control units
(conforming to the maximum of eight paths per LCU limit) and each logical control
unit has 256 device addresses. All control unit FICON host adapters are
connected through two FICON Directors.
There are two FICON Directors and each is connected to four FICON native (FC)
channels of each CEC, resulting in 16 ports on each switch for channel
connectivity. Each of the FICON Directors is also connected to four adapters of
each control unit, resulting in 24 ports in total for each switch.
So this FICON native (FC) configuration is within the FICON resource limits and
in fact requires less channel and connectivity resources than the corresponding
ESCON configuration. In this migration scenario, four ESCON CHPIDs have
been aggregated into one FICON CHPID.
The remainder of this section discusses the considerations for the connectivity
and I/O operation concurrency of this FICON configuration. A single FICON
channel uses a dynamic connection in the FICON Director, which provides
concurrent access to both control units. Each control unit FICON adapter can
access any of the eight configured logical control units.
This also means that this FICON native (FC) channel is addressing 4,096
volumes (256 volumes per logical control unit). The FICON implementation
allows up to 16,384 device addresses per FICON channel.
ESCON FICON
The actual number of concurrent I/O operations per CEC depends on the FICON
channel implementation on the CEC, and the actual number of concurrent I/O
operations per control unit also depends on the FICON adapter implementation
on the control unit.
Using four times less FICON channels than ESCON channels, the FICON
configuration can have more concurrent I/O operations in each control unit and in
each CEC.
LP1 LP2 LP3 LP1 LP2 LP3 LP1 LP2 LP3 LP1 LP2 LP3
8 8 8 8 8 8
8 8 8 8
8 8 8
248 248 8 248 248
8 8
ESCD 1 ESCD 2 ESCD 3 ESCD 4
Ports Ports Ports Ports
ESCON ESCON
Ports Ports
The target FICON installation is to have six CECs installed - three CECs are in
one machine room, and three CECs are in a machine room at another location. A
poorly-designed (over-defined) FICON native (FC) configuration is shown in
Figure 148. There are 18 host images (three on each of the six CECs), and each
image is configured with eight paths per control unit LCU. Therefore, the total
number of logical paths configured (18* 8 = 144) exceeds the capacity of a logical
control unit. The FICON ESS 2105 control unit shown supports up to 128 logical
paths per LCU. Note that the same problem of an over-defined configuration can
also occur in an ESCON environment.
LP1 LP2 LP3 LP1 LP2 LP3 LP1 LP2 LP3 LP1 LP2 LP3 LP1 LP2 LP3 LP1 LP2 LP3
FICON 64 64 FICON
Director #1 Ports Ports Director #2
FICON FICON
Ports Ports
Let’s assume that two more CECs are now required, each of them having three
images, resulting in a total number of 18 images. The new control unit resource
calculations are:
• Number of N_Port logins per adapter = 6
Now there are 6 CECs and all control unit adapters are connected to all CECs,
so there are 6 N_Port logins per control unit adapter.
This number is significantly less than the ESS 2105 limit, which is 128 N_Port
logins per control unit port.
• Number of logical paths per adapter = 72
There are 18 images and each image has four logical paths to a control unit
FICON adapter.
The IBM ESS 2105 limit is 256 logical paths per FICON adapter.
• Number of logical paths per logical control unit = 144
There are eight paths per logical control unit for each host image. In all six
CECs there are 18 images, so 144 (8 x 18) logical paths per logical control
unit.
This number is higher than the ESS 2105 limit, which is 128 logical paths per
logical control unit.
VARY PATH(dddd,cc),ONLINE
IEE714I PATH(dddd,cc) NOT OPERATIONAL
Note that there is no additional indication of the cause of the "not operational"
condition. To identify the source of the problem, it is necessary to display the
Analyze Serial Link Status frame in the CHPID Problem Determination Task at
the HMC. Refer to “zSeries and 9672 G5/G6 channel problem determination
panels” on page 229. In this scenario, the panel shows the text “CU resources
exceeded” for the logical path to the over-defined logical control unit that cannot
be established. In this case, the ICKDSF logical path report can be run to identify
which channel images have established logical paths to the logical control unit.
Refer to “ICKDSF logical paths report” on page 249 for information on
interpretting the report.
In order to overcome this problem, the number of paths for some less important
images should be reduced from eight.
If the current ESS 2105 subsystem is an F model with ESCON adapters, the
migration to a FICON configuration is straightforward. The migration steps are
described in this section.
Keep in mind that although ESCON and FICON paths can co-exist in the same
path group (that is, the set of paths to one operating system image) on the ESS
2105 F models, the intermixed path group configuration is only supported for the
duration of the migration. The ESS 2105 F models fully support an intermix
configuration of ESCON and FICON adapters; the limitation applies only to the
intermix of ESCON and FICON paths in a path group, that is, intermixed paths to
the same operating system image.
LP1 LP2 LP3 LP1 LP2 LP3 LP1 LP2 LP3 LP1 LP2 LP3
8 8
8 8
8
8
8 ESCON
248 8 248
8 Ports ESCD 2 ESCD 3 8 Ports
Channel Paths
ESCON
Ports
Figure 149. Sample ESS 2105 Model F20 with ESCON adapters
The customer plans to install four FICON channels per CEC and four FICON
adapters on the ESS. The interim migration configuration is shown in Figure 150.
In the interim configuration, the same images can access the ESS devices over a
combination of both ESCON and FICON paths. This configuration is only
supported for the duration of the migration to FICON.
LP1 LP2 LP3 LP1 LP2 LP3 LP1 LP2 LP3 LP1 LP2 LP3
8 8
8 8
8 8 8
64 FICON 248 8 248 FICON 64
Ports Director #1 Ports ESCD 2 ESCD 3 Ports Director #2 Ports
FICON ESCON
Ports Ports
LP1 LP2 LP3 LP1 LP2 LP3 LP1 LP2 LP3 LP1 LP2 LP3
FICON
64 64 Channel Paths
to other FICON FICON
Ports Ports to other
FICON-capable Director #1 Director #2
FICON-capable
control units
control units
unused
FICON ESCON FICON
Ports Ports Ports
Note that the intermixed ESCON and FICON native (FC) channel paths in the
same path group are only supported to facilitate a non-disruptive migration, and
should not be used for any extended length of time. Reconnections for devices in
an intermixed configuration are not optimal from a performance perspective and it
is strongly recommended that the customer move from an intermixed
configuration as soon as possible.
CCW and data pipelining and frame multiplexing are fully compatible with existing
programs and z/OS and OS/390 Access Methods.
Application z/OS or OS/390 I/O Requests #1. I/O Request (Macros or SVC 0)
SSCH
I/O #2. SSCH (SSID) and ORB (CPA)
IOS UCB Interrupt with ORB - P, Y, and M bits
FC3 (Services)
FC2 (Framing) #6. FC-2 (FC-FS) frames
FC1 Encode/
Decode
FC0 (Optics)
ESCON CU FICON CU
The flow of a FICON channel operation is explained in more detail using the
numbered steps:
1. Application I/O requests
To request I/O operations to a device, regular unauthorized users issue
macros such as GET and PUT that invoke Access Methods and use the
standard EXCP SVC 0 interface, while supervisor routines and system
components use a privileged I/O driver interface.
The IOBE is an optional control block for users of EXCP or the I/O driver
interface. It is used as a communication area between the user, IOS and
device dependent code such as Error Recovery Procedures (ERPs). For I/O
drivers, the IOBE is an extension of the IOSB extension (IOSBE).
Communication over the Fibre Channel takes place between a pair of N_Ports,
one N_Port associated with a channel and the other associated with a control
unit, over a Fibre Channel Fabric.
FC-FS defines all of the functions required to transfer information from one
N_Port to another. FC-FS consists of related functions FC-0, FC-1, and FC-2.
The physical interface (FC-0) consists of transmission media, transmitters,
receivers, and associated interfaces. FC-1 specifies the transmission protocol.
The signaling protocol, FC-2, provides the rules and mechanisms needed to
transfer information from one N_Port to another.
FICON CU
FICON
I/O Op Device - A I/O Op Device - A Connected
FICON LINK
CCW1 Full Duplex CCW1 Devices
CCW2 CCW2
CCW3 CCW3 Device
CCW4 CCW4
FICON Frames A
I/O Op Device - B I/O - A I/O - B I/O - C I/O Op Device - B
CCW1 CCW1
CCW2 CCW2
Device
CCW3 CCW3 B
CCW4 CCW4
FICON
Channel
I/O Op Device - C I/O Op Device - C
CCW1 CCW1
CCW2 CCW2
Device
CCW3 CCW3 C
CCW4 CCW4
For most cases, as the individual commands are being successfully executed
from the FICON channel and the FICON control unit, there is no need to report
back to the FICON channel. There is only a need to communicate with the
channel when the operation does one of the following:
• A disconnect command chaining condition occurs.
• The operation gets to the end of the CCW chain.
• The operation terminates in an error.
• A CU-detected modifying condition occurs (CU reports status-modifier).
The method of not communicating back to the channel for successful completion
of individual commands in the channel command chain, up to the last command,
saves both channel turnaround times and frame bandwidth on the FICON link.
CE/DE End
CCW3 CCW3 CCW3 CCW3
CE/DE End
As shown in the diagram, the ESCON channel transfers the CCW to the control
unit and waits for Channel End/Device End to be presented by the control unit
after execution of the CCW by the device (CCW interlock). After receiving CE/DE
for the previous CCW, the channel transfers the next CCW to the control unit for
execution.
On a FICON channel, all CCWs may be transferred to the control unit without
waiting for CE/DE after each I/O operation. The device presents a DE to the
control unit after each CCW execution, as before. If the last CCW of the CCW
chain has been executed by the device, the Control Unit will present CE/DE to the
channel. This feature of the Fibre Channel architecture is known as pipelining, or
prefetching of CCW commands and data, and allows the FICON channel to
operate at optimum efficiency.
The diagram in Figure 155 shows the FICON channel operation when CCW and
data pipelining is specified. It shows the FICON channel fetching and transferring
CCWs and data to the control unit, without having to wait for status indicating the
progress of the execution of the CCWs at the control unit and device. CCW and
data pipelining allows the FICON channel to operate at maximum efficiency.
CCWn CCWn
End
CE/DE
The diagram in Figure 156 on page 211 shows the consequences of preventing
CCW and data pipelining in the FICON channel. If ORBP=0, the FICON channel
must synchronize the execution of each CCW. The next CCW cannot be fetched
and transferred to the control unit before status for the current CCW is received.
Executing without pipelining means that the performance of the channel program
is impacted.
CCW1 CCW1
CE/DE
CRR+SSS
End
CCW2 CCW2
CMR
CCW2 CCW2
CE/DE End
CRR+SSS
CCW3 CCW3
CMR
CCW3 CCW3
End
CE/DE
When ORBY is set to 1 and ORBP (word 1 bit 9) is set to 1, synchronize control is
not specified. That is, the FICON channel does not synchronize status at a
read-write transition, and the benefits of CCW and data pipelining are realized.
When ORBY is set to 0 and pipelining is indicated (ORBP=1), synchronize control
is specified and the FICON channel must delay sending the output operation until
the status at the end of execution of the input operation has been received at the
channel.
The synchronize control bit is only meaningful when the device is configured on a
FICON (FC or FCV) channel and the prefetch control bit (ORBP) is 1.
The diagram in Figure 157 shows the FICON channel operation when read-write
transition synchronization is specified. That is, this diagram shows the normal
FICON channel operation, and the I/O requester has not explicitly indicated that
the synchronization can be overridden. In this example, the channel program
consists of the following CCWs:
• 63 - Define Extent (transfers positioning data)
• 47 - Locate Record (transfers positioning data)
• 06 - Read Data
• 47 - Locate Record (transfers positioning data)
• and so on...
The FICON channel recognizes the transition from an input operation (Read Data
CCW) to an output operation (Locate Record CCW), and sends CCW3 to the
control unit with Synchronize Send Status (SSS) flag set. The FICON channel
then suspends further fetching of CCWs until the status for CCW3 has been
received.
FICON
Control Unit Device
Channel
CCW1 - 63 (W) CCW1
CCW2 - 47 (W) CMR
CCW2
CCW1 CCW1
read-to-write CCW3 - 06 (R) CCW3
transition End
CCW4 - 47 (W) CCW4 CCW2 CCW2
CCW5 - 06 (R) CCW5 End
CCW6 - 06 (R) CCW3 CCW3
CCW6 End
---- ----
CCWn CCWn
End
CE/DE (CCWn)
The zSeries architecture provides the Modification Control bit that allows a
program to request the FICON channel not to synchronize on the CCW following
the PCI. When modification control is not specified, command synchronization is
not required and the channel subsystem may transfer commands to the device
without waiting for status.
The diagram in Figure 159 on page 215 shows the normal operation of the
FICON channel when a CCW with a PCI flag is executed but the ORB does not
specify modification control. In this example, the FICON channel fetches CCW12
which has the PCI flag on. ORBP=1 and ORBM=1 which means that modification
control is not specified, that is, no PCI synchronization is required. The FICON
channel sends CCW12 to the control unit with command response request (CRR)
flag set. When CCW12 becomes current in the control unit, a command response
(CMR) for CCW12 is sent to the FICON channel. When the FICON channel
associates the CMR with CCW12 which has the PCI flag on, a PCI I/O interrupt is
generated.
The PCI I/O interrupt is a signal to the I/O requester as to the progress of the
execution of the channel program. The application may now reuse the buffers
associated with the completed portion of the channel program, for example.
Because PCI synchronization is not required and modification control is not
specified, the full benefits of FICON channel pipelining are realized.
CCWn CCWn
End
CE/DE
The diagram in Figure 160 on page 216 shows the FICON channel operation
when PCI synchronization is required. ORBP=1 and ORBM=0 indicating
modification control is specified. When the FICON channel fetches CCW12 with
the PCI flag on, it sends CCW12 to the control unit with CRR flag on. The FICON
channel then fetches CCW13 and sends it to the control unit with the Synchronize
Send Status (SSS) flag set on. The FICON channel suspends fetching further
CCWs until the status for CCW13 is received from the control unit.
In the control unit, when CCW12 becomes current, a CMR for CCW12 is sent to
the FICON channel. The FICON channel recognizes that CCW12 has the PCI flag
on and generates a PCI I/O interrupt. On receipt of the PCI interrupt, the
authorized application may then modify any CCW from CCW14 (CCW12+8bytes)
onwards.
At the end of execution of CCW13, the control unit sends status to the FICON
channel and synchronization is now complete. The FICON channel can now
continue to fetch and send CCWs (that is, resume pipelining) to the control unit.
Note that the I/O requester has no awareness of the point in time where the
status for CCW13 is presented to the FICON channel. If the I/O requester intends
modifying CCW14, the priority of the image, on an LPAR mode machine, and the
dispatching priority of the application should be set to ensure that the requester
receives control in a timely manner after the PCI interrupt.
Frame multiplexing uses Fibre Channel’s full duplex data transfer in each
direction and provides:
• Multiplexing operations for different devices and control units.
• Transmitted frames are in groups (implementation dependent).
• Received frames may be multiplexed (switch and operation dependent).
• Frames from each system intermix at the destination port.
• Destination port busy signals to SAP eliminated.
Control
Unit
FICON
Adapter
FICON
Channel
zSeries Server
Figure 161 shows a frame multiplexing example. FICON channels can send
multiplexed sequence-frames, transmitting frames in groups via a switch to a
control unit’s FICON adapter. The received frames may be multiplexed by the
switch (implementation dependent).
Figure 162 on page 219 shows the components of an ESCON I/O operation when
a cache hit occurs. In this case, there is no disconnect time and the I/O operation
ends at the end of the connect time, after transferring the requested data.
The ESCON I/O operation may accumulate IOSQ time if the device (UCB) is
already in use for another I/O request from this system. IOS only initiates one I/O
operation at a time for a device with the Channel Subsystem. The new I/O
operation cannot be started with the Channel Subsystem until the I/O interrupt
signalling completion of the current outstanding I/O operation has been
processed by IOS. Parallel Access Volume (PAV) support, available on the IBM
ESS 2105 subsystem, helps reduce IOSQ time and device busy conditions by
allowing multiple I/O requests per UCB for access to the same logical volume.
Once the request has been accepted by the Channel Subsystem, it may
accumulate PEND time if the Channel Subsystem is unable to start the request
because of either channel busy, port busy, control unit (CU) busy, or device busy.
IO SQ Pend C onnect
Channel Busy
Device busy W orking
(UCB Busy) Transferring Data
Port Busy
PAV helps
with multiple CU Busy
UCBs and CU I/O Q ueuing
Device Disconnect time
Addresses
Device Busy
MA
Reduce Pend Time
With the ESS 2105 subsystem, some control unit busy can be alleviated with I/O
queuing by the control unit. In the case of a cache hit, the ESS 2105 control unit
may queue an I/O request for conditions which in other subsystems would result
in CU busy, such as destaging, extent conflict resolution, and so on. This control
unit I/O queuing time is accumulated in DISCONNECT time, but reported later in
PEND time.
With the ESS 2105 subsystem, some device busy can be alleviated through the
Multiple Allegiance function that enables different operating system images to
perform concurrent I/O operations at the same logical volume as long as no
extent conflict exists. Note that device busy still occurs if the device is reserved
by another operating system image.
When the I/O operation is accepted by the control unit, CONNECT time is
accumulated as the channel transfers data to/from cache.
The I/O operation completes when the data transfer into cache is complete. No
access to the physical volume is required before the end of the I/O operation is
signalled in the case of a cache hit.
(Cache miss)
Device Busy
MA
Reduce Pend Time
Figure 163 shows an ESCON I/O operation sequence when a cache miss occurs.
In this case, CONNECT time is accumulated as the positioning CCWs are
transferred to the control unit. For the ESS 2105 subsystem, this CONNECT time
component also includes the extent conflict checking time.
The I/O operation ends after the requested data has been transferred and the
terminating interrupt has been presented by the channel.
FC frame multiplexing,
IOSQ Pend Connect allows for better link
utilization, but may extend
Reduced Reduced some connect times
UCB busy channel busy Working
Transferring Data
(multiple starts) FICON connect time is not as
(PAV helps predictable as ESCON, more
with multiple an awareness than a problem
UCBs and No port busy
device (buffer credits)
numbers -
Configure Reduced CU busy
more PAVs) (CU I/O queuing) Connect
logical disc time?
Reduced device
busy
(multiple
allegiance)
Figure 164 shows a FICON I/O operation sequence when a cache hit occurs. As
with an ESCON cache hit operation, no DISCONNECT time is accumulated. Note
that some busy conditions can be reduced or eliminated when using FICON
channels:
• More devices/UCBs can be configured (up to 16,384 devices per FICON
channel), allowing a higher ESS 2105 PAV function exploitation, including
dynamic PAV support in OS/390 R2.7 Workload Manager (WLM). This will
reduce the number of device busy and UCB busy conditions that will be
accumulated in IOSQ time.
• Channel busy is reduced with FICON’s capability of multiple starts to the same
channel path, thereby reducing PEND time.
• Port busy does not exist on FICON switches. The FICON switch uses switch
port buffer credits.
• Control unit busy conditions are reduced with CU I/O queueing in the ESS
2105 subsystem, also reducing PEND time.
• Device busy conditions are reduced by further exploitation of the ESS 2105
Multiple Allegiance (MA) function due to FICON’s multiple concurrent I/O
operations capability.
Figure 165 shows a FICON I/O operation sequence when a cache miss occurs. In
the ESCON cache miss operation, a DICONNECT time component is expected.
Having all the benefits about reducing busy conditions and times as shown in the
previous cache hit example, a new condition takes place in this kind of I/O
operation, removing another busy condition.
Because the control unit FICON adapter can handle multiple concurrent I/O
operations at a time, it will not disconnect from the channel when a cache miss
occurs for a single I/O operation. So the control unit adapter remains connected
to the channel, being able to transfer data from other I/O operations. This
condition is called “logical disconnect”.
With no disconnect time, the port busy condition during ESCON channel
reconnect time does not exist also, and this is another improvement over ESCON
channels. Note that the channel subsystem reported connect times are not
affected by logical disconnected times. The logical disconnect time is
accumulated by the hardware as a component of CONNECT time, but the
CONNECT time reported by the channel is calculated by excluding the logical
disconnect time. The logical disconnect time is reported as part of DISC time.
FICON channels allow a higher I/O throughput, using fewer resources, but this
does not mean that each I/O response time will be reduced (although this is
expected on large block sizes transfers).
Different zSeries channel types accessing the same CU can perform differently
for the same operation with the same topology or distance for the new channel
environment due to the operating characteristics of the channel type:
• Topology (point-to-point versus switched point-to-point)
• Distances - characteristic impacts
- Frame multiplexing
- Number of outstanding frame requests allowed
New zSeries channel types that provide connectivity to the same type of
CU/device are always introduced to provide connectivity, addressing, topology, or
performance benefits over the previous channels. Not every characteristic of the
older channel will automatically be improved. But the net of all the new channel
benefits provides significant improvements over the previous channel. In each
case the new channel type provides connectivity and performance enhancements
in a more complex, intermixed environment.
The zSeries FICON channel provides the zSeries tie-in to the evolving Storage
Area Networks (SAN) environment.
SMF record types 73 and 79-12 have been changed. The record changes are
documented in “SMF record changes for FICON” on page 259.
The type of information displayed is the same as for ESCON native (CNC mode)
channels.
The Worldwide name (WWN) is an eight-byte field that uniquely identifies a node
(F_Port or N_Port). This field is independant of and unrelated to FICON
addressing.
Figure 168 shows an example of the Analyze Subchannel Data display for a
FICON native (FC mode) attached device. Device number CA01 corresponds to
subchannel number 135A and has three FICON native channel paths (FD, F0 and
FA) and two ESCON native channel paths (9C and 08). Note that the CHPID type
information is not available on this frame.)
To ensure minimum Fiber Channel system impact and high signal integrity, the
user chooses from two operating modes.
• Analog pass-through mode
The received signal is buffered and retransmitted unmodified. The signal is
amplified and link jitter is increased by less than 100 sec.
Finisar Fibre Channel GT System Protocol Analyzer can also be used for FICON
FC link problem analysis. This analyzer attaches to the FC link being checked
with user changeable Finisar Instrument Grade GBIC transceivers, which support
data rates to 1.25 Gb/sec.
Captured traces can be analyzed directly from trace memory or saved to hard
disk in either Finisar binary or Finisar Archive compressed format. Captured
traces can also be saved on diskettes or transmitted to the network using the
provided Ethernet adapter.
Figure 169 shows the display of an FC2 Extended Link Service frame (FLOGI).
The GTX-Trace viewer allows you to display any FC2 captured frame and
provides interpretation of the data.
Figure 169. Example of FC2 Extended Link Service frame (FLOGI) trace display
Figure 170. Example of FC4 (FC-SB-2) Command and Data frame Trace display
In the event log you will find a reference to a failing Field Replaceable Unit (FRU).
Use this information together with the supplied Maintenance Manual to identify
the failing component.
If necessary, configure the COMx port to the settings shown in Figure 173.
On the Hyper Terminal screen select File --> Properties --> Configure and
change the fields to the following data:
- Bits per second 115200
- Data Bits 8
- Parity N
- Stop Bits 1
Do not use this procedure unless instructed to do so by INRANGE technical
support!
Refer to 6.5, “McDATA FICON Director EFC Manager” on page 73 for more
details on how to invoke the EFC Product Manager. Logs can be selected by
clicking the Logs button from the FICON Director Hardware view as it is shown in
Figure 174.
The Audit, Event, Hardware, and Link Incident logs store up to 1000 entries each.
The most recent entry displays at the top of the log. After 1000 entries are stored,
new entries overwrite the oldest entries.
The audit log displays a history of all configuration changes applied to the FICON
Director from any source, such as Product Manager, operator panel, and SNMP.
Refer to McDATA ED-5000 or ED-6064 User Manual in the “Using Logs” chapter
for more details.
The event log provides a record of significant events that have occurred on the
FICON Director, such as FRU failures, degraded operation, and port problems.
All detected firmware faults and hardware failures are reported to the operator
panel and sent to the EFC Server for recording in the event log.
For detailed information on event data and problem resolution, refer to FICON
Director Service Manual.
Refer to McDATA ED-5000 or ED-6064 User Manual in the “Using Logs” chapter
for more details.
The hardware log displays information on FRUs inserted and removed from the
ED-5000.
Refer to McDATA ED-5000 or ED-6064 User Manual in the “Using Logs” chapter
for more details.
The link incident log displays the 1000 most recent link incidents with the date the
incident occurred, the time it occurred, and the port on which the incident took
place. Please note that the note column displays the port number and not the port
address.
Refer to McDATA ED-5000 or ED-6064 User Manual in the “Using Logs” chapter
for more details.
D M=CHP
The D M=CHP command displays the status and type of CHPIDs.
D M=CHP
The first part of the display shows the local status of the CHPIDs (online, and so
on), while the second part of the display provides information about the type of
More detailed information and examples of each of these FICON CHPID states
are provided in subsequent sections.
D M=CHP(cc)
The D M=CHP(cc) command displays the status of an individual CHPID.
D M=CHP(FA)
Note the reported description for CHPID FA in the above dsplay: FICON
SWITCHED.
D M=CHP(F9)
For this display, there are no devices accessible through this FICON
INCOMPLETE channel.
D U,,,dddd,1
The Display Units command is useful for determining the z/OS status of a device.
An example is shown in the following screen.
D U,,,CA00,8
D M=DEV(dddd)
The following screen shows the output of the Display Matrix command for a
device connected to FICON native (FC) channels.
D M=DEV(CA01)
This display lists the CHPIDs defined for device number CA01. It also lists the
destination link address for each CHPID, and the destination logical control unit,
in this case CUADD, or CU image, 2. Once again there is nothing in this display
to identify this device as FICON-attachable. The display would look the same for
a device configured on ESCON switched point-to-point channels.
DS P,dddd
Another useful command for determining the status of paths to a device is the
DFSMS DEVSERV Paths command. Sample output is shown below.
DS P,CA01
This display is only available for disk and tape and is useful in reporting the
real-time state of each path to the device. Once again, there is no information in
the output of this display to identify the device as FICON-attached. This display
would look the same for parallel, ESCON, or FICON channels.
Display Switch
The following screen shows an example of the output of the SA I/O-Ops Display
Switch command when the configuration includes FICON Directors.
F IOOPSV2,D S *
This display shows that the configuration includes two McDATA ED-5000 FICON
Directors, each with 32 ports, as well as a number of IBM 9032 ESCON Directors.
The two McDATA FICON Directors are defined as device numbers B550 and
B551, with Logical Switch Numbers (LSN) 50 and 51, respectively.
F IOOPSV2,D S B550
This display shows the status and port name of each port on the switch. The
status reflects the real-time status of the port:
Note that there is no change to this display for a FICON Director from that for an
ESCON Director.
Display CHPID
The following screen shows the output of the I/O-Ops Display Channel command
for a FICON native (FC) channel.
F IOOPSV2,D C F8
Information about CHPID F8 is displayed including its type - FC_S; the switch to
which it is connected - device number B551 and logical switch number 51; the
channel’s entry port - 05; and the status and name of the port.
Display Device
The Display Device command can be used to determine all the devices
connected through a particular switch. The following screen shows an example of
the command used to determine the list of devices accessible through FICON
Director device number B550.
F IOOPSV2,D D * B550
/ / / /
IHVC824I PORT
IHVC825I CHP SWCH STATUS
IHVC826I DEVN CHP TYPE DEVN LSN PORT H B C P PORT NAME
IHVC827I 0500 F4 FC_S B550 50 08 Port 04
IHVC827I FA FC_S B550 50 05 Port 01
IHVC827I FC FC_S B550 50 09 Port 05
IHVC827I 0501 F4 FC_S B550 50 08 Port 04
IHVC827I FA FC_S B550 50 05 Port 01
IHVC827I FC FC_S B550 50 09 Port 05
IHVC827I 0502 F4 FC_S B550 50 08 Port 04
IHVC827I FA FC_S B550 50 05 Port 01
IHVC827I FC FC_S B550 50 09 Port 05
IHVC827I B550 F4 FC_S B550 50 08 Port 04
IHVC827I C800 F4 FC_S B550 50 08 Port 04
// /
IHVC827I CF14 FC FC_S B550 50 09 Port 05
IHVC827I CF15 FC FC_S B550 50 09 Port 05
IHVC827I CF16 FC FC_S B550 50 09 Port 05
IHVC827I CF17 FC FC_S B550 50 09 Port 05
IHVO000I I/O-OPS IS READY TO PROCESS OPERATOR COMMANDS
F IOOPSV2,D D CA01 *
// /
IHVC824I PORT
IHVC825I CHP SWCH STATUS
IHVC826I DEVN CHP TYPE DEVN LSN PORT H B C P PORT NAME
IHVC827I CA01 FD FC_S B551 51 08 Port 04
IHVC82AI CNTL UNIT DATA:B551 51 1C Port 18
IHVC827I F0 FC_S
IHVC827I 9C CNC_S
IHVC827I 08 CNC_S
IHVC827I FA FC_S B550 50 05 Port 01
IHVC82AI CNTL UNIT DATA:B550 50 1D Port 19
IHVO000I I/O-OPS IS READY TO PROCESS OPERATOR COMMANDS
This display shows that device number CA01 has five paths defined:
• FD - FICON switched point-to-point (connected to FICON Director B551, LSN
51)
• F0 - FICON switched point-to-point (CHPID offline)
• 9C - ESCON switched point-to-point (CHPID offline)
• 08 - ESCON switched point-to-point (CHPID offline)
• FA - FICON switched point-to-point (connected to FICON Director B550, LSN
50)
Refer to “CCW and data prefetch and pipelining” on page 208 for more
information on the ORB bit settings.
In this scenario, SMF is writing to a data set on device number CAEF, which is on
an IBM ESS 2105 subsystem. The subsystem is connected by both ESCON
(CNC) and FICON native (FC) CHPIDs.
Figure 180, Figure 181 on page 251, Figure 182 on page 253, and Figure 183 on
page 254 show extracts from the sample output of the ICKDSF job run to a device
on an ESS subsystem configured with FICON native (FC) channels only.
The first part of the ICKDSF logical path report, shown in Figure 180, provides
information about the device and the paths to the device.
The report is run for any device number on the required logical control unit. The
paths with status F/E are those established for this specific logical control unit.
Paths with status F/L are established for some other logical control unit than that
associated with the device for which the report was run. Therefore, if this logical
control unit has a “control unit resources exceeded” condition, the logical paths of
interest are those with status F/E. These should be matched with the owning
operating systems (through the use of the D M=CPU command output) to
determine who owns all the possible logical paths for this logical control unit.
This section of the logical path report provides information about each ESCON or
Fibre Channel host adapter (FC 3021 or 3023) in FC-SB2 mode (FICON).
This section of the logical path report shows information about the interfaces from
the system where the report was run to the logical control unit associated with the
device for which the report was run.
SMF Type 73, the Channel Path Control Section, contains the information shown
in Table 32.
Table 32. SMF type 73 Channel Path Control section
VALUE MEANING
7 CPMF mode has
changed
VALUE MEANING
1 Compatibility mode
2 Extended mode
91 (5B) 1 Reserved
SMF Type 73, the Channel Path Data Section, contains the information shown in
Table 33.
Table 33. SMF type 73 Channel Path Data section
1 Maximum channel
work units
5-7 Reserved
8 (8) 40 Reserved
VALUE MEANING
1 CPMF mode has
changed
VALUE MEANING
1 Compatibility mode
2 Extended mode
6 (6) 2 Reserved
SMF Type 79-12, the Channel Path Data Section, contains the information shown
in Table 37.
Table 37. SMF type 79-12 Channel Path Data section
1 Maximum channel
work units
5-7 Reserved
23 (17) 1 Reserved
8 (8) 40 Reserved
FICON Director Type _______ Model _____ FICON Director S/N ___________
263
264 FICON Native Implementation and Reference Guide
Appendix E. Special notices
This publication is intended to help system programmers, hardware planners, and
system engineers who will plan and install FICON native (FC) products in a zSeries
900 and 9672 Generation 5 (G5) and Generation 6 (G6) environment. The
information in this publication is not intended as the specification of any
programming interfaces that are provided by FICON native (FC) products. See the
PUBLICATIONS section of the IBM Programming Announcement for your specific
FICON native (FC) product for more information about what publications are
considered to be product documentation.
Information in this book was developed in conjunction with use of the equipment
specified, and is limited in application to those specific hardware and software
products and levels.
IBM may have patents or pending patent applications covering subject matter in
this document. The furnishing of this document does not give you any license to
these patents. You can send license inquiries, in writing, to the IBM Director of
Licensing, IBM Corporation, North Castle Drive, Armonk, NY 10504-1785.
Licensees of this program who wish to have information about it for the purpose
of enabling: (i) the exchange of information between independently created
programs and other programs (including this one) and (ii) the mutual use of the
information which has been exchanged, should contact IBM Corporation, Dept.
600A, Mail Drop 1329, Somers, NY 10589 USA.
The information contained in this document has not been submitted to any formal
IBM test and is distributed AS IS. The use of this information or the
implementation of any of these techniques is a customer responsibility and
depends on the customer's ability to evaluate and integrate them into the
customer's operational environment. While each item may have been reviewed
by IBM for accuracy in a specific situation, there is no guarantee that the same or
similar results will be obtained elsewhere. Customers attempting to adapt these
techniques to their own environments do so at their own risk.
Any pointers in this publication to external Web sites are provided for
convenience only and do not in any manner serve as an endorsement of these
Web sites.
C-bus is a trademark of Corollary, Inc. in the United States and/or other countries.
Java and all Java-based trademarks and logos are trademarks or registered
trademarks of Sun Microsystems, Inc. in the United States and/or other countries.
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of
Microsoft Corporation in the United States and/or other countries.
UNIX is a registered trademark in the United States and other countries licensed
exclusively through The Open Group.
SET, SET Secure Electronic Transaction, and the SET Logo are trademarks owned
by SET Secure Electronic Transaction LLC.
Other company, product, and service names may be trademarks or service marks
of others.
This information was current at the time of publication, but is continually subject to change. The latest information
may be found at the Redbooks Web site.
Company
Address
We accept American Express, Diners, Eurocard, Master Card, and Visa. Payment by credit card not
available in all countries. Signature mandatory for credit card payment.
American National Standards Institute (ANSI). An channel path (CHP). A single interface between a
organization consisting of producers, consumers, and central processor and one or more control units along
general interest groups, that establishes the which signals and data can be sent to perform I/O
procedures by which accredited organizations create requests.
and maintain voluntary industry standards in the channel path identifier (CHPID). In a channel
United States. subsystem, a value assigned to each installed channel
ANSI. See American National Standards Institute. path of the system that uniquely identifies that path to
the system.
APAR. See authorized program analysis report.
channel subsystem (CSS). Relieves the processor of
authorized program analysis report (APAR). A direct I/O communication tasks, and performs path
report of a problem caused by a suspected defect in a management functions. Uses a collection of
current, unaltered release of a program. subchannels to direct a channel to control the flow of
information between I/O devices and main storage.
B
channel-attached. (1) Pertaining to attachment of
basic mode. A S/390 or zSeries central processing devices directly by data channels (I/O channels) to a
mode that does not use logical partitioning. Contrast computer. (2) Pertaining to devices attached to a
with logically partitioned (LPAR) mode. controlling unit by cables rather than by
blocked. In an ESCON Director, the attribute that, telecommunication lines.
when set, removes the communication capability of a CHPID. Channel path identifier.
specific port. Contrast with unblocked.
cladding. In an optical cable, the region of low
byte. (1) In fibre channel, an eight-bit entity prior to refractive index surrounding the core. See also core
encoding or after decoding, with its least significant bit and optical fiber.
denoted as bit 0, and most significant bit as bit 7. The
most significant bit is shown on the left side in FC-FS CNC. Mnemonic for an ESCON channel used to
unless otherwise shown. (2) In S/390 architecture or communicate to an ESCON-capable device.
zSeries z/Architecture (and FICON), an eight-bit entity configuration matrix. In an ESCON environment or
prior to encoding or after decoding, with its least FICON, an array of connectivity attributes that appear
significant bit denoted as bit 7, and most significant bit as rows and columns on a display device and can be
as bit 0. The most significant bit is shown on the left used to determine or change active and saved ESCON
side in S/390 architecture and zSeries z/Architecture. or FICON director configurations.
C connected. In an ESCON Director, the attribute that,
when set, establishes a dedicated connection between
Cascade switches. The connecting of one Fibre two ESCON ports. Contrast with disconnected.
Channel switch to another Fibre Channel switch,
thereby creating a cascaded switch route between two connection. In an ESCON Director, an association
N_Nodes connected to a fibre channel fabric. established between two ports that provides a physical
communication path between them.
CBY. Mnemonic for an ESCON channel attached to an
IBM 9034 convertor. The 9034 converts from ESCON connectivity attribute. In an ESCON and FICON
CBY signals to parallel channel interface (OEMI) Director, the characteristic that determines a particular
communication operating in byte multiplex mode (Bus element of a port's status. See allowed, prohibited,
and Tag). Contrast with CVC. blocked, unblocked, (connected and disconnected).
Extended Link Services (ELS). An Extended Link FICON Director. A Fibre Channel switch that supports
Service (command) request solicits a destination port the ESCON-like “control unit port” (CUP function) that
(N_Port or F_Port) to perform a function or service. is assigned a 24-bit FC port address to allow FC-SB-2
Each ELS request consists of an Link Service (LS) addressing of the CUP function to perform command
command; the N_Port ELS commands are defined in and data transfer (in the FC world, it is a means of
the FC-FS architecture. in-band management using a FC-4 ULP).
field replaceable unit (FRU). An assembly that is
F replaced in its entirety when any one of its required
FC. (1) (Fibre Channel), a short form when referring to components fails.
something that is part of the fibre channel standard. (2) FRU. See field replaceable unit.
Also used by the IBM I/O definition process when
defining a FICON channel (using IOCP of HCD) that G
will be used in FICON native mode (using the FC-SB-2
communication protocol). Note: The two uses of the Giga bit (Gbit). Usually used to refer to a data rate,
term FC can be confusing at times. the number of Giga bits being transferred in one
second. One Giga bit is 1062.5 Mega bits.(See Mega
FC-FS. Fibre Channel-Framing and Signalling, the bit)
term used to describe the FC-FS architecture.
FCS. See fibre channel standard.
H
fiber. See optical fiber. half duplex. In data communication, pertaining to
transmission in only one direction at a time. Contrast
fiber optic cable. See optical cable. with duplex.
273
hard disk drive. (1) A storage media within a storage IODF. The data set that contains the S/390 or zSeries
server used to maintain information that the storage I/O configuration definition file produced during the
server requires. (2) A mass storage medium for defining of the S/390 or zSeries I/O configuration by
computers that is typically available as a fixed disk or a HCD. Used as a source for IPL, IOCP and Dynamic I/O
removable cartridge. Reconfiguration.
HCD. Hardware Configuration Dialog. IPL. See initial program load.
HDA. Head and disk assembly. J
HDD. See hard disk drive.
jumper cable. In an ESCON and FICON environment,
head and disk assembly. The portion of an HDD an optical cable having two conductors that provides
associated with the medium and the read/write head. physical attachment between a channel and a
distribution panel or an ESCON/FICON Director port or
I a control unit/devices, or between an ESCON/FICON
ID. See identifier. Director port and a distribution panel or a control
unit/device, or between a control unit/device and a
Identifier. A unique name or address that identifies distribution panel. Contrast with trunk cable.
things such as programs, devices or systems.
initial program load (IPL). (1) The initialization
L
procedure that causes an operating system to LAN. See local area network.
commence operation. (2) The process by which a
laser. A device that produces optical radiation using a
configuration image is loaded into storage at the
population inversion to provide light amplification by
beginning of a work day, or after a system malfunction.
stimulated emission of radiation and (generally) an
(3) The process of loading system programs and
optical resonant cavity to provide positive feedback.
preparing a system to run jobs.
Laser radiation can be highly coherent temporally, or
input/output (I/O). (1) Pertaining to a device whose spatially, or both.
parts can perform an input process and an output
LCU. See Logical Control Unit.
process at the same time. (2) Pertaining to a functional
unit or channel involved in an input process, output LED. See light emitting diode.
process, or both, concurrently or not, and to the data
licensed internal code (LIC). Microcode that IBM
involved in such a process. (3) Pertaining to input,
does not sell as part of a machine, but instead,
output, or both.
licenses it to the customer. LIC is implemented in a
input/output configuration data set (IOCDS). The part of storage that is not addressable by user
data set in the S/390 and zSeries processor (in the programs. Some IBM products use it to implement
support element) that contains an I/O configuration functions as an alternate to hard-wire circuitry.
definition built by the input/output configuration
light-emitting diode (LED). A semiconductor chip that
program (IOCP).
gives off visible or infrared light when activated.
input/output configuration program (IOCP). A S/390 Contrast Laser.
program that defines to a system the channels, I/O
link. (1) In an ESCON environment or FICON
devices, paths to the I/O devices, and the addresses of
environment (fibre channel environment), the physical
the I/O devices.The output is normally written to a
connection and transmission medium used between
S/390 or zSeries IOCDS.
an optical transmitter and an optical receiver. A link
interface. (1) A shared boundary between two consists of two conductors, one used for sending and
functional units, defined by functional characteristics, the other for receiving, thereby providing a duplex
signal characteristics, or other characteristics as communication path. (2) In an ESCON I/O interface,
appropriate. The concept includes the specification of the physical connection and transmission medium
the connection of two devices having different used between a channel and a control unit, a channel
functions. (2) Hardware, software, or both, that links and an ESCD, a control unit and an ESCD, or, at
systems, programs, or devices. times, between two ESCDs. (3) In a FICON I/O
interface, the physical connection and transmission
I/O. See input/output.
medium used between a channel and a control unit, a
I/O configuration. The collection of channel paths, channel and a FICON Director, a control unit and a
control units, and I/O devices that attaches to the fibre channel FICON Director, or, at times, between
processor. This may also include channel switches (for two fibre channels switches.
example, an ESCON Director).
link address. (1) On an ESCON interface, the portion
IOCDS. See Input/Output configuration data set. of a source or destination address in a frame that
IOCP. See Input/Output configuration control program. ESCON uses to route a frame through an ESCON
director. ESCON associates the link address with a
275
bus environment. This OEMI interface is also prohibited. In an ESCON or FICON Director, the
supported by the zSeries 900 processors. attribute that, when set, removes dynamic connectivity
capability. Contrast with allowed.
P
protocol. (1) A set of semantic and syntactic rules that
parallel channel. A channel having a System/360 and determines the behavior of functional units in
System/370 channel-to-control-unit I/O interface that achieving communication. (2) In fibre channel, the
uses bus and tag cables as a transmission medium. meanings of and the sequencing rules for requests
Contrast with ESCON channel. and responses used for managing the switch or switch
path. In a channel or communication network, any fabric, transferring data, and synchronizing the states
route between any two nodes. For ESCON and FICON of fibre channel fabric components. (3) A specification
this would be the route between the channel and the for the format and relative timing of information
control unit/device, or sometimes from the operating exchanged between communicating parties.
system control block for the device and the device PTF. See program temporary fix.
itself.
R
path group. The ESA/390 and zSeries architecture
(z/Architecture) term for a set of channel paths that are route. The path that an ESCON frame takes from a
defined to a controller as being associated with a channel through an ESCD to a control unit/device.
single S/390 image. The channel paths are in a group
state and are on-line to the host. S
path-group identifier. The ESA/390 and zSeries saved configuration. In an ESCON or FICON
architecture (z/Architecture) term for the identifier that Director environment, a stored set of connectivity
uniquely identifies a given LPAR. The path-group attributes whose values determine a configuration that
identifier is used in communication between the can be used to replace all or part of the ESCD's or
system image program and a device. The identifier FICON’s active configuration. Contrast with active
associates the path-group with one or more channel configuration.
paths, thereby defining these paths to the control unit service element (SE). A dedicated service processing
as being associated with the same system image. unit used to service a S/390 machine (processor).
PCICC. (IBM’s) PCI Cryptographic Coprocessor. Small Computer System Interface (SCSI). (1) An
port. (1) An access point for data entry or exit. (2) A ANSI standard for a logical interface to computer
receptacle on a device to which a cable for another peripherals and for a computer peripheral interface.
device is attached. (3) See also duplex receptacle. The interface uses an SCSI logical protocol over an
I/O interface that configures attached targets and
port address. (1) In an ESCON Director, an address
initiators in a multi-drop bus topology. (2) A standard
used to specify port connectivity parameters and to
hardware interface that enables a variety of peripheral
assign link addresses for attached channels and
devices to communicate with one another.
control units. See also link address. (2) In a FICON
director or Fibre Channel switch, it is the middle 8 bits subchannel. A logical function of a channel
of the full 24-bit FC port address. This field is also subsystem associated with the management of a
referred to as the “area field” in the 24-bit FC port single device.
address. See also link address. subsystem. (1) A secondary or subordinate system,
port card. In an ESCON and FICON environment, a or programming support, usually capable of operating
field-replaceable hardware component that provides independently of or asynchronously with a controlling
the optomechanical attachment method for jumper system.
cables and performs specific device-dependent logic SWCH. In ESCON Manager, the mnemonic used to
functions. represent an ESCON Director.
port name. In an ESCON or FICON Director, a switch. In ESCON Manager, synonym for ESCON
user-defined symbolic name of 24 characters or less Director.
that identifies a particular port.
processor complex. A system configuration that T
consists of all the machines required for operation; for trunk cable. In an ESCON and FICON environment, a
example, a processor unit, a processor controller, a cable consisting of multiple fiber pairs that do not
system display, a service support display, and a power directly attach to an active device. This cable usually
and coolant distribution unit. exists between distribution panels (or sometimes
program temporary fix (PTF). A temporary solution between a set processor channels and a distribution
or bypass of a problem diagnosed by IBM in a current panel) and can be located within, or external to, a
unaltered release of a program. building. Contrast with jumper cable.
Z
z/Architecture. An IBM architecture for mainframe
computers and peripherals. Processors that follow this
architecture include the zSeries family of processors.
zSeries. A family of IBM mainframe servers that
support high performance, availability, connectivity,
security and integrity.
277
278 FICON Native Implementation and Reference Guide
Index
OW43132 51, 173
Numerics OW43574 115, 186
2029 142, 144, 145, 146, 160 OW44188 53
2032 52, 57, 64 OW44362 118
definition 180 OW46633 52
2042 49 OW47972 53
2105 5 OW48434 53
24-bit N_Port address 11 OW49278 53
3170 architecture
definition 186 FC-4 3
device 118 FC-FS 3, 9, 17
distance 119 FC-PI 9, 17
feature codes 119 FC-SB-2 2, 9, 17
FICON adapter 118 FC-SW 17
FICON microcode 190 website 20
FICON support 117 z/Architecture 9, 17
logical paths 118 area 28
PSF 118 ASM 50
3590-A60 189 attached node information 230
50 micron 9 attenuation 157
50.0 micron 42 Auxiliary Storage Manager (ASM) 190
62.5 micron 9, 42, 156
9 micron 9, 42
9032 58, 64, 65
B
backplane 72, 93
9032-5 2, 8
bandwidth 42, 43, 142
9672 G5
bandwidth capacity 42
channel problem determination panels 229
benefits 43
concurrent I/O connectivity 43
buffer credits 5, 13, 14, 15, 25, 39, 40, 142, 144
FICON channels 41
buffer-to-buffer credit 25
FICON native attachment 189
bus utilization 54, 227
IOCP 53, 167
9672 G6
channel problem determination panels 229 C
concurrent I/O connectivity 44 cables
FICON attachment 189 multi-mode 9
FICON channels 41 single-mode 9
IOCP 53, 167 cabling 153
standard sizes 166
cabling options 156
A cascade switching 7, 11
A frame 47
cascaded switches 12
Access Methods 49
cascading switches 126
addressability 43
CCW and Data pipelining 36
addressing 45
CCW interlock 39
AFP1 187
CCW pipelining 5, 38, 39, 133, 139
AL 28
Central Memory Module (CMM) 58
Analyse Channel Information panel 229
channel adapter 148
Analyse Device Status panel 229
channel cards 47
Analyse Serial Link Status panel 229
channel constraint 43
Analyze Control Unit Header panel 229
channel device addressing 5, 45
Analyze Paths to a Device panel 229
channel intermix 140
Analyze Subchannel Data panel 229
channel link utilization 225
APAR
channel path 155
IR39712 52
Channel Path Activity report 54
IR42956 52
channel utilization 225
OW34073 185
CHPID numbers 46
OW40040 53
CHPID Report 147, 168
OW43131 51, 173
circuit-switching 5
281
G IOS 50
Geographically Dispersed Parallel Sysplex (GDPS) 146 IPI 19
Gigabit Interface Converter (GBIC) 92 IPL 50
Gigabit Interface Converters (GBIC) 67 ISV software 190
GTF 50 IU header 35
GTF trace 247 IU pacing 5, 14, 39
GTX-Trace viewer 232 IYPIOCP 52, 167
IZPIOCP 53, 167
CHPID macroinstruction
H defining FICON channel 167
Hardware Management Console (HMC) 52, 229 PATH keyword 168
HCD 29, 50 SWITCH keyword 168
HCM SWITCH= keyword 167
conversion utilities 52 TYPE keyword 167, 168
FICON native (FC) support 51 publication 53, 173
software support 50 support for FICON channels 172
HIPPI 19
J
I JES2 50
I/O cage JES3 50
new 45 jumper cable 59
old 45
I/O concurrency 149
I/O connectivity 3 L
I/O frame 47 link address 179
I/O queue time 39 link bandwidth 5
I/O slot 46 ESCON 41
I/O slots 43 FICON 41
I/O supervisor (IOS) 30 link budget (db) loss 156
I/O types 47 link budget loss 157, 158
I/O-Ops 53, 244 link distance 4
ICKDSF 50, 54, 249 link initialization 23
IEBCOPY 50, 54 link loss budget 157
IEWFETCH 50, 54 link pacing 5
IMS 50 link utilization 40, 225
Information Unit 35 LIRR 23, 27
Information Unit (IU) multiplexing 5, 42 logical control unit 10, 14, 16, 126, 128, 133
Inrange logical path 11, 14, 16
40U cabinet 91 logical switch number 168
Audit Log 233 long wavelength 42, 45
control Unit port (CUP) 96 Long wavelength laser 153
documentation 97 long wavelength laser 9, 41
Enterprise Manager 91 longwave laser 62
Event Log 234
FC/9000 180 M
FC/9000-128 91 management server 24
FC/9000-64 91 McDATA
FC/9000-64/128 189 Audit Log 236
high availability configuration 95 control unit port (CUP) 62
IN-VSN Enterprise Manager 97 documentation 73
interlock hand-shaking 5 ED-5000 180, 189
intermixing 140 ED-6064 64, 189
IOCP 29, 50 Enterprise Fabric Connectivity (EFC) Manager 73
9672 G5 167 Event Log 236
9672 G6 167 FC-512 cabinet 57, 64
IYPIOCP 52, 167 feature codes 62, 72
IZPIOCP 53, 167 Hardware Log 236
standalone 9672 G5/G6 53 high-availability configuration 72
zSeries 900 167 Link Incident Log 236
zSeries standalone 52
N
N_Port 13, 20, 24, 25 , 125, 144 R
address 11 RACF 50
FICON port 9 RDS Channel Extender 50
internal 9 read bandwidth 54, 227
login (PLOGI) 9, 15 read-to-write synchronization 211
port-address 21 read-to-write transition synchronization control 247
N_Port Login 26 read-write transition synchronization 190
N_Port login 26 read-write transition synchronization control 54
National Committee for Information Technology Standards receive signal lens 165
(NCITS) 18 receiver 156
NIP 50 receivers 19
NOOP 190 remote site 144
remotes sites 141
repeater 142
O RFI shield 70
OAM 50 RIND 27
OCI adapter 160 RJ-45 twisted pair connector 59
Open Fibre Switch (FCS) 52 RMF 50, 227
Operations Request Block (ORB) 30, 54, 210 bus utilization 54
optical extender 155 Channel Path Activity report 54
optical link 13, 15, 142, 155 FICON Director Activity report 54, 181
ORBM 54, 206, 247 read bandwidth 54
ORBP 54, 206, 247 software support 54
ORBY 54, 206, 247 write bandwidth 54
OSA-2 46, 47 RNID 23
overrun 5, 26 RPQ 47
P S
packet-switching 5 S/A I/O-Ops 53
Parallel Access Volumes (PAV) 5, 133, 136 , 139 safe switching 182
Parallel channel 47 SB-2 21
parallel channel cards 47 SB-2 header 35
parallel channels 46 SBAR assembly 71
comparisons 224 SBCON 20
patch panel 156 SC-duplex connector 156
PAV 39 SCR 23, 27
PCI synchronization 54, 191, 214 SCSI 19
283
self-modifying channel programs 190, 209 vendor-written 49, 191
service parameters 15, 25, 26, 27 ULPs 18
short wavelength 45
Short wavelength laser 153
short wavelength laser 9, 41 V
shortwave laser 62 vendor-written UIM 191
signaling protocol 19 vendor-written UIMs 49
single-mode 13, 62, 144 VM/ESA 54
single-mode fiber 42 VSE/ESA 55
SMF 228
SNMP 77 W
SNMP management station 59, 66 wavelength
source port address identifier (S_ID) 25 short 9
SRM 50 well known port addresses 23
Standalone Dump 190 World Wide Name (WWN) 25
standalone dump 50 Worldwide name (WWN) 230
standalone IOCP write bandwidth 54, 227
zSeries 52
standalone IOCP 9672 G5/G6 53
STI 148 X
STI connection 148 XDF 143
subchannel number 179 XRC 50
subsystem identification word (SID) 30
Support Element (SE) 52
SWCH 181
Z
Z frame 47
switch
z/VM 54
address 170
zoning 62, 72
device number 169
zSeries 45, 226
dynamic switch 168
zSeries 900
entry switch 168
channel problem determination panels 229
logical switch number 168
FICON attachment 189
number 168
FICON channels 41
SWITCH keyword on CHPID macroinstruction 168
IOCP 167
switched fabric 7
switched point-to-point 2, 7, 12
Synchronize Send Status (SSS) 191
sysplex timer 146
System Assist Processor (SAP) 226
System Automation for OS/390 181
System Automation for OS/390 I/O-Ops 53
Systems Automation for OS/390 244
T
tag field 230
tape 152
Task roadmap 1
terminology 7
topology 7
TR/EN 46
transmission media 19
transmission protocol 19
transmission types 9
transmitter 156
transmitters 19
U
UIM 150
CBDUS002 185
CBDUS005 186
Review
Questions about IBM’s privacy The following link explains how we protect your personal information.
policy? ibm.com/privacy/yourprivacy/
FICON Native
Implementation and
Reference Guide
Architecture, This IBM Redbook covers the planning and implementation of
FICON channels, operating in FICON native (FC) mode for the IBM
INTERNATIONAL
terminology, and
zSeries 900 and 9672 Generation 5 (G5) and Generation 6 (G6) TECHNICAL
topology concepts
processors. It discusses the FICON and Fibre Channel SUPPORT
Planning, architectures, terminology, and supported topologies. ORGANIZATION
implementation, and This book provides information about the available FICON native
products, system and I/O device setup, availability and recovery
migration guidance
considerations, and migration recommendations. It focuses on
installing the new FICON Directors and FICON native control units
Realistic examples BUILDING TECHNICAL
in both a new and existing ESCON and FICON channel environment. INFORMATION BASED ON
and scenarios Helpful information for monitoring and managing a FICON native PRACTICAL EXPERIENCE
(FC) environment is also included.
In this document you will find examples of the z/OS and OS/390 IBM Redbooks are developed
definitions required to support FICON native control units and by the IBM International
FICON Directors, as well as migration scenarios for control units Technical Support
using ESCON (CNC) channels or FICON Bridge (FCV) mode channels Organization. Experts from
IBM, Customers and Partners
to FICON native (FC) mode channels. from around the world create
This redbook is intended for system programmers, hardware timely technical information
planners, and system engineers who will plan and install FICON based on realistic scenarios.
native (FC) products in a zSeries 900 and 9672 Generation 5 (G5) Specific recommendations
and Generation 6 (G6) environment. A good background in systems are provided to help you
implement IT solutions more
planning, hardware and cabling infrastructure planning, and I/O effectively in your
definitions (HCD or IOCP) is assumed. environment.