Creating LPARs Using NPIV - SAN Boot LUN Instead of Local Boot LUN
Creating LPARs Using NPIV - SAN Boot LUN Instead of Local Boot LUN
Follow ITI_TIP_18099 V02 Technical Installation Plan for IBM Power Platform Virtual IO Server - Print
Screens, but instead of creating Virtual SCSI adapter, create Fibre Channel Adapter.
Make sure the fcs adapters you allocate are on different SAN fabrics, so the LUN’s are presented from
different SAN switches.
US2US00078 (VIO 1)
10000000c9e3d3ba fcs0 Fabric - A
10000000c9e3d3bb fcs1 Fabric - A
10000000c9e3d7ee fcs2 Fabric - B
10000000c9e3d7ef fcs3 Fabric - B
US2US00079 (VIO 2)
10000000c9e3d1c6 fcs0 Fabric - A
10000000c9e3d1c7 fcs1 Fabric - A
10000000c9e39ec6 fcs2 Fabric - B
10000000c9e39ec7 fcs3 Fabric - B
VIO server 1 – US2US00078
# lscfg -vl fcs0 | grep Network
Network Address.............10000000C9E3D3BA
# lscfg -vl fcs1 | grep Network
Network Address.............10000000C9E3D3BB
# lscfg -vl fcs2 | grep Network
Network Address.............10000000C9E3D7EE
# lscfg -vl fcs3 | grep Network
Network Address.............10000000C9E3D7EF
#
SAN Boot
us2us00078 & us2us00079 LUNs fcs0 fcs2 vfchost0 101 201 us2us00081 c0507604a9180020 c0507604a9180024
SAN Boot
us2us00078 & us2us00079 LUNs fcs1 fcs3 vfchost1 102 202 us2us00081 c0507604a9180022 c0507604a9180026
SAN Boot
us2us00078 & us2us00079 LUNs fcs0 fcs2 vfchost2 103 203 us2us00082 c0507604a9180028 c0507604a918002c
SAN Boot
us2us00078 & us2us00079 LUNs fcs1 fcs3 vfchost3 104 204 us2us00082 c0507604a918002a c0507604a918002e
SAN Boot
us2us00078 & us2us00079 LUNs fcs0 fcs2 vfchost4 105 205 us2us00083 c0507604a9180030 c0507604a9180034
SAN Boot
us2us00078 & us2us00079 LUNs fcs1 fcs3 vfchost5 106 206 us2us00083 c0507604a9180032 c0507604a9180036
SAN Boot
us2us00078 & us2us00079 LUNs fcs0 fcs2 vfchost6 107 207 us2us00084 c0507604a918003a c0507604a918003e
SAN Boot
us2us00078 & us2us00079 LUNs fcs1 fcs3 vfchost7 108 208 us2us00084 c0507604a918003c c0507604a9180038
SAN Boot
us2us00078 & us2us00079 LUNs fcs0 fcs2 vfchost8 109 209 us2us00085 c0507604a9180044 c0507604a9180040
SAN Boot
us2us00078 & us2us00079 LUNs fcs1 fcs3 vfchost9 110 210 us2us00085 c0507604a9180046 c0507604a9180042
6. To check WWNPs for each Client Fibre Channel that has been assigned on each LPARs
If you add them using **, you will have 2 different sets of WWNs – at Profiles and at the LPAR itself (using
command lscfg –vl fcsX | grep –i “Network Address”).
$ lsnports
name physloc fabric tports aports swwpns awwpns
fcs0 U5802.001.RCH9095-P1-C2-T1 1 64 64 2048 2047
fcs1 U5802.001.RCH9095-P1-C2-T2 1 64 64 2048 2047
fcs2 U5802.001.RCH6631-P1-C6-T1 1 64 64 2048 2047
fcs3 U5802.001.RCH6631-P1-C6-T2 1 64 64 2048 2047
$
$ cfgdev
Status:NOT_LOGGED_IN
FC name: FC loc code:
Ports logged in:0
Flags:1<NOT_MAPPED,NOT_CONNECTED>
VFC client name: VFC client DRC:
Status:NOT_LOGGED_IN
FC name:fcs0 FC loc code:U5802.001.RCH9095-P1-C1-T1
Ports logged in:0
Flags:4<NOT_LOGGED>
VFC client name: VFC client DRC:
$
Sample commands used for this build.
On US2US00078;
Then on Client;
o Applicable for OTHER than SAN Boot LUN – e.g. DB Volume Groups
o If for SAN Boot LUsN, we are unable to run these commands since the LPARs are not
being built yet
Update Spreadsheet with new virtual fibre WWPN’s
# cfgmgr
!! Please take note that each SAN Boot LUN is to be zoned down ONE path initially. After the install of
the servers are complete, inform the Storage team to zone down all the LUNs with the rest of the
PATHs.
If the Storage team is unable to see the ports and the LPARs, do the following on each LPARs:
SMS menu Select [5] Select Boot Options Select [1] Select Install/Boot Device Select [7]
List all devices > It will scan and list all the devices available
Then check with the Storage Team
IMPORTANT!!
While the Storage Team is raising their CC and then implementing their CR, please make sure the
port is always open
Whenever you need to leave, choose DISCONNECT instead of Logoff as it will preserve your
sessions and the port can be leave opened.
8. Start OS installation using NIM - follow ITI_TIP_15751 - Technical Installation Plan for the IBM AIX
Operating System (NIM) - Print Screens
You should see the same SMS menu when you open the adapter, press Esc button to get to the
first SMS menu
If you are unable to see the SMS menu again, go back to your LPAR Open Terminal Window
Click at Advanced, choose SMS mode
Once you have set all the IP parameters and the set up at the NIM server, exit SMS menu, you
should see up to this screen as shown below;
Choose [1], and press Enter
Ask the storage team to present the SAN Boot LUNs down to the rest of the paths (WWNs).
!! Please take note that each SAN Boot LUN is to be zoned down ONE path initially. After the
install of the servers are complete, inform the Storage team to zone down all the LUNs with
the rest of the PATHs.
10. After the LPARs have been build, then install PowerPath.
First Build LPAR on single fibre PATH, after build bootlist should show one disk, for example:
# bootlist -m normal -o
hdisk1 blv=hd5
After the storage team has group the paths (Step 9), proceed with the PowerPath installation.
# uname -a
AIX us2us00081 1 6 00F6F8E04C00
# mount bresxuxc001p09:/export/unix_sw /unix_sw
#
# cd /unix_sw
# ls
AIX firmware openssh-5.5p1-bff.tar.gz Siebel
backup lost+found openssl.0.9.8.1103.tar.Z
# cd AIX/Apps/EMC_Powerpath/5500_P03
# ls -lrt
total 135072
-rwxr--r-- 1 root system 26668 12 Apr 2011 emc_reserve_v2.sh
-rw-r--r-- 1 root system 1733 03 May 2011 emc_reserve_v2_README
-rw-r--r-- 1 root system 69120000 24 Oct 08:37 EMCpower_install
drwxr-xr-x 4 root system 256 21 Jan 08:07 AIX_ODM
-rw-r--r-- 1 root system 928 21 Jan 08:11 .toc
#
# cd /unix_sw/AIX/Apps/EMC_Powerpath/5500_P03; installp -a -Y -d '.' EMCpower
Selected Filesets
-----------------
EMCpower.base 5.5.0.3 # PowerPath Base Driver and Ut...
EMCpower.encryption 5.5.0.3 # PowerPath Encryption with RSA
EMCpower.migration_enabler 5.5.0.3 # PowerPath Migration Enabler ...
EMCpower.mpx 5.5.0.3 # PowerPath Multi_Pathing Exte...
+-----------------------------------------------------------------------------+
Summaries:
+-----------------------------------------------------------------------------+
Installation Summary
--------------------
Name Level Part Event Result
-------------------------------------------------------------------------------
EMCpower.base 5.5.0.3 USR APPLY SUCCESS
EMCpower.mpx 5.5.0.3 USR APPLY SUCCESS
EMCpower.migration_enabler 5.5.0.3 USR APPLY SUCCESS
EMCpower.encryption 5.5.0.3 USR APPLY SUCCESS
#
Selected Filesets
-----------------
EMC.Symmetrix.aix.rte 5.3.0.5 # EMC Symmetrix AIX Support So...
EMC.Symmetrix.fcp.rte 5.3.0.5 # EMC Symmetrix FCP Support So...
+-----------------------------------------------------------------------------+
BUILDDATE Verification ...
+-----------------------------------------------------------------------------+
Verifying build dates...done
FILESET STATISTICS
------------------
2 Selected to be installed, of which:
2 Passed pre-installation verification
----
2 Total to be installed
+-----------------------------------------------------------------------------+
Summaries:
+-----------------------------------------------------------------------------+
Installation Summary
--------------------
Name Level Part Event Result
-------------------------------------------------------------------------------
EMC.Symmetrix.aix.rte 5.3.0.5 USR APPLY SUCCESS
EMC.Symmetrix.fcp.rte 5.3.0.5 USR APPLY SUCCESS
EMC.Symmetrix.aix.rte 5.3.0.5 ROOT APPLY SUCCESS
EMC.Symmetrix.fcp.rte 5.3.0.5 ROOT APPLY SUCCESS
#
# emcpreg -install
# powermt check_registration
Key BIPZ-HB43-WFMV-QCC4-M49O-JKQT
Product: PowerPath
Capabilities: All
#
# shutdown -r now
# pprootdev on
# bootlist -m normal -o
hdisk1
hdisk3 blv=hd5
hdisk5
hdisk7
#
# pprootdev fix
# pprootdev fix
Do the following:
Add the script below and do another round of reboot.
(The script includes /usr/sbin/pprootdev fix, so you do not need to run it manually)
--------------------------------------
#!/bin/sh
#
# After a system boots from a PowerPath device, the bosboot tool
# cannot function correctly. This is because of the state of the
# configuration after booting from a PowerPath device and the fact that
# bosboot expects the boot device to be an hdisk, not an hdiskpower
# device.
#
# The pprootdev fix command corrects the configuration to allow bosboot to work. Run
# pprootdev fix before undertaking any administrative task that runs
# bosboot. This corrects the configuration for bosboot but does not
# change the PowerPath boot switch. The next system boot still uses
# PowerPath. Run pprootdev fix only once after a system restarts that
# uses PowerPath. bosboot then functions correctly until the system
# restarts again.
#
# Note: Always use the command bosboot -ad /dev/ipldevice to create a boot
# image from the current boot kernel disk.
#
/usr/sbin/pprootdev fix
----------------------------------------
Reboot Server
# shutdown -r now
The test:
# bootlist -m normal -o
hdisk1 blv=hd5
hdisk3 blv=hd5
hdisk5 blv=hd5
hdisk7 blv=hd5
Selected Filesets
-----------------
aex-nsclt 6.2.1378.0 # Altiris Agent for UNIX and L...
+-----------------------------------------------------------------------------+
BUILDDATE Verification ...
+-----------------------------------------------------------------------------+
Verifying build dates...done
FILESET STATISTICS
------------------
1 Selected to be installed, of which:
1 Passed pre-installation verification
----
1 Total to be installed
+-----------------------------------------------------------------------------+
Summaries:
+-----------------------------------------------------------------------------+
Installation Summary
--------------------
Name Level Part Event Result
-------------------------------------------------------------------------------
aex-nsclt 6.2.1378.0 USR APPLY SUCCESS
aex-nsclt 6.2.1378.0 ROOT APPLY SUCCESS
#
(E) Post Tasks
E.2 - Submit separate SSM request for Patrol configuration on each LPARs
Sample SSM Request ID: 8313997