3wareSerialATAcontroller UserGuide
3wareSerialATAcontroller UserGuide
PN 720-0146-00
October 2006
Trademarks
3ware®, Escalade®, 3DM®, and TwinStor® are all registered trademarks of
AMCC. The 3ware logo, 3BM, StorSwitch, and R5 Fusion are all trademarks
of AMCC. PowerPC and the PowerPC logo are trademarks of International
Business Machines Corporation. Linux® is a registered trademark of Linus
Torvalds in the United States, other countries, or both. Windows® is a
registered trademark of Microsoft Corporation in the United States and other
countries. Firefox® is a registered trademark of the Mozilla Foundation. PCI
Express® is a registered trademark of PCI-SIG®. All other trademarks herein
are property of their respective owners.
Disclaimer
While every attempt is made to make this document as accurate as possible,
AMCC assumes no responsibility for errors or omissions in this document,
nor does AMCC make any commitment to update the information contained
herein.
www.3ware.com ii
www.3ware.com iii
www.3ware.com v
www.3ware.com vii
Conventions
The following conventions are used through this guide:
• 3BM and 3BM 2 both refer to the 3ware BIOS Manager, version 2.
• 3DM and 3DM 2 both refer to the 3ware Disk Manager, version 2.
• In the sections that describe using 3DM, current controller is used to refer
to the controller which is currently selected in this drop-down list.
• Unit refers to one or more disks configured through 3ware to be treated by
the operating system as a single drive. Also known as an array. Array and
unit are used interchangeably throughout this manual.
• Boldface is used for buttons, fields, and settings that appear on the screen.
• Monospace font is used for code and to indicate things you type.
Screenshots
The screenshots in this documentation are examples only, and may not exactly
reflect the operating system and browser you are using. 3ware software works
on a number of different operating systems, including Mac OS X, Microsoft
Windows®, Linux®, and FreeBSD®, and runs in a number of different
browsers. In addition, the version shown in screenshots may not match your
version. For the current released and tested version number, see the latest
release notes.
www.3ware.com ix
www.3ware.com 1
System Requirements
3ware 9650SE, 959SE, and 9550SX model RAID controllers have the
following requirements:
Notes:
3ware 9650SE and 9590SE RAID controllers must be installed in a PCI Express
slot that complies with PCI 1.0 or later standards.
The 3ware 9550SX Controller performs best when installed in a PCI-X 133MHz 64-
bit slot. However, it can also operate at 66MHz or 100MHz.
PCI Slots used for the 9550SX controllers must comply with PCI 2.2 or later
standards and must meet the Plug and Play and PC99 specifications.
Drive Requirements
Depending on the particular model, the 3ware RAID controller may be
connected to two, four, eight, twelve, or sixteen SATA drives using the
supplied interface cables.
Drives must meet SATA-1 (1.5 GB/s) or SATA-2 (3.0 Gb/s) standards.
A list of drives that have been tested is available at
http://www.3ware.com/products/compatibility_sata2.asp
Drives may be of any capacity or physical form factor.
The length of shielded and unshielded interface cables may not exceed 1M
(39”) for Serial ATA controllers.
Operating System
• 3ware RAID controllers may be used with:
• Windows 2000, Windows XP, Windows Server 2003, both 32-bit and 64-
bit x86
• Red Hat Linux, 32-bit and 64-bit x86
• SuSE Linux, 32-bit and 64-bit x86
• Fedora Core, 32-bit and 64-bit x86
• Other versions of Linux, 32-bit and 64-bit x86, using the open source
Linux 2.4 or 2.6 kernel driver
• FreeBSD, 32-bit and 64-bit x86
For the latest driver versions for all operating systems, see the Release Notes.
Other Requirements
• Adequate air flow and cooling
• Adequate power supply for drives
• 3DM 2 (3ware Disk Manager) displays information in a browser. It
requires one of the following browsers:
• Internet Explorer 5.5 and later
• Mozilla Firefox 1.2 and later
• Netscape 7 and later
In addition:
• JavaScript must be enabled
• Cookies must be enabled
• For best viewing, screen resolution should be 1024 x 768 or greater,
with 16-bit color or greater.
For a complete listing of features and system requirements, refer to the 3ware
SATA RAID Controller datasheets, available from the website at http://
www.3ware.com/products.
www.3ware.com 3
RAID Concepts
The following concepts are important to understand when working with a
RAID controller:
• Arrays and Units. In the storage industry, the term “array” is used to
describe two or more disk drives that appear to the operating system as a
single unit. When working with a 3ware RAID controller, “unit” is the
term used to refer to an array of disks that is configured and managed
through the 3ware software. Single-disk units can also be configured in
the 3ware software.
• Mirroring. Mirrored arrays (RAID 1) write data to paired drives
simultaneously. If one drive fails, the data is preserved on the paired
drive. Mirroring provides data protection through redundancy. In
addition, mirroring using a 3ware RAID controller provides improved
performance because 3ware’s TwinStor technology reads from both
drives simultaneously.
• Striping. Striping across disks allows data to be written and accessed on
more than one drive, at the same time. Striping combines each drive’s
capacity into one large volume. Striped disk arrays (RAID 0) achieve
highest transfer rates and performance at the expense of fault tolerance.
• Distributed Parity. Parity works in combination with striping on RAID 5,
RAID 6, and RAID 50. Parity information is written to each of the striped
drives, in rotation. Should a failure occur, the data on the failed drive can
be reconstructed from the data on the other drives.
• Hot Swap. The process of exchanging a drive without having to shut
down the system. This is useful when you need to exchange a defective
drive in a redundant array.
• Array Roaming. The process of removing a unit from a controller and
putting it back later, either on the same controller, or a different one, and
having it recognized as a unit. The disks may be attached to different ports
than they were originally attached to, without harm to the data.
For definitions of other terms used throughout the documentation, see the
“Glossary”.
RAID 0
RAID 0 provides improved performance, but no fault tolerance. Since the
data is striped across more than one disk, RAID 0 disk arrays achieve high
transfer rates because they can read and write data on more than one drive
simultaneously. The stripe size is configurable during unit creation. RAID 0
requires a minimum of two drives.
When drives are configured in a striped disk array (see Figure 2), large files
are distributed across the multiple disks using RAID 0 techniques.
Striped disk arrays give exceptional performance, particularly for data
intensive applications such as video editing, computer-aided design and
geographical information systems.
RAID 0 arrays are not fault tolerant. The loss of any drive results in the loss of
all the data in that array, and can even cause a system hang, depending on
your operating system. RAID 0 arrays are not recommended for high
availability systems unless additional precautions are taken to prevent system
hangs and data loss.
Figure 2. RAID 0 Configuration Example
RAID 1
RAID 1 provides fault tolerance and a speed advantage over non-RAID disks.
RAID 1 is also known as a mirrored array. Mirroring is done on pairs of
drives. Mirrored disk arrays write the same data to two different drives using
RAID 1 algorithms (see Figure 3). This gives your system fault tolerance by
preserving the data on one drive if the other drive fails. Fault tolerance is a
basic requirement for critical systems like web and database servers.
www.3ware.com 5
RAID 5
RAID 5 provides performance, fault tolerance, high capacity, and storage
efficiency. It requires a minimum of three drives and combines striping data
with parity (exclusive OR) to restore data in case of a drive failure.
Performance and efficiency increase as the number of drives in a unit
increases.
Parity information is distributed across all of the drives in a unit rather than
being concentrated on a single disk (see Figure 4). This avoids throughput
loss due to contention for the parity drive.
RAID 5 is able to tolerate 1 drive failure in the unit.
Figure 4. RAID 5 Configuration Example
RAID 6
RAID 6 requires a 3ware 9650SE RAID controller.
RAID 6 provides greater redundancy and fault tolerance than RAID 5. It is
similar to RAID 5, but has two blocks of parity information (P+Q) distributed
across all the drives of a unit, instead of the single block of RAID 5.
Due to the two parities, a RAID 6 unit can tolerate two hard drives failing
simultaneously. This also means that a RAID 6 unit may be in two different
states at the same time. For example, one sub-unit can be degraded, while
another may be rebuilding, or one sub-unit may be initializing, while another
is verifying.
RAID 6 requires a minimum of five drives. Performance and storage
efficiency also increase as the number of drives increase.
RAID 10
RAID 10 is a combination of striped and mirrored arrays for fault tolerance
and high performance.
When drives are configured as a striped mirrored array, the disks are
configured using both RAID 0 and RAID 1 techniques, thus the name RAID
10 (see Figure 6). A minimum of four drives are required to use this
technique. The first two drives are mirrored as a fault tolerant array using
RAID 1. The third and fourth drives are mirrored as a second fault tolerant
array using RAID 1. The two mirrored arrays are then grouped as a striped
www.3ware.com 7
RAID 0 array using a two tier structure. Higher data transfer rates are
achieved by leveraging TwinStor and striping the arrays.
In addition, RAID 10 arrays offer a higher degree of fault tolerance than
RAID 1 and RAID 5, since the array can sustain multiple drive failures
without data loss. For example, in a twelve-drive RAID 10 array, up to six
drives can fail (half of each mirrored pair) and the array will continue to
function. Please note that if both halves of a mirrored pair in the RAID 10
array fail, then all of the data will be lost.
RAID 50
RAID 50 is a combination of RAID 5 with RAID 0. This array type provides
fault tolerance and high performance. RAID 50 requires a minimum of six
drives.
Several combinations are available with RAID 50. For example, on a 12-port
controller, you can have a grouping of 3, 4, or 6 drives. A grouping of 3 means
that the RAID 5 arrays used have 3 disks each; four of these 3-drive RAID 5
arrays are striped together to form the 12-drive RAID 50 array. On a 16-port
controller, you can have a grouping of 4 or 8 drives.
In addition, RAID 50 arrays offer a higher degree of fault tolerance than
RAID 1 and RAID 5, since the array can sustain multiple drive failures
without data loss. For example, in a twelve-drive RAID 50 array, up to one
drive in each RAID 5 set can fail and the array will continue to function.
Please note that if two or more drives in a RAID 5 set fail, then all of the data
will be lost.
Single Disk
A single drive can be configured as a unit through 3ware software. (3BM,
3DM 2, or CLI). Like disks in other RAID configurations, single disks
contain 3ware Disk Control Block (DCB) information and are seen by the OS
as available units.
Single drives are not fault tolerant and therefore not recommended for high
availability systems unless additional precautions are taken to prevent system
hangs and data loss.
JBOD
A JBOD (acronym for “Just a Bunch of Disks”) is an unconfigured disk
attached to your 3ware RAID controller. JBOD configuration is no longer
supported in the 3ware 9000 series. AMCC recommends that you use Single
Disk as a replacement for JBOD, to take advantage of advanced features such
as caching, OCE, and RLM.
JBOD units are not fault tolerant and therefore not recommended for high
availability systems unless additional precautions are taken to prevent system
hangs and data loss.
Hot Spare
A hot spare is a single drive, available online, so that a redundant unit can be
automatically rebuilt in case of drive failure.
www.3ware.com 9
RAID 1 Provides fault tolerance and a read speed advantage over non-
RAID disks.
RAID 5 This type of unit provides performance, fault tolerance, and high
storage efficiency. RAID 5 units can tolerate one drive failing
before losing data.
RAID 6 Provides very high fault tolerance with the ability to protect
against two consecutive drive failures. Performance and
efficiency increase with higher numbers of drives.
You can create one or more units, depending on the number of drives you
have installed.
2 RAID 0 or RAID 1
3 RAID 0
RAID 1 with hot spare
RAID 5
5 RAID 6
RAID 5 with hot spare
RAID 10 with hot spare
Combination of RAID 0, RAID 1, hot spare, single disk
6 or more RAID 6
RAID 6 with hot spare
RAID 50
Combination of RAID 0, 1, 5, 6,10, hot spare, single disk
Through drive coercion, the capacity used for each drive is rounded down so
that drives from differing manufacturers are more likely to be able to be used
www.3ware.com 11
as spares for each other. The capacity used for each drive is rounded down to
the nearest GB for drives under 45 GB (45,000,000,000 bytes), and rounded
down to the nearest 5 GB for drives over 45 GB. For example, a 44.3 GB
drive will be rounded down to 44 GB, and a 123 GB drive will be rounded
down to 120 GB. For more information, see the discussion of drive coercion
under “Creating a Hot Spare” on page 108.
www.3ware.com 13
When the I2C port on the controller has been connected to a chassis with a
Chassis Control Unit (CCU), you can issue drive locate commands that
blink the LEDs for particular drives, so that you can quickly identify what
drive needs to be checked or replaced. (For more information, see
“Locating a Drive by Blinking Its LED” on page 166.)
• Auto Rebuild. For times when you do not have a spare available, setting
the Auto Rebuild policy allows rebuilds to occur with an available drive
or with a failed drive. (For more information, see “Setting the Auto
Rebuild Policy” on page 90.)
www.3ware.com 15
www.3ware.com 17
Controller-Level Settings
Unit-Level Settings
www.3ware.com 19
If you will install the operating system on and boot from a unit managed
through the new 3ware RAID controller, follow the steps in this chapter to use
the 3ware BIOS Manager (3BM) to configure the unit and install the driver.
If the operating system is already installed on another drive in your system,
you can use the steps below or you can configure units through 3DM or the
CLI.
You can create one or more units on a single controller, depending on the
number of drives that the specific 3ware RAID controller supports and the
number of drives attached. (For more information, see “Determining What
RAID Level to Use” on page 10.)
Note: If the capacity of the unit you create will exceed 2TB and you are using
Windows 2000, Windows XP, Linux 2.4, or FreeBSD 4.x, you will need to enable
auto-carving. Before creating your unit, follow the instructions under “Using Auto-
Carving for Multi LUN Support” on page 91.
To launch 3BM
Exportable Units:
3drive 64K RAID5 558.77GB (PrimaryRAID5)
Port0 Maxtor 7B300S0 279.48 GB
Port1 Maxtor 7B300S0 279.48 GB
Port2 Maxtor 7B300S0 279.48 GB
3 If you have more than one 9000-series controller in your system, a screen
lists the available boards. (See Figure 9.) In this case, highlight the board
with which you want to work and press Enter.
You see a screen similar to Figure 10, warning you that changing your
disk array configuration may overwrite data on the disks.
www.3ware.com 21
2 After all drives for the unit are selected, use the Tab to move to the
Create Unit button and press Enter.
The Create Disk Array screen appears (see Figure 12).
1 (Optional) Press Enter in the Array Name field and type a name for the
unit. Then press Enter again to accept the name.
2 Use the arrow keys or press Tab to move to the RAID Configuration
field and press Enter to display the available RAID levels for the number
of drives you selected.
3 Use the arrow keys to highlight the desired RAID configuration and
press Enter.
For information about the different RAID levels and when to use each,
see “Understanding RAID Concepts and Levels” on page 3.
4 Use the arrow keys or press Tab to move to the field Stripe Size and
select the desired stripe size (16KB, 64KB, or 256KB).
Notes:
Striping size is not applicable for RAID 1, because it is a mirrored unit
without striping.
For RAID 6, only stripe size of 64KB is supported.
In general, use smaller stripe sizes for sequential access (such as video
access) and larger stripe sizes for random access (such as a database).
www.3ware.com 23
1 Use the arrow keys or press Tab to move to the field you want to change.
2 Press Enter to see the available options.
3 Use the arrow keys to select the option you want and press Enter to
choose it.
For details about these parameters, see:
• “Enabling and Disabling the Unit Write Cache” on page 113
• “Enabling and Disabling Queuing for a Unit” on page 116
• “Setting the StorSave Profile for a Unit” on page 117
• “Setting Continue on Source Error During Rebuild” on page 115
Note: Setting a Boot Volume Size is optional. In addition, if you specify a boot
volume, you do not have to install your operating system onto it. For more
information about creating a boot volume, see “Boot volume size” on page 99. If the
size your array is 2TB or greater, you may also want to review the information about
carving the unit into multiple volumes. For details, see “Using Auto-Carving for Multi
LUN Support” on page 91.
1 Use the arrow keys or press Tab to move to the Boot Volume Size field.
3 Enter the size in Gigabytes that should be assigned to the boot volume.
1 Press Tab to select the OK button and press Enter to confirm creation of
the unit.
Or, if you want to cancel the creation of the unit, tab to Cancel and press
Enter.
2 If you leave the Unit Write Cache field enabled and do not have a BBU
installed, 3BM will ask you to confirm that you want enable write cache.
The unit is not actually created and no data is overwritten until you have
finished making all your changes and press F8.
3 If the volume summary screen appears, review the information and press
any key to continue.
Multiple volumes will be created if you entered a Boot Volume Size of
greater than zero (0), or if auto-carving is enabled and the combined size
of the drives in your unit is large enough to divide it into multiple
volumes. For more information about auto-carving, see “Using Auto-
Carving for Multi LUN Support” on page 91.
www.3ware.com 25
2 If you configured more than one unit, and you plan to install the operating
system on one of them, make that unit be the first unit (Unit 0) in the list
of Exportable Units.
To move a unit up in the list, highlight it and press the Page Up key.
You will also want to make sure that the controller is the boot device for
your computer. After finalizing the configuration below, be sure to follow
the steps under “Checking the Motherboard Boot Sequence” on page 29.
3 When you are finished configuring units, press F8 to save the changes
and exit 3BM.
A warning message asks you to confirm that all existing data on the drives
will be deleted.
4 Type Y to continue, delete any existing data on the drives, and create the
unit.
Depending on the RAID configuration you are creating, initialization of
the unit may begin immediately. (RAID 6 units and some RAID 5 and
RAID 50 units begin immediate initialization.) The initialization process
can take several hours, depending on the size of your drives.
6 If you are finished creating RAID units, be sure to check the boot
sequence for your system, as described under “Checking the Motherboard
Boot Sequence” on page 29.
www.3ware.com 27
2 Type s to specify that the selected drive will be the hot spare.
You’ll see the words “Hot Spare” appear next to the drive in the Available
Drives list.
If a hot spare is already enabled, you can disable it by following the same
process.
Note: In order to replace a failed drive in a degraded unit, a hot spare drive
must have the same or larger storage capacity than the failed drive.
What Next?
The final steps in setting up your RAID units are to load the 3ware driver and
make the units available to your operating system. For details, turn to
Chapter 4, “Driver Installation.”
After installing the driver, you may also want to install 3ware’s browser-based
Disk Management tool, 3DM 2, or the 3ware Command Line Interface (CLI).
With 3DM 2 and CLI, you can maintain your RAID units while running
Windows. For more information, see Chapter 6, “3DM 2 (3ware Disk
Manager) Introduction” and the 3ware Serial ATA RAID Controller CLI
Guide.
www.3ware.com 29
This chapter provides details about how to install the driver for your 3ware
RAID controller and make the units available to your operating system.
• If the unit you have created will be your system's boot device, you install
the driver for the controller as you install the operating system.
• If the operating system is already installed on a unit connected to another
controller or to the motherboard, you start the operating system and then
install the driver.
Details for both situations are described in this chapter. Driver information is
organized by operating system:
• “Driver Installation Under Windows” on page 31
• “Driver Installation Under Linux” on page 39
• “Driver Installation Under FreeBSD” on page 50
Note: If you are working with a system that already has a 3ware RAID controller
installed, and want to update the driver or firmware for your 3ware RAID controller
to a newer version, see the information in “Updating the Driver and Firmware” on
page 181.
The 3ware RAID controller can be used with Microsoft Windows 2000 (SP3
or newer), Windows XP (SP1 or newer), and Windows Server 2003. Windows
2003 64-bit for AMD Opteron or Intel EM64T is also supported. It is
recommended that you upgrade to the latest service pack available.
A drive or unit managed by the 3ware RAID controller may be configured to
be your system’s boot device. Or, you can use units managed by the 3ware
controller for secondary storage and boot from another device, such as a disk
attached to the motherboard, or other bootable media.
This section contains instructions for how to:
• Create a driver diskette for the 3ware RAID controller
• Install the 3ware driver and Windows on a new drive or unit.
• Install the 3ware driver when Windows is already installed on a different
device.
Note: You must have administrator privileges for your system to install the
Windows operating system and the 3ware driver.
Materials Required
• 3ware software CD-ROM
• Microsoft Windows 2000, XP, or Server 2003 installation CD-ROM. (Not
required if Windows is already installed on another drive.).
• Floppy diskette, to create a driver diskette.
If you are installing Windows onto the RAID unit you are creating, you
must create a 3ware driver diskette. If Windows is already installed on
another device, you may install the 3ware driver from either the 3ware
software CD-ROM or from a diskette.
www.3ware.com 31
2 When the 3ware Menu appears, click Driver and Firmware Disks.
3 In the 3ware Driver & Firmware Images menu, click the appropriate
button to create the driver diskette that you need.
Note that there are both 32-bit and 64-bit AMD drivers available for
Windows. Be sure to select the correct one.
4 When the confirm message appears, insert a blank diskette into a floppy
drive and click the Yes button to begin the process.
1 Boot from the Windows 2000, Windows XP, or Windows Server 2003 CD
and press F6 when you see the message: “Press F6 if you need to install a
3rd party SCSI or RAID driver” at the bottom of the display.
2 When you see the message: “Setup could not determine the type of one or
more mass storage devices or you have chosen to manually specify an
adapter…”
Type S to specify that you have an additional 3ware RAID controller.
3 Insert the 3ware driver diskette and press Enter.
4 When a box with AMCC 3ware Series ATA RAID Controller appears,
press Enter to select it.
5 Type S if you have additional devices to add. Otherwise, press Enter.
7 Continue with the normal Windows installation at this point. There are no
instructions after installing the driver that are specific to 3ware. If you
need additional instructions, refer to the Windows 2000, Windows XP, or
Windows Server 2003 documentation supplied by Microsoft.
www.3ware.com 33
1 Click the Next button and respond to the questions the Wizard displays
using the default selections.
2 When the Wizard prompts you to select a device driver, click Have Disk,
and then indicate that it is on the CD or floppy.
4 When the Completing the Found New Hardware Wizard screen appears
(Figure 19), click Finish.
5 If the “Completing” screen (Figure 19) indicates that you should restart
your computer, do so now.
6 When the Install Hardware Device Drivers screen appears (Figure 20),
click Next and follow the prompts on the screen to install the second
driver.
7 When the second Completing the Found New Hardware screen appears,
click Finish.
After the driver has been installed, continue with the instructions under
“Making Units Managed by a 3ware Controller Available to Windows”
on page 38.
www.3ware.com 35
1 Click the Next button and respond to the questions the Wizard displays.
2 When the Wizard prompts you to select a device driver, click Have Disk,
and then indicate that it is on the CD or floppy.
4 When the Completing the Found New Hardware Wizard screen appears
(Figure 23), click Finish.
5 If the “Completing” screen similar to the one above indicates that you
should restart your computer, do so now.
6 When the Welcome to the Found New Hardware Wizard screen appears
again (Figure 24), click Next and follow the prompts on the screen to
install the second driver.
7 When the second Completing the Found New Hardware screen appears,
click Finish.
After the driver has been installed, continue with the instructions below under
“Making Units Managed by a 3ware Controller Available to Windows” on
page 38.
www.3ware.com 37
1 Remove the driver diskette or CD, reboot the system, and log in as the
system administrator.
2 Use Disk Administrator to partition and format the new units or disks:
From the Start menu, choose Administrative Tools > Computer
Management.
In the Computer Management window, under Storage, select Disk
Management.
3 Follow the steps that appear on the screen to write a signature to the drive.
5 Follow the steps the appear on-screen to create a volume and to assign a
drive letter.
www.3ware.com 39
Warning: Be sure to use the correct driver for your processor. It is possible to load
the wrong driver onto a system, however when you boot such systems, they will not
work.
For Red Hat and SuSE, AMCC offers the following drivers:
• x86 32-bit for Intel x86 and AMD Athlon
• AMD x86 64-bit, used for both AMD Opteron and Intel 64-bit Xeon (EM64T)
where the asterisk (*) represents SCSI host ID and 9xxx represents the
family of the controller. For example:
cat /proc/scsi/3w-9xxx/0
If you have a 2.6 kernel with sysfs, type the following command:
cat /sys/class/scsi_host/<hostid>/stats
where <hostid> is usually host0, unless other SCSI devices are available,
in which case it may be host1 or higher.
If you have a 2.6 kernel without sysfs, type the following command:
dmesg | grep 3w
Materials required
• 3ware software CD-ROM
• Floppy diskette, if you need to create a driver install diskette.
• Red Hat Linux installation CD-ROM. (Not required if Red Hat Linux is
already installed on another drive.)
www.3ware.com 41
3 In the 3ware Driver & Firmware Disk Images menu, click the button for
the driver disk you want to create.
A confirmation window opens.
4 Insert a blank diskette into a drive and click the Yes button to begin
creating the driver floppy diskette.
Note: If you need to create a Linux driver diskette for a Linux distribution other that
what is available on the menu, see 3ware knowledgebase article 14546 http://
www.3ware.com/kb/article.aspx?id=14546
Note: If Red Hat Linux is already installed and bootable on another drive, turn to
“Installing the 3ware Kernel Driver Module on a Red Hat or Fedora Core Linux
System that Boots From a Different Device” on page 44.
Note: We have tested some older systems where a drive connected to the
motherboard interfered with using a drive or unit managed by the 3ware RAID
controller as a boot device. Disconnecting the drive while installing Linux will
eliminate this problem. After Linux is installed, the drive can be reconnected.
To install the 3ware kernel driver module while installing Red Hat
or Fedora Core Linux on a new unit
A number of files will load and then a message will prompt you to
insert your driver install disk.
4 Install the 3ware kernel driver module, using the driver install diskette:
Insert the driver install diskette containing the 3ware driver for Red Hat
and press Enter.
The system automatically reports: Loading 3w-9xxx
5 When prompted, select the proper language and keyboard types for your
locality.
6 If asked for what type of media, select Local CD-ROM since you are
installing from the Red Hat CD-ROM.
For Fedora Core 5, due to an installation bug that does not update the driver,
do not reboot. Instead perform the following additional steps:
8 Change directory to
/mnt/sysimage
The workaround will copy in the updated driver(s) and recreate the
ramdisk(s) so that upon reboot you have the updated drivers and not the
ones that came on the OS installation CD.
www.3ware.com 43
www.3ware.com 45
8 Reboot.
The 3ware kernel driver module will be loaded from the ram disk
automatically at boot time.
To install the 3ware kernel driver module and load the module
manually instead of using a RAM disk
You can also incorporate the insmod command into a startup script.
Materials required
• 3ware software CD-ROM
• Floppy diskette, if you need to make a driver install diskette.
• SuSE Linux Installation CD-ROM/DVD (Not required if SuSE Linux is
already installed on another drive.)
Note: If you need to create a Linux driver diskette for a Linux distribution other that
what is available on the menu, see 3ware knowledgebase article 14546
http://www.3ware.com/KB/article.aspx?id=14546
www.3ware.com 47
Note: If SuSE Linux is already installed on another drive, turn to “Installing the
3ware Kernel Driver Module on a SuSE Linux System that Boots from a Different
Device” on page 48.
3 If you are using SuSE 9.1 or earlier, after the existing 3w-xxx entry, add
3w-9xxx to the file /lib/modules/<kernel string>/modules.dep
4 Mount the CD-ROM and copy and install the appropriate kernel driver
module for your system.
Note: The AMD 64-bit driver is also used for 64-bit Intel Xeon
systems.
www.3ware.com 49
Note: If the kernel driver module installation fails, confirm that the
correct driver was installed from the CD-ROM. If a driver is not
available for your system, you will need to compile your own driver.
For more information, see 3ware knowledgebase article 14546 http://
www.3ware.com/kb/article.aspx?id=14546.
6 Type:
/sbin/depmod -a
7 Type:
/sbin/mkinitrd
8 If you are using the GRUB boot loader, you are finished.
If you are using the LILO boot loader, run LILO to update the boot record
on disk by typing the following:
/sbin/lilo
Materials Required
• 3ware kernel driver module
The kernel driver module and the corresponding source files can be found
on the 3ware CD-ROM, at
/packages/drivers/freebsd/6.1/x86
or
/packages/drivers/freebsd/6.1/x86_64
You can also download the FreeBSD kernel driver module from the 3ware
web site (http://www.3ware.com/support/index.asp).
• FreeBSD installation CD-ROM or diskette
www.3ware.com 51
Note: The 3ware kernel driver module integrated into the FreeBSD installation CD
supports 9500S controllers, but not 9550SX/9590SE/9650SE controllers. Since this
driver is statically compiled with the kernel, newer drivers with the same name
(twa.ko) cannot exist. A temporary driver is provided, named twa_9ksx.ko, which
can be used to accomplish the FreeBSD installation and enable boot device
support. Once up and booted, you will need to upgrade the kernel driver module by
compiling the new kernel driver sources provided on the CD or website. The steps
below describe how to load the temporary kernel driver module, and then how to
upgrade the kernel to include it.
Note: Some versions of FreeBSD cannot boot to arrays larger than 1 TByte. If you
want to create an array larger than 1 TByte, check to make sure that the version of
FreeBSD you have supports it.
1 Disconnect all SCSI devices in the system, except the except the CD or
DVD and the ones connected to the 3ware RAID controller.
2 Create the RAID units on the 3ware RAID controller using 3BM (the
3ware BIOS Manager). For details, see “First-Time RAID Configuration
Using 3BM” on page 20.
4 Boot the system from the FreeBSD installation CD. Immediately after the
system starts booting the kernel, insert the floppy containing the
appropriate 3ware 9550SX/9590SE/9650SE kernel driver module into the
floppy drive.
5 Run sysinstall.
In the sysinstall menu, choose Configure > Load KLD.
Load twa_9ksx.ko from the floppy drive.
6 Install the FreeBSD OS, remove the floppy and the CD, and reboot.
7 Immediately after the system starts booting the kernel, re-insert the floppy
into the floppy drive.
10 Once the system boots up, replace the twa driver sources at
/sys/dev/twa and /sys/modules/twa with the new sources that
have 9550SX/9590SE/9650SE support, for the OS version being used.
The sources for the new kernel driver module for FreeBSD 6.1 can be
found on both the 3ware CD-ROM and the 3ware website.
For step-by-step instructions, see “To update the kernel with new driver
source” on page 53.
2 Go to /usr/src/sys/conf/ and edit the files file (use vi or any other editor)
a Remove these lines:
twa/twa.c
twa/twa_cam.c
twa/twa_freebsd.c
twa/twa_fwing.c
twa/twa_globals.c
b Replace them with:
twa/tw_cl_fwimg.c (omit this if using code set 9.3.0.4 or newer)
twa/tw_cl_init.c
twa/tw_cl_intr.c
twa/tw_cl_io.c
twa/tw_cl_misc.c
twa/tw_osl_cam.c
twa/tw_osl_freebsd.c
c Save changes.
www.3ware.com 53
4 Go to usr/src/sys/i386/conf or /usr/src/sys/amd64/conf,
depending on whether you have a 32-bit or 64-bit version of FreeBSD 5.4
(respectively).
a Edit the GENERIC file (use vi or any other editor).
b Make sure Device twa # 3ware 9000 series is not commented
out.
c Save changes.
d Do config (GENERIC, SMP, PAE), using the flags required for your
hardware, followed by
cd ../compile/SMP
make clean
make cleandepend
make depend
make
make install
Note: If you have more than 4 GBytes of system memory, you will need to use the
PAE kernel. The FreeBSD PAE kernel has a bug that requires the 3ware driver to
be statically compiled. Do not dynamically load the kernel driver module (e.g.
kldload twa.ko); doing so will cause the kernel to panic.
1 Make sure the 3ware RAID controller is not installed in the system yet.
3 Once FreeBSD is installed, power down the system and install the 3ware
RAID controller. For assistance, see the installation guide that came with
the controller.
Create the RAID units on the controller using either 3BM (the BIOS of
the controller) or 3DM2/CLI (once FreeBSD is loaded).
4 Boot to FreeBSD.
5 Once the system boots up, replace the twa driver sources at
/sys/dev/twa and /sys/modules/twa with the new sources that
have 9550SX/9590SE/9650 support, for the OS version being used.
The sources for the new kernel driver module for FreeBSD 5.4 can be
found on both the 3ware CD-ROM and the 3ware website.
For step-by-step instructions, see “To update the kernel with new driver
source” on page 53.
1 Disconnect all SCSI devices in the system, except the ones connected to
the 3ware RAID controller.
2 Create the RAID units on the 3ware RAID controller using 3BM (BIOS)
3 Unpack twa.tgz and copy (*.c and *.h) files to sys/dev/twa and
Makefile to sys/modules/twa
www.3ware.com 55
4 cd /sys/modules/twa
make
This section describes the basics of using 3ware BIOS Manager 2 (3BM 2),
one of the tools you can use to configure and maintain the units connected to
your 3ware RAID controller. It is organized into the following topics:
• Starting 3BM 2
• Exiting the 3BM Configuration Utility
• Working in the 3BM Screens
• Adjusting BIOS Loading Settings
• Displaying Controller Information
• Getting Help While Using 3BM
For information about doing particular tasks in 3BM, refer to the later sections
in this guide.
Starting 3BM 2
You access 3BM during the start-up process for your computer.
2 While the system is starting, watch for a screen similar to the 3ware BIOS
screen below.
Exportable Units:
3drive 64K RAID5 558.77GB (PrimaryRAID5)
Port0 Maxtor 7B300S0 279.48 GB
Port1 Maxtor 7B300S0 279.48 GB
Port2 Maxtor 7B300S0 279.48 GB
www.3ware.com 57
4 If you have more than one 9000-series controller in your system, a screen
lists the available boards (see Figure 28). In this case, highlight the board
with which you want to work and press Enter.
You see a screen similar to the warning message below, warning you that
changing your disk array configuration may overwrite data on the disks.
5 If you plan to make changes to your configuration and need to backup
data before continuing, press ESC and do so now. Otherwise, press any
key to continue.
If 3BM detects a degraded array, a red message box appears, to alert you
to the problem. For information about rebuilding a degraded array, see
“Locating a Drive by Blinking Its LED” on page 166.
2 Type Y.
The booting process resumes.
1 Press Esc.
2 If you have unsaved changes, 3BM will ask you whether you want to save
the changes and exit, or exit without saving the changes.
If you want to exit without saving changes, type N.
If you change your mind and want to save the changes, type Y.
Exception: Changes made to controller policies are saved when you leave the
Policy screen. Pressing F8 is not required to save those changes. For more about
changing policies, see “Setting the Auto Rebuild Policy” on page 90.
www.3ware.com 59
You will see one or more of the following sections in the main 3BM screen:
• Available Drives lists any unconfigured, independent drives (JBODs)
that are not associated with an array, and hot spares. If this section does
not appear, there are no available drives.
• Exportable Units lists the existing units, along with the drives contained
in each. These are the units that will be available to the operating system
when you boot your computer. If this section does not appear, no units
have been configured.
If you have more than one unit, the boot unit is the one at the top of the
list. (You can change the order by highlighting a unit and pressing the
PgUp or PgDn key.)
• Unusable Arrays lists any RAID configuration missing too many drives
to construct the unit. For example, a RAID 5 unit with two or more drives
missing would appear in this list.
• Incomplete Drives and Others lists drives that are remaining from a unit
with missing or failed drives, drives that are not usable, and drives that
were part of a unit on a 3ware 7000/8000-series controller, and contain
data that needs to be updated before your 3ware 9000 series controller can
use them. (If you want to move a unit from a 7/8000 controller to the 9000
controller, you must convert the drives first. For more information, see the
section “Moving a Unit from One Controller to Another” on page 131.)
When some of the drives are remaining from a unit, you can power down
and add the missing drives to complete the unit. To use drives that are
listed here in other units, you must first delete them. For more
information, see “Deleting a Unit” on page 125.
If any of the sections are not shown, it means that there are no items of that
type connected to the controller.
Table 7 lists how to move around and select information in the 3BM screens.
When these commands are available in 3BM, they appear at the bottom of the
3BM screen.
www.3ware.com 61
www.3ware.com 63
Note: During the boot process, you can also bypass loading of the BIOS for all
controllers for one time only by pressing Alt-B. This is useful to temporarily boot
from a non-3ware device without having to change the system’s boot order.
www.3ware.com 65
Note: 3DM 2 includes software developed by the OpenSSL Project for use in the
OpenSSL Toolkit (http://www.openssl.org/).
3ware Disk Manager 2 (3DM 2) allows you to manage and view the status of
your 3ware RAID controllers and associated drives.
There are two parts to 3DM: a process, that runs in the background on the
computer where you have installed your 3ware controller, and a web
application that can be used to access it. 3DM runs as a service under
Microsoft Windows, and as a daemon under Linux and FreeBSD. When the
3DM process is running, you can use your browser to go to 3DM application
pages, where you can view status information about the controller and RAID
units, create RAID units, and perform other administrative and maintenance
tasks locally or remotely.
Two levels of access to 3DM are provided: user and administrator. Users have
view-only access, and can check the status of drives and units. Administrators
can view and make changes, using 3DM to configure RAID units and
designate hot spares, and to perform maintenance tasks on RAID units.
In this section, information is organized into the following topics:
• Browser Requirements for 3DM
• Installing 3DM
• Starting 3DM and Logging In
• Working with the 3DM Screens
• Setting Up 3DM Preferences
For details about the settings and fields on each of the 3DM 2 screens, see
“3DM 2 Reference” on page 189.
For additional information about managing and maintaining 3ware controllers
using 3DM, see the remaining chapters in this guide.
Note: Because 3DM may be viewed in different browsers, the format and style of
the 3DM browser windows illustrated in this documentation are examples only. The
actual “look” of the windows will depend on the browser, 3DM version, and
operating system you use.
Note: For security reasons, some web browsers do not allow connections to
certain ports including port 1080 and 888. To override this on a per-port basis, the
Mozilla release notes recommend adding a comma-separated list of ports to
default/all.js (in your Mozilla installation directory). For example, to unblock port
888, add the following line:
pref(“network.security.ports.banned.override”, “888”)
This file is located at:
/usr/lib/mozilla/defaults/pref/all.js
Installing 3DM
3DM 2 can be installed from the 3ware CD that came with your 3ware RAID
controller. You can also download the current version from the website at
http://www.3ware.com/support/download.asp.
3DM must be installed on the system in which the controller is installed. 3DM
does not have to be installed on remote systems in order to remotely manage a
www.3ware.com 67
3ware controller; you simply enter the correct URL into a browser on the
remote system. You will need to enable remote access first, however.
During installation, you will be asked to enter the following preferences for
3DM use. (Each of these preferences can be changed later, from within the
3DM web application.)
• The HTTP port to be used as the listening port
• Whether remote access will be allowed
• Whether you want email notifications to be sent when errors occur, and
who should receive them
1 Insert the 3DM CD-ROM and click Install 3DM 2 when the menu
appears.
Or, if you downloaded 3DM from the website, find the file setup.exe and
double-click it to launch the setup.
2 If a command window opens, press any key to begin the installation
process.
3 When the License Agreement screen appears, read and agree to the
license information; then let the InstallShield Wizard guide you through
the installation process.
5 If the 3DM HTTP listening port setup screen appears, enter the HTTP
port you want to use.
This screen only appears when you check the first box on the 3DM
Remote Monitoring and Security Configuration screen.
(You can change this setting later within 3DM.)
6 On the E-mail Notification Preferences screen (see Figure 34) use the
fields to specify initial email settings.
• In the Server field, enter the name or IP address of your email server.
You can get the IP address of your mail server by typing
nslookup <file server name>
To find the mail server name, ask your system administrator or check
the e-mail preferences or setup options on your e-mail client.
• In the Recipients field, enter the e-mail address of the user who
should receive the 3DM e-mail status messages.
You may enter multiple e-mail addresses, separating each entry with a
comma (,).
• In the Sender field, enter the email address from which the email
notifications will be sent. This is typically the local host name.
(You can change these settings later within 3DM.)
www.3ware.com 69
8 If you elect to launch the web interface, a Security Alert may appear, as
shown in Figure 35. Click Yes continue.
You may install the certificate if you do not want to see this alert in the
future. To do so, click View Certificate and then click Install Certificate.
Notes:
You can start 3DM later by choosing 3DM2 from the Start/Programs/3ware/
3DM2 menu.
If you change, add, or remove an IP address, or change the machine name of the
machine on which you have installed 3DM 2, you will need to recreate the security
certificate. You can do so by re-installing 3DM 2, or by deleting the file 3dm2.pem
and restarting the 3DM 2 service. Under Windows, this file is located in the same
directory in which you installed 3DM 2. Under Linux, the file resides in /etc/3dm2.
You may also want to delete the installed/cached security certificate from your
browser.
1 Insert the 3ware software installation CD-ROM for Linux into the CD-
ROM drive.
For FreeBSD:
cd /mnt/packages/3dm2/freebsd
./install.3dm --i
www.3ware.com 71
Press Enter to accept the default and install 3DM2 so that you can access
it through a browser.
2 Would you like to have email notification enabled? (Y/N) [Y]
If you want to be able to use 3DM for remote administration, change this
to No.
5 Change the directory and then eject the CD-ROM disk when finished:
cd /home
eject cdrom
1 Insert the 3ware software installation CD-ROM into the CD-ROM drive.
Note that if you downloaded 3DM from the web, replace “/mnt/” in the
previous command with “/root/”
Note: If 3DM Linux is reinstalled or restarted, close any open web browsers before
starting 3DM again to close the server socket.
www.3ware.com 73
Note: If you receive a page not found message, make sure you
entered the URL correctly. If you did, 3DM may not be running in the
background. You can start it manually.
2 The first time you start 3DM, when the security certificate message
displays, click Show Certificate and accept the certificate so that you do
not see the security message each time you start 3DM.
(You can also click Continue, in which case you will see this message the
next time you start 3DM.)
3 When the 3DM logon screen appears, select whether you are a User or
Administrator.
2 Afterwards, type:
/etc/init.d/tdm2 start
3 To start the 3DM web application, open your browser and enter the URL
for your system.
https://localhost.888
If the 3DM connection is to a remote machine, you can replace
“localhost” with the IP address of the computer that contains the 3ware
controller. For example: https://<IP address>:888/
www.3ware.com 75
Note: When using 3DM to access a remote system, the time on the
local system must match the time on the file server. If the time varies
by more than 30 minutes, it will not be possible to remotely monitor
the system (you will not be able to log in). If you are in a different time
zone, you must first change the time of the local system to match the
time of the remote system.
Note: If you expect to see a controller that is not listed, it may not be compatible
with the driver that is loaded; a firmware flash upgrade may be required.
Address of the
system to which
you are
connected.
Menu bar
Message bar
List of
controllers on
the system
Time of last
page refresh
Version of 3DM
The menu bar across the top of the screen gives you access to other pages in
3DM. You can move between pages by using the menu bar, or by clicking a
link on the page.
The main area of the page provides summary or detail information about your
3ware RAID controller and the resources connected to it.
As you work in 3DM, the Messages area just below the menu bar displays
information about the results of commands you have selected.
Tip: If you have a question about something you see on the screen, just click the
Help button in the menu bar.
www.3ware.com 77
3DM Menus
The 3DM menu bar groups access to a number of 3DM pages on menus, and
provides direct link access to others.
Status information is available from the Information menu. You can view
controller, unit, and drive information for a particular controller.
The Management menu gives you access to tasks used for managing
controller-level settings (background task rate, unit polices such as enabling
of unit write cache, and controller settings that affect all units managed by the
controller), tasks that can be scheduled (rebuild, verify, and self-test), and
maintenance of individual units. Unit configuration can also be done through
the Management > Maintenance page.
The Monitor menu gives you access to the Alarms page, the BBU page, and
the Enclosure Summary page. The Alarms page shows a list of alarms,
including the specific alarm message, and the exact date and time it occurred.
The BBU page shows the status of a Battery Backup Unit (BBU), if one is
installed, and allows you to test the battery. The Enclosure Summary page
provides lists the enclosures connected to the controller and lets you drill
down for more detailed status information about each.
The 3DM 2 Settings page lets you set preferences, including email
notification for alarms, passwords, page refresh frequency, whether remote
access is permitted, and the incoming port which 3DM will use for listening.
Help lets you access information about using 3DM. The Help is context-
sensitive, so you first see information about the page you now have in view. A
Table of Contents and Index are available to help you find other information.
Note: Throughout these instructions, the term current controller is used to refer to
the controller which is currently selected in this drop-down list.
Note: If you click Refresh on the browser window instead of on the 3DM menu bar,
you will be taken back to the Summary page.
www.3ware.com 79
Unit Information page Shows a list of the units on the current controller and
provides summary information about each unit.
To see this page, choose Information > Unit Information
from the menu bar or click an ID number on the Controller
Summary.
Drive Details window Shows the SMART data for a specific drive, and shows
additional detail information for the drive.
To see this page, click the Port # for a drive on the Drive
Information page.
Controller Settings Lets you view settings that affect the units on the current
page controller and change some of those settings.
Controller-level settings that can be changed include
background task rate, Auto Rebuild, Auto-Carving, and
Carve Size. Some additional policies are shown that can
only be changed in the BIOS or CLI.
Unit-level settings include specifying the StorSave Profile
and enabling or disabling the Write Cache, Auto-Verify,
Continue on Error During Rebuild, and Queuing.
To see this page, choose Management > Controller
Settings from the menu bar.
Scheduling page Lets you view and change the schedule for tasks that
affect all units on the current controller.
To see this page, choose Management > Scheduling
from the menu bar.
Maintenance page Lets you configure new units and make changes to
existing units.
To view this page, choose Management > Maintenance
from the menu bar.
Battery Backup page Shows the status of a Battery Backup Unit (BBU), if one is
installed, and allows you to test the battery.
To view this page, choose Monitor > Battery Backup on
the menu bar.
3DM 2 Settings page Lets you set preferences, including email notification for
alarms, passwords, page refresh frequency, whether
remote access is permitted, and the incoming port which
3DM will use for listening.
To view this page, click 3DM 2 Settings on the menu bar.
www.3ware.com 81
2 On the 3DM 2 Settings page, in the Password section, select the type of
password you want to change: User or Administrator.
3 Type the current password in the Current Password field.
If you are changing the password for the first time, the factory-set default
password is 3ware.
4 Enter the new password in the New Password field and again in the
Confirm New Password field.
Note: If you forget your password, you can uninstall 3DM and then
reinstall it. This will reset the password to the default password,
3ware.
www.3ware.com 83
This section describes how to view details about the controller, check its
status, and change configuration settings that affect the controller and all of
the drives connected to it. It is organized into the following sections:
• Viewing Information About a Controller
• Viewing Controller Policies
• Setting the Auto Rebuild Policy
• Using Auto-Carving for Multi LUN Support
• Setting the Size of Volumes Created with Auto-Carving
• Enabling and Setting Up Staggered Spin-up
• Exporting JBOD Disks
Note: Background task rate is also set for all units on a controller. For information
about setting the task rate, see “Setting Background Task Rate” on page 160.
www.3ware.com 85
2 To see more details about a particular controller, click the ID link for that
controller to display the Controller Details page.
Note: Throughout this documentation, the term current controller is used to refer to
the controller currently selected in this drop-down list.
www.3ware.com 87
• Carve Size. (Referred to as Carving Factor in 3BM) Sets the size for
dividing up units into volumes when Auto-Carving is enabled. This
setting can be between 1024 and 2048 GB.
• Staggered spin-up. Spin-up allows drives to be powered-up into the
Standby power management state to minimize in-rush current at power-up
and to allow the controller to sequence the spin-up of drives. Compatible
drives are sent a spin up command based on the settings specified with the
policies Number of drives per spin-up and Delay between spin-up
settings. These policies can only be set using 3BM or the CLI.
• Number of drives per spin-up. Number of drives that will spin up at
the same time when the controller is powered up, if staggered spin-up
is enabled. From 1 to x, depending on the number of ports on the
controller.
• Delay between spin-up. The delay time (in seconds) between drive
groups that spin up at one time on this particular controller, if
staggered spin-up is enabled.
www.3ware.com 89
3 On the Policy Settings page, Tab to the Auto-Rebuild field, press Enter
to display the options, select Enable and press Enter again to select it.
1 Choose Management > Controller Settings from the menu bar in 3DM.
2 In the Other Controller Settings section at the bottom of the screen, select
the Enabled option for Auto Rebuild.
The page refreshes, and a message at the top confirms the change you
have made.
www.3ware.com 91
The main use of auto-carving is to gain use of the full capacity in units greater
than 2 TB. This is because Windows 2000, Windows 2003, Windows XP, and
FreeBSD 4.x, do not currently recognize unit capacity in excess of 2 TB.
Note: Operating systems without this limitation include Linux 2.6, FreeBSD 5.x,
Windows XP-64bit, and Windows 2003, SP 1.
Even though the Linux 2.6 kernel supports partitions larger than 2 TB, the installers
for SuSE and Redhat do not. Turn auto-carving on to prevent the installation from
failing.
You must turn on the Auto-Carving policy before creating the unit. Units
created with this policy turned off will not be affected by a change to the
policy. If the policy is turned off later, units that have been carved into
volumes will retain their individual volumes; existing data is not affected.
To use auto-carving
2 Create a new unit or migrate an existing unit to include the drives you
want to use.
If the combined capacity of the drives exceeds the carve size, a number of
volumes will be created.
4 Verify that the volumes appear in the operating system. They will appear
as additional drives.
Notes:
• If you are configuring a unit for primary storage and it will be greater than 2 TB,
be sure to enable the auto-carve policy before creating the unit.
• When volumes have been created through auto-carving, they cannot be
deleted except by deleting the unit.
• If you create a bootable unit that has multiple volumes, the first volume is
always used as the boot device.
• Changing the auto-carve policy does not affect existing units.
1 Choose Management > Controller Settings from the menu bar in 3DM.
2 In the Other Controller Settings section at the bottom of the screen, in the
Carve Size field, enter the size you want (between 1024 GB and 204
GB) to use and click Submit.
The page refreshes, and a message at the top confirms the change you
have made.
www.3ware.com 93
3 On the Policy Settings page, Tab to the Carving Factor field, press Enter
to display the text entry box, enter the size you want (between 1024 GB
and 2048 GB) and press Enter again to accept it.
Note: Some hard drives require that the power management jumper (PM2) be set
to enable staggered spinup, in order for the SATA OOB option to be used. For more
information, see the knowledgebase article 14889, at http://www.3ware.com/
KB/article.aspx?id=14889
If JBOD disks are not exported to the operating system, they will appear as
available drives in 3DM, and can be configured as single disks or spares, and
included in other RAID configurations. If you change the policy to allow
JBOD disks to be exported to the operating system, they will appear as units
in 3DM if those drives were previously used as JBODs on another controller.
AMCC recommends that new drives be configured as Singles and not JBODs.
Note: If you enable the Export JBOD Disks option, the controller recognizes and
displays as JBODs any drives that were previously connected to 3ware 7000/8000-
series controllers as JBODs. Drives that were previously connected to a 9000-
series controller and configured will not be seen as JBODs.
www.3ware.com 95
Note: If you will install the operating system on and boot from a unit managed
through the new 3ware RAID controller, see Chapter 3, “First-Time RAID
Configuration Using 3BM.”
www.3ware.com 97
Note: Creating a unit erases all data on all drives. Although creating a RAID 1
(mirror) creates a unit that will have a duplicate of data on both drives after it is put
in use, creating a RAID 1 cannot be used to make a backup copy of data that
currently exists on a single drive unless you migrate from a RAID 1 to two individual
single disks.
Unit policies
Several unit policies are set when you create a new unit:
• Write Cache (enabled, by default)
• Drive Queuing (disabled, by default)
• Auto Verify (disabled, by default)
• Continue on Source Error During Rebuild (disabled, by default)
• StorSave Profile (Protection, by default)
The particular policies that you can adjust when you create the unit vary,
depending on which program you are using: 3DM, 3BM, or the CLI.
• In 3DM and the CLI, you can enable/disable write cache, enable Auto-
Verify, and specify whether to continue on source error
• In 3BM, you can specify all policies except Auto-Verify
You can change all of these policies after the unit has been created.
For a summary of what these policies do, see the discussion under “Setting
Unit Policies” on page 111. For how to adjust each one, see the procedures
later in this chapter.
To create a unit
1 In 3DM, choose Management > Maintenance.
2 In the Available Drives list, select the drives you want to include in the
unit by marking the checkbox in front of the Port number for each one.
If you are creating single drive units (single disks or hot spares), you can
configure multiple drives at once.
www.3ware.com 99
5 If stripe size applies to the RAID type you select, select a Stripe Size.
(Stripe size does not apply to RAID 1.)
6 Optional: In the Name box, enter a name for the unit (up to 21 characters,
including dashes and underscores).
8 Make changes to the unit policies, as desired. You can enable or disable
the Write Cache, Auto Verify, and Continue on Source Error During
Rebuild. You can also set the StorSave policy.
For details about these settings, see “Setting Unit Policies” on page 111.
9 Click OK.
The new unit appears in the Unit Maintenance list at the top of the page
and the operating system is notified of the new unit.
If you have auto-carving enabled and the size of your unit exceeds the
carve size, you may see multiple unit volumes in your operating system.
For details, see “Using Auto-Carving for Multi LUN Support” on
page 91.
In Linux, a device node will now be associated with each unit created. In
Windows, the device manager will reflect the changes under the disk
drives icon.
10 Partition, format, and mount the unit. The required steps will vary
depending on the operating system. For details, see “Partitioning,
Formatting, and Mounting Units” on page 106.
Note: For RAID 5 and RAID 6 units with 5 or more disks, and RAID
50 units with subunits of 6 drives, initialization (synchronization) of the
unit begins immediately.
The unit can be used while it is initializing and is fault-tolerant.
www.3ware.com 101
2 After all drives for the unit are selected, Tab to the Create Unit button
and press Enter.
Tip: You can also press Alt-C to choose Create Unit.
3 On the 3ware Disk Array screen, make sure that the proper drives are
listed.
4 (Optional) Press Enter and type a name for the unit; then press Enter
again to set the name.
5 Tab to the RAID Configuration field and press Enter to display a list of
available configurations for the number of drives you selected.
6 Use the arrow keys to select the configuration you want and press Enter.
7 Tab to the field Stripe Size and select the desired striping size (16, 64, or
256 KB).
www.3ware.com 103
8 (Optional) Tab through the policy fields and make any appropriate
changes to the settings for:
• Write Cache Setting
• Drive Queuing Mode
• Continue on Error During Rebuild
• StorSave Policy
For details about these settings, see “Configuration Options When
Creating a Unit” on page 97.
9 (Optional) Tab to the field Boot Volume Size, press Enter and type the
size for the boot volume (volume 0) in gigabytes; then press Enter again
to set the size.
10 Tab to the OK button and press Enter to confirm creation of the unit.
11 If the volume summary screen appears, review the information and press
any key to continue.
Multiple volumes will be created if you entered a Boot Volume Size of
greater than zero (0), or if auto-carving is enabled and the combined size
of the drives in your unit is large enough to divide it into multiple
volumes.
If you are not satisfied with how the volumes will be split up in the unit,
delete the unit from the main 3BM screen and recreate it using a different
Boot Volume Size. If desired, you can change the auto-carving policy or
the carve size on the Policies page. For more information, see “Using
Auto-Carving for Multi LUN Support” on page 91.
You are returned to the main 3BM screen.
Note: The unit is not actually created and no data is overwritten until
you have finished making all your changes and press F8.
If you made changes to units on more than one controller, the details
about changes about to be made may extend beyond one screen. In this
case, you use the PgUp and PgDn keys to bring more information into
view.
13 Type Y to continue, delete any existing data on the drives, and create the
unit.
www.3ware.com 105
2 Press the Page Up key to move the unit up the list; press the Page Down
key to move the unit down the list.
Position the unit you want to be bootable at the top of the list of
exportable units.
3 When you are finished working in 3BM, press F8 to save your changes
and exit.
2 Partition and format the new arrays or disks using the Administrative
Tools from the Start menu:
a Choose Computer Management from the Administrative Tools
menu.
b Select Storage.
c Select Disk Management.
4 Follow the steps that appear on-screen to write a signature to the drive.
6 Follow the steps that appear on-screen to create a volume and to assign a
drive letter.
The volume is automatically mounted after formatting completes.
(parted) mklabel
New disk label type? gpt
(parted) p
(parted) mkpart
(parted) p
Disk geometry for /dev/sda: 0kB - 1074GB
Disk label type: gpt
Number Start End Size File system Name Flags1 17kB 1074MB
1074MB
If the partition is over 2TB, use parted to also make the file system:
parted /dev/sda1
(parted) mkfs
Partition number? 1
File system? [ext2]?
writing per-group metadata (begins)...0% to 100% is
displayed)
www.3ware.com 107
You can also use sysinstall to format and partition the unit.
Note: When a hot spare replaces a failed drive, an event notification is generated
and appears in the list of alarms in 3DM. You can also have 3DM send you an email
about this. See “Managing E-mail Event Notification” on page 82.
It is a good idea to create a hot spare after you create a redundant unit.
In order to replace a failed drive, a hot spare must have the same or larger
storage capacity than the drive it is replacing.
The Auto Rebuild policy allows automatic rebuilding to occur with available
drives that are not designated as spares. For more information, see “Setting
the Auto Rebuild Policy” on page 90.
Note: 3ware’s 9000 series RAID controllers use drive coercion so that drives from
differing manufacturers and with slightly different capacities are more likely to be
able to be used as spares for each other. Drive coercion slightly decreases the
usable capacity of a drive that is used in redundant units.
The capacity used for each drive is rounded down to the nearest GB for drives
under 45 GB (45,000,000,000 bytes), and rounded down to the nearest 5 GBytes
for drives over 45 GB. For example, a 44.3 GB drive will be rounded down to 44
GBytes, and a 123 GB drive will be rounded down to 120 GBytes.
If you have 120 GB drives from different manufacturers, chances are that the
capacity varies slightly. For example, one drive might be 122 GB, and the other 123
GB, even though both are sold and marketed as “120 GB drives.” 3ware drive
coercion uses the same capacity for both of these drives so that one could replace
the other.
2 In the Available Drives list, select the drive you want as a hot spare by
marking the checkbox in front of it’s Port number.
3 Click Create Unit.
4 In the dialog box that appears, select the configuration type Spare.
5 Click Ok.
You will see the spare appear at the top of the page, under Unit
Maintenance.
2 Type s to specify that the selected drive will be the hot spare.
You’ll see the words “Hot Spare” appear next to the drive in the Available
Drives list.
www.3ware.com 109
3 If you are finished making changes in 3BM, press F8 to save the changes
and exit.
Note: If the drive you designated as a spare is not large enough to replace a failed
drive in a fault-tolerant unit, or if there is not a fault-tolerant unit for the spare to
support, 3BM will notify you.
Naming a Unit
Units attached to 9000-series controllers can be given unique names to more
easily identify them. A unit can be assigned a name when it is created. It can
also be named or renamed at a later time.
2 Choose Management > Controller Settings from the menu bar in 3DM.
3 In the Unit Names section of the Controller Settings page, locate the unit
for which you want to change the name.
Note: If you want to cancel your change before saving it, click the
Reset Names button.
1 At the main 3BM screen, select the unit by highlighting it and pressing
Enter.
An asterisk appears in the left-most column to indicate that it is selected.
2 Tab to the Maintain Unit button and press Enter.
3 On the pop-up menu, select Configure and press Enter.
On the Configure Disk Array screen, the Array Name field is already
selected.
4 Press Enter to open a text box.
5 Type a name for the unit and press Enter.
6 Tab to the OK button and press Enter to select it.
You return to the main 3BM screen.
7 When you are finished making changes, press F8 to save them and exit
3BM.
www.3ware.com 111
Note: If write cache is enabled, in the event of a power failure, the data in the write
cache will be lost if you do not have a Battery Backup Unit (BBU).To avoid a sudden
power failure if you do not have a BBU, it is advisable to have an Uninterruptible
Power Supply (UPS).
Write cache can be turned on or off for individual units in both 3DM and 3BM
without changing the configuration or losing data from the drives.
If you have a BBU (Battery Backup Unit) installed on the controller, the
battery preserves the contents of the controller cache memory for a limited
period of time (up to 72 hours) in the event of a system power loss. When a
BBU is installed, if the battery is not “Ready,” write cache is disabled and
cannot be enabled.
The unit's StorSave profile can also determine whether the write cache can be
enabled or disabled. A warning message will be given if the change is not
permitted due to the StorSave setting and the state of the unit.
Note: If the Write Cache checkbox is disabled (not selectable), check to see if the
unit has degraded. If a unit has a StorSave policy of “Protect” and the unit degrades,
the policy prevents write cache from being re-enabled until the unit has been rebuilt.
1 Choose Management > Controller Settings from the menu bar in 3DM.
2 In the Unit Policies section of the Controller Settings page, check the
Write Cache box to enable it for the designated unit.
The page refreshes, and a message at the top confirms the change you
have made.
If your system has no BBU, a message will caution you about enabling
write cache.
www.3ware.com 113
1 At the main 3BM screen, select the unit by highlighting it and pressing
Enter.
An asterisk appears in the left-most column to indicate that it is selected.
4 In the Configure Disk Array screen, Tab to the field Write Cache
Settings.
5 Press Enter to display the choices, use the arrow keys to select the
setting you want, and press Enter again to choose it.
6 Tab to the OK button and press Enter to select it.
You return to the main 3BM screen.
7 When you are finished making changes, press F8 to save them and exit
3BM.
verify task during the scheduled time windows. (For information about
schedules, see “Scheduling Background Tasks” on page 161.)
If Auto Verify is not set, you must manually specify when you want to run a
verify, on the 3DM Controller Settings page. If a schedule is set for verify,
then the verify that you manually start will only run during the scheduled
time.
You can set the Auto Verify policy while creating a unit through 3DM or you
can change the setting later using the following method.
1 Choose Management > Controller Settings from the menu bar in 3DM.
2 In the Unit Policies section of the Controller Settings page, check the
Auto Verify box for the appropriate unit. (To disable this policy, uncheck
the box.)
The page refreshes, and a message at the top confirms the change you
have made.
1 Choose Management > Controller Settings from the menu bar in 3DM.
2 In the Unit Policies section of the Controller Settings page, check the
boxes to select the policies you want to be in effect for each unit
www.3ware.com 115
The page refreshes, and a message at the top confirms the change you
have made.
5 Press Enter to display the choices, use the arrow keys to select the
setting you want (Enabled or Disabled), and press Enter again to choose
it.
7 When you are finished making changes, press F8 to save them and exit
3BM.
Note: Not all drives support NCQ. If a drive does not support NCQ, the policy
setting for the controller is ignored.
1 Choose Management > Controller Settings from the menu bar in 3DM.
2 In the Unit Policies section of the Controller Settings page, enable
queuing by checking the box under “Queuing” for the designated unit;
disable it by unchecking the box.
The page refreshes, and a message at the top confirms the change that you
have made.
1 At the main 3BM screen, select the unit by highlighting it and pressing
Enter.
An asterisk appears in the left-most column to indicate that it is selected.
4 In the Configure Disk Array screen, Tab to the field Drive Queuing
Mode.
5 Press Enter to display the choices, use the arrow keys to select the
setting you want (Enabled or Disabled), and press Enter again to choose
it.
www.3ware.com 117
Honor FUA (If no BBU is Honor FUA (If no BBU is Ignore FUA
FUA (Force Unit present) present)
Access) Ignore FUA (If BBU is Ignore FUA (If BBU is
present) present)
• FUA (Force Unit Access). FUA commands are a way that the RAID
controller or a program (such as a database program) can ensure that data
is actually written to the disk drive media, and is not stored in cache.
When a write command is followed with a FUA command, then the disk
drive will only issue “command complete” to the controller once the data
is written to media. When performance is considered more important than
protection, it may be desirable to ignore FUA commands.
The Protection and Balanced profiles honor FUA commands if no BBU is
present; the Performance profile ignores them regardless of whether a
BBU is present.
If you use a battery backup unit (BBU), FUA is ignored, because the BBU
preserves the contents of the controller cache memory for a limited period
of time (up to 72 hours), in the event of a power failure.
• Write Journaling. Write journaling tracks the writing of data to disk and
preserves a copy of data that has not yet been written to the disk media.
Following a power failure or in the event of accidental drive removal and
reinsertion, the firmware can recover the unit without data loss. All
pending writes sitting in the controller cache are replayed after power is
restored or the drive is reinserted and are flushed from the controller to
the drive.
Using write journaling helps protect your data, however it can have an
impact on performance.
1 Choose Management > Controller Settings from the menu bar in 3DM.
2 In the Unit Policies section of the Controller Settings page, select the
profile you want to use from the drop-down list in the StorSave column.
The page refreshes, and a message at the top confirms the change you
have made.
1 At the main 3BM screen, select the unit by highlighting it and pressing
Enter.
An asterisk appears in the left-most column to indicate that it is selected.
4 In the Configure Disk Array screen, Tab to the field StorSave Profile.
The current setting—Protection, Balanced, or Performance—is shown.
(The default setting is Protection.)
www.3ware.com 119
5 Press Enter to display the choices, use the arrow keys to select the
setting you want, and press Enter again to choose it.
7 When you are finished making changes, press F8 to save them and exit
3BM.
Note: A unit being migrated can still be used (I/O still continues), however the
performance will be affected while the migrating task is active. You can control how
much effect this has on performance by setting the background task rate. For more
information, see “Setting Background Task Rate” on page 112.
www.3ware.com 121
Destination
JBOD No No No No No No No No No
Spare No No No No No No No No No
Warning: If you are booted from a mirror (RAID 1 unit), never split it into 2 single
(identical) drives. Once the unit is split, any pending writes cannot be written to the
second drive. In addition, the file system on the drive will not be clean. Instead, shut
down the system, replace one of the drives, and start the rebuild from 3BM.
Note: You can only migrate a unit to a RAID level that has the same or more
capacity as the existing one. A four-drive RAID 5 unit can migrate to a four-drive
RAID 0, but a three-drive RAID 0 unit cannot migrate to a three-drive RAID 5,
without adding another drive, due to the need for additional storage capacity for
parity bits.
Note: Once migration starts, the unit stays in the migrating state until the migration
process is complete. The migration process cannot be aborted, and must be
allowed to finish before a rebuild or verify to the unit is permitted.
Warning: It is important that you allow migration to complete before adding to the
unit. Making physical changes to the unit during migration may cause the migration
process to stop, and can jeopardize the safety of your data.
2 In the Unit Maintenance table on the Maintenance Page, select the unit
you wish to expand by checking the box next to the Unit ID.
www.3ware.com 123
4 Select the drives(s) you wish to add to the unit by checking the Port ID
box next to each one.
6 Click OK.
The Maintenance page updates to show the newly reconfigured unit. The
Status column title indicates that Migration is in progress.
7 If you booted from the unit that is being migrated, when migration is
complete, reboot your system. Then turn to Step 4 under “Informing the
Operating System of Changed Configuration” on page 124.
Note: This step can only be done after the system has completed the migration or
online capacity process. The operating system will not see the capacity until that
process is complete.
1 If the unit you reconfigured is the boot unit, restart the system and skip to
Step 3.
If the unit you reconfigured is secondary storage, unmount the file system
from the unit.
Under Windows, go to Start > Administrative Tools > Computer
Management, and select Disk Management. Remove the logical drive
letter for the unit.
Under Linux and FreeBSD, from a command prompt, type sync <enter>,
sync <enter>, sync <enter>.
You can then unmount the unit with this command: umount <mount
location>
2 In the software, remove and rescan the controller, in order to update unit
information.
a In 3DM2 choose Management > Maintenance and select the
appropriate unit.
a Click the Remove Unit button.
b After the unit has been removed, click the Rescan button. The new
unit capacity displays.
Deleting a Unit
You delete a unit—either an array of disks, or a Single Disk—when you want
to reconfigure the unit or use the drives for other purposes.
After you delete a unit, the drives appear in the list of Available Drives.
Warning: When a unit is deleted, all of the data on that unit will be lost. The drives
cannot be reassembled into the same unit because the data on it is erased. If you
want to reassemble the drives into the same unit on another controller, use the
Remove Unit button in 3DM instead of the Delete Unit button. Or, you can shut
down the computer and physically move the drives to another 3ware RAID
controller. When you restart your system, the controller will recognize the unit. For
more information see “Moving a Unit from One Controller to Another” on page 131.
www.3ware.com 125
Warning: When a unit is deleted, all of the data on that unit will be lost. The drives
cannot be reassembled into the same unit because the data on it is erased. If you
want to reassemble the drives into the same unit on another controller, use the
Remove Unit button in 3DM instead of the Delete Unit button. Or, if you’re at the
BIOS level already, you can shut down the computer and physically move the drives
to another 3ware 9000 series RAID controller. When you restart your system, the
controller will recognize the unit. For more information see “Moving a Unit from One
Controller to Another” on page 131.
If you have incomplete drives, or drives that appear with a message such as
“Unsupported DCB,” indicating that they were previously part of a unit on a
3ware 7000/8000 series controller, they must be deleted before you use them.
(If you want to move a unit from a 7/8000 controller to a 9000 series
controller, you must convert the drives first. For more information, see
“Moving a Unit from One Controller to Another” on page 131.)
1 Make sure the operating system is not accessing the unit you want to
remove.
For example, make sure you are not copying files to the unit, and make
sure that there are no applications with open files on that unit.
5 In the Unit Maintenance section of the Maintenance page, select the unit
you want to remove and click Delete Unit.
1 At the main 3BM screen, select the unit in the list of Exportable Units by
highlighting it and pressing Enter or Space.
An asterisk appears in the left-most column to indicate that it is selected.
Warning: Any data on the unit will be lost once the unit is deleted.
Backup any data that you want to keep.
www.3ware.com 127
3 On the Delete Disk Array screen, review the information about the unit to
make sure it is the one you want to delete.
Removing a Unit
Removing a unit allows you to safely remove drives from a controller in order
to move the unit to another controller or to store the drives for safekeeping
purposes. This process is sometimes referred to as “array roaming.” Hot swap
carriers are required unless you power down first.
When you remove a unit (in contrast to deleting a unit), information about the
unit remains intact on the drives. This allows the drives to be reassembled into
a unit again on this controller, or if moved to another controller.
Note: You can also remove a drive, if you want to force a degrade on a redundant
unit, or if you want to remove a drive from the “Available Drives” list so that you can
then remove it from the system. For more information, see “Removing a Drive” on
page 135.
1 Make sure the operating system is not accessing the unit you want to
remove.
For example, make sure you are not copying files to the unit, and make
sure that there are no applications with open files on that unit.
4 In the Unit Maintenance table on the Maintenance page, select the unit
you want to remove and click Remove Unit.
5 When a message asks you to confirm, click OK.
The unit number and information is removed from the Maintenance page
in 3DM.
www.3ware.com 129
The operating system is notified that the unit was removed. In Linux the
device node associated with this unit is removed. In Windows the Device
Manager will reflect the changes under the disk drives icon.
You can now physically remove the drives and move them to another
controller. If you have a hotswap carrier, you can do this without shutting
down the system. If you do not have a hot-swap carrier, power-down the
system and ground yourself before making changes to the hardware.
If you change your mind and want to reuse the drives and unit on the
current controller, click Rescan Controller.
2 At the main 3BM screen, highlight the unit you want to remove and press
Enter to select it.
An asterisk appears in the left-most column to indicate that the unit is
selected.
Note: Moving a unit to another controller while the unit is in the migration state is
supported with one restriction. If the unit was in the middle of the migration process
and the controller was shutdown uncleanly, the unit cannot be moved to another
controller until the unit has recovered from the unclean shutdown.
www.3ware.com 131
Note: In order to preserve the data that is on the units attached to the 8000, you
will need to run a special utility to convert the units to a format that the 9000
controller can use. Contact Technical Support to obtain the utility. (This utility is not
required for legacy JBOD units.)
Do not remove the 8000 board from your system until you have converted the units.
The units must be attached to the 8000 controller when you run the utility.
3 Power down the system, disconnect the drives from the 8000 controller
and remove the controller from the system.
4 Install the 9000 controller and attach the drives to the 9000 board, as
described earlier in this section.
www.3ware.com 133
5 If you are working with a Linux system, install the 9550SX, 9590SE, or
9650SE controller.
6 Attach the drives that were on the to the 9500S to the 9550SX, 9590SE, or
9650SE controller.
7 Power up the computer and verify that the upgrade is complete. (The
existing units should be available for use.)
4 Attach the drives that were on the 9500S to the 9550SX, 9590SE, or
9650SE.
Adding a Drive
If you have a hot-swap carrier, you can add a drive to your system and make it
available through 3DM without powering down the system.
Without hot swap carriers, you should not add a drive via 3DM. Instead,
power down the system and add the applicable drives.
Note: When you add a drive to your system and connect it to the controller, it is
automatically detected and listed in 3DM. If it does not immediately display, you can
use the rescan feature, as described below.
To add a drive
Removing a Drive
If you have a hot-swap carrier and want to physically remove a drive from
your system without powering it down, you must first remove it through the
3ware software.
This is useful if you know that a drive is developing a problem and you want
to replace it, or to replace a drive which has already failed.
Warnings:
Physically removing a drive that is not in a hot swap carrier can result in a system
hang or may even damage the system and the drive.
The steps below will destroy any information that identifies this drive as part of a
RAID unit. Existing data on this drive will no longer be available.
Notes:
If you want to remove a unit from your system and reassemble it in another system,
do not follow these steps. Instead, turn to “Removing a Unit” on page 128.
If you physically remove a drive on a controller without first removing it in 3DM, it will
be listed as removed, however it will not be completely removed unless you Rescan
the controller.
To remove a drive
www.3ware.com 135
On the Maintenance page, Remove Drive links appear next to all drives
that can be removed from units, and next to drives in the Available Drives
list.
2 Locate the drive you want to remove and click the Remove Drive link
(Figure ).
3 When 3DM asks you to confirm that you want to remove the drive, click
OK.
You can now remove the drive from your system.
If you removed a drive that was part of a unit, the unit may become
degraded, as shown in (Figure 60).
For more details about how the Rescan feature works, see the information in
the 3DM Reference section, under “Maintenance page” on page 204.
www.3ware.com 137
www.3ware.com 138
The next figure illustrates how you can drill down to get additional detail
about units and drives in your system.
For some RAID levels (RAID 6, RAID 10, and RAID 50), a single RAID unit
may have more than one status. For example, part of the unit could be
rebuilding, while another part is degraded or initializing. When this is the
case, you will see both statuses listed at the top unit level. When you drill in to
see details, you will be able to see which the specific subunits or drives to
which the status applies.
For an explanation of unit and drive status, see:
• “Unit Statuses” on page 140
• “Drive Statuses” on page 142
If you use an enclosure that has an integrated AMCC/3ware CCU (chassis
control unit), the LEDs on your enclosure also provide some status
information. For details, see “Enclosure LED Status Indicators” on page 140.
www.3ware.com 139
Note: The following table is an example only. Check with your chassis
documentation for more details. Not all features may be supported or implemented
in the same way.
Solid green OK
Black No drive
Unit Statuses
The following is a list of unit statuses you may see in 3DM:
• OK. The unit is optimal and is functioning normally.
• Rebuilding. The unit is in the process of writing data to a newly added
disk in a redundant unit, in order to restore the unit to an optimal state.
The unit is not fully fault tolerant until the rebuilding is complete. For
more information, see “To verify a unit through 3BM” on page 154.
• Rebuild-Paused. The unit is set to rebuild, however scheduling is
enabled, and the present time is not during a scheduled timeslot.
Rebuilding will start at the next scheduled time slot. Rebuilds are also
paused for up to ten minutes after a reboot, even during a scheduled
timeslot.
• Initializing. The unit is in the process of writing to all of the disks in the
unit in order to make the array fault tolerant. For more information, see
“About Initialization” on page 148.
• Initializing-Paused. The unit is set to initialize, however scheduling is
enabled and the present time is not during a scheduled timeslot.
Initializing will start at the next scheduled time slot. Initialization is also
paused for up to ten minutes after a reboot, even during a scheduled
timeslot.
• Verifying. The unit is in the process of ensuring that the parity data of a
redundant unit is valid. For more information, see “About Verification”
on page 151.
• Verify-Paused. The unit is set to verify, however, scheduling is enabled,
and the present time is not during a scheduled timeslot. Verification will
start at the next scheduled time slot.
• Migrating. The unit is in the process of being reconfigured while it is
online. Migration can be used to change the RAID level, to expand the
capacity by adding additional drives, or to change the stripe size. For
more information, see “Changing An Existing Configuration by
Migrating” on page 120.
• Migrate-Paused. The unit is in the process of migrating, however
scheduling is enabled, and the present time is not during a scheduled
timeslot. Migrating will start at the next scheduled time slot. Migration is
also paused for up to ten minutes after a reboot, even during a scheduled
timeslot.
• Degraded. One or more drives in the redundant unit is no longer being
used by the controller. For more information, see “About Degraded
Units” on page 142.
• Inoperable. This is a condition where one or more drives are missing
from a unit, causing the unit to no longer be available to the operating
system. Data on an inoperable unit cannot be accessed. For more
information, see “About Inoperable Units” on page 143.
www.3ware.com 141
Drive Statuses
The following is a list of drive statuses you may see in 3DM:
• OK. The drive is fine and is functioning normally.
• Not Present. No drive is present in this slot.
• Drive Removed. The drive has been removed.
• Other. A number of other drive statuses may appear in the event of a
problem. If you have a question about a status shown, contact AMCC
customer support. knowing the exact drive status can help trouble-shoot
the problem.
Tip: If you have an enclosure that has an integrated AMCC/3ware CCU (chassis
control unit), the LEDs on your enclosure also provide you with status information
about drives. For more information, see “Enclosure LED Status Indicators” on page
150.
www.3ware.com 143
2 In the Windows Audible Visual Alarm window, select the types of alerts
you want to be notified of.
If you want to turn off the sound alarm and only have a pop-up message
appear, check the Audio Off button.
If you wish, you can open 3DM from this window by clicking Open
Browser. This can be useful when you receive a message, because the
3DM Alarms page allows you to easily access online help associated with
the events.
3 Click OK to close the window and accept any changes you have made.
www.3ware.com 145
1 In 3DM, choose Information > Controller Details from the menu bar.
3 On the Controller Details page, click the Download Error Log link.
4 When the Save or Open dialog box appears, navigate to where you want
to save the log and click OK.
2 On the Drive Information page, click the port number for the drive you
are interested in.
A window showing details of the SMART data opens. The data is shown
as hex values.
Background Tasks
Background tasks are maintenance tasks that help maintain the integrity of
your drives and data. These tasks include
• Initialization of units
• Verification of units
• Rebuilds when units have become degraded
• Migration of an on-line RAID from one RAID configuration to another
• Self-tests
You can set up your system so that these tasks occur as they are needed, or
you can create schedules so that they occur during non-peak times.
Background tasks can have an effect on performance, so using a schedule can
minimize the impact.
This section includes the following topics related to background tasks:
• About Initialization
• About Verification
• Starting a Verify Manually
• Rebuilding Units
• Cancelling a Rebuild and Restarting It with a Different Drive
• Setting Background Task Rate
• Background Task Prioritization
• Scheduling Background Tasks
• Viewing Current Task Schedules
• Turning On or Off Use of a Task Schedule
• Removing a Task Schedule
• Adding a New Task Schedule Slot
• Selecting Self-tests to be Performed
Although the migration of a unit is handled as a background task, initiating it
is similar to creating a new unit. For details, see “Changing An Existing
Configuration by Migrating” on page 120.
www.3ware.com 147
About Initialization
For 3ware SATA RAID controllers, initialize means to put the redundant data
on the drives of redundant units into a known state so that data can be
recovered in the event of a disk drive failure. For RAID 1 and RAID 10,
initialization copies the data from the lower port to the higher port. For RAID
5, RAID 6, and RAID 50, initialization calculates the RAID 5 parity and
writes it to disk (background initialization). This is sometimes referred to as
background initialization or resynching, and does not erase user data.
Some RAID levels must be initialized for best performance. (For specifics,
see “Initialization of Different RAID Types” on page 149.) When these units
are created in the BIOS (through 3BM), initialization begins immediately.
This type of initialization is referred to as foreground initialization, because it
is the primary task being performed on the system, before the operating
system has loaded. This process erases existing data, by writing zeroes to all
of the drives in the unit. You can elect to cancel foreground initialization, put
the units into service, and have initialization run in the background, instead.
Note: Units that do not need to be immediately initialized for full performance will
be automatically initialized using background initialization when they are verified for
the first time. (Verification requires that the units have been previously initialized.)
This will not affect the data on the drives, and the units will perform normally,
although performance will be slowed until the initialization and verification are
completed.
www.3ware.com 149
Notes:
For RAID 5 with more 5 or more drives, it is strongly recommended that you
initialize the unit before using it. Initializing such a unit is critical to insuring data
integrity on the unit.
For RAID 5 with 3 or 4 drives, initialization before use is not required. However,
initialization is required before a unit can be verified. Consequently, if you attempt to
verify a RAID 5 with 3 or 4 drives that has not yet been initialized, you will see a
message that the array has not been initialized, and initialization will begin. This is
considered part of normal operation of the unit.
Initialization Required
for Highest RAID Configurations
Performance?
No Single drive
No RAID 0
No RAID 1
RAID 10
Initialization Required
for Highest RAID Configurations
Performance?
About Verification
The verify feature combines verification of redundant units (confirming the
validity of the redundant data) and media scans for non-redundant units.
Verification can provide early warning of a disk drive problem or failure. This
allows you to replace drives before they fail.
You can manually request a verify, or you can enable the Auto Verify policy,
and the controller will automatically start verification once every 24 hours.
(See “Starting a Verify Manually” on page 153 and “Setting Auto Verify for a
Unit” on page 114.)
During verification, I/O continues normally, but with a slight performance
loss, depending on your verify rate setting. You can adjust how much
verification will slow performance by setting a rate at which it occurs. (See
“Setting Background Task Rate” on page 160.) You can also postpone
verification until a scheduled time. (See “Scheduling Background Tasks” on
page 161.)
Note: Not verifying the unit periodically can lead to an unstable array unit and may
cause data loss.
It is strongly recommended that you schedule a verify at least 1 time per week.
www.3ware.com 151
Note: If the unit has not previously been initialized and you manually select Verify
Unit in either 3BM or 3DM, the initialization process starts.
www.3ware.com 153
1 At the main 3BM screen, select the unit by highlighting it and pressing
Enter.
An asterisk appears in the left-most column to indicate that it is selected.
Notes:
If a unit that requires initialization has not previously been initialized, selecting Verify
Unit starts initialization. This is because fault-tolerant units cannot be verified until
after they are initialized.
If the unit is already in a state of rebuild, initialization, or verification, the unit cannot
be verified in 3BM. You must boot the system and let the task finish in the
background.
Rebuilding Units
Rebuilding is the process of generating data on a new drive after it is put into
service to replace a failed drive in a fault tolerant unit.
If a hot spare is specified and a redundant unit degrades, it will be used to
automatically replace the failed drive in the redundant unit without
intervention on your part. The rebuild process will automatically be launched
as a background process at the next scheduled time. If scheduling is turned
off, the rebuild process will start almost immediately (within a couple of
minutes). If 3DM is running and E-mail notification is enabled, an event
notification will be sent to specified users when the unit degrades and again
when the rebuild process is complete.
If the Auto Rebuild policy is enabled (see “Setting the Auto Rebuild Policy”
on page 90), the firmware will attempt to rebuild a degraded unit with an
available drive or a failed drive.
If desired, you can manually replace the drive, rescan the controller, and start
the rebuild process. Manual rebuilds can be started from either 3BM or 3DM,
although the rebuild itself only happens when the operating system is running.
Rebuilds on multiple units can take place simultaneously.
If multiple drives are faulted in a RAID 10 configuration, the drives are
rebuilt simultaneously. In a 4-drive RAID 10 configuration, up to two drives
can be rebuilt. In a 6-drive configuration, up to three drives can be rebuilt. In
an 8-drive configuration, up to four drives can be rebuilt. In a 12-drive
configuration, up to six drives can be rebuilt.
Note: If both drives in a RAID 10 mirrored set are faulted, the data is not
recoverable. Up to half of the drives in a RAID 10 unit can become defective and
still have the user data retained, as long as the failed drives are only half of each
mirrored pair.
A RAID 5 unit can have one drive fail before becoming inoperable.
A RAID 50 unit can sustain multiple drive failures, as long there is only one
failed drive in each RAID 5 set.
www.3ware.com 155
A RAID 6 unit can have two simultaneous drive failures, before becoming
inoperable.
When a RAID 5 or RAID 6 is running in Degraded mode and you rebuild it,
the missing data is reconstructed from all functioning drives.
Note: If a rebuild fails, check the Alarms page for the reason. If there was an ECC
error on the source disk, you can force the rebuild to continue by checking the
Overwrite ECC Error policy on the Controller Settings page in 3DM and then
running Rebuild again. This will cause uncorrectable blocks to be rewritten, but the
data may be incorrect. It is recommended that you execute a file system check
when the rebuild completes. Under Windows, you can do this by right-clicking on
the Drive and choosing Properties; then on the Tools tab, click Check Now.
1 If necessary, add a new drive to replace the failed drive. (For details, see
“Adding a Drive” on page 134.)
2 In 3DM, choose Management > Maintenance.
5 If the degraded unit has more than one failed drive (for example, a RAID
10 where both mirrored pairs each have a failed drive), repeat step 3 and
step 4 to select another drive.
If rebuild scheduling is not enabled on the Scheduling page, the rebuild
process begins almost immediately in the background. If rebuild
scheduling is enabled, the unit will not start actively rebuilding until the
next scheduled time.
Note: If you need to cancel a rebuild, you can do so by using the Remove Drive
link on the Maintenance page to remove the drive from the unit.
You can start the rebuild of a degraded unit manually in 3BM, or you can let
the system boot and allow the rebuild to take place automatically.
www.3ware.com 157
3 If your degraded unit has a drive indicated as Not in Use, the drive may
still be usable. Try rebuilding with the Not in Use drive intact. Simply
select the unit (highlight it and press Enter) and then select the Rebuild
Unit button.
4 When the Rebuild confirmation screen appears, confirm that you selected
the correct unit by selecting OK.
5 Press F8 to save your changes and exit 3BM. The unit will begin
rebuilding after the operating system finishes loading.
If the rebuild fails and you have no available drives, do one of the following:
• If your system has hot-swap carriers, you can replace the failed or Not In
Use drive and rescan (Alt-R) the unit.
• If your system does not have hot-swap carriers, power down the system
and replace the failed or Not In Use drive. Then power on the system and
restart 3BM.
2 Press Tab to select the degraded unit and press Enter to select it.
3 Tab to the Maintain Unit button and press Enter.
www.3ware.com 159
and cancel a rebuild by using the Remove Drive link on the Maintenance
page.
If you do not have hot-swap carriers and do not want to boot the operating
system and launch 3DM, you can also cancel a rebuild by powering down the
system, physically removing a drive, and installing another one that you want
to use. Then when you start 3BM, the unit will appear as degraded and you
can rebuild it, using the steps described under “Rebuilding Units through
3BM” on page 157.
Note: If you want to pause the rebuild process through 3DM, you can do so by
setting or changing the rebuild schedule on the Scheduling page. If you set a
schedule for rebuilds that does not include the current time, the rebuild process will
pause.
The furthest left buttons set the firmware to the fastest rebuild and verify
settings. This means that maximum processing time will be given to
rebuilds or verifies rather than I/O. The furthest right buttons set the
firmware to the slowest rebuild and verify settings, giving maximum
processing time to I/O.
After you select one of the radio buttons, the page refreshes, and a
message at the top confirms the change you have made.
www.3ware.com 161
Tip: If you want to change a task schedule window, you first remove the schedule
item and then add it back with the desired day, time, and duration.
Note: Setting up the scheduling window does not actually request background
tasks. It simply specifies when they can run. For more information about the
background tasks themselves, see “Background Tasks” on page 147.
You can also set the rate at which background tasks are performed compared
to I/O tasks. For more information, see “Setting Background Task Rate” on
page 160.
2 To view Verify Tasks or Self-test Tasks, select it from the drop-down list
at the top of the page.
Note: When you first use 3DM, daily schedules exist with 24 hour duration—that is,
the schedule is for “all the time.” Until you change these 24-hour daily schedule,
enabling the schedule will not have any direct effect.
2 To view Verify Tasks, select it from the drop-down list at the top of the
page.
www.3ware.com 163
Note: Self-test schedules cannot be turned off in this way. To disable self-tests you
must either remove all schedule times, or uncheck the tests listed in the Tasks
column. For more information, see “Selecting Self-tests to be Performed” on
page 165.
2 To view Verify Tasks or Self-test Tasks, select it from the drop-down list
at the top of the page.
2 To view Verify Tasks or Self-test Tasks, select it from the drop-down list
at the top of the page.
3 Scroll to the section of the Scheduling page that shows the task you want
to add.
4 In the fields at the bottom of the section, select the Day, Time, and
Duration for the task.
Note: The scheduled tasks can be added in any order. For example a new task
scheduled for Tuesday (slot-2) will preempt the task originally scheduled for
Wednesday (slot-1).
Note: These tasks will only be run during scheduled times if they are checked in
the Schedule Self-tests section of the Scheduling page. If neither of the tasks is
checked, self-tests will never run, even if you have scheduled time slots set.
2 Select Self-test Tasks from the drop-down list at the top of the page.
www.3ware.com 165
To disable self-tests
Unlike scheduling of rebuilds and verifies, scheduling of self-tests is always
enabled.
To disable self-tests you must either remove all schedule times, or uncheck
the tests listed in the Tasks column.
Note: Drive Locate is supported by some chassis vendors. This feature requires a
chassis with a Chassis Control Unit (CCU) designed according to AMCC/3ware
specifications. Check the 3ware support web site for future updates on a list of
chassis vendors that support the CCU, as they become available.
You can issue the command to blink the LED through 3DM.
(For details about what the different LED patterns on the enclosure mean, see
“Enclosure LED Status Indicators” on page 140.)
3 When you are finished working with the drive and no longer need to see
the LED, return to this page and uncheck the Identify box.
www.3ware.com 167
This section contains instructions for how to perform tasks that help you
maintain your controller, including:
• Determining the Current Version of Your 3ware Driver
• Updating the Driver and Firmware
• Viewing Battery Information
• Testing Battery Capacity
where the asterisk (*) represents controller number and “9xxx” represents the
version of the controller. For example:
cat /proc/scsi/3w-9xxx/0
If you have a 2.6 kernels with sysfs, type the following command:
cat /sys/class/scsi_host/<hostid>/stats
where <hostid> is usually host0, unless other SCSI devices are available, in
which case it may be host1 or higher.
If you have a 2.6 kernel without sysfs, type the following command:
dmesg | grep 3w
Note: Information in this section applies to updating drivers and firmware for the
9550SX, 9590SE, and 9650SE controllers. The 3ware website also allows you to
download drivers for other 3ware controller models and associated release notes.
For Windows, the firmware and driver can be installed from the same
download. When you run the utility, you can choose to update both the driver
and the firmware, or only the driver.
For Linux and FreeBSD, updating the driver and updating the firmware are
done separately. You can download them individually from the website.
Note: For Linux, do not use the driver from the external Linux distribution as it is
older than the currently supported driver. Instead, use the driver from the 3ware CD
or from the 3ware web site.
6 Click Next.
7 When details about the download you requested appear, click the link for
the item you want to download.
www.3ware.com 169
Depending on the item you selected, you may see either .zip (for
Windows) or .tgz (for Linux/FreeBSD) files to download.
Note: If using Winzip or another Windows utility to extract the Linux
file, use the .zip version instead of the .tgz version. Otherwise the files
will not be compatible with Linux.
Note: At the end of this process, you may need to restart the system. Restarting is
always required if you update the firmware. In addition, if you boot from a unit on a
3ware RAID controller, updating the driver will require that you restart the system.
To update the 3ware driver and firmware using the update utility
1 Download and extract the driver files, as described under “Updating the
Driver and Firmware” on page 169.
4 Locate the folder that contains the driver files you extracted in step 1.
www.3ware.com 171
If the firmware image is not found with the driver files, the 3ware Driver/
Firmware Update dialog box will show only the driver as available.
If the driver is not found, the 3ware Driver/Firmware Update dialog box
will show only the firmware as available.
www.3ware.com 173
Note: If you have multiple controllers in your system, your screen will
look slightly different, so that you can update the firmware for one or
all controllers. For details, see “Using the Update Utility With Multiple
Controllers” on page 175
6 In the Action section of the dialog, make any changes to what will be
updated and click Continue to install your selections.
During the update, the driver installs on your local drive. The firmware
will first download and then will flash a new image to the controller.
You will see either one or two progress dialog boxes, depending on what
is being installed. Progress is shown during:
• Driver installation
• Firmware download and flashing of the controller
Warning: Do not power off the system while the firmware is being flashed. Doing
so will render the controller unusable.
7 If a dialog box prompts you to restart your computer, click Yes to do so.
(If you were working from a driver diskette, be sure to remove the floppy
diskette before Windows reboots.)
8 If the driver you are installing is unsigned, you will receive a message to
that effect.
To complete the installation with an unsigned driver, click OK.
9 If a final message box confirms that the process is complete, click OK.
(This message appears if you do not need to restart your computer.)
1 Follow steps 1 through 5 above, under “Updating the 3ware Driver and
Firmware Under Windows” on page 170.
When the 3ware Driver/Firmware Update dialog box appears, it lists the
number of controllers in your system, shows available updates for the
device driver, and available firmware updates for the first controller.
Type of controller
Number of
controllers
Current controller
Number of
controllers that
will be updated.
3 For each controller, review the option for whether the firmware should be
updated, and change it if appropriate.
4 Continue with step 6 above, in the procedure “Updating the 3ware Driver
and Firmware Under Windows.”
www.3ware.com 175
1 Download and extract the driver files, as described under “Updating the
Driver and Firmware” on page 169.
6 Click on the Hardware tab and then click on the Device Manager tab.
11 If your system has Windows XP Service Pack 2, the first screen asks
whether you want to connect to Windows Update.
Select “No, not this time” and click Next.
12 When you reach the Hardware Update Wizard screen shown below,
select “Install from a list or specific location (Advanced)” and then click
Next.
www.3ware.com 177
13 At the next screen (Figure 80) choose “Don’t search. I will choose the
driver to install” and click Next.
14 When the Select the Device Driver screen appears (Figure 81), click the
Have Disk… button.
15 When the Install from Disk dialog box appears (Figure 82), enter the
correct path name to the driver. If you created a driver diskette, insert it
now. (The path will be A: if you are using a diskette in the A drive.)
16 When the Select the Device Driver dialog box reappears, select the
appropriate driver (Figure 83) and click Next.
Be sure to select the correct driver name, otherwise the driver upgrade
will not be successful.
The wizard begins installing the driver. You will see a progress box
during installation.
17 If the Digital Signature Not Found screen appears, click Yes to continue
and follow the instructions to complete the driver installation.
www.3ware.com 179
Note: Pre-compiled, tested, and supported drivers are no longer available for older
RedHat or Fedora Core releases using the 2.4 kernel. The source code is still
available (for a limited time) if a newer driver is still needed. Check the release
notes for more details regarding supported operating systems
www.3ware.com 181
Note: The name of the module you will copy (3w-9xxx.*) varies,
depending on the kernel; however you will always copy it to a file named
3w-9xxx.o for 2.4 kernels, or 3w-9xxx.ko for 2.6 kernels
For Red Hat or Fedora Core Uniprocessor
cp <version>/3w-9xxx.o /lib/modules/
<kernel>/drivers/scsi/3w-9xxx.o
For Red Hat SMP
cp <version>/3w-9xxx.smp /lib/modules/
<kernel>/drivers/scsi/3w-9xxx.o
For Red Hat Bigmem
cp <version>/3w-9xxx.big /lib/modules/
<kernel>/drivers/scsi/3w-9xxx.o
For Red Hat Hugemem
cp <version>/3w-9xxx.hug /lib/modules/
<kernel>/drivers/scsi/3w-9xxx.o
Note: Pre-compiled, tested, and supported drivers are no longer available for older
SuSE releases using the 2.4 kernel. The source code is still available (for a limited
time) if a newer driver is still needed. Check the release notes for more details
regarding supported operating systems.
1 Download and extract the driver, as described under “Updating the Driver
and Firmware” on page 169.
5 Run /sbin/depmod -a
6 Make sure the file /lib/modules/<kernel string>/modules.dep
contains an entry for 3w-9xxx. If not, add it after the 3w-xxxx entry.
www.3ware.com 183
8 Run mkinitrd.
9 If you are using lilo, use lilo to update to the boot loader.
You should see a printout of kernels that are able to boot on this system
after running lilo.
1 Download and extract the driver, as described under “Updating the Driver
and Firmware” on page 169.
2 Backup any critical data prior to updating the 3ware driver.
If units are present, you should see unit information in the system
log (usually, /var/log/messages).
6 If you wish to load the driver automatically every
time the system is rebooted, add the line 'twa_load="YES"' to
the file
/boot/loader.conf
3 Change the directory to the location with the extracted files, which
include tw_update.
The utility shows the version of the driver and firmware included in the
utility, the versions currently installed on your controller, and
recommends whether to upgrade the firmware or not.
Warning: We strongly recommend backing up your data before updating
the firmware. Updating the firmware can render the device driver
and/or management tools incompatible. It is recommended to have
a copy of current firmware image for rollbacks.
Both API and Driver are compatible with the new firmware.
Recommendation: proceed to update.
www.3ware.com 185
Note: When the BBU status is not “Ready,” write caching is automatically disabled
on all units attached to the controller
2 On the Battery Backup page, click the Test Battery Capacity link.
3 When a message cautions you that testing the battery will disable the
BBU for up to 24 hours, click OK to continue.
After the battery test starts, you will see the voltage start dropping;
eventually the battery voltage will say "LOW". This is part of the battery
test. After the voltage drops to a point, it will start charging again, and the
status will change to “Charging.” Eventually, the battery voltage will say
“OK” again.
www.3ware.com 187
1 At the main 3BM screen, tab to the BBU button and press Enter.
This section includes details about the fields and features available on the
pages you work with throughout 3DM 2. It is organized by 3DM page, as the
pages are organized on the 3DM menu bar.
• Controller Summary page
• Controller Details page
• Unit Information page
• Unit Details page
• Drive Information page
• Drive Details window
• Controller Settings page
• Scheduling page
• Maintenance page
• Alarms page
• Battery Backup page
• Enclosure Summary page
• Enclosure Details page
• 3DM 2 Settings page
www.3ware.com 189
The Summary page appears after you first logon to 3DM, and when you click
the Summary link in the menu bar.
This page provides basic information about each 3ware RAID controller in
your system. To see details about the units in a controller, click the link in the
ID column.
ID. The ID that the operating system assigns to the controller.
Note: The controller ID you see in 3DM 2 may not match the number that you see
for the same controller in 3DM version 1.x.
Model. The model name of the controller. (The model number is also printed
on a sticker on the outside bracket of the controller.)
Serial #. The serial number of the controller. (The serial number is also
printed on a sticker on the outside bracket of the controller.)
Firmware. The firmware version running on the controller.
Driver. The driver version being used to interact with the controller.
Status. The overall status of the controller. Possible statuses include OK,
Warning, Error, and No Units. Warning indicates that a background task is
currently being performed (rebuilding, migrating, or initializing). Error
indicates that a unit is degraded or inoperable. If both Error and Warning
conditions exist, the status will appear as Error. For more information, see
“Checking Unit and Drive Status through 3DM” on page 138.
The Controller Details page appears when you choose Information >
Controller Details from the menu bar.
This page provides detailed information about the controller specified in the
drop-down list on the menu bar.
You can also open or download an error log from this screen.
Model. The model name of the controller.
Serial #. The serial number of the controller.
Firmware. The firmware version running on the controller.
Driver. The driver version being used to interact with the controller.
BIOS. The BIOS version on the controller.
Boot Loader. Boot Loader version on the controller.
Memory Installed. The amount of memory installed on the controller.
Bus Type. The bus type used on the controller is shown: PCI, PCIX, or PCIE.
Bus Width. The bus width used on the controller: 32 or 64 for PCI-X slots; 4
lanes, 8 lanes, or 16 lanes for PCIE slots.
Bus Speed. The speed of the bus used on the controller is shown.
# of Ports. The number of total ports on the controller, regardless of whether
each currently has a drive connected.
# of Units. The number of units on the controller.
www.3ware.com 191
The Unit Information page appears when you choose Information > Unit
Information from the menu bar, or when you click an ID number on the
Controller Summary page.
This page shows a list of the units on the current controller and provides
summary information about each unit.
To see details about a particular unit, click the link in the Unit # column.
Unit #. The unit number assigned to the unit by the firmware. For 9000-series
controllers, unit numbers are in sequential order.
Name. If a name has been given to this unit, it shows here. If it is empty, no
name has been assigned. You can name your unit in the Unit Names section
of the Management > Controller Settings page.
Type. The type of unit, specified during configuration: RAID 0, RAID 1,
RAID 5, RAID 6, RAID 10, RAID 50, Single Disk, JBOD, or Spare. For
details about each of the RAID levels, see “Available RAID Configurations”
on page 5.
Capacity. The logical capacity (size) of the unit. 1KB = 1024 bytes.
Note: 3DM 2 displays the capacity (in MBytes or GBytes) the same way that
Microsoft Windows and Linux operating systems do: as 1KB = 1024 bytes. Previous
versions of 3DM 1.x used the 1KB = 1000 bytes definition. Consequently capacities
of units listed under 3DM v 1.x may appear to be larger than they do under 3DM 2.
Note: If an asterisk (*) appears next to the status of a unit, there is an error on one
of the drives in the unit. This feature provides a diagnostic capability for potential
problem drives. The error may not be a repeated error, and may be caused by an
ECC error, SMART failure, or a device error. To see if this error condition still exists,
rescan the controller; rescanning will clear the drive error status if the condition no
longer exists.
Identify. Check this box to cause the LED for the drives associated with this
unit to blink in the enclosure. (This feature only applies when drives are in an
enclosure that has a Chassis Control Unit (CCU) and is connected to the I2C
Chassis Control connector on the 9550SX, 9590SE, or 9650SE controller.
The Unit Details page appears when you click an ID number on the Unit
Information page. Because it is a sub-page of Unit Information, the page title
in the menu bar continues to display “Unit Information” even when you view
details of a unit.
The Unit Details page shows details about a particular unit. The specific
information shown depends on what type of unit it is. For example, details
about a RAID 5 unit made up of three subunits, each of which contains one
www.3ware.com 193
drive, will include details about the unit and each subunit, as shown in
Figure 92. However, if the unit is a Single Disk, only information about one
disk will be shown.
Details on this page may include all or some of the following information
described below.
To see details about a particular drive, click the Port #. You’ll see a list of all
drives, with the drive you selected highlighted.
Status. The operational status of the unit or subunit: OK, Rebuilding,
Migrating, Initializing, Verifying, Degraded, or Inoperable (missing drives).
When a unit is Rebuilding, Initializing, or Verifying, the percentage (%)
complete is also shown. For status definitions, see “Unit Statuses” on
page 140.
Capacity. The total capacity of the unit (capacities of subunits are not shown).
Type. The type of unit or subunit. RAID 0, RAID 1, RAID 5, RAID 6, RAID
10, RAID 50, Single Disk, Spare, JBOD, or Disk
Volumes. Displays the number of volumes in a unit. This is usually 1. If you
created a boot volume on this unit, or if you have a unit on which you have
enabled the auto-carving policy, you will see the number of volumes into
which the unit has been divided. For more information, see “Using Auto-
Carving for Multi LUN Support” on page 91.
Stripe. The stripe size of the unit, if applicable.
Subunits. If the unit has subunits, details of the subunits are shown.
Note: If an asterisk (*) appears next to the status of a subunit, there is an error on
one of the drives in the subunit. This feature provides a diagnostic capability for
potential problem drives. The error may not be a repeated error, and may be
caused by an ECC error, SMART failure, or a device error. Rescanning the
controller will clear the drive error status if the condition no longer exists.
Port #. If the Type is Disk, Single Disk, JBOD, or Spare, the port to which the
drive is connected is shown. For multiple drive units, the port numbers are
shown in the subunits section. The port number is a link to the Drive
Information page.
The Drive Information page appears when you choose Information > Drive
Information from the menu bar, or when you click a port # on the Unit Details
page. If you arrive at this page from the port # hyperlink on the Unit
Information page, the line showing the port # you clicked on is highlighted.
This page shows a list of drives on the current controller and a summary of
each one.
To see additional detail about a particular drive in the Drive Details window,
including the SMART data, whether NCQ is supported and enabled, and the
SATA Link speed, click the link in the Port # column.
Port #. The port to which the drive is connected.
Model. The model of the drive.
Capacity. The physical capacity of the drive. (Note that the capacity as shown
on 3DM screen is calculated as 1KB = 1024. This amount may differ from the
capacity that is printed on the disk drive, where it typically has been
calculated as 1K = 1000. Consequently, the capacity of the drive may appear
smaller in the 3DM screens. No storage capacity is actually lost; the size has
simply been calculated differently for consistency.)
Serial #. The serial number of the drive.
Firmware. The firmware version of the drive.
Unit. The unit the drive belongs to, if applicable.
Status. The status of the drive: OK, Not Supported, Not Present, and so forth.
If you need help regarding a status displayed here, please contact Technical
Support. For more information, see “Drive Statuses” on page 142.
www.3ware.com 195
Note: In most cases, the status of the drive will not correspond to the status of the
unit, shown on the Unit Information page. Different status information is provided for
drives and for units.
Identify. Check this box to cause the LED for this drive to blink in the
enclosure. (This feature only applies when drives are in an enclosure that has
a Chassis Control Unit (CCU) and is connected to the I2C Chassis Control
connector on the 9550SX, 9590SE, or 9650SE controller.)
The Drive Details window appears when you click a Port # on the Drive
Information page.
This Drive Details window shows some Extra Drive Information, including
NCQ and SATA Link Speed support, and the SMART data for the drive.
Command Queuing, the feature must be enabled at both the drive and the
controller. Not all drives support NCQ. .
The NCQ values in this window indicate whether the feature is supported and
enabled at the drive. At the controller level, queuing is enabled or disabled for
all drives in a unit on the Controller Settings page.
SATA Link Supported and SATA Link Enabled. These fields show the
fastest link speed that the disk drive supports and the current speed that the
drive is running.
SMART Data
SMART data is displayed as hex values.
Consult your disk drive manufacturer for information on how to interpret the
SMART data. The SMART data meaning varies by disk drive manufacturer
and model.
The Controller Settings page appears when you choose Management >
Controller Settings from the menu bar.
This page lets you view and change settings that affect the units on the
controller specified in the drop-down list on the menu bar.
www.3ware.com 197
Unit Policies
You can enable or disable these policies: Write Cache, Auto-verify,
Continue on Source Error During Rebuild, Queuing, and you can select a
StorSave Profile. 3DM lists each unit on the current controller, and shows
you whether the policies are currently enabled or disabled for each unit.
Write Cache. When write cache is enabled, data is stored locally in memory
on the drive before it is written to the disk drive media, allowing the computer
to continue with its next task. This improves performance. However, in the
event of a power failure, the data in the write cache will be lost if you do not
have a battery backup unit (BBU) or an uninterruptible power supply (UPS).
For additional information, see “Enabling and Disabling the Unit Write
Cache” on page 113.
Auto Verify. When the Auto Verify policy is enabled, a verify task is
performed automatically once every 24 hours. This feature is designed to
make regular verification of units easier.
If a verify scheduling window has been set up and enabled, then Auto Verify
will wait until the scheduled time window to start the automatic verify
process.
When Auto Verify is not enabled, verify tasks are only run if you manually
request one on the 3DM Management page. If a verify scheduling window is
set and enabled, then manual verifies will wait until the scheduled time to
start.
Continue on Source Error During Rebuild. This policy applies only to units
which are redundant. (For units which are not redundant, a check box is not
available.) When this policy is set, ECC errors are ignored when they are
encountered during a rebuild. When this policy is not set, a rebuild will abort
upon encountering an ECC error and the unit will be set back to Degraded.
Since this option could result in the loss of some source data in the event of
source errors, select this option only if you want to ensure that a rebuild will
complete successfully without manual intervention. If the rebuild fails and
Continue on Source Error During Rebuild is not selected, then you have the
option to start a rebuild manually. It is recommended that you execute a file
system check when the rebuild completes. Under Windows, you can do this
by right-clicking on the Drive and choosing Properties; then on the Tools tab,
click Check Now.
Note: The policy Continue on Source Error During Rebuild is equivalent to the
“Force continue on source errors” option in 3DM v 1.x and the “ignoreEcc” option in
the CLI.
Note: If the write cache setting is disabled for a unit, the StorSave Profile capability
does not apply and is automatically disabled.
www.3ware.com 199
Unit Names
Units can be assigned names. A name can be assigned when the unit is created
and can be changed from this screen. For additional information, see “Naming
a Unit” on page 110.
is disabled and JBOD drives are not exported to the operating system. For
more information about this feature, see “Setting the Auto Rebuild Policy” on
page 90.
For additional information, see “Setting the Auto Rebuild Policy” on page 90.
Scheduling page
Figure 96. Scheduling Page
The Scheduling page appears when you choose Management > Scheduling
from the menu bar.
The Scheduling page lets you set up a schedule for when background tasks
(rebuild, migrate, initialize, verify, and self-test) should occur. Background
tasks can have impact on the performance of your system, so you may prefer
to schedule them at times when they will be least disruptive, such as in the
middle of the night or on a weekend.
Select a type of task you would like to schedule. You start by selecting the
type of task for which you want to set the schedule from the drop-down list at
the top of the page.
• Rebuild/migrate tasks (also applies to initialization)
• Verify tasks (also applies to media scans)
• Self-tests
3DM then updates the page to show you schedule details for that type of task.
www.3ware.com 201
For details about the different background tasks, see “Background Tasks” on
page 147.
Task Schedules
Initially, 7 schedule slots are defined, for 24 hours each. Even if Follow
Schedule is enabled, this schedule is equivalent to Ignore Schedule, because
tasks can run at any time, round the clock.
A maximum of 7 slots can be created, so to set a different schedule, start by
deleting one or more of the existing scheduled slots, and then add new slots.
For step-by-step instructions for adding and removing schedules, and setting
schedules to be followed or ignored, see “Scheduling Background Tasks” on
page 161.
Self-test Schedules
Unlike scheduling of rebuilds and verifies, scheduling of self-tests is always
followed. To disable self-tests you either remove all schedule times, or
uncheck the tests listed in the Tasks column.
Note: Only the checked tasks will be run during the scheduled times. If none of the
tasks are checked, self-tests will never run, even if you have scheduled time slots
set.
The UDMA mode can become downgraded in the event that cable CRC errors
are encountered, requiring multiple retries to read sectors. In severe cases, the
UDMA mode may be downgraded from ATA 150 to ATA 133, to ATA 100, to
66, to 33.
This check is also done every time the system is booted.
Check SMART Thresholds. This test checks to see whether SMART
thresholds have been exceeded.
The SMART thresholds indicate when a drive is likely to fail, based on the
number of errors that have been recorded through SMART (Self-Monitoring,
Analysis and Reporting Technology).
If any of the disk drives have detected a “threshold exceeded” condition, then
an AEN is logged to the 3DM Alarms page. Moreover, if anything unusual is
found during any self-test, it will be logged as an Alarm.
www.3ware.com 203
Maintenance page
Figure 97. Maintenance Page
Rescan Controller
The Rescan Controller button scans the ports on the controller. Rescanning
updates the list of available drives shown and updates the status of all ports. If
error conditions have been fixed, the status is updated to reflect that.
Rescanning is useful in variety of maintenance tasks. For example, if you
physically plug in a drive and want the controller to recognize the newly
plugged in drive, Rescan will find it.
Note: If you unplug a drive without first removing it through 3DM, Rescan may not
recognize it as gone unless the drive was in use or until it is required by the system.
Always use the Remove link to remove a drive before unplugging it.
Warning: Physically removing or adding drives which are not in hotswap carriers
can result in a system hang or may even damage the system and the drive.
Rescan checks all ports. It checks empty ports for newly plugged-in drives. If
those drives were previously part of a 3ware RAID configuration and they
still have valid DCB (Disk Configuration Block) information on them, the
controller tries to piece them back together into a working unit. If a working
unit can be formed, it will appear in the Unit Maintenance list when the scan
is complete, and the operating system will be notified of the unit. In Linux or
FreeBSD, a device node will be associated with each unit created. In
Windows, the device manager will reflect the changes under the disk drives
icon. This process is known as importing drives.
If new drives do not have any data indicating they were previously part of a
3ware RAID configuration, they will appear in the Available Drives list.
In addition, if there is a unit with the status Inoperable before a rescan (for
example, a RAID 5 unit missing 2 or more drives), and a rescan finds drives
that complete the unit, the inoperable unit will become a valid unit.
Unit Maintenance
The Unit Maintenance section of the page lists all existing units on the current
controller, and displays summary information about them.
The top row shows information about the unit, while subsequent rows show
summary information about each drive in the unit.
www.3ware.com 205
Unit Information
Unit Number. The unit number assigned to the unit by the firmware. Use the
checkbox next to the unit to select a unit before clicking one of the task
buttons.
# Drives. Number of drives in the unit.
Type of Unit. Type of unit: RAID 0, RAID 1, RAID 5, RAID 6, RAID 10,
RAID 50, Single Disk, JBOD, or Spare. If the unit has been given a unique
name, it shows beneath the RAID type.
Name of Unit. User-assigned unique name of the unit. The default setting is
blank.
Capacity. The usable capacity (size) of the unit.
Status. Operational status of the unit: Ok, Rebuilding, Initializing, Verifying,
Migrating, Degraded, or Inoperable (missing drives). When Rebuilding,
Initializing, Migrating, or Verifying, the percentage (%) complete is also
shown. The percentage complete can be active or paused. To see whether this
task is currently active or paused, click on the unit number to display the Unit
Details page, which has that information. For an explanation of the statuses,
see “Unit Statuses” on page 140.
Drive Information
Port. The port to which the drive is connected.
Model. The model of the drive.
Capacity. The capacity (size) of the drive.
Status. The status of the drive: OK, Not Supported, Not Present, and so forth.
If you need help regarding a status displayed here, please contact Technical
Support. For more information, see “Drive Statuses” on page 142.
Remove Drive. The Remove Drive link removes a drive from the controller
so that you can safely unplug it. In the Unit Maintenance section, this link is
only provided for drives that can be safely removed without creating an
inoperable unit. (For example, a RAID 5 missing 2 or more drives or a RAID
0 missing 1 or more drives would become inoperable.) If you remove a drive
from a redundant unit, the unit will become degraded. Once a unit has become
degraded, additional drives cannot be removed without making it inoperable,
so no Remove Drive link will display.
Warning: Physically removing drives which are not in hotswap carriers can result
in a system hang or may even damage the system and the drive.
Verify Unit. Puts the selected unit in verifying mode. If verify scheduling is
enabled on the Scheduling page, the unit will not start actively verifying until
the scheduled time, and the status will indicate “Verify-Paused.” (The Unit
Details page will indicate whether a unit is actively verifying.) If verify
scheduling is not enabled, clicking Verify Unit begins the verification process.
If the unit you selected to verify is a redundant unit, the redundancy of the unit
will be verified. For example it will check parity for a RAID 5 or check data
consistency for a RAID 1. If the unit you checked is not a redundant unit,
verify will do a surface scan of the media. During verification, I/O continues
normally. For RAID 0, single disks, JBODs, and spares, there is only a slight
performance loss. For redundant units, you can set the background task rate
on the Controller Settings page to specify whether more processing time
should be given to verifying or to I/O. For more information, see “About
Verification” on page 151 and “Setting Background Task Rate” on page 160.
While a unit is verifying, the status changes to Verifying and a Stop Verify
link appears in the right-most column of the Unit Maintenance table.
Note: If the unit has not previously been initialized and you click Verify Unit, the
initialization process starts. Initialization cannot be halted, so no Stop Verify link
appears. (Initialization can be paused, however, through Scheduling. Initialization
follows the Rebuild schedule, so turning on scheduling for Rebuild will pause
initialization, as well.) For more information about initialization, see “About
Initialization” on page 148.
www.3ware.com 207
If rebuild scheduling is enabled on the Scheduling page, the unit will not start
actively rebuilding until the scheduled time, and the status will change to say
“Rebuild-Paused.” (The Unit Details page indicates whether a unit is actively
rebuilding.) If rebuild scheduling is not enabled, the rebuild process will
begin right away.
For more information about rebuilds, see “To verify a unit through 3BM” on
page 154.
Migrate Unit. Reconfigures a unit while it is on-line. Migration can be used to
change the RAID level, to expand the capacity by adding additional drives, or
to change the stripe size.
When you select a unit and click Migrate Unit, a dialog box appears which
lists the drives in the unit and any additional available drives. In the dialog
box are two drop-down menus, one for choosing the RAID level and one for
choosing stripe size.
You can only migrate a unit to a RAID level that will be larger than the
original unit. For example, you can migrate from a RAID 5 array with 4
drives to a RAID 0 with four drives but you cannot migrate from a RAID 5
with four drives to a RAID 10 with four drives.
After you have specified changes to the unit, the Unit Maintenance screen
reflects your changes and shows the percentage of migration completed.
While the unit is migrating, you can still access the unit as normal but the
performance will be lower. You can adjust the I/O rate with the radio buttons
on the Controller Settings page. (See “Setting Background Task Rate” on
page 160.)
Remove Unit. Removes a selected unit and allows you to unplug the drives
and move the unit to another controller. The data on the unit remain intact.
Caution: Before you click Remove Unit, make sure the unit you are removing is
unmounted and the system is not accessing it. (For example, make sure you are
not copying files to the unit, and make sure that there are no applications with open
files on that unit.)
If a unit is not unmounted and you remove it, it is the equivalent of physically
yanking a hard drive out from under the operating system. You could lose data, the
system could hang, or the controller could reset.
To unmount a unit under windows, use Administrative Tools > Computer
Management > Disk Management. In the Computer Management window, right-
click on the partition and Remove the logical drive letter associated with the unit.
To unmount a unit under Linux, unmount the mount point to where the RAID unit is
mounted. For example, if you want to remove unit 0 and you know that 0
corresponds to /dev/sdb, you should unmount all partitions for sdbx (where x is the
number of the partition).
umount /dev/sdbx
For FreeBSD, the command would be
umount /dev/twedx
When you click Remove Unit, you will be asked to confirm that you want to
proceed. When you confirm the removal, the unit number and information
will be removed from 3DM. (Units created in the future can reclaim this unit
number.)
The operating system is notified that the unit was removed. In Linux the
device node associated with this unit is removed. In Windows the Device
Manager will reflect the changes under the disk drives icon.
Information about the unit remains intact on the drives. This allows the drive
or drives to be reassembled into a unit again on this controller, or if moved to
another controller.
Warning: Physically removing drives which are not in hotswap carriers can result
in a system hang or may even damage the system and the drive.
Delete Unit. Deletes the selected unit and allows you to use the drives to
create another unit. The drives appear in the list of Available Drives.
www.3ware.com 209
Caution: Before you click Delete Unit, make sure the unit you are removing is
unmounted and the system is not accessing it. (For example, make sure you are
not copying files to the unit, and make sure that there are no applications with open
files on that unit.)
If a unit is not unmounted and you remove it, it is the equivalent of physically
yanking a hard drive out from under the operating system. You could lose data, the
system could hang, or the controller could reset.
Devices can be unmounted through the operating system. For details, see the
discussion under Remove Unit, above.
Warning: When a unit is deleted, the data will be permanently deleted: the drives
cannot be reassembled into the same unit. If you want to reassemble the drives on
another controller and access the existing data, use Remove Unit instead of
Delete Unit.
After deletion, the operating system is notified that the unit was deleted. In
Linux the device node associated with this unit is removed. In Windows the
Device Manager will reflect the changes under the disk drives icon.
Warning: Physically removing drives which are not in hotswap carriers can result
in a system hang or may even damage the system and the drive.
Create Unit
Use the Create Unit button to create a unit for use on the current controller.
Begin by selecting the drives you want to use in the list of Available Drives,
and then click Create Unit. You will be prompted to select the unit Type,
Name, Stripe size (if applicable), and unit policy settings.
A window like the one below shows the drives you selected, and lets you
specify configuration settings.
For more detailed instructions, see “Configuring a New Unit” on page 96.
Type. The drop-down list lists the possible RAID configurations for the drives
selected in the list of Available Drives. Available configurations may include
RAID 0, RAID 1, RAID 5, RAID 10, RAID 50, Single Disk, and Spare Disk.
For information about these configurations, see “Available RAID
Configurations” on page 5.
When you are configuring a RAID 50 with twelve drives, an additional field
appears, in which you select the number of drives per subunit—3, 4, or 6.
www.3ware.com 211
and the worse the random I/O. The larger the stripe size, the worse the
sequential I/O and the better the random I/O.
Write Cache, Auto Verify, and Continue on Source Error during Rebuild.
These check boxes let you set the policies for the unit. These policies can also
be set and changed on the Controller Settings page. For details about these
policies, see “Unit Policies” on page 198.
Note: If the configuration window disappears while you are selecting drives, 3DM 2
may have refreshed. Click Create Unit again. If desired, you can reduce the
frequency with which information refreshes in 3DM 2, or disable refresh temporarily,
on the 3DM 2 Settings page.
StorSave. You can specify the StorSave Profile to be used for the unit. Three
profiles are available: Protection, Balanced, and Performance. For more
information, see “Setting the StorSave Profile for a Unit” on page 117.
Alarms page
Figure 100. Alarms Page
The Alarms page appears when you click Monitor > Alarms on the menu bar.
This page displays a list of AENs (asynchronous event notifications) received
from the controller displayed in the drop-down list in the menu bar.
Up to 1000 events can be listed. After the 1000-limit is reached, the oldest
events are deleted, as new ones occur.
You can sort the events by severity or time. To do so, just click the column
header.
For information about a particular event, click it on the Alarms page; the 3DM
Help will open with information about the event. For a complete listing of the
alarms that appear on the Alarms page, see “Error and Notification Messages”
on page 224.
Clear Alarms. The Clear Alarms button removes all alarms shown in the list.
Sev. Shows the severity of the event. Three levels are provided:
• Errors are shown next to a red box
• Warnings are shown next to a yellow box
• Information is shown next to a blue box
Time. The time shown for alarms is the time the alarm was received by the
driver from firmware.
Message. The specific text relating to the alarm condition.
The Battery Backup page appears when you choose Monitor > Battery
Backup on the menu bar. Use this page to determine whether a backup battery
is present, see details about it, and perform a battery test.
Battery Backup Unit. Indicates whether the BBU is present.
Firmware. Indicates the BBU firmware version.
www.3ware.com 213
The Enclosure Summary page appears when you choose Enclosure >
Enclosure Summary from the menu bar.
The Enclosure Summary page provides basic information about any
enclosures attached to your system.
ID. The ID that the 3ware firmware assigns to the enclosure.
Slots. The number of slots in the enclosure.
Drives. The number of drives in the enclosure.
Fans. The number of fans in the enclosure.
Temp Sensor. The number of the temperature sensor in the enclosure.
www.3ware.com 215
The Enclosure Details page appears when you click the ID of the enclosure on
the Enclosure Summary page.
Enclosure ID. The ID of the controller to which the enclosure is attached.
Fan Summary. Shows the ID of the enclosure and the status of the fan—
either OK or Unknown.
Temp Sensor Summary. Shows the ID of the enclosure and the temperature
in the enclosure.
The maximum temperature for successful use of a drive should be noted in the
documentation for the drive.
Slot Summary. Lists the enclosure slots and indicates which ones contain
drives, and the status of each drive. The Identify checkbox can be used to
blink the LED associated with that slot.
Identify. Check the box for a slot to cause the LED for it to blink in the
enclosure.
The 3DM 2 Settings page appears when you click 3DM 2 Settings on the
menu bar. Use this page to set preferences, including email notification for
alarms, passwords, page refresh frequency, whether remote access is
permitted, and the incoming port for 3DM to listen for requests.
The initial settings for most of these preferences are specified during
installation of 3DM.
Information about the 3DM 2 Settings page is organized under these
headings:
• E-mail Notification
• Password
• Page Refresh
• Remote Access
• HTTP Settings
E-mail Notification
Use the fields in this section to set up and manage notifications of events by e-
mail.
www.3ware.com 217
Password
Use the fields in this section to set the passwords for the User and
Administrator. When 3DM is first installed, the default password for both is
3ware.
Change Password For. Select the access level for which you are setting the
password: User or Administrator. Users can only view status information in
3DM, while Administrators can make changes and administer the controller
and associated drives.
Current Password. Enter the current password.
New Password. Enter the new password.
Confirm New Password. Enter the new password a second time, to be sure
you have entered it correctly.
Change Password button. Saves password changes.
Page Refresh
Minutes Between Refresh. Displays how frequently pages in 3DM will be
refreshed with new data from the controller. To change this setting, select
another option from the drop-down. If you prefer 3DM to only refresh when
you click Refresh Page, select Never.
The Login, Help and Drive SMART data pages do not automatically refresh.
All other 3DM pages do.
Remote Access
Allow Remote Access. This field enables or disables the ability for users and
administrators to access 3DM from a remote computer.
HTTP Settings
Listening Port. This field specifies the HTTP: port to be used by 3DM when
listening for communications. The default port setting is 888.
If you change this port, make sure the port you specify is not being used.
Failure to do so will cause 3DM to stop responding and you will have to
restart it by hand.
Change Port button. Saves a new port number.
www.3ware.com 219
Web Resources
For support, troubleshooting tips, frequently asked questions, software
releases, and compatibility information related to 3ware RAID controllers,
refer to:
• 3ware support page at:
http://www.3ware.com/support/
• 3ware knowledgebase:
http://www.3ware.com/KB/kb.asp
• 3ware software downloads:
http://www.3ware.com/support/download.asp
• 3ware documentation:
http://www.3ware.com/support/userdocs.asp
• 3ware Compatibility Lists:
http://www.3ware.com/support/sys_compatibility.asp
If you have a degraded unit or problem drive, see “Maintaining Units” on
page 138.
Command Logging
All changes that are made to RAID configurations using 3DM or CLI are
automatically stored in a special log file. This log can be helpful to AMCC
technical support if they are helping you troubleshoot problems with your
RAID controller and units.
In Linux and FreeBSD, the log file is in /var/log directory.
In Windows, the log file is in the 3DM2 installation directory if 3DM2 is
installed on your system. If 3DM2 is not installed, the log file is in the home
directory of the current user.
Command logging is on by default. It can be disabled through the CLI. (For
details see the 3ware Serial ATA RAID Controller CLI Guide.)
www.3ware.com 221
Hardware Installation
Q1: The 3ware BIOS screen never appears.
The 3ware RAID controller may not be installed properly. Reinstall the
hardware and reboot.
There may also be a problem with the motherboard. Please check the
Motherboard Compatibility List on the 3ware website at http://
www.3ware.com/products/compatibility.asp to see if you motherboard
has been tested by 3ware. If you have a different type of motherboard
available, you may want to test the controller in it to see if the 3ware
BIOS screen appears.
The motherboard's BIOS may need to be upgraded. Check the web site
of the motherboard manufacturer to download and install their latest
BIOS.
You can also try using a different PCI slot. If you are using a PCI riser
card, try installing it directly. Some riser cards are not compatible with
certain motherboards.
Software Installation
Q4: The 3ware RAID controller was configured without problems,
but the system does not boot.
The problem could be one or more of the following:
• The BIOS may have changed the order of the boot devices. Check
your system BIOS boot sequence.
• The operating system is installed on a device that is not in your
system’s boot order. Use your system’s Setup utility to include the
StorSwitch controller in the boot order.
The unit has some but not all of its members available. The unit will be
unusable. If this unit is your boot device, your system will not boot. You
must either find the missing disk and replace it to complete the unit, or
release the member disks by deleting the incomplete unit(s) listed in the
display. Remember that deleting a RAID unit overwrites any existing
data on the member drives.
Problems in 3DM
Q6: A 3ware RAID controller does not show in the list of
controllers.
You may not have the most recent driver for your controller.
To find out the driver number currently installed, see “Determining the
Current Version of Your 3ware Driver” on page 168
Current drivers are available for download on the 3ware website at
http://www.3ware.com/support/download.asp.
www.3ware.com 223
Value Message
Value Message
www.3ware.com 225
Value Message
Value Message
www.3ware.com 227
the rebuild. However, due to ATA drives’ ability to reallocate sectors on write
errors, the rebuild failure is most likely caused by the source drive of the
rebuild detecting some sort of read error. The default operation of the 3ware
RAID controller is to abort a rebuild if an error is encountered. If it is desired
to continue on error, you can set the Continue on Source Error During Rebuild
policy for the unit on the Controller Settings page in 3DM.
For more information, see “Setting Continue on Source Error During
Rebuild” on page 115.
(clean shutdown). If the system loses power or is reset without going through
the normal shutdown procedure, it is possible that the data on a redundant unit
may be out of synchronization. The unclean shutdown detection will detect
this case and force the unit to enter the verify state.
For more information on the verify state, see “About Verification” on
page 151
To prevent unclean shutdowns, always go through the normal shutdown
procedure. It is also recommended to use an uninterruptible power supply
(UPS) to prevent unclean shutdowns due to sudden power loss.
www.3ware.com 229
www.3ware.com 231
index.asp. For information on what error logs are and how to collect them, see
http://www.3ware.com/KB/article.aspx?id=12278.
www.3ware.com 233
www.3ware.com 235
www.3ware.com 237
from some unknown reasons. (This event rarely happens. Please contact
AMCC 3ware technical support if this event occurs.)
www.3ware.com 239
www.3ware.com 241
www.3ware.com 243
www.3ware.com 244
www.3ware.com 245
• Drive ID. A unique identifier for a specific drive in a system. Also called a
port ID.
• Drive Number. The SCSI number, or channel number, of a particular
drive.
• ECC. Error correction code. ECC Errors are grown defects that have
occurred on a drive since it was last read.
• ECC Error policy. Determines whether an error detected during a rebuild
stops the rebuild or whether the rebuild can continue in spite of the error.
Specified by the Continue on Source Error During Rebuild unit policy.
• EMS (Enclosure Management Services). Chassis-monitoring functions
for environmental, power, mechanical monitoring, and control using the
I²C (chassis control) bus port.
• Export a unit. To remove the association of a unit with a controller. Does
not affect the data on the drives. Used for array roaming, when you want
to swap out a unit without powering down the system, and move the unit
to another controller. Compare to Delete, which erases all unit
configuration information from the drive.
• Exportable unit or drive. In 3BM (BIOS), exportable units and drives
are those that will be available to the operating system when you boot
your computer.
• Fault tolerant. A RAID unit which provides the ability to recover from a
failed drive, either because the data is duplicated (as when drives are
mirrored) or because of error checking (as in a RAID 5 unit).
• Firmware. Computer programming instructions that are stored in a read-
only memory on the controller rather than being implemented through
software.
• Grown defect. Defects that arise on a disk from daily use.
• Hot spare. A drive that is available, online, and designated as a spare.
When a drive fails in a redundant unit, causing the unit to become
degraded, a hot spare can replace the failed drive automatically and the
unit will be rebuilt.
• Hot swapping. The process of removing a disk drive from the system
while the power is on. Hot swapping can be used to remove units with
data on them, when they are installed in hot-swap carriers. This is referred
to as array roaming. Hot swapping can also be used to remove and
replaced failed drives when a hot-swap carrier is used.
• I²C-(or Inter-IC) bus. A two-wire serial bus solution used as a control,
diagnostic, environmental, and power management for EMS (enclosure
management services).
www.3ware.com 247
www.3ware.com 249
www.3ware.com 251
Limited Warranty
RAID Controller Hardware. 3-Year Hardware Warranty: AMCC warrants
this product against defects in material and workmanship for a period of
thirty-six (36) months from the date of original purchase. AMCC, at no charge
and at its option, will repair or replace any part of this product which proves
defective by reason of improper workmanship or materials. Repair parts or
replacement products will be provided by AMCC on an exchange basis and
will be either new or refurbished to be functionally equivalent to new.
Products or parts replaced under this provision shall become the property of
AMCC.
Battery Backup Unit (BBU) Hardware. 1-Year Hardware Warranty: AMCC
warrants this product against defects in material and workmanship for a
period of twelve (12) months from the date of original purchase. AMCC, at no
charge and at its option, will repair or replace any part of this product which
proves defective by reason of improper workmanship or materials. Repair
parts or replacement products will be provided by AMCC on an exchange
basis and will be either new or refurbished to be functionally equivalent to
new. Products or parts replaced under this provision shall become the property
of AMCC.
Software Warranty: AMCC will replace a defective media purchased with
this product for a period of up to 30 days from the date of purchase.
AMCC warranty service is provided by returning the defective product to
AMCC.
Exclusions
This warranty does not cover any damage to this product which results from
accident, abuse, misuse, natural or personal disaster, or any unauthorized
disassembly, repair or modification. AMCC shall not be liable for any
incidental or consequential damages, including but not limited to loss of
profits, other loss, damage or expense directly or indirectly arising from the
customer's misuse of or inability to use the product, either separately or in
combination with other equipment, regardless of whether AMCC has been
advised of the possibility of such damages. AMCC is not liable for and does
not cover under warranty, any costs associated with servicing and/or the
installation of AMCC products. This warranty sets for the entire liability and
obligations of AMCC with respect to breach of warranty and the warranties
set forth or limited herein are the sole warranties and are in lieu of all other
warranties, expressed or implied, including warranties or fitness for particular
purpose and merchantability.
www.3ware.com 253
Please use the original packing material contents of the box when exchanging
or returning a product.
For information about the status of a replacement, please contact AMCC
Technical Support.
A
A-Chip
Numerics definition 244
2TB support 91 active content in the 3ware HTML Bookshelf,
3BM security message about x
help 65 AEN
main screen 60 Backup DCB read error detected (0043) 238
navigation 61 Battery capacity is below error level (0059) 241
screens 60 Battery capacity is below warning level (0058) 241
starting 57 Battery capacity test completed (0050) 240
working in 61 Battery capacity test is overdue (0053) 241
3DM Battery capacity test started (004E) 240
3DM menus 78 Battery charging completed (0056) 241
Alarms page 212 Battery charging fault (0057) 241
Battery Backup Information page 213 Battery charging started (0055) 241
browser requirements 67 Battery health check completed (0052) 241
Controller Details page 191 Battery health check failed (005D) 242
Controller Settings page 197 Battery health check started (0051) 240
Controller Summary page 190 Battery is not present (005B) 242
Disk Management Utility Overview 66 Battery is present (005A) 241
Drive Details page 196 Battery is weak (005C) 242
Drive Information page 195 Battery temperature is high (004B) 239
enabling remote access 83 Battery temperature is low (004A) 239
Enclosure Details page (3DM) 216 Battery temperature is normal (0049) 239
Enclosure Summary page (3DM) 215 Battery temperature is too high (004D) 240
installing 3DM on Linux 71 Battery temperature is too low (004C) 239
installing 3DM on Windows 68 Battery voltage is high (0046) 238
main 3DM screen 77 Battery voltage is low (0045) 238
Maintenance page 204 Battery voltage is normal (0044) 238
managing email event notification 82 Battery voltage is too high (0048) 239
page refresh frequency 84 Battery voltage is too low (0047) 239
passwords 82 Buffer ECC error corrected (0039) 236
preferences 81 Buffer integrity test failed (0024) 232
problems 223 Cache flush failed, some data lost (0025) 232
remote access, enabling 83 Cache synchronization completed (005E) 242
Scheduling page 201 Cache synchronization failed 242
setting incoming port number 84 Cache synchronization skipped (004F) 240
Settings page 217 Controller error occurred (0003) 227
SMART Details page 196 Controller reset occurred (1001) 227
starting 73 DCB checksum error detected(0027) 233
starting in Linux 75 DCB version unsupported (0028) 233
uninstalling 3DM on Degraded unit (0002) 227
Linux 73 Downgrade UDMA (0021) 231
Windows 71 Drive ECC error reported (0026) 233
Unit Details page 193 Drive error detected (000A) 229
Unit Information page 192 Drive inserted (001A) 231
3ware HTML Bookshelf ix Drive not supported (0030) 235
3ware Sidecar LED status indicators 140 Drive power on reset detected (003A) 236
255 www.3ware.com
www.3ware.com 257
www.3ware.com 259
www.3ware.com 261
W
Warranty 252
WHQL (Windows Hardware Quality Labs),
Microsoft 251
WinAVAlarm 144
Windows alert utility (WinAVAlarm) 144
working in 3BM 61
write cache 14, 198
disable on degrade, part of Storsave profile 119
enabling in 3BM 114
enabling in 3DM 113
write journaling, part of StorSave profile 118