isp(4) and HP variants of the QLogic QLE2562 fibre channel cards

[Scott Burns]

FYI in case someone would like to use the below FC disks in the future.

We picked up the HP branded QLogic 8Gb Fibre Channel card listed below to
test with.

We have been able to successfully install the HP variant of the QLE2562
(AJ764A) using a single Fibre Channel direct connection to a HP M6412A Disk
Enclosure with 8 x 450GB 15K RPM drives in a DL380/G5 running NetBSD/amd64
6.1.4.

We are booting off the internal HP Smart Array raid drives and mounting
these new FC drives for data. The BIOS is disabled on the Fibre Channel card
for this reason and the firmware of the card was updated using the normal
Proliant automated BIOS update DVD beforehand. The enclosure appears to
support the ses device and sesd is happy with the status of the enclosure
and enumerates all the drives it hosts.

Heavily loading the drives with 'dd' generating gigs of IO with no
concerning problems so far.

Now we need to figure out software raid on NetBSD to bind these all
together.

Once this config has been tested for a week we will be moving to a DL380/G6
in production.

Relevant kernel messages:

isp0 at pci4 dev 0 function 0: QLogic FC-AL and 8Gbps Fabric PCI-E HBA
isp0: interrupting at ioapic0 pin 17
isp1 at pci4 dev 0 function 1: QLogic FC-AL and 8Gbps Fabric PCI-E HBA
isp1: interrupting at ioapic0 pin 18
scsibus1 at isp0: 512 targets, 8 luns per target
scsibus1: waiting 2 seconds for devices to settle...
ses0 at scsibus1 target 4 lun 0: <HP, M6412 AG638A, 0062> enclosure
services fixed
sd2 at scsibus1 target 0 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd3 at scsibus1 target 1 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd4 at scsibus1 target 2 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd5 at scsibus1 target 3 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd6 at scsibus1 target 5 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd7 at scsibus1 target 6 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd8 at scsibus1 target 7 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd9 at scsibus1 target 8 lun 0: <HPQ, BF450DA483, HP06> disk fixed

Scott...
-----Original Message-----
From: Scott Burns [mailto:***@SeQent.Com]
Sent: June-24-14 9:58 PM
To: 'netbsd-***@netbsd.org'
Subject: isp(4) and HP variants of the QLogic QLE2562 fibre channel cards

HW: HP DL380/G6
OS: NetBSD/amd64 - 6.1.4

We are looking to hang a Fibre Channel disk expansion off the above
platform.

From my reading of mailing list history etc. it would seem the QLogic driver

appears mature and would probably be our best platform for this
configuration.

My question is regarding OEM branded versions and the isp(4) driver.

The man page reports as supported:

Qlogic 2500
Qlogic 2500 8-Gigabit Optical Fibre Channel PCI cards.

From the QLogic site I see that HP 82Q (AJ764A) and HP AH401A are based on

the QLogic QLE2562 chipset.

If anyone running either of the above two Hewlett Packard branded versions
with the isp(4) driver or should I stay with the generic QLogic QLE2562?

Looking through the driver code I see references to the QLE2532 board but
not the

Thank you
Scott...

[Stephan]

Hi,

what was the throughput when dd´ing data to disk?

Post by Scott Burns
FYI in case someone would like to use the below FC disks in the future.
We picked up the HP branded QLogic 8Gb Fibre Channel card listed below to
test with.
We have been able to successfully install the HP variant of the QLE2562
(AJ764A) using a single Fibre Channel direct connection to a HP M6412A Disk
Enclosure with 8 x 450GB 15K RPM drives in a DL380/G5 running NetBSD/amd64
6.1.4.
We are booting off the internal HP Smart Array raid drives and mounting
these new FC drives for data. The BIOS is disabled on the Fibre Channel card
for this reason and the firmware of the card was updated using the normal
Proliant automated BIOS update DVD beforehand. The enclosure appears to
support the ses device and sesd is happy with the status of the enclosure
and enumerates all the drives it hosts.
Heavily loading the drives with 'dd' generating gigs of IO with no
concerning problems so far.
Now we need to figure out software raid on NetBSD to bind these all
together.
Once this config has been tested for a week we will be moving to a DL380/G6
in production.
isp0 at pci4 dev 0 function 0: QLogic FC-AL and 8Gbps Fabric PCI-E HBA
isp0: interrupting at ioapic0 pin 17
isp1 at pci4 dev 0 function 1: QLogic FC-AL and 8Gbps Fabric PCI-E HBA
isp1: interrupting at ioapic0 pin 18
scsibus1 at isp0: 512 targets, 8 luns per target
scsibus1: waiting 2 seconds for devices to settle...
ses0 at scsibus1 target 4 lun 0: <HP, M6412 AG638A, 0062> enclosure
services fixed
sd2 at scsibus1 target 0 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd3 at scsibus1 target 1 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd4 at scsibus1 target 2 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd5 at scsibus1 target 3 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd6 at scsibus1 target 5 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd7 at scsibus1 target 6 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd8 at scsibus1 target 7 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd9 at scsibus1 target 8 lun 0: <HPQ, BF450DA483, HP06> disk fixed
Scott...
-----Original Message-----
Sent: June-24-14 9:58 PM
Subject: isp(4) and HP variants of the QLogic QLE2562 fibre channel cards
HW: HP DL380/G6
OS: NetBSD/amd64 - 6.1.4
We are looking to hang a Fibre Channel disk expansion off the above
platform.
From my reading of mailing list history etc. it would seem the QLogic driver
appears mature and would probably be our best platform for this
configuration.
My question is regarding OEM branded versions and the isp(4) driver.
Qlogic 2500
Qlogic 2500 8-Gigabit Optical Fibre Channel PCI cards.
From the QLogic site I see that HP 82Q (AJ764A) and HP AH401A are based on
the QLogic QLE2562 chipset.
If anyone running either of the above two Hewlett Packard branded versions
with the isp(4) driver or should I stay with the generic QLogic QLE2562?
Looking through the driver code I see references to the QLE2532 board but
not the
Thank you
Scott...

[Scott Burns]

I am not in the office but I know the card is 8Gb per the kernel probe below. The drives are 4Gb FC (HP BF450DA483) as is the drive enclosure (HP M6412A).

Disk Label:

testfc# disklabel -r sd2
# /dev/rsd2d:
type: SCSI
disk: BF450DA483
label: fictitious
flags:
bytes/sector: 512
sectors/track: 716
tracks/cylinder: 8
sectors/cylinder: 5728
cylinders: 153352
total sectors: 878906250
rpm: 15015
interleave: 1
trackskew: 0
cylinderskew: 0
headswitch: 0 # microseconds
track-to-track seek: 0 # microseconds
drivedata: 0

4 partitions:
# size offset fstype [fsize bsize cpg/sgs]
a: 878906250 0 4.2BSD 0 0 0 # (Cyl. 0 - 153440*)
d: 878906250 0 unused 0 0 # (Cyl. 0 - 153440*)

Running this test:

dd if=/dev/zero of=/sd2/iotest.del count=350000 bs=16384 >> /tmp/iotest.log
2>> /tmp/iotest.log

dd if=/sd2/iotest.del of=/dev/null count=350000 bs=16384 >> /tmp/iotest.log
2>> /tmp/iotest.log

Where /sd2 is the mount point for the first drive listed in the kernel output below the results are:

Write:
350000+0 records in
350000+0 records out
5734400000 bytes transferred in 380.728 secs (15061671 bytes/sec)

Read:
350000+0 records in
350000+0 records out
5734400000 bytes transferred in 12.978 secs (441855447 bytes/sec)

Scott...
-----Original Message-----
From: Stephan [mailto:***@googlemail.com]
Sent: July-04-14 1:28 AM
To: ***@seqent.com
Cc: NetBSD Users's Discussion List
Subject: Re: isp(4) and HP variants of the QLogic QLE2562 fibre channel cards

Hi,

what was the throughput when dd´ing data to disk?

Post by Scott Burns
FYI in case someone would like to use the below FC disks in the future.
We picked up the HP branded QLogic 8Gb Fibre Channel card listed below
to test with.
We have been able to successfully install the HP variant of the QLE2562
(AJ764A) using a single Fibre Channel direct connection to a HP M6412A
Disk Enclosure with 8 x 450GB 15K RPM drives in a DL380/G5 running
NetBSD/amd64 6.1.4.
We are booting off the internal HP Smart Array raid drives and
mounting these new FC drives for data. The BIOS is disabled on the
Fibre Channel card for this reason and the firmware of the card was
updated using the normal Proliant automated BIOS update DVD
beforehand. The enclosure appears to support the ses device and sesd
is happy with the status of the enclosure and enumerates all the drives it hosts.
Heavily loading the drives with 'dd' generating gigs of IO with no
concerning problems so far.
Now we need to figure out software raid on NetBSD to bind these all
together.
Once this config has been tested for a week we will be moving to a
DL380/G6 in production.
isp0 at pci4 dev 0 function 0: QLogic FC-AL and 8Gbps Fabric PCI-E HBA
isp0: interrupting at ioapic0 pin 17
isp1 at pci4 dev 0 function 1: QLogic FC-AL and 8Gbps Fabric PCI-E HBA
isp1: interrupting at ioapic0 pin 18
scsibus1 at isp0: 512 targets, 8 luns per target
scsibus1: waiting 2 seconds for devices to settle...
ses0 at scsibus1 target 4 lun 0: <HP, M6412 AG638A, 0062> enclosure
services fixed
sd2 at scsibus1 target 0 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd3 at scsibus1 target 1 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd4 at scsibus1 target 2 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd5 at scsibus1 target 3 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd6 at scsibus1 target 5 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd7 at scsibus1 target 6 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd8 at scsibus1 target 7 lun 0: <HPQ, BF450DA483, HP06> disk fixed
sd9 at scsibus1 target 8 lun 0: <HPQ, BF450DA483, HP06> disk fixed
Scott...
-----Original Message-----
Sent: June-24-14 9:58 PM
Subject: isp(4) and HP variants of the QLogic QLE2562 fibre channel cards
HW: HP DL380/G6
OS: NetBSD/amd64 - 6.1.4
We are looking to hang a Fibre Channel disk expansion off the above
platform.
From my reading of mailing list history etc. it would seem the QLogic
driver appears mature and would probably be our best platform for this
configuration.
My question is regarding OEM branded versions and the isp(4) driver.
Qlogic 2500
Qlogic 2500 8-Gigabit Optical Fibre Channel PCI cards.
From the QLogic site I see that HP 82Q (AJ764A) and HP AH401A are
based on the QLogic QLE2562 chipset.
If anyone running either of the above two Hewlett Packard branded
versions with the isp(4) driver or should I stay with the generic QLogic QLE2562?
Looking through the driver code I see references to the QLE2532 board
but not the
Thank you
Scott...

[Scott Burns]

Retesting after issuing:

testfc# scsictl sd2 setcache rw
testfc# scsictl sd2 getcache
/dev/rsd2d: read cache enabled
/dev/rsd2d: write-back cache enabled
/dev/rsd2d: caching parameters are savable

This has reduced the write time by about a factor of 10:

350000+0 records in
350000+0 records out
5734400000 bytes transferred in 35.770 secs (160313111 bytes/sec)
350000+0 records in
350000+0 records out
5734400000 bytes transferred in 12.814 secs (447510535 bytes/sec)

Originally about 380 seconds to write it has dropped to ~36 seconds.

Scott...