SEO

Hello people.

I have an OpenBSD 3.3 server with 4 80gb wd 800JB disks, configured with 3
raid5 volumes on it. The mainboard is an Abit KT7a with integrated ATA100
controller. The machine has 512 mb ram, a Duron 600 cpu and 2 intel 10/100
NICs. The KT7a has been tested with several different BIOSes, currently
running the newest.

The machine works great, but RAID performance is poor. Reading from a single
raw disk yields 30 to 40 mb/s as expected, but reading from a raw raid
volume (i.e. /dev/raid2c) only yields between 10 and 12 mb/s. Write
performance is similar. I would have expected to see at least similar values
as when reading from a single disk, given the amount of ram, fairly usable
processor (no performance increase compared to pentium II 400) and that I
have 4 physical disks to read from.

I tried to connect the disks to a Highpoint Rocket133 controller (HPT302),
which I created a 3.3 driver for, but values are almost exactly the same,
maybe 5% or so better.

I suspect that I have done something terribly wrong while configuring the
RAID sets, and would like comments on my setup. I have however tried
different stripe unit sizes (as can be seen in the config files), but with
no luck. Here are the raid config files used to create the volumes:

raid0.conf:
START array
1 4 0

START disks
/dev/wd0e
/dev/wd2e
/dev/wd1e
/dev/wd3e

START layout
64 1 1 5

START queue
fifo 100


raid1.conf:
START array
1 4 0

START disks
/dev/wd0f
/dev/wd3f
/dev/wd1f
/dev/wd2f

START layout
32 1 1 5

START queue
fifo 100

raid2.conf:
START array
1 4 0

START disks
/dev/wd0g
/dev/wd2g
/dev/wd1g
/dev/wd3g

START layout
64 1 1 5

START queue
fifo 100


The disks (wd0-3) have the following disk label:
# using MBR partition 3: type A6 off 63 (0x3f) size 156296322 (0x950e482)
# /dev/rwd0c:
type: ESDI
disk: ESDI/IDE disk
label: WDC WD800JB-00C
flags:
bytes/sector: 512
sectors/track: 63
tracks/cylinder: 16
sectors/cylinder: 1008
cylinders: 16383
total sectors: 156301488
rpm: 7200
interleave: 1
trackskew: 0
cylinderskew: 0
headswitch: 0 # microseconds
track-to-track seek: 0 # microseconds
drivedata: 0

16 partitions:
# size offset fstype [fsize bsize cpg]
a: 204800 63 4.2BSD 1024 8192 16 # (Cyl. 0*- 203*)
b: 102400 204863 swap # (Cyl. 203*- 304*)
c: 156301488 0 unused 0 0 # (Cyl. 0 -
155060)
d: 1024000 307263 4.2BSD 1024 8192 16 # (Cyl. 304*-
1320*)
e: 512000 1331263 RAID # (Cyl. 1320*-
1828*)
f: 5120000 1843263 RAID # (Cyl. 1828*-
6907*)
g: 149333122 6963263 RAID # (Cyl. 6907*-
155055*)


Output from dd on the raid volumes:
$ sudo dd if=/dev/raid0c of=/dev/null count=1024 bs=32k
1024+0 records in
1024+0 records out
33554432 bytes transferred in 2.702 secs (12415855 bytes/sec)
$ sudo dd if=/dev/raid1c of=/dev/null count=1024 bs=32k
1024+0 records in
1024+0 records out
33554432 bytes transferred in 3.429 secs (9783381 bytes/sec)
$ sudo dd if=/dev/raid2c of=/dev/null count=1024 bs=32k
1024+0 records in
1024+0 records out
33554432 bytes transferred in 2.778 secs (12077781 bytes/sec)

/dev/wd0a is mounted on /miniboot in order to easily copy newly compiled
kernels to the BIOS boot partition.

Any suggestions will be appreciated. To answer by email, please remove the
obvious part of my email address.

Thanks in advance
Helge Olsen

I forgot to add dmesg output to my last post. here it is:


OpenBSD 3.3 (SERVER) #11: Mon Oct 27 16:29:19 CET 2003
nospam@server.olsentech.net:/usr/src/sys/arch/i386/compile/SERVER
cpu0: AMD Duron Model 3 (Spitfire) ("AuthenticAMD" 686-class) 600 MHz
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,SYS,MTRR,PGE,MC A,CMOV,PAT,PSE36,MMX,FXSR
real mem = 536391680 (523820K)
avail mem = 240197632 (234568K)
using 4278 buffers containing 280363008 bytes (273792K) of memory
mainbus0 (root)
bios0 at mainbus0: AT/286+(f1) BIOS, date 07/11/02, BIOS32 rev. 0 @ 0xfb4b0
pcibios0 at bios0: rev. 2.1 @ 0xf0000/0xdf94
pcibios0: PCI IRQ Routing Table rev. 1.0 @ 0xfdee0/176 (9 entries)
pcibios0: PCI Exclusive IRQs: 10 11 12
pcibios0: PCI Interrupt Router at 000:07:0 ("VIA VT82C596A PCI-ISA" rev
0x00)
pcibios0: PCI bus #1 is the last bus
bios0: ROM list: 0xc0000/0x8000 0xc8000/0x1800 0xca000/0x1000
pci0 at mainbus0 bus 0: configuration mode 1 (no bios)
pchb0 at pci0 dev 0 function 0 "VIA VT8363 Host" rev 0x03
ppb0 at pci0 dev 1 function 0 "VIA VT8363 PCI-AGP" rev 0x00
pci1 at ppb0 bus 1
pcib0 at pci0 dev 7 function 0 "VIA VT82C686 PCI-ISA" rev 0x40
pciide0 at pci0 dev 7 function 1 "VIA VT82C571 IDE" rev 0x06: ATA100,
channel 0 configured to compatibility, channel 1 configured to compatibility
wd0 at pciide0 channel 0 drive 0: <WDC WD800JB-00CRA1>
wd0: 16-sector PIO, LBA, 76319MB, 16383 cyl, 16 head, 63 sec, 156301488
sectors
wd1 at pciide0 channel 0 drive 1: <WDC WD800JB-00CRA1>
wd1: 16-sector PIO, LBA, 76319MB, 16383 cyl, 16 head, 63 sec, 156301488
sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 5
wd1(pciide0:0:1): using PIO mode 4, Ultra-DMA mode 5
wd2 at pciide0 channel 1 drive 0: <WDC WD800JB-00ETA0>
wd2: 16-sector PIO, LBA48, 76319MB, 16383 cyl, 16 head, 63 sec, 156301488
sectors
wd3 at pciide0 channel 1 drive 1: <WDC WD800JB-00ETA0>
wd3: 16-sector PIO, LBA48, 76319MB, 16383 cyl, 16 head, 63 sec, 156301488
sectors
wd2(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 5
wd3(pciide0:1:1): using PIO mode 4, Ultra-DMA mode 5
"VIA VT82C686 SMBus" rev 0x40 at pci0 dev 7 function 4 not configured
fxp0 at pci0 dev 11 function 0 "Intel 82557" rev 0x08: irq 11, address
00:02:a5:41:85:4e
inphy0 at fxp0 phy 1: i82555 10/100 media interface, rev. 4
fxp1 at pci0 dev 15 function 0 "Intel 82557" rev 0x08: irq 10, address
00:02:b3:26:e6:6f
inphy1 at fxp1 phy 1: i82555 10/100 media interface, rev. 4
vga1 at pci0 dev 17 function 0 "Tseng Labs ET6000/ET6100" rev 0x30
wsdisplay0 at vga1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
isa0 at pcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
sysbeep0 at pcppi0
lpt0 at isa0 port 0x378/4 irq 7
npx0 at isa0 port 0xf0/16: using exception 16
pccom0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
pccom1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
biomask c040 netmask cc40 ttymask ccc2
pctr: user-level cycle counter enabled
mtrr: Pentium Pro MTRR support
Kernelized RAIDframe activated
raid0 (root): (RAID Level 5) total number of sectors is 1535808 (749 MB)
raid1 (root): (RAID Level 5) total number of sectors is 15359808 (7499 MB)
as root
raid2 (root): (RAID Level 5) total number of sectors is 447999168 (218749
MB)
dkcsum: wd0 matched BIOS disk 80
dkcsum: wd1 matched BIOS disk 81
dkcsum: warning: dup BSD->BIOS disk mapping
dkcsum: wd2 matched BIOS disk 82
dkcsum: warning: dup BSD->BIOS disk mapping
dkcsum: wd3 matched BIOS disk 83
rootdev=0x1310 rrootdev=0x3610 rawdev=0x3612