Hi there

Sun V480 + D1000 cluster with VxVM/VCS 4.0.
Two nodes, torapp47 & tordbs48, two D1000 mirrored
The two nodes (torapp47, tordbs48) share 2 D1000 by standard
connections, meaning each connects to outer interfaces of the D1000s.
The inner interfaces of each D1000 is connected by a short SCSI
connector cable (so one scsi bus?!). The 2 D1000 are mirrored by VxVM.

Two faiover (active/passive) service groups
service group A active on torapp47, contains disk group dstsdg, which
has 3 disks in D1000. File system of dstsdg mounted on torapp47
service group B active on tordbs48, contains disk group oracledg,
which has other 9 disks in same D1000. File system of oracledg mounted
on tordbs48

scsi-initiator-id set to 6 on tordbs48

tordbs48# eeprom nvramrc
nvramrc=probe-all
cd /pci@8,600000/scsi@1
6 " scsi-initiator-id" integer-property
device-end
cd /pci@8,700000/scsi@2
6 " scsi-initiator-id" integer-property
device-end
install-console
banner
devalias vx-rootmirror
/pci@9,600000/SUNW,qlc@2/fp@0,0/disk@w21000000871b7a06,0:a
devalias vx-rootdisk
/pci@9,600000/SUNW,qlc@2/fp@0,0/disk@w21000000871c2127,0:a
devalias rootmirror /pci@9,600000/SUNW,qlc@2/fp@0,0/disk@w21000000871b7a06,0:a
devalias rootdisk /pci@9,600000/SUNW,qlc@2/fp@0,0/disk@w21000000871c2127,0:a


When one of the nodes is shut down or reboot, or perform service group
failover, or even umount file systems on D1000 , the other running
node always got scsi reset errors.

Jul 7 11:12:12 tordbs48 scsi: WARNING: /pci@8,600000/scsi@1 (glm2):
Jul 7 11:12:12 tordbs48 got SCSI bus reset
Jul 7 11:12:12 tordbs48 scsi: WARNING: /pci@8,600000/scsi@1/sd@c,0
(sd41):
Jul 7 11:12:12 tordbs48 SCSI transport failed: reason 'reset':
retrying command
Jul 7 11:12:15 tordbs48 scsi: WARNING: /pci@8,600000/scsi@1/sd@3,0
(sd33):
Jul 7 11:12:15 tordbs48 Error for Command: write(10)
Error Level: Retryable
Jul 7 11:12:15 tordbs48 scsi: Requested Block: 2625920
Error Block: 2625920
Jul 7 11:12:15 tordbs48 scsi: Vendor: FUJITSU
Serial Number: 0224X45616
Jul 7 11:12:15 tordbs48 scsi: Sense Key: Unit Attention
Jul 7 11:12:15 tordbs48 scsi: ASC: 0x29 (<vendor unique code 0x29>),
ASCQ: 0x2, FRU: 0x0
Jul 7 11:12:15 tordbs48 scsi: WARNING: /pci@8,600000/scsi@1/sd@c,0
(sd41):
Jul 7 11:12:15 tordbs48 Error for Command: write(10)
Error Level: Retryable
Jul 7 11:12:15 tordbs48 scsi: Requested Block: 44181760
Error Block: 44181760
Jul 7 11:12:15 tordbs48 scsi: Vendor: FUJITSU
Serial Number: 0206X37068
Jul 7 11:12:15 tordbs48 scsi: Sense Key: Unit Attention
Jul 7 11:12:15 tordbs48 scsi: ASC: 0x29 (<vendor unique code 0x29>),
ASCQ: 0x2, FRU: 0x0
Jul 7 11:12:16 tordbs48 scsi: WARNING: /pci@8,700000/scsi@2/sd@2,0
(sd2):
Jul 7 11:12:16 tordbs48 Error for Command: read(10)
Error Level: Retryable
Jul 7 11:12:16 tordbs48 scsi: Requested Block: 26216704
Error Block: 26216704
Jul 7 11:12:16 tordbs48 scsi: Vendor: FUJITSU
Serial Number: 0349N06RP6
Jul 7 11:12:16 tordbs48 scsi: Sense Key: Unit Attention
Jul 7 11:12:16 tordbs48 scsi: ASC: 0x29 (<vendor unique code 0x29>),
ASCQ: 0x2, FRU: 0x0
Jul 7 11:12:16 tordbs48 scsi: WARNING: /pci@8,700000/scsi@2/sd@3,0
(sd3):
Jul 7 11:12:16 tordbs48 Error for Command: write(10)
Error Level: Retryable
Jul 7 11:12:16 tordbs48 scsi: Requested Block: 2625920
Error Block: 2625920
Jul 7 11:12:16 tordbs48 scsi: Vendor: FUJITSU
Serial Number: 0349N06RCE
Jul 7 11:12:16 tordbs48 scsi: Sense Key: Unit Attention
Jul 7 11:12:16 tordbs48 scsi: ASC: 0x29 (<vendor unique code 0x29>),
ASCQ: 0x2, FRU: 0x0
Jul 7 11:12:16 tordbs48 scsi: WARNING: /pci@8,700000/scsi@2/sd@c,0
(sd11):
Jul 7 11:12:16 tordbs48 Error for Command: read(10)
Error Level: Retryable
Jul 7 11:12:16 tordbs48 scsi: Requested Block: 44183808
Error Block: 44183808
Jul 7 11:12:16 tordbs48 scsi: Vendor: FUJITSU
Serial Number: 0224X45095
Jul 7 11:12:16 tordbs48 scsi: Sense Key: Unit Attention
Jul 7 11:12:16 tordbs48 scsi: ASC: 0x29 (<vendor unique code 0x29>),
ASCQ: 0x2, FRU: 0x0
Jul 7 11:12:16 tordbs48 scsi: WARNING: /pci@8,600000/scsi@1/sd@9,0
(sd38):
Jul 7 11:12:16 tordbs48 Error for Command: write(10)
Error Level: Retryable
Jul 7 11:12:16 tordbs48 scsi: Requested Block: 26225296
Error Block: 26225296
Jul 7 11:12:16 tordbs48 scsi: Vendor: FUJITSU
Serial Number: 0233X12603
Jul 7 11:12:16 tordbs48 scsi: Sense Key: Unit Attention
Jul 7 11:12:16 tordbs48 scsi: ASC: 0x29 (<vendor unique code 0x29>),
ASCQ: 0x2, FRU: 0x0


Please advise if there is any problem of this configuration.
Is it because the same D1000 (only one scsi bus ??) has two disk
groups, each of which is on different node?

Thanks a lot.

Perry