Opened 8 years ago

Last modified 8 years ago

#236 assigned defect

fallo en c2t5000CCA369C509D4d0

Reported by: fernando Owned by: fernando
Priority: major Milestone:
Component: TracMeteo Keywords:
Cc:

Description (last modified by fernando)

  • c2t5000CCA369C509D4d0 FAULTED 0 32 0 too many errors
  • iostat -exn c2t5000CCA369C509D4d0: 0.1 3.6 2.2 76.3 0.0 0.0 0.0 1.2 0 0 2 0 6 8 c2t5000CCA369C509D4d0
admin@seal:~$ iostat -Ex  c2t5000CCA369C509D4d0
                 extended device statistics
device    r/s    w/s   kr/s   kw/s wait actv  svc_t  %w  %b
sd175     0.1    3.6    2.2   76.2  0.0  0.0    1.2   0   0
sd175     Soft Errors: 2 Hard Errors: 0 Transport Errors: 6
Vendor: ATA      Product: Hitachi HDS72302 Revision: A580 Serial No: MN3220F30B2LHE
Size: 2000.40GB <2000398934016 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 2
Illegal Request: 0 Predictive Failure Analysis: 0


fmdump -m -u 02b085b1-7953-4554-c4b1-f1302bcff05d
SUNW-MSG-ID: ZFS-8000-FD, TYPE: Fault, VER: 1, SEVERITY: Major
EVENT-TIME: Sat May 18 06:44:46 CEST 2013
PLATFORM: X8DTH-i-6-iF-6F, CSN: 1234567890, HOSTNAME: seal
SOURCE: zfs-diagnosis, REV: 1.0
EVENT-ID: 02b085b1-7953-4554-c4b1-f1302bcff05d
DESC: The number of I/O errors associated with a ZFS device exceeded
             acceptable levels.  Refer to http://illumos.org/msg/ZFS-8000-FD for more information.
AUTO-RESPONSE: The device has been offlined and marked as faulted.  An attempt
             will be made to activate a hot spare if available.
IMPACT: Fault tolerance of the pool may be compromised.
REC-ACTION: Run 'zpool status -x' and replace the bad device.

Señalizar y deseñalizar:

root@seal:~/LSIUTIL/sg3_utils-1.34/src# sg_ses -I 0,0 --set=fault /dev/es/ses2
root@seal:~/LSIUTIL/sg3_utils-1.34/src# sg_ses -I 0,0 --clear=fault /dev/es/ses2

Reemplazo:

log al meter el nuevo disco:
Jun 11 16:50:27 seal genunix: [ID 483743 kern.info] /scsi_vhci/disk@g5000cca369c508e5 (sd63) multipath status: degraded: path 7 mpt_sas4/disk@w5000cca369c508e5,0 is online

zpool replace depot c2t5000CCA369C509D4d0 c2t5000CCA369C508E5d0
sudo zpool detach depot c2t5000CCA369C509D4d0


Change History (5)

comment:1 Changed 8 years ago by fernando

  • Description modified (diff)
  • Owner set to fernando
  • Status changed from new to assigned

comment:2 Changed 8 years ago by fernando

El sistema lo marca como unconfigured, por lo que no funciona la herramienta sg_inq ni la herramienta smarctl dan "I/O error"

root@seal:~/LSIUTIL# cfgadm -av c9|grep uncon
c9::w5000cca369c509d4,0        connected    unconfigured unknown    Client Device: /dev/dsk/c2t5000CCA369C509D4d0s0(sd175)

root@seal:~/LSIUTIL/sg3_utils-1.34/src# sg_inq -u /dev/rdsk/c2t5000CCA369C509D4d0
inquiry: pass through os error: I/O error
    inquiry: failed, res=-1


root@seal:~/LSIUTIL/smartmontools-6.0# smartctl -a -d sat /dev/rdsk/c2t5000CCA369C509D4d0s0

comment:3 Changed 8 years ago by fernando

  • Description modified (diff)

comment:4 Changed 8 years ago by fernando

En este caso utilizo los números de serie que hay en https://www.meteo.unican.es/trac/meteo/wiki/Jbods

o bien directamente con el dispositivo "LETRAS en minúscula" /device/SCSI_vhci/disk@g.........

y mirando el "attached-port" value='w5003048001155a7f'

prtconf -Dcv /devices/scsi_vhci/disk@g5000cca369c509d4

root@seal:~/LSIUTIL/sg3_utils-1.34/src# prtconf -v|grep -B6 -A310 F30B2LHE|more
        disk, instance #175
            System software properties:
                name='ddi-devid-registrant' type=int items=1
                    value=00000001
            Driver properties:
                name='inquiry-serial-no' type=string items=1 dev=none
                    value='MN3220F30B2LHE'
                name='pm-components' type=string items=3 dev=none
                    value='NAME=spindle-motor' + '0=off' + '1=on'
                name='pm-hardware-state' type=string items=1 dev=none
                    value='needs-suspend-resume'
                name='ddi-failfast-supported' type=boolean dev=none
                name='ddi-kernel-ioctl' type=boolean dev=none
                name='fm-ereport-capable' type=boolean dev=none
                name='device-nblocks' type=int64 items=1 dev=none
                    value=00000000e8e088b0
                name='device-blksize' type=int items=1 dev=none
                    value=00000200
            Hardware properties:
                name='devid' type=string items=1
                    value='id1,sd@n5000cca369c509d4'
                name='class' type=string items=1
                    value='scsi'
                name='inquiry-revision-id' type=string items=1
                    value='A580'
                name='inquiry-product-id' type=string items=1
                    value='Hitachi HDS72302'
                name='inquiry-vendor-id' type=string items=1
                    value='ATA'
                name='inquiry-device-type' type=int items=1
                    value=00000000
                name='pm-capable' type=int items=1
                    value=00000001
                name='compatible' type=string items=4
                    value='scsiclass,00.vATA.pHitachi_HDS72302.rA580' + 'scsiclass,00.vATA.pHitachi_HDS72302' + 'sc
siclass,00' + 'scsiclass'
                name='client-guid' type=string items=1
                    value='5000cca369c509d4'
            Paths from multipath bus adapters:
                Path 136: /pci@7a,0/pci8086,340e@7/pci1000,3080@0/iport@f0/disk@w5000cca369c509d4,0
                mpt_sas#4 (offline)
                        name='wwn' type=string items=1
                            value='5000cca369c509d4'
                        name='lun' type=int items=1
                            value=00000000
                        name='lun64' type=int64 items=1
                            value=0000000000000000
                        name='target-port' type=string items=1
                            value='w5000cca369c509d4'
                        name='attached-port' type=string items=1
                            value='w5003048001155a7f'
                        name='obp-path' type=string items=1
                            value='/pci@7a,0/pci8086,340e@7/pci1000,3080@0/disk@w5000cca369c509d4,0'
                        name='phy-num' type=int items=1
                            value=0000000c
                        name='path-class' type=string items=1
                            value='primary'
            Device Minor Nodes:
                dev=(269,11200)
                    dev_path=/scsi_vhci/disk@g5000cca369c509d4:a
                        spectype=blk type=minor
                        dev_link=/dev/dsk/c2t5000CCA369C509D4d0s0
                    dev_path=/scsi_vhci/disk@g5000cca369c509d4:a,raw
                        spectype=chr type=minor
                        dev_link=/dev/rdsk/c2t5000CCA369C509D4d0s0
                    Device Minor Layered Under:
                        mod=zfs accesstype=blk
                            dev_path=/pseudo/zfs@0

comment:5 Changed 8 years ago by fernando

  • Description modified (diff)

En este caso utilizo los números de serie que hay en https://www.meteo.unican.es/trac/meteo/wiki/Jbods

o bien directamente con el dispositivo "LETRAS en minúscula" /device/SCSI_vhci/disk@g.........

y mirando el "attached-port" value='w5003048001155a7f'

prtconf -Dcv /devices/scsi_vhci/disk@g5000cca369c509d4

root@seal:~/LSIUTIL/sg3_utils-1.34/src# prtconf -v|grep -B6 -A310 F30B2LHE|more
        disk, instance #175
            System software properties:
                name='ddi-devid-registrant' type=int items=1
                    value=00000001
            Driver properties:
                name='inquiry-serial-no' type=string items=1 dev=none
                    value='MN3220F30B2LHE'
                name='pm-components' type=string items=3 dev=none
                    value='NAME=spindle-motor' + '0=off' + '1=on'
                name='pm-hardware-state' type=string items=1 dev=none
                    value='needs-suspend-resume'
                name='ddi-failfast-supported' type=boolean dev=none
                name='ddi-kernel-ioctl' type=boolean dev=none
                name='fm-ereport-capable' type=boolean dev=none
                name='device-nblocks' type=int64 items=1 dev=none
                    value=00000000e8e088b0
                name='device-blksize' type=int items=1 dev=none
                    value=00000200
            Hardware properties:
                name='devid' type=string items=1
                    value='id1,sd@n5000cca369c509d4'
                name='class' type=string items=1
                    value='scsi'
                name='inquiry-revision-id' type=string items=1
                    value='A580'
                name='inquiry-product-id' type=string items=1
                    value='Hitachi HDS72302'
                name='inquiry-vendor-id' type=string items=1
                    value='ATA'
                name='inquiry-device-type' type=int items=1
                    value=00000000
                name='pm-capable' type=int items=1
                    value=00000001
                name='compatible' type=string items=4
                    value='scsiclass,00.vATA.pHitachi_HDS72302.rA580' + 'scsiclass,00.vATA.pHitachi_HDS72302' + 'sc
siclass,00' + 'scsiclass'
                name='client-guid' type=string items=1
                    value='5000cca369c509d4'
            Paths from multipath bus adapters:
                Path 136: /pci@7a,0/pci8086,340e@7/pci1000,3080@0/iport@f0/disk@w5000cca369c509d4,0
                mpt_sas#4 (offline)
                        name='wwn' type=string items=1
                            value='5000cca369c509d4'
                        name='lun' type=int items=1
                            value=00000000
                        name='lun64' type=int64 items=1
                            value=0000000000000000
                        name='target-port' type=string items=1
                            value='w5000cca369c509d4'
                        name='attached-port' type=string items=1
                            value='w5003048001155a7f'
                        name='obp-path' type=string items=1
                            value='/pci@7a,0/pci8086,340e@7/pci1000,3080@0/disk@w5000cca369c509d4,0'
                        name='phy-num' type=int items=1
                            value=0000000c
                        name='path-class' type=string items=1
                            value='primary'
            Device Minor Nodes:
                dev=(269,11200)
                    dev_path=/scsi_vhci/disk@g5000cca369c509d4:a
                        spectype=blk type=minor
                        dev_link=/dev/dsk/c2t5000CCA369C509D4d0s0
                    dev_path=/scsi_vhci/disk@g5000cca369c509d4:a,raw
                        spectype=chr type=minor
                        dev_link=/dev/rdsk/c2t5000CCA369C509D4d0s0
                    Device Minor Layered Under:
                        mod=zfs accesstype=blk
                            dev_path=/pseudo/zfs@0

Note: See TracTickets for help on using tickets.