ARCHIVED as no longer relevant.
Layout as of 2018-05-27 2300 UTC
Notes:
The "Disk Group" is the group in the PERC bios associated with a RAID0 per physical disk. They appear to translate to the mfid? number used in FreeBSD. For example, Disk Group 0 maps to mfid0 (physical disk E1:S0). Disk Group 9 appears to map to mfid9 (physical disk E1:S11) Unfortunately, these group IDs seem to change when physical disks are added/removed, so when "mfid5" failed, the disk name changed on reboot and mfid5 no longer referred to the failed E1:S5 but now refers to E1:S8. The only way to obtain this mapping is by viewing the PERC BIOS.
Fortunately, ZFS seems to be able to detect this and can reconstitute the zpools, but it makes it very difficult to figure out what physical drive maps to which mfid? device, and replacing drives requires rebooting the machine and verifying the changed device mappings. Some of this can be identified with mfiutil, but the canonical disk group to physical disk mapping is only available via the PERC BIOS.
Current VG to PD mapping:
| Disk Group | Virtual Disk ID | PD ID | Physical Disk | Serial | zpool |
|---|---|---|---|---|---|
| 0 | 0 | 01:00:00 | E1:S0 | S0CNNEAZ800006 | (SSD) x1 cache |
| 1 | 1 | 01:00:01 | E1:S1 | S0CNNEAZ800068 | (SSD) x2 (hermes queue) |
| 2 | 2 | 01:00:02 | E1:S2 | ||
| 3 | 7 | 01:00:07 | E1:S7 | 3SL1L8MR | x1 mfid3 |
| 4 | 4 | 01:00:04 | E1:S4 | 6SL7WEZD | x1 mfid4 |
| 5 | 9 | 01:00:08 | E1:S8 | S7M06MM4 | zroot mfid5p3 |
| 6 | 3 | 01:00:03 | E1:S3 | (spare) | |
| 7 | 6 | 01:00:06 | E1:S6 | 6SL8CWXW | (spare) |
| 8 | 8 | 01:00:11 | E1:S11 | 6SL8TQ1Y | x1 mfid8 |
| 9 | 5 | 01:00:05 | E1:S05 | S7M07CJ2 | x1 mfid9 |
mfi0 Volumes: Id Size Level Stripe State Cache Name mfid0 ( 92G) RAID-0 64k OPTIMAL Disabled mfid1 ( 92G) RAID-0 64k OPTIMAL Disabled mfid2 ( 558G) RAID-0 64k OPTIMAL Disabled mfid3 ( 558G) RAID-0 64k OPTIMAL Disabled mfid4 ( 558G) RAID-0 64k OPTIMAL Writes mfid5 ( 558G) RAID-0 64k OPTIMAL Writes mfid8 ( 558G) RAID-0 64k OPTIMAL Disabled mfid9 ( 558G) RAID-0 64k OPTIMAL Writes
mfi0 Physical Drives: 0 ( 93G) ONLINE <SAMSUNG MCCOE1HG CD3Q serial=S0CNNEAZ800006> SATA E1:S0 1 ( 93G) ONLINE <SAMSUNG MCCOE1HG CD3Q serial=S0CNNEAZ800068> SATA E1:S1 2 ( 558G) ONLINE <SEAGATE ST3600057SS ES64 serial=3SL1KVQZ> SAS E1:S2 4 ( 558G) ONLINE <SEAGATE ST3600057SS 000B serial=6SL7WEZD> SAS E1:S4 5 ( 558G) ONLINE <SEAGATE ST600MP0005 VS08 serial=S7M07QY6> SCSI-6 E1:S5 6 ( 558G) UNCONFIGURED GOOD <SEAGATE ST600MP0005 VS08 serial=S7M08WVC> SCSI-6 E1:S6 7 ( 558G) ONLINE <SEAGATE ST3600057SS ES64 serial=3SL1L8MR> SAS E1:S7 8 ( 558G) ONLINE <SEAGATE ST600MP0005 VS08 serial=S7M06MM4> SCSI-6 E1:S8 11 ( 558G) ONLINE <SEAGATE ST600MP0005 VS08 serial=S7M07CJ2> SCSI-6 E1:S11
pool: x1 state: ONLINE scan: resilvered 167G in 11h30m with 0 errors on Sun May 27 05:45:05 2018 config: NAME STATE READ WRITE CKSUM x1 ONLINE 0 0 0 raidz1-0 ONLINE 0 0 0 mfid4 ONLINE 0 0 0 mfid8 ONLINE 0 0 0 mfid9 ONLINE 0 0 0 mfid3 ONLINE 0 0 0 cache mfid0 ONLINE 0 0 0 errors: No known data errors pool: x2 state: ONLINE scan: scrub repaired 0 in 0h0m with 0 errors on Sun Dec 31 20:40:13 2017 config: NAME STATE READ WRITE CKSUM x2 ONLINE 0 0 0 mfid1 ONLINE 0 0 0 errors: No known data errors pool: zroot state: ONLINE scan: resilvered 5.03G in 0h0m with 0 errors on Sun May 27 18:43:21 2018 config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 mfid2p3 ONLINE 0 0 0 mfid5p3 ONLINE 0 0 0 errors: No known data errors
email users@infra.apache.org
for any queries or suggestions.