Hi Everyone.
First of all XPEnology is great fun project. I hope its never end or Synology wont block all of us and we will use future release (DSM6) with our customs systems.
I bought 1 months ago HP MS Gen8. What a beatiful and usefull small piece of system. But I have some weird problems. Mine system come with G1640T and 4 GB memory. After some trials I change some parts.
Intel Xeon E3-1270 v2 - 4 x 3.5 Ghz
2 x 8 GB Kingstone 10600 Mhz ECC
4 x 4TB Western Digital Red NAS Disks
1 x 240 GB SSD
AHCI Mode
At first I use HP Custom ESXi 6 Update 1 image from Jan 2016 with MicroSD card. But sometimes when I reboot system it wont see the card. I know that is card of iLo problem. Then I move to USB stick for ESXi. But couple of time USB make some problems and I reinstall. Know I'm using another USB. At that stage I have G1640T and 4GB Ram.
Last week ESXi 6 Update 2 rolled out. And I made fresh install on USB. It found my datastore on 240 GB SSD. I create Physical RDM files for my 4 x 4TB Disks and create DSM 5.2 VM. So far so good. I have good speed (100-110 mb write over Samba) and I copy almost all data from my old Zyxel NAS to DSM 5.2. Then I reboot ESXi and DSM wont start. It said it cant lock file or somethink like that. After couple restart it start but it freeze. VMWare Embedded Web Client wont freeze but I cant even stop DSM. Even after couple restart nothing change. Then I look ESXi Logs. I saw lots of errors.
2016-03-23T23:50:04.959Z cpu5:32796)ScsiDeviceIO: 2613: Cmd(0x439d80362680) 0x85, CmdSN 0x2f from world 35341 to dev "t10.ATA_____WDC_WD40EFRX2D68WT0N0_________________________WD2DWCC4E4XPHS2P" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0xb 0x0 0x0.
2016-03-23T23:50:04.964Z cpu5:32796)ScsiDeviceIO: 2613: Cmd(0x439d80362680) 0x85, CmdSN 0x2f from world 35341 to dev "t10.ATA_____WDC_WD40EFRX2D68WT0N0_________________________WD2DWCC4E4XPHS2P" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0xb 0x0 0x0.
2016-03-23T23:50:05.022Z cpu5:32796)ScsiDeviceIO: 2613: Cmd(0x439d80362680) 0x85, CmdSN 0x2f from world 35341 to dev "t10.ATA_____WDC_WD40EFRX2D68WT0N0_________________________WD2DWCC4E4XPHS2P" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0xb 0x0 0x0.
2016-03-23T23:50:05.035Z cpu5:32796)ScsiDeviceIO: 2613: Cmd(0x439d80362680) 0x85, CmdSN 0x2f from world 35341 to dev "t10.ATA_____WDC_WD40EFRX2D68WT0N0_________________________WD2DWCC4E4XPHS2P" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0xb 0x0 0x0.
2016-03-23T23:50:05.063Z cpu5:32796)ScsiDeviceIO: 2613: Cmd(0x439d80362680) 0x85, CmdSN 0x2f from world 35341 to dev "t10.ATA_____WDC_WD40EFRX2D68WT0N0_________________________WD2DWCC4E4XPHS2P" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0xb 0x0 0x0.
2016-03-23T23:50:05.076Z cpu5:32796)ScsiDeviceIO: 2613: Cmd(0x439d80362680) 0x85, CmdSN 0x2f from world 35341 to dev "t10.ATA_____WDC_WD40EFRX2D68WT0N0_________________________WD2DWCC4E4XPHS2P" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0xb 0x0 0x0.
2016-03-23T23:50:05.106Z cpu5:32796)ScsiDeviceIO: 2613: Cmd(0x439d80362680) 0x85, CmdSN 0x2f from world 35341 to dev "t10.ATA_____WDC_WD40EFRX2D68WT0N0_________________________WD2DWCC4E4XPHS2P" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0xb 0x0 0x0.
2016-03-23T23:50:05.115Z cpu5:32796)ScsiDeviceIO: 2613: Cmd(0x439d80362680) 0x85, CmdSN 0x2f from world 35341 to dev "t10.ATA_____WDC_WD40EFRX2D68WT0N0_________________________WD2DWCC4E4XPHS2P" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0xb 0x0 0x0.
2016-03-23T23:50:05.157Z cpu5:32796)ScsiDeviceIO: 2613: Cmd(0x439d80362680) 0x85, CmdSN 0x2f from world 35341 to dev "t10.ATA_____WDC_WD40EFRX2D68WT0N0_________________________WD2DWCC4E4XPHS2P" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0xb 0x0 0x0.
2016-03-23T23:50:05.161Z cpu5:32796)ScsiDeviceIO: 2613: Cmd(0x439d80362680) 0x85, CmdSN 0x2f from world 35341 to dev "t10.ATA_____WDC_WD40EFRX2D68WT0N0_________________________WD2DWCC4E4XPHS2P" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0xb 0x0 0x0.
And this errors for all of my hard drives except SSD. Even I see errors for USB Stick which is only used for boot. Even I delete RDM files and just restart ESXi without starting any vm I can see this errors. And after lots of errors like 2000s its starting to reseting AHCI ports. I tried switch B120i Raid Mode and create Raid0 for each drive but I can see similar "failed H:0x0 D:0x2 P:0x0 Valid sense data: 0xb 0x0 0x0." type errors. Not so much as AHCI but it still. I cant be sure is second hand Xeon CPU or new rams problematic or ESXi. Becasuse even I remove all HDDs I can see this errors for USB.
2016-03-24T00:01:01.316Z cpu5:32796)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x9e (0x439d80429b80, 0) to dev "mpx.vmhba32:C0:T0:L0" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
For now I'm booting XPEnology ISO directly on real hardware. But I really want ESXi. Dont want to go Hyper-V route. I know lots of people using same microservers with esxi + xpe. Is anyone see similar problems. Can anyone check logs of vmkernel for me. I will try reinstall ESXi 6 Update 2 on another USB.
By the way I just install latest iLo 2.4 which is not released yet. HP site showing 1 April for release. If anyone interested here is the link.