Dell R720XD With H310 in IT Mode - Not all HDD seen


Recommended Posts

Hi, I am new so bear with me please. 

 

I have a Dell R720XD E5-2697 V2 with 12 3x 3.5 HDDs. Running ESXi Version 7.02

The ESXi is running through a separate Raid Card on one of the PCIe slots. This leaves the H310 mini in IT mode to be passed through and used with Xpenology in full.

 

I installed Jun loader (for DS3617xs) - v1.03b and managed to get the Xpenology as a VM up and running. However the problem is Xpenology only sees 8 of the 12 drives connected to the H310 Mini. 

 

If I passthrough the same card (H310 Mini) to a Windows VM, it sees all 12 drives and can format and use them, however when I switch back and passthrough to Xpenology again it only sees 8 drives. I tried reinstalling and tried 3615xs and 3617xs but always the same problem only 8 drives seen. I tried all the basic troubleshooting like shuffling the HDDs around and disconnecting and reconnecting but none helped. Also its always the same ports are not seen in Xpenology, ports 0, 1, 3 and 4. No idea why or how it can pick up and see a HDD in port 2 between 1 and 3.

 

Any help appreciated.

Link to post
Share on other sites
1 hour ago, Delluser said:

however when I switch back and passthrough to Xpenology again it only sees 8 drives. I tried reinstalling and tried 3615xs and 3617xs but always the same problem only 8 drives seen. I tried all the basic troubleshooting like shuffling the HDDs around and disconnecting and reconnecting but none helped. Also its always the same ports are not seen in Xpenology, ports 0, 1, 3 and 4. No idea why or how it can pick up and see a HDD in port 2 between 1 and 3.

could you post the  /var/log/dmesg?

we would see how dsm is seeing and counting the drives, generic to H310 are two sas ports resulting in 2 x 4 sata ports, to be 12 it would need a sas expander (backplane) with Serial ATA Tunneling Protocol (STP)

two possible reasons in can think of

1. 3615/17 is max 12 disks, if a sata controller is 1st found and blocks 4 ports then disks above 12 will not show in the gui, so only 8 ports from sas will show up

2. problems with the expander and drivers prevent disks showing up (similar to sata multiplexer not working in dsm, but as its completely different tech that seems not likely)

Link to post
Share on other sites
10 minutes ago, Delluser said:

Point 1 in your answer seems a good candidate about why this happening.

 

but its not the case, looks like the sas  exander is messing around

...
[Mon Apr  5 07:55:25 2021] mpt2sas version 20.00.00.00 loaded
[Mon Apr  5 07:55:25 2021] scsi1 : Fusion MPT SAS Host
[Mon Apr  5 07:55:25 2021] mpt2sas0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (16447164 kB)
...
[Mon Apr  5 07:55:27 2021] mpt2sas0: host_add: handle(0x0001), sas_addr(0x544a84200187ff00), phys(8)
[Mon Apr  5 07:55:27 2021] mpt2sas0: expander_add: handle(0x0009), parent(0x0001), sas_addr(0x500056b37789abff), phys(26)
...
[Mon Apr  5 07:55:32 2021] sd 1:0:0:0: [sdo] Spinning up disk...
...
[Mon Apr  5 07:55:32 2021] sd 1:0:1:0: [sdc] 23437770752 512-byte logical blocks: (12.0 TB/10.9 TiB)
...
[Mon Apr  5 07:55:32 2021] sd 1:0:2:0: [sdd] 23437770752 512-byte logical blocks: (12.0 TB/10.9 TiB)
...

...
[Mon Apr  5 07:55:33 2021] sd 1:0:8:0: [sdj] 23437770752 512-byte logical blocks: (12.0 TB/10.9 TiB)
...
[Mon Apr  5 07:55:33 2021] sd 1:0:9:0: [sdn] Spinning up disk...
...
[Mon Apr  5 07:55:33 2021] sd 1:0:10:0: [sdp] Spinning up disk...
...
[Mon Apr  5 07:55:33 2021] sd 1:0:11:0: [sdq] Spinning up disk...
...
[Mon Apr  5 07:55:34 2021] md: created md0
[Mon Apr  5 07:55:34 2021] md: bind<sdj1>
[Mon Apr  5 07:55:34 2021] md: bind<sdi1>
[Mon Apr  5 07:55:34 2021] md: bind<sdh1>
[Mon Apr  5 07:55:34 2021] md: bind<sdg1>
[Mon Apr  5 07:55:34 2021] md: bind<sdf1>
[Mon Apr  5 07:55:34 2021] md: bind<sde1>
[Mon Apr  5 07:55:34 2021] md: bind<sdd1>
[Mon Apr  5 07:55:34 2021] md: bind<sdc1>
[Mon Apr  5 07:55:34 2021] md: running: <sdc1><sdd1><sde1><sdf1><sdg1><sdh1><sdi1><sdj1>
[Mon Apr  5 07:55:34 2021] md/raid1:md0: active with 8 out of 12 mirrors
...
[Mon Apr  5 07:56:05 2021] sd 0:0:0:0: Attached scsi generic sg0 type 0
[Mon Apr  5 07:56:05 2021] sd 1:0:0:0: Attached scsi generic sg1 type 0
[Mon Apr  5 07:56:05 2021] sd 1:0:1:0: Attached scsi generic sg2 type 0
[Mon Apr  5 07:56:05 2021] sd 1:0:2:0: Attached scsi generic sg3 type 0
[Mon Apr  5 07:56:05 2021] sd 1:0:3:0: Attached scsi generic sg4 type 0
[Mon Apr  5 07:56:05 2021] sd 1:0:4:0: Attached scsi generic sg5 type 0
[Mon Apr  5 07:56:05 2021] sd 1:0:5:0: Attached scsi generic sg6 type 0
[Mon Apr  5 07:56:05 2021] sd 1:0:6:0: Attached scsi generic sg7 type 0
[Mon Apr  5 07:56:05 2021] sd 1:0:7:0: Attached scsi generic sg8 type 0
[Mon Apr  5 07:56:05 2021] sd 1:0:8:0: Attached scsi generic sg9 type 0
[Mon Apr  5 07:56:05 2021] sd 1:0:9:0: Attached scsi generic sg10 type 0
[Mon Apr  5 07:56:05 2021] sd 1:0:10:0: Attached scsi generic sg11 type 0
[Mon Apr  5 07:56:05 2021] sd 1:0:11:0: Attached scsi generic sg12 type 0
...

expander makes the drives on it getting a port thats out of the 12 drive range (drive 0 is sdO, then 1-8 sdC to sdJ, 9 gets sdN, 10 and 11 get sdP and SdQ)

all 12 drives are found but the gap created by the expander (sdn, sdo, sdp,sdq) will make them out of range for the 12 drive limit

also sda and sdb are unused

as seen with /dev/md0 (system partition) only sdc-sdj is used rest is above the drive limit of 12

in theory its possible to remap positions but the lsi sas driver is famous for doing funny stuff when drives go missing (disconnected, not working,) as it rearranges the positions (sdY->sdX)

seems safer to change the max. disks to 20 (changes to synoinfo.conf that will be lost on bigger updates and needs to be redone) and leave the drives be the way dsm finds them

 

another scenario would be to use RDM for the 12 drives instead of pass through the controller, that way they might be seen as sda to sdl and work ootb without doing anything

afaik you would not see smart of temp that way for the drives but esxi would be able to monitor the drives and they would still be the same raw drives as in baremetal

 

Link to post
Share on other sites

Hi Guru Master, thank you again for the prompt reply.

 

What is RDM please?

 

This is still not in production yet, so i can re-do it if needs be. I will try to enable the 20 drives. I watched a YouTube video which shows how to expand to 45 drives and tried that but on reboot the config was lost, now will try it again with 20 drives and see if that helps.

 

thanks again.

Link to post
Share on other sites
6 hours ago, Delluser said:

What is RDM please?

 

ever used a search engine on the internet?

try "rdm esxi vmware"

 

6 hours ago, Delluser said:

YouTube video which shows how to expand to 45 drives and tried that but on reboot the config was lost,

sadly no one take the time to watch all three parts of that - maybe search the forum, i wrote about that more then once

he never found out what went wrong and gave up (and he never had a deeper look into xpenology or he would have known that 45 is not possible like that)

 

24 ist the max for now until someone takes some time and effort to look into quicknicks loader, but thats a different story

 

thats more what you need: Expand XPenology beyond 12 drives, https://www.youtube.com/watch?v=2PSGAZy7LVQ

 

Link to post
Share on other sites
9 hours ago, IG-88 said:

 

ever used a search engine on the internet?

try "rdm esxi vmware"

 

sadly no one take the time to watch all three parts of that - maybe search the forum, i wrote about that more then once

he never found out what went wrong and gave up (and he never had a deeper look into xpenology or he would have known that 45 is not possible like that)

 

24 ist the max for now until someone takes some time and effort to look into quicknicks loader, but thats a different story

 

thats more what you need: Expand XPenology beyond 12 drives, https://www.youtube.com/watch?v=2PSGAZy7LVQ

 

 

Thank you Guru Master, sorted now!!

 

This is for the benefit of those who might hit this article at a later time. As pointed out above by Guru Master, the issue turned out to be the 4 drives was not visible due not being in the first 12 drives assigned. As soon as I extended the 12 drive limit to 20 the rest of the drives was visible and usable.

 

@ Xpenology team - you done a excellent job!! Thank you. Please keep up the good work. I am so happy with what I ended up with :)

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.