Jump to content
XPEnology Community

Help to setup NVME in DS3622xs+ inside Proxmox


Indio

Recommended Posts

Hi all,

I am trying to follow some guides here in the forum how to setup the SSD cache in my NAS but without success.

I have Proxmox 7.1-7 with an VM of DS3622xs+ (DSM 7.0.1-42218) with redpill.

The NVME in Proxmox was passthrough by PCI and in the DSM console is visible with address 0000:00:10.0:

user@NAS:~$ lspci 
0000:00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] (rev 02)
0000:00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II]
0000:00:01.1 IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]
0000:00:01.2 USB controller: Intel Corporation 82371SB PIIX3 USB [Natoma/Triton II] (rev 01)
0000:00:01.3 Bridge: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 03)
0000:00:02.0 VGA compatible controller: Red Hat, Inc. Virtio GPU (rev 01)
0000:00:03.0 Unclassified device [00ff]: Red Hat, Inc. Virtio memory balloon
0000:00:05.0 SCSI storage controller: Broadcom / LSI 53c895a
0000:00:07.0 SATA controller: Intel Corporation 82801IR/IO/IH (ICH9R/DO/DH) 6 port SATA Controller [AHCI mode] (rev 02)
0000:00:0b.0 SATA controller: Intel Corporation 82801IR/IO/IH (ICH9R/DO/DH) 6 port SATA Controller [AHCI mode] (rev 02)
0000:00:10.0 Non-Volatile memory controller: Micron/Crucial Technology P2 NVMe PCIe SSD (rev 01)
0000:00:12.0 Ethernet controller: VMware VMXNET3 Ethernet Controller (rev 01)
0000:00:1e.0 PCI bridge: Red Hat, Inc. QEMU PCI-PCI bridge
0000:00:1f.0 PCI bridge: Red Hat, Inc. QEMU PCI-PCI bridge
0001:09:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9235 PCIe 2.0 x2 4-port SATA 6 Gb/s Controller (rev 11)
0001:0c:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9235 PCIe 2.0 x2 4-port SATA 6 Gb/s Controller (rev 11)

In the file /etc.defaults/extensionPorts I changed to the nvme address:

[pci]
pci1="0000:00:10.0"

In fact, in the OS is clear that is connected:

user@NAS:~# nvme list
Node             SN                   Model                                    Namespace Usage                      Format           FW Rev  
---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- --------
/dev/nvme0n1     2113E591230F         CT1000P2SSD8                             1           1.00  TB /   1.00  TB    512   B +  0 B   P2CR033 

 

The problem is that in the DSM nothing apears:

1995175981_Capturadeecr2022-04-09s11_23_24.thumb.png.7a9d1e78101b3f7c4f221ec243bc7657.png

Any suggestion how to add an SSD cache or what is the problem with my setup?

Thank you.

  • Like 1
Link to comment
Share on other sites

11 hours ago, pocopico said:

I need to check but I think that etc.defaults it gets overwritten if it’s not on the rd.gz you can add the file during creation if you add it In the user_config.json 

Hi @pocopico, thank you once again.

Can you please show me an example how can add the file in user_config.json?

 

Thank you.

Link to comment
Share on other sites

2 hours ago, Indio said:

Hi @pocopico, thank you once again.

Can you please show me an example how can add the file in user_config.json?

 

Thank you.

 

You need to read the following to understand

 

https://github.com/pocopico/redpill-load/blob/master/FOR_DEVS.md

 

"extra": {

"compress_rd": false,

"ramdisk_copy":

{

"redpill-linux-v4.4.180+.ko": "usr/lib/modules/rp.ko"

},

 

you can add an extra line to the user_config.json about your file and where you need it to be copied. 

 

e.g. 

 

"extensionPorts" : "/etc/extensionPorts"

 

the file should be placed inside /home/tc/redpill-load/ext/ directore and named extensionPorts 

Link to comment
Share on other sites


Mine is DS918+ Redpill run as VM on proxmox
my ssd is NVMe SamsungEvo 970 250GB
 
Assuming that's you have 
 
by following this tutorial (https://dannyda.com/2020/08/26/how-to-passthrough-hdd-ssd-physical-disks-to-vm-on-proxmox-vepve/)
 
the command that I send to proxmox is 

qm set 586 -sata1 /dev/disk/by-id/nvme-Samsung_SSD_970_EVO_250GB_S465NB0K540387X,serial=S465NB0K540387X,cache=none,ssd=1,backup=0,discard=on,replicate=0


 according to tutorial 586 is my VM id, so change it.

 

 

image.thumb.png.e99cfee8c48f9fba54e095b1524f91d5.png

image.thumb.png.6fb27407ca43300ac8171ecabaed7157.pngimage.thumb.png.49bef7e6393c54409da6dff9b70cfb0a.png

Edited by bigbearXL
edit link
Link to comment
Share on other sites

4 hours ago, pocopico said:

 

You need to read the following to understand

 

https://github.com/pocopico/redpill-load/blob/master/FOR_DEVS.md

 

"extra": {

"compress_rd": false,

"ramdisk_copy":

{

"redpill-linux-v4.4.180+.ko": "usr/lib/modules/rp.ko"

},

 

you can add an extra line to the user_config.json about your file and where you need it to be copied. 

 

e.g. 

 

"extensionPorts" : "/etc/extensionPorts"

 

the file should be placed inside /home/tc/redpill-load/ext/ directore and named extensionPorts 

Hi again, @pocopico I made the changes you suggested, but I think I did something wrong:

I don't like the error code RIP 😁

[    3.181638] RIP  [<ffffffff8140651d>] ata_host_start.part.44+0x1bd/0x1e0
[    3.181638]  RSP <ffff880526203bc8>
[    3.181638] CR2: 0000000000000120
[    3.181638] ---[ end trace 1444ecca4539818b ]---
[    3.274699] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000009
[    3.274699] 
[    3.275671] Kernel Offset: disabled
[    3.275671] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000009
[    3.275671] 

 

Link to comment
Share on other sites

5 hours ago, bigbearXL said:


Mine is DS918+ Redpill run as VM on proxmox
my ssd is NVMe SamsungEvo 970 250GB
 
Assuming that's you have 
 
by following this tutorial (https://dannyda.com/2020/08/26/how-to-passthrough-hdd-ssd-physical-disks-to-vm-on-proxmox-vepve/)
 
the command that I send to proxmox is 


qm set 586 -sata1 /dev/disk/by-id/nvme-Samsung_SSD_970_EVO_250GB_S465NB0K540387X,serial=S465NB0K540387X,cache=none,ssd=1,backup=0,discard=on,replicate=0


 according to tutorial 586 is my VM id, so change it.

 

 

image.thumb.png.e99cfee8c48f9fba54e095b1524f91d5.png

image.thumb.png.6fb27407ca43300ac8171ecabaed7157.pngimage.thumb.png.49bef7e6393c54409da6dff9b70cfb0a.png

Thank you @bigbearXL but proxmox has sata limitations in the number of drives you can have in a VM. I have all full:1061153758_Capturadeecr2022-04-11s16_33_10.thumb.png.a28b90a1cc8c8009400331b1b7f07b4f.png

I am trying to add them as SCSI but was not successful. 

Link to comment
Share on other sites

9 minutes ago, Indio said:

Thank you @bigbearXL but proxmox has sata limitations in the number of drives you can have in a VM. I have all full:1061153758_Capturadeecr2022-04-11s16_33_10.thumb.png.a28b90a1cc8c8009400331b1b7f07b4f.png

I am trying to add them as SCSI but was not successful. 

I see, and yep SCSI won't works in this case

How about this ?  https://forum.proxmox.com/threads/limit-on-number-of-pass-through-sata-drives.28979/#post-311466

Link to comment
Share on other sites

@cferra, I have in proxmox with passthrough.

Cool - if you have it working - 7.1 isn’t a major leap forward so I imagine after making the required edits again it will function.

I would disable any cache prior to update though otherwise your volume will crash without that cache


Sent from my iPhone using Tapatalk
Link to comment
Share on other sites

1 hour ago, cferra said:


Cool - if you have it working - 7.1 isn’t a major leap forward so I imagine after making the required edits again it will function.

I would disable any cache prior to update though otherwise your volume will crash without that cache


Sent from my iPhone using Tapatalk

I don't know if I was clear @cferra, I was not able to make the nvme appear on DSM, only appears on the in the linux OS of the DSM as shown in my first post.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...