Develop and refine SA3600(broadwellnk) and SA6400(epyc7002) thread

[pocopico]

4 minutes ago, scoobdriver said:

@pocopico @Peter Suh

I was able to get Jim3ma loader to boot on Esxi by passing a Physical USB to the VM (Esxi 8.0U1) 

I can reach the initial webpage were you would normally install the .pat file, but it detects no disks ? Does his loader have the require modules would you know ? There doesn’t seem to be an option to add any ?

I’m ready to try a passthrough of my 11th gen IGPU , but unfortunately I get no disks ?

Would really like to get 11th gen transcoding working in ESXi

 

 

 

Can you clarify a bit how you boot from USB drive in ESXi ?

 

For the "No drives detected" did you use SATA controllers ? SCSI will not work with SA6400

 

 

[scoobdriver]

1 minute ago, pocopico said:

 

Can you clarify a bit how you boot from USB drive in ESXi ?

 

For the "No drives detected" did you use SATA controllers ? SCSI will not work with SA6400

 

 

Yes I am using Sata controllers, tried on 0:0 , 0:1 , 1:0 and 1:1  (do I need to specify SataPortMap , DiskIdxMap , I assumed it was device tree ? )  , I added the physical USB to the VM , Then I forced the Bios to enter setup in VM options (in VM options )  , where I was able to pick the USB drive as a boot device (it did not auto detect it I had to manually pick it ) 

 

Initially I was going along these lines https://www.virtualizationhowto.com/2019/01/boot-esxi-virtual-machine-from-passthrough-usb/ , but it turns out it was not needed and it quite happily boots from the physical USB passed through , once you select it . 

 

[pocopico]

21 minutes ago, scoobdriver said:

Yes I am using Sata controllers, tried on 0:0 , 0:1 , 1:0 and 1:1  (do I need to specify SataPortMap , DiskIdxMap , I assumed it was device tree ? )  

 

Yes, if its AHCI SATA controller they should be detected. Did you use the TCRP addons ? specifically disks is used to build the model.dtb on the fly.

Edited May 27, 2023 by pocopico

[scoobdriver]

47 minutes ago, pocopico said:

 

Yes, if it’s AHCI SATA controller they should be detected. Did you use the TCRP addons ? specifically disks is used to build the model.dtb on the fly.

Something with that particular model , I tried with the i18n loader , again booting from a physical USB in ESXi, allows me to Build DS920+ and install , but again SA6400 finds no disks . 

[scoobdriver]

1 hour ago, pocopico said:

specifically disks is used to build the model.dtb on the fly.

I don’t recall seeing the disks add on on Jim3ma loader , but I saw it on i18n loader. 
 

just another thing to note make sure the usb controller matches the usb type , if it’s set in 2.0 it won’t see a physical 3.0 usb stick. I had a couple of loaders across different speed usb sticks , and I had to change it at one point to get esxi to use it as a boot device. 

[Peter Suh]

5 hours ago, scoobdriver said:

I don’t recall seeing the disks add on on Jim3ma loader , but I saw it on i18n loader. 
 

just another thing to note make sure the usb controller matches the usb type , if it’s set in 2.0 it won’t see a physical 3.0 usb stick. I had a couple of loaders across different speed usb sticks , and I had to change it at one point to get esxi to use it as a boot device. 

 

Restarting my exsi environment.
config for SA6400 7.2-64561 is also being built now.
M SHELL already has disks addon built with SA6400.
Pocopico's TCRP probably does the same.
I'll let you know the results after I finish the test today.

[Peter Suh]

9 hours ago, scoobdriver said:

Yes I am using Sata controllers, tried on 0:0 , 0:1 , 1:0 and 1:1  (do I need to specify SataPortMap , DiskIdxMap , I assumed it was device tree ? )  , I added the physical USB to the VM , Then I forced the Bios to enter setup in VM options (in VM options )  , where I was able to pick the USB drive as a boot device (it did not auto detect it I had to manually pick it ) 

 

Initially I was going along these lines https://www.virtualizationhowto.com/2019/01/boot-esxi-virtual-machine-from-passthrough-usb/ , but it turns out it was not needed and it quite happily boots from the physical USB passed through , once you select it . 

 

 

 

I upgraded from esxi 6.7 to 7.0 and
I entered the BIOS from there.
The USB 2.0 controller and my SanDISK 3.2Gen1 are (Connected)
Is it normal to not see it in BIOS?
What could be the problem?

Is it because there is no VMTools?

 

Edited May 28, 2023 by Peter Suh

[scoobdriver]

@Peter Suh try changing the USB controller to 3.1 , I had that happen on a usb 3 stick. 

 

when I tried to use your mshell the menus defaulted to Chinese language, how would I change this please ? 

Edited May 28, 2023 by scoobdriver
3.1

[Peter Suh]

19 minutes ago, scoobdriver said:

@Peter Suh try changing the USB controller to 3.0 , I had that happen on a usb 3 stick. 

 

when I tried to use your mshell the menus defaulted to Chinese language, how would I change this please ? 

 

I read your tips a bit more and booting from USB 2.0 was successful.
SANDISK was not on the compatibility list, so pipbt.iso helped.

 

https://www.plop.at/en/bootmanager/download.html

 

 

 

 

 

 

Everything is fine, but after installing DSM I can't get to the next step.
I am unable to switch DSM boot due to an issue where it stays in Junior mode.
It seems difficult to find the cause alone. Junior log attached.
Which part is the problem?

 

Adjust disks related configs automatically - patches
maxdisks=2
ls: /sys/bus/usb/devices/usb*: No such file or directory
/tmp/model.dts:6.21-12.7: Warning (unit_address_vs_reg): /internal_slot@1: node has a unit name, but no reg or ranges property
/tmp/model.dts:13.21-19.7: Warning (unit_address_vs_reg): /internal_slot@2: node has a unit name, but no reg or ranges property
/tmp/model.dts:20.17-23.7: Warning (unit_address_vs_reg): /nvme_slot@1: node has a unit name, but no reg or ranges property
'/etc/model.dtb' -> '/run/model.dtb'
System Disk: (not supported in junior mode)
Internal Disk
01: /dev/sata1
02: /dev/sata2

...

Extensions processed
insmod: can't insert '/lib/modules/etxhci-hcd.ko': No such file or directory
Starting /usr/syno/bin/synocfgen...
/usr/syno/bin/synocfgen returns 0
Insert synorbd kernel module
Insert synofsbd kernel module
Insert libsha256 kernel module
Insert sha256 kernel module
All disk ready or timeout execeed
Assemble args: -u f757c100:1845e22d:05d949f7:b0bbaec7 /dev/sata1p1 /dev/sata2p1
mdadm: /dev/md0 has been started with 2 drives.
Partition Version=9
 /sbin/e2fsck exists, checking /dev/md0... 
e2fsck 1.44.1 (24-Mar-2018)
[QUOTA WARNING] Usage inconsistent for ID 0:actual (1318912, 12) != expected (1314816, 11)
/sbin/e2fsck -yvf returns 1
All components of md0 have partition layout above v9.
ForceNewestLayout: Skipped
Mounting /dev/md0 /tmpRoot
------------upgrade
Begin upgrade procedure
Failed to found any patch
No upgrade file found
End upgrade procedure
============upgrade
------------bootup-smallupdate
Failed to AssertDirectory[/tmpRoot/etc.defaults/]
Skip bootup smallupdate, because root is not matched to junior
============bootup-smallupdate
Missing directory /usr/syno/etc. Copy from /usr/syno/etc.defaults...
cp: can't stat '/tmpRoot/usr/syno/etc.defaults': No such file or directory
Exit on error [255] prepare /usr/syno/etc failed...
Sun May 28 03:45:21 UTC 2023
/dev/md0 /tmpRoot ext4 rw,relatime,journal_checksum,prjquota 0 0
none /sys/kernel/debug debugfs rw,relatime 0 0

 

[Peter Suh]

24 minutes ago, scoobdriver said:

@Peter Suh try changing the USB controller to 3.0 , I had that happen on a usb 3 stick. 

 

when I tried to use your mshell the menus defaulted to Chinese language, how would I change this please ? 

 

If you want to change the language, you can switch by pressing the l key.

[scoobdriver]

3 minutes ago, Peter Suh said:

 

If you want to change the language, you can switch by pressing the l key.

Thank you will try again. My Kingston stick and a few others show, my VM Bios  looks different though 

 

[Peter Suh]

5 minutes ago, scoobdriver said:

Thank you will try again. My Kingston stick and a few others show, my VM Bios  looks different though 

 

 

I've tried with legacy.
Let's switch to UEFI.
thank you

[scoobdriver]

You may need to change usb controller to 3.1 also

[Peter Suh]

3 minutes ago, scoobdriver said:

You may need to change usb controller to 3.1 also

 

Switched to EFI and booted successfully with just the USB 2.0 controller. pipbt is removed.
Let's test further to see if we get out of the loop of constant migration from junior .

[Peter Suh]

I also tried DSM 7.1, but I get a 55% file corruption message while installing DSM and cannot proceed.

 

When I tried DSM 7.2, I got an infinite loop of SERIAL port logs.

 

[   95.440638] BUG: scheduling while atomic: swapper/0/0/0x00000003
[   95.446297] Modules linked in: uas hid_generic(E) usbhid(E) hid(E) usblp(E) uhci_hcd(E) ehci_pci(E) ehci_hcd(E) epyc7002_synobios(POE) leds_atm
ega1608(E) adt7475(E) hwmon_vid(OE) nfs_ssc(E) lockd(E) grace(E) sunrpc(E) hfsplus(E) md4(E) hmac(E) i40e(OE) auxiliary(OE) qede(OE) qed(OE) atlan
tic(OE) r8125(OE) r8168(OE) ixgbe(OE) be2net(OE) igb(OE) i2c_algo_bit(E) e1000e(OE) vxlan(OE) ip6_udp_tunnel(E) udp_tunnel(E) ip_tunnel(E) fuse(E)
 vfat(E) fat(E) aesni_intel(E) glue_helper(E) crypto_simd(E) cryptd(E) ecryptfs(E) ecb(E) authenc(E) des_generic(E) libdes(E) ansi_cprng(E) cts(E)
 md5(E) cbc(E) cpufreq_powersave(E) cpufreq_performance(E) dm_snapshot(E) dm_bufio(E) dm_mod(E) crc_itu_t(E) crc_ccitt(E) sg(E) psnap(E) p8022(E) 
llc(E) ipv6(E) sha256_generic(E) libsha256(E) synorbd(POE) synofsbd(POE) vmxnet3(OE) usb_storage xhci_pci xhci_hcd usbcore usb_common [last unload
ed: epyc7002_synobios]
[   95.524026] CPU: 0 PID: 0 Comm: swapper/0 Tainted: P        W  OEL    5.10.55+ #64561
[   95.532240] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.18227214.B64.2106252220 06/25/2021
[   95.543496] Call Trace:
[   95.546203]  [<ffffffff817681fa>] dump_stack+0x57/0x6a
[   95.551669]  [<ffffffff81758810>] __schedule_bug.cold+0x4b/0x58
[   95.557280]  [<ffffffff8178c03c>] __schedule+0x5ec/0x8a0
[   95.562776]  [<ffffffff8178c69c>] schedule_idle+0x2c/0x40
[   95.568300]  [<ffffffff8109ab99>] cpu_startup_entry+0x19/0x20
[   95.573864]  [<ffffffff82a19ebb>] start_kernel+0x499/0x4a2
[   95.579390]  [<ffffffff810000f5>] secondary_startup_64_no_verify+0xb0/0xbb

[   95.749500] softirq: huh, entered softirq 3 NET_RX 00000000813f0cda with preempt_count 00000101, exited with 00000102?
[   96.751088] softirq: huh, entered softirq 3 NET_RX 00000000813f0cda with preempt_count 00000101, exited with 00000102?
[   97.239430] softirq: huh, entered softirq 3 NET_RX 00000000813f0cda with preempt_count 00000101, exited with 00000102?
[   97.732303] softirq: huh, entered softirq 3 NET_RX 00000000813f0cda with preempt_count 00000101, exited with 00000102?

 

[wjz304]

Although the 7.1 and 7.2 kernel versions are both 5.10.55 in SA6400, but they are different toolchains, so it is best to compile lkm and modules separately.

But precisely because the kver is the same, both tcrp and arpl need to make corresponding modifications to it

Edited May 28, 2023 by wjz304

[scoobdriver]

Ok, got it installed with your @wjz304 loader !!! 

I had to disable most of the modules , and just load those needed . something was stopping VMnet3 / network working ?! 

 

I've installed 7.2 , but I'm going to go back and install 7.1 as I understand this supports i915 ? I'd like to passthrough the intel gpu in Esxi 

 

Fingers crossed , and thanks for everyones hard work !!! 

[wjz304]

52 minutes ago, scoobdriver said:

Ok, got it installed with your @wjz304 loader !!! 

I had to disable most of the modules , and just load those needed . something was stopping VMnet3 / network working ?! 

 

I've installed 7.2 , but I'm going to go back and install 7.1 as I understand this supports i915 ? I'd like to passthrough the intel gpu in Esxi 

 

Fingers crossed , and thanks for everyones hard work !!! 

Try switching to direct startup and check if vmxnet3 is working properly,

there is currently an issue with dhcp, and I am still trying to figure out how to solve it.

 

In the advanced menu of arpl-i18n, there is an option to "Allow downgrade installation", which will allow you to install versions lower than the existing system version

 

[scoobdriver]

3 minutes ago, wjz304 said:

Try switching to direct startup and check if vmxnet3 is working properly,

I got 7.2 working and can see from the serial port vmxnet loads. 
so I got 7.2 installed all good. 
then tried 7.1 for i915 port but it fails at 57% , corrupt pat. 

[wjz304]

11 minutes ago, scoobdriver said:

I got 7.2 working and can see from the serial port vmxnet loads. 
so I got 7.2 installed all good. 
then tried 7.1 for i915 port but it fails at 57% , corrupt pat. 

 

Sorry, I'm not very familiar with graphics cards(i915).

Because jim3ma has been studying it, So I haven't allocated my energy to doing repetitive things,

 

[scoobdriver]

5 minutes ago, wjz304 said:

Sorry, I'm not very familiar with graphics cards(i915).

Because jim3ma has been studying it, So I haven't allocated my energy to doing repetitive things,

Would you know how I could build the .img from his arpl repository? 

[wjz304]

4 minutes ago, scoobdriver said:

Would you know how I could build the .img from his arpl repository? 

I haven't seen him recently. I will inquire about his progress later

[scoobdriver]

Ok, I managed to load the .ko 's associated with i915 in 7.2 built with you loader @wjz304 , booting from a external USB in ESXi , passing through the 11th gen igpu 

Think I'm there , dev/dri is showing up

 

02:02.0 VGA compatible controller: Intel Corporation RocketLake-S GT1 [UHD Graphics 730] (rev 04)

 

02:02.0 VGA compatible controller: Intel Corporation RocketLake-S GT1 [UHD Graphics 730] (rev 04)
        DeviceName: pciPassthru0
        Subsystem: Lenovo Device 31a7
        Kernel driver in use: i915

[ 1105.667560] Modules linked in: i915(OE) drm_kms_helper(OE) drm(OE) drm_panel_orientation_quirks(OE) drm_mipi_dsi(OE) hdmi(OE) fbcore(OE) fbdev(OE) video(OE) backlight(OE) backport_sa6400(OE) backport_sa6400_export(OE) synoacl_vfs(PO) fuse vfat fat tcm_qla2xxx(O) qla2xxx(O) libfc scsi_transport_fc vhost_scsi(O) vhost(O) vhost_iotlb(O) tcm_loop(O) iscsi_target_mod(O) target_core_user(O) target_core_ep(O) target_core_multi_file(O) target_core_file(O) target_core_iblock(O) target_core_mod(O) syno_extent_pool(PO) rodsp_ep(O) udf isofs btrfs xor raid6_pq adt7475 hwmon_vid hid_generic 8021q leds_atmega1608 lrw gf128mul epyc7002_synobios(PO) uhci_hcd ehci_pci ehci_hcd be2net bnxt_en(O) bnx2x(O) qede(O) qed(O) mlx5_core(O) mlx4_en(O) mlx4_core(O) atlantic_v2(O) atlantic(O) r8168(O) i40e(O) auxiliary(O) ixgbe(O) i2c_algo_bit igb(O) dm_crypt essiv loop sg dm_snapshot dm_bufio crc_itu_t crc_ccitt psnap p8022 llc hfsplus md4 hmac sit tunnel4 ipv6 flashcache_syno(O) zram syno_flashcache_control(O)

 

 

Edited May 28, 2023 by scoobdriver

[scoobdriver]

Ok , despite /dev/dri been present and the i915 module loading , I don’t seem to be able to get HW transcoding in Plex docker, I think the modules perhaps aren't compatible with 7.2  looks like its not just a case of copying the module from 7.1 , or I’ve missed some dependencies 

[wjz304]

Yes, it has many dependencies，I remember Jim had a separate modules compression package

3 hours ago, scoobdriver said:

Ok , despite /dev/dri been present and the i915 module loading , I don’t seem to be able to get HW transcoding in Plex docker, I think the modules perhaps aren't compatible with 7.2  looks like its not just a case of copying the module from 7.1 , or I’ve missed some dependencies 

 

Edited May 29, 2023 by wjz304