Jump to content
XPEnology Community

RacerX

Member
  • Posts

    123
  • Joined

  • Last visited

  • Days Won

    2

Posts posted by RacerX

  1. Small Test

     

    Two SSD connected to Adaptec 71605

     

    The card is set up as HBA


     

    lspci
    
    03:00.0 RAID bus controller: Adaptec Series 7 6G SAS/PCIe 3 (rev 01)

     

    Adaptec has been making raid cards for long time

     

    On github  there are extensions for accraid and aic94xx

     

    What would be the proper extension URL to install Adaptec 71605  I'm not clear......

     

    Any help would be appreciated

     

     

     

     

     

  2. tc@box:~$ [    2.790315] cxgb4 0000:02:00.4: 8.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b.4 (capable of 63.008 Gb/s with 8.0 GT/s PCIe x8 link)
    -sh: syntax error: unexpected "("
    tc@box:~$ [    2.819587] cxgb4 0000:02:00.4 eth0: eth0: Chelsio T520-CR (0000:02:00.4) 1G/10GBASE-SFP
    -sh: syntax error: unexpected "("
    tc@box:~$ [    2.820488] cxgb4 0000:02:00.4 eth1: eth1: Chelsio T520-CR (0000:02:00.4) 1G/10GBASE-SFP
    -sh: syntax error: unexpected "("
    tc@box:~$ [    2.867629] cxgb4 0000:02:00.4: Chelsio T520-CR rev 0
    sh: missing ]

  3. tc@box:~$ dmesg | grep -iC 3 "cxgb4"
    [    1.191364] usb: port power management may be unreliable
    [    1.192118] mei_me 0000:00:16.0: enabling device (0004 -> 0006)
    [    1.204492] input: PC Speaker as /devices/platform/pcspkr/input/input3
    [    1.227661] cxgb4 0000:02:00.4: Direct firmware load for cxgb4/t5fw.bin failed with error -2
    [    1.227666] cxgb4 0000:02:00.4: Falling back to sysfs fallback for: cxgb4/t5fw.bin
    [    1.229749] cxgb4 0000:02:00.4: unable to load firmware image cxgb4/t5fw.bin, error -11
    [    1.230116] cxgb4 0000:02:00.4: Coming up as MASTER: Initializing adapter
    [    1.280852] tsc: Refined TSC clocksource calibration: 3599.999 MHz
    [    1.280861] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x33e4525366a, max_idle_ns: 440795257657 ns
    [    1.280880] clocksource: Switched to clocksource tsc
    --
    [    1.791161] input: HP HP Wireless Keyboard Kit as /devices/pci0000:00/0000:00:14.0/usb1/1-7/1-7:1.1/0003:03F0:140C.0002/input/input9
    [    1.791280] hid-generic 0003:03F0:140C.0002: input,hiddev96,hidraw1: USB HID v1.11 Mouse [HP HP Wireless Keyboard Kit] on usb-0000:00:14.0-7/input1
    [    1.917566] usb 1-8: new full-speed USB device number 3 using xhci_hcd
    [    1.934293] cxgb4 0000:02:00.4: Direct firmware load for cxgb4/t5-config.txt failed with error -2
    [    1.934300] cxgb4 0000:02:00.4: Falling back to sysfs fallback for: cxgb4/t5-config.txt
    [    2.064772] input: Logitech USB Receiver as /devices/pci0000:00/0000:00:14.0/usb1/1-8/1-8:1.0/0003:046D:C52B.0003/input/input10
    [    2.121210] hid-generic 0003:046D:C52B.0003: input,hidraw2: USB HID v1.11 Keyboard [Logitech USB Receiver] on usb-0000:00:14.0-8/input0
    [    2.123927] input: Logitech USB Receiver Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-8/1-8:1.1/0003:046D:C52B.0004/input/input11
    --
    [    2.300914] usb 1-10: new high-speed USB device number 4 using xhci_hcd
    [    2.444652] usb-storage 1-10:1.0: USB Mass Storage device detected
    [    2.445235] scsi host6: usb-storage 1-10:1.0
    [    2.460930] cxgb4 0000:02:00.4: Successfully configured using Firmware Configuration File "Firmware Default", version 0x0, computed checksum 0x0
    [    2.634245] cxgb4 0000:02:00.4: Hash filter supported only on T6
    [    2.684240] cxgb4 0000:02:00.4: max_ordird_qp 21 max_ird_adapter 387072
    [    2.724247] cxgb4 0000:02:00.4: Current filter mode/mask 0x632b:0x21
    [    2.790295] cxgb4 0000:02:00.4: 62 MSI-X vectors allocated, nic 12 eoqsets 12 per uld 6 mirrorqsets 12
    [    2.790315] cxgb4 0000:02:00.4: 8.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b.4 (capable of 63.008 Gb/s with 8.0 GT/s PCIe x8 link)
    [    2.819587] cxgb4 0000:02:00.4 eth0: eth0: Chelsio T520-CR (0000:02:00.4) 1G/10GBASE-SFP
    [    2.820488] cxgb4 0000:02:00.4 eth1: eth1: Chelsio T520-CR (0000:02:00.4) 1G/10GBASE-SFP
    [    2.867629] cxgb4 0000:02:00.4: Chelsio T520-CR rev 0
    [    2.867635] cxgb4 0000:02:00.4: S/N: PT03151028, P/N: 110118250B0
    [    2.867640] cxgb4 0000:02:00.4: Firmware version: 1.24.17.0
    [    2.867644] cxgb4 0000:02:00.4: Bootstrap version: 1.1.0.0
    [    2.867648] cxgb4 0000:02:00.4: TP Microcode version: 0.1.4.9
    [    2.867652] cxgb4 0000:02:00.4: Expansion ROM version: 1.0.0.68
    [    2.867656] cxgb4 0000:02:00.4: Serial Configuration version: 0x1005000
    [    2.867659] cxgb4 0000:02:00.4: VPD version: 0x2
    [    2.867664] cxgb4 0000:02:00.4: Configuration: RNIC MSI-X, Offload capable
    [    4.491443] scsi 6:0:0:0: Direct-Access     PNY      USB 2.0 FD       1100 PQ: 0 ANSI: 4
    [    4.491929] sd 6:0:0:0: Attached scsi generic sg2 type 0
    [    4.492842] sd 6:0:0:0: [sdc] 63180800 512-byte logical blocks: (32.3 GB/30.1 GiB)
    --
    [   12.192418] FAT-fs (sdc3): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.
    [   12.201623] FAT-fs (sdc3): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.
    [   13.484519] random: crng init done
    [   25.550912] cxgb4 0000:02:00.4 eth0: passive DA module inserted
    [   26.127601] cxgb4 0000:02:00.4 eth1: port module unplugged
    [   26.143164] cxgb4 0000:02:00.4 eth0: link up, 10Gbps, full-duplex, Tx/Rx PAUSE
    [  105.842097] usb 1-7: USB disconnect, device number 2
    [  106.187588] usb 1-8: USB disconnect, device number 3
    [  112.964211] usb 1-7: new low-speed USB device number 5 using xhci_hcd
    tc@box:~$

  4. On DMS usb boot

     

    Loading Linux...

    Loading initramfs...

    Starting kernel with USB boot

     

    That's it, I do not see the driver loading

     

    One qustion regarding

    navigate to /home/tc/redpill-load/cache/ and download (in my case) S3622xs+_42218.pat

     

    when I go to that folder  that file is already present.  Is this necessary?

     

    Also I tried the card in a different pci slot no change

     

    If I test with virtual box, vm, since the nic is virtual could that tell us more?

  5. Just a Test with the new module

     

    Chelsio T520-CR

     

    sudo ./rploader.sh ext bromolow-7.0.1-42218 add https://raw.githubusercontent.com/pocopico/rp-ext/master/cxgb4/rpext-index.json

     

    The module seems to load correctly


     

    [OK]
    [#] ========================================== pocopico.cxgb4 ==================                                               
    
    ========================
    [#] Extension name: cxgb4
    [#] Description: Adds Chelsio T4/T5/T6 Network Driver Support
    [#] To get help visit: <todo>
    [#] Extension preparer/packer: https://github.com/pocopico/rp-ext/tree/main/cxgb 4
    [#] Software author: https://github.com/pocopico
    [#] Update URL: https://raw.githubusercontent.com/pocopico/rp-ext/master/cxgb4/r pext-index.json
    [#] Platforms supported: ds1621p_42218 ds918p_41890 ds3617xs_42218 ds918p_25556                                                
    
    dva3221_42218 ds3622xsp_42218 ds3615xs_41222 ds3615xs_25556 ds918p_42218 ds3615x                                               
    
    s_42218
    [#] ============================================================================ ===========

     

    ssh into tinycore

     

    tc@box:~$ uname  -r
    5.10.3-tinycore64

     

    It works fine in tinycore except the firmware is old

     

    tc@box:~$ dmesg |grep cxgb4
    [    1.204078] cxgb4 0000:01:00.4: Direct firmware load for cxgb4/t5fw.bin failed with error -2
    [    1.204080] cxgb4 0000:01:00.4: Falling back to sysfs fallback for: cxgb4/t5f w.bin
    [    1.207705] cxgb4 0000:01:00.4: unable to load firmware image cxgb4/t5fw.bin, error -11
    [    1.207942] cxgb4 0000:01:00.4: Coming up as MASTER: Initializing adapter
    [    1.897496] cxgb4 0000:01:00.4: Direct firmware load for cxgb4/t5-config.txt failed with error -2
    [    1.897502] cxgb4 0000:01:00.4: Falling back to sysfs fallback for: cxgb4/t5-config.txt
    [    2.424116] cxgb4 0000:01:00.4: Successfully configured using Firmware Configuration File "Firmware Default", version 0x0, computed checksum 0x0
    [    2.594109] cxgb4 0000:01:00.4: Hash filter supported only on T6
    [    2.644117] cxgb4 0000:01:00.4: max_ordird_qp 21 max_ird_adapter 387072
    [    2.684118] cxgb4 0000:01:00.4: Current filter mode/mask 0x632b:0x21
    [    2.750065] cxgb4 0000:01:00.4: 62 MSI-X vectors allocated, nic 12 eoqsets 12 per uld 6 mirrorqsets 12
    [    2.750081] cxgb4 0000:01:00.4: 63.008 Gb/s available PCIe bandwidth (8.0 GT/s PCIe x8 link)
    [    2.779388] cxgb4 0000:01:00.4 eth0: eth0: Chelsio T520-CR (0000:01:00.4) 1G/10GBASE-SFP
    [    2.780246] cxgb4 0000:01:00.4 eth1: eth1: Chelsio T520-CR (0000:01:00.4) 1G/10GBASE-SFP
    [    2.817487] cxgb4 0000:01:00.4: Chelsio T520-CR rev 0
    [    2.817493] cxgb4 0000:01:00.4: S/N: PT03151028, P/N: 110118250B0
    [    2.817498] cxgb4 0000:01:00.4: Firmware version: 1.24.17.0
    [    2.817502] cxgb4 0000:01:00.4: Bootstrap version: 1.1.0.0
    [    2.817506] cxgb4 0000:01:00.4: TP Microcode version: 0.1.4.9
    [    2.817510] cxgb4 0000:01:00.4: Expansion ROM version: 1.0.0.68
    [    2.817514] cxgb4 0000:01:00.4: Serial Configuration version: 0x1005000
    [    2.817517] cxgb4 0000:01:00.4: VPD version: 0x2
    [    2.817521] cxgb4 0000:01:00.4: Configuration: RNIC MSI-X, Offload capable
    [   27.104114] cxgb4 0000:01:00.4 eth0: passive DA module inserted
    [   27.680816] cxgb4 0000:01:00.4 eth1: port module unplugged
    [   27.706482] cxgb4 0000:01:00.4 eth0: link up, 10Gbps, full-duplex, Tx/Rx PAUS                                   E
    tc@box:~$

     

    When I boot usb I get a red light on the back of the card (not initialized)

     

    Is this a firmware thing?

     

    https://service.chelsio.com/store2/T5/Unified Wire/Linux/ChelsioUwire-3.16.0.0/README.txt

     

    The firmware (v1.26.6.0) is installed on the system, typically in /lib/firmware/cxgb4, and the driver will auto-load the firmware if an update is required. The kernel must be configured to enable userspace firmware loading support. Device Drivers -> Generic Driver Options -> Userspace firmware loading support

     

    Any advise?

     

     

     

     

     

     

     

  6. Here is the info on Chelsio T420

     

    lspci -tnnvq

               +-02.0-[02]--+-00.0  Chelsio Communications Inc T420-CR Unified Wire Ethernet Controller [1425:4001]
               |            +-00.1  Chelsio Communications Inc T420-CR Unified Wire Ethernet Controller [1425:4001]
               |            +-00.2  Chelsio Communications Inc T420-CR Unified Wire Ethernet Controller [1425:4001]
               |            +-00.3  Chelsio Communications Inc T420-CR Unified Wire Ethernet Controller [1425:4001]
               |            +-00.4  Chelsio Communications Inc T420-CR Unified Wire Ethernet Controller [1425:4401]
               |            +-00.5  Chelsio Communications Inc T420-CR Unified Wire Storage Controller [1425:4501]
               |            +-00.6  Chelsio Communications Inc T420-CR Unified Wire Storage Controller [1425:4601]
               |            \-00.7  Chelsio Communications Inc Device [1425:0000]

     

     

    Here is  Asmedia Sata Controller ASM1062

     

    lspci -tnnvq

     

    +-04.0-[03]----00.0  ASMedia Technology Inc. ASM1062 Serial ATA Controller [1b21:0612]

     

    If these two could be included that would be great, thanks

     

     

     

     

  7. When time permits could you please add Chelsio T520-CR

     

    The other day i tested

    sudo ./rploader.sh build bromolow-7.0.1-42218

     

    The script ran fine but when I rebooted it does not find my card.  No lights on the back of the card.

    Here are the results from Ubuntu 20.4 terminal


     

    lscpi
    
    01:00.0 Ethernet controller: Chelsio Communications Inc T520-CR Unified Wire Ethernet Controller
    01:00.1 Ethernet controller: Chelsio Communications Inc T520-CR Unified Wire Ethernet Controller
    01:00.2 Ethernet controller: Chelsio Communications Inc T520-CR Unified Wire Ethernet Controller
    01:00.3 Ethernet controller: Chelsio Communications Inc T520-CR Unified Wire Ethernet Controller
    01:00.4 Ethernet controller: Chelsio Communications Inc T520-CR Unified Wire Ethernet Controller
    01:00.5 SCSI storage controller: Chelsio Communications Inc T520-CR Unified Wire Storage Controller
    01:00.6 Fibre Channel: Chelsio Communications Inc T520-CR Unified Wire Storage Controller

     

    If you need any more info I can help...Thanks,

  8. Just a test on a test box (Z370 i5 860K),   VirtualBox 6.132,  ssh as tc 

     

    sudo ./rploader.sh build bromolow-7.0.1-42218

     

    ----------------
    It looks that you will need the following modules :


    Found VGA Controller : pciid 15add00000405  Required Extension :
    No matching extension
    Found Ethernet Interface : pciid 1af4d00001000 Required Extension :
    No matching extension
    Found SATA Controller : pciid 8086d00002829  Required Extension :
    No matching extension

     

    [!] Failed to unpack /home/tc/redpill-load/ext/boot-image-template.img.gz to loader.img

    *** Process will exit ***

     

    Any ideas?

  9. I can test Bare Metal or Promax VM , TrueNas Scale VM for mellanox

     

    In the past I had no luck at all booting ds3615 with several different Mellanox 10gb cards  it had to move to Intel 720 to get it to work.  I regret that move.

     

    I have the following ConnectX3

    CX353A-FCBT  Single Port

    CX353A-QCBT  Single Port

    544+QSFP  Dual Port

     

    I'm not clear how to install 7.01? do we have to use Tinyloader?

     

     

     

     

     

  10. Hello

     

    I'm back again,  yesterday I setup a test on one of my N54L's.

     

    DMS3615xs_23739  works correctly

    Hardware wise 

    Intel PCIE Desktop Nic  e1000e is in the middle x4 slot

    10Gb ConnectX2 in the x16 slot  I reflashed the card according the PID from Mellanox

    The card is native Mellanox Infiniband but the ports can be configured to do IP  or Infiniband

     

    This is just a test no data involved

     

    On the desktop I can see the Intel Nic but not the Mellanox 10GB nic

    Here is the log.  

     

    dmesg -wH

     +0.000002] e1000e 0000:03:00.0 eth0: Intel(R) PRO/1000 Network Connection
    [  +0.000013] e1000e 0000:03:00.0 eth0: MAC: 3, PHY: 8, PBA No: E46981-005
    [  +0.024683] Intel(R) Gigabit Ethernet Network Driver - version 5.3.5.3
    [  +0.000005] Copyright (c) 2007-2015 Intel Corporation.
    [  +0.017744] Intel(R) 10GbE PCI Express Linux Network Driver - version 5.1.3
    [  +0.000005] Copyright(c) 1999 - 2017 Intel Corporation.
    [  +0.019045] i40e: Intel(R) 40-10 Gigabit Ethernet Connection Network Driver -                                   version 2.3.6
    [  +0.000004] i40e: Copyright(c) 2013 - 2017 Intel Corporation.
    [  +0.022818] tn40xx low_mem_msg proc entry initialized
    [  +0.000007] tn40xx low_mem_counter proc entry initialized
    [  +0.000003] tn40xx debug_msg proc entry initialized
    [  +0.000002] tn40xx: Tehuti Network Driver, 0.3.6.12.3
    [  +0.041244] qed_init called
    [  +0.000005] QLogic FastLinQ 4xxxx Core Module qed 8.33.9.0
    [  +0.000002] creating debugfs root node
    [  +0.008795] qede_init: QLogic FastLinQ 4xxxx Ethernet Driver qede 8.33.9.0
    [  +0.009530] Loading modules backported from Linux version v3.18.1-0-g39ca484
    [  +0.000004] Backport generated by backports.git v3.18.1-1-0-g5e9ec4c
    [  +0.046503] Compat-mlnx-ofed backport release: c22af88
    [  +0.000005] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git c22af88
    [  +0.000002] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
    [  +0.106092] mlx4_core: Mellanox ConnectX core driver v4.1-1.0.2 (27 Jun 2017)
    [  +0.000050] mlx4_core: Initializing 0000:02:00.0
    [  +0.627691] systemd-udevd[5692]: starting version 204
    [  +1.052738] mlx4_core 0000:02:00.0: DMFS high rate mode not supported
    [  +0.000235] mlx4_core: device is working in RoCE mode: Roce V1
    [  +0.000002] mlx4_core: UD QP Gid type is: V1
    [  +1.121411] mlx4_core 0000:02:00.0: PCIe link speed is 5.0GT/s, device support                                  s 5.0GT/s
    [  +0.000007] mlx4_core 0000:02:00.0: PCIe link width is x8, device supports x8
    [  +0.000131] mlx4_core 0000:02:00.0: irq 45 for MSI/MSI-X
    [  +0.000007] mlx4_core 0000:02:00.0: irq 46 for MSI/MSI-X
    [  +0.000007] mlx4_core 0000:02:00.0: irq 47 for MSI/MSI-X
    [  +0.000006] mlx4_core 0000:02:00.0: irq 48 for MSI/MSI-X
    [  +0.000005] mlx4_core 0000:02:00.0: irq 49 for MSI/MSI-X
    [  +0.232870] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.1-1.0.2 (27 Jun                                   2017)

     

     

    Do I need to setup the grub info for the card?

     

     

  11. I just bought the connectx3 card last week so I wanted to make sure it works (it does with my limited test).  I know more about the connect2 cards since I've had them for a long time.  I tried changing grub to 3 macs. but now i get error 13 every time I try to install it.

     

    Thanks

×
×
  • Create New...