10Gbe setup - will this work with 6.1?


Recommended Posts

4 hours ago, vortexxx said:

Its OK working!!!, Many thanks for all.

1. Windows user need EXT2FSD, install.

2. Booting USB from xpenology insert PC with EXT2FSD

3. Assign drive letter to partition.

4. Find extra.lzma

5. download latest 4.9 extra.lzma from http://s000.tinyupload.com/?file_id=88305548032449150873 

6. replace original extra.lzma

7. remove USB, insert in bare metal and power on.

 

i was assuming you followed the normal howto and there is some text about the extra.lzma and how to modify grub.cfg on 1st partition and copy over the extended extra.lzma (if needed), usually you prepare/mount the img file with OSFMount and after that you write it to usb

also win10 latest 2 or 3 versions can at least use the 2nd partition where the extra.lzma is located (there was one that could do both but MS changed things and atm its just the 2nd)

 

 

Link to post
Share on other sites
8 минут назад, IG-88 сказал:

 

i was assuming you followed the normal howto and there is some text about the extra.lzma and how to modify grub.cfg on 1st partition and copy over the extended extra.lzma (if needed), usually you prepare/mount the img file with OSFMount and after that you write it to usb

also win10 latest 2 or 3 versions can at least use the 2nd partition where the extra.lzma is located (there was one that could do both but MS changed things and atm its just the 2nd)

 

 

 

I try 1020 on promox, is working and no need hard dance with drivers. My W10 cant see linux partitions, I dont know why. Its not a problem. Maybe you add this to top of this topic (and 1020 flashing bios too)? 

 

Link to post
Share on other sites

1st and 2nd partiton on the usb flash drive are FAT partitions, out of curiosity i've tried Ext2Fsd-0.69.exe and with it i can "force" windows to have a drive letter for the 1st partition but there seem to be a accessrights problem as i was not able to open it, only when i opened notepad++ as administrator i was able to edit the grub.cfg, not as comfortable as using it normal but still better as mountig it in a virtualbox linux vm

 

 

  • Thanks 1
Link to post
Share on other sites
  • 3 months later...

Good day, please can you help me? Its not Xpenology, I try to make 10G switch on VyOS, Its work fine on intel cards, but brocade 1020 cant run, I try to copy ctfw-3.2.1.1.bin to /lib/firmware/ but  its not work

 

[    1.163499] Brocade 10G Ethernet driver - version: 3.2.21.1
[    1.163534] bnad_pci_probe : (0xffff88040cb81000, 0xffffffffa0068250) PCI Func : (2)
[    1.163559] bna 0000:02:00.2: Direct firmware load failed with error -2
[    1.163561] bna 0000:02:00.2: Falling back to user helper
[    1.164254] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.0.5-k
[    1.164257] igb: Copyright (c) 2007-2013 Intel Corporation.
[    1.164526] e1000e: Intel(R) PRO/1000 Network Driver - 2.3.2-k
[    1.164530] e1000e: Copyright(c) 1999 - 2013 Intel Corporation.
[    1.164555] Brocade BFA FC/FCOE SCSI driver - version: 3.2.21.1
[    1.165673] ahci 0000:05:00.0: version 3.0
[    1.179108] Can't locate firmware ctfw-3.2.1.1.bin
[    1.179412] Failed to load Firmware Image!
[    1.179422] bnad_pci_probe : (0xffff88040cb82000, 0xffffffffa0068250) PCI Func : (3)
[    1.179433] bna 0000:02:00.3: Direct firmware load failed with error -2
[    1.179434] bna 0000:02:00.3: Falling back to user helper
[    1.180579] Can't locate firmware ctfw-3.2.1.1.bin
[    1.180889] Failed to load Firmware Image!

 

Please help me.
 

Edited by vortexxx
Link to post
Share on other sites

Its not my, but works fine.

 

wget http://git.kernel.org/cgit/linux/kernel/git/firmware/linux-firmware.git/tree/ctfw-3.2.3.0.bin

wget http://git.kernel.org/cgit/linux/kernel/git/firmware/linux-firmware.git/tree/ct2fw-3.2.3.0.bin

wget http://git.kernel.org/cgit/linux/kernel/git/firmware/linux-firmware.git/tree/cbfw-3.2.3.0.bin

cp ctfw-3.2.3.0.bin /lib/firmware/

cp ct2fw-3.2.3.0.bin /lib/firmware/

cp cbfw-3.2.3.0.bin /lib/firmware/ ]

cd /lib/firmware

ln -s ctfw-3.2.3.0.bin ctfw.bin

ln -s ct2fw-3.2.3.0.bin ct2fw.bin

ln -s cbfw-3.2.3.0.bin cbfw.bin

modprobe -r bna

modprobe bna

Edited by vortexxx
Link to post
Share on other sites

Its no my but works from this https://gist.github.com/ViKingIX/95db2d154ebcf271f6df2d48d53e79a0

Get Firmwares

cd /lib/firmware
sudo wget http://git.kernel.org/cgit/linux/kernel/git/firmware/linux-firmware.git/plain/{ctfw,ct2fw}-3.2.5.1.bin

Update initramfs

sudo update-initramfs -u -k all

Unload and lacklist bfa module

echo blaclist bfa | sudo tee /etc/modprobe.d/blaclist-bfa

Reload bna module

sudo rmmod bna
sudo modprobe bna

Link to post
Share on other sites
  • 1 month later...

Hello

 

I'm back again,  yesterday I setup a test on one of my N54L's.

 

DMS3615xs_23739  works correctly

Hardware wise 

Intel PCIE Desktop Nic  e1000e is in the middle x4 slot

10Gb ConnectX2 in the x16 slot  I reflashed the card according the PID from Mellanox

The card is native Mellanox Infiniband but the ports can be configured to do IP  or Infiniband

 

This is just a test no data involved

 

On the desktop I can see the Intel Nic but not the Mellanox 10GB nic

Here is the log.  

 

dmesg -wH

 +0.000002] e1000e 0000:03:00.0 eth0: Intel(R) PRO/1000 Network Connection
[  +0.000013] e1000e 0000:03:00.0 eth0: MAC: 3, PHY: 8, PBA No: E46981-005
[  +0.024683] Intel(R) Gigabit Ethernet Network Driver - version 5.3.5.3
[  +0.000005] Copyright (c) 2007-2015 Intel Corporation.
[  +0.017744] Intel(R) 10GbE PCI Express Linux Network Driver - version 5.1.3
[  +0.000005] Copyright(c) 1999 - 2017 Intel Corporation.
[  +0.019045] i40e: Intel(R) 40-10 Gigabit Ethernet Connection Network Driver -                                   version 2.3.6
[  +0.000004] i40e: Copyright(c) 2013 - 2017 Intel Corporation.
[  +0.022818] tn40xx low_mem_msg proc entry initialized
[  +0.000007] tn40xx low_mem_counter proc entry initialized
[  +0.000003] tn40xx debug_msg proc entry initialized
[  +0.000002] tn40xx: Tehuti Network Driver, 0.3.6.12.3
[  +0.041244] qed_init called
[  +0.000005] QLogic FastLinQ 4xxxx Core Module qed 8.33.9.0
[  +0.000002] creating debugfs root node
[  +0.008795] qede_init: QLogic FastLinQ 4xxxx Ethernet Driver qede 8.33.9.0
[  +0.009530] Loading modules backported from Linux version v3.18.1-0-g39ca484
[  +0.000004] Backport generated by backports.git v3.18.1-1-0-g5e9ec4c
[  +0.046503] Compat-mlnx-ofed backport release: c22af88
[  +0.000005] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git c22af88
[  +0.000002] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
[  +0.106092] mlx4_core: Mellanox ConnectX core driver v4.1-1.0.2 (27 Jun 2017)
[  +0.000050] mlx4_core: Initializing 0000:02:00.0
[  +0.627691] systemd-udevd[5692]: starting version 204
[  +1.052738] mlx4_core 0000:02:00.0: DMFS high rate mode not supported
[  +0.000235] mlx4_core: device is working in RoCE mode: Roce V1
[  +0.000002] mlx4_core: UD QP Gid type is: V1
[  +1.121411] mlx4_core 0000:02:00.0: PCIe link speed is 5.0GT/s, device support                                  s 5.0GT/s
[  +0.000007] mlx4_core 0000:02:00.0: PCIe link width is x8, device supports x8
[  +0.000131] mlx4_core 0000:02:00.0: irq 45 for MSI/MSI-X
[  +0.000007] mlx4_core 0000:02:00.0: irq 46 for MSI/MSI-X
[  +0.000007] mlx4_core 0000:02:00.0: irq 47 for MSI/MSI-X
[  +0.000006] mlx4_core 0000:02:00.0: irq 48 for MSI/MSI-X
[  +0.000005] mlx4_core 0000:02:00.0: irq 49 for MSI/MSI-X
[  +0.232870] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.1-1.0.2 (27 Jun                                   2017)

 

 

Do I need to setup the grub info for the card?

 

 

Edited by RacerX
spelling error
Link to post
Share on other sites
  • 1 year later...

If you want make cluster and need 10Gb switch, you can make this.

 

insmod /lib/modules/stp.ko
insmod /lib/modules/bridge.ko
brctl addbr br0 // add new bridge
brctl stp br0 off // stp off
ifconfig br0 192.168.50.200 netmask 255.255.255.0 up // add address to bridge
brctl addif br0 eth2 // add adapter one
brctl addif br0 eth3 // add next adapter
route add default gw 192.168.50.1 dev br0 // add GW to bridge

 

and add this to autoboot

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.