A dual-port ConnectX-5 (MT27800, firmware 16.35.1012, MLNXOFED 5.8 on BC-Linux 8.2) connected to a switch with a DAC would not recover after the cable had been connected and disconnected about fifteen times: the port stayed in State: Polling with Physical state ETHANFSMABILITYDETECT, and mlxlink…
On a Mellanox SN2410 (MLNX-OS 3.6.4112) a 100G port connected to a Chelsio adapter through a 2 m unequalised QSFP copper cable would not link when FEC was disabled; no HSS lane signal was detected on the adapter side. The poster required FEC-off operaation and asked whether the switch supports it…
Adding a 100G link between two racks on an X690 that has been quietly doing 10G access work for a couple of years. The uplink cage will not take the speed at all. ExtremeSwitching X690-48x-2q-4c 1 m QSFP28 direct attach cable, Q28+CR41m port 57, one of the QSFP28 uplink cages The cable comes up as…
A Mellanox ConnectX-3 40GbE NIC connected with Mellanox QSFP passive copper cables (MC2210126-005) to a Dell PowerConnect 8164 (firmware 5.1.4.5) produced a link-up event for a few seconds followed by a permanent link-down. The same cables worked NIC-to-NIC, and Dell refused support because the…
Standing up a small traffic-test bench next to the production fabric, and the tester ports will not come up over copper at all. HP 5900 40G switch, JC772A HP JG328A 40G QSFP+ direct attach cable Ixia Xcellon-Multis QSFP 40/10GE load module Spirent TestCenter 40G module, tried as a second opinion HP…
All 10G ports on a Netgear M5300-28G3 were used, so the poster asked whether a Cisco 3 m SFP+ DAC (H10GB-CU3M) or Finisar FTLX8571D3BCL 10G SR modules could be used in the switch's 1G SFP ports to add another 10G-capable device at reduced speed. Hardware involved: Netgear M5300-28G3, Cisco…
Small office rack: there is a 40G card in the file server and a switch with spare uplink ports, so instead of buying another box I tried to hang the server straight off the switch. Both ends see the cable, the link never comes up. Huawei S6730-H24X6C, QSFP28 uplink ports QNAP LAN-40G2SF-MLX in the…
A FreeNAS box with on-board Intel X552 SFP+ ports (Xeon D) and an ESXi 6.7 host with a Mellanox ConnectX-3 (MT27500, Dell Y3KKR) were cabled with two Mellanox MCP2104-X003B passive DACs from 2014. Looping each device to itself brought the ports up, but between the two systems ESXi showed…
I run a small Proxmox box at home and wanted a proper 10G path to the storage node, so I dropped in a used Supermicro AOC-STGN-i1S. It is the plain Intel 82599 design, board marked E157872, and I assumed this would be the boring part of the build. It is not. Supermicro AOC-STGN-i1S, Intel X520-DA1…
Bringing up a pair of GPU boxes against our existing 400G fabric, and I have already managed to buy the wrong cable once, so I would rather get the theory straight before ordering again. NIC: ConnectX-7 MCX715105AS-WEAT, single 400G port, OSFP cage Switch: 400G QSFP-DD ports In hand: a passive 400G…
On an HP 5820-24XG-SFP+ (JC102A) the ports cabled with genuine HP X240 10G SFP+ 3 m DACs (JD097C) came up but logged OPTMOD/4/FIBERSFPMODULENOWINVALID: This is not a supported transceiver for this platform, and broadcast/multicast counters on those ports grew faster than normal. The cable is lisetd…
We run a three-node cluster with the nodes cabled directly to each other over 100G DAC, no switch in the path, and the interfaces put into a broadcast bond so replication traffic has its own fabric. Before I put real load on it I wanted a baseline, and the numbers do not agree with each other. 3x…
The poster configured new HP 2530-48G switches (J9281B) with J9775A SFP+ direct-attach cables bought as accessories. The ports stayed down and the log said FFI: port 49 Transceiver type not supported in this port; show tech transceivers first showed nothing and, afer upgrading from YA.15.12.0007 to…
A 2920-48G-PoE+ (J9729A) rejected a J9283B 3 m SFP+ DAC with 00536 FFI: port 45 Transceiver type not supported in this port even though HP lists the cable as compatible; the same cable worked in a 2530 with SFP+ slots. Firmware had been updated without effect. A later reader noticed an old J9283B…
Small office, two buildings, and all I want is a plaain 1000M fibre link between the racks. Both ends are configured for 1000M, both stay dark, and this has been dragging on for weeks now. TP-Link TL-SG3452P, hardware V3, firmware 3.20.4, link taken from one of its SFP cages PLANET IGS-6329-8UP2S4…
