All questions
Latest questions from the community.
I run a small Proxmox box at home and wanted a proper 10G path to the storage node, so I dropped in a used Supermicro AOC-STGN-i1S. It is the plain Intel 82599 design, board marked E157872, and I assumed this would be the boring part of the build. It is not. Supermicro AOC-STGN-i1S, Intel X520-DA1…
We poll a handful of Nokia 7705 aggregation routers in LibreNMS and I wanted optical DOM off them for the usual reason - catching a span going soft before the customer notices. Discovery never finishes on those devices. Nokia 7705 running TiMOS LibreNMS 26.3.1 Ordinary single-lane 1G SFPs in the…
The poster had third-party SFP+ optics for both the on-board Intel X553 ports of a Netgate XG-7100 and an add-in X520-DA2 and had found that hw.ixgbe.unsupportedsfp=1 in /boot/loader.conf enables them. Questions: does it apply to both on-board and PCIe Intel ports, what is the difference between…
The poster tried a Mellanox MFA2P10-Axxx 25G SFP28 AOC between a MikroTik switch and a Supermicro server with an Intel X722 (ixl driver) under pfSense. The cable linked fine switch-to-switch but on the X722 ifconfig -vvvm showed the module recognised (10GBase-SFI, 1000Base-KX listed) yet no carrier…
2votes
2comments
273views
A QSFPTEK 10GBASE-T SFP+ module installed in port ix1 of a passively cooled Netgate 6100 reported 73 C through DDM although the room was at 20 C; the module is specified for 0-70 C and up to 2.5 W. The poster asked for known-good RJ45 SFP+ modules that stay within spec. Hardware involved: Netgate…
5votes
5comments
223views
Bringing up a pair of GPU boxes against our existing 400G fabric, and I have already managed to buy the wrong cable once, so I would rather get the theory straight before ordering again. NIC: ConnectX-7 MCX715105AS-WEAT, single 400G port, OSFP cage Switch: 400G QSFP-DD ports In hand: a passive 400G…
A DS14-MK4 shelf came my way for almost nothing and I would like to hang it off an ordinary tower server as bulk storage at home. It is fully populated with its original carriers, it powers up, fans spin, front panel looks alive - but I cannot get a single disk to appear on the host. NetApp…
4votes
5comments
132views
I do small batches of module recoding for integrators, and until now everything on my bench has been SFP-shaped: read the 256 bytes at A0h with the serial ID in the first half, read A2h for the diagnostics and thresholds, write the identification block, done. A customer has now turned up with 100G…
On a Supermicro SYS-1019D-FRN8TP running VyOS 1.4 rolling the on-board Intel X722 (i40e) did not recognise an ISP-supplied 1310/1270 nm single-fibre SFP nor other spare optics; ethtool -m returned Cannot get module EEPROM information: Invalid argument. The poster asked how to apply the well-known…
Running a small virtualization setup: two Proxmox 6 nodes and a target on FreeNAS 11.2. While the HBAs were connected to the target directly, everything ran for months without a single error. Put a used Brocade 200e between them to avoid crossing cables, and that's when it started. two Proxmox 6…
We run a pair of racks that hand off to a carrier-facing Cisco NCS, and one of the 100G server uplinks has never come up since the build. Same result after moving the server to another cabinet with a different patch panel, so I have stopped treating it as a one-off. Supermicro server…
On a Protectli Vault 6 with Intel X710 SFP+ ports (ixl0/ixl1) a 1G EZConn ETB43315-7S34-FR SFP showed no carrier. Logs contained Invalid advertised speed; valid flags are: 0x06, ixl1setlink: Error getting phy capabilities -37, aq error: 8 and Link failed because an unqualified module was detected!…
An XCP-ng host with an Intel X520-DA2 and Finisar SFP+ transceivers logged failed to load because an unsupported SFP+ or QSFP module type was detected. insmod with allowunsupportedsfp=1 failed with Unknown symbol in module; options ixgbe allowunsupportedsfp=1 in /etc/modprobe.d/ixgbe-options.conf…
We are lighting a handful of channels over one metro pair with passive mux and demux at both ends, 100 GHz plan. Everything I can actually source is fixed-wavelength DWDM SFP+, a separate part number per channel, and keeping spares that way is getting silly. 10G aggregation at both ends, SFP+ cages…
6votes
4comments
111views
I am wiring per-port optical telemetry into monitoring for a couple of Nexus 9000 fabrics. Collection runs through NAPALM, and the getter I lean on is getoptics(). Nexus 9000 leaf and spine pairs QSFP-100G-CWDM4 modules on the fabric links NAPALM with the nxosssh driver, SSH transport, no NX-API…
Joining two buildings over a Nortel pair that has been in place longer than I have. The plan was simply to light the existing house fibre between the two switches and be done with it, but port 23 will not come up on either end. Two Nortel ERS 5510-24T, software 4.0.2.02 1000SX SFP GBICs, one in…
New ESXi host going into a rack that hangs off a campus 3850. Management on copper came up without drama, the 10G uplinks did not: as soon as the server boots, the switch port drops into err-disable and the host sees nothing on that vmnic. Lenovo ThinkSystem SR650, 7X06CTO1WW, with an Emulex VFA5.2…
6votes
6comments
141views
My fibre WAN runs into a Turris Omnia and I moved from the ISP box to an XPON stick to drop one hop. The stick is a 2.5G part, the Omnia cage does 2.5G, and everything still lands at 1G. Turris Omnia, Turris OS 7.0.2 HBS, kernel 5.15.148 Luleey LL-XS2510 XPON SFP, RTL960x based, DFP-34X-2C2 family…
Home setup, and I am trying to get rid of the ISP router on a Cosmote GPON line. The idea is to run the fibre straight into the UDM-Pro and let the stick do the ONU job, but the provider only accepts the session if the 12-character serial and the device model string of the old CPE are presented, so…
Small office, one leased line, and the carrier terminated it on an ADVA FSP150CP screwed to the wall of the comms cupboard. My job is to get our own router onto that circuit instead of renting one from them, so the ix0 SFP+ port of a Netgate XG-7100 goes straight ino the ADVA access port. Netgate…
One host in a blade chassis went to ESXi 8.0 U3 and came back with no Fibre Channel at all. The datastores are gone, the adapters are not in the storage adapter list, and nothing logs in on the fabric side for those ports. The rest of the cluster is untouched and still sees the same LUNs. blade…
Small tower site: an RB4011 in a ventilated roadside cabinet feeding a couple of radios, with one 10GBASE-T copper hop over to the switch because there was already cable in the duct. The port drops out on warm afternoons and comes back at night, which points fairly clearly at the module rather than…
After upgrading to Proxmox VE 8 with the 6.x kernel, on-board Intel X553 SFP+ ports that worked on kernel 5.15.108 showed NO-CARRIER even with the cable and module connected. The regression was traced to an upstream ixgbe commit (565736048bd5) that broke auto-negotiation handling for X550/X553…
Coming from ordinary office switching, so treat this as a beginner question on the industrial side. I am replacing a long copper run between two panels with fiber on a pair of Stratix 5700 switches and I have never used the SFP slots on these. What I have: two Stratix 5700 switches, one per panel…
On Proxmox VE 6.0 (kernel 5.0.18-1-pve, ixgbe 5.1.0-k) an Intel X520-DA2 exposed ens1f0/ens1f1 but any inserted thirrd-party SFP+ module produced failed to load because an unsupported SFP+ or QSFP module type was detected, and the driver had to be reloaded to detect module changes at all. Hardware…
A Dell R720 with the integrated i350/X520 daughter card ran Proxmox VE; Cisco-branded 10G multimode LC SFP+ modules that worked elsewhere were rejected as unsupported. Adding options ixgbe allowunsupportedsfp=1 to the module options had no visible effect. Respondents walked through GRUB kernel…
We had a 200 m OM4 backbone pulled between two buildings a while back and I am trying to light it with kit we already own. Both ends are 2530s, both modules are the HPE part, and the link simply will not come up. 2x Aruba 2530-48G 2x J4858C 1000SX, port 51 on each side roughly 200 m of freshly…
5votes
6comments
174views
Our inventory tooling walks every switch and records vendor, part number and serial for each pluggable straight out of the SONiC CLI. It works everywhere except one batch of QSFP-DD modules, where the identity fields come back mangled and the asset database fills up with junk. Switch: SONiC…
On an HP 5820-24XG-SFP+ (JC102A) the ports cabled with genuine HP X240 10G SFP+ 3 m DACs (JD097C) came up but logged OPTMOD/4/FIBERSFPMODULENOWINVALID: This is not a supported transceiver for this platform, and broadcast/multicast counters on those ports grew faster than normal. The cable is lisetd…
On a Minisforum MS-01 running Proxmox (i40e, kernel 6.8.12-10-pve) the X710 SFP+ port enp2s0f0np0 recogniesd a Ubiquiti SFP+-to-RJ45 module (ethtool listed 10G Base-SR capability) but the link never came up: Link detected: no, interface DOWN, no dmesg errors, ip link set up made no difference…