CodingBox Q&A Ask question

ConnectX-4 in InfiniBand mode: OpenSM reports PORT_DOWN and the SB7700 shows Unknown cable - the DAC was Ethernet-only

Asked Active Viewed 22 Original language: English
2

Two servers with dual-port ConnectX-4 VPI cards (CX456A, firmware 12.14.2036) connected back-to-back with copper cables run at about 100 Gb/s in Ethernet mode, but after switching the ports to InfiniBand OpenSM 4.6.1 loops with "Got invalid base LID 65535 from the network" and "SM port is down", and the physical state stays Disabled. Plugging the same cables into an SB7700 EDR switch leaves the switch ports in Down/Polling with "Unknown cable" / "Cable is not present" in show interface ib transceiver. What is wrong?

Comments 2

The reported cable was MCP1600-C002, qualified for 100GbE. Successful Ethernet operation did not establish InfiniBand support for the same physical cable.

3 South Korealanbyte16KR Original (English)

Replacing it wth MCP1600-E002, a VPI cabe for the required Ethernet/InfiniBand combination, resolved the case. Check the full cable part number and protocol qualification before changing OpenSM or HCA firmware.

1 Italylambdapilot72IT Original (English)
Log in to comment. Log in