@twicedd@mr_r0b0t Yes, they seem to work well. Drops the sparks' temperature quite a few degrees and stops the switch screaming! The cluster is flat out at the moment, but I'll measure power on idle when it's there.
@mr_r0b0t@StevenM_42 its four of 400G to 2x 200G split cable from FS : "1m (3ft) NVIDIA/Mellanox MCP7H60-W001R30 Compatible 400G QSFP-DD 8 x 50G PAM4 to 2 x 200G QSFP56 4 x 50G PAM4 Ethernet Passive Copper Breakout Cable
CN HS Code: 85444210
Product ID: 101799"
@twicedd@mr_r0b0t Great! I got 3 pwm <> usb cables and connected them to a small 3-way usb power hub that you can see just above the switch. Everything goes through a couple of smart sockets that measure the power, running at around 1kw-1.5kw for all 8 sparks and the switch during inference.
@twicedd@mr_r0b0t Thanks! The fans are 3-way ones from Amazon: "upHere Gaming U3K3 All-in-One PC Fan - Low Noise 3x120mm Case Fan, High Performance Cooling, 1650 RPM Hydraulic Bearing, Quiet 25dB(A) for PC Case CPU Cooling - Black" and do a good job with airflow.