Live DB — analyst tables
Test
X AI 2048 MI300X CX-7 Hyperscaler Infiniband Cluster Configuration

XAI-MI300X-CX7-IB-2L

X AI · MI300X · CX-7

Rack type
Cluster / location
MI300X - Infiniband Cluster
Buyer profile
Hyperscaler
Networking type
Infiniband
Number of XPUs
2,048
NIC used
CX-7
NICs / XPU
1
Scale-out BW / XPU
400G
XPU / server
8

Scale-up network

Assigned blockDefault
MI300X
Scale-UpXPU: MI300X0 linesshared by 8 SKUs

Scale-up Units are based on the scale-up world size (8 XPUs).

XPU World Size

2
WS
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
XPUs per Node·84481432
Scale-Up World Size·83,584··

Switches

1
SW
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
Scale-Up Switch Total··0··

Connections & cabling

3
CN
Scale-Up Network LayerPart / Model
Units#
BW / PortGbit/s uni-d
Unit DP#
DP / Port#
Total DPs#
BW / ConnectorCable / Model
Cable Units#
Male Connectors·······Already Counted Below·
Female Connectors·······Already Counted Below·
Switch Total
Male Connectors·······Already Counted Below·
Notes
  • XPUs per Node — >>Mesh, 7x64Gb/s links per chip

Scale-Up Parts Summary

0
ItemQty/ClusterQty/ServerAttach/XPU

Backend network

5 rows
Assigned blockDefault
MI300X - CX7 - 2L - IB - QM9700 - Generic
BackendXPU: MI300X5 linesshared by 2 SKUs

Backend Units are based on the cluster size (2,048 XPUs).

Switches

4
SW
 Network Layer
Switch and Server SpecAggregate Port UtilizationNetwork Bandwidth Aggregate
SwitchPart Name / Model
Units#
Unit BWGbit/s
Port BWGbit/s
Downlink Ports / SW#
Uplink Ports / SW#
Max Ports#
Downlink Ports#
Uplink Ports#
Total Ports#
Downlink BWTbit/s
Uplink BWTbit/s
OversubRatio
XPUs·2,04840040002,0482,04802,0482,0480819.2·
NICs per NodeConnectX-7 NIC - 400G8400400··8······
LeafQuantum-2 InfiniBand (QM9700)6425,6008001616321,0241,0242,048819.2819.21
SpineQuantum-2 InfiniBand (QM9700)3225,600800320321,02401,024819.20·

Transceivers

6
CN
 Network Layer
Transceiver / CablePart Name / Model
Total Units#
Units per SW/GPU#
Unit BWGbit/s
Lanes#
BW per LaneGbit/s
Agg. BWTbit/s
XPU NodesNvidia LinkX 400G SR42,0482,048400850819.2
Leaf
DownlinkNvidia LinkX 800G SR81,024168008100819.2
UplinkNvidia LinkX 800G SR81,024168008100819.2
Spine
DownlinkNvidia LinkX 800G SR81,024328008100819.2
UplinkNvidia LinkX 800G SR80·····
Core
Downlink·······
Uplink·······
Super-Core

Cables

6
CB
 Network Layer
Cable/ FiberType
Total Units#
Units per Transceiver#
Unit BWGbit/s
Lane Count#
SerDes BWGbit/s
XPU NodesNvidia LinkX 400G Multimode2,04814004100
Leaf
DownlinkAlready counted above·····
UplinkNvidia LinkX 400G Multimode2,04824004100
Spine
DownlinkAlready counted above·····
Uplink······
Core
DownlinkAlready counted above·····
Uplink······
Super-Core

Backend Parts Summary

5
ItemQty/ClusterQty/ServerAttach/XPU
Nvidia LinkX 400G SR42,0488.001.00
Nvidia LinkX 400G Multimode4,09616.002.00
Nvidia LinkX 800G SR83,07212.001.50
ConnectX-7 NIC - 400G2,0488.001.00
Quantum-2 InfiniBand (QM9700)960.380.05

Frontend network

11 rows
Assigned blockDefault
MI300X - Juniper QFX5240 - XAI
FrontendXPU: MI300X11 linesshared by 1 SKU

Converged Frontend + Storage Fabric

11
LayerPart / ModelUnitsAttach / XPU
·Juniper Tomahawk 5 51.2T (QFX5240)250.0120
·Juniper Ethernet 12.8T (QFX5130)00.0000
·Juniper Ethernet 6.4T (QFX5200)40.0018
·1GbE Juniper Ethernet (EX4400)300.0147
·Nvidia LinkX 800G SR81,1890.5807
·Nvidia LinkX 400G SR41,1830.5777
·Nvidia LinkX 100G SR4 QSFP285250.2563
·Nvidia LinkX 800G Multimode1,6280.7947
·Nvidia LinkX 400G Multimode80.0041
·Nvidia LinkX 100G Multimode2340.1142
·RJ45 Cables1,4430.7048

Frontend Parts Summary

11
ItemQty/ClusterQty/ServerAttach/XPU
Juniper Tomahawk 5 51.2T (QFX5240)2500.0120
Juniper Ethernet 12.8T (QFX5130)000.0001
Juniper Ethernet 6.4T (QFX5200)400.0018
1GbE Juniper Ethernet (EX4400)3000.0147
Nvidia LinkX 800G SR81,18950.5807
Nvidia LinkX 400G SR41,18350.5777
Nvidia LinkX 100G SR4 QSFP2852520.2563
Nvidia LinkX 800G Multimode1,62860.7947
Nvidia LinkX 400G Multimode800.0041
Nvidia LinkX 100G Multimode23410.1142
RJ45 Cables1,44360.7048

Compute Tray Networking Content

4 rows

Networking components inside the compute tray — accelerators, board-to-board connectors, retimers, and their per-tray bandwidth.

Assigned blockDefault
MI300X - Generic
Compute TrayXPU: MI300X4 linesshared by 8 SKUs
Tray layerPart / ModelUnits per Tray
Unit BWGb/s
Lanes
Lane BWGb/s
Per switch
XPUs per TrayRubin 2004····
PCIe 6.0 Connector (Male)Paladin Board to Board 32 Pin 4p8c (Male)2512···
PCIe 6.0 Connector (Male)Paladin Board to Board 64 Pin 4p16c (Male)81,024···
PCIe 6.0 Connector (Female)Paladin Board to Board 32 Pin 4p8c (Female)4512···
PCIe 6.0 Connector (Female)Paladin Board to Board 64 Pin 4p16c (Female)161,024···
PCIe 6.0 Connector (Male)Paladin Board to Board 32 Pin 4p8c (Male)2512···
PCIe 6.0 Connector (Male)Paladin Board to Board 64 Pin 4p16c (Male)81,024···
Notes
  • PCIe 6.0 Connector (Male) · Paladin Board to Board 32 Pin 4p8c (Male) — 2 pins = 1DP
  • PCIe 6.0 Connector (Male) · Paladin Board to Board 64 Pin 4p16c (Male) — 2DP = 1Lane

Compute Tray Parts Summary

4
ItemQty/ClusterQty/ServerAttach/XPU
Paladin Board to Board 32 Pin 4p8c (Male)2,0488.001.00
Paladin Board to Board 64 Pin 4p16c (Male)8,19232.004.00
Paladin Board to Board 32 Pin 4p8c (Female)2,0488.001.00
Paladin Board to Board 64 Pin 4p16c (Female)8,19232.004.00