Live DB — analyst tables
Test
X AI 2048 MI350X Thor-2 400G NIC Hyperscaler Ethernet Cluster Configuration

XAI-MI350X-THOR2-Eth-2L

X AI · MI350X · Thor-2 400G NIC

Rack type
Cluster / location
MI350X - Ethernet Cluster
Buyer profile
Hyperscaler
Networking type
Ethernet
Number of XPUs
2,048
NIC used
Thor-2 400G NIC
NICs / XPU
1
Scale-out BW / XPU
400G
XPU / server
8

Scale-up network

Assigned blockDefault
MI350X
Scale-UpXPU: MI350X0 linesshared by 8 SKUs

Scale-up Units are based on the scale-up world size (8 XPUs).

Note: Scale-up fabric (AMD Infinity Fabric): 7 links per GPU × 153.6 GB/s bidirectional = 1,075.2 GB/s bidirectional, i.e. 537.6 GB/s unidirectional per GPU. The 448 GB/s unidirectional figure is the prior-generation MI300X value (7 × 128 GB/s bidirectional); MI350X (CDNA4) upgraded the Infinity Fabric links to 153.6 GB/s. (AMD Instinct MI350X platform brief)

XPU World Size

2
WS
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
XPUs per Node·8537.61438.4
Scale-Up World Size·84,300.8··

Switches

1
SW
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
Scale-Up Switch Total··0··

Connections & cabling

3
CN
Scale-Up Network LayerPart / Model
Units#
BW / PortGbit/s uni-d
Unit DP#
DP / Port#
Total DPs#
BW / ConnectorCable / Model
Cable Units#
Male Connectors·······Already Counted Below·
Female Connectors·······Already Counted Below·
Switch Total
Male Connectors·······Already Counted Below·
Notes
  • XPUs per Node — >>Mesh, 7x153.6Gb/s bidirectional links per chip due to improved CDNA PHY from MI300X (Fabric-only upgrade)

Scale-Up Parts Summary

0
ItemQty/ClusterQty/ServerAttach/XPU

Backend network

5 rows
Assigned blockDefault
MI350X - Thor2 - 2L - ETH - 7060DX5-64E - XAI
BackendXPU: MI350X5 linesshared by 1 SKU

Backend Units are based on the cluster size (2,048 XPUs).

Switches

4
SW
 Network Layer
Switch and Server SpecAggregate Port UtilizationNetwork Bandwidth Aggregate
SwitchPart Name / Model
Units#
Unit BWGbit/s
Port BWGbit/s
Downlink Ports / SW#
Uplink Ports / SW#
Max Ports#
Downlink Ports#
Uplink Ports#
Total Ports#
Downlink BWTbit/s
Uplink BWTbit/s
OversubRatio
XPUs·2,04840040002,0482,04802,0482,0480819.2·
NICs per NodeThor-2 400G NIC8400400··8······
LeafArista Tomahawk 4 25.6T (7060DX5-64E)6425,6008001616321,0241,0242,048819.2819.21
SpineArista Tomahawk 4 25.6T (7060DX5-64E)3225,60080032·321,02401,024819.20·

Transceivers

6
CN
 Network Layer
Transceiver / CablePart Name / Model
Total Units#
Units per SW/GPU#
Unit BWGbit/s
Lanes#
BW per LaneGbit/s
Agg. BWTbit/s
XPU NodesGeneric 400G SR42,0482,048400850819.2
Leaf
DownlinkGeneric 800G SR81,024168008100819.2
UplinkGeneric 800G SR81,024168008100819.2
Spine
DownlinkGeneric 800G SR81,024328008100819.2
UplinkGeneric 800G SR80·····
Core
Downlink·······
Uplink·······
Super-Core

Cables

6
CB
 Network Layer
Cable/ FiberType
Total Units#
Units per Transceiver#
Unit BWGbit/s
Lane Count#
SerDes BWGbit/s
XPU NodesGeneric 400G Multimode2,04814004100
Leaf
DownlinkAlready counted above·····
UplinkGeneric 400G Multimode2,04824004100
Spine
DownlinkAlready counted above·····
Uplink······
Core
DownlinkAlready counted above·····
Uplink······
Super-Core

Backend Parts Summary

5
ItemQty/ClusterQty/ServerAttach/XPU
Generic 400G SR42,0488.001.00
Generic 400G Multimode4,09616.002.00
Generic 800G SR83,07212.001.50
Thor-2 400G NIC2,0488.001.00
Arista Tomahawk 4 25.6T (7060DX5-64E)960.380.05

Frontend network

11 rows
Assigned blockDefault
MI350X - Juniper QFX5240 - XAI
FrontendXPU: MI350X11 linesshared by 1 SKU

Converged Frontend + Storage Fabric

11
LayerPart / ModelUnitsAttach / XPU
·Juniper Tomahawk 5 51.2T (QFX5240)250.0120
·Juniper Ethernet 12.8T (QFX5130)00.0000
·Juniper Ethernet 6.4T (QFX5200)40.0018
·1GbE Juniper Ethernet (EX4400)300.0147
·Generic 800G SR81,1890.5807
·Generic 400G SR41,1830.5777
·Generic 100G SR4 QSFP285250.2563
·Generic 800G Multimode1,6280.7947
·Generic 400G Multimode80.0041
·Generic 100G Multimode2340.1142
·RJ45 Cables1,4430.7048

Frontend Parts Summary

11
ItemQty/ClusterQty/ServerAttach/XPU
Juniper Tomahawk 5 51.2T (QFX5240)2500.0120
Juniper Ethernet 12.8T (QFX5130)000.0001
Juniper Ethernet 6.4T (QFX5200)400.0018
1GbE Juniper Ethernet (EX4400)3000.0147
Generic 800G SR81,18950.5807
Generic 400G SR41,18350.5777
Generic 100G SR4 QSFP2852520.2563
Generic 800G Multimode1,62860.7947
Generic 400G Multimode800.0041
Generic 100G Multimode23410.1142
RJ45 Cables1,44360.7048

Compute Tray Networking Content

4 rows

Networking components inside the compute tray — accelerators, board-to-board connectors, retimers, and their per-tray bandwidth.

Assigned blockDefault
MI350X - Generic
Compute TrayXPU: MI350X4 linesshared by 8 SKUs
Tray layerPart / ModelUnits per Tray
Unit BWGb/s
Lanes
Lane BWGb/s
Per switch
XPUs per TrayRubin 2004····
PCIe 6.0 Connector (Male)Paladin Board to Board 32 Pin 4p8c (Male)2512···
PCIe 6.0 Connector (Male)Paladin Board to Board 64 Pin 4p16c (Male)81,024···
PCIe 6.0 Connector (Female)Paladin Board to Board 32 Pin 4p8c (Female)4512···
PCIe 6.0 Connector (Female)Paladin Board to Board 64 Pin 4p16c (Female)161,024···
PCIe 6.0 Connector (Male)Paladin Board to Board 32 Pin 4p8c (Male)2512···
PCIe 6.0 Connector (Male)Paladin Board to Board 64 Pin 4p16c (Male)81,024···
Notes
  • PCIe 6.0 Connector (Male) · Paladin Board to Board 32 Pin 4p8c (Male) — 2 pins = 1DP
  • PCIe 6.0 Connector (Male) · Paladin Board to Board 64 Pin 4p16c (Male) — 2DP = 1Lane

Compute Tray Parts Summary

4
ItemQty/ClusterQty/ServerAttach/XPU
Paladin Board to Board 32 Pin 4p8c (Male)2,0488.001.00
Paladin Board to Board 64 Pin 4p16c (Male)8,19232.004.00
Paladin Board to Board 32 Pin 4p8c (Female)2,0488.001.00
Paladin Board to Board 64 Pin 4p16c (Female)8,19232.004.00