Live DB — analyst tables
Test
Amazon 131072 GB200 NVL36x2 Nitro-v5 Hyperscaler EFA Cluster Configuration

AWS-GB200 NVL36x2-EFA-WB

Amazon · GB200 · Nitro-v5

Rack type
NVL36x2
Cluster / location
GB200 NVL36x2 Clusters
Buyer profile
Hyperscaler
Networking type
EFA
Number of XPUs
131,072
NIC used
Nitro-v5
NICs / XPU
2
Scale-out BW / XPU
400G
XPU / server
72

Scale-up network

8 rows
Assigned blockDefault
GB200 - NVL36x2
Scale-UpXPU: GB200 NVL36x28 linesshared by 6 SKUs

Scale-up Units are based on the scale-up world size (72 XPUs).

XPU World Size

2
WS
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
XPUs per Node·47,20018400
Scale-Up World Size·72518,400··

Switches

2
SW
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
per SwitchNvidia NVSwitch 5.0 (NVLink 5)128,80072400
Scale-Up Switch Total·361,036,800··

Connections & cabling

10
CN
Scale-Up Network LayerPart / Model
Units#
BW / PortGbit/s uni-d
Unit DP#
DP / Port#
Total DPs#
BW / ConnectorCable / Model
Cable Units#
Ultrapass to SwitchNV 1 UltraPass OverPass 72 DP 224Gb/s72400144410,3687,200··
Male ConnectorsNV Paladin HD2 224Gb/s 72 DP (Male)14440072410,3687,200Already Counted Below·
Female ConnectorsNV Paladin HD2 224Gb/s 72 DP (Female)14440072410,3687,200Already Counted Below·
Switch Total (Connectors)** Two connectors per switch·····14,400··
Male ConnectorsNV Paladin HD2 224Gb/s 72 DP (Male)724007245,1847,200Already Counted Below·
Female ConnectorsNV Paladin HD2 224Gb/s 72 DP (Female)724007245,1847,200NV 224Gb/s SkewClear EXD Gen 2 Cable5,184
XPU Total (Connectors)** One connector per GPU·····14,400··
Overpass to 1.6T OSFP CageNV OverPass DensiLink UltraPass (NVLink 5)324·······
Cross Rack CablesNV 1.6T Twin Port OSFP 2x800G LinkX NVLink5 ACC162·······
·NVL Spine Chassis (NvLink 5)4·······
Notes
  • Male Connectors · NV Paladin HD2 224Gb/s 72 DP (Male) — >> 16 lanes or 32 DP are Redundant
  • Female Connectors · NV Paladin HD2 224Gb/s 72 DP (Female) — >> Explains why the DPs avail at switch trays exceed
  • per Switch · Nvidia NVSwitch 5.0 (NVLink 5) — >>> Only 50% of ports utilized for GPU-Switch Connection
  • Switch Total (Connectors) · ** Two connectors per switch — ...DPs avail on the XPU Tray

Scale-Up Parts Summary

8
ItemQty/ClusterQty/ServerAttach/XPU
Nvidia NVSwitch 5.0 (NVLink 5)65,53636.000.50
NV 1 UltraPass OverPass 72 DP 224Gb/s131,07272.001.00
NV Paladin HD2 224Gb/s 72 DP (Male)393,216216.003.00
NV Paladin HD2 224Gb/s 72 DP (Female)393,216216.003.00
NV 224Gb/s SkewClear EXD Gen 2 Cable9,437,1845,184.0072.00
NV OverPass DensiLink UltraPass (NVLink 5)589,824324.004.50
NV 1.6T Twin Port OSFP 2x800G LinkX NVLink5 ACC294,912162.002.25
NVL Spine Chassis (NvLink 5)7,2824.000.06

Backend network

7 rows
Assigned blockDefault
GB200 - NVL36x2 - EFAv3 - 3L - ETH - TH3 - AWS
BackendXPU: GB200 NVL36x27 linesshared by 1 SKU

Backend Units are based on the cluster size (131,072 XPUs).

Switches

5
SW
 Network Layer
Switch and Server SpecAggregate Port UtilizationNetwork Bandwidth Aggregate
SwitchPart Name / Model
Units#
Unit BWGbit/s
Port BWGbit/s
Downlink Ports / SW#
Uplink Ports / SW#
Max Ports#
Downlink Ports#
Uplink Ports#
Total Ports#
Downlink BWTbit/s
Uplink BWTbit/s
OversubRatio
XPUs·131,0724004000131,072131,0720131,072131,072052,428.8·
NICs per NodeEFAv3 Nitro-v5 200G NIC8200400··8······
ToRWhiteBox Tomahawk 3 12.8T8,19212,800400161632131,072131,072262,14452,428.852,428.81
LeafWhiteBox Tomahawk 5 51.2T2,04851,2004006464128131,072131,072262,14452,428.852,428.81
SpineWhiteBox Tomahawk 5 51.2T1,02451,2004001280128131,0720131,07252,428.80·

Transceivers

7
CN
 Network Layer
Transceiver / CablePart Name / Model
Total Units#
Units per SW/GPU#
Unit BWGbit/s
Lanes#
BW per LaneGbit/s
Agg. BWTbit/s
GPU NodesNone - AECs are Used ->131,072131,072400410052,428.8
CPU NodesNone - AECs are Used ->32,768·····
Leaf
DownlinkGeneric 800G DR865,53632800810052,428.8
UplinkGeneric 800G DR865,536#ERR800#ERR1000
Spine
DownlinkGeneric 800G DR865,536#ERR800#ERR1000
Uplink·······
Core
Downlink·······
Uplink·······
Super-Core
ToR
DownlinkNone - AECs are Used ->131,0728400810052,428.8
UplinkGeneric 400G DR4131,0728400810052,428.8

Cables

7
CB
 Network Layer
Cable/ FiberType
Total Units#
Units per Transceiver#
Unit BWGbit/s
Lane Count#
SerDes BWGbit/s
GPU NodesGeneric 400G Y Cable AEC131,07214004100
CPU Nodes······
Leaf
DownlinkAlready counted above·····
UplinkGeneric 400G Single Mode131,07224004100
Spine
Downlink······
Uplink······
Core
Downlink······
Uplink······
Super-Core
ToR
DownlinkAlready counted above·····
UplinkGeneric 400G Single Mode131,07214004100

Backend Parts Summary

7
ItemQty/ClusterQty/ServerAttach/XPU
Generic 400G Y Cable AEC131,07272.001.00
EFAv3 Nitro-v5 200G NIC262,144144.002.00
Generic 400G DR4131,07272.001.00
Generic 400G Single Mode262,144144.002.00
WhiteBox Tomahawk 3 12.8T8,1924.500.06
Generic 800G DR8196,608108.001.50
WhiteBox Tomahawk 5 51.2T3,0721.690.02

Frontend network

No converged frontend + storage fabric data for this cluster.

Frontend Parts Summary

0
ItemQty/ClusterQty/ServerAttach/XPU

Compute Tray Networking Content

4 rows

Networking components inside the compute tray — accelerators, board-to-board connectors, retimers, and their per-tray bandwidth.

Assigned blockDefault
GB200 - NVL36x2 - AWS - EFA-WB
Compute TrayXPU: GB200 NVL36x24 linesshared by 1 SKU
Tray layerPart / ModelUnits per Tray
Unit BWGb/s
Lanes
Lane BWGb/s
Per switch
XPUs per TrayBlackwell 2004····
Bianca BoardNV MCIO PCIe x16 Connector2····
Bianca BoardNV MCIO PCIe x16 Cable2····
Mezz Board to OSFPNV DensiLink OverPass to OSFP Cage4····
Daughter BoardAstera Labs Scorpio-P 64-Lane PCIe Gen 5.04····

Compute Tray Parts Summary

4
ItemQty/ClusterQty/ServerAttach/XPU
NV MCIO PCIe x16 Connector65,53636.000.50
NV MCIO PCIe x16 Cable65,53636.000.50
NV DensiLink OverPass to OSFP Cage131,07272.001.00
Astera Labs Scorpio-P 64-Lane PCIe Gen 5.0131,07272.001.00