Live DB — analyst tables
Test
Amazon 131072 P5en-H100 NVL8 Nitro-v5 Hyperscaler EFA Cluster Configuration

AWS-P5en-H100 NVL8-EFA-WB

Amazon · H100 · Nitro-v5

Rack type
P5en NVL8
Cluster / location
P5en-H100 NVL8 Clusters
Buyer profile
Hyperscaler
Networking type
EFA
Number of XPUs
131,072
NIC used
Nitro-v5
NICs / XPU
2
Scale-out BW / XPU
400G
XPU / server
8

Scale-up network

1 rows
Assigned blockDefault
H100 - NVL8
Scale-UpXPU: H100 NVL81 lineshared by 17 SKUs

Scale-up Units are based on the scale-up world size (8 XPUs).

XPU World Size

2
WS
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
XPUs per Node·83,600··
Scale-Up World Size·828,800··

Switches

5
SW
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
Scale-Up Switch ANvidia NVSwitch 3.0 (NVLink 4)18,00020400
Scale-Up Switch BNvidia NVSwitch 3.0 (NVLink 4)16,40016400
Scale-Up Switch CNvidia NVSwitch 3.0 (NVLink 4)16,40016400
Scale-Up Switch DNvidia NVSwitch 3.0 (NVLink 4)18,00020400
Scale-Up Switch TotalNvidia NVSwitch 3.0 (NVLink 4)428,80072·

Scale-Up Parts Summary

1
ItemQty/ClusterQty/ServerAttach/XPU
Nvidia NVSwitch 3.0 (NVLink 4)65,5364.000.50

Backend network

5 rows
Assigned blockDefault
H100 - P5en NVL8 - EFAv3 - 3L - ETH - TH3 - AWS
BackendXPU: H100 P5en NVL85 linesshared by 1 SKU

Backend Units are based on the cluster size (131,072 XPUs).

Switches

5
SW
 Network Layer
Switch and Server SpecAggregate Port UtilizationNetwork Bandwidth Aggregate
SwitchPart Name / Model
Units#
Unit BWGbit/s
Port BWGbit/s
Downlink Ports / SW#
Uplink Ports / SW#
Max Ports#
Downlink Ports#
Uplink Ports#
Total Ports#
Downlink BWTbit/s
Uplink BWTbit/s
OversubRatio
XPUs·131,0724004000131,072131,0720131,072131,072052,428.8·
NICs per NodeEFAv3 Nitro-v5 200G NIC16200400··8······
ToRWhiteBox Tomahawk 3 12.8T8,19212,800400161632131,072131,072262,14452,428.852,428.81
LeafWhiteBox Tomahawk 3 12.8T8,19212,800400161632131,072131,072262,14452,428.852,428.81
SpineWhiteBox Tomahawk 3 12.8T4,09612,80040032032131,0720131,07252,428.80·

Transceivers

8
CN
 Network Layer
Transceiver / CablePart Name / Model
Total Units#
Units per SW/GPU#
Unit BWGbit/s
Lanes#
BW per LaneGbit/s
Agg. BWTbit/s
GPU NodesNone - AECs are Used ->131,072131,072400410052,428.8
CPU NodesNone - AECs are Used ->32,768·····
Leaf
DownlinkGeneric 400G DR4131,07216400410052,428.8
UplinkGeneric 400G DR4131,072#ERR400#ERR1000
Spine
DownlinkGeneric 400G DR4131,072#ERR400#ERR1000
Uplink·······
Core
Downlink·······
Uplink·······
Super-Core
ToR
DownlinkNone - AECs are Used ->131,07216400410052,428.8
UplinkGeneric 400G DR4131,07216400410052,428.8

Cables

8
CB
 Network Layer
Cable/ FiberType
Total Units#
Units per Transceiver#
Unit BWGbit/s
Lane Count#
SerDes BWGbit/s
GPU NodesGeneric 400G Y Cable AEC131,07214004100
CPU Nodes······
Leaf
DownlinkAlready counted above·····
UplinkGeneric 400G Single Mode131,07214004100
Spine
Downlink······
Uplink······
Core
Downlink······
Uplink······
Super-Core
ToR
DownlinkAlready counted above·····
UplinkGeneric 400G Single Mode131,07214004100

Backend Parts Summary

5
ItemQty/ClusterQty/ServerAttach/XPU
Generic 400G Y Cable AEC131,0728.001.00
EFAv3 Nitro-v5 200G NIC262,14416.002.00
Generic 400G DR4524,28832.004.00
Generic 400G Single Mode262,14416.002.00
WhiteBox Tomahawk 3 12.8T20,4801.250.16

Frontend network

No converged frontend + storage fabric data for this cluster.

Frontend Parts Summary

0
ItemQty/ClusterQty/ServerAttach/XPU

Compute Tray Networking Content

2 rows

Networking components inside the compute tray — accelerators, board-to-board connectors, retimers, and their per-tray bandwidth.

Assigned blockDefault
H100 - P5en NVL8 - AWS
Compute TrayXPU: H100 P5en NVL82 linesshared by 1 SKU
Tray layerPart / ModelUnits per Tray
Unit BWGb/s
Lanes
Lane BWGb/s
Per switch
XPUs per TrayBlackwell 2008····
Compute TrayBroadcom PEX89144 Gen 5.0 144L4····
GPU to CPU TrayGeneric PCIe Gen5 x16 2-meter DAC8····

Compute Tray Parts Summary

2
ItemQty/ClusterQty/ServerAttach/XPU
Broadcom PEX89144 Gen 5.0 144L65,5364.000.50
Generic PCIe Gen5 x16 2-meter DAC131,0728.001.00