Live DB — analyst tables
Test
Google 16384 H100 RoCE NIC - 200G Hyperscaler Ethernet Cluster Configuration

GOOG-H100-Eth-a3mega-16k

Google · H100 · RoCE NIC - 200G

Rack type
NVL8
Cluster / location
Default H100
Buyer profile
Hyperscaler
Networking type
Ethernet
Number of XPUs
16,384
NIC used
RoCE NIC - 200G
NICs / XPU
1
Scale-out BW / XPU
200G
XPU / server
8

Scale-up network

1 rows
Assigned blockDefault
H100 - NVL8
Scale-UpXPU: H100 NVL81 lineshared by 17 SKUs

Scale-up Units are based on the scale-up world size (8 XPUs).

XPU World Size

2
WS
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
XPUs per Node·83,600··
Scale-Up World Size·828,800··

Switches

5
SW
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
Scale-Up Switch ANvidia NVSwitch 3.0 (NVLink 4)18,00020400
Scale-Up Switch BNvidia NVSwitch 3.0 (NVLink 4)16,40016400
Scale-Up Switch CNvidia NVSwitch 3.0 (NVLink 4)16,40016400
Scale-Up Switch DNvidia NVSwitch 3.0 (NVLink 4)18,00020400
Scale-Up Switch TotalNvidia NVSwitch 3.0 (NVLink 4)428,80072·

Scale-Up Parts Summary

1
ItemQty/ClusterQty/ServerAttach/XPU
Nvidia NVSwitch 3.0 (NVLink 4)8,1924.000.50

Backend network

8 rows
Assigned blockDefault
H100 - NVL8 - 200G NIC - 3L - ETH - TH3 - GOOG
BackendXPU: H100 NVL88 linesshared by 1 SKU

Backend Units are based on the cluster size (16,384 XPUs).

Switches

5
SW
 Network Layer
Switch and Server SpecAggregate Port UtilizationNetwork Bandwidth Aggregate
SwitchPart Name / Model
Units#
Unit BWGbit/s
Port BWGbit/s
Downlink Ports / SW#
Uplink Ports / SW#
Max Ports#
Downlink Ports#
Uplink Ports#
Total Ports#
Downlink BWTbit/s
Uplink BWTbit/s
OversubRatio
XPUs·16,384200200016,38416,384016,38416,38403,276.8·
NICs per NodeRoCE NIC - 200G8····8······
LeafWhiteBox Tomahawk 3 12.8T2,04812,80040044328,1928,19265,5363,276.83,276.81
SpineWhiteBox Tomahawk 4 25.6T25625,6004003232648,1928,19216,3843,276.83,276.81
CoreWhiteBox Tomahawk 4 25.6T12825,600400640648,19208,1923,276.80·

Transceivers

7
CN
 Network Layer
Transceiver / CablePart Name / Model
Total Units#
Units per SW/GPU#
Unit BWGbit/s
Lanes#
BW per LaneGbit/s
Agg. BWTbit/s
GPU NodesNone - DACs are Used ->16,38416,3842004503,276.8
CPU NodesNone - DACs are Used ->······
Leaf
DownlinkNone - DACs are Used ->16,38482004503,276.8
UplinkGeneric 200G DR4 QSFP5616,38482004503,276.8
Spine
DownlinkGeneric 400G SR88,192324008503,276.8
UplinkGeneric 400G SR88,192324008503,276.8
Core
DownlinkGeneric 400G SR88,192644008503,276.8
Uplink·······
Super-Core

Cables

7
CB
 Network Layer
Cable/ FiberType
Total Units#
Units per Transceiver#
Unit BWGbit/s
Lane Count#
SerDes BWGbit/s
GPU NodesGeneric 200G 2-meter DAC16,3841200450
CPU Nodes······
Leaf
DownlinkAlready counted above·····
UplinkGeneric 200G Multimode16,3841200450
Spine
DownlinkAlready counted above·····
UplinkGeneric 400G Multimode8,1921400850
Core
Downlink······
Uplink······
Super-Core

Backend Parts Summary

8
ItemQty/ClusterQty/ServerAttach/XPU
Generic 200G 2-meter DAC16,3848.001.00
RoCE NIC - 200G16,3848.001.00
Generic 200G DR4 QSFP5616,3848.001.00
Generic 200G Multimode16,3848.001.00
WhiteBox Tomahawk 3 12.8T2,0481.000.13
Generic 400G SR824,57612.001.50
WhiteBox Tomahawk 4 25.6T3840.190.02
Generic 400G Multimode8,1924.000.50

Frontend network

11 rows
Assigned blockDefault
H100 - NVL8 - WhiteBox TH5 - GOOG
FrontendXPU: H100 NVL811 linesshared by 2 SKUs

Converged Frontend + Storage Fabric

11
LayerPart / ModelUnitsAttach / XPU
·WhiteBox Tomahawk 5 51.2T1970.0120
·WhiteBox Tomahawk 3 12.8T10.0000
·WhiteBox Tomahawk 2 6.4T290.0018
·Generic 1GbE Ethernet2410.0147
·Generic 800G DR89,5140.5807
·Generic 400G SR89,4650.5777
·Generic 100G SR4 QSFP284,2000.2563
·Generic 800G Single Mode13,0210.7947
·Generic 400G Multimode670.0041
·Generic 100G Multimode1,8710.1142
·RJ45 Cables11,5470.7048

Frontend Parts Summary

11
ItemQty/ClusterQty/ServerAttach/XPU
WhiteBox Tomahawk 5 51.2T19700.0120
WhiteBox Tomahawk 3 12.8T100.0001
WhiteBox Tomahawk 2 6.4T2900.0018
Generic 1GbE Ethernet24100.0147
Generic 800G DR89,51450.5807
Generic 400G SR89,46550.5777
Generic 100G SR4 QSFP284,20020.2563
Generic 800G Single Mode13,02160.7947
Generic 400G Multimode6700.0041
Generic 100G Multimode1,87110.1142
RJ45 Cables11,54760.7048

Compute Tray Networking Content

1 rows

Networking components inside the compute tray — accelerators, board-to-board connectors, retimers, and their per-tray bandwidth.

Assigned blockDefault
H100 - NVL8 - Generic
Compute TrayXPU: H100 NVL81 lineshared by 16 SKUs
Tray layerPart / ModelUnits per Tray
Unit BWGb/s
Lanes
Lane BWGb/s
Per switch
XPUs per TrayHopper 1008····
H100 ServerNVLink PCIe 5.0 x16 Retimer8512···

Compute Tray Parts Summary

1
ItemQty/ClusterQty/ServerAttach/XPU
NVLink PCIe 5.0 x16 Retimer16,3848.001.00