Live DB — analyst tables
Test
Google 65536 B200 RoCE NIC - 400G Hyperscaler Infiniband Cluster Configuration

GOOG-B200-Eth-DEF

Google · B200 · RoCE NIC - 400G

Rack type
NVL8
Cluster / location
All Other Clusters
Buyer profile
Hyperscaler
Networking type
Infiniband
Number of XPUs
65,536
NIC used
RoCE NIC - 400G
NICs / XPU
1
Scale-out BW / XPU
400G
XPU / server
8

Scale-up network

1 rows
Assigned blockDefault
B200 - NVL8
Scale-UpXPU: B200 NVL81 lineshared by 6 SKUs

Scale-up Units are based on the scale-up world size (8 XPUs).

XPU World Size

2
WS
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
XPUs per Node·87,20018400
Scale-Up World Size·857,600··

Switches

2
SW
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
per SwitchNvidia NVSwitch 5.0 (NVLink 5)128,80072400
Scale-Up Switch TotalNvidia NVSwitch 5.0 (NVLink 5)257,60072·

Scale-Up Parts Summary

1
ItemQty/ClusterQty/ServerAttach/XPU
Nvidia NVSwitch 5.0 (NVLink 5)16,3842.000.25

Backend network

6 rows
Assigned blockDefault
B200 - NVL8 - CX7 - 3L - ETH - TH5 - GOOG
BackendXPU: B200 NVL86 linesshared by 1 SKU

Backend Units are based on the cluster size (65,536 XPUs).

Switches

5
SW
 Network Layer
Switch and Server SpecAggregate Port UtilizationNetwork Bandwidth Aggregate
SwitchPart Name / Model
Units#
Unit BWGbit/s
Port BWGbit/s
Downlink Ports / SW#
Uplink Ports / SW#
Max Ports#
Downlink Ports#
Uplink Ports#
Total Ports#
Downlink BWTbit/s
Uplink BWTbit/s
OversubRatio
XPUs·65,536400400065,53665,536065,53665,536026,214.4·
NICs per NodeConnectX-7 NIC - 400G8400400··8······
LeafWhiteBox Tomahawk 5 51.2T1,02451,20080032326432,76832,76865,53626,214.426,214.41
SpineWhiteBox Tomahawk 5 51.2T1,02451,20080032326432,76832,76865,53626,214.426,214.41
CoreWhiteBox Tomahawk 5 51.2T51251,2008006406432,768032,76826,214.40·

Transceivers

6
CN
 Network Layer
Transceiver / CablePart Name / Model
Total Units#
Units per SW/GPU#
Unit BWGbit/s
Lanes#
BW per LaneGbit/s
Agg. BWTbit/s
XPU NodesGeneric 400G DR465,53665,536400410026,214.4
Leaf
DownlinkGeneric 800G DR832,76832800810026,214.4
UplinkGeneric 800G DR832,76832800810026,214.4
Spine
DownlinkGeneric 800G DR832,76832800810026,214.4
UplinkGeneric 800G DR832,76832800810026,214.4
Core
DownlinkGeneric 800G DR832,76864800810026,214.4
Uplink·······
Super-Core

Cables

6
CB
 Network Layer
Cable/ FiberType
Total Units#
Units per Transceiver#
Unit BWGbit/s
Lane Count#
SerDes BWGbit/s
XPU NodesGeneric 400G Single Mode65,53614004100
Leaf
DownlinkAlready counted above·····
UplinkGeneric 800G Single Mode32,76818008100
Spine
DownlinkAlready counted above·····
UplinkGeneric 800G Single Mode32,76818008100
Core
DownlinkAlready counted above·····
Uplink······
Super-Core

Backend Parts Summary

6
ItemQty/ClusterQty/ServerAttach/XPU
Generic 400G DR465,5368.001.00
Generic 400G Single Mode65,5368.001.00
Generic 800G DR8163,84020.002.50
Generic 800G Single Mode65,5368.001.00
ConnectX-7 NIC - 400G65,5368.001.00
WhiteBox Tomahawk 5 51.2T2,5600.310.04

Frontend network

11 rows
Assigned blockDefault
B200 - NVL8 - WhiteBox TH5 - GOOG
FrontendXPU: B200 NVL811 linesshared by 1 SKU

Converged Frontend + Storage Fabric

11
LayerPart / ModelUnitsAttach / XPU
·WhiteBox Tomahawk 5 51.2T7870.0120
·WhiteBox Tomahawk 3 12.8T30.0000
·WhiteBox Tomahawk 2 6.4T1170.0018
·Generic 1GbE Ethernet9620.0147
·Generic 800G DR838,0570.5807
·Generic 400G SR837,8590.5777
·Generic 100G SR4 QSFP2816,8000.2563
·Generic 800G Single Mode52,0840.7947
·Generic 400G Multimode2670.0041
·Generic 100G Multimode7,4830.1142
·RJ45 Cables46,1870.7048

Frontend Parts Summary

11
ItemQty/ClusterQty/ServerAttach/XPU
WhiteBox Tomahawk 5 51.2T78700.0120
WhiteBox Tomahawk 3 12.8T300.0001
WhiteBox Tomahawk 2 6.4T11700.0018
Generic 1GbE Ethernet96200.0147
Generic 800G DR838,05750.5807
Generic 400G SR837,85950.5777
Generic 100G SR4 QSFP2816,80020.2563
Generic 800G Single Mode52,08460.7947
Generic 400G Multimode26700.0041
Generic 100G Multimode7,48310.1142
RJ45 Cables46,18760.7048

Compute Tray Networking Content

1 rows

Networking components inside the compute tray — accelerators, board-to-board connectors, retimers, and their per-tray bandwidth.

Assigned blockDefault
B200 - NVL8 - Generic
Compute TrayXPU: B200 NVL81 lineshared by 5 SKUs
Tray layerPart / ModelUnits per Tray
Unit BWGb/s
Lanes
Lane BWGb/s
Per switch
XPUs per TrayBlackwell 2008····
B200 ServerNVLink PCIe 5.0 x16 Retimer8512···

Compute Tray Parts Summary

1
ItemQty/ClusterQty/ServerAttach/XPU
NVLink PCIe 5.0 x16 Retimer65,5368.001.00