Live DB — analyst tables
Test
Google 65536 TPUv4 NIC - 100G Hyperscaler Ethernet Cluster Configuration

GOOG-TPUv4-400G-Eth-WB-4096

Google · TPUv4 · NIC - 100G

Rack type
Cluster / location
TPUv4 Cluster - 3D Torus
Buyer profile
Hyperscaler
Networking type
Ethernet
Number of XPUs
65,536
NIC used
NIC - 100G
NICs / XPU
0.5
Scale-out BW / XPU
50G
XPU / server
4,096

Scale-up network

Assigned blockDefault
TPUv4
Scale-UpXPU: TPUv40 linesshared by 1 SKU

Scale-up Units are based on the scale-up world size (4,096 XPUs).

XPU World Size

2
WS
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Lane Count#
Lane BWGbit/s uni-d
XPUs per Node·4,096···
Scale-Up World Size·4,096···

Switches

2
SW
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Lane Count#
Lane BWGbit/s uni-d
per World64x64 Port OCS48···
per Cluster·341.333···

Google ICI Networking

3D Torus Worksheet
17

Scale-Up Network Worksheet (per Scale-Up World Size) — per-TPU ICI connectivity by connector type, from the config workbook.

ConnectorPart / ModelTPUs
per TPU Units#
Units#
Unit BWGbit/s
Lane Count#
SerDes BWGbit/s
Attach Ratio# per GPU
Cluster Total#
TPU Rack64
Interior TPUs8
Copper Cable400G Copper4164004100
PCBPCB28
Optical400G FR8004004100
Corner TPUs8
Copper Cable400G Copper144004100
PCBPCB28
Optical400G FR83244004100
Edge TPUs24
Copper Cable400G Copper2244004100
PCBPCB224
Optical400G FR82484004100
Face TPUs24
Copper Cable400G Copper3364004100
PCBPCB224
Optical400G FR81244004100
Total for TPU Rack64
Copper Cable400G Copper8040041001.2581,920
ActiveNo Active Copper for 400G
PassiveGeneric 400G DAC8040041001.2581,920
PCBPCB560.8857,344
Optical400G FR89640041001.598,304

Scale-Up Parts Summary

4
ItemQty/ClusterQty/ServerAttach/XPU
400G Copper81,9205,120.001.25
Generic 400G DAC81,9205,120.001.25
PCB57,3443,584.000.88
400G FR898,3046,144.001.50

Backend network

7 rows
Assigned blockDefault
TPUv4 - 100G NIC - 4L - ETH - TH2 - GOOG
BackendXPU: TPUv47 linesshared by 1 SKU

Backend Units are based on the cluster size (65,536 TPUs).

Switches

7
SW
 Network Layer
Switch and Server SpecAggregate Port UtilizationNetwork Bandwidth Aggregate
SwitchPart Name / Model
Units#
Unit BWGbit/s
Port BWGbit/s
Downlink Ports / SW#
Uplink Ports / SW#
Max Ports#
Downlink Ports#
Uplink Ports#
Total Ports#
Downlink BWTbit/s
Uplink BWTbit/s
OversubRatio
TPUs·65,53650100032,76832,768032,76832,76803,276.8·
TPUs per Node·4····1······
NICs per NodeNIC - 100G2100100··1······
ToRWhiteBox Tomahawk 2 6.4T2,0486,40010016166432,76832,768131,0723,276.83,276.81
LeafWhiteBox Tomahawk 3 12.8T51212,800100646412832,76832,76865,5363,276.83,276.81
SpineWhiteBox Tomahawk 3 12.8T51212,800100646412832,76832,76865,5363,276.83,276.81
4 Aggregation Blocks
Core136x136 Port OCS256·100128128032,76832,76803,276.83,276.81

Transceivers

10
CN
 Network Layer
Transceiver / CablePart Name / Model
Total Units#
Units per SW/GPU#
Unit BWGbit/s
Lanes#
BW per LaneGbit/s
Agg. BWTbit/s
XPU NodesNone - AECs are Used ->32,76865,5361004253,276.8
Leaf
DownlinkGeneric 100G DR4 QSFP2832,768641004253,276.8
UplinkGeneric 100G DR4 QSFP2832,768641004253,276.8
Spine
DownlinkGeneric 100G DR4 QSFP2832,76864100#ERR253,276.8
UplinkGeneric 100G FR432,76864100#ERR253,276.8
Core
Downlink·32,768128100··0
Uplink·32,768128100··3,276.8
Super-CoreOCS is Circular, 128 North, 128 South······
ToR
DownlinkNone - AECs are Used ->32,768161004253,276.8
UplinkGeneric 100G DR4 QSFP2832,768161004253,276.8

Cables

10
CB
 Network Layer
Cable/ FiberType
Total Units#
Units per Transceiver#
Unit BWGbit/s
Lane Count#
SerDes BWGbit/s
XPU NodesGeneric 100G AEC32,7681100425
Leaf
DownlinkAlready counted above·····
UplinkGeneric 100G Single Mode32,7681100425
Spine
DownlinkAlready counted above·····
Uplink·32,7681100425
Core
DownlinkAlready counted above·····
Uplink······
Super-Core······
ToR
DownlinkAlready counted above·····
UplinkGeneric 100G Single Mode32,7681100425

Backend Parts Summary

7
ItemQty/ClusterQty/ServerAttach/XPU
Generic 100G AEC32,7682,048.000.50
Generic 100G DR4 QSFP28131,0728,192.002.00
Generic 100G Single Mode65,5364,096.001.00
NIC - 100G322.000.00
WhiteBox Tomahawk 2 6.4T2,048128.000.03
WhiteBox Tomahawk 3 12.8T1,02464.000.02
Generic 100G FR432,7682,048.000.50

Frontend network

No converged frontend + storage fabric data for this cluster.

Frontend Parts Summary

0
ItemQty/ClusterQty/ServerAttach/XPU

Compute Tray Networking Content

1 rows

Networking components inside the compute tray — accelerators, board-to-board connectors, retimers, and their per-tray bandwidth.

Assigned blockDefault
TPUv4 - GOOG
Compute TrayXPU: TPUv41 lineshared by 1 SKU
Tray layerPart / ModelUnits per Tray
Unit BWGb/s
Lanes
Lane BWGb/s
Per switch
TPU Tray to Host TrayPCIe 3.0 x16 Cable4512···

Compute Tray Parts Summary

1
ItemQty/ClusterQty/ServerAttach/XPU
PCIe 3.0 x16 Cable···