Live DB — analyst tables
Test
Google 65536 TPUv6e NIC - 200G Hyperscaler Ethernet Cluster Configuration

GOOG-TPUv6e-800G-Eth-WB-256

Google · TPUv6e · NIC - 200G

Rack type
Cluster / location
TPUv6e 2D Torus Cluster
Buyer profile
Hyperscaler
Networking type
Ethernet
Number of XPUs
65,536
NIC used
NIC - 200G
NICs / XPU
0.5
Scale-out BW / XPU
100G
XPU / server
256

Scale-up network

Assigned blockDefault
TPUv6e
Scale-UpXPU: TPUv6e0 linesshared by 1 SKU

Scale-up Units are based on the scale-up world size (256 XPUs).

XPU World Size

2
WS
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Lane Count#
Lane BWGbit/s uni-d
XPUs per Node·····
Scale-Up World Size·256···

Switches

1
SW
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Lane Count#
Lane BWGbit/s uni-d
XPUs per Rack·64···
Notes
  • Scale-Up World Size — >>Mesh Configuration

Google ICI Networking

3D Torus Worksheet
11

Scale-Up Network Worksheet (per Scale-Up World Size) — per-TPU ICI connectivity by connector type, from the config workbook.

ConnectorPart / ModelTPUs
per TPU Units#
Units#
Unit BWGbit/s
Lane Count#
SerDes BWGbit/s
Attach Ratio# per GPU
Cluster Total#
TPU Scale-Up World Size256256
Interior TPUs112
Copper Cable800G Copper21128008100
PCBPCB2112
OpticalGeneric 800G FR8008008100
Edge TPUs144
Copper Cable800G Copper21448008100
PCBPCB2144
OpticalGeneric 800G FR8008008100
Total for TPU Rack256
Copper Cable800G Copper2568008100
ActiveNo Active Copper for 800G
PassiveGeneric 800G DAC2568008100165,536
PCBPCB144
OpticalGeneric 800G FR80800810000

Scale-Up Parts Summary

1
ItemQty/ClusterQty/ServerAttach/XPU
Generic 800G DAC65,536256.001.00

Backend network

6 rows
Assigned blockDefault
TPUv6e - 200G NIC - 4L - ETH - TH3 - GOOG
BackendXPU: TPUv6e6 linesshared by 1 SKU

Backend Units are based on the cluster size (65,536 TPUs).

Switches

7
SW
 Network Layer
Switch and Server SpecAggregate Port UtilizationNetwork Bandwidth Aggregate
SwitchPart Name / Model
Units#
Unit BWGbit/s
Port BWGbit/s
Downlink Ports / SW#
Uplink Ports / SW#
Max Ports#
Downlink Ports#
Uplink Ports#
Total Ports#
Downlink BWTbit/s
Uplink BWTbit/s
OversubRatio
TPUs·65,536100200032,76832,768032,76832,76806,553.6·
TPUs per Node·4····1······
NICs per NodeNIC - 200G2200200··1······
ToRWhiteBox Tomahawk 3 12.8T2,04812,80020016166432,76832,768131,0726,553.66,553.61
LeafWhiteBox Tomahawk 4 25.6T51225,600200646412832,76832,76865,5366,553.66,553.61
SpineWhiteBox Tomahawk 4 25.6T51225,600200646412832,76832,76865,5366,553.66,553.61
4 Aggregation Blocks
Core300x300 Port OCS128·200288288036,86436,86407,372.87,372.81

Transceivers

10
CN
 Network Layer
Transceiver / CablePart Name / Model
Total Units#
Units per SW/GPU#
Unit BWGbit/s
Lanes#
BW per LaneGbit/s
Agg. BWTbit/s
XPU NodesGeneric 200G DR4 QSFP5665,53665,53620045013,107.2
Leaf
DownlinkGeneric 200G DR4 QSFP5632,768642004506,553.6
UplinkGeneric 200G DR4 QSFP5632,768642004506,553.6
Spine
DownlinkGeneric 200G DR4 QSFP5632,76864200#ERR507,372.8
UplinkGeneric 200G FR432,76864200#ERR507,372.8
Core
Downlink·36,864288200··0
Uplink·36,864288200··6,553.6
Super-CoreOCS is Circular, 288 North, 288 South······
ToR
DownlinkGeneric 200G DR4 QSFP5632,768162004506,553.6
UplinkGeneric 200G DR4 QSFP5632,768162004506,553.6

Cables

10
CB
 Network Layer
Cable/ FiberType
Total Units#
Units per Transceiver#
Unit BWGbit/s
Lane Count#
SerDes BWGbit/s
XPU NodesGeneric 200G Single Mode65,5361200450
Leaf
DownlinkAlready counted above·····
UplinkGeneric 200G Single Mode32,7681200450
Spine
DownlinkAlready counted above·····
Uplink·32,7681200450
Core
DownlinkAlready counted above·····
Uplink······
Super-Core······
ToR
DownlinkAlready counted above·····
UplinkGeneric 200G Single Mode32,7681200450

Backend Parts Summary

6
ItemQty/ClusterQty/ServerAttach/XPU
Generic 200G DR4 QSFP56229,376896.003.50
Generic 200G Single Mode131,072512.002.00
NIC - 200G20.010.00
WhiteBox Tomahawk 3 12.8T2,0488.000.03
WhiteBox Tomahawk 4 25.6T1,0244.000.02
Generic 200G FR432,768128.000.50

Frontend network

No converged frontend + storage fabric data for this cluster.

Frontend Parts Summary

0
ItemQty/ClusterQty/ServerAttach/XPU

Compute Tray Networking Content

1 rows

Networking components inside the compute tray — accelerators, board-to-board connectors, retimers, and their per-tray bandwidth.

Assigned blockDefault
TPUv6e - GOOG
Compute TrayXPU: TPUv6e1 lineshared by 1 SKU
Tray layerPart / ModelUnits per Tray
Unit BWGb/s
Lanes
Lane BWGb/s
Per switch
XPUs per TrayTPUv7x (Ironwood)4····
TPU Tray to Host TrayPCIe 5.0 x16 Cable4512···

Compute Tray Parts Summary

1
ItemQty/ClusterQty/ServerAttach/XPU
PCIe 5.0 x16 Cable65,536256.001.00