Live DB — analyst tables
Test
Google 143360 TPUv5p NIC - 100G Hyperscaler Ethernet Cluster Configuration
GOOG-TPUv5p-800G-Eth-WB-8960
Google · TPUv5p · NIC - 100G
Rack type
—
Cluster / location
TPUv5p 3D Torus Cluster
Buyer profile
Hyperscaler
Networking type
Ethernet
Number of XPUs
143,360
NIC used
NIC - 100G
NICs / XPU
0.5
Scale-out BW / XPU
50G
XPU / server
8,960
Scale-up network
Assigned blockDefault
TPUv5p
Scale-UpXPU: TPUv5p0 linesshared by 1 SKU
Scale-up Units are based on the scale-up world size (8,960 XPUs).
XPU World Size
2
WS| Scale-Up Network Layer | Part / Model | Units# | Unit BWGbit/s uni-d | Lane Count# | Lane BWGbit/s uni-d |
|---|---|---|---|---|---|
| XPUs per Node | · | 8,960 | · | · | · |
| Scale-Up World Size | · | 8,960 | · | · | · |
Switches
2
SW| Scale-Up Network Layer | Part / Model | Units# | Unit BWGbit/s uni-d | Lane Count# | Lane BWGbit/s uni-d |
|---|---|---|---|---|---|
| per World | 144x144 Port OCS | 48 | · | · | · |
| per Scale-Up | · | 768 | · | · | · |
Notes
- per World · 144x144 Port OCS — >>Only 140 ports are used
Google ICI Networking
3D Torus Worksheet
17
Scale-Up Network Worksheet (per Scale-Up World Size) — per-TPU ICI connectivity by connector type, from the config workbook.
| Connector | Part / Model | TPUs | per TPU Units# | Units# | Unit BWGbit/s | Lane Count# | SerDes BWGbit/s | Attach Ratio# per GPU | Cluster Total# |
|---|---|---|---|---|---|---|---|---|---|
| TPU Rack | 64 | ||||||||
| Interior TPUs | 8 | ||||||||
| Copper Cable | 800G Copper | 4 | 16 | 1,600 | 8 | 200 | |||
| PCB | PCB | 2 | 8 | ||||||
| Optical | Generic 800G FR8 | 0 | 0 | 1,600 | 8 | 200 | |||
| Corner TPUs | 8 | ||||||||
| Copper Cable | 800G Copper | 1 | 4 | 1,600 | 8 | 200 | |||
| PCB | PCB | 2 | 8 | ||||||
| Optical | Generic 800G FR8 | 3 | 24 | 1,600 | 8 | 200 | |||
| Edge TPUs | 24 | ||||||||
| Copper Cable | 800G Copper | 2 | 24 | 1,600 | 8 | 200 | |||
| PCB | PCB | 2 | 24 | ||||||
| Optical | Generic 800G FR8 | 2 | 48 | 1,600 | 8 | 200 | |||
| Face TPUs | 24 | ||||||||
| Copper Cable | 800G Copper | 3 | 36 | 1,600 | 8 | 200 | |||
| PCB | PCB | 2 | 24 | ||||||
| Optical | Generic 800G FR8 | 1 | 24 | 1,600 | 8 | 200 | |||
| Total for TPU Rack | 64 | ||||||||
| Copper Cable | 800G Copper | 80 | 1,600 | 8 | 200 | 1.25 | 179,200 | ||
| Active | No Active Copper for 800G | ||||||||
| Passive | Generic 800G DAC | 80 | 1,600 | 8 | 200 | 1.25 | 179,200 | ||
| PCB | PCB | 56 | 0.88 | 125,440 | |||||
| Optical | Generic 800G FR8 | 96 | 1,600 | 8 | 200 | 1.5 | 215,040 |
Scale-Up Parts Summary
4
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| 800G Copper | 179,200 | 11,200.00 | 1.25 |
| Generic 800G DAC | 179,200 | 11,200.00 | 1.25 |
| PCB | 125,440 | 7,840.00 | 0.88 |
| Generic 800G FR8 | 215,040 | 13,440.00 | 1.50 |
Backend network
7 rows
Assigned blockDefault
TPUv5p - 100G NIC - 4L - ETH - TH2 - GOOG
BackendXPU: TPUv5p7 linesshared by 1 SKU
Backend Units are based on the cluster size (143,360 TPUs).
Switches
7
SW Network Layer | Switch and Server Spec | Aggregate Port Utilization | Network Bandwidth Aggregate | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
SwitchPart Name / Model | Units# | Unit BWGbit/s | Port BWGbit/s | Downlink Ports / SW# | Uplink Ports / SW# | Max Ports# | Downlink Ports# | Uplink Ports# | Total Ports# | Downlink BWTbit/s | Uplink BWTbit/s | OversubRatio | |
| TPUs | · | 143,360 | 50 | 100 | 0 | 71,680 | 71,680 | 0 | 71,680 | 71,680 | 0 | 7,168 | · |
| TPUs per Node | · | 4 | · | · | · | · | 1 | · | · | · | · | · | · |
| NICs per Node | NIC - 100G | 2 | 100 | 100 | · | · | 1 | · | · | · | · | · | · |
| ToR | WhiteBox Tomahawk 2 6.4T | 4,480 | 6,400 | 100 | 16 | 16 | 64 | 71,680 | 71,680 | 286,720 | 7,168 | 7,168 | 1 |
| Leaf | WhiteBox Tomahawk 3 12.8T | 1,120 | 12,800 | 100 | 64 | 64 | 128 | 71,680 | 71,680 | 143,360 | 7,168 | 7,168 | 1 |
| Spine | WhiteBox Tomahawk 3 12.8T | 1,120 | 12,800 | 100 | 64 | 64 | 128 | 71,680 | 71,680 | 143,360 | 7,168 | 7,168 | 1 |
| 4 Aggregation Blocks | |||||||||||||
| Core | 320x320 OCS | 256 | · | 100 | 280 | 280 | 0 | 71,680 | 71,680 | 0 | 7,168 | 7,168 | 1 |
Transceivers
10
CN Network Layer | Transceiver / CablePart Name / Model | Total Units# | Units per SW/GPU# | Unit BWGbit/s | Lanes# | BW per LaneGbit/s | Agg. BWTbit/s |
|---|---|---|---|---|---|---|---|
| XPU Nodes | Generic 100G DR4 QSFP28 | 71,680 | 143,360 | 100 | 4 | 25 | 7,168 |
| Leaf | |||||||
| Downlink | Generic 100G DR4 QSFP28 | 71,680 | 64 | 100 | 4 | 25 | 7,168 |
| Uplink | Generic 100G DR4 QSFP28 | 71,680 | 64 | 100 | 4 | 25 | 7,168 |
| Spine | |||||||
| Downlink | Generic 100G DR4 QSFP28 | 71,680 | 64 | 100 | #ERR | 25 | 7,168 |
| Uplink | Generic 100G FR4 | 71,680 | 64 | 100 | #ERR | 25 | 7,168 |
| Core | |||||||
| Downlink | · | 71,680 | 280 | 100 | · | · | 0 |
| Uplink | · | 71,680 | 280 | 100 | · | · | 7,168 |
| Super-Core | OCS is Circular, 280 North, 280 South | · | · | · | · | · | · |
| ToR | |||||||
| Downlink | Generic 100G DR4 QSFP28 | 71,680 | 16 | 100 | 4 | 25 | 7,168 |
| Uplink | Generic 100G DR4 QSFP28 | 71,680 | 16 | 100 | 4 | 25 | 7,168 |
Cables
10
CB Network Layer | Cable/ FiberType | Total Units# | Units per Transceiver# | Unit BWGbit/s | Lane Count# | SerDes BWGbit/s |
|---|---|---|---|---|---|---|
| XPU Nodes | Generic 100G Single Mode | 71,680 | 1 | 100 | 4 | 25 |
| Leaf | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | Generic 100G Single Mode | 71,680 | 1 | 100 | 4 | 25 |
| Spine | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | · | 71,680 | 1 | 100 | 4 | 25 |
| Core | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | · | · | · | · | · | · |
| Super-Core | · | · | · | · | · | · |
| ToR | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | Generic 100G Single Mode | 71,680 | 1 | 100 | 4 | 25 |
Backend Parts Summary
7
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| Generic 100G DR4 QSFP28 | 430,080 | 26,880.00 | 3.00 |
| Generic 100G Single Mode | 215,040 | 13,440.00 | 1.50 |
| NIC - 100G | 32 | 2.00 | 0.00 |
| WhiteBox Tomahawk 2 6.4T | 4,480 | 280.00 | 0.03 |
| WhiteBox Tomahawk 3 12.8T | 2,240 | 140.00 | 0.02 |
| Generic 100G FR4 | 71,680 | 4,480.00 | 0.50 |
| 320x320 OCS | 256 | 16.00 | 0.00 |
Frontend network
No converged frontend + storage fabric data for this cluster.
Frontend Parts Summary
0
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|
Compute Tray Networking Content
1 rows
Networking components inside the compute tray — accelerators, board-to-board connectors, retimers, and their per-tray bandwidth.
Assigned blockDefault
TPUv5p - GOOG
Compute TrayXPU: TPUv5p1 lineshared by 1 SKU
| Tray layer | Part / Model | Units per Tray | Unit BWGb/s | Lanes | Lane BWGb/s | Per switch |
|---|---|---|---|---|---|---|
| XPUs per Tray | TPUv7x (Ironwood) | 4 | · | · | · | · |
| TPU Tray to Host Tray | PCIe 5.0 x16 Cable | 4 | 512 | · | · | · |
Compute Tray Parts Summary
1
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| PCIe 5.0 x16 Cable | 143,360 | 8,960.00 | 1.00 |