Live DB — analyst tables
Test
Google 32768 TPUv7x (Ironwood) NIC - 100G Hyperscaler Ethernet Cluster Configuration
GOOG-TPUv5e-400G-Eth-WB-256
Google · TPUv5e · NIC - 100G
Rack type
—
Cluster / location
TPUv5p 3D Torus Cluster
Buyer profile
Hyperscaler
Networking type
Ethernet
Number of XPUs
32,768
NIC used
NIC - 100G
NICs / XPU
0.5
Scale-out BW / XPU
50G
XPU / server
256
Scale-up network
Assigned blockDefault
TPUv5e
Scale-UpXPU: TPUv5e0 linesshared by 1 SKU
Scale-up Units are based on the scale-up world size (256 XPUs).
XPU World Size
2
WS| Scale-Up Network Layer | Part / Model | Units# | Unit BWGbit/s uni-d | Lane Count# | Lane BWGbit/s uni-d |
|---|---|---|---|---|---|
| XPUs per Node | · | 256 | · | · | · |
| Scale-Up World Size | · | 256 | · | · | · |
Switches
2
SW| Scale-Up Network Layer | Part / Model | Units# | Unit BWGbit/s uni-d | Lane Count# | Lane BWGbit/s uni-d |
|---|---|---|---|---|---|
| per World | 144x144 Port OCS | 48 | · | · | · |
| per Scale-Up | · | 170.667 | · | · | · |
Notes
- per World · 144x144 Port OCS — >>Only 140 ports are used
Google ICI Networking
3D Torus Worksheet
11
Scale-Up Network Worksheet (per Scale-Up World Size) — per-TPU ICI connectivity by connector type, from the config workbook.
| Connector | Part / Model | TPUs | per TPU Units# | Units# | Unit BWGbit/s | Lane Count# | SerDes BWGbit/s | Attach Ratio# per GPU | Cluster Total# |
|---|---|---|---|---|---|---|---|---|---|
| TPU Rack | 64 | ||||||||
| Interior TPUs | 112 | ||||||||
| Copper Cable | 400G Copper | 2 | 112 | 400 | 4 | 100 | |||
| PCB | PCB | 2 | 112 | ||||||
| Optical | 400G FR8 | 0 | 0 | 400 | 4 | 100 | |||
| Corner TPUs | 144 | ||||||||
| Copper Cable | 400G Copper | 2 | 144 | 400 | 4 | 100 | |||
| PCB | PCB | 2 | 144 | ||||||
| Optical | 400G FR8 | 0 | 0 | 400 | 4 | 100 | |||
| Total for TPU Rack | 64 | ||||||||
| Copper Cable | 400G Copper | 256 | 400 | 4 | 100 | ||||
| Active | No Active Copper for 400G | ||||||||
| Passive | Generic 400G DAC | 256 | 400 | 4 | 100 | 4 | 131,072 | ||
| PCB | PCB | 144 | |||||||
| Optical | 400G FR8 | 0 | 400 | 4 | 100 | 0 | 0 |
Scale-Up Parts Summary
1
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| Generic 400G DAC | 131,072 | 1,024.00 | 4.00 |
Backend network
6 rows
Assigned blockDefault
TPUv5e - 100G NIC - 4L - ETH - TH2 - GOOG
BackendXPU: TPUv5e6 linesshared by 1 SKU
Backend Units are based on the cluster size (32,768 TPUs).
Switches
7
SW Network Layer | Switch and Server Spec | Aggregate Port Utilization | Network Bandwidth Aggregate | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
SwitchPart Name / Model | Units# | Unit BWGbit/s | Port BWGbit/s | Downlink Ports / SW# | Uplink Ports / SW# | Max Ports# | Downlink Ports# | Uplink Ports# | Total Ports# | Downlink BWTbit/s | Uplink BWTbit/s | OversubRatio | |
| TPUs | · | 32,768 | 50 | 100 | 0 | 16,384 | 16,384 | 0 | 16,384 | 16,384 | 0 | 1,638.4 | · |
| TPUs per Node | · | 4 | · | · | · | · | 1 | · | · | · | · | · | · |
| NICs per Node | NIC - 100G | 2 | 100 | 100 | · | · | 1 | · | · | · | · | · | · |
| ToR | WhiteBox Tomahawk 2 6.4T | 2,048 | 6,400 | 100 | 16 | 16 | 64 | 32,768 | 32,768 | 131,072 | 3,276.8 | 3,276.8 | 1 |
| Leaf | WhiteBox Tomahawk 3 12.8T | 512 | 12,800 | 100 | 64 | 64 | 128 | 32,768 | 32,768 | 65,536 | 3,276.8 | 3,276.8 | 1 |
| Spine | WhiteBox Tomahawk 3 12.8T | 512 | 12,800 | 100 | 64 | 64 | 128 | 32,768 | 32,768 | 65,536 | 3,276.8 | 3,276.8 | 1 |
| 4 Aggregation Blocks | |||||||||||||
| Core | 136x136 Port OCS | 256 | · | 100 | 128 | 128 | 0 | 32,768 | 32,768 | 0 | 3,276.8 | 3,276.8 | 1 |
Transceivers
10
CN Network Layer | Transceiver / CablePart Name / Model | Total Units# | Units per SW/GPU# | Unit BWGbit/s | Lanes# | BW per LaneGbit/s | Agg. BWTbit/s |
|---|---|---|---|---|---|---|---|
| XPU Nodes | Generic 100G DR4 QSFP28 | 32,768 | 65,536 | 100 | 4 | 25 | 3,276.8 |
| Leaf | |||||||
| Downlink | Generic 100G DR4 QSFP28 | 32,768 | 64 | 100 | 4 | 25 | 3,276.8 |
| Uplink | Generic 100G DR4 QSFP28 | 32,768 | 64 | 100 | 4 | 25 | 3,276.8 |
| Spine | |||||||
| Downlink | Generic 100G DR4 QSFP28 | 32,768 | 64 | 100 | #ERR | 25 | 3,276.8 |
| Uplink | Generic 100G FR4 | 32,768 | 64 | 100 | #ERR | 25 | 3,276.8 |
| Core | |||||||
| Downlink | · | 32,768 | 128 | 100 | · | · | 0 |
| Uplink | · | 32,768 | 128 | 100 | · | · | 3,276.8 |
| Super-Core | OCS is Circular, 128 North, 128 South | · | · | · | · | · | · |
| ToR | |||||||
| Downlink | Generic 100G DR4 QSFP28 | 32,768 | 16 | 100 | 4 | 25 | 3,276.8 |
| Uplink | Generic 100G DR4 QSFP28 | 32,768 | 16 | 100 | 4 | 25 | 3,276.8 |
Cables
10
CB Network Layer | Cable/ FiberType | Total Units# | Units per Transceiver# | Unit BWGbit/s | Lane Count# | SerDes BWGbit/s |
|---|---|---|---|---|---|---|
| XPU Nodes | Generic 100G Single Mode | 32,768 | 1 | 100 | 4 | 25 |
| Leaf | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | Generic 100G Single Mode | 32,768 | 1 | 100 | 4 | 25 |
| Spine | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | · | 32,768 | 1 | 100 | 4 | 25 |
| Core | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | · | · | · | · | · | · |
| Super-Core | · | · | · | · | · | · |
| ToR | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | Generic 100G Single Mode | 32,768 | 1 | 100 | 4 | 25 |
Backend Parts Summary
6
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| Generic 100G DR4 QSFP28 | 196,608 | 1,536.00 | 6.00 |
| Generic 100G Single Mode | 98,304 | 768.00 | 3.00 |
| NIC - 100G | 256 | 2.00 | 0.01 |
| WhiteBox Tomahawk 2 6.4T | 2,048 | 16.00 | 0.06 |
| WhiteBox Tomahawk 3 12.8T | 1,024 | 8.00 | 0.03 |
| Generic 100G FR4 | 32,768 | 256.00 | 1.00 |
Frontend network
No converged frontend + storage fabric data for this cluster.
Frontend Parts Summary
0
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|
Compute Tray Networking Content
1 rows
Networking components inside the compute tray — accelerators, board-to-board connectors, retimers, and their per-tray bandwidth.
Assigned blockDefault
TPUv5e - GOOG
Compute TrayXPU: TPUv5e1 lineshared by 1 SKU
| Tray layer | Part / Model | Units per Tray | Unit BWGb/s | Lanes | Lane BWGb/s | Per switch |
|---|---|---|---|---|---|---|
| XPUs per Tray | TPUv7x (Ironwood) | 4 | · | · | · | · |
| TPU Tray to Host Tray | PCIe 5.0 x16 Cable | 4 | 512 | · | · | · |
Compute Tray Parts Summary
1
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| PCIe 5.0 x16 Cable | 32,768 | 256.00 | 1.00 |