Live DB — analyst tables
Test
Amazon 131072 Teton3 Max Nitro-v6 Hyperscaler EFA Cluster Configuration
AWS-Teton3 MAX-Nv6-EFA-WB-320L
Amazon · Trainium3 · Nitro-v6
Rack type
Teton3 Max
Cluster / location
Teton3 Max Clusters
Buyer profile
Hyperscaler
Networking type
EFA
Number of XPUs
131,072
NIC used
Nitro-v6
NICs / XPU
1
Scale-out BW / XPU
400G
XPU / server
144
Scale-up network
9 rows
Assigned blockDefault
Trainium3 - Teton3 Max - AWS - 3
Scale-UpXPU: Trainium3 Teton3 Max9 linesshared by 1 SKU
Scale-up Units are based on the scale-up world size (144 XPUs).
XPU World Size
2
WS| Scale-Up Network Layer | Part / Model | Units# | Unit BWGbit/s uni-d | Lane Count# | Lane BWGbit/s uni-d |
|---|---|---|---|---|---|
| XPUs per Node | · | 4 | · | · | · |
| Scale-Up World Size | · | 144 | · | · | · |
Switches
4
SW| Scale-Up Network Layer | Part / Model | Units# | Unit BWGbit/s uni-d | Lane Count# | Lane BWGbit/s uni-d |
|---|---|---|---|---|---|
| per Switch | Astera Labs Scorpio X 320-lane PCIe Gen 6.0 | 1 | 10,240 | 160 | 64 |
| per Switch | Astera Labs Scorpio-P 32-Lane PCIe Gen 6.0 | 1 | 2,048 | 32 | 64 |
| Scale-Up Switch Total | Astera Labs Scorpio X 320-lane PCIe Gen 6.0 | 40 | 10,240 | · | · |
| Scale-Up Switch Total | Astera Labs Scorpio-P 32-Lane PCIe Gen 6.0 | 288 | · | · | · |
Connections & cabling
8
CN| Scale-Up Network Layer | Part / Model | Units# | BW / LaneGbit/s uni-d | Unit DP# | DP / Lane# | Total DPs# | BW / Connector | Cable / Model | Cable Units# |
|---|---|---|---|---|---|---|---|---|---|
| Male Connectors | Paladin HD 112Gb/s 320 DP (Male) | 80 | 64 | 320 | 2 | 25,600 | 10,240 | Already Counted Below | · |
| Female Connectors | Paladin HD 112Gb/s 320 DP (Female) | 80 | 64 | 320 | 2 | 25,600 | 10,240 | 112Gb/s SkewClear EXD Cable | 25,600 |
| Switch Total | ** Two Connectors per Switch | · | · | · | · | · | · | · | · |
| Male Connectors | Strada Whisper 112Gb/s 80 DP Absolute Connector (Male) | 288 | 64 | 80 | 2 | 23,040 | 2,560 | Already Counted Below | · |
| Female Connectors | Strada Whisper 112Gb/s 80 DP Absolute Connector (Female) | 288 | 64 | 80 | 2 | 23,040 | 2,560 | Already Counted Below | · |
| XPU Total | ** Two Connectors per XPU | · | · | · | · | · | · | · | · |
| · | Generic PCIe Gen6 x16 (128Gb/s uni-di) 2-meter AEC | 72 | · | · | · | · | · | · | · |
| · | Teton3 Backplane Chassis | 2 | · | · | · | · | · | · | · |
Notes
- Male Connectors · Paladin HD 112Gb/s 320 DP (Male) — >> 16 lanes or 32 DP are Redundant
- Female Connectors · Paladin HD 112Gb/s 320 DP (Female) — >> Explains why the DPs avail at switch trays exceed
- Switch Total · ** Two Connectors per Switch — ...DPs avail on the XPU Tray
PCIe Lane Math
PCIe Lane Math
18
PCIe lane accounting for the Trainium scale-up domain. Values behave like spreadsheet cells: type = to start a formula, then click other Value cells to link them (hard-coded values read blue, pure cell links read white).
| Section | Metric | Value# | Note |
|---|---|---|---|
| · | Lanes per Connector pair | 160 | · |
| · | Total Lanes per Switch | 320 | >> Only 288 Lanes Utilized per Switch |
| · | Redundant Lanes | 32 | · |
| · | Switch Tray Paladin Units per Chip | 2 | · |
| · | DP per Connector pair | 80 | · |
| · | DP per Lane | 2 | · |
| · | Lanes per Connector pair | 40 | · |
| · | Backplane Lanes per Chip | 64 | · |
| · | Spare Lanes | 16 | · |
| · | XPU Strada Whisper Units per Chip | 2 | · |
| (a) | Number of Chips | 144 | · |
| · | AEC Lanes per Chip | 16 | · |
| · | Lanes per AEC | 16 | · |
| · | AEC Units per (a) | 72 | · |
| · | Backplane Lanes | 64 | · |
| · | AEC Lanes | 16 | · |
| · | PCB Lanes | 64 | · |
| · | Total Lanes per Trainium | 144 | · |
Scale-Up Parts Summary
9
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| Astera Labs Scorpio X 320-lane PCIe Gen 6.0 | 36,409 | 40.00 | 0.28 |
| Astera Labs Scorpio-P 32-Lane PCIe Gen 6.0 | 262,144 | 288.00 | 2.00 |
| Paladin HD 112Gb/s 320 DP (Male) | 72,818 | 80.00 | 0.56 |
| Paladin HD 112Gb/s 320 DP (Female) | 72,818 | 80.00 | 0.56 |
| 112Gb/s SkewClear EXD Cable | 23,301,689 | 25,600.00 | 177.78 |
| Strada Whisper 112Gb/s 80 DP Absolute Connector (Male) | 262,144 | 288.00 | 2.00 |
| Strada Whisper 112Gb/s 80 DP Absolute Connector (Female) | 262,144 | 288.00 | 2.00 |
| Generic PCIe Gen6 x16 (128Gb/s uni-di) 2-meter AEC | 65,536 | 72.00 | 0.50 |
| Teton3 Backplane Chassis | 1,820 | 2.00 | 0.01 |
Backend network
7 rows
Assigned blockDefault
Trainium3 - Teton3 Max - EFAv4 - 3L - ETH - TH3 - AWS - 2
BackendXPU: Trainium3 Teton3 Max7 linesshared by 1 SKU
Backend Units are based on the cluster size (131,072 XPUs).
Switches
5
SW Network Layer | Switch and Server Spec | Aggregate Port Utilization | Network Bandwidth Aggregate | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
SwitchPart Name / Model | Units# | Unit BWGbit/s | Port BWGbit/s | Downlink Ports / SW# | Uplink Ports / SW# | Max Ports# | Downlink Ports# | Uplink Ports# | Total Ports# | Downlink BWTbit/s | Uplink BWTbit/s | OversubRatio | |
| XPUs | · | 131,072 | 400 | 200 | 0 | 262,144 | 262,144 | 0 | 262,144 | 262,144 | 0 | 52,428.8 | · |
| NICs per Node | EFAv4 Nitro-v6 400G NIC | 2 | 400 | 200 | · | · | 8 | · | · | · | · | · | · |
| ToR | WhiteBox Tomahawk 3 12.8T | 8,192 | 12,800 | 400 | 16 | 16 | 32 | 131,072 | 131,072 | 262,144 | 52,428.8 | 52,428.8 | 1 |
| Leaf | WhiteBox Tomahawk 5 51.2T | 2,048 | 51,200 | 400 | 64 | 64 | 128 | 131,072 | 131,072 | 262,144 | 52,428.8 | 52,428.8 | 1 |
| Spine | WhiteBox Tomahawk 5 51.2T | 1,024 | 51,200 | 400 | 128 | 0 | 128 | 131,072 | 0 | 131,072 | 52,428.8 | 0 | · |
Transceivers
7
CN Network Layer | Transceiver / CablePart Name / Model | Total Units# | Units per SW/GPU# | Unit BWGbit/s | Lanes# | BW per LaneGbit/s | Agg. BWTbit/s |
|---|---|---|---|---|---|---|---|
| GPU Nodes | None - AECs are Used -> | 131,072 | 131,072 | 400 | 4 | 100 | 52,428.8 |
| CPU Nodes | None - AECs are Used -> | 32,768 | · | · | · | · | · |
| Leaf | |||||||
| Downlink | Generic 800G DR8 | 65,536 | 32 | 800 | 8 | 100 | 52,428.8 |
| Uplink | Generic 800G DR8 | 65,536 | #ERR | 800 | #ERR | 100 | 0 |
| Spine | |||||||
| Downlink | Generic 800G DR8 | 65,536 | #ERR | 800 | #ERR | 100 | 0 |
| Uplink | · | · | · | · | · | · | · |
| Core | |||||||
| Downlink | · | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · | · |
| Super-Core | |||||||
| ToR | |||||||
| Downlink | None - AECs are Used -> | 131,072 | 8 | 400 | 8 | 100 | 52,428.8 |
| Uplink | Generic 400G DR4 | 131,072 | 8 | 400 | 8 | 100 | 52,428.8 |
Cables
7
CB Network Layer | Cable/ FiberType | Total Units# | Units per Transceiver# | Unit BWGbit/s | Lane Count# | SerDes BWGbit/s |
|---|---|---|---|---|---|---|
| GPU Nodes | Generic 400G AEC | 131,072 | 1 | 400 | 4 | 100 |
| CPU Nodes | · | · | · | · | · | · |
| Leaf | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | Generic 400G Single Mode | 131,072 | 2 | 400 | 4 | 100 |
| Spine | ||||||
| Downlink | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · |
| Core | ||||||
| Downlink | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · |
| Super-Core | ||||||
| ToR | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | Generic 400G Single Mode | 131,072 | 1 | 400 | 4 | 100 |
Backend Parts Summary
7
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| Generic 400G AEC | 131,072 | 144.00 | 1.00 |
| EFAv4 Nitro-v6 400G NIC | 65,536 | 72.00 | 0.50 |
| Generic 400G DR4 | 131,072 | 144.00 | 1.00 |
| Generic 400G Single Mode | 262,144 | 288.00 | 2.00 |
| WhiteBox Tomahawk 3 12.8T | 8,192 | 9.00 | 0.06 |
| Generic 800G DR8 | 196,608 | 216.00 | 1.50 |
| WhiteBox Tomahawk 5 51.2T | 3,072 | 3.38 | 0.02 |
Frontend network
No converged frontend + storage fabric data for this cluster.
Frontend Parts Summary
0
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|
Compute Tray Networking Content
3 rows
Networking components inside the compute tray — accelerators, board-to-board connectors, retimers, and their per-tray bandwidth.
Assigned blockDefault
Trainium3 - Teton3 Max - AWS
Compute TrayXPU: Trainium3 Teton3 Max3 linesshared by 3 SKUs
| Tray layer | Part / Model | Units per Tray | Unit BWGb/s | Lanes | Lane BWGb/s | Per switch |
|---|---|---|---|---|---|---|
| XPUs per Tray | Trainium3 | 4 | · | · | · | 4 |
| To Front End CPU (PCIe 5.0) | Astera Labs Scorpio-P 32-Lane PCIe Gen 6.0 | 2 | · | · | · | 2 |
| To Front End CPU (PCIe 5.0) | Aries PG6032 16L/32L Gearbox | 2 | · | · | · | 2 |
| · | Aries PCIe 6.0 x16 Retimer | 4 | · | · | · | 4 |
Compute Tray Parts Summary
3
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| Astera Labs Scorpio-P 32-Lane PCIe Gen 6.0 | 65,536 | 72.00 | 0.50 |
| Aries PG6032 16L/32L Gearbox | 65,536 | 72.00 | 0.50 |
| Aries PCIe 6.0 x16 Retimer | 131,072 | 144.00 | 1.00 |