Live DB — analyst tables
Test
Amazon 24576 Trainium3 EFAv3 Nitro-v5 200G NIC Hyperscaler Ethernet Cluster Configuration
AWS-Inferentia3-Default
Amazon · Inferentia3 · EFAv3 Nitro-v5 200G NIC
Rack type
—
Cluster / location
Default Inferentia2
Buyer profile
Hyperscaler
Networking type
Ethernet
Number of XPUs
24,576
NIC used
EFAv3 Nitro-v5 200G NIC
NICs / XPU
1
Scale-out BW / XPU
200G
XPU / server
72
Scale-up network
Assigned blockDefault
Inferentia3
Scale-UpXPU: Inferentia30 linesshared by 1 SKU
Scale-up Units are based on the scale-up world size (72 XPUs).
XPU World Size
2
WS| Scale-Up Network Layer | Part / Model | Units# | Unit BWGbit/s uni-d | Lane Count# | Lane BWGbit/s uni-d |
|---|---|---|---|---|---|
| XPUs per Node | · | · | · | · | · |
| Scale-Up World Size | · | 72 | · | · | · |
Switches
1
SW| Scale-Up Network Layer | Part / Model | Units# | Unit BWGbit/s uni-d | Lane Count# | Lane BWGbit/s uni-d |
|---|---|---|---|---|---|
| per Cluster | No Scale-Up Switch | · | · | · | · |
Connections & cabling
1
CN| Scale-Up Network Layer | Part / Model | Units# | BW / PortGbit/s uni-d | Unit DP# | DP / Port# | Total DPs# | BW / Connector | Cable / Model | Cable Units# |
|---|---|---|---|---|---|---|---|---|---|
| · | No Connectors on the Switch Side | · | · | · | · | · | · | · | · |
Notes
- XPUs per Node · Scale-Up World Size — >>This is a guess - no public documentation
Scale-Up Parts Summary
0
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|
Backend network
5 rows
Assigned blockDefault
Inferentia3 - EFAv3 - 3L - ETH - TH3 - AWS
BackendXPU: Inferentia35 linesshared by 1 SKU
Backend Units are based on the cluster size (24,576 Number of NICs).
Switches
6
SW Network Layer | Switch and Server Spec | Aggregate Port Utilization | Network Bandwidth Aggregate | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
SwitchPart Name / Model | Units# | Unit BWGbit/s | Port BWGbit/s | Downlink Ports / SW# | Uplink Ports / SW# | Max Ports# | Downlink Ports# | Uplink Ports# | Total Ports# | Downlink BWTbit/s | Uplink BWTbit/s | OversubRatio | |
| Number of NICs | · | 24,576 | 200 | 200 | 0 | 24,576 | 24,576 | 0 | 24,576 | 24,576 | 0 | 4,915.2 | · |
| XPUs per Instance | · | 72 | · | · | · | · | 8 | · | · | · | · | · | · |
| NICs per Instance | EFAv3 Nitro-v5 200G NIC | 72 | 200 | 200 | · | · | 8 | · | · | · | · | · | · |
| ToR | WhiteBox Tomahawk 3 12.8T | 768 | 12,800 | 200 | 32 | 32 | 64 | 24,576 | 24,576 | 49,152 | 4,915.2 | 4,915.2 | 1 |
| Leaf | WhiteBox Tomahawk 3 12.8T | 384 | 25,600 | 200 | 64 | 64 | 128 | 24,576 | 24,576 | 49,152 | 4,915.2 | 4,915.2 | 1 |
| Spine | WhiteBox Tomahawk 3 12.8T | 192 | 25,600 | 200 | 128 | 0 | 128 | 24,576 | 0 | 24,576 | 4,915.2 | 0 | · |
Transceivers
8
CN Network Layer | Transceiver / CablePart Name / Model | Total Units# | Units per SW/GPU# | Unit BWGbit/s | Lanes# | BW per LaneGbit/s | Agg. BWTbit/s |
|---|---|---|---|---|---|---|---|
| XPU Nodes | None - AECs are Used -> | 24,576 | · | 200 | 4 | 50 | 4,915.2 |
| CPU Nodes | None - AECs are Used -> | 1,536 | · | · | · | · | · |
| Leaf | |||||||
| Downlink | Generic 200G SR4 QSFP56 | 24,576 | 64 | 200 | 4 | 50 | 4,915.2 |
| Uplink | Generic 200G SR4 QSFP56 | 24,576 | #ERR | 200 | #ERR | 50 | 0 |
| Spine | |||||||
| Downlink | Generic 200G SR4 QSFP56 | 24,576 | #ERR | 200 | #ERR | 50 | 0 |
| Uplink | · | · | · | · | · | · | · |
| Core | |||||||
| Downlink | · | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · | · |
| Super-Core | |||||||
| ToR | |||||||
| Downlink | None - AECs are Used -> | 24,576 | 32 | 200 | 4 | 50 | 4,915.2 |
| Uplink | Generic 200G SR4 QSFP56 | 24,576 | 32 | 200 | 4 | 50 | 4,915.2 |
Cables
8
CB Network Layer | Cable/ FiberType | Total Units# | Units per Transceiver# | Unit BWGbit/s | Lane Count# | SerDes BWGbit/s |
|---|---|---|---|---|---|---|
| XPU Nodes | Generic 200G AEC | 24,576 | 1 | 200 | 4 | 50 |
| CPU Nodes | · | · | · | · | · | · |
| Leaf | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | Generic 200G Multimode | 49,152 | 2 | 100 | 4 | 25 |
| Spine | ||||||
| Downlink | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · |
| Core | ||||||
| Downlink | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · |
| Super-Core | ||||||
| ToR | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | Generic 200G Multimode | 49,152 | 2 | 100 | 4 | 25 |
Backend Parts Summary
5
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| Generic 200G AEC | 24,576 | 72.00 | 1.00 |
| EFAv3 Nitro-v5 200G NIC | 24,576 | 72.00 | 1.00 |
| Generic 200G SR4 QSFP56 | 98,304 | 288.00 | 4.00 |
| Generic 200G Multimode | 98,304 | 288.00 | 4.00 |
| WhiteBox Tomahawk 3 12.8T | 1,344 | 3.94 | 0.05 |
Frontend network
No converged frontend + storage fabric data for this cluster.
Frontend Parts Summary
0
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|