Live DB — analyst tables
Test
Amazon 24576 Trainium1 EFAv2 Nitro-v4 100G NIC Hyperscaler Ethernet Cluster Configuration
AWS-Trainium1-Default
Amazon · Trainium1 · EFAv2 Nitro-v4 100G NIC
Rack type
—
Cluster / location
Default Inferentia2
Buyer profile
Hyperscaler
Networking type
Ethernet
Number of XPUs
24,576
NIC used
EFAv2 Nitro-v4 100G NIC
NICs / XPU
0.5
Scale-out BW / XPU
50G
XPU / server
16
Scale-up network
Assigned blockDefault
Trainium1
Scale-UpXPU: Trainium10 linesshared by 1 SKU
Scale-up Units are based on the scale-up world size (16 XPUs).
XPU World Size
2
WS| Scale-Up Network Layer | Part / Model | Units# | Unit BWGbit/s uni-d | Lane Count# | Lane BWGbit/s uni-d |
|---|---|---|---|---|---|
| XPUs per Node | · | · | · | · | · |
| Scale-Up World Size | · | 16 | · | · | · |
Switches
1
SW| Scale-Up Network Layer | Part / Model | Units# | Unit BWGbit/s uni-d | Lane Count# | Lane BWGbit/s uni-d |
|---|---|---|---|---|---|
| per Cluster | No Scale-Up Switch | · | · | · | · |
Connections & cabling
1
CN| Scale-Up Network Layer | Part / Model | Units# | BW / PortGbit/s uni-d | Unit DP# | DP / Port# | Total DPs# | BW / Connector | Cable / Model | Cable Units# |
|---|---|---|---|---|---|---|---|---|---|
| · | No Connectors on the Switch Side | · | · | · | · | · | · | · | · |
Scale-Up Parts Summary
0
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|
Backend network
6 rows
Assigned blockDefault
Trainium1 - EFAv2 - 3L - ETH - TH2 - AWS
BackendXPU: Trainium16 linesshared by 1 SKU
Backend Units are based on the cluster size (12,288 Number of NICs).
Switches
6
SW Network Layer | Switch and Server Spec | Aggregate Port Utilization | Network Bandwidth Aggregate | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
SwitchPart Name / Model | Units# | Unit BWGbit/s | Port BWGbit/s | Downlink Ports / SW# | Uplink Ports / SW# | Max Ports# | Downlink Ports# | Uplink Ports# | Total Ports# | Downlink BWTbit/s | Uplink BWTbit/s | OversubRatio | |
| Number of NICs | · | 12,288 | 100 | 100 | 0 | 12,288 | 12,288 | 0 | 12,288 | 12,288 | 0 | 1,228.8 | · |
| XPUs per Instance | · | 16 | · | · | · | · | 8 | · | · | · | · | · | · |
| NICs per Instance | EFAv2 Nitro-v4 100G NIC | 8 | 100 | 100 | · | · | 8 | · | · | · | · | · | · |
| ToR | WhiteBox Tomahawk 2 6.4T | 384 | 6,400 | 100 | 32 | 32 | 64 | 12,288 | 12,288 | 24,576 | 1,228.8 | 1,228.8 | 1 |
| Leaf | WhiteBox Tomahawk 3 12.8T | 192 | 12,800 | 100 | 64 | 64 | 128 | 12,288 | 12,288 | 24,576 | 1,228.8 | 1,228.8 | 1 |
| Spine | WhiteBox Tomahawk 3 12.8T | 96 | 12,800 | 100 | 128 | 0 | 128 | 12,288 | 0 | 12,288 | 1,228.8 | 0 | · |
Transceivers
8
CN Network Layer | Transceiver / CablePart Name / Model | Total Units# | Units per SW/GPU# | Unit BWGbit/s | Lanes# | BW per LaneGbit/s | Agg. BWTbit/s |
|---|---|---|---|---|---|---|---|
| XPU Nodes | None - AECs are Used -> | 12,288 | · | 100 | 4 | 25 | 1,228.8 |
| CPU Nodes | None - AECs are Used -> | 768 | · | · | · | · | · |
| Leaf | |||||||
| Downlink | Generic 100G SR4 QSFP28 | 12,288 | 64 | 100 | 4 | 25 | 1,228.8 |
| Uplink | Generic 100G SR4 QSFP28 | 12,288 | #ERR | 100 | #ERR | 25 | 0 |
| Spine | |||||||
| Downlink | Generic 100G SR4 QSFP28 | 12,288 | #ERR | 100 | #ERR | 25 | 0 |
| Uplink | · | · | · | · | · | · | · |
| Core | |||||||
| Downlink | · | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · | · |
| Super-Core | |||||||
| ToR | |||||||
| Downlink | None - AECs are Used -> | 12,288 | 32 | 100 | 4 | 25 | 1,228.8 |
| Uplink | Generic 100G SR4 QSFP28 | 12,288 | 32 | 100 | 4 | 25 | 1,228.8 |
Cables
8
CB Network Layer | Cable/ FiberType | Total Units# | Units per Transceiver# | Unit BWGbit/s | Lane Count# | SerDes BWGbit/s |
|---|---|---|---|---|---|---|
| XPU Nodes | Generic 100G AEC | 12,288 | 1 | 100 | 4 | 25 |
| CPU Nodes | · | · | · | · | · | · |
| Leaf | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | Generic 100G Multimode | 12,288 | 1 | 100 | 4 | 25 |
| Spine | ||||||
| Downlink | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · |
| Core | ||||||
| Downlink | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · |
| Super-Core | ||||||
| ToR | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | Generic 100G Multimode | 12,288 | 1 | 100 | 4 | 25 |
Backend Parts Summary
6
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| Generic 100G AEC | 12,288 | 8.00 | 0.50 |
| EFAv2 Nitro-v4 100G NIC | 12,288 | 8.00 | 0.50 |
| Generic 100G SR4 QSFP28 | 49,152 | 32.00 | 2.00 |
| Generic 100G Multimode | 24,576 | 16.00 | 1.00 |
| WhiteBox Tomahawk 2 6.4T | 384 | 0.25 | 0.02 |
| WhiteBox Tomahawk 3 12.8T | 288 | 0.19 | 0.01 |
Frontend network
No converged frontend + storage fabric data for this cluster.
Frontend Parts Summary
0
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|