Live DB — analyst tables
Test
Amazon 24576 Inferentia2 NIC - 100G Hyperscaler Ethernet Cluster Configuration
AWS-Inferentia2-Default
Amazon · Inferentia2 · NIC - 100G
Rack type
—
Cluster / location
Default Inferentia2
Buyer profile
Hyperscaler
Networking type
Ethernet
Number of XPUs
24,576
NIC used
NIC - 100G
NICs / XPU
0.083
Scale-out BW / XPU
8.33G
XPU / server
12
Scale-up network
Assigned blockDefault
Inferentia2
Scale-UpXPU: Inferentia20 linesshared by 1 SKU
Scale-up Units are based on the scale-up world size (12 XPUs).
XPU World Size
2
WS| Scale-Up Network Layer | Part / Model | Units# | Unit BWGbit/s uni-d | Lane Count# | Lane BWGbit/s uni-d |
|---|---|---|---|---|---|
| XPUs per Node | · | · | · | · | · |
| Scale-Up World Size | · | 12 | · | · | · |
Switches
1
SW| Scale-Up Network Layer | Part / Model | Units# | Unit BWGbit/s uni-d | Lane Count# | Lane BWGbit/s uni-d |
|---|---|---|---|---|---|
| per Cluster | No Scale-Up Switch | · | · | · | · |
Connections & cabling
1
CN| Scale-Up Network Layer | Part / Model | Units# | BW / PortGbit/s uni-d | Unit DP# | DP / Port# | Total DPs# | BW / Connector | Cable / Model | Cable Units# |
|---|---|---|---|---|---|---|---|---|---|
| · | No Connectors on the Switch Side | · | · | · | · | · | · | · | · |
Scale-Up Parts Summary
0
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|
Backend network
6 rows
Assigned blockDefault
Inferentia2 - 100G NIC - 2L - ETH - TH2 - AWS
BackendXPU: Inferentia26 linesshared by 1 SKU
Backend Units are based on the cluster size (2,048 Number of Instances).
Switches
5
SW Network Layer | Switch and Server Spec | Aggregate Port Utilization | Network Bandwidth Aggregate | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
SwitchPart Name / Model | Units# | Unit BWGbit/s | Port BWGbit/s | Downlink Ports / SW# | Uplink Ports / SW# | Max Ports# | Downlink Ports# | Uplink Ports# | Total Ports# | Downlink BWTbit/s | Uplink BWTbit/s | OversubRatio | |
| Number of Instances | · | 2,048 | 100 | 100 | 0 | 2,048 | 2,048 | 0 | 2,048 | 2,048 | 0 | 204.8 | · |
| XPUs per Instance | · | 12 | · | · | · | · | 8 | · | · | · | · | · | · |
| NICs per Instance | NIC - 100G | 1 | 100 | 100 | · | · | 8 | · | · | · | · | · | · |
| ToR | WhiteBox Tomahawk 2 6.4T | 64 | 6,400 | 100 | 32 | 32 | 64 | 2,048 | 2,048 | 4,096 | 204.8 | 204.8 | 1 |
| Leaf | WhiteBox Tomahawk 3 12.8T | 16 | 12,800 | 100 | 128 | 0 | 128 | 2,048 | 0 | 2,048 | 204.8 | 0 | · |
Transceivers
7
CN Network Layer | Transceiver / CablePart Name / Model | Total Units# | Units per SW/GPU# | Unit BWGbit/s | Lanes# | BW per LaneGbit/s | Agg. BWTbit/s |
|---|---|---|---|---|---|---|---|
| XPU Nodes | None - AECs are Used -> | 2,048 | · | 100 | 4 | 25 | 204.8 |
| CPU Nodes | None - AECs are Used -> | 128 | · | · | · | · | · |
| Leaf | |||||||
| Downlink | Generic 100G SR4 QSFP28 | 2,048 | #ERR | 100 | #ERR | 25 | 0 |
| Uplink | Generic 100G SR4 QSFP28 | · | · | · | · | · | · |
| Spine | |||||||
| Downlink | · | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · | · |
| Core | |||||||
| Downlink | · | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · | · |
| Super-Core | |||||||
| ToR | |||||||
| Downlink | None - AECs are Used -> | 2,048 | 32 | 100 | 4 | 25 | 204.8 |
| Uplink | Generic 100G SR4 QSFP28 | 2,048 | #ERR | 100 | #ERR | 25 | 0 |
Cables
7
CB Network Layer | Cable/ FiberType | Total Units# | Units per Transceiver# | Unit BWGbit/s | Lane Count# | SerDes BWGbit/s |
|---|---|---|---|---|---|---|
| XPU Nodes | Generic 100G AEC | 2,048 | 1 | 100 | 4 | 25 |
| CPU Nodes | · | · | · | · | · | · |
| Leaf | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | · | · | · | · | · | · |
| Spine | ||||||
| Downlink | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · |
| Core | ||||||
| Downlink | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · |
| Super-Core | ||||||
| ToR | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | Generic 100G Multimode | 2,048 | 1 | 100 | 4 | 25 |
Backend Parts Summary
6
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| Generic 100G AEC | 2,048 | 1.00 | 0.08 |
| NIC - 100G | 2,048 | 1.00 | 0.08 |
| Generic 100G SR4 QSFP28 | 4,096 | 2.00 | 0.17 |
| Generic 100G Multimode | 2,048 | 1.00 | 0.08 |
| WhiteBox Tomahawk 2 6.4T | 64 | 0.03 | 0.00 |
| WhiteBox Tomahawk 3 12.8T | 16 | 0.01 | 0.00 |
Frontend network
No converged frontend + storage fabric data for this cluster.
Frontend Parts Summary
0
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|