Live DB — analyst tables
Test
Neoclouds/AI Lab/SovAI 2048 Gaudi2 RoCE NIC - 100G Emerging Neocloud Ethernet Cluster Configuration
OTHER-Gaudi2-2L
Neoclouds/AI Lab/SovAI · Gaudi2 · RoCE NIC - 100G
Rack type
—
Cluster / location
Default Gaudi2 2-Layer Cluster
Buyer profile
Emerging Neocloud
Networking type
Ethernet
Number of XPUs
2,048
NIC used
RoCE NIC - 100G
NICs / XPU
3
Scale-out BW / XPU
300G
XPU / server
8
Scale-up network
Assigned blockDefault
Gaudi2
Scale-UpXPU: Gaudi20 linesshared by 1 SKU
Scale-up Units are based on the scale-up world size (8 XPUs).
XPU World Size
2
WS| Scale-Up Network Layer | Part / Model | Units# | Unit BWGbit/s uni-d | Port Count# | Port BWGbit/s uni-d |
|---|---|---|---|---|---|
| XPUs per Node | · | 8 | 2,100 | 21 | 100 |
| Scale-Up World Size | · | 8 | 16,800 | · | · |
Switches
2
SW| Scale-Up Network Layer | Part / Model | Units# | Unit BWGbit/s uni-d | Port Count# | Port BWGbit/s uni-d |
|---|---|---|---|---|---|
| per Switch | · | · | · | · | · |
| Scale-Up Switch Total | · | · | · | · | · |
Notes
- XPUs per Node — >>7 of 3*100G links to every other chip in a mesh
Scale-Up Parts Summary
0
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|
Backend network
6 rows
Assigned blockDefault
Gaudi2 - 100G NIC - 2L - ETH - TH3 - Generic
BackendXPU: Gaudi26 linesshared by 1 SKU
Backend Units are based on the cluster size (2,048 XPUs).
Switches
4
SW Network Layer | Switch and Server Spec | Aggregate Port Utilization | Network Bandwidth Aggregate | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
SwitchPart Name / Model | Units# | Unit BWGbit/s | Port BWGbit/s | Downlink Ports / SW# | Uplink Ports / SW# | Max Ports# | Downlink Ports# | Uplink Ports# | Total Ports# | Downlink BWTbit/s | Uplink BWTbit/s | OversubRatio | |
| XPUs | · | 2,048 | 300 | 100 | 0 | 6,144 | 6,144 | 0 | 6,144 | 6,144 | 0 | 614.4 | · |
| NICs per Node | RoCE NIC - 100G | 8 | 100 | 100 | · | · | 8 | · | · | · | · | · | · |
| Leaf | WhiteBox Tomahawk 3 12.8T | 128 | 12,800 | 400 | 12 | 12 | 32 | 1,536 | 1,536 | 4,096 | 614.4 | 614.4 | 1 |
| Spine | WhiteBox Tomahawk 4 25.6T | 24 | 25,600 | 400 | 64 | 0 | 64 | 1,536 | 0 | 1,536 | 614.4 | 0 | · |
Transceivers
5
CN Network Layer | Transceiver / CablePart Name / Model | Total Units# | Units per SW/GPU# | Unit BWGbit/s | Lanes# | BW per LaneGbit/s | Agg. BWTbit/s |
|---|---|---|---|---|---|---|---|
| XPU Nodes | Generic 400G SR4 | 2,048 | 2,048 | 300 | 8 | 37.5 | 614.4 |
| Leaf | |||||||
| Downlink | Generic 400G SR4 | 1,536 | 16 | 400 | 8 | 50 | 614.4 |
| Uplink | Generic 400G SR4 | 1,536 | 16 | 400 | 8 | 50 | 614.4 |
| Spine | |||||||
| Downlink | Generic 400G SR4 | 1,536 | 64 | 400 | 8 | 50 | 614.4 |
| Uplink | · | · | · | · | · | · | · |
| Core | |||||||
| Downlink | · | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · | · |
| Super-Core | |||||||
Cables
5
CB Network Layer | Cable/ FiberType | Total Units# | Units per Transceiver# | Unit BWGbit/s | Lane Count# | SerDes BWGbit/s |
|---|---|---|---|---|---|---|
| XPU Nodes | Generic 100G Multimode | 6,144 | 3 | 100 | 1 | 100 |
| Leaf | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | Generic 400G Multimode | 1,536 | 1 | 400 | 4 | 100 |
| Spine | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | Already counted above | · | · | · | · | · |
| Core | ||||||
| Downlink | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · |
| Super-Core | ||||||
Backend Parts Summary
6
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| Generic 400G SR4 | 6,656 | 26.00 | 3.25 |
| Generic 100G Multimode | 6,144 | 24.00 | 3.00 |
| Generic 400G Multimode | 1,536 | 6.00 | 0.75 |
| RoCE NIC - 100G | 2,048 | 8.00 | 1.00 |
| WhiteBox Tomahawk 3 12.8T | 128 | 0.50 | 0.06 |
| WhiteBox Tomahawk 4 25.6T | 24 | 0.09 | 0.01 |
Notes
- Leaf · WhiteBox Tomahawk 3 12.8T — >>assume 2 ToR per box
Frontend network
11 rows
Assigned blockDefault
Gaudi2 - BlackBox TH5 - Generic
FrontendXPU: Gaudi211 linesshared by 1 SKU
Converged Frontend + Storage Fabric
11
| Layer | Part / Model | Units | Attach / XPU |
|---|---|---|---|
| · | BlackBox Tomahawk 5 51.2T | 25 | 0.0120 |
| · | BlackBox Tomahawk 3 12.8T | 0 | 0.0000 |
| · | BlackBox Tomahawk 2 6.4T | 4 | 0.0018 |
| · | BlackBox Tomahawk 1GbE Ethernet | 30 | 0.0147 |
| · | Generic 800G SR8 | 1,189 | 0.5807 |
| · | Generic 400G SR4 | 1,183 | 0.5777 |
| · | Generic 100G SR4 QSFP28 | 525 | 0.2563 |
| · | Generic 800G Multimode | 1,628 | 0.7947 |
| · | Generic 400G Multimode | 8 | 0.0041 |
| · | Generic 100G Multimode | 234 | 0.1142 |
| · | RJ45 Cables | 1,443 | 0.7048 |
Frontend Parts Summary
11
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| BlackBox Tomahawk 5 51.2T | 25 | 0 | 0.0120 |
| BlackBox Tomahawk 3 12.8T | 0 | 0 | 0.0001 |
| BlackBox Tomahawk 2 6.4T | 4 | 0 | 0.0018 |
| BlackBox Tomahawk 1GbE Ethernet | 30 | 0 | 0.0147 |
| Generic 800G SR8 | 1,189 | 5 | 0.5807 |
| Generic 400G SR4 | 1,183 | 5 | 0.5777 |
| Generic 100G SR4 QSFP28 | 525 | 2 | 0.2563 |
| Generic 800G Multimode | 1,628 | 6 | 0.7947 |
| Generic 400G Multimode | 8 | 0 | 0.0041 |
| Generic 100G Multimode | 234 | 1 | 0.1142 |
| RJ45 Cables | 1,443 | 6 | 0.7048 |
Compute Tray Networking Content
Networking components inside the compute tray — accelerators, board-to-board connectors, retimers, and their per-tray bandwidth.
Assigned blockDefault
Gaudi2 - Generic
Compute TrayXPU: Gaudi20 linesshared by 1 SKU
| Tray layer | Part / Model | Units per Tray | Unit BWGb/s | Lanes | Lane BWGb/s | Per switch |
|---|---|---|---|---|---|---|
| XPUs per Tray | Hopper 100 | 8 | · | · | · | · |
Compute Tray Parts Summary
0
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|