Live DB — analyst tables
Test
Neoclouds/AI Lab/SovAI 2048 Gaudi3 RoCE NIC - 200G Emerging Neocloud Ethernet Cluster Configuration

OTHER-Gaudi3-2L

Neoclouds/AI Lab/SovAI · Gaudi3 · RoCE NIC - 200G

Rack type
Cluster / location
Default Gaudi3 2-Layer Cluster
Buyer profile
Emerging Neocloud
Networking type
Ethernet
Number of XPUs
2,048
NIC used
RoCE NIC - 200G
NICs / XPU
3
Scale-out BW / XPU
600G
XPU / server
8

Scale-up network

Assigned blockDefault
Gaudi3
Scale-UpXPU: Gaudi30 linesshared by 1 SKU

Scale-up Units are based on the scale-up world size (8 XPUs).

XPU World Size

2
WS
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
XPUs per Node·82,10021100
Scale-Up World Size·816,800··

Switches

2
SW
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
per Switch·····
Scale-Up Switch Total·····
Notes
  • XPUs per Node — >>7 of 3*100G links to every other chip in a mesh

Scale-Up Parts Summary

0
ItemQty/ClusterQty/ServerAttach/XPU

Backend network

6 rows
Assigned blockDefault
Gaudi3 - 200G NIC - 2L - ETH - TH4 - Generic
BackendXPU: Gaudi36 linesshared by 1 SKU

Backend Units are based on the cluster size (2,048 XPUs).

Switches

4
SW
 Network Layer
Switch and Server SpecAggregate Port UtilizationNetwork Bandwidth Aggregate
SwitchPart Name / Model
Units#
Unit BWGbit/s
Port BWGbit/s
Downlink Ports / SW#
Uplink Ports / SW#
Max Ports#
Downlink Ports#
Uplink Ports#
Total Ports#
Downlink BWTbit/s
Uplink BWTbit/s
OversubRatio
XPUs·2,04860020006,1446,14406,1446,14401,228.8·
NICs per NodeRoCE NIC - 200G8200200··8······
LeafWhiteBox Tomahawk 4 25.6T12825,6008001212321,5361,5364,0961,228.81,228.81
SpineWhiteBox Tomahawk 5 51.2T2451,200800640641,53601,5361,228.80·

Transceivers

5
CN
 Network Layer
Transceiver / CablePart Name / Model
Total Units#
Units per SW/GPU#
Unit BWGbit/s
Lanes#
BW per LaneGbit/s
Agg. BWTbit/s
XPU NodesGeneric 800G SR82,0482,0486008751,228.8
Leaf
DownlinkGeneric 800G SR81,5361680081001,228.8
UplinkGeneric 800G SR81,5361680081001,228.8
Spine
DownlinkGeneric 800G SR81,5366480081001,228.8
Uplink·······
Core
Downlink·······
Uplink·······
Super-Core

Cables

5
CB
 Network Layer
Cable/ FiberType
Total Units#
Units per Transceiver#
Unit BWGbit/s
Lane Count#
SerDes BWGbit/s
XPU NodesGeneric 200G Multimode6,1443200825
Leaf
DownlinkAlready counted above·····
UplinkGeneric 800G Multimode1,53618004200
Spine
DownlinkAlready counted above·····
UplinkAlready counted above·····
Core
Downlink······
Uplink······
Super-Core

Backend Parts Summary

6
ItemQty/ClusterQty/ServerAttach/XPU
Generic 800G SR86,65626.003.25
Generic 200G Multimode6,14424.003.00
Generic 800G Multimode1,5366.000.75
RoCE NIC - 200G2,0488.001.00
WhiteBox Tomahawk 4 25.6T1280.500.06
WhiteBox Tomahawk 5 51.2T240.090.01
Notes
  • Leaf · WhiteBox Tomahawk 4 25.6T — >>assume 2 ToR per box

Frontend network

11 rows
Assigned blockDefault
Gaudi3 - BlackBox TH5 - Generic
FrontendXPU: Gaudi311 linesshared by 1 SKU

Converged Frontend + Storage Fabric

11
LayerPart / ModelUnitsAttach / XPU
·BlackBox Tomahawk 5 51.2T250.0120
·BlackBox Tomahawk 3 12.8T00.0000
·BlackBox Tomahawk 2 6.4T40.0018
·BlackBox Tomahawk 1GbE Ethernet300.0147
·Generic 800G SR81,1890.5807
·Generic 400G SR41,1830.5777
·Generic 100G SR4 QSFP285250.2563
·Generic 800G Multimode1,6280.7947
·Generic 400G Multimode80.0041
·Generic 100G Multimode2340.1142
·RJ45 Cables1,4430.7048

Frontend Parts Summary

11
ItemQty/ClusterQty/ServerAttach/XPU
BlackBox Tomahawk 5 51.2T2500.0120
BlackBox Tomahawk 3 12.8T000.0001
BlackBox Tomahawk 2 6.4T400.0018
BlackBox Tomahawk 1GbE Ethernet3000.0147
Generic 800G SR81,18950.5807
Generic 400G SR41,18350.5777
Generic 100G SR4 QSFP2852520.2563
Generic 800G Multimode1,62860.7947
Generic 400G Multimode800.0041
Generic 100G Multimode23410.1142
RJ45 Cables1,44360.7048

Compute Tray Networking Content

Networking components inside the compute tray — accelerators, board-to-board connectors, retimers, and their per-tray bandwidth.

Assigned blockDefault
Gaudi3 - Generic
Compute TrayXPU: Gaudi30 linesshared by 1 SKU
Tray layerPart / ModelUnits per Tray
Unit BWGb/s
Lanes
Lane BWGb/s
Per switch
XPUs per TrayHopper 1008····

Compute Tray Parts Summary

0
ItemQty/ClusterQty/ServerAttach/XPU