Live DB — analyst tables
Test
HS-Feynman NVL144-CX10-IB-4R

HS-Feynman NVL144-CX10-IB-4R

Default Hyperscaler · Feynman · CX10

Rack type
Kyber NVL144
Cluster / location
Default Hyperscaler Kyber NVL144 x800 Q3400 (non-CPO)
Buyer profile
Hyperscaler
Networking type
Infiniband
Number of XPUs
93,312
NIC used
CX10
NICs / XPU
3
Scale-out BW / XPU
4.8T
XPU / server
144

Scale-up network

5 rows
Assigned blockDefault
Feynman - Kyber NVL144
Scale-UpXPU: Feynman Kyber NVL1445 linesshared by 11 SKUs

Scale-up Units are based on the scale-up world size (144 XPUs).

XPU World Size

2
WS
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
XPUs per Node·14428,800144400
Scale-Up World Size·1444,147,200··

Switches

4
SW
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
per SwitchNvidia NVSwitch 8.0 (NVLink 8)1115,200288400
Layer 1 SwitchesNvidia NVSwitch 8.0 (NVLink 8)364,147,200288400
Layer 2 SwitchesNvidia NVSwitch 8.0 (NVLink 8)00288400
Scale-Up Switch Total·364,147,200··

Connections & cabling

11
CN
Scale-Up Network LayerPart / Model
Units#
BW / PortGbit/s uni-d
Ports#
Bidi / Port#
Total BW#
BW / ConnectorCable / Model
Cable Units#
Optical EnginesNV 3.2T Optical Engine (OE) for NVLink Switch side CPO020016·03,200NV 1.6T 8 Fiber Pair FAU0
External Laser SourceNV External Laser Source (ELS) 8 LD 6.4T for NVLink CPO Switch020032·06,400··
L2 Switch Total
Male Connectors to GPUNV Sentry HD 448Gb/s 144DP (Male)14440072·4,147,20028,800Already Counted Below·
Female Connectors to GPUNV Sentry HD 448Gb/s 144DP (Female)14440072·4,147,20028,800··
Optical EnginesNV 3.2T Optical Engine (OE) for NVLink Switch side CPO020016·2,419,2003,200NV 1.6T 8 Fiber Pair FAU0
External Laser SourceNV External Laser Source (ELS) 8 LD 6.4T for NVLink CPO Switch020032·2,419,2006,400··
L1 Switch Total
Male ConnectorsNV Sentry HD 448Gb/s 144DP (Male)14440072·4,147,20028,800Uses a Midplane PCB to connect to NVSwitch Chips·
Female ConnectorsNV Sentry HD 448Gb/s 144DP (Female)14440072·4,147,20028,800Uses a Midplane PCB to connect to NVSwitch Chips·
XPU Total** One connector per GPU·····28,800··
·NVL Blade Column Spine Chassis (NvLink 7)2·······
·NVL Kyber Canister Midplane PCB (NvLink 7)1·······

Scale-Up Parts Summary

5
ItemQty/ClusterQty/ServerAttach/XPU
Nvidia NVSwitch 8.0 (NVLink 8)23,32836.000.25
NV Sentry HD 448Gb/s 144DP (Male)186,624288.002.00
NV Sentry HD 448Gb/s 144DP (Female)186,624288.002.00
NVL Blade Column Spine Chassis (NvLink 7)1,2962.000.01
NVL Kyber Canister Midplane PCB (NvLink 7)6481.000.01

Backend network

4 rows
Assigned blockDefault
Feynman - Kyber NVL144 - CX10 - 3L - IB - X800-Q3400-RA - Generic
BackendXPU: Feynman Kyber NVL1444 linesshared by 2 SKUs

Backend Units are based on the cluster size (93,312 XPUs).

Switches

5
SW
 Network Layer
Switch and Server SpecAggregate Port UtilizationNetwork Bandwidth Aggregate
SwitchPart Name / Model
Units#
Unit BWGbit/s
Port BWGbit/s
Downlink Ports / SW#
Uplink Ports / SW#
Max Ports#
Downlink Ports#
Uplink Ports#
Total Ports#
Downlink BWTbit/s
Uplink BWTbit/s
OversubRatio
XPUs·93,3124,8004,800093,31293,312093,31293,3120447,897.6·
NICs per NodeConnectX-10 NIC - 1.6T121,600100··8······
LeafQuantum-X800-Q3400-RA (Air Cooled)7,776115,2008007272144559,872559,8721,119,744447,897.6447,897.61
SpineQuantum-X800-Q3400-RA (Air Cooled)7,776115,2008007272144559,872559,8721,119,744447,897.6447,897.61
CoreQuantum-X800-Q3400-RA (Air Cooled)3,888115,200800144·144559,8720559,872447,897.60·

Transceivers

7
CN
 Network Layer
Transceiver / CablePart Name / Model
Total Units#
Units per SW/GPU#
Unit BWGbit/s
Lanes#
BW per LaneGbit/s
Agg. BWTbit/s
XPU NodesNvidia LinkX 1.6T DR8 (SiPho)93,31293,3124,8008600447,897.6
Leaf
DownlinkNvidia LinkX 1.6T DR8 (SiPho)279,936361,6008200447,897.6
UplinkNvidia LinkX 1.6T DR8 (SiPho)279,936361,6008200447,897.6
Spine
DownlinkNvidia LinkX 1.6T DR8 (SiPho)279,936361,6008200447,897.6
UplinkNvidia LinkX 1.6T DR8 (SiPho)279,936361,6008200447,897.6
Core
DownlinkNvidia LinkX 1.6T DR8 (SiPho)279,936721,6008200447,897.6
Uplink·······
Super-CoreCPO is used here - so there is no need for Transceivers on Switches······

Cables

7
CB
 Network Layer
Cable/ FiberType
Total Units#
Units per Transceiver#
Unit BWGbit/s
Lane Count#
SerDes BWGbit/s
XPU NodesNvidia LinkX 800G Single Mode559,87268004200
Leaf
DownlinkAlready counted above·····
UplinkNvidia LinkX 800G Single Mode559,87228004200
Spine
DownlinkAlready counted above·····
UplinkNvidia LinkX 800G Single Mode559,87228004200
Core
DownlinkAlready counted above·····
Uplink······
Super-Core······

Backend Parts Summary

4
ItemQty/ClusterQty/ServerAttach/XPU
Nvidia LinkX 1.6T DR8 (SiPho)1,492,9922,304.0016.00
Nvidia LinkX 800G Single Mode1,679,6162,592.0018.00
ConnectX-10 NIC - 1.6T279,936432.003.00
Quantum-X800-Q3400-RA (Air Cooled)19,44030.000.21

Frontend network

11 rows
Assigned blockDefault
Feynman - Kyber NVL144 - SN6600 - Generic
FrontendXPU: Feynman Kyber NVL14411 linesshared by 11 SKUs

Converged Frontend + Storage Fabric

11
LayerPart / ModelUnitsAttach / XPU
·Spectrum-6 102.4T x1600 (SN6600)1,1200.0120
·Spectrum-4 25.6T (SN5400)50.0000
·Spectrum-3 12.8T (SN4700)1670.0018
·Spectrum-2 6.4T (SN3700)1,3700.0147
·Nvidia LinkX 1.6T DR8 (SiPho)54,1870.5807
·Nvidia LinkX 800G DR453,9040.5777
·Nvidia LinkX 200G SR423,9200.2563
·Nvidia LinkX 800G Multimode74,1590.7947
·Nvidia LinkX 400G Multimode3800.0041
·Nvidia LinkX 200G Multimode10,6550.1142
·RJ45 Cables65,7630.7048

Frontend Parts Summary

11
ItemQty/ClusterQty/ServerAttach/XPU
Spectrum-6 102.4T x1600 (SN6600)1,12020.0120
Spectrum-4 25.6T (SN5400)500.0001
Spectrum-3 12.8T (SN4700)16700.0018
Spectrum-2 6.4T (SN3700)1,37020.0147
Nvidia LinkX 1.6T DR8 (SiPho)54,187840.5807
Nvidia LinkX 800G DR453,904830.5777
Nvidia LinkX 200G SR423,920370.2563
Nvidia LinkX 800G Multimode74,1591140.7947
Nvidia LinkX 400G Multimode38010.0041
Nvidia LinkX 200G Multimode10,655160.1142
RJ45 Cables65,7631010.7048

Compute Tray Networking Content

4 rows

Networking components inside the compute tray — accelerators, board-to-board connectors, retimers, and their per-tray bandwidth.

Assigned blockDefault
Feynman - Kyber NVL144 - Generic
Compute TrayXPU: Feynman Kyber NVL1444 linesshared by 11 SKUs
Tray layerPart / ModelUnits per Tray
Unit BWGb/s
Lanes
Lane BWGb/s
Per switch
XPUs per TrayRubin 2004····
PCIe 6.0 Connector (Male)NV Paladin Board to Board 32 Pin 4p8c (Male)2512···
PCIe 6.0 Connector (Male)NV Paladin Board to Board 64 Pin 4p16c (Male)81,024···
PCIe 6.0 Connector (Female)NV Paladin Board to Board 32 Pin 4p8c (Female)4512···
PCIe 6.0 Connector (Female)NV Paladin Board to Board 64 Pin 4p16c (Female)161,024···
PCIe 6.0 Connector (Male)NV Paladin Board to Board 32 Pin 4p8c (Male)2512···
PCIe 6.0 Connector (Male)NV Paladin Board to Board 64 Pin 4p16c (Male)81,024···
Notes
  • PCIe 6.0 Connector (Male) · NV Paladin Board to Board 32 Pin 4p8c (Male) — 2 pins = 1DP
  • PCIe 6.0 Connector (Male) · NV Paladin Board to Board 64 Pin 4p16c (Male) — 2DP = 1Lane

Compute Tray Parts Summary

4
ItemQty/ClusterQty/ServerAttach/XPU
NV Paladin Board to Board 32 Pin 4p8c (Male)93,312144.001.00
NV Paladin Board to Board 64 Pin 4p16c (Male)373,248576.004.00
NV Paladin Board to Board 32 Pin 4p8c (Female)93,312144.001.00
NV Paladin Board to Board 64 Pin 4p16c (Female)373,248576.004.00