Live DB — analyst tables
Test
Meta 24576 H100 CX-7 Hyperscaler InfiniBand Cluster Configuration

META-H100-CX7-IB-NV-24K

Meta · H100 · CX-7

Rack type
NVL8
Cluster / location
24k InfiniBand Cluster
Buyer profile
Hyperscaler
Networking type
InfiniBand
Number of XPUs
24,576
NIC used
CX-7
NICs / XPU
1
Scale-out BW / XPU
400G
XPU / server
8

Scale-up network

1 rows
Assigned blockDefault
H100 - NVL8
Scale-UpXPU: H100 NVL81 lineshared by 17 SKUs

Scale-up Units are based on the scale-up world size (8 XPUs).

XPU World Size

2
WS
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
XPUs per Node·83,600··
Scale-Up World Size·828,800··

Switches

5
SW
Scale-Up Network LayerPart / Model
Units#
Unit BWGbit/s uni-d
Port Count#
Port BWGbit/s uni-d
Scale-Up Switch ANvidia NVSwitch 3.0 (NVLink 4)18,00020400
Scale-Up Switch BNvidia NVSwitch 3.0 (NVLink 4)16,40016400
Scale-Up Switch CNvidia NVSwitch 3.0 (NVLink 4)16,40016400
Scale-Up Switch DNvidia NVSwitch 3.0 (NVLink 4)18,00020400
Scale-Up Switch TotalNvidia NVSwitch 3.0 (NVLink 4)428,80072·

Scale-Up Parts Summary

1
ItemQty/ClusterQty/ServerAttach/XPU
Nvidia NVSwitch 3.0 (NVLink 4)12,2884.000.50

Backend network

6 rows
Assigned blockDefault
H100 - NVL8 - CX7 - 3L - IB - QM9700 - META
BackendXPU: H100 NVL86 linesshared by 1 SKU

Backend Units are based on the cluster size (24,576 XPUs).

Switches

5
SW
 Network Layer
Switch and Server SpecAggregate Port UtilizationNetwork Bandwidth Aggregate
SwitchPart Name / Model
Units#
Unit BWGbit/s
Port BWGbit/s
Downlink Ports / SW#
Uplink Ports / SW#
Max Ports#
Downlink Ports#
Uplink Ports#
Total Ports#
Downlink BWTbit/s
Uplink BWTbit/s
OversubRatio
XPUs·24,576400400024,57624,576024,57624,57609,830.4·
NICs per NodeConnectX-7 NIC - 400G4400400··1······
LeafQuantum-2 InfiniBand (QM9700)76825,60040032326424,57624,57649,1529,830.49,830.41
SpineQuantum-2 InfiniBand (QM9700)76825,60040032326424,57624,57649,1529,830.49,830.41
CoreQuantum-2 InfiniBand (QM9700)38425,6004006406424,576024,5769,830.40·

Transceivers

6
CN
 Network Layer
Transceiver / CablePart Name / Model
Total Units#
Units per SW/GPU#
Unit BWGbit/s
Lanes#
BW per LaneGbit/s
Agg. BWTbit/s
XPU NodesNvidia LinkX 400G DR424,57624,5764008509,830.4
Leaf
DownlinkNvidia LinkX 800G DR812,2881680081009,830.4
UplinkNvidia LinkX 800G DR812,2881680081009,830.4
Spine
DownlinkNvidia LinkX 800G DR812,2881680081009,830.4
UplinkNvidia LinkX 800G DR812,2881680081009,830.4
Core
DownlinkNvidia LinkX 800G DR812,2883280081009,830.4
Uplink·······
Super-Core

Cables

6
CB
 Network Layer
Cable/ FiberType
Total Units#
Units per Transceiver#
Unit BWGbit/s
Lane Count#
SerDes BWGbit/s
XPU NodesNvidia LinkX 400G Single Mode24,57614004100
Leaf
DownlinkAlready counted above·····
UplinkNvidia LinkX 800G Single Mode12,28818008100
Spine
DownlinkAlready counted above·····
UplinkNvidia LinkX 800G Single Mode12,28818008100
Core
DownlinkAlready counted above·····
Uplink······
Super-Core

Backend Parts Summary

6
ItemQty/ClusterQty/ServerAttach/XPU
Nvidia LinkX 400G DR424,5768.001.00
Nvidia LinkX 400G Single Mode24,5768.001.00
Nvidia LinkX 800G DR861,44020.002.50
Nvidia LinkX 800G Single Mode24,5768.001.00
ConnectX-7 NIC - 400G24,5768.001.00
Quantum-2 InfiniBand (QM9700)1,9200.630.08

Frontend network

11 rows
Assigned blockDefault
H100 - NVL8 - SN5600 - Generic
FrontendXPU: H100 NVL811 linesshared by 10 SKUs

Converged Frontend + Storage Fabric

11
LayerPart / ModelUnitsAttach / XPU
·Spectrum-4 51.2T (SN5600)2950.0120
·Spectrum-3 12.8T (SN4700)10.0000
·Spectrum-2 6.4T (SN3700)440.0018
·Spectrum-2 1GbE (SN2201)3610.0147
·Nvidia LinkX 800G SR814,2710.5807
·Nvidia LinkX 400G SR414,1970.5777
·Nvidia LinkX 100G SR4 QSFP286,3000.2563
·Nvidia LinkX 800G Multimode19,5320.7947
·Nvidia LinkX 400G Multimode1000.0041
·Nvidia LinkX 100G Multimode2,8060.1142
·RJ45 Cables17,3200.7048

Frontend Parts Summary

11
ItemQty/ClusterQty/ServerAttach/XPU
Spectrum-4 51.2T (SN5600)78700.0320
Spectrum-3 12.8T (SN4700)300.0001
Spectrum-2 6.4T (SN3700)11700.0048
Spectrum-2 1GbE (SN2201)96200.0392
Nvidia LinkX 800G SR838,057121.5485
Nvidia LinkX 400G SR437,859121.5405
Nvidia LinkX 100G SR4 QSFP2816,80050.6836
Nvidia LinkX 800G Multimode52,084172.1193
Nvidia LinkX 400G Multimode26700.0108
Nvidia LinkX 100G Multimode7,48320.3045
RJ45 Cables46,187151.8794

Compute Tray Networking Content

1 rows

Networking components inside the compute tray — accelerators, board-to-board connectors, retimers, and their per-tray bandwidth.

Assigned blockDefault
H100 - NVL8 - Generic
Compute TrayXPU: H100 NVL81 lineshared by 16 SKUs
Tray layerPart / ModelUnits per Tray
Unit BWGb/s
Lanes
Lane BWGb/s
Per switch
XPUs per TrayHopper 1008····
H100 ServerNVLink PCIe 5.0 x16 Retimer8512···

Compute Tray Parts Summary

1
ItemQty/ClusterQty/ServerAttach/XPU
NVLink PCIe 5.0 x16 Retimer24,5768.001.00