Live DB — analyst tables
Test
Microsoft 131072 VR200 CX-9 Hyperscaler Spectrum X Cluster Configuration
MSFT-VR200-CX9-SX6-8P-2L
Microsoft · VR200 · CX-9
Rack type
NVL72
Cluster / location
4-Rail 131k, 8 planes
Buyer profile
Hyperscaler
Networking type
Spectrum X
Number of XPUs
131,072
NIC used
CX-9
NICs / XPU
2
Scale-out BW / XPU
1.6T
XPU / server
72
Scale-up network
7 rows
Assigned blockDefault
VR200 - NVL72
Scale-UpXPU: VR200 NVL727 linesshared by 31 SKUs
Scale-up Units are based on the scale-up world size (72 XPUs).
XPU World Size
2
WS| Scale-Up Network Layer | Part / Model | Units# | Unit BWGbit/s uni-d | Port Count# | Port BWGbit/s uni-d |
|---|---|---|---|---|---|
| XPUs per Node | · | 4 | 14,400 | 36 | 400 |
| Scale-Up World Size | · | 72 | 1,036,800 | · | · |
Switches
2
SW| Scale-Up Network Layer | Part / Model | Units# | Unit BWGbit/s uni-d | Port Count# | Port BWGbit/s uni-d |
|---|---|---|---|---|---|
| per Switch | Nvidia NVSwitch 6.0 (NVLink 6) | 1 | 28,800 | 72 | 400 |
| Scale-Up Switch Total | · | 36 | 1,036,800 | · | · |
Connections & cabling
7
CN| Scale-Up Network Layer | Part / Model | Units# | BW / PortGbit/s uni-d | Unit Bidi# | Bidi / Port# | Total Bidi# | BW / Connector | Cable / Model | Cable Units# |
|---|---|---|---|---|---|---|---|---|---|
| Male Connectors | NV Paladin HD2 224Gb/s 144 Bidi (Male) | 36 | 400 | 144 | 2 | 5,184 | 28,800 | Already Counted Below | · |
| Female Connectors | NV Paladin HD2 224Gb/s 144 Bidi (Female) | 36 | 400 | 144 | 2 | 5,184 | 28,800 | Already Counted Below | · |
| Switch Total | ** One connector per switch | · | · | · | · | · | 28,800 | · | · |
| Male Connectors | NV Paladin HD2 224Gb/s 72 Bidi (Male) | 72 | 400 | 72 | 2 | 5,184 | 14,400 | Already Counted Below | · |
| Female Connectors | NV Paladin HD2 224Gb/s 72 Bidi (Female) | 72 | 400 | 72 | 2 | 5,184 | 14,400 | NV 224Gb/s SkewClear EXD Gen 2 Bidi Cable | 5,184 |
| XPU Total | ** One connector per GPU | · | · | · | · | · | 14,400 | · | · |
| · | NVL Spine Chassis (NvLink 6) | 2 | · | · | · | · | · | · | · |
Notes
- per Switch · Nvidia NVSwitch 6.0 (NVLink 6) — >> 9 switch trays, 4 NVSwitch 6.0 per tray
Scale-Up Parts Summary
7
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| Nvidia NVSwitch 6.0 (NVLink 6) | 65,536 | 36.00 | 0.50 |
| NV Paladin HD2 224Gb/s 144 Bidi (Male) | 65,536 | 36.00 | 0.50 |
| NV Paladin HD2 224Gb/s 144 Bidi (Female) | 65,536 | 36.00 | 0.50 |
| NV Paladin HD2 224Gb/s 72 Bidi (Male) | 131,072 | 72.00 | 1.00 |
| NV Paladin HD2 224Gb/s 72 Bidi (Female) | 9,437,184 | 5,184.00 | 72.00 |
| NV 224Gb/s SkewClear EXD Gen 2 Bidi Cable | 9,437,184 | 5,184.00 | 72.00 |
| NVL Spine Chassis (NvLink 6) | 3,641 | 2.00 | 0.03 |
Backend network
5 rows
Assigned blockDefault
VR200 - NVL72 - CX9 - 2L - ETH - SN6600 - MSFT
BackendXPU: VR200 NVL725 linesshared by 1 SKU
Backend Units are based on the cluster size (131,072 XPUs).
Switches
4
SW Network Layer | Switch and Server Spec | Aggregate Port Utilization | Network Bandwidth Aggregate | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
SwitchPart Name / Model | Units# | Unit BWGbit/s | Port BWGbit/s | Downlink Ports / SW# | Uplink Ports / SW# | Max Ports# | Downlink Ports# | Uplink Ports# | Total Ports# | Downlink BWTbit/s | Uplink BWTbit/s | OversubRatio | |
| XPUs | · | 131,072 | 1,600 | 200 | 0 | 1,048,576 | 1,048,576 | 0 | 1,048,576 | 1,048,576 | 0 | 209,715.2 | · |
| NICs per Node | ConnectX-9 NIC - 800G | 8 | 800 | 100 | · | · | 8 | · | · | · | · | · | · |
| Leaf | Spectrum-6 102.4T x1600 (SN6600) | 4,096 | 102,400 | 200 | 256 | 256 | 512 | 1,048,576 | 1,048,576 | 2,097,152 | 209,715.2 | 209,715.2 | 1 |
| Spine | Spectrum-6 102.4T x1600 (SN6600) | 2,048 | 102,400 | 200 | 512 | · | 512 | 1,048,576 | 0 | 1,048,576 | 209,715.2 | 0 | · |
Transceivers
4
CN Network Layer | Transceiver / CablePart Name / Model | Total Units# | Units per SW/GPU# | Unit BWGbit/s | Lanes# | BW per LaneGbit/s | Agg. BWTbit/s |
|---|---|---|---|---|---|---|---|
| XPU Nodes | Generic 800G DR4 | 262,144 | 262,144 | 800 | 4 | 200 | 209,715.2 |
| Leaf | |||||||
| Downlink | Generic 1.6T DR8 (SiPho) | 131,072 | 32 | 1,600 | 8 | 200 | 209,715.2 |
| Uplink | Generic 1.6T DR8 (SiPho) | 131,072 | 32 | 1,600 | 8 | 200 | 209,715.2 |
| Spine | |||||||
| Downlink | Generic 1.6T DR8 (SiPho) | 131,072 | 64 | 1,600 | 8 | 200 | 209,715.2 |
| Uplink | · | · | · | · | · | · | · |
| Core | |||||||
| Downlink | · | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · | · |
| Super-Core | |||||||
Cables
4
CB Network Layer | Cable/ FiberType | Total Units# | Units per Transceiver# | Unit BWGbit/s | Lane Count# | SerDes BWGbit/s |
|---|---|---|---|---|---|---|
| XPU Nodes | Generic 800G Single Mode | 262,144 | 1 | 800 | 4 | 200 |
| Leaf | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | Generic 800G Single Mode | 262,144 | 2 | 800 | 4 | 200 |
| Spine | ||||||
| Downlink | Already counted above | · | · | · | · | · |
| Uplink | · | · | · | · | · | · |
| Core | ||||||
| Downlink | · | · | · | · | · | · |
| Uplink | · | · | · | · | · | · |
| Super-Core | ||||||
Backend Parts Summary
5
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| Generic 800G DR4 | 262,144 | 144.00 | 2.00 |
| Generic 800G Single Mode | 524,288 | 288.00 | 4.00 |
| Generic 1.6T DR8 (SiPho) | 393,216 | 216.00 | 3.00 |
| ConnectX-9 NIC - 800G | 262,144 | 144.00 | 2.00 |
| Spectrum-6 102.4T x1600 (SN6600) | 6,144 | 3.38 | 0.05 |
Frontend network
11 rows
Assigned blockDefault
VR200 - NVL72 - SN6600 - Generic
FrontendXPU: VR200 NVL7211 linesshared by 10 SKUs
Converged Frontend + Storage Fabric
11
| Layer | Part / Model | Units | Attach / XPU |
|---|---|---|---|
| · | Spectrum-6 102.4T x1600 (SN6600) | 1,573 | 0.0120 |
| · | Spectrum-4 25.6T (SN5400) | 7 | 0.0000 |
| · | Spectrum-3 12.8T (SN4700) | 234 | 0.0018 |
| · | Spectrum-2 1GbE (SN2201) | 1,924 | 0.0147 |
| · | Generic 1.6T DR8 (SiPho) | 76,114 | 0.5807 |
| · | Generic 800G DR4 | 75,717 | 0.5777 |
| · | Generic 200G DR4 QSFP56 | 33,600 | 0.2563 |
| · | Generic 800G Single Mode | 104,168 | 0.7947 |
| · | Generic 400G Single Mode | 533 | 0.0041 |
| · | Generic 200G Single Mode | 14,967 | 0.1142 |
| · | RJ45 Cables | 92,375 | 0.7048 |
Frontend Parts Summary
11
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| Spectrum-6 102.4T x1600 (SN6600) | 221 | 0 | 0.0017 |
| Spectrum-4 25.6T (SN5400) | 1 | 0 | 0.0000 |
| Spectrum-3 12.8T (SN4700) | 33 | 0 | 0.0003 |
| Spectrum-2 1GbE (SN2201) | 271 | 0 | 0.0021 |
| Generic 1.6T DR8 (SiPho) | 10,704 | 6 | 0.0817 |
| Generic 800G DR4 | 10,648 | 6 | 0.0812 |
| Generic 200G DR4 QSFP56 | 4,725 | 3 | 0.0360 |
| Generic 800G Single Mode | 14,649 | 8 | 0.1118 |
| Generic 400G Single Mode | 75 | 0 | 0.0006 |
| Generic 200G Single Mode | 2,105 | 1 | 0.0161 |
| RJ45 Cables | 12,990 | 7 | 0.0991 |
Compute Tray Networking Content
4 rows
Networking components inside the compute tray — accelerators, board-to-board connectors, retimers, and their per-tray bandwidth.
Assigned blockDefault
VR200 - NVL72 - Generic
Compute TrayXPU: VR200 NVL724 linesshared by 31 SKUs
| Tray layer | Part / Model | Units per Tray | Unit BWGb/s | Lanes | Lane BWGb/s | Per switch |
|---|---|---|---|---|---|---|
| XPUs per Tray | Rubin 200 | 4 | · | · | · | · |
| PCIe 6.0 Connector (Male) | NV Paladin Board to Board 32 Pin 4p8c (Male) | 2 | 512 | · | · | · |
| PCIe 6.0 Connector (Male) | NV Paladin Board to Board 64 Pin 4p16c (Male) | 8 | 1,024 | · | · | · |
| PCIe 6.0 Connector (Female) | NV Paladin Board to Board 32 Pin 4p8c (Female) | 4 | 512 | · | · | · |
| PCIe 6.0 Connector (Female) | NV Paladin Board to Board 64 Pin 4p16c (Female) | 16 | 1,024 | · | · | · |
| PCIe 6.0 Connector (Male) | NV Paladin Board to Board 32 Pin 4p8c (Male) | 2 | 512 | · | · | · |
| PCIe 6.0 Connector (Male) | NV Paladin Board to Board 64 Pin 4p16c (Male) | 8 | 1,024 | · | · | · |
Notes
- PCIe 6.0 Connector (Male) · NV Paladin Board to Board 32 Pin 4p8c (Male) — 2 pins = 1DP
- PCIe 6.0 Connector (Male) · NV Paladin Board to Board 64 Pin 4p16c (Male) — 2DP = 1Lane
Compute Tray Parts Summary
4
| Item | Qty/Cluster | Qty/Server | Attach/XPU |
|---|---|---|---|
| NV Paladin Board to Board 32 Pin 4p8c (Male) | 131,072 | 72.00 | 1.00 |
| NV Paladin Board to Board 64 Pin 4p16c (Male) | 524,288 | 288.00 | 4.00 |
| NV Paladin Board to Board 32 Pin 4p8c (Female) | 131,072 | 72.00 | 1.00 |
| NV Paladin Board to Board 64 Pin 4p16c (Female) | 524,288 | 288.00 | 4.00 |