NVLink provides a high-speed path between GPUs, allowing them to communicate peak data rates of 300 GB/s, a speed 10X faster than PCIe. Unlike PCIe, with NVLink a device has multiple paths to choose from, and rather than share a central hub to communicate, they instead use a mesh that enables the highest bandwidth data interchange between GPUs. This significantly speeds up applications and delivers greater raw compute performance than GPUs using PCIe. By increasing the total bandwidth between the GPU and other parts of the system, the data flow and total system throughput are improved to enhance the performance of the workload.
The system supports 8 Tesla SXM2 V100 GPUs installed on the GPU mainboard add-on module which is connected to the motherboard by a midplane. The GPU mainboard is connected through Nvidia’s Cube Mesh NVLINK architecture. Direct connection between all GPUs are single NVlink (25 GB/s). A direct connection from the GPUs to the network can be provided from the PCI-E PLX switch to the PCI-E3.0 x16 up front. Each PCI-E PLX switch is root to two SXM2 modules and one PCI-E3.0 x16 slot. A fast network (expansion) card installed on the riser card affords very high speeds. Data can go from GPU to the PLX to the NIC without going through the CPU. For the NIC, the system can support both FDR and EDR (in x16 slots).
The system has an onboard Baseboard Management Controller (BMC) chip that supports system health monitoring.
|Memory Type||2933/2666/2400/2133MHz ECC DDR4 RDIMM/LRDIMM|
|Chipset||Intel® C621 chipset|
|SATA||SATA3 (6Gbps) with RAID 0, 1, 5, 10|
|Network Controllers||Dual Port 10GBase-T from Intel X540 Ethernet Controller|
|Graphics||ASPEED AST2500 BMC|
|SATA||8 SATA3 (6Gbps) ports|
|USB||2 USB 3.0 ports (front)|
|Video||1 VGA Connector|
|COM Port||1 COM port (header)|
|Form Factor||4U Rackmountable with Rail kit|
||Backplane||16-port 2U SAS3 12Gbps hybrid backplane, support up to 8x 2.5" SAS3/SATA3 HDD/SSD and 8x SAS3/SATA3/NVMe Storage Devices|
|Power Supply||2200W Redundant Titanium Level Power Supplies with PMBus|
|Total Output Power||1200W/1800W/1980W/2090W/2200W(UL/cUL only)|