Gigabyte has launched a pair of powerful new 4U GPU servers. Aimed at Deep Learning and AI applications, the new G481-S80 and G481-HA0 pack 8 x SXM2 GPUs and 10 x GPUs respectively for massively parallel computing capabilities. These Nvidia Tesla-based servers deliver highly attractive GPU densities for data centre managers.
Before we get onto the deep-learning power represented by these servers it is important to consider the supporting architecture. Both G481-S80 and G481-HA0 are powered by dual Intel Xeon Scalable processors, with up to 28 cores per CPU. Intel's Omni-Path connection technology is employed to eliminate CPU to network latency here. Furthermore, six memory channels per CPU with two DIMM slots per channel are supported for DDR4 memory. Depending upon your CPU model your server will be able to support up to 1.5TB of RAM per CPU.
The G481-S80 accommodates up to 8x SXM2 form factor GPUs, such as the Nvidia Volta V100 or Pascal P100, with support for NVLink GPU to GPU interconnection fabric, offering higher bandwidth, more links, and improved scalability. Gigabyte gives an example of "a single Nvidia Tesla V100 GPU can support up to six NVLink links with a signalling rate of 25GB/sec in each direction, equalling a total bandwidth of 300GB/sec."
Four PCIe expansion slots are present to support network connectivity, such as InfiniBand for RDMA for high-throughput, low latency GPU to network connectivity for each GPU pair. As standard the G481-S80 features dual 1Gb/s BASE-T LAN ports (Intel I350-AM2) at the front of each unit, as well as 1Gb dedicated management LAN ports front and rear.
For storage the G481-S80 features 10 x 2.5-inch hot swap drive bays in the front, which can support 4x ultra-fast NVMe drives via U.2 connection, and 6x drives via SATA/SAS. Turning to power, the G481-S80 features 4 x 80 PLUS Platinum 2200W power supply units, 3 units for a N + N redundancy.
Turning to the G481-HA0, this 4U server can fit up to 10 PCIe GPGPU cards. That is the maximum GPU density available in this form factor on the market right now. In addition to the PCIe expansion slot offered in the rear of this 4U server, suitable for networking expansion, you can choose to add further networking cards in place of one or more GPU cards.
Again Gigabyte has an example in that users "may choose to install 8 x GPU cards and 2 x additional networking cards such as InfiniBand or 10 / 25 / 50 / 100Gb Ethernet". The G481-HA0 features dual 10Gb/s BASE-T LAN ports (Intel X550-AT2) in the rear as standard and dual 1Gb/s BASE-T LAN ports (Intel I350-AM2) at the front, plus 1Gb dedicated management LAN ports front and rear.
The G481-HA0 offers expansive storage capacity and flexibility, with 10 x 2.5-inch hot swap drive bays available for up to 8 x 2.5-inch NVMe drives and 2 x 2.5-inch SATA/SAS drives (or the customer may choose an alternative combination such as 6 x NVMe and 6 x SATA/SAS). Featured below the 2.5-inch storage drive area are a further 12 x 3.5-inch SATA/ SAS hot swap drive bays. For power the G481-HA0 features 3 x 80 PLUS Platinum 2200W power supply units for a N + 1 redundancy.
Both models also feature a PCIe expansion slot in the front above the storage area to attach a hardware or software RAID card, with a battery backup unit slot for additional data protection. Cooling in both 4U servers includes a 'dual fan wall' made up of 12 hot-swappable fans between the CPU and GPU areas creating a large 'airflow tunnel'.
Gigabyte asks that interested parties head on over to b2b.gigabyte.com for more information.