8U DP Intel® Xeon® 6 GPU Server with 8x Intel® Gaudi 3 Accelerators
AceleMax® AXG-828IG
- Increased memory for LLM efficiency: >1TB HBM capacity
per universal baseboard and 29.6 TB/s HBM bandwidth. The
large HBM capacity and bandwidth allow the Intel® Gaudi®
3 accelerators to achieve state-of-the-art performance for
GenAI training and inference. - Better performance: Intel® Gaudi® 3 accelerators deliver 4x
BF16 compute, 2x networking bandwidth, and 1.5x memory
bandwidth over Gaudi® 2. - Scalability: With systems built on the Intel® Gaudi® 3
accelerators, enterprise customers can address the compute
demands of GenAI with flexibility and capacity to scale from
1 node to 1000s based on open, industry-standard ethernet
networking.
Specifications
| Category | Specifications |
|---|---|
| GPU | • 8 Gaudi H3 HL-325L (air-cooled) accelerators on OAM 2.0 baseboard |
| CPU | • Dual Intel® Xeon® 6 processors |
| Memory | • 24 DIMMs - up to 6TB memory in 1DPC |
| Drives | • Up to 8 hot-swap PCIe 5.0 NVMe |
| Power Supplies | • 8 3000W high efficiency fully redundant (4+4) Titanium Level |
| Networking | • 6 on-board OSFP 800GbE ports for scale-out |
| Expansion Slots | • 2 PCIe 5.0 x16 (FHHL) + 2 PCIe 5.0 x8 (FHHL) |
| Workloads | • AI Training and Inference |