8U 8-GPU System - Large-Scale AI Inference Serving AS -8126GS-NB3RT-01-G2

Key Applications

• Scientific Research
• Conversational AI
• Business Intelligence & Analytics
• Drug Discovery
• Finance Services and Fraud Detection
• AI/Deep Learning Training and Inference
• Large Language Model (LLM) and Generative AI
• High Performance Computing (HPC)
• Autonomous Vehicle Technologies

Key Features

1. Dual AMD EPYC™ 9005/9004 Series Processors
2. NVIDIA HGX B300 8-GPU with 5th Generation NVLink® 1.8TB/s, 2.3TB of HBM3e GPU memory per system
3. 24 DIMMs, with up to 6TB at 6400MT/s DDR5 memory
   (Please check System Memory Section for detail)
4. 8 Hot-swap E1.S NVMe storage drive bays and 2 M.2 NVMe boot drives
5. 8 NVIDIA ConnectX®-8 SuperNICs, up to 800Gb/s, up to two dual-port NVIDIA BlueField®-3 DPUs
6. 6x 6600W Redundant (3 + 3) Titanium Level (96%) power supplies
   (Power supply full redundancy based on configuration and application load)

* Orders are subject to review and require verification prior to shipping. We reserve the right to cancel any order at our discretion.

* Estimated lead time is currently 2-3 weeks post-verification. Actual delivery schedule will depend on quantity and availability.