BIZON X9000 G3 – 8 GPU NVIDIA HGX H200 H100 AI GPU Server for Data Centers with AMD EPYC, Intel Xeon (SXM)

• Artificial Intelligence
• Big Data Analytics
• High-performance Computing
• Research Lab/National Lab
• Astrophysics, Business Intelligence

• NVIDIA HGX H200 8-GPU
• 900GB/s GPU-to-GPU bandwidth with NVIDIA NVLink and NVSwitch
• Dual AMD EPYC 9004 Series Processors
• 12-Channel DDR5 RDIMM, 24 x DIMMs
• Dual ROM Architecture
• 2 x 10Gb/s LAN ports via Intel X710-AT2
• 2 x M.2 slots with PCIe Gen3 x4 and x1 interface
• 8 x 2.5" Gen5 NVMe/SATA/SAS-4 hot-swappable bays
• 4 x FHHL PCIe Gen5 x16 slots
• 8 x LP PCIe Gen5 x16 slots
• 4+2 3000W 80 PLUS Titanium redundant power supplies

Dual CPU server board.

• AMD EPYC 9004 series processors (Socket SP5).
• System on Chip (SoC).

• AMD EPYC 9004 Series Processors
• Dual processor, 5nm technology
• Up to 128-core, 256 threads per processor
• cTDP up to 400W

• Up to 6144 GB DDR5 4800 MHz ECC Buffered
• 24 x DIMM slots
• DDR5 memory supported only
• 12-Channel memory architecture
• RDIMM modules up to 96GB supported
• 3DS RDIMM modules up to 256GB supported

NOTE: actual RAM clock speed depends on the CPU specifications and may vary.

Front Side:

• 2 x 10Gb/s BASE-T LAN ports (Intel X710-AT2) (front side)
• 1 x 10/100/1000 management LAN (Dedicated IPMI) (front side)
• 1 x 10/100/1000 management LAN (Dedicated IPMI) (rear side)
• 100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; QSFP56) (optional)

• Integrated in Aspeed AST2600
• 2D Video Graphic Adapter with PCIe bus interface
• 1920x1200@60Hz 32bpp, DDR4 SDRAM

8 x Nvidia HGX H200 141 GB

N/A

8 x 2.5" Gen5 NVMe/SATA*/SAS* hot-swappable bays

* Storage card is required to support SATA and SAS drives.

Require SAS add-in cards

Require SAS add-in cards

• 8 x SXM5 sockets for NVIDIA HGX H200 141GB module
• 8 x PCIe x16 (Gen5 x16) low-profile slots
• 4 x PCIe x16 (Gen5 x16) FHHL slots
• 1 x M.2 slots:
  - M-key
  - PCIe Gen3 x1, from CPU_0
  - Supports 2280/22110 cards
• 1 x M.2 slots:
  - M-key
  - PCIe Gen3 x4, from CPU_1
  - Supports 2280/22110 cards

• 1 x TPM header

• 2 x USB 3.2 Gen1
• 1 x VGA
• 2 x RJ45
• 1 x MLAN (default port)
• 1 x Power button with LED
• 1 x ID button with LED
• 1 x Reset button
• 1 x NMI button
• 1 x System status LED
• 1 x Storage activity LED

1 x MLAN

Speed and bandwidth: PCIe Gen5 x4 or SATA 6Gb/s or SAS-4 24Gb/s

1 x TPM header with SPI interface

• 4+2 3000W (240V) 80 PLUS Titanium redundant power supplies

AC Input:

• 115-127V~/ 14.2A, 50-60Hz
• 200-220V~/ 15.8A, 50-60Hz
220-240V~/ 14.9A, 50-60Hz
DC Input:

• 240Vdc/ 14A

DC Output:

• Max 1450W at 115-127V~
• +54V/ 26.6A
• +12Vsb/ 3A
• Max 2900W at 200-220V
• +54V/ 53.4A
• +12Vsb/ 3A
• Max 3000W at 220-240V
• +54V/ 55.6A
• +12Vsb/ 3A

NOTE: X9000 comes with 6 x 3000W Redundant (4+2) power supplies. Total 6 power supplies (4 main + 2 backups).
That means that maximum output power is 12000 W (4 x 3000W) with 6000W (2 x 3000W) for backup power supplies.
If one or two power supplies will fail, the other backup power supply starts running to keep the computer powered up.
The switch between the power supplies is seamless, so as not to interrupt the normal use of the computer.

NOTE: The system power supply requires C19 type power cord.

100-120V (standard US outlet):
If you have a standard 20 A / 120V US outlet, you can connect one power supply to one dedicated power circuit (each outlet should have its dedicated circuit). In total, you need four (6) 20 A /120V outlets with a dedicated circuit.

Actual power consumption is not the same as maximum power supply power. Power supply power means how much watts you can get from the power supply and your actual power consumption should not be higher than max power supply power. Actual power consumption depends on your configuration (graphics card and CPU).

Power consumption example: X9000 with 8 x Tesla V100 32G B + 2 x Xeon 4116 CPUs = 2400-2600W (100% load for all the GPUs and CPUs).

Information for reference only. Consult your electrician for more details.

BizonOS and BizonOS Control Panel.
BizonOS includes a user-friendly, web-based control panel with everything one needs, all organized into one convenient location.

BizonOS features:

• Remote access from anywhere (SSH/VNC)
• Virtual machines
• GPU sharing
• Containers
• One-click software updates
• Jupyter notebooks
• GPU/System monitoring
• accounts, and permissions

• Aspeed AST2600 management controller
• Dashboard
• HTML5 KVM
• Sensor Monitor (Voltage, RPM, Temperature, CPU Status …etc.)
• Sensor Reading History Data
• FRU Information
• SEL Log in Linear Storage / Circular Storage Policy
• Hardware Inventory
• Fan Profile
• System Firewall
• Power Consumption
• Power Control
• Advanced power capping
• LDAP / AD / RADIUS Support
• Backup & Restore Configuration
• Remote BIOS/BMC/CPLD Update
• Event Log Filter
• User Management
• Media Redirection Settings
• PAM Order Settings
• SSL Settings
• SMTP Settings

• BIZON Z–Stack (Ubuntu 22.04 with preinstalled deep learning frameworks).
• Rocky Linux 9 (optional).
• Windows 11 Pro (optional).
• Windows 10 Pro (optional).
• Microsoft Windows Server 2022 Standard (optional).


• Windows Server 2019
• Windows Server 2022
• Red Hat Enterprise Linux 8.6 ( x64) or later
• SUSE Linux Enterprise Server 15 SP4 ( x64) or later
• Ubuntu 20.04.5 LTS (x64) or later
• Ubuntu 22.04 LTS (x64) or later
• VMware ESXi 7.0 Update 3i
• VMware ESXi 8.0
• VMware ESXi 8.0 Update 1
• Citrix Hypervisor 8.2 LTSR CU1

• Motherboard: 2 x 40x40x56mm (32,000rpm), 4 x 60x60x56mm (24,000rpm)
• PCIe slots: 4 x 40x40x28mm (25,000rpm), 2 x 40x40x56mm (32,000rpm)
• GPU tray: 6 x 60x60x76mm (21,700rpm), 11 x 80x80x80mm (17,000rpm)

• Operating temperature: 50° to 95° F (10° to 35° C)
• Operating humidity: 8%-80% (non-condensing)
• Non-operating temperature: -40° to 140° F (-40°C to 60°C)
• Non-operating humidity: 20%-95% (non-condensing)

8 x NVIDIA H100 80 GB:

Idle: 60 dB
Max Load (stress test): 70 dB

Measured from 6 ft / 1.8 m distance.

Case

• Rackmountable; 5U; horizontal placement
• Height: 8.7 inches (22.0 cm)
• Width: 17.3 inches (44.7 cm)
• Depth: 37 inches (94.5 cm)

Shipping Package

• Height: 27.6 inches (70.0 cm)
• Width: 35 inches (89.0 cm)
• Length: 47.2 inches (120.0 cm)
• Weight: 135 lbs (61.2 kg) (shipped on a pallet)

• Bizon X9000 G3.
• 1 x Rail kit
• 6 x power cords (USA).
• User manual.
• Benchmark report.

bizon-x9000-0924-g3

• Artificial Intelligence
• Big Data Analytics
• High-performance Computing
• Research Lab/National Lab
• Astrophysics, Business Intelligence

• Supports NVIDIA HGX H200 with 8 x SXM5 GPUs
• Supports NVIDIA NVLink and NVSwitch technology
• Up to 900GB/s GPU to GPU interconnection
• 4th/5th Gen. Intel Xeon Scalable Processors
• Intel Xeon CPU Max Series
• Dual processor, LGA 4677
• 8-Channel RDIMM DDR5 per processor, 16 DIMM per CPU, 32 x DIMMs
• 2 x 10Gb/s BASE-T LAN ports (Intel X710-AT2)
• 1 x dedicated management port
• 10 x 2.5" Gen5 NVMe/SATA hot-swappable bays
• 12 x LP Gen5 x16 expansion slots
• 1 x LP Gen4 x16 expansion slot
• 4+2 3000W (240V) 80 PLUS Titanium redundant power supply

Dual CPU server board.

• Intel Xeon Scalable Processors LGA 4677 (Socket E).
• Intel C741 chipset.

• 4th/5th Generation Intel Xeon Scalable Processors
• Intel Xeon CPU Max Series
• Intel Xeon Platinum Processor, Intel Xeon Gold Processor, Intel Xeon Silver Processor
• Dual processors, 10nm
• Up to 60-core, 120 threads per processor
• cTDP up to 350W

• Up to 8192 GB DDR5 4400 MHz ECC Buffered
• 32 x DIMM slots
• DDR5 memory supported only
• 8-Channel memory per processor architecture
• RDIMM modules up to 64GB supported
• 3DS RDIMM modules up to 256GB supported

NOTE: actual RAM clock speed depends on the CPU specifications and may vary.

• 8 x PCIe Gen5 x16 link (LP, HL) (PCIe Switch directly)
• 2 x PCIe Gen5 x16 link (FH, HL) (CPU directly)
• 1 x PCIe Gen4 x8 link from CPU2 DMI (FH, HL) (CPU directly)

• 10 x 2.5" Hot-swap Drive Bays (8 NVMe, 2 NVMe/SATA/SAS):
  -8 x NVMe (PCIe Switch directly) (front)
  -2 x NVMe(CPU2)/SATA(PCH) (CPU directly) (rear)
• 2 x M.2 Gen3 x2 link (PCH)

Front Side:

• 2 x 10Gb/s BASE-T LAN ports (Intel X710-AT2)
• 1 x 10/100/1000 management LAN (Dedicated IPMI)
• 100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; QSFP56) (optional)

8 Nvidia HGX H200 141 GB with NVLink.

• 4 x USB 3.2 Gen 1 ports
• 1 x VGA port
• 2 x RJ45
• 1 x MLAN
• 1 x Location Button w/LED
• 1 x Power Button w/LED
• 1 x Message LED
• 1 x Q-Code/Port 80 LED

• 1 x Power Button w/LED
• 1 x Location Button w/LED

• 4+2 3000W (240V) 80 PLUS Titanium redundant power supply

NOTE: The system power supply requires C19 type power cord.

BizonOS and BizonOS Control Panel.
BizonOS includes a user-friendly, web-based control panel with everything one needs, all organized into one convenient location.

BizonOS features:

• Remote access from anywhere (SSH/VNC)
• Virtual machines
• GPU sharing
• Containers
• One-click software updates
• Jupyter notebooks
• GPU/System monitoring
• accounts, and permissions

• BIZON Z–Stack (Ubuntu 22.04 with preinstalled deep learning frameworks).
• Rocky Linux 9 (optional).
• Windows 11 Pro (optional).
• Windows 10 Pro (optional).
• Microsoft Windows Server 2022 Standard (optional).


• Windows Server 2019
• Windows Server 2022
• Red Hat Enterprise Linux 8.x ( x64) or later
• Red Hat Enterprise Linux 9.x ( x64) or later
• Ubuntu 20.04 LTS (x64) or later
• Ubuntu 22.04 LTS (x64) or later
• ESXi 8.0 or later
• Rocky Linux 8.x
• Rocky Linux 9.x

• Operating temperature: 50° to 95° F (10° to 35° C)
• Operating humidity: 8%-80% (non-condensing)
• Non-operating temperature: -40° to 158° F (-40°C to 70°C)
• Non-operating humidity: 20%-90% (non-condensing)

8 x NVIDIA H200 141 GB:

Idle: 60 dB
Max Load (stress test): 70 dB

Measured from 6 ft / 1.8 m distance.

Case

• Rackmountable; 7U; horizontal placement
• Height: 11.8 inches (30.7 cm)
• Width: 17.3 inches (44.7 cm)
• Depth: 34.8 inches (88.5 cm)

Shipping Package

• Height: 30.7 inches (78.2 cm)
• Width: 32.3 inches (82.2 cm)
• Length: 46.1 inches (117.6 cm)
• Weight: 383.6 lbs (174 kg) (shipped on a pallet)

• Bizon X9000 G3
• 1 x Rail kit
• 6 x power cords (USA)
• User manual
• Benchmark report

bizon-x9000-0924-g3