BIZON G9000 – 4x 8x NVIDIA A100, H100, H200 Tensor Core AI GPU Server with AMD EPYC, Intel Xeon

Tech Specs
Customize

G9000 G2

4x 8x NVIDIA A100 H100 AI Deep Learning Server for Data Centers

NVIDIA A100 or NVIDIA H100 GPU (80GB) HPC GPU Server with dual Intel XEON, AMD EPYC

In stock. 19 units left.
Estimated Ship Date: 5–7 days

Starting at $23,995

Ask expert

System Core

Processor

AMD EPYC 9004
2x
16-Core 3.00 GHz AMD EPYC 9124+$0
2x
32-Core 3.25 GHz AMD EPYC 9354+$4030
2x
64-Core 3.10 GHz AMD EPYC 9554+$5228
2x
84-Core 2.25 GHz AMD EPYC 9634+$5017
2x
96-Core 2.40 GHz AMD EPYC 9654+$6528
2x
128-Core 2.25 GHz AMD EPYC 9754+$9247
AMD EPYC 9005
2x
32-Core 3.55 GHz AMD EPYC 9355+$7853
2x
32-Core 3.80 GHz AMD EPYC 9375F+$11228
2x
48-Core 3.65 GHz AMD EPYC 9475F+$13253
2x
64-Core 3.20 GHz AMD EPYC 9555+$15683
2x
64-Core 3.30 GHz AMD EPYC 9575F+$20138
2x
96-Core 2.60 GHz AMD EPYC 9655+$21083
2x
128-Core 2.70 GHz AMD EPYC 9755+$22163
2x
160-Core 2.10 GHz AMD EPYC 9845+$25943
2x
192-Core 2.25 GHz AMD EPYC 9965+$32033
Intel Xeon Scalable
2x
16-Core 2.50 GHz Intel Xeon Gold 6426Y+$2622
2x
32-Core 2.10 GHz Intel Xeon Gold 6448Y+$5288
2x
40-Core 2.00 GHz Intel Xeon Platinum 8460Y++$7475
2x
48-Core 2.10 GHz Intel Xeon Platinum 8468+$11255
2x
52-Core 2.00 GHz Intel Xeon Platinum 8470+$18518
2x
56-Core 2.00 GHz Intel Xeon Platinum 8480++$19328
2x
60-Core 1.90 GHz Intel Xeon Platinum 8490H+$36743

Graphics Card

NVIDIA A100 Compute
4x NVIDIA A100 40 GB Tensor Core GPU (160 GB HBM2e Memory, NVLink)+$0
8x NVIDIA A100 40 GB Tensor Core GPU (320 GB HBM2e Memory, NVLink)+$47120
4x NVIDIA A100 80 GB Tensor Core GPU (320 GB HBM2e Memory, NVLink)+$49886
8x NVIDIA A100 80 GB Tensor Core GPU (640 GB HBM2e Memory, NVLink)+$146892
NVIDIA H100 Compute
4x NVIDIA H100 94 GB NVL Tensor Core GPU (376 GB HBM3 Memory, NVLink)+$92440
8x NVIDIA H100 94 GB NVL Tensor Core GPU (752 GB HBM3 Memory, NVLink)+$231999
NVIDIA H200 Compute
4x NVIDIA H200 141 GB NVL Tensor Core GPU (564 GB HBM3e Memory, NVLink)+$130160
8x NVIDIA H200 141 GB NVL Tensor Core GPU (1128 GB HBM3e Memory, NVLink)+$307440

Memory

As a rule of thumb, for machine learning and AI, system RAM should be roughly 2x times the GPU VRAM.

If your GPU has 48 GB of VRAM, you would typically want at least 128 GB of system RAM.
If you have two GPUs with 24 GB VRAM each (48 GB VRAM total), you would typically want at least 128 GB of system RAM.

This ratio ensures that your CPU can effectively manage the data passed to the GPU without bottlenecks, especially for large datasets and deep learning tasks.

Learn More

4x
16 GB 5600 MHz DDR5 ECC/REG+$0
4x
32 GB 5600 MHz DDR5 ECC/REG+$318
4x
64 GB 5600 MHz DDR5 ECC/REG+$1329
4x
96 GB 5600 MHz DDR5 ECC/REG+$2372
12x
128 GB 5600 MHz DDR5 ECC/REG+$17342

Operating System

You can choose multiple operating systems.

BIZON Z–Stack (includes Ubuntu 22.04 and latest deep learning frameworks)
Recommended for Deep Learning. Preinstalled with the Most Powerful Deep Learning Software (including Tensorflow, Torch/PyTorch, Keras, Caffe 2.0 Caffe-nv, Theano, CUDA and cuDNN). We provide BIZON Z-Stack Tool with a user-friendly interface for easy installation and future upgrades. If a new version of any framework is released, you can upgrade with a click of a button and avoid complicated command lines.

Learn More

Ubuntu 24.04 (includes BIZON OS and deep learning software stack; TensorFlow, PyTorch, CUDA, cuDNN, SLURM, etc)+$0
Windows 11 Pro (includes deep learning software stack)+$203
Windows 11 Pro+$203
Microsoft Windows Server 2022 Standard (24 Core license)+$1849
Rocky Linux 9+$0
No operating system+$0

Storage

SSD #1 (Operating System, Applications)

PCI-E 4.0 NVMe Solid State Drives (Up to 7000 Mb/s)
4 TB PCI-E 4.0 NVMe SSD+$0
7.68 TB PCI-E 4.0 NVMe SSD+$780
15.36 TB PCI-E 4.0 NVMe SSD+$1799
30.72 TB PCI-E 4.0 NVMe SSD+$3965
61.44 TB PCI-E 4.0 NVMe SSD+$9550

SSD #2

Not included
PCI-E 4.0 NVMe Solid State Drives (Up to 7000 Mb/s)
1x
1 TB PCI-E 4.0 NVMe SSD+$265
1x
2 TB PCI-E 4.0 NVMe SSD+$371
1x
4 TB PCI-E 4.0 NVMe SSD+$600
1x
7.68 TB PCI-E 4.0 NVMe SSD+$1380
1x
15.36 TB PCI-E 4.0 NVMe SSD+$2399
1x
30.72 TB PCI-E 4.0 NVMe SSD+$4556
1x
61.44 TB PCI-E 4.0 NVMe SSD+$10150
SATA Solid State Drives (Up to 550 Mb/s)
1x
1 TB SATA SSD+$145
1x
2 TB SATA SSD+$212
1x
4 TB SATA SSD+$465
1x
8 TB SATA SSD+$828

Additional SSD

Optional storage drive for footage, scratch files, media cache or project files. SSD for project files, scratch, & media cache.

Learn More

Not included
PCI-E 4.0 NVMe Solid State Drives (Up to 7000 Mb/s)
1x
15.36 TB PCI-E 4.0 NVMe SSD+$2399
1x
30.72 TB PCI-E 4.0 NVMe SSD+$4556
1x
61.44 TB PCI-E 4.0 NVMe SSD+$10150
SATA Solid State Drives (Up to 550 Mb/s)
1x
4 TB SATA SSD+$465
1x
8 TB SATA SSD+$828

RAID Controller

RAID controllers are generally optional when using SSDs since they already offer fast read/write speeds and are more reliable because they have no moving parts.

A RAID controller manages multiple hard drives and creates a redundant array of independent disks (RAID). It's needed when users require improved data redundancy, performance, or both by combining drives to protect against data loss.

Learn More

Not included
RAID controller for PCIe NVMe SSDs
4x port RAID NVMe SSD controller (Up to 4x NVMe SSDs; PCIe 3.0)+$839
4x port RAID NVMe SSD controller (Up to 4x NVMe SSDs; PCIe 4.0)+$1146
8x port RAID NVMe SSD controller (Up to 8x NVMe SSDs; PCIe 4.0)+$1999
RAID controller for SATA/SAS SSDs
8x port RAID SAS/SATA SSD controller (Up to 8x HDDs, 12Gb/s; 8 ports; PCIe 3.0)+$599

Adapters

Network

1x
10 Gigabit Dual Port Ethernet (2x RJ45) (integrated)+$0
1x
25 Gigabit Dual Port Ethernet (2x SFP28)+$233
1x
100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; 1x QSFP)+$1399
1x
200 Gbps Dual Port InfiniBand HDR (Mellanox ConnectX-6 VPI Adapter; 2x QSFP)+$2299
1x
400 Gbps Single Port InfiniBand NDR (Mellanox ConnectX-7 VPI Adapter; 1x OSFP)+$1999

Trusted Platform Module

Not included
Trusted Platform Module - TPM 2.0+$79

Peripherals

UPS System

* UPS system supplied by APC or Cyberpower. 120V. The model may vary depending on availability. Contact sales if you have a specific preference.

Learn More

Not included
Rackmountable UPS System 1500W 120V+$1299
Rackmountable UPS System 3000W 120V (2 x 1500W)+$2455

Service & Support

Warranty/Support

The "Life-time Expert Customer Care with 3 / 4 / 5 Year Limited Warranty" includes the following benefits:

Life-time access to our expert customer support team for all kinds of computer issues.

Three / four / five years (depending on the option you choose) of labor free warranty service (including labor costs for part replacements, and diagnostics).

One / two / three years (depending on the option you choose) of direct defective part replacement service directly from BIZON's inventory.

Learn More

Lifetime Expert Care with 3 Year Limited Warranty (3 Year Labor & 1 Year Part Replacement)+$0
Lifetime Expert Care with 4 Year Limited Warranty (4 Year Labor & 2 Year Part Replacement)+$3830
Lifetime Expert Care with 5 Year Limited Warranty (5 Year Labor & 3 Year Part Replacement)+$5746

$63,840

Financing

$63,840

In Stock

Download Quote EDU, GOV discounts B2B/reseller discounts Financing Available

Need help?

Contact our specialists and get help.

Ask a Question

G9000 – AMD EPYC Platform G9000 – Intel Xeon Platform

G9000 – AMD EPYC Platform

Use cases

Artificial Intelligence
Big Data Analytics
High-performance Computing
Research Lab/National Lab
Astrophysics, Business Intelligence

Motherboard

Dual CPU server board.

AMD EPYC 9005/9004 series processors (Socket SP5).
System on Chip (SoC).

CPU

AMD EPYC 9005/9004 series processor family
Dual processors, 5nm
Up to 192-core, 384 threads per processor
cTDP up to 400W

Memory

Up to 6144 GB DDR5 4800 MHz ECC Buffered
24 x DIMM slots
DDR5 memory supported only
12-Channel memory per processor architecture
RDIMM modules up to 64GB supported
3DS RDIMM modules up to 256GB supported

NOTE: actual RAM clock speed depends on the CPU specifications and may vary.

LAN

2 x 10Gb/s LAN ports (Intel X710-AT2)
1 x 10/100/1000 management LAN (Dedicated IPMI)
100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; QSFP56) (optional)

Video

Integrated in Aspeed AST2600
2D Video Graphic Adapter with PCIe bus interface
1920x1200@60Hz 32bpp, DDR4 SDRAM

Graphics Cards

Up to 8 Nvidia cards with NVLink support.

Available options:

Nvidia A100 40Gb (no video outputs)
Nvidia A100 80Gb (no video outputs)
Nvidia H100 94Gb NVL (no video outputs)
Nvidia H200 141Gb NVL (no video outputs)

Audio

N/A

Storage

8 x 3.5"/2.5" Gen5 NVMe (front hot-swap)
1 x M.2 (2280/22110), PCIe Gen3 x4

SAS

Depends on additional SAS card.

RAID

Depends on additional SAS card.

Peripheral Drives

N/A

Expansion Slots

8 x PCIe slots (Gen5 x16 link, FH,FL) for dual-slot GPU cards
1 x PCIe slot (Gen5 x8 link ,LP,HL) for HBA/RAID cards (front)
1 x PCIe slot (Gen5 x16 link) for NIC (rear)
1 x PCIe slot (Gen5 x8 link) for NIC (rear)

Front I/O

2 x USB 3.2 Gen1
1 x VGA
1 x Power button w/LED
1 x Location Button w/LED
1 x Message LED
1 x Q-Code/Port 80 LED
1 x Clear CMOS Switch
1 x Reset Switch
1 x M.2 LED

Rear I/O

1 x COM port
2 x RJ45
1 x MLAN
1 x Power Button w/LED
1 x Location Button w/LED

Power Supply

2+2 Redundant 2600W 80 PLUS Titanium Power Supply
Rating: 220-240 Vac, 15.5A(x4), 50-60 Hz

NOTE: G9000 comes with 4 x 2600W Redundant (2+2) power supplies. Total 4 power supplies (2 main + 2 backup).
That means that maximum output power is 5200W (2 x 2600W) with 5200W (2 x 2600W) for backup power supplies.
If one power supplies will fail, the other backup power supply starts running to keep the computer powered up.
The switch between the power supplies is seamless, so as not to interrupt the normal use of the computer.

NOTE: The system power supply requires C19 type power cord.

Power Requirements

100-120V (standard US outlet):
If you have a standard 20 A / 120V US outlet, you can connect one power supply to one dedicated power circuit (each outlet should have its dedicated circuit). In total, you need four (4) 20 A /120V outlets with a dedicated circuit.

Actual power consumption is not the same as maximum power supply power. Power supply power means how much watts you can get from the power supply and your actual power consumption should not be higher than max power supply power. Actual power consumption depends on your configuration (graphics card and CPU).

Power consumption example: G9000 with 8 x NVIDIA H100 = 2800W-3000W (100% load for all the GPUs).

Information for reference only. Consult your electrician for more details.

System Management

BizonOS and BizonOS Control Panel.
BizonOS includes a user-friendly, web-based control panel with everything one needs, all organized into one convenient location.

BizonOS features:

Remote access from anywhere (SSH/VNC)
Virtual machines
GPU sharing
Containers
One-click software updates
Jupyter notebooks
GPU/System monitoring
accounts, and permissions

Aspeed AST2600 management controller
Dashboard
HTML5 KVM
Sensor Monitor (Voltage, RPM, Temperature, CPU Status …etc.)
Sensor Reading History Data
FRU Information
SEL Log in Linear Storage / Circular Storage Policy
Hardware Inventory
Fan Profile
System Firewall
Power Consumption
Power Control
LDAP / AD / RADIUS Support
Backup & Restore Configuration
Remote BIOS/BMC/CPLD Update
Event Log Filter
User Management
Media Redirection Settings
PAM Order Settings
SSL Settings
SMTP Settings

OS Compatibility

BIZON Z–Stack (Ubuntu 22.04 with preinstalled deep learning frameworks).
Rocky Linux 9 (optional).
Windows 11 Pro (optional).
Microsoft Windows Server 2022 Standard (optional).

Windows Server 2022
Red Hat Enterprise Linux 8.6 ( x64) or later
SUSE Linux Enterprise Server 15 SP4 or later
Ubuntu 20.04.5 LTS (x64) or later
Ubuntu 22.04 LTS (x64) or later
Ubuntu 22.04.1 LTS (x64) or later
VMware ESXi 7.0 Update 3i later
VMware ESXi 8.0 Update1 or later
Citrix Hypervisor 8.2.1 or later

Operating Properties

Operating temperature: 50° to 95° F (10° to 35° C)
Operating humidity: 8%-80% (non-condensing)
Non-operating temperature: -40° to 158° F (-40°C to 70°C)
Non-operating humidity: 20%-90% (non-condensing)

Noise

8 x NVIDIA A100:

Idle: 71 dB
Max Load (stress test): 91 dB

Measured from 6 ft / 1.8 m distance.

Dimensions & Weight

Case

Rackmountable; 4U; horizontal placement
Height: 6.69 inches (17.45 cm)
Width: 17.3 inches (44.0 cm)
Depth: 31.5 inches (80.0 cm)

Shipping Package

Height: 17.3 inches (44.4 cm)
Width: 31.5 inches (80.0 cm)
Length: 47.2 inches (120.0 cm)
Weight: 135 lbs (61.2 kg) (shipped on pallet)

In the Box

Bizon G9000 G2
1 x Rail kit
4 x power cords (USA)
User manual
Benchmark report

Part Number

bizon-g9000-0523

Diagram

G9000 – Intel Xeon Platform

Use cases

Artificial Intelligence
Big Data Analytics
High-performance Computing
Research Lab/National Lab
Astrophysics, Business Intelligence

Motherboard

Dual CPU server board.

Intel Xeon Scalable Processors LGA 4677 (Socket E).
Intel C741 chipset.

CPU

4th/5th Generation Intel Xeon Scalable Processors
Intel Xeon CPU Max Series
Intel Xeon Platinum Processor, Intel Xeon Gold Processor, Intel Xeon Silver Processor
Dual processors, 10nm
Up to 60-core, 120 threads per processor
cTDP up to 350W

Memory

Up to 8192 GB DDR5 4800 MHz ECC Buffered
32 x DIMM slots
DDR5 memory supported only
8-Channel memory per processor architecture
RDIMM modules up to 64GB supported
3DS RDIMM modules up to 256GB supported

NOTE: actual RAM clock speed depends on the CPU specifications and may vary.

LAN

2 x 10Gb/s LAN ports (Intel X710-AT2)
1 x 10/100/1000 management LAN (Dedicated IPMI)
100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; QSFP56) (optional)

Video

Integrated in Aspeed AST2600
2D Video Graphic Adapter with PCIe bus interface
1920x1200@60Hz 32bpp, DDR4 SDRAM

Graphics Cards

Up to 8 Nvidia cards with NVLink support.

Available options:

Nvidia A100 40Gb (no video outputs)
Nvidia A100 80Gb (no video outputs)
Nvidia H100 94Gb NVL (no video outputs)
Nvidia H200 141Gb NVL (no video outputs)

Audio

N/A

Storage

8 x 3.5"/2.5" Gen5 NVMe (front hot-swap)
1 x M.2 (2280/22110), PCIe Gen3 x4

SAS

Depends on additional SAS card.

RAID

Depends on additional SAS card.

Peripheral Drives

N/A

Expansion Slots

8 x PCIe slots (Gen5 x16 link, FH,FL) for dual-slot GPU cards
1 x PCIe slot (Gen5 x8 link ,LP,HL) for HBA/RAID cards (front)
1 x PCIe slot (Gen5 x16 link) for NIC (rear)
1 x PCIe slot (Gen5 x8 link) for NIC (rear)

Front I/O

2 x USB 3.2 Gen1
1 x VGA
1 x Power button w/LED
1 x Location Button w/LED
1 x Message LED
1 x Q-Code/Port 80 LED
1 x Clear CMOS Switch
1 x Reset Switch
1 x M.2 LED

Rear I/O

1 x COM port
2 x RJ45
1 x MLAN
1 x Power Button w/LED
1 x Location Button w/LED

Power Supply

2+2 Redundant 2600W 80 PLUS Titanium Power Supply
Rating: 220-240 Vac, 15.5A(x4), 50-60 Hz

NOTE: The system power supply requires C19 type power cord.

Power Requirements

System Management

BizonOS and BizonOS Control Panel.
BizonOS includes a user-friendly, web-based control panel with everything one needs, all organized into one convenient location.

BizonOS features:

Remote access from anywhere (SSH/VNC)
Virtual machines
GPU sharing
Containers
One-click software updates
Jupyter notebooks
GPU/System monitoring
accounts, and permissions

Aspeed AST2600 management controller
Dashboard
HTML5 KVM
Sensor Monitor (Voltage, RPM, Temperature, CPU Status …etc.)
Sensor Reading History Data
FRU Information
SEL Log in Linear Storage / Circular Storage Policy
Hardware Inventory
Fan Profile
System Firewall
Power Consumption
Power Control
LDAP / AD / RADIUS Support
Backup & Restore Configuration
Remote BIOS/BMC/CPLD Update
Event Log Filter
User Management
Media Redirection Settings
PAM Order Settings
SSL Settings
SMTP Settings

OS Compatibility

BIZON Z–Stack (Ubuntu 22.04 with preinstalled deep learning frameworks).
Rocky Linux 9 (optional).
Windows 11 Pro (optional).
Microsoft Windows Server 2022 Standard (optional).

Windows Server 2022
Red Hat Enterprise Linux 8.6 ( x64) or later
SUSE Linux Enterprise Server 15 SP4 or later
Ubuntu 20.04.5 LTS (x64) or later
Ubuntu 22.04 LTS (x64) or later
Ubuntu 22.04.1 LTS (x64) or later
VMware ESXi 7.0 Update 3i later
VMware ESXi 8.0 Update1 or later
Citrix Hypervisor 8.2.1 or later

Operating Properties

Operating temperature: 50° to 95° F (10° to 35° C)
Operating humidity: 8%-80% (non-condensing)
Non-operating temperature: -40° to 158° F (-40°C to 70°C)
Non-operating humidity: 20%-90% (non-condensing)

Noise

8 x NVIDIA A100:

Idle: 71 dB
Max Load (stress test): 91 dB

Measured from 6 ft / 1.8 m distance.

Dimensions & Weight

Case

Rackmountable; 4U; horizontal placement
Height: 6.69 inches (17.45 cm)
Width: 17.3 inches (44.0 cm)
Depth: 31.5 inches (80.0 cm)

Shipping Package

Height: 17.3 inches (44.4 cm)
Width: 31.5 inches (80.0 cm)
Length: 47.2 inches (120.0 cm)
Weight: 135 lbs (61.2 kg) (shipped on pallet)

In the Box

Bizon G9000 G2
1 x Rail kit
4 x power cords (USA)
User manual
Benchmark report

Part Number

bizon-g9000-0523

Diagram

All specifications are subject to change without notice. The entire materials provided herein are for reference only. Weight varies by configuration and manufacturing process. Advertised performance is based on maximum theoretical interface values from respective Chipset vendors or organization who defined the interface specification. Actual performance may vary by system configuration. Pictures shown for the options on the configuration page are generic and for reference only.

BIZON G9000 – 4x 8x NVIDIA A100, H100, H200 Tensor Core AI GPU Server with AMD EPYC, Intel Xeon

G9000 – AMD EPYC Platform G9000 – Intel Xeon Platform

G9000 – AMD EPYC Platform

G9000 – Intel Xeon Platform

Customers who bought this item also bought