BIZON ZX9000 – Water-cooled 8 GPU NVIDIA H100, H200, A100, A6000 RTX Deep Learning, AI, ML, Data science, LLM GPU Server – Up to 8 GPU, Dual AMD EPYC up to 384 cores

ZX9000

NVIDIA GPU water-cooled server for AI, ML, deep learning

The World's First

Up to 3x times lower noise vs. air cooled servers. 24/7/365 operation at max load. Powered by the latest AMD CPUs, NVIDIA Compute GPUs for data centers, and preinstalled AI software stack.

Estimated Ship Date: 3–7 Days

Starting at $30,388

Ask expert

System Core

Processor (AMD EPYC 9004, 9005)

AMD EPYC 9004
2x
16-Core 3.00 GHz AMD EPYC 9124+$0
2x
16-Core 4.10 GHz AMD EPYC 9174F+$4733
2x
24-Core 2.50 GHz AMD EPYC 9224+$2174
2x
24-Core 2.90 GHz AMD EPYC 9254+$2827
2x
24-Core 4.05 GHz AMD EPYC 9274F+$4977
2x
32-Core 2.70 GHz AMD EPYC 9334+$3652
2x
32-Core 3.25 GHz AMD EPYC 9354+$4029
2x
32-Core 3.85 GHz AMD EPYC 9374F+$6684
2x
48-Core 2.75 GHz AMD EPYC 9454+$4784
2x
48-Core 3.60 GHz AMD EPYC 9474F+$7744
2x
64-Core 2.45 GHz AMD EPYC 9534+$4009
2x
64-Core 3.10 GHz AMD EPYC 9554+$5228
2x
84-Core 2.25 GHz AMD EPYC 9634+$5016
2x
96-Core 2.40 GHz AMD EPYC 9654+$6527
2x
96-Core 2.55 GHz AMD EPYC 9684X+$11134
2x
112-Core 2.20 GHz AMD EPYC 9734+$6729
2x
128-Core 2.25 GHz AMD EPYC 9754+$9246
AMD EPYC 9005
2x
32-Core 3.00 GHz AMD EPYC 9335+$5152
2x
32-Core 3.80 GHz AMD EPYC 9375F+$11227
2x
48-Core 3.15 GHz AMD EPYC 9455+$10336
2x
48-Core 3.65 GHz AMD EPYC 9475F+$13252
2x
64-Core 3.20 GHz AMD EPYC 9555+$15682
2x
64-Core 3.30 GHz AMD EPYC 9575F+$20137
2x
96-Core 2.60 GHz AMD EPYC 9655+$21082
2x
128-Core 2.40 GHz AMD EPYC 9745+$20812
2x
128-Core 2.70 GHz AMD EPYC 9755+$22162
2x
160-Core 2.10 GHz AMD EPYC 9845+$25942
2x
192-Core 2.25 GHz AMD EPYC 9965+$32032

Cooling

What type of cooling to choose?

It depends on how many GPUs you need and the GPU model.

1x-2x NVIDIA RTX 40xx with no plans to add more in the future
Air-cooling will work perfectly fine. Water-cooling is optional.

1x-2x NVIDIA RTX 40xx with plans to add 1-2x more
Due to the risk of overheating and the dimensions of the 40-Series GPUs, you cannot fit more than 2x GPUs in an air-cooled workstation. This limitation applies to any air-cooled workstation from any supplier. Water-cooled workstations are the only option to fit up to 4x 40xx-Series GPUs.
You can customize a workstation with 2x GPUs and add two more in the future.

4x NVIDIA RTX 40xx
Water-cooling is mandatory.

1-4x NVIDIA Professional RTX (A5000, A6000)
Air cooling will work perfectly fine. Water cooling is optional. Important note: The most high-powered configurations, such as 4x NVIDIA A6000 and 4x A100, will be very noisy and hot. Water cooling is highly recommended.

Any NVIDIA A100, H100
Water cooling is mandatory when using GPUs in a workstation (low noise level; office or lab use).
Air cooling for these GPUs will work only in GPU servers (high noise level and a dedicated server room required).

What GPU to choose?

See benchmarks page here »

General information about water-cooling
Bizon liquid-cooled workstation computers can handle 24/7/365 workloads by design. The liquid cooling loop uses enterprise-class components. It provides 24/7 stability, low noise, low temperatures, and long life for components with 100% performance out of the GPUs. Liquid cooling keeps the temperatures within a safe range of 50C–60C vs. 85-90C when air-cooled. No overheating. No thermal throttling. No performance drops.

Multi-GPU air-cooled workstations with NVIDIA RTX 40xx, and A100 are extremely hot under a heavy load. When GPUs overheat, they activate thermal throttling mode (90C is the “red zone” where GPUs activate thermal throttling). Thermal throttling means that the fans can no longer dissipate heat sufficiently, so the graphics card starts to drop performance to protect itself from damage.
IMPORTANT: We have seen performance drops of up to 30-60% (!) due to overheating.

A water-cooled workstation is the only option if you are looking to support up to 4x NVIDIA RTX 40xx GPUs.

Learn More

BIZON Enterprise-class Custom Liquid-cooling System+$0

Memory

As a rule of thumb, for machine learning and AI, system RAM should be roughly 2x times the GPU VRAM.

If your GPU has 48 GB of VRAM, you would typically want at least 128 GB of system RAM.
If you have two GPUs with 24 GB VRAM each (48 GB VRAM total), you would typically want at least 128 GB of system RAM.

This ratio ensures that your CPU can effectively manage the data passed to the GPU without bottlenecks, especially for large datasets and deep learning tasks.

Learn More

4x
32 GB 5600 MHz DDR5 ECC/REG+$0
4x
64 GB 5600 MHz DDR5 ECC/REG+$1011
4x
96 GB 5600 MHz DDR5 ECC/REG+$2054
12x
128 GB 5600 MHz DDR5 ECC/REG+$17025

Operating System

You can choose multiple operating systems.

BIZON Z–Stack (includes Ubuntu 22.04 and latest deep learning frameworks)
Recommended for Deep Learning. Preinstalled with the Most Powerful Deep Learning Software (including Tensorflow, Torch/PyTorch, Keras, Caffe 2.0 Caffe-nv, Theano, CUDA and cuDNN). We provide BIZON Z-Stack Tool with a user-friendly interface for easy installation and future upgrades. If a new version of any framework is released, you can upgrade with a click of a button and avoid complicated command lines.

Learn More

Ubuntu 24.04 (includes BIZON OS and deep learning software stack; TensorFlow, PyTorch, CUDA, cuDNN, SLURM, etc)+$0
Windows 11 Pro (includes deep learning software stack)+$203
Windows 11 Pro+$203
Microsoft Windows Server 2022 Standard (24 Core license)+$1849
Rocky Linux 9+$0
No operating system+$0

Graphics

Graphics Card

What type of cooling to choose?

It depends on how many GPUs you need and the GPU model.

1x-2x NVIDIA RTX 40xx with no plans to add more in the future
Air-cooling will work perfectly fine. Water-cooling is optional.

1x-2x NVIDIA RTX 40xx with plans to add 1-2x more
Due to the risk of overheating and the dimensions of the 40-Series GPUs, you cannot fit more than 2x GPUs in an air-cooled workstation. This limitation applies to any air-cooled workstation from any supplier. Water-cooled workstations are the only option to fit up to 4x 40xx-Series GPUs.
You can customize a workstation with 2x GPUs and add two more in the future.

4x NVIDIA RTX 40xx
Water-cooling is mandatory.

1-4x NVIDIA Professional RTX (A5000, A6000)
Air cooling will work perfectly fine. Water cooling is optional. Important note: The most high-powered configurations, such as 4x NVIDIA A6000 and 4x A100, will be very noisy and hot. Water cooling is highly recommended.

Any NVIDIA A100, H100
Water cooling is mandatory when using GPUs in a workstation (low noise level; office or lab use).
Air cooling for these GPUs will work only in GPU servers (high noise level and a dedicated server room required).

Learn More

Not included
Dedicated Display Card
1x
NVIDIA A1000 8GB+$498
NVIDIA Professional RTX (Water-cooled)
2x
Liquid-cooled NVIDIA RTX A6000 48 GB+$15416
2x
Liquid-cooled NVIDIA RTX 6000 Ada 48 GB+$19298
Air-cooled 4–8 x NVIDIA RTX A6000 – See X7000 model [ –$15,000 ]
Blackwell
2x
Liquid-cooled NVIDIA RTX PRO 6000 Blackwell 96 GB+$28860
NVIDIA Compute (Water-cooled)
2x
Liquid-cooled NVIDIA A100 40 GB+$28512
2x
Liquid-cooled NVIDIA A100 80 GB+$55725
2x
Liquid-cooled NVIDIA H100 94 GB NVL+$79500
2x
Liquid-cooled NVIDIA H200 141 GB NVL+$95400
Air-cooled 4–8 x NVIDIA A100, H100 – See X7000 model [ –$15,000 ]

NVIDIA NVLink Bridge

Note: Only for NVIDIA A100, H100, H200, A6000.

NVLink is no longer supported on the NVIDIA RTX 40xx, and RTX6000 Ada GPUs. Replacing NVLink is the PCIe Gen 5 standard, which will be sufficiently fast to connect multiple GPUs together. NVLINK is available for RTX A100, H100, H200, A6000 GPUs only.

Learn More

Not included
1x
NVLink for 2 x NVIDIA RTX A5000, A6000+$199
1x
NVLink for 2 x NVIDIA A100, H100, H200+$597

Storage

SSD #1 (Operating System, Applications)

PCI-E 4.0 NVMe Solid State Drives (Up to 7000 Mb/s)
2 TB PCI-E 4.0 NVMe SSD+$0
4 TB PCI-E 4.0 NVMe SSD+$292
7.68 TB PCI-E 4.0 NVMe SSD+$1072
15.36 TB PCI-E 4.0 NVMe SSD+$2091
30.72 TB PCI-E 4.0 NVMe SSD+$4248
61.44 TB PCI-E 4.0 NVMe SSD+$9842
SATA Solid State Drives (Up to 550 Mb/s)
4 TB SATA SSD+$173
8 TB SATA SSD+$544

SSD #2

Not included
PCI-E 4.0 NVMe Solid State Drives (Up to 7000 Mb/s)
1x
1 TB PCI-E 4.0 NVMe SSD+$265
1x
2 TB PCI-E 4.0 NVMe SSD+$371
1x
4 TB PCI-E 4.0 NVMe SSD+$600
1x
7.68 TB PCI-E 4.0 NVMe SSD+$1380
1x
15.36 TB PCI-E 4.0 NVMe SSD+$2399
1x
30.72 TB PCI-E 4.0 NVMe SSD+$4556
1x
61.44 TB PCI-E 4.0 NVMe SSD+$10150
SATA Solid State Drives (Up to 550 Mb/s)
1x
1 TB SATA SSD+$145
1x
2 TB SATA SSD+$212
1x
4 TB SATA SSD+$465
1x
8 TB SATA SSD+$828

Additional SSD

Optional storage drive for footage, scratch files, media cache or project files. SSD for project files, scratch, & media cache.

Learn More

Not included
PCI-E 4.0 NVMe Solid State Drives (Up to 7000 Mb/s)
1x
15.36 TB PCI-E 4.0 NVMe SSD+$2399
1x
30.72 TB PCI-E 4.0 NVMe SSD+$4556
1x
61.44 TB PCI-E 4.0 NVMe SSD+$10150
SATA Solid State Drives (Up to 550 Mb/s)
1x
4 TB SATA SSD+$465
1x
8 TB SATA SSD+$828

RAID Controller

RAID controllers are generally optional when using SSDs since they already offer fast read/write speeds and are more reliable because they have no moving parts.

A RAID controller manages multiple hard drives and creates a redundant array of independent disks (RAID). It's needed when users require improved data redundancy, performance, or both by combining drives to protect against data loss.

Learn More

Not included
RAID controller for PCIe NVMe SSDs
4x port RAID NVMe SSD controller (Up to 4x NVMe SSDs; PCIe 3.0)+$839
4x port RAID NVMe SSD controller (Up to 4x NVMe SSDs; PCIe 4.0)+$1146
8x port RAID NVMe SSD controller (Up to 8x NVMe SSDs; PCIe 4.0)+$1999
RAID controller for SATA/SAS SSDs
8x port RAID SAS/SATA SSD controller (Up to 8x HDDs, 12Gb/s; 8 ports; PCIe 3.0)+$599

Adapters

Network

1x
10 Gigabit Dual Port Ethernet (2x RJ45) (integrated)+$0
1x
25 Gigabit Dual Port Ethernet (2x SFP28)+$233
1x
100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; 1x QSFP)+$1399
1x
200 Gbps Dual Port InfiniBand HDR (Mellanox ConnectX-6 VPI Adapter; 2x QSFP)+$2299
1x
400 Gbps Single Port InfiniBand NDR (Mellanox ConnectX-7 VPI Adapter; 1x OSFP)+$1999

Trusted Platform Module

Not included
Trusted Platform Module - TPM 2.0+$79

Peripherals

UPS System

* UPS system supplied by APC or Cyberpower. 120V. The model may vary depending on availability. Contact sales if you have a specific preference.

Learn More

Not included
Rackmountable UPS System 1500W 120V+$1299
Rackmountable UPS System 3000W 120V (2 x 1500W)+$2455

Service & Support

Warranty/Support

The "Life-time Expert Customer Care with 3 / 4 / 5 Year Limited Warranty" includes the following benefits:

Life-time access to our expert customer support team for all kinds of computer issues.

Three / four / five years (depending on the option you choose) of labor free warranty service (including labor costs for part replacements, and diagnostics).

One / two / three years (depending on the option you choose) of direct defective part replacement service directly from BIZON's inventory.

Learn More

Lifetime Expert Care with 3 Year Limited Warranty (3 Year Labor & 1 Year Part Replacement)+$0
Lifetime Expert Care with 4 Year Limited Warranty (4 Year Labor & 2 Year Part Replacement)+$3343
Lifetime Expert Care with 5 Year Limited Warranty (5 Year Labor & 3 Year Part Replacement)+$6685

$30,388

Financing

$30,388

In Stock

Download Quote EDU, GOV discounts B2B/reseller discounts Financing Available

Need help?

Contact our specialists and get help.

Ask a Question

Liquid-cooled 8x NVIDIA GPU Server for AI/ML, LLM, Deep Learning.
#1 world's fastest ranked server (luxmark benchmark).
Up to 3x times lower noise vs. air-cooling.
Enterprise-class custom liquid-cooling system.
Simple maintenance.
Integrated quick disconnect technology for easy GPU expandability.
Modular design.
Smart controller.
You can place the server in a lab or office.

Gen 2 (AMD EPYC 9004/9005) Gen 1 (AMD EPYC 7003) – Discontinued

Gen 2 (AMD EPYC 9004/9005)

Use cases

Artificial Intelligence
Big Data Analytics
High-performance Computing
Research Lab/National Lab
Astrophysics, Business Intelligence

Key Features

Supports up to 8 x Dual slot Gen5 GPUs
Dual AMD EPYC 9005/9004 Series Processors
12-Channel DDR5 RDIMM, 24 x DIMMs
Dual ROM Architecture
2 x 10Gb/s LAN ports via Intel X710-AT2
2 x M.2 slots with PCIe Gen3 x4 and x1 interface
8 x FHFL PCIe Gen5 x16 slots for GPUs
2 x FHFL PCIe Gen5 x16 slots
3+1 3000W (240V) 80 PLUS Titanium redundant power supply

Motherboard

Dual CPU server board.

AMD EPYC 9004/9005 series processors (Socket SP5).
System on Chip (SoC).

CPU

AMD EPYC 9004/9005 series processor family
Dual processors, 5nm
Up to 192-core, 384 threads per processor
cTDP up to 400W

Memory

Up to 6144 GB DDR5 4800 MHz ECC Buffered
24 x DIMM slots
DDR5 memory supported only
12-Channel memory per processor
RDIMM modules up to 128GB supported
3DS RDIMM modules up to 256GB supported

NOTE: actual RAM clock speed depends on the CPU specifications and may vary.

LAN

Front Side:

2 x 10Gb/s LAN ports (Intel X710-AT2)
1 x 10/100/1000 management LAN (Dedicated IPMI)
100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; QSFP56) (optional)

Video

Integrated in Aspeed AST2600
2D Video Graphic Adapter with PCIe bus interface
1920x1200@60Hz 32bpp, DDR4 SDRAM

Graphics Cards

Up to 8 Nvidia RTX graphics cards with NVLink support.

Available options:

Nvidia RTX T1000 8Gb (4 DP)

Nvidia RTX A6000 48Gb (4 DP)
Nvidia RTX 6000 Ada 48Gb (4 DP)

Nvidia A100 40Gb (no video outputs)
Nvidia A100 80Gb (no video outputs)
Nvidia H100 94Gb NVL (no video outputs)
Nvidia H200 141Gb NVL (no video outputs)

Display Support (all cards):
Maximum Digital Resolution: 7680x4320 @60Hz
Multi Monitor Support: 4

Audio

N/A

Storage

Internal M.2:

1 x M.2 (2280/22110), PCIe Gen3 x4, from CPU_1
1 x M.2 (2280/22110), PCIe Gen3 x1, from CPU_0

SAS

N/A

RAID

N/A

Peripheral Drives

N/A

Expansion Slots

4 x FHFL x16 (Gen5 x16), from CPU_0, for GPUs
4 x FHFL x16 (Gen5 x16), from CPU_1, for GPUs
1 x FHFL x16 (Gen5 x16), from CPU_0
1 x FHFL x16 (Gen5 x16), from CPU_1

Front I/O

2 x USB 3.2 Gen1 (Type-A)
1 x VGA
2 x RJ45
1 x MLAN
1 x Power button with LED
1 x ID button with LED
1 x Reset button
1 x NMI button
1 x System activity LED
1 x Storage activity LED

Rear I/O

N/A

Backplane I/O

N/A

Security Modules

1 x TPM header with SPI interface

Power Supply

3+1 3000W (240V) 80 PLUS Titanium redundant power supply

100-127V~/ 14.5A, 50-60Hz
200-220V~/ 16A, 50-60Hz
220-240V~/ 16A, 50-60Hz

240Vdc/ 16A

Max 1097.4W/ 100-127V~
+12.2V/ 87A
+12Vsb/ 3A
Max 2598W/ 200-220V
+12.2V/ 210A
+12Vsb/ 3A
Max 3037.2W/ 220-240V
+12.2V/ 246A
+12Vsb/ 3A

NOTE: ZX9000 comes with 4 x 3000W Redundant (3+1) power supplies. Total 4 power supplies (3 main + 1 backup).
That means that maximum output power is 9000W (3 x 3000W) with 3000W (1 x 3000W) for backup power supplies.
If one power supplies will fail, the other backup power supply starts running to keep the computer powered up.
The switch between the power supplies is seamless, so as not to interrupt the normal use of the computer.

NOTE: The system power supply requires C19 type power cord

Power Requirements

Power consumption examples:
1. ZX9000 with 8 x NVIDIA RTX A6000 + 2 x AMD EPYC 7252 CPUs = 2600W-2800W (100% load for all the GPUs and the CPUs at the same time).
BTUs (per hour): 8871 @ 2600W

2. ZX9000 with 8 x NVIDIA RTX 6000 Ada + 2 x AMD EPYC 7282 CPUs = 3000W-3400W (100% load for all the GPUs and the CPUs at the same time).
BTUs (per hour): 10200 @ 3000W

100-120V (standard US outlet):
If you have a standard 20 A / 120V (2400Watts max) US outlet, you can connect two power supplies to one dedicated power circuit (each outlet should have its dedicated circuit). You need four (4) 20 A /120V outlets with a dedicated circuit.

Actual power consumption is not the same as maximum power supply power. Power supply power means how many watts you can get from the power supply, and your actual power consumption should not be higher than max power supply power. Actual power consumption depends on your configuration (graphics card and CPUs).

Information for reference only. Consult your electrician for more details.

System Management

BizonOS and BizonOS Control Panel.
BizonOS includes a user-friendly, web-based control panel with everything one needs, all organized into one convenient location.

BizonOS features:

Remote access from anywhere (SSH/VNC)
Virtual machines
GPU sharing
Containers
One-click software updates
Jupyter notebooks
GPU/System monitoring
accounts, and permissions

Aspeed AST2600 management controller
Dashboard
HTML5 KVM
Sensor Monitor (Voltage, RPM, Temperature, CPU Status …etc.)
Sensor Reading History Data
FRU Information
SEL Log in Linear Storage / Circular Storage Policy
Hardware Inventory
Fan Profile
System Firewall
Power Consumption
Power Control
LDAP / AD / RADIUS Support
Backup & Restore Configuration
Remote BIOS/BMC/CPLD Update
Event Log Filter
User Management
Media Redirection Settings
PAM Order Settings
SSL Settings
SMTP Settings

OS Compatibility

BIZON Z–Stack (Ubuntu 22.04 with preinstalled deep learning frameworks).
Rocky Linux 9 (optional).
Windows 11 Pro (optional).
Microsoft Windows Server 2022 Standard (optional).

Windows Server 2022
Red Hat Enterprise Linux 8.6 ( x64) or later
SUSE Linux Enterprise Server 15 SP4 or later
Ubuntu 20.04.5 LTS (x64) or later
Ubuntu 22.04 LTS (x64) or later
Ubuntu 22.04.1 LTS (x64) or later
VMware ESXi 7.0 Update 3i later
VMware ESXi 8.0 Update1 or later
Citrix Hypervisor 8.2.1 or later

Cooling System

Enterprise-class Custom Liquid-cooling System
The system includes a server and external cooling unit for advanced reliability, modularity, and the best cooling performance.

Fully self-contained (does not require external water supply line or chiller)
8 x water-cooled GPUs
8 x port manifold with quick disconnect technology
NOTE: The design of each BIZON workstation integrates quick-disconnect technology for easy GPU expandability. This technology allows you to disconnect existing GPUs or add new GPUs without shipping the system back. Connecting/disconnecting a GPU is similar to plugging in a cable. No spills, no leaks. Fast, easy, and safe.
External Cooling unit (radiator, pump, reservoir)

NOTE: Cooling loop design may vary from the pictures shown on the product page, but will be of equal or better specs than what's specified above.

Operating Properties

Operating temperature: 50° to 95° F (10° to 35° C)
Operating humidity: 8%-80% (non-condensing)
Non-operating temperature: -40° to 140° F (-40°C to 60°C)
Non-operating humidity: 20%-95% (non-condensing)

Noise level and temperature

Idle noise level: up to 54 dB
Idle temperature (GPUs): Average 33 C / 91.4 F (min 31C - max 36C)
Max load noise level (stress test): up to 56 dB
Max load temperature (GPUs): Average 59 C / 138.2 F (min 54C - max 65C)

8 x NVIDIA A6000. Noise level measured from 6 ft / 1.8 m distance. Environment: 24 C / 75 F, 45% humidity, 38 dB. Noise meter directed to the front panel of the server. Temps measured after 30 min test. 240V power source. Luxmark 3.0. Ubuntu 22.04.

Dimensions & Weight

Chassis (server)

Rackmountable; 4U; horizontal placement
Height: 6.9 inches (17.6 cm)
Width: 17.6 inches (44.8 cm)
Depth: 34.6 inches (88.0 cm)
Weight (8 GPU; with coolant): 131.4 lbs (59.6 kg)

Cooling Unit

Rackmountable; 3U; vertical placement
Height: 4.1 inches (10.3 cm)
Width: 17.3 inches (44.9 cm)
Depth: 24.4 inches (62.0 cm)
Weight (with coolant): 27 lbs (12.24 kg)

Shipping Package 1 (server)

Height: 17.3 inches (44.4 cm)
Width: 31.5 inches (80.0 cm)
Length: 47.2 inches (120.0 cm)
Weight: 145.5 lbs (66.5 kg)

Shipping Package 2 (cooling unit)

Height: 11 inches (27.94 cm)
Width: 22 inches (55.88 cm)
Length: 29 inches (73.7 cm)
Weight: 30 lbs (13.6 kg)

Shipped in two boxes on the pallet.

In the Box

Bizon ZX9000
1 x Rail kit
4 x power cords (USA)
User manual
Benchmark report

Part Number

bizon-zx9000-0423

Gen 1 (AMD EPYC 7003) – Discontinued

Use cases

Artificial Intelligence
Big Data Analytics
High-performance Computing
Research Lab/National Lab
Astrophysics, Business Intelligence

Key Features

Up to 10 x PCIe GPGPU cards
AMD EPYC 7003 processors with AMD 3D V-Cache Technology
AMD EPYC 7003 series processor family
8-Channel RDIMM/LRDIMM DDR4 per processor, 32 x DIMMs
2 x 10Gb/s BASE-T LAN ports (Intel X550-AT2)
1 x dedicated management port
8 x 3.5" NVMe/SATA, 4 x SATA/SAS 3.5" hot-swappable HDD/SSD bays
10 x FHFL Gen4 expansion slots for GPU cards
3 x low profile PCIe Gen4 expansion slots
1 x OCP 3.0 Gen4 x16 mezzanine slot on rear side
3 x 80 PLUS Platinum 2200W (240V) redundant PSU

Motherboard

Dual CPU server board.

AMD EPYC 7003/7002 series processors (Socket SP3).
System on Chip (SoC).

CPU

AMD EPYC 7003 processors with AMD 3D V-Cache Technology
AMD EPYC 7003/7002 series processor family
Dual processors, 7nm
Up to 64-core, 128 threads per processor
cTDP up to 280W

Memory

Up to 8192 GB DDR4 3200 MHz ECC Buffered
32 x DIMM slots
DDR4 memory supported only
8-Channel memory per processor architecture
RDIMM modules up to 128GB supported
3DS RDIMM modules up to 256GB supported

NOTE: actual RAM clock speed depends on the CPU specifications and may vary.

LAN

Front Side:

2 x 10Gb/s BASE-T LAN ports (Intel X550-AT2)
1 x 10/100/1000 management LAN (Dedicated IPMI)
100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; QSFP56) (optional)

Video

Integrated in Aspeed AST2500
2D Video Graphic Adapter with PCIe bus interface
1920x1200@60Hz 32bpp, DDR4 SDRAM

Graphics Cards

Up to 8 Nvidia RTX graphics cards with NVLink support.

Available options:

Nvidia RTX A6000 48Gb (4 DP)
Nvidia RTX 6000 Ada 48Gb (4 DP)

Nvidia A100 80Gb (no video outputs)
Nvidia H100 80Gb (no video outputs)

Nvidia RTX T1000 8Gb (4 DP)

Display Support (all cards):
Maximum Digital Resolution: 7680x4320 @60Hz
Multi Monitor Support: 4

Audio

N/A

Storage

12 x 3.5" hot-swappable HDD/SSD bays:
- 8 x amber HDD trays compatible with NVMe or SATA/SAS devices
- 4 x blue HDD trays compatible with SATA/SAS devices only

SAS

Supported

RAID

Optional

Peripheral Drives

N/A

Expansion Slots

10 x PCIe x16 slots (Gen4 x16 bus) for GPUs
2 x PCIe x16 (Gen4 x16 bus) Half-length low-profile slots on front side
1 x PCIe x16 (Gen4 x16 bus) Half-length low-profile slot on rear side
1 x OCP 3.0 mezzanine slot with PCIe Gen4 x16 on rear side

Internal I/O

1 x TPM header
1 x Front panel header

Front I/O

2 x USB 3.0
1 x VGA
2 x RJ45
1 x MLAN
1 x Power button with LED
1 x ID button with LED
1 x Reset button
1 x NMI button
1 x System status LED
1 x HDD access LED

Rear I/O

N/A

Backplane I/O

12 x 3.5" ports
Speed and bandwidth: PCIe Gen3 or SAS 12Gb/s or SATA 6Gb/s

TPM

1 x TPM header with SPI interface

Power Supply

3 x 2200W 80 PLUS Platinum redundant PSUs

100-127V~/ 14A, 47-63Hz
200-240V~/ 12.6A, 47-63Hz

240Vdc/ 12.6A

Max 1200W/ 100-127V~
+12.12V/ 95.6A
+12Vsb/ 3.5A
Max 2200W/ 200-240V
+12.12V/ 178.1A
+12Vsb/ 3.5A

NOTE: ZX9000 comes with 3 x 2200W Redundant (2+1) power supplies. Total 3 power supplies (2 main + 1 backup).
That means that maximum output power is 4400W (2 x 2200W) with 2200W (1 x 2200W) for backup power supplies.
If one power supplies will fail, the other backup power supply starts running to keep the computer powered up.
The switch between the power supplies is seamless, so as not to interrupt the normal use of the computer.

NOTE: The system power supply requires C19 type power cord

Power Requirements

Power consumption examples:
1. ZX9000 with 8 x NVIDIA RTX 2080 Ti + 2 x AMD EPYC 7252 CPUs = 2400W-2600W (100% load for all the GPUs and the CPUs at the same time).
BTUs (per hour): 8188.8

2. ZX9000 with 8 x NVIDIA TITAN RTX + 2 x AMD EPYC 7402 CPUs = 2600W-2800W (100% load for all the GPUs and the CPUs at the same time).
BTUs (per hour): 9212.4

100-120V (standard US outlet):
If you have a standard 20 A / 120V (2400Watts max) US outlet, you can connect two power supplies to one dedicated power circuit (each outlet should have its dedicated circuit). In total, you need two (2) 20 A /120V outlets with a dedicated circuit. This is true for the configurations 1 and 2 mentioned above.

Actual power consumption is not the same as maximum power supply power. Power supply power means how much watts you can get from the power supply and your actual power consumption should not be higher than max power supply power. Actual power consumption depends on your configuration (graphics card and CPU).

Information for reference only. Consult your electrician for more details.

System Management

BizonOS and BizonOS Control Panel.
BizonOS includes a user-friendly, web-based control panel with everything one needs, all organized into one convenient location.

BizonOS features:

Remote access from anywhere (SSH/VNC)
Virtual machines
GPU sharing
Containers
One-click software updates
Jupyter notebooks
GPU/System monitoring
accounts, and permissions

Aspeed AST2500 management controller
Dashboard
HTML5 KVM
Sensor Monitor (Voltage, RPM, Temperature, CPU Status …etc.)
Sensor Reading History Data
FRU Information
SEL Log in Linear Storage / Circular Storage Policy
Hardware Inventory
Fan Profile
System Firewall
Power Consumption
Power Control
LDAP / AD / RADIUS Support
Backup & Restore Configuration
Remote BIOS/BMC/CPLD Update
Event Log Filter
User Management
Media Redirection Settings
PAM Order Settings
SSL Settings
SMTP Settings

OS Compatibility

BIZON Z–Stack (Ubuntu 22.04 with preinstalled deep learning frameworks).
CentOS (optional).
Windows 11 Pro (optional).
Windows 10 Pro (optional).
Microsoft Windows Server 2022 Standard (optional).

Windows Server 2016 (X2APIC/256T not supported)
Windows Server 2019
Windows Server 2022
Red Hat Enterprise Linux 8.3 (x64) or later
Red Hat Enterprise Linux 9.0 (x64) or later
SUSE Linux Enterprise Server 12 SP5 (x64) or later
SUSE Linux Enterprise Server 15 SP2 (x64) or later
Ubuntu 18.04.5 LTS (x64) or later
Ubuntu 20.04 LTS (x64) or later
Ubuntu 22.04 LTS (x64) or later
VMware ESXi 6.7 Update3 P03 or later
VMware ESXi 7.0 Update1 or later
VMware ESXi 8.0 or later
Citrix Hypervisor 8.2.0 or later

Cooling System

Enterprise-class Custom Liquid-cooling System
The system includes a server and external cooling unit for advanced reliability, modularity, and the best cooling performance.

Fully self-contained (does not require external water supply line or chiller)
8 x water-cooled GPUs
8 x port manifold with quick disconnect technology
NOTE: The design of each BIZON workstation integrates quick-disconnect technology for easy GPU expandability. This technology allows you to disconnect existing GPUs or add new GPUs without shipping the system back. Connecting/disconnecting a GPU is similar to plugging in a cable. No spills, no leaks. Fast, easy, and safe.
External Cooling unit (radiator, pump, reservoir)

NOTE: Cooling loop design may vary from the pictures shown on the product page, but will be of equal or better specs than what's specified above.

Operating Properties

Operating temperature: 50° to 95° F (10° to 35° C)
Operating humidity: 8%-80% (non-condensing)
Non-operating temperature: -40° to 140° F (-40°C to 60°C)
Non-operating humidity: 20%-95% (non-condensing)

Noise level and temperature

Idle noise level: up to 54 dB
Idle temperature (GPUs): Average 33 C / 91.4 F (min 31C - max 36C)
Max load noise level (stress test): up to 59 dB
Max load temperature (GPUs): Average 59 C / 138.2 F (min 54C - max 65C)

8 x NVIDIA TITAN RTX. Noise level measured from 6 ft / 1.8 m distance. Environment: 24 C / 75 F, 38 dB. Noise meter directed to the front panel of the server. Temps measured after 30 min test. 120V power source. Luxmark 3.0. Ubuntu 18.04. Drivers 418. CUDA 10.0

Dimensions & Weight

Chassis (server)

Rackmountable; 4U; horizontal placement
Height: 6.9 inches (17.6 cm)
Width: 17.6 inches (44.8 cm)
Depth: 34.6 inches (88.0 cm)
Weight (8 GPU; with coolant): 131.4 lbs (59.6 kg)

Cooling Unit

Rackmountable; 3U; vertical placement
Height: 4.1 inches (10.3 cm)
Width: 17.3 inches (44.9 cm)
Depth: 24.4 inches (62.0 cm)
Weight (with coolant): 27 lbs (12.24 kg)

Shipping Package 1 (server)

Height: 24.0 inches (60.9 cm)
Width: 23.8 inches (60.6 cm)
Length: 44 inches (111.9 cm)
Weight: 145.5 lbs (66.5 kg)

Shipping Package 2 (cooling unit)

Height: 11 inches (27.94 cm)
Width: 22 inches (55.88 cm)
Length: 29 inches (73.7 cm)
Weight: 30 lbs (13.6 kg)

Shipped in two boxes on the pallet.

In the Box

Bizon ZX9000.
1 x Rail kit
4 x power cords (USA).
User manual.
Benchmark report.

Part Number

bizon-zx9000-0820

All specifications are subject to change without notice. The entire materials provided herein are for reference only. Weight varies by configuration and manufacturing process. Advertised performance is based on maximum theoretical interface values from respective Chipset vendors or organization who defined the interface specification. Actual performance may vary by system configuration. Pictures shown for the options on the configuration page are generic and for reference only.

BIZON ZX9000 – Water-cooled 8 GPU NVIDIA H100, H200, A100, A6000 RTX Deep Learning, AI, ML, Data science, LLM GPU Server – Up to 8 GPU, Dual AMD EPYC up to 384 cores

Gen 2 (AMD EPYC 9004/9005) Gen 1 (AMD EPYC 7003) – Discontinued

Gen 2 (AMD EPYC 9004/9005)

Gen 1 (AMD EPYC 7003) – Discontinued

Customers who bought this item also bought