BIZON ZX9000 – Water-cooled 8 GPU NVIDIA H100, A100, A6000 RTX Deep Learning, AI, ML, Data science, LLM GPU Server – Up to 8 GPU, Dual AMD EPYC up to 256 cores

• Artificial Intelligence
• Big Data Analytics
• High-performance Computing
• Research Lab/National Lab
• Astrophysics, Business Intelligence

• Supports up to 10 x double slot Gen5 GPU cards
• AMD EPYC 9004 series processor family
• Dual processor, 5nm technology
• 12-Channel RDIMM DDR5, 48 x DIMMs
• Dual ROM Architecture supported
• 2 x 1Gb/s BASE-T LAN ports (Intel I350-AM2)
• 1 x dedicated management port
• 8 x 2.5" Gen5 NVMe/SATA hot-swappable bays
• 4 x 2.5" SATA hot-swappable bays
• 2 x Ultra-Fast M.2 with PCIe Gen3 interface
• 2 x LP PCIe Gen5 x16 MD2 expansion slots on front side
• 3+1 3000W (240V) 80 PLUS Titanium redundant power supply

Dual CPU server board.

• AMD EPYC 9004 series processors (Socket SP5).
• System on Chip (SoC).

• AMD EPYC 9004 series processor family
• Dual processors, 5nm
• Up to 96-core, 192 threads per processor
• cTDP up to 400W

• Up to 6144 GB DDR5 4800 MHz ECC Buffered
• 48 x DIMM slots
• DDR5 memory supported only
• 12-Channel memory per processor architecture
• RDIMM modules up to 128GB supported
• 3DS RDIMM modules up to 256GB supported

NOTE: actual RAM clock speed depends on the CPU specifications and may vary.

Front Side:

• 2 x 1Gb/s BASE-T LAN ports (Intel I350-AM2)
• 1 x 10/100/1000 management LAN (Dedicated IPMI)
• 100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; QSFP56) (optional)

• Integrated in Aspeed AST2600
• 2D Video Graphic Adapter with PCIe bus interface
• 1920x1200@60Hz 32bpp, DDR4 SDRAM

Up to 8 Nvidia RTX graphics cards with NVLink support.

Available options:

• Nvidia RTX A6000 48Gb (4 DP)
• Nvidia RTX 6000 Ada 48Gb (4 DP)


• Nvidia A100 80Gb (no video outputs)
• Nvidia H100 80Gb (no video outputs)


• Nvidia RTX T1000 8Gb (4 DP)

Display Support (all cards):
Maximum Digital Resolution: 7680x4320 @60Hz
Multi Monitor Support: 4

N/A

• 8 x 2.5" Gen5 NVMe/SATA/SAS hot-swappable bays
  - 2 x from CPU_0, 2 x from CPU_1, 2 x from PEX_0, 2 x from PEX_1
• 4 x 2.5" SATA/SAS hot-swappable bays

Depends on SAS Add-on card

N/A

N/A

• 10 x FHFL PCIe x16 slots (Gen5 x16 bus) for GPUs
  - 5 x from PEX_0, 5 x from PEX_1
• 2 x Low profile PCIe Gen5 x16 MD2 expansion slots on front side
  - 1 x from CPU_0, 1 x from CPU_1
• 2 x M.2 slots:
  - M-key
  - PCIe Gen3 x4 from CPU_0
  - PCIe Gen3 x4 from CPU_1
  - Supports 2280/22110 cards

• 1 x TPM header

• 2 x USB 3.2 Gen1
• 1 x VGA
• 2 x RJ45
• 1 x MLAN
• 1 x Power button with LED
• 1 x ID button with LED
• 1 x Reset button
• 1 x NMI button
• 1 x System status LED
• 1 x HDD access LED

N/A

• Speed and bandwidth: PCIe Gen5 x4 or SATA 6Gb/s or SAS 12Gb/s

1 x TPM header with SPI interface

• 3+1 3000W (240V) 80 PLUS Titanium redundant power supply

AC Input:

• 100-127V~/ 15.5A, 50-60Hz
• 200-220V~/ 15.5A, 50-60Hz
• 220-240V~/ 15.5A, 50-60Hz

DC Input:

• 240Vdc/ 15.5A

DC Output:

• Max 1000W/ 100-127V~
• +12.2V/ 81A
• +12Vsb/ 3A
• Max 2600W/ 200-220V
• +12.2V/ 213A
• +12Vsb/ 3A
• Max 2200W/ 220-240V
• +12.2V/ 240A
• +12Vsb/ 3A

NOTE: ZX9000 comes with 4 x 3000W Redundant (3+1) power supplies. Total 4 power supplies (3 main + 1 backup).
That means that maximum output power is 9000W (3 x 3000W) with 3000W (1 x 3000W) for backup power supplies.
If one power supplies will fail, the other backup power supply starts running to keep the computer powered up.
The switch between the power supplies is seamless, so as not to interrupt the normal use of the computer.

NOTE: The system power supply requires C19 type power cord

Power consumption examples:
1. ZX9000 with 8 x NVIDIA A6000 + 2 x AMD EPYC 7252 CPUs = 2600W-2800W (100% load for all the GPUs and the CPUs at the same time).
BTUs (per hour): 8871 @ 2600W

2. ZX9000 with 8 x NVIDIA Quadro RTX 3090 + 2 x AMD EPYC 7282 CPUs = 3000W-3400W (100% load for all the GPUs and the CPUs at the same time).
BTUs (per hour): 10200 @ 3000W

100-120V (standard US outlet):
If you have a standard 20 A / 120V (2400Watts max) US outlet, you can connect two power supplies to one dedicated power circuit (each outlet should have its dedicated circuit). You need four (4) 20 A /120V outlets with a dedicated circuit.

Actual power consumption is not the same as maximum power supply power. Power supply power means how many watts you can get from the power supply, and your actual power consumption should not be higher than max power supply power. Actual power consumption depends on your configuration (graphics card and CPUs).

Information for reference only. Consult your electrician for more details.

BizonOS and BizonOS Control Panel.
BizonOS includes a user-friendly, web-based control panel with everything one needs, all organized into one convenient location.

BizonOS features:

• Remote access from anywhere (SSH/VNC)
• Virtual machines
• GPU sharing
• Containers
• One-click software updates
• Jupyter notebooks
• GPU/System monitoring
• accounts, and permissions

• Aspeed AST2600 management controller
• Dashboard
• HTML5 KVM
• Sensor Monitor (Voltage, RPM, Temperature, CPU Status …etc.)
• Sensor Reading History Data
• FRU Information
• SEL Log in Linear Storage / Circular Storage Policy
• Hardware Inventory
• Fan Profile
• System Firewall
• Power Consumption
• Power Control
• LDAP / AD / RADIUS Support
• Backup & Restore Configuration
• Remote BIOS/BMC/CPLD Update
• Event Log Filter
• User Management
• Media Redirection Settings
• PAM Order Settings
• SSL Settings
• SMTP Settings

• BIZON Z–Stack (Ubuntu 20.04 with preinstalled deep learning frameworks).
• Rocky Linux 9 (optional).
• Windows 11 Pro (optional).
• Windows 10 Pro (optional).
• Microsoft Windows Server 2022 Standard (optional).


• Windows Server 2022
• Red Hat Enterprise Linux 8.6 ( x64) or later
• SUSE Linux Enterprise Server 15 SP4 or later
• Ubuntu 20.04.5 LTS (x64) or later
• Ubuntu 22.04 LTS (x64) or later
• Ubuntu 22.04.1 LTS (x64) or later
• VMware ESXi 7.0 Update 3i later
• VMware ESXi 8.0 Update1 or later
• Citrix Hypervisor 8.2.1 or later

Enterprise-class Custom Liquid-cooling System
The system includes a server and external cooling unit for advanced reliability, modularity, and the best cooling performance.

• Fully self-contained (does not require external water supply line or chiller)
• 8 x water-cooled GPUs
• 8 x port manifold with quick disconnect technology
  NOTE: The design of each BIZON workstation integrates quick-disconnect technology for easy GPU expandability. This technology allows you to disconnect existing GPUs or add new GPUs without shipping the system back. Connecting/disconnecting a GPU is similar to plugging in a cable. No spills, no leaks. Fast, easy, and safe.
• External Cooling unit (radiator, pump, reservoir)

NOTE: Cooling loop design may vary from the pictures shown on the product page, but will be of equal or better specs than what's specified above.

• Operating temperature: 50° to 95° F (10° to 35° C)
• Operating humidity: 8%-80% (non-condensing)
• Non-operating temperature: -40° to 140° F (-40°C to 60°C)
• Non-operating humidity: 20%-95% (non-condensing)

• Idle noise level: up to 54 dB
• Idle temperature (GPUs): Average 33 C / 91.4 F (min 31C - max 36C)
• Max load noise level (stress test): up to 56 dB
• Max load temperature (GPUs): Average 59 C / 138.2 F (min 54C - max 65C)

8 x NVIDIA A6000. Noise level measured from 6 ft / 1.8 m distance. Environment: 24 C / 75 F, 45% humidity, 38 dB. Noise meter directed to the front panel of the server. Temps measured after 30 min test. 240V power source. Luxmark 3.0. Ubuntu 20.04.

Chassis (server)

• Rackmountable; 4U; horizontal placement
• Height: 6.9 inches (17.6 cm)
• Width: 17.6 inches (44.8 cm)
• Depth: 34.6 inches (88.0 cm)
• Weight (8 GPU; with coolant): 131.4 lbs (59.6 kg)

Cooling Unit

• Rackmountable; 3U; vertical placement
• Height: 4.1 inches (10.3 cm)
• Width: 17.3 inches (44.9 cm)
• Depth: 24.4 inches (62.0 cm)
• Weight (with coolant): 27 lbs (12.24 kg)

Shipping Package 1 (server)

• Height: 17.3 inches (44.4 cm)
• Width: 31.5 inches (80.0 cm)
• Length: 47.2 inches (120.0 cm)
• Weight: 145.5 lbs (66.5 kg)

Shipping Package 2 (cooling unit)

• Height: 11 inches (27.94 cm)
• Width: 22 inches (55.88 cm)
• Length: 29 inches (73.7 cm)
• Weight: 30 lbs (13.6 kg)

Shipped in two boxes on the pallet.

• Bizon ZX9000
• 1 x Rail kit
• 4 x power cords (USA)
• User manual
• Benchmark report

bizon-zx9000-0423

• Artificial Intelligence
• Big Data Analytics
• High-performance Computing
• Research Lab/National Lab
• Astrophysics, Business Intelligence

• Up to 10 x PCIe GPGPU cards
• AMD EPYC 7003 processors with AMD 3D V-Cache Technology
• AMD EPYC 7003 series processor family
• 8-Channel RDIMM/LRDIMM DDR4 per processor, 32 x DIMMs
• 2 x 10Gb/s BASE-T LAN ports (Intel X550-AT2)
• 1 x dedicated management port
• 8 x 3.5" NVMe/SATA, 4 x SATA/SAS 3.5" hot-swappable HDD/SSD bays
• 10 x FHFL Gen4 expansion slots for GPU cards
• 3 x low profile PCIe Gen4 expansion slots
• 1 x OCP 3.0 Gen4 x16 mezzanine slot on rear side
• 3 x 80 PLUS Platinum 2200W (240V) redundant PSU

Dual CPU server board.

• AMD EPYC 7003/7002 series processors (Socket SP3).
• System on Chip (SoC).

• AMD EPYC 7003 processors with AMD 3D V-Cache Technology
• AMD EPYC 7003/7002 series processor family
• Dual processors, 7nm
• Up to 64-core, 128 threads per processor
• cTDP up to 280W

• Up to 8192 GB DDR4 3200 MHz ECC Buffered
• 32 x DIMM slots
• DDR4 memory supported only
• 8-Channel memory per processor architecture
• RDIMM modules up to 128GB supported
• 3DS RDIMM modules up to 256GB supported

NOTE: actual RAM clock speed depends on the CPU specifications and may vary.

Front Side:

• 2 x 10Gb/s BASE-T LAN ports (Intel X550-AT2)
• 1 x 10/100/1000 management LAN (Dedicated IPMI)
• 100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; QSFP56) (optional)

• Integrated in Aspeed AST2500
• 2D Video Graphic Adapter with PCIe bus interface
• 1920x1200@60Hz 32bpp, DDR4 SDRAM

Up to 8 Nvidia RTX graphics cards with NVLink support.

Available options:

• Nvidia RTX A6000 48Gb (4 DP)
• Nvidia RTX 6000 Ada 48Gb (4 DP)


• Nvidia A100 80Gb (no video outputs)
• Nvidia H100 80Gb (no video outputs)


• Nvidia RTX T1000 8Gb (4 DP)

Display Support (all cards):
Maximum Digital Resolution: 7680x4320 @60Hz
Multi Monitor Support: 4

N/A

• 12 x 3.5" hot-swappable HDD/SSD bays:
  - 8 x amber HDD trays compatible with NVMe or SATA/SAS devices
  - 4 x blue HDD trays compatible with SATA/SAS devices only

Supported

Optional

N/A

• 10 x PCIe x16 slots (Gen4 x16 bus) for GPUs
• 2 x PCIe x16 (Gen4 x16 bus) Half-length low-profile slots on front side
• 1 x PCIe x16 (Gen4 x16 bus) Half-length low-profile slot on rear side
• 1 x OCP 3.0 mezzanine slot with PCIe Gen4 x16 on rear side

• 1 x TPM header
• 1 x Front panel header

• 2 x USB 3.0
• 1 x VGA
• 2 x RJ45
• 1 x MLAN
• 1 x Power button with LED
• 1 x ID button with LED
• 1 x Reset button
• 1 x NMI button
• 1 x System status LED
• 1 x HDD access LED

N/A

• 12 x 3.5" ports
• Speed and bandwidth: PCIe Gen3 or SAS 12Gb/s or SATA 6Gb/s

1 x TPM header with SPI interface

• 3 x 2200W 80 PLUS Platinum redundant PSUs

AC Input:

• 100-127V~/ 14A, 47-63Hz
• 200-240V~/ 12.6A, 47-63Hz

DC Input:

• 240Vdc/ 12.6A

DC Output:

• Max 1200W/ 100-127V~
• +12.12V/ 95.6A
• +12Vsb/ 3.5A
• Max 2200W/ 200-240V
• +12.12V/ 178.1A
• +12Vsb/ 3.5A

NOTE: ZX9000 comes with 3 x 2200W Redundant (2+1) power supplies. Total 3 power supplies (2 main + 1 backup).
That means that maximum output power is 4400W (2 x 2200W) with 2200W (1 x 2200W) for backup power supplies.
If one power supplies will fail, the other backup power supply starts running to keep the computer powered up.
The switch between the power supplies is seamless, so as not to interrupt the normal use of the computer.

NOTE: The system power supply requires C19 type power cord

Power consumption examples:
1. ZX9000 with 8 x NVIDIA RTX 2080 Ti + 2 x AMD EPYC 7252 CPUs = 2400W-2600W (100% load for all the GPUs and the CPUs at the same time).
BTUs (per hour): 8188.8

2. ZX9000 with 8 x NVIDIA TITAN RTX + 2 x AMD EPYC 7402 CPUs = 2600W-2800W (100% load for all the GPUs and the CPUs at the same time).
BTUs (per hour): 9212.4

100-120V (standard US outlet):
If you have a standard 20 A / 120V (2400Watts max) US outlet, you can connect two power supplies to one dedicated power circuit (each outlet should have its dedicated circuit). In total, you need two (2) 20 A /120V outlets with a dedicated circuit. This is true for the configurations 1 and 2 mentioned above.

Actual power consumption is not the same as maximum power supply power. Power supply power means how much watts you can get from the power supply and your actual power consumption should not be higher than max power supply power. Actual power consumption depends on your configuration (graphics card and CPU).

Information for reference only. Consult your electrician for more details.

BizonOS and BizonOS Control Panel.
BizonOS includes a user-friendly, web-based control panel with everything one needs, all organized into one convenient location.

BizonOS features:

• Remote access from anywhere (SSH/VNC)
• Virtual machines
• GPU sharing
• Containers
• One-click software updates
• Jupyter notebooks
• GPU/System monitoring
• accounts, and permissions

• Aspeed AST2500 management controller
• Dashboard
• HTML5 KVM
• Sensor Monitor (Voltage, RPM, Temperature, CPU Status …etc.)
• Sensor Reading History Data
• FRU Information
• SEL Log in Linear Storage / Circular Storage Policy
• Hardware Inventory
• Fan Profile
• System Firewall
• Power Consumption
• Power Control
• LDAP / AD / RADIUS Support
• Backup & Restore Configuration
• Remote BIOS/BMC/CPLD Update
• Event Log Filter
• User Management
• Media Redirection Settings
• PAM Order Settings
• SSL Settings
• SMTP Settings

• BIZON Z–Stack (Ubuntu 22.04 with preinstalled deep learning frameworks).
• CentOS (optional).
• Windows 11 Pro (optional).
• Windows 10 Pro (optional).
• Microsoft Windows Server 2022 Standard (optional).


• Windows Server 2016 (X2APIC/256T not supported)
• Windows Server 2019
• Windows Server 2022
• Red Hat Enterprise Linux 8.3 (x64) or later
• Red Hat Enterprise Linux 9.0 (x64) or later
• SUSE Linux Enterprise Server 12 SP5 (x64) or later
• SUSE Linux Enterprise Server 15 SP2 (x64) or later
• Ubuntu 18.04.5 LTS (x64) or later
• Ubuntu 20.04 LTS (x64) or later
• Ubuntu 22.04 LTS (x64) or later
• VMware ESXi 6.7 Update3 P03 or later
• VMware ESXi 7.0 Update1 or later
• VMware ESXi 8.0 or later
• Citrix Hypervisor 8.2.0 or later

Enterprise-class Custom Liquid-cooling System
The system includes a server and external cooling unit for advanced reliability, modularity, and the best cooling performance.

• Fully self-contained (does not require external water supply line or chiller)
• 8 x water-cooled GPUs
• 8 x port manifold with quick disconnect technology
  NOTE: The design of each BIZON workstation integrates quick-disconnect technology for easy GPU expandability. This technology allows you to disconnect existing GPUs or add new GPUs without shipping the system back. Connecting/disconnecting a GPU is similar to plugging in a cable. No spills, no leaks. Fast, easy, and safe.
• External Cooling unit (radiator, pump, reservoir)

NOTE: Cooling loop design may vary from the pictures shown on the product page, but will be of equal or better specs than what's specified above.

• Operating temperature: 50° to 95° F (10° to 35° C)
• Operating humidity: 8%-80% (non-condensing)
• Non-operating temperature: -40° to 140° F (-40°C to 60°C)
• Non-operating humidity: 20%-95% (non-condensing)

• Idle noise level: up to 54 dB
  
• Idle temperature (GPUs): Average 33 C / 91.4 F (min 31C - max 36C)
  
• Max load noise level (stress test): up to 59 dB
  
• Max load temperature (GPUs): Average 59 C / 138.2 F (min 54C - max 65C)
  

8 x NVIDIA TITAN RTX. Noise level measured from 6 ft / 1.8 m distance. Environment: 24 C / 75 F, 38 dB. Noise meter directed to the front panel of the server. Temps measured after 30 min test. 120V power source. Luxmark 3.0. Ubuntu 18.04. Drivers 418. CUDA 10.0

Chassis (server)

• Rackmountable; 4U; horizontal placement
• Height: 6.9 inches (17.6 cm)
• Width: 17.6 inches (44.8 cm)
• Depth: 34.6 inches (88.0 cm)
• Weight (8 GPU; with coolant): 131.4 lbs (59.6 kg)

Cooling Unit

• Rackmountable; 3U; vertical placement
• Height: 4.1 inches (10.3 cm)
• Width: 17.3 inches (44.9 cm)
• Depth: 24.4 inches (62.0 cm)
• Weight (with coolant): 27 lbs (12.24 kg)

Shipping Package 1 (server)

• Height: 24.0 inches (60.9 cm)
• Width: 23.8 inches (60.6 cm)
• Length: 44 inches (111.9 cm)
• Weight: 145.5 lbs (66.5 kg)

Shipping Package 2 (cooling unit)

• Height: 11 inches (27.94 cm)
• Width: 22 inches (55.88 cm)
• Length: 29 inches (73.7 cm)
• Weight: 30 lbs (13.6 kg)

Shipped in two boxes on the pallet.

• Bizon ZX9000.
• 1 x Rail kit
• 4 x power cords (USA).
• User manual.
• Benchmark report.

bizon-zx9000-0820