AI, Deep Learning Workstations and Servers – Buyer's Guide
NVIDIA GPU AI Workstations
-
CPU
AMD Threadripper PRO 5000WX/7000WX (96 Cores)
-
GPU
Up to 2x NVIDIA RTX 4090/4080 or 4x RTX 6000 Ada
-
Memory
Up to 1 TB DDR5 Memory
-
Cooling
GPU: Air-cooling | CPU: Water-cooling
-
Features
Optimized for stable diffusion, LLaMA, Alpaca. ChatGPT-like AI On Your Local Computer
-
CPU
Intel Xeon W-2500/W-3500 (60 Cores)
-
GPU
Up to 2x NVIDIA RTX 4090, 4080 or 4x RTX 6000 Ada
-
Memory
Up to 2TB DDR5 Memory
-
Cooling
GPU: Air-cooling | CPU: Water-cooling
-
Features
NVIDIA AI Workstation for AI Research
-
CPU
AMD Threadripper Pro 5000WX/7000WX (96 Cores)
-
GPU
Up to 7x Water-cooled NVIDIA 4090, 6000 Ada, A100, H100, H200
-
Memory
Up to 1 TB DDR5 Memory
-
Cooling
Enterprise-class water-cooling
-
Features
Up to 3x times lower noise vs. air-cooling. Maximum GPU power for inference and training
NVIDIA GPU Servers (AMD EPYC)
-
CPU
1x AMD EPYC 9004, 9005 (192 Cores)
-
GPU
Up to 4x NVIDIA RTX 6000 Ada, A100, H100, H200 GPUs
-
Memory
Up to 2 TB Memory
-
Cooling
GPU: Air-cooling | CPU: Air-cooling
-
CPU
2x AMD EPYC 9004, 9005 (256 Cores)
-
GPU
Up to 8x NVIDIA RTX6000 Ada, H100, H200, A100, L40S GPUs
-
Memory
Up to 8 TB Memory
-
Cooling
GPU: Air-cooling | CPU: Air-cooling
-
CPU
2x AMD EPYC 9004/9005 (256 Cores)
-
GPU
Up to 8x water-cooled NVIDIA RTX A6000, A100, H100, H200 GPUs
-
Memory
Up to 8 TB Memory
-
Cooling
Server-grade water-cooling
NVIDIA GPU Servers (Intel Xeon)
-
CPU
Dual Intel Xeon Scalable (4th/5th gen) – Up to 80 Cores
-
GPU
Up to 8x NVIDIA A100, H100, H200, L40S, RTX 6000 Ada GPUs
-
Memory
Up to 8 TB ECC/Reg
-
Cooling
GPU: Air-cooling | CPU: Air-cooling
-
CPU
2x Intel Xeon 4th/5th Gen (128 cores)
-
GPU
Up to 8x water-cooled NVIDIA RTX A6000, A100, H100 GPUs
-
Memory
Up to 6 TB Memory
-
Cooling
Server-grade water-cooling
Enterprise-class custom liquid-cooling system
-
CPU
2x Intel Xeon or AMD EPYC 9004/9005
-
GPU
4x 8x NVIDIA A100, H100 94GB GPU
-
Memory
Up to 8 TB Memory
-
Cooling
GPU: Air-cooling | CPU: Air-cooling
- Low temperatures (50C vs 90C).
- Low noise level (up to 3x times lower vs. air-cooled). 90 dB = motorcycle engine running is about 90 dB. With water-cooled system, ou can place the server/workstation in the lab/office.
- Air-cooled 4x, 8x x NVIDIA A100, A6000, RTX 4090 (top-level GPUs) are extremely hot under the heavy load. When GPUs are overheating, they will activate thermal throttling mode. Thermal throttling means that the fans can no longer dissipate the heat and graphics card starts to dump the performance to shed the heat. IMPORTANT: We have seen up to 60% (!) performance drop due to overheating. Liquid cooling is the best solution. Liquid cooling will provide 24/7 stability, low noise, long-life for components and you will get 100% performance out of the GPU.