GPU Benchmarks NVIDIA RTX 4090 vs. NVIDIA RTX 6000 Ada

Quick links:

Best GPUs for deep learning, AI development, compute in 2023–2024. Recommended GPU & hardware for AI training, inference (LLMs, generative AI). GPU training, inference benchmarks using PyTorch, TensorFlow for computer vision (CV), NLP, text-to-speech, etc.

We benchmark NVIDIA RTX 4090 vs NVIDIA RTX 6000 Ada GPUs and compare AI performance (deep learning training; FP16, FP32, PyTorch, TensorFlow), 3d rendering, Cryo-EM performance in the most popular apps (Octane, VRay, Redshift, Blender, Luxmark, Unreal Engine, Relion Cryo-EM).

Our benchmarks will help you decide which GPU (NVIDIA RTX 4090/4080, H100 Hopper, H200, A100, RTX 6000 Ada, A6000, A5000, or RTX 6000 ADA Lovelace) is the best GPU for your needs. We provide an in-depth analysis of the AI performance of each graphic card's performance so you can make the most informed decision possible. We offer deep learning and 3d rendering benchmarks that will help you get the most out of your hardware.


Looking for a GPU workstation or server for AI/ML, design, rendering, simulation or molecular dynamics?
Explore BIZON AI workstations or GPU servers.
Contact us today or explore our various customizable AI solutions.


Featured GPU benchmarks:

Benchmarks

Deep Learning GPU Benchmarks 2024–2025 [Updated]

As of May 2025

Resnet50 (FP16)

1 GPU
NVIDIA RTX 4090
1720 points
NVIDIA RTX 6000 Ada
1800 points
4 GPU
NVIDIA RTX 4090
5934 points
NVIDIA RTX 6000 Ada
6369 points
8 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
16968 points
higher is better

Resnet50 (FP32)

1 GPU
NVIDIA RTX 4090
927 points
NVIDIA RTX 6000 Ada
709 points
4 GPU
NVIDIA RTX 4090
1715 points
NVIDIA RTX 6000 Ada
2692 points
8 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
7607 points
higher is better

Resnet152 (FP16)

1 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
729 points
4 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
2581 points
8 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
7004 points
higher is better

Resnet152 (FP32)

1 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
273 points
4 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
1037 points
8 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
3074 points
higher is better

Inception V3 (FP16)

1 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
1086 points
4 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
3842 points
8 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
8931 points
higher is better

Inception V3 (FP32)

1 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
449 points
4 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
1703 points
8 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
5081 points
higher is better

Inception V4 (FP16)

1 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
502 points
4 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
1776 points
8 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
3848 points
higher is better

Inception V4 (FP32)

1 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
200 points
4 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
757 points
8 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
2322 points
higher is better

VGG16 (FP16)

1 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
642 points
4 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
2272 points
8 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
8977 points
higher is better

VGG16 (FP32)

1 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
408 points
4 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
1549 points
8 GPU
NVIDIA RTX 4090
n/a
NVIDIA RTX 6000 Ada
4526 points
higher is better

3D, GPU Rendering Benchmarks 2024–2025 [Updated]

As of May 2025

V-Ray

1 GPU
NVIDIA RTX 4090
5556 points
NVIDIA RTX 6000 Ada
4798 points
higher is better

Octane

1 GPU
NVIDIA RTX 4090
1445 points
NVIDIA RTX 6000 Ada
1140 points
higher is better

Redshift

1 GPU
NVIDIA RTX 4090
1.16 minutes
NVIDIA RTX 6000 Ada
1.27 minutes
lower is better

Blender

1 GPU
NVIDIA RTX 4090
12123.96 score
NVIDIA RTX 6000 Ada
11864.76 score
higher is better

Luxmark

1 GPU
NVIDIA RTX 4090
158815 points
NVIDIA RTX 6000 Ada
n/a
higher is better

Unreal Engine

1 GPU
NVIDIA RTX 4090
92.1 FPS
NVIDIA RTX 6000 Ada
78.5 FPS
higher is better

RELION Cryo-EM Benchmarks 2024-2025 [Updated]

As of May 2025

Total run time

1 GPU
NVIDIA RTX 4090
105.2 Min
NVIDIA RTX 6000 Ada
n/a
4 GPU
NVIDIA RTX 4090
53.2 Min
NVIDIA RTX 6000 Ada
n/a
lower is better

Llama3 70B Inference Benchmark 2024–2025 [Updated]

As of May 2025

Eval rate

1 GPU
NVIDIA RTX 4090
9.95 tokens/s
NVIDIA RTX 6000 Ada
18.06 tokens/s
2 GPU
NVIDIA RTX 4090
19.99 tokens/s
NVIDIA RTX 6000 Ada
n/a
higher is better

Technical Specifications

Board Design

NVIDIA RTX 4090NVIDIA RTX 6000 AdaDifference
Length13 in / 336 mm11 in / 267 mm-3 in / -69 mm (-21%)
Outputs1x HDMI, 3x DisplayPort4x DisplayPort
Power Connectors1x 16-pin1x 16-pin-
Slot widthTriple-slotDual-slot
TDP450 W300 W-150 W (-33%)

Clock Speeds

NVIDIA RTX 4090NVIDIA RTX 6000 AdaDifference
Boost Clock2520 MHz2505 MHz-15 MHz (-1%)
GPU Clock2235 MHz915 MHz-1320 MHz (-59%)
Memory Clock21200 MHz20000 MHz-1200 MHz (-6%)

Graphics Card

NVIDIA RTX 4090NVIDIA RTX 6000 AdaDifference
Bus InterfacePCIe 4.0 x16PCIe 4.0 x16-
GenerationGeForce 40Quadro Ada (x000A)

Graphics Features

NVIDIA RTX 4090NVIDIA RTX 6000 AdaDifference
DirectX12 Ultimate (12_2)12 Ultimate (12_2)-
OpenCL33-
OpenGL4.64.6-
Shader Model6.76.7-
CUDA8.98.9-

Graphics Processor

NVIDIA RTX 4090NVIDIA RTX 6000 AdaDifference
ArchitectureAda LovelaceAda Lovelace-
Die Size608 mm2608 mm2-
GPU NameAD102-300-A1AD102
Process Size5 nm5 nm-
Transistors76300 million76300 million-

Memory

NVIDIA RTX 4090NVIDIA RTX 6000 AdaDifference
Bandwidth1018 GB/s960 GB/s-58 GB/s (-6%)
Memory Bus384 bit384 bit-
Memory Size24 GB48 GB24 GB (100%)
Memory TypeGDDR6XGDDR6

Render Config

NVIDIA RTX 4090NVIDIA RTX 6000 AdaDifference
ROPs192192-
RT Cores12814214 (11%)
Shading Units/ CUDA Cores16384181761792 (11%)
TMUs51256856 (11%)
Tensor Cores51256856 (11%)

Theoretical Performance

NVIDIA RTX 4090NVIDIA RTX 6000 AdaDifference
FP16 (half) performance82.58 TFLOPS91.06 TFLOPS8.48 TFLOPS (10%)
FP32 (float) performance82.58 TFLOPS91.06 TFLOPS8.48 TFLOPS (10%)
FP64 (double) performance1290 GFLOPS1423 GFLOPS133 GFLOPS (10%)
Pixel Rate483.8 GPixel/s481 GPixel/s-2.8 GPixel/s (-1%)
Texture Rate1290 GTexel/s1423 GTexel/s133 GTexel/s (10%)

Price

NVIDIA RTX 4090NVIDIA RTX 6000 AdaDifference
MSRP$1,599.00$6,799.00$5,200.00 (325%)
Release DateOct 12th, 2022Jan 20th, 2023

Test bench configuration

NVIDIA RTX 4090NVIDIA RTX 6000 AdaDifference
HardwareBIZON X5500 More detailsBIZON X5500 More details-
Software3D Rendering:
Nvidia Driver:
VRay Benchmark:
Octane Benchmark:
Redshift Benchmark:
Blender:
Luxmark:
3D Rendering:
Nvidia Driver:
VRay Benchmark:
Octane Benchmark:
Redshift Benchmark:
Blender:
Luxmark:
-

Recommended hardware

NVIDIA RTX 4090NVIDIA RTX 6000 AdaDifference
Best GPU workstationsBIZON X5500BIZON X5500-
Best NVIDIA GPU servers-BIZON X7000
Need Help? We're here to help.

Unsure what to get? Have technical questions?
Contact us and we'll help you design a custom system which will meet your needs.

Explore Products