Compare

NVIDIA RTX 3090 vs NVIDIA RTX 4090 vs NVIDIA RTX 4080 16GB

Best GPUs for Deep Learning, AI, compute in 2022 2023. Recommended GPUs. Recommended hardware for deep learning, AI research

Our deep learning, AI and 3d rendering GPU benchmarks will help you decide which NVIDIA RTX 4090, RTX 4080, RTX 3090, RTX 3080, A6000, A5000, or RTX 6000 ADA Lovelace is the best GPU for your needs. We provide in-depth analysis of each graphic card's performance so you can make the most informed decision possible. We offer deep learning and 3d rendering benchmarks that will help you get the most out of your hardware.

Benchmarks

Deep Learning Benchmarks

Resnet50 (FP16)

1 GPU
NVIDIA RTX 3090
1071
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
2922
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Resnet50 (FP16 XLA)

1 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Resnet50 (FP32)

1 GPU
NVIDIA RTX 3090
596
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
1625
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Resnet50 (FP32 XLA)

1 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Resnet152 (FP16)

1 GPU
NVIDIA RTX 3090
491
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
1029
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Resnet152 (FP16 XLA)

1 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Resnet152 (FP32)

1 GPU
NVIDIA RTX 3090
223
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
434
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Resnet152 (FP32 XLA)

1 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Inception V3 (FP16)

1 GPU
NVIDIA RTX 3090
715
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
1720
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Inception V3 (FP16 XLA)

1 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Inception V3 (FP32)

1 GPU
NVIDIA RTX 3090
399
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
1267
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Inception V3 (FP32 XLA)

1 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Inception V4 (FP16)

1 GPU
NVIDIA RTX 3090
383
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
1022
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Inception V4 (FP16 XLA)

1 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Inception V4 (FP32)

1 GPU
NVIDIA RTX 3090
156
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
319
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Inception V4 (FP32 XLA)

1 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

VGG16 (FP16)

1 GPU
NVIDIA RTX 3090
577
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
1004
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

VGG16 (FP16 XLA)

1 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

VGG16 (FP32)

1 GPU
NVIDIA RTX 3090
341
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
1077
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

VGG16 (FP32 XLA)

1 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a
4 GPU
NVIDIA RTX 3090
n/a
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

3D Rendering Benchmarks

V-Ray

1 GPU
NVIDIA RTX 3090
2185
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Octane

1 GPU
NVIDIA RTX 3090
769
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Redshift

1 GPU
NVIDIA RTX 3090
2.3
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Blender

1 GPU
NVIDIA RTX 3090
64.5233
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Luxmark

1 GPU
NVIDIA RTX 3090
95123
NVIDIA RTX 4090
n/a
NVIDIA RTX 4080 16GB
n/a

Technical Specifications

Board Design

NVIDIA RTX 3090 NVIDIA RTX 4090 NVIDIA RTX 4080 16GB
Length 313 mm 336 mm 336 mm
Outputs 1x HDMI, 3x DisplayPort 1x HDMI, 3x DisplayPort 1x HDMI, 3x DisplayPort
Power Connectors 2x 8-pin 1x 16-pin 1x 16-pin
Slot width Triple-slot Triple-slot Dual-slot
TDP 350 W 450 W 320 W

Clock Speeds

NVIDIA RTX 3090 NVIDIA RTX 4090 NVIDIA RTX 4080 16GB
Boost Clock 1695 MHz 2520 MHz 2505 MHz
GPU Clock 1410 MHz 2235 MHz 2205 MHz
Memory Clock 19496 MHz 21200 MHz 23000 MHz

Graphics Card

NVIDIA RTX 3090 NVIDIA RTX 4090 NVIDIA RTX 4080 16GB
Bus Interface PCIe 4.0 x16 PCIe 4.0 x16 PCIe 4.0 x16
Generation GeForce 30 GeForce 40 GeForce 40

Graphics Features

NVIDIA RTX 3090 NVIDIA RTX 4090 NVIDIA RTX 4080 16GB
DirectX 12 Ultimate (12_2) 12 Ultimate (12_2) 12 Ultimate (12_2)
OpenCL 3.0 3.0 3.0
OpenGL 4.6 4.6 4.6
Shader Model 6.6 6.6 6.6
CUDA 8.6 8.9 8.9

Graphics Processor

NVIDIA RTX 3090 NVIDIA RTX 4090 NVIDIA RTX 4080 16GB
Architecture Ampere Ada Lovelace Ada Lovelace
Die Size 627 mm2 608 mm2 379 mm2
GPU Name GA102-300-A1 AD102-300-A1 AD103-300-A1
Process Size 8 nm 4 nm 4 nm
Transistors 28000 million 76300 million 45900 million

Memory

NVIDIA RTX 3090 NVIDIA RTX 4090 NVIDIA RTX 4080 16GB
Bandwidth 935.8 GB/s 1018 GB/s 735.7 GB/s
Memory Bus 384 bit 384 bit 256 bit
Memory Size 24 GB 24 GB 16 GB
Memory Type GDDR6X GDDR6X GDDR6X

Render Config

NVIDIA RTX 3090 NVIDIA RTX 4090 NVIDIA RTX 4080 16GB
ROPs 96 192 96
RT Cores 82 128 76
Shading Units/ CUDA Cores 10496 16384 9728
TMUs 328 512 304
Tensor Cores 328 512 304

Theoretical Performance

NVIDIA RTX 3090 NVIDIA RTX 4090 NVIDIA RTX 4080 16GB
FP16 (half) performance 71.16 TFLOPS 82.58 TFLOPS 48.74 TFLOPS
FP32 (float) performance 35.58 TFLOPS 82.58 TFLOPS 48.74 TFLOPS
FP64 (double) performance 1112 GFLOPS 1290 GFLOPS 761.5 GFLOPS
Pixel Rate 162.7 GPixel/s 483.8 GPixel/s 240.5 GPixel/s
Texture Rate 556 GTexel/s 1290 GTexel/s 761.5 GTexel/s

Price

NVIDIA RTX 3090 NVIDIA RTX 4090 NVIDIA RTX 4080 16GB
MSRP 1499 $ 1599 $ 1199 $
Release Date Sep 1st, 2020 Oct 12th, 2022 2022

Test bench configuration

NVIDIA RTX 3090 NVIDIA RTX 4090 NVIDIA RTX 4080 16GB
Hardware BIZON X5000 More details BIZON X5500 More details BIZON X5500 More details
Software 3D Rendering:
Nvidia Driver: 456.38
VRay Benchmark: 5
Octane Benchmark: 2020.1.5
Redshift Benchmark: 3.0.28 Demo
Blender: 2.90
Luxmark: 3.1
3D Rendering:
Nvidia Driver:
VRay Benchmark:
Octane Benchmark:
Redshift Benchmark:
Blender:
Luxmark:
3D Rendering:
Nvidia Driver:
VRay Benchmark:
Octane Benchmark:
Redshift Benchmark:
Blender:
Luxmark:
Need Help? We're here to help.

Unsure what to get? Have technical questions?
Contact us and we'll help you design a custom system which will meet your needs.

Explore Products