GPU Benchmarks NVIDIA RTX 2080 Ti vs. NVIDIA Titan RTX vs. NVIDIA A800 40 GB (PCIe)

Quick links:

Best GPUs for deep learning, AI development, compute in 2023–2024. Recommended GPU & hardware for AI training, inference (LLMs, generative AI). GPU training, inference benchmarks using PyTorch, TensorFlow for computer vision (CV), NLP, text-to-speech, etc.

We benchmark NVIDIA RTX 2080 Ti vs NVIDIA Titan RTX vs NVIDIA A800 40 GB (PCIe) GPUs and compare AI performance (deep learning training; FP16, FP32, PyTorch, TensorFlow), 3d rendering, Cryo-EM performance in the most popular apps (Octane, VRay, Redshift, Blender, Luxmark, Unreal Engine, Relion Cryo-EM).

Our benchmarks will help you decide which GPU (NVIDIA RTX 4090/4080, H100 Hopper, H200, A100, RTX 6000 Ada, A6000, A5000, or RTX 6000 ADA Lovelace) is the best GPU for your needs. We provide an in-depth analysis of the AI performance of each graphic card's performance so you can make the most informed decision possible. We offer deep learning and 3d rendering benchmarks that will help you get the most out of your hardware.


Looking for a GPU workstation or server for AI/ML, design, rendering, simulation or molecular dynamics?
Explore BIZON AI workstations or GPU servers.
Contact us today or explore our various customizable AI solutions.


Featured GPU benchmarks:

Benchmarks

Deep Learning GPU Benchmarks 2024–2025 [Updated]

As of May 2025

Resnet50 (FP16)

1 GPU
NVIDIA RTX 2080 Ti
488.56 points
NVIDIA Titan RTX
599.29 points
NVIDIA A800 40 GB (PCIe)
2179 points
4 GPU
NVIDIA RTX 2080 Ti
1597.66 points
NVIDIA Titan RTX
1793.02 points
NVIDIA A800 40 GB (PCIe)
8561 points
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA A800 40 GB (PCIe)
16797 points
higher is better

Resnet50 (FP16 XLA)

1 GPU
NVIDIA RTX 2080 Ti
741.26 points
NVIDIA Titan RTX
938.63 points
NVIDIA A800 40 GB (PCIe)
n/a
4 GPU
NVIDIA RTX 2080 Ti
2465.23 points
NVIDIA Titan RTX
3015.66 points
NVIDIA A800 40 GB (PCIe)
n/a
higher is better

Resnet50 (FP32)

1 GPU
NVIDIA RTX 2080 Ti
302.88 points
NVIDIA Titan RTX
330.9 points
NVIDIA A800 40 GB (PCIe)
1001 points
4 GPU
NVIDIA RTX 2080 Ti
1075.19 points
NVIDIA Titan RTX
1111.27 points
NVIDIA A800 40 GB (PCIe)
3849 points
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA A800 40 GB (PCIe)
7557 points
higher is better

Resnet50 (FP32 XLA)

1 GPU
NVIDIA RTX 2080 Ti
330.72 points
NVIDIA Titan RTX
364.35 points
NVIDIA A800 40 GB (PCIe)
n/a
4 GPU
NVIDIA RTX 2080 Ti
1132.16 points
NVIDIA Titan RTX
1231.15 points
NVIDIA A800 40 GB (PCIe)
n/a
higher is better

Resnet152 (FP16)

1 GPU
NVIDIA RTX 2080 Ti
213.35 points
NVIDIA Titan RTX
267.62 points
NVIDIA A800 40 GB (PCIe)
930 points
4 GPU
NVIDIA RTX 2080 Ti
681.19 points
NVIDIA Titan RTX
751.47 points
NVIDIA A800 40 GB (PCIe)
3557 points
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA A800 40 GB (PCIe)
6809 points
higher is better

Resnet152 (FP16 XLA)

1 GPU
NVIDIA RTX 2080 Ti
290.23 points
NVIDIA Titan RTX
369.05 points
NVIDIA A800 40 GB (PCIe)
n/a
4 GPU
NVIDIA RTX 2080 Ti
977.06 points
NVIDIA Titan RTX
1205.22 points
NVIDIA A800 40 GB (PCIe)
n/a
higher is better

Resnet152 (FP32)

1 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
139.43 points
NVIDIA A800 40 GB (PCIe)
409 points
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
450.18 points
NVIDIA A800 40 GB (PCIe)
1498 points
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA A800 40 GB (PCIe)
2851 points
higher is better

Resnet152 (FP32 XLA)

1 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
147.6 points
NVIDIA A800 40 GB (PCIe)
n/a
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
502.34 points
NVIDIA A800 40 GB (PCIe)
n/a
higher is better

Inception V3 (FP16)

1 GPU
NVIDIA RTX 2080 Ti
293.76 points
NVIDIA Titan RTX
374 points
NVIDIA A800 40 GB (PCIe)
1283 points
4 GPU
NVIDIA RTX 2080 Ti
1031 points
NVIDIA Titan RTX
1226.21 points
NVIDIA A800 40 GB (PCIe)
5218 points
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA A800 40 GB (PCIe)
10122 points
higher is better

Inception V3 (FP16 XLA)

1 GPU
NVIDIA RTX 2080 Ti
404.99 points
NVIDIA Titan RTX
543.32 points
NVIDIA A800 40 GB (PCIe)
n/a
4 GPU
NVIDIA RTX 2080 Ti
1467.97 points
NVIDIA Titan RTX
1901.16 points
NVIDIA A800 40 GB (PCIe)
n/a
higher is better

Inception V3 (FP32)

1 GPU
NVIDIA RTX 2080 Ti
198.81 points
NVIDIA Titan RTX
226.3 points
NVIDIA A800 40 GB (PCIe)
658 points
4 GPU
NVIDIA RTX 2080 Ti
739.49 points
NVIDIA Titan RTX
814.29 points
NVIDIA A800 40 GB (PCIe)
2568 points
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA A800 40 GB (PCIe)
5058 points
higher is better

Inception V3 (FP32 XLA)

1 GPU
NVIDIA RTX 2080 Ti
215.54 points
NVIDIA Titan RTX
244.12 points
NVIDIA A800 40 GB (PCIe)
n/a
4 GPU
NVIDIA RTX 2080 Ti
772.66 points
NVIDIA Titan RTX
967.93 points
NVIDIA A800 40 GB (PCIe)
n/a
higher is better

Inception V4 (FP16)

1 GPU
NVIDIA RTX 2080 Ti
155.84 points
NVIDIA Titan RTX
200.71 points
NVIDIA A800 40 GB (PCIe)
616 points
4 GPU
NVIDIA RTX 2080 Ti
564.62 points
NVIDIA Titan RTX
664.39 points
NVIDIA A800 40 GB (PCIe)
2377 points
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA A800 40 GB (PCIe)
4532 points
higher is better

Inception V4 (FP16 XLA)

1 GPU
NVIDIA RTX 2080 Ti
220.7 points
NVIDIA Titan RTX
298.5 points
NVIDIA A800 40 GB (PCIe)
n/a
4 GPU
NVIDIA RTX 2080 Ti
790.82 points
NVIDIA Titan RTX
1042.2 points
NVIDIA A800 40 GB (PCIe)
n/a
higher is better

Inception V4 (FP32)

1 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
111.56 points
NVIDIA A800 40 GB (PCIe)
290 points
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
394.81 points
NVIDIA A800 40 GB (PCIe)
1031 points
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA A800 40 GB (PCIe)
1950 points
higher is better

Inception V4 (FP32 XLA)

1 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
118.83 points
NVIDIA A800 40 GB (PCIe)
n/a
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
427.81 points
NVIDIA A800 40 GB (PCIe)
n/a
higher is better

VGG16 (FP16)

1 GPU
NVIDIA RTX 2080 Ti
264.14 points
NVIDIA Titan RTX
366.59 points
NVIDIA A800 40 GB (PCIe)
1249 points
4 GPU
NVIDIA RTX 2080 Ti
578.14 points
NVIDIA Titan RTX
518.28 points
NVIDIA A800 40 GB (PCIe)
4989 points
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA A800 40 GB (PCIe)
10733 points
higher is better

VGG16 (FP16 XLA)

1 GPU
NVIDIA RTX 2080 Ti
324.85 points
NVIDIA Titan RTX
504.48 points
NVIDIA A800 40 GB (PCIe)
n/a
4 GPU
NVIDIA RTX 2080 Ti
926.34 points
NVIDIA Titan RTX
1235.83 points
NVIDIA A800 40 GB (PCIe)
n/a
higher is better

VGG16 (FP32)

1 GPU
NVIDIA RTX 2080 Ti
178.65 points
NVIDIA Titan RTX
199.68 points
NVIDIA A800 40 GB (PCIe)
529 points
4 GPU
NVIDIA RTX 2080 Ti
452.2 points
NVIDIA Titan RTX
400.25 points
NVIDIA A800 40 GB (PCIe)
2215 points
8 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA A800 40 GB (PCIe)
4278 points
higher is better

VGG16 (FP32 XLA)

1 GPU
NVIDIA RTX 2080 Ti
194.89 points
NVIDIA Titan RTX
218.47 points
NVIDIA A800 40 GB (PCIe)
n/a
4 GPU
NVIDIA RTX 2080 Ti
528.33 points
NVIDIA Titan RTX
559.34 points
NVIDIA A800 40 GB (PCIe)
n/a
higher is better

3D, GPU Rendering Benchmarks 2024–2025 [Updated]

As of May 2025

V-Ray

1 GPU
NVIDIA RTX 2080 Ti
345 points
NVIDIA Titan RTX
382 points
NVIDIA A800 40 GB (PCIe)
1555 points
higher is better

Octane

1 GPU
NVIDIA RTX 2080 Ti
368 points
NVIDIA Titan RTX
377 points
NVIDIA A800 40 GB (PCIe)
498 points
higher is better

Redshift

1 GPU
NVIDIA RTX 2080 Ti
8.38 minutes
NVIDIA Titan RTX
8.2 minutes
NVIDIA A800 40 GB (PCIe)
n/a
lower is better

Blender

1 GPU
NVIDIA RTX 2080 Ti
3163.85 score
NVIDIA Titan RTX
3434.73 score
NVIDIA A800 40 GB (PCIe)
3788 score
higher is better

Luxmark

1 GPU
NVIDIA RTX 2080 Ti
33195 points
NVIDIA Titan RTX
36654 points
NVIDIA A800 40 GB (PCIe)
n/a
higher is better

Unreal Engine

1 GPU
NVIDIA RTX 2080 Ti
30.1 FPS
NVIDIA Titan RTX
n/a
NVIDIA A800 40 GB (PCIe)
n/a
higher is better

RELION Cryo-EM Benchmarks 2024-2025 [Updated]

As of May 2025

Total run time

1 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA A800 40 GB (PCIe)
178.9 Min
4 GPU
NVIDIA RTX 2080 Ti
n/a
NVIDIA Titan RTX
n/a
NVIDIA A800 40 GB (PCIe)
50.3 Min
lower is better

Technical Specifications

Board Design

NVIDIA RTX 2080 TiNVIDIA Titan RTXNVIDIA A800 40 GB (PCIe)
Length11 in / 267 mm11 in / 267 mm11 in / 267 mm
Outputs1x HDMI, 3x DisplayPort, 1x USB Type-C1x HDMI, 3x DisplayPort, 1x USB Type-CNo outputs
Power Connectors2x 8-pin2x 8-pin8-pin EPS
Slot widthDual-slotDual-slotDual-slot
TDP250 W280 W250 W

Clock Speeds

NVIDIA RTX 2080 TiNVIDIA Titan RTXNVIDIA A800 40 GB (PCIe)
Boost Clock1545 MHz1770 MHz1410 MHz
GPU Clock1350 MHz1350 MHz765 MHz
Memory Clock14000 MHz14000 MHz2400 MHz

Graphics Card

NVIDIA RTX 2080 TiNVIDIA Titan RTXNVIDIA A800 40 GB (PCIe)
Bus InterfacePCIe 3.0 x16PCIe 3.0 x16PCIe 4.0 x16
GenerationGeForce 20GeForce 20Tesla (Axx)

Graphics Features

NVIDIA RTX 2080 TiNVIDIA Titan RTXNVIDIA A800 40 GB (PCIe)
DirectX12 Ultimate (12_1)12 Ultimate (12_1)-
OpenCL223
OpenGL4.64.6-
Shader Model6.56.5-
CUDA7.57.58

Graphics Processor

NVIDIA RTX 2080 TiNVIDIA Titan RTXNVIDIA A800 40 GB (PCIe)
ArchitectureTuringTuringAmpere
Die Size754 mm2754 mm2826 mm2
GPU NameTU102-300A-K1-A1TU102-400-A1GA100
Process Size12 nm12 nm7 nm
Transistors18600 million18600 million54200 million

Memory

NVIDIA RTX 2080 TiNVIDIA Titan RTXNVIDIA A800 40 GB (PCIe)
Bandwidth616 GB/s672 GB/s1555 GB/s
Memory Bus352 bit384 bit5120 bit
Memory Size11 GB24 GB40 GB
Memory TypeGDDR6GDDR6HBM2e

Render Config

NVIDIA RTX 2080 TiNVIDIA Titan RTXNVIDIA A800 40 GB (PCIe)
ROPs8896160
RT Cores6872-
Shading Units/ CUDA Cores435246086912
TMUs272288432
Tensor Cores544576432

Theoretical Performance

NVIDIA RTX 2080 TiNVIDIA Titan RTXNVIDIA A800 40 GB (PCIe)
FP16 (half) performance26.9 TFLOPS32.62 TFLOPS77.97 TFLOPS
FP32 (float) performance13.45 TFLOPS16.31 TFLOPS19.49 TFLOPS
FP64 (double) performance420.2 GFLOPS509.8 GFLOPS9746 GFLOPS
Pixel Rate136 GPixel/s169.9 GPixel/s225.6 GPixel/s
Texture Rate420.2 GTexel/s509.8 GTexel/s609.1 GTexel/s

Price

NVIDIA RTX 2080 TiNVIDIA Titan RTXNVIDIA A800 40 GB (PCIe)
MSRP$1,199.00$2,499.00-
Release DateSep 20th, 2018Dec 18th, 2018Nov 8th, 2022

Test bench configuration

NVIDIA RTX 2080 TiNVIDIA Titan RTXNVIDIA A800 40 GB (PCIe)
HardwareBIZON G3000 More detailsBIZON ZX5000 More detailsBIZON X5000 More details
SoftwareDeep learning:
Nvidia Driver: 440
CUDA: 10.1
TensorFlow: 1.14
Batch size: 64
3D Rendering:
Nvidia Driver: 442.19
VRay Benchmark: 4.10.3
Octane Benchmark: 4.00
Redshift Benchmark: 3.0.x
Blender: 2.81
Luxmark: 3.1
Deep learning:
Nvidia Driver: 440
CUDA: 10.1
TensorFlow: 1.14
Batch size: 64
3D Rendering:
Nvidia Driver: 442.19
VRay Benchmark: 4.10.3
Octane Benchmark: 4.00
Redshift Benchmark: 3.0.x
Blender: 2.81
Luxmark: 3.1
3D Rendering:
VRay Benchmark: 5
Octane Benchmark: 2020.1.5
Redshift Benchmark: 3.0.28 Demo
Blender: 2.90
Luxmark: 3.1

Recommended hardware

NVIDIA RTX 2080 TiNVIDIA Titan RTXNVIDIA A800 40 GB (PCIe)
Best GPU workstationsBIZON X5500BIZON X5500BIZON X5500
Best NVIDIA GPU servers--BIZON X7000
Need Help? We're here to help.

Unsure what to get? Have technical questions?
Contact us and we'll help you design a custom system which will meet your needs.

Explore Products