Compare

NVIDIA A100 80 GB (PCIe) vs NVIDIA RTX 6000 Ada

Quick links:

Benchmarks
Specifications

Best GPUs for deep learning, AI development, compute in 2023–2024. Recommended GPU & hardware for AI training, inference (LLMs, generative AI). GPU training, inference benchmarks using PyTorch, TensorFlow for computer vision (CV), NLP, text-to-speech, etc.

We benchmark these GPUs and compare AI performance (deep learning training; FP16, FP32, PyTorch, TensorFlow), 3d rendering, Cryo-EM performance in the most popular apps (Octane, VRay, Redshift, Blender, Luxmark, Unreal Engine, Relion Cryo-EM).

Our benchmarks will help you decide which GPU (NVIDIA RTX 4090/4080, H100 Hopper, H200, A100, RTX 6000 Ada, A6000, A5000, or RTX 6000 ADA Lovelace) is the best GPU for your needs. We provide an in-depth analysis of the AI performance of each graphic card's performance so you can make the most informed decision possible. We offer deep learning and 3d rendering benchmarks that will help you get the most out of your hardware.

Looking for a GPU workstation or server for AI/ML, design, rendering, simulation or molecular dynamics?
Explore BIZON AI workstations or GPU servers.
Contact us today or explore our various customizable AI solutions.

Featured GPU benchmarks:

Benchmarks

Deep Learning GPU Benchmarks 2024–2025 [Updated]

Resnet50 (FP16)

1 GPU

NVIDIA A100 80 GB (PCIe)

2535

NVIDIA RTX 6000 Ada

1800

4 GPU

NVIDIA A100 80 GB (PCIe)

9366

NVIDIA RTX 6000 Ada

6369

8 GPU

NVIDIA A100 80 GB (PCIe)

21479

NVIDIA RTX 6000 Ada

16968

Resnet50 (FP16 XLA)

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Resnet50 (FP32)

1 GPU

NVIDIA A100 80 GB (PCIe)

1144

NVIDIA RTX 6000 Ada

709

4 GPU

NVIDIA A100 80 GB (PCIe)

4273

NVIDIA RTX 6000 Ada

2692

8 GPU

NVIDIA A100 80 GB (PCIe)

9752

NVIDIA RTX 6000 Ada

7607

Resnet50 (FP32 XLA)

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Resnet152 (FP16)

1 GPU

NVIDIA A100 80 GB (PCIe)

1027

NVIDIA RTX 6000 Ada

729

4 GPU

NVIDIA A100 80 GB (PCIe)

3795

NVIDIA RTX 6000 Ada

2581

8 GPU

NVIDIA A100 80 GB (PCIe)

8865

NVIDIA RTX 6000 Ada

7004

Resnet152 (FP16 XLA)

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Resnet152 (FP32)

1 GPU

NVIDIA A100 80 GB (PCIe)

441

NVIDIA RTX 6000 Ada

273

4 GPU

NVIDIA A100 80 GB (PCIe)

1646

NVIDIA RTX 6000 Ada

1037

8 GPU

NVIDIA A100 80 GB (PCIe)

3941

NVIDIA RTX 6000 Ada

3074

Resnet152 (FP32 XLA)

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Inception V3 (FP16)

1 GPU

NVIDIA A100 80 GB (PCIe)

1529

NVIDIA RTX 6000 Ada

1086

4 GPU

NVIDIA A100 80 GB (PCIe)

5650

NVIDIA RTX 6000 Ada

3842

8 GPU

NVIDIA A100 80 GB (PCIe)

11305

NVIDIA RTX 6000 Ada

8931

Inception V3 (FP16 XLA)

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Inception V3 (FP32)

1 GPU

NVIDIA A100 80 GB (PCIe)

724

NVIDIA RTX 6000 Ada

449

4 GPU

NVIDIA A100 80 GB (PCIe)

2703

NVIDIA RTX 6000 Ada

1703

8 GPU

NVIDIA A100 80 GB (PCIe)

6514

NVIDIA RTX 6000 Ada

5081

Inception V3 (FP32 XLA)

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Inception V4 (FP16)

1 GPU

NVIDIA A100 80 GB (PCIe)

707

NVIDIA RTX 6000 Ada

502

4 GPU

NVIDIA A100 80 GB (PCIe)

2612

NVIDIA RTX 6000 Ada

1776

8 GPU

NVIDIA A100 80 GB (PCIe)

4871

NVIDIA RTX 6000 Ada

3848

Inception V4 (FP16 XLA)

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Inception V4 (FP32)

1 GPU

NVIDIA A100 80 GB (PCIe)

322

NVIDIA RTX 6000 Ada

200

4 GPU

NVIDIA A100 80 GB (PCIe)

1202

NVIDIA RTX 6000 Ada

757

8 GPU

NVIDIA A100 80 GB (PCIe)

2977

NVIDIA RTX 6000 Ada

2322

Inception V4 (FP32 XLA)

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

VGG16 (FP16)

1 GPU

NVIDIA A100 80 GB (PCIe)

904

NVIDIA RTX 6000 Ada

642

4 GPU

NVIDIA A100 80 GB (PCIe)

3341

NVIDIA RTX 6000 Ada

2272

8 GPU

NVIDIA A100 80 GB (PCIe)

11363

NVIDIA RTX 6000 Ada

8977

VGG16 (FP16 XLA)

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

VGG16 (FP32)

1 GPU

NVIDIA A100 80 GB (PCIe)

658

NVIDIA RTX 6000 Ada

408

4 GPU

NVIDIA A100 80 GB (PCIe)

2458

NVIDIA RTX 6000 Ada

1549

8 GPU

NVIDIA A100 80 GB (PCIe)

5803

NVIDIA RTX 6000 Ada

4526

VGG16 (FP32 XLA)

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Googlenet (FP16)

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Googlenet (FP32)

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

3D, GPU Rendering Benchmarks 2024–2025 [Updated]

V-Ray

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

4798

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Octane

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

1140

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Redshift

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

1.27

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Blender

1 GPU

NVIDIA A100 80 GB (PCIe)

3935.71

NVIDIA RTX 6000 Ada

11864.76

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Luxmark

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Unreal Engine

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

78.5

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

RELION Cryo-EM Benchmarks 2024-2025 [Updated]

Total run time

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

BERT LARGE Training, Inference Benchmark 2024-2025 [Updated]

Training Time (FP16)

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Performance (FP16)

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Training Time (FP32)

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Performance (FP32)

1 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

8 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Llama3 70B Inference Benchmark 2024–2025 [Updated]

Eval rate

1 GPU

NVIDIA A100 80 GB (PCIe)

25.35

NVIDIA RTX 6000 Ada

18.06

2 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

4 GPU

NVIDIA A100 80 GB (PCIe)

n/a

NVIDIA RTX 6000 Ada

n/a

Technical Specifications

Board Design

	NVIDIA A100 80 GB (PCIe)	NVIDIA RTX 6000 Ada
Length	267 mm	267 mm
Outputs	No outputs	4x DisplayPort
Power Connectors	8-pin EPS	1x 16-pin
Slot width	Dual-slot	Dual-slot
TDP	250 W	300 W

Clock Speeds

	NVIDIA A100 80 GB (PCIe)	NVIDIA RTX 6000 Ada
Boost Clock	1410 MHz	2505 MHz
GPU Clock	1065 MHz	915 MHz
Memory Clock	3200 MHz	20000 MHz

Graphics Card

	NVIDIA A100 80 GB (PCIe)	NVIDIA RTX 6000 Ada
Bus Interface	PCIe 4.0 x16	PCIe 4.0 x16
Generation	Tesla (Axx)	Quadro Ada (x000A)

Graphics Features

	NVIDIA A100 80 GB (PCIe)	NVIDIA RTX 6000 Ada
OpenCL	3.0	3.0
CUDA	8.0	8.9
DirectX		12 Ultimate (12_2)
OpenGL		4.6
Shader Model		6.7

Graphics Processor

	NVIDIA A100 80 GB (PCIe)	NVIDIA RTX 6000 Ada
Architecture	Ampere	Ada Lovelace
Die Size	826 mm2	608 mm2
GPU Name	GA100	AD102
Process Size	7 nm	5 nm
Transistors	54200 million	76300 million

Memory

	NVIDIA A100 80 GB (PCIe)	NVIDIA RTX 6000 Ada
Bandwidth	2039 GB/s	960 GB/s
Memory Bus	5120 bit	384 bit
Memory Size	80 GB	48 GB
Memory Type	HBM2e	GDDR6

Render Config

	NVIDIA A100 80 GB (PCIe)	NVIDIA RTX 6000 Ada
ROPs	160	192
Shading Units/ CUDA Cores	6912	18176
TMUs	432	568
Tensor Cores	432	568
RT Cores		142

Theoretical Performance

	NVIDIA A100 80 GB (PCIe)	NVIDIA RTX 6000 Ada
FP16 (half) performance	77.97 TFLOPS	91.06 TFLOPS
FP32 (float) performance	19.49 TFLOPS	91.06 TFLOPS
FP64 (double) performance	9746 GFLOPS	1423 GFLOPS
Pixel Rate	225.6 GPixel/s	481 GPixel/s
Texture Rate	609.1 GTexel/s	1423 GTexel/s

Price

	NVIDIA A100 80 GB (PCIe)	NVIDIA RTX 6000 Ada
Release Date	Jun 28th, 2021	Jan 20th, 2023
MSRP	$	6799 $

Test bench configuration

	NVIDIA A100 80 GB (PCIe)	NVIDIA RTX 6000 Ada
Hardware	BIZON X5000 More details	BIZON X5500 More details
Software	3D Rendering: Nvidia Driver: 461.09 VRay Benchmark: 5 Octane Benchmark: 2020.1.5 Redshift Benchmark: 3.0.28 Demo Blender: 2.90 Luxmark: 3.1	3D Rendering: Nvidia Driver: VRay Benchmark: Octane Benchmark: Redshift Benchmark: Blender: Luxmark:

Recommended hardware

	NVIDIA A100 80 GB (PCIe)	NVIDIA RTX 6000 Ada
Best GPU workstations	BIZON X5500	BIZON X5500
Best NVIDIA GPU servers	BIZON X7000	BIZON X7000