NVIDIA H100 NVL (PCIe) vs NVIDIA RTX 4090 vs NVIDIA RTX 4080 
	
	
		
			
				
											NVIDIA RTX 2080 Ti 
											NVIDIA Titan RTX 
											NVIDIA Quadro RTX 6000 
											NVIDIA Quadro RTX 8000 
											NVIDIA GTX 1080 Ti 
											NVIDIA Titan V 
											NVIDIA Tesla V100 
											NVIDIA GTX 780 
											NVIDIA GTX 780 Ti 
											NVIDIA GTX 960 
											NVIDIA GTX 980 
											NVIDIA GTX 980 Ti 
											NVIDIA GTX 1050 
											NVIDIA GTX 1050 Ti 
											NVIDIA GTX 1060 
											NVIDIA GTX 1070 
											NVIDIA GTX 1070 Ti 
											NVIDIA GTX 1080 
											NVIDIA GTX 1650 
											NVIDIA GTX 1660 
											NVIDIA GTX 1660 Ti 
											NVIDIA RTX 2060 
											NVIDIA RTX 2060 Super 
											NVIDIA RTX 2070 
											NVIDIA RTX 2070 Super 
											NVIDIA RTX 2080 
											NVIDIA RTX 2080 Super 
											NVIDIA Titan Xp 
											NVIDIA Quadro M6000 
											NVIDIA Quadro P1000 
											NVIDIA Quadro P2000 
											NVIDIA Quadro P4000 
											NVIDIA Quadro P5000 
											NVIDIA Quadro P6000 
											NVIDIA Quadro GP100 
											NVIDIA Quadro GV100 
											NVIDIA Quadro RTX 4000 
											NVIDIA Quadro RTX 5000 
											NVIDIA RTX 3070 
											NVIDIA RTX 3080 
											NVIDIA RTX 3090 
											NVIDIA RTX A6000 
											NVIDIA RTX 3060 
											NVIDIA RTX 3060 Ti 
											NVIDIA A100 40 GB (PCIe) 
											NVIDIA A40 
											NVIDIA A10 
											NVIDIA A16 
											NVIDIA A30 
											NVIDIA RTX A4000 
											NVIDIA RTX A5000 
											NVIDIA RTX 3070 Ti 
											NVIDIA RTX 3080 Ti 
											NVIDIA A100 80 GB (PCIe) 
											NVIDIA A100 80 GB (SXM4) 
											NVIDIA RTX A4500 
											NVIDIA T400 
											NVIDIA T600 
											NVIDIA T1000 
											NVIDIA RTX A5500 
											NVIDIA RTX A2000 
											NVIDIA H100 NVL (PCIe) 
											NVIDIA H100 NVL (SXM5) 
											NVIDIA H100 CNX 
											NVIDIA RTX 3090 Ti 
											NVIDIA RTX 4090 
											NVIDIA RTX 4080 
											NVIDIA RTX 4070 Ti 
											NVIDIA RTX 6000 Ada 
											NVIDIA L40 
											NVIDIA RTX 4090 Ti (Unreleased) 
											NVIDIA RTX 4000 SFF Ada 
											NVIDIA RTX 4070 
											NVIDIA L40s 
											NVIDIA RTX 4000 Ada 
											NVIDIA RTX 4500 Ada 
											NVIDIA RTX 5000 Ada 
											NVIDIA A800 40 GB (PCIe) 
											NVIDIA A800 40 GB Active 
											NVIDIA H200 NVL (SXM5) 
											NVIDIA GH200 
											NVIDIA L4 
											NVIDIA B200 (SXM) 
											NVIDIA RTX 5090 
											NVIDIA H200 NVL (PCIe) 
											NVIDIA RTX 5080 
											NVIDIA RTX 5070 Ti 
											NVIDIA RTX 5070 
											NVIDIA RTX 5060 Ti 
											NVIDIA RTX 5060 
											NVIDIA RTX PRO 6000 Blackwell Server 
											NVIDIA RTX PRO 6000 Blackwell 
											NVIDIA RTX PRO 6000 Blackwell Max-Q 
											NVIDIA RTX PRO 5000 Blackwell 
											NVIDIA RTX PRO 4500 Blackwell 
											NVIDIA RTX PRO 4000 Blackwell 
											AMD Radeon RX 9070 XT 
											AMD Radeon Instinct MI300 
											AMD Radeon Instinct MI300X 
											AMD Radeon Instinct MI325X 
											NVIDIA B300 NVL16 
											NVIDIA RTX PRO 5000 72GB Blackwell 
											NVIDIA DGX Spark 
									 
			
			
				X 
				 
		 
		
			+ 
		
		VS
	 
	
	
		
Quick links: 
		
	
	
	Best GPUs for deep learning, AI development, compute in 2023–2024. Recommended GPU & hardware for AI training, inference (LLMs, generative AI).
GPU training, inference benchmarks using PyTorch, TensorFlow for computer vision (CV), NLP, text-to-speech, etc. 
We benchmark these  GPUs and compare AI performance (deep learning training; FP16, FP32, PyTorch, TensorFlow), 3d rendering, Cryo-EM performance in the most popular apps (Octane, VRay, Redshift, Blender, Luxmark, Unreal Engine, Relion Cryo-EM).
Our benchmarks will help you decide which GPU (NVIDIA RTX 4090/4080, H100 Hopper, H200, A100, RTX 6000 Ada, A6000, A5000, or RTX 6000 ADA Lovelace) is the best GPU for your needs. We provide an in-depth analysis of the AI performance of each graphic card's performance so you can make the most informed decision possible. We offer deep learning and 3d rendering benchmarks that will help you get the most out of your hardware.
Looking for a GPU workstation or server for AI/ML, design, rendering, simulation or molecular dynamics? 
Explore BIZON AI workstations  or GPU servers . Contact us  today or explore our various customizable AI solutions.
Featured GPU benchmarks: 
	
	
	
	
					
				Deep Learning AI GPU Benchmarks 2025 [Updated] 
									
						Resnet50 (FP16) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											3042
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											11989
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											30070
										 
																													
																													
																	 
							 
											 
									
						Resnet50 (FP16 XLA) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Resnet50 (FP32) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											1350
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											5513
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											14725
										 
																													
																													
																	 
							 
											 
									
						Resnet50 (FP32 XLA) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Resnet152 (FP16) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											1232
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											4858
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											12411
										 
																													
																													
																	 
							 
											 
									
						Resnet152 (FP16 XLA) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Resnet152 (FP32) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											520
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											2124
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											5950
										 
																													
																													
																	 
							 
											 
									
						Resnet152 (FP32 XLA) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Inception V3 (FP16) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											1835
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											7232
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											15827
										 
																													
																													
																	 
							 
											 
									
						Inception V3 (FP16 XLA) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Inception V3 (FP32) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											854
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											3487
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											9837
										 
																													
																													
																	 
							 
											 
									
						Inception V3 (FP32 XLA) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Inception V4 (FP16) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											848
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											3343
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											6819
										 
																													
																													
																	 
							 
											 
									
						Inception V4 (FP16 XLA) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Inception V4 (FP32) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											380
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											1551
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											4496
										 
																													
																													
																	 
							 
											 
									
						Inception V4 (FP32 XLA) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						VGG16 (FP16) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											1085
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											4276
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											15908
										 
																													
																													
																	 
							 
											 
									
						VGG16 (FP16 XLA) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						VGG16 (FP32) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											776
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											3171
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											8762
										 
																													
																													
																	 
							 
											 
									
						VGG16 (FP32 XLA) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Googlenet (FP16) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Googlenet (FP32) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						
(copy) 
											
							 
					
				3D, GPU Rendering Benchmarks 2025 [Updated] 
									
						V-Ray 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Octane 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Redshift 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Blender 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											5069.86
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Luxmark 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Unreal Engine 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
							 
					
				RELION Cryo-EM Benchmarks 2025 [Updated] 
									
						Total run time 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
							 
					
				BERT LARGE Training, Inference Benchmark 2025 [Updated] 
									
						Training Time (FP16) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Performance (FP16) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Training Time (FP32) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Performance (FP32) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
							 
					
				LLM Inference Benchmark 2025 [Updated] 
									
						Llama3.1 70B 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											32
										 
																													
																													
																	 
							 
													
								2 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											32
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						Llama3.1 405B 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											0.1
										 
																													
																													
																	 
							 
													
								2 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						OpenAI gpt-oss-20b (FP4) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
									
						OpenAI gpt-oss-120b (FP4) 
													
								1 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								4 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
													
								8 GPU
								
																																						
											
											NVIDIA H100 NVL (PCIe)
											n/a
										 
																													
																													
																	 
							 
											 
							 
			 
	
	
	
				
			Board Design 
			
				
					
						NVIDIA H100 NVL (PCIe) 
													NVIDIA RTX 4090 
													NVIDIA RTX 4080 
											 
						Length 
													268 mm 
													336 mm 
													336 mm 
											 
									
						Outputs 
													No outputs  
													1x HDMI, 3x DisplayPort  
													1x HDMI, 3x DisplayPort  
											 
									
						Power Connectors 
													8-pin EPS  
													1x 16-pin  
													1x 16-pin  
											 
									
						Slot width 
													Dual-slot  
													Triple-slot  
													Dual-slot  
											 
									
						TDP 
													700 W 
													450 W 
													320 W 
											 
								
			 
		 
				
			Clock Speeds 
			
				
					
						NVIDIA H100 NVL (PCIe) 
													NVIDIA RTX 4090 
													NVIDIA RTX 4080 
											 
						Boost Clock 
													1837 MHz 
													2520 MHz 
													2505 MHz 
											 
									
						GPU Clock 
													1665 MHz 
													2235 MHz 
													2205 MHz 
											 
									
						Memory Clock 
													5300 MHz 
													21200 MHz 
													23000 MHz 
											 
								
			 
		 
				
			Graphics Card 
			
				
					
						NVIDIA H100 NVL (PCIe) 
													NVIDIA RTX 4090 
													NVIDIA RTX 4080 
											 
						Bus Interface 
													PCIe 5.0 x16  
													PCIe 4.0 x16  
													PCIe 4.0 x16  
											 
									
						Generation 
													Server Hopper (Hxx)  
													GeForce 40  
													GeForce 40  
											 
								
			 
		 
				
			Graphics Features 
			
				
					
						NVIDIA H100 NVL (PCIe) 
													NVIDIA RTX 4090 
													NVIDIA RTX 4080 
											 
						OpenCL 
													3.0  
													3.0  
													3.0  
											 
									
						CUDA 
													9.0  
													8.9  
													8.9  
											 
									
						DirectX 
													  
													12 Ultimate (12_2)  
													12 Ultimate (12_2)  
											 
									
						OpenGL 
													  
													4.6  
													4.6  
											 
									
						Shader Model 
													  
													6.7  
													6.7  
											 
								
			 
		 
				
			Graphics Processor 
			
				
					
						NVIDIA H100 NVL (PCIe) 
													NVIDIA RTX 4090 
													NVIDIA RTX 4080 
											 
						Architecture 
													Hopper  
													Ada Lovelace  
													Ada Lovelace  
											 
									
						Die Size 
													814 mm2 
													608 mm2 
													379 mm2 
											 
									
						GPU Name 
													GH100  
													AD102-300-A1  
													AD103-300-A1  
											 
									
						Process Size 
													5 nm 
													5 nm 
													5 nm 
											 
									
						Transistors 
													80000 million 
													76300 million 
													45900 million 
											 
								
			 
		 
				
			Memory 
			
				
					
						NVIDIA H100 NVL (PCIe) 
													NVIDIA RTX 4090 
													NVIDIA RTX 4080 
											 
						Bandwidth 
													3360 GB/s 
													1018 GB/s 
													735.7 GB/s 
											 
									
						Memory Bus 
													5120 bit 
													384 bit 
													256 bit 
											 
									
						Memory Size 
													96 GB 
													24 GB 
													16 GB 
											 
									
						Memory Type 
													HBM3  
													GDDR6X  
													GDDR6X  
											 
								
			 
		 
				
			Render Config 
			
				
					
						NVIDIA H100 NVL (PCIe) 
													NVIDIA RTX 4090 
													NVIDIA RTX 4080 
											 
						ROPs 
													24  
													192  
													96  
											 
									
						Shading Units/ CUDA Cores 
													16896  
													16384  
													9728  
											 
									
						TMUs 
													528  
													512  
													304  
											 
									
						Tensor Cores 
													528  
													512  
													304  
											 
									
						RT Cores 
													  
													128  
													76  
											 
								
			 
		 
				
			Theoretical Performance 
			
				
					
						NVIDIA H100 NVL (PCIe) 
													NVIDIA RTX 4090 
													NVIDIA RTX 4080 
											 
						FP16 (half) performance 
													248.3 TFLOPS 
													82.58 TFLOPS 
													48.74 TFLOPS 
											 
									
						FP32 (float) performance 
													62.08 TFLOPS 
													82.58 TFLOPS 
													48.74 TFLOPS 
											 
									
						FP64 (double) performance 
													31040 GFLOPS 
													1290 GFLOPS 
													761.5 GFLOPS 
											 
									
						Pixel Rate 
													44.09 GPixel/s 
													483.8 GPixel/s 
													240.5 GPixel/s 
											 
									
						Texture Rate 
													969.9 GTexel/s 
													1290 GTexel/s 
													761.5 GTexel/s 
											 
								
			 
		 
				
			Price 
			
				
					
						NVIDIA H100 NVL (PCIe) 
													NVIDIA RTX 4090 
													NVIDIA RTX 4080 
											 
						Release Date 
													Mar 21st, 2023  
													Oct 12th, 2022  
													Nov 16th, 2022  
											 
									
						MSRP 
													 $ 
													1599 $ 
													1199 $ 
											 
								
			 
		 
				
			Test bench configuration 
			
				
					
						NVIDIA H100 NVL (PCIe) 
													NVIDIA RTX 4090 
													NVIDIA RTX 4080 
											 
						Hardware 
													BIZON X5000 More details   
													BIZON X5500 More details   
													BIZON X5500 More details   
											 
									
						Software 
													3D Rendering: 
VRay Benchmark: 5
Octane Benchmark: 2020.1.5 
Redshift Benchmark: 3.0.28 Demo
Blender: 2.90
Luxmark: 3.1 3D Rendering: 
Nvidia Driver:
VRay Benchmark: 
Octane Benchmark:  
Redshift Benchmark: 
Blender: 
Luxmark: 3D Rendering: 
Nvidia Driver:
VRay Benchmark: 
Octane Benchmark:  
Redshift Benchmark: 
Blender: 
Luxmark: