H100 SXM5 64 GB vs GeForce RTX 4090 Ti

#ad 
Buy on Amazon
VS

Primary details

GPU architecture, market segment, value for money and other general parameters compared.

Place in the rankingnot ratednot rated
Place by popularity67not in top-100
ArchitectureAda Lovelace (2022−2024)Hopper (2022−2023)
GPU code nameAD102GH100
Market segmentDesktopWorkstation
Release date2023 (1 year ago)21 March 2023 (1 year ago)

Detailed specifications

General parameters such as number of shaders, GPU core base clock and boost clock speeds, manufacturing process, texturing and calculation speed. Note that power consumption of some graphics cards can well exceed their nominal TDP, especially when overclocked.

Pipelines / CUDA cores1817616896
Core clock speed2325 MHz1665 MHz
Boost clock speed2565 MHz1980 MHz
Number of transistors76,300 million80,000 million
Manufacturing process technology5 nm4 nm
Power consumption (TDP)600 Watt700 Watt
Texture fill rate1,4571,045
Floating-point processing power93.24 TFLOPS66.91 TFLOPS
ROPs19224
TMUs568528
Tensor Cores568528
Ray Tracing Cores142no data

Form factor & compatibility

Information on compatibility with other computer components. Useful when choosing a future computer configuration or upgrading an existing one. For desktop graphics cards it's interface and bus (motherboard compatibility), additional power connectors (power supply compatibility).

InterfacePCIe 4.0 x16PCIe 5.0 x16
Length336 mmno data
Width3-slotSXM Module
Supplementary power connectors2x 16-pin8-pin EPS

VRAM capacity and type

Parameters of VRAM installed: its type, size, bus, clock and resulting bandwidth. Integrated GPUs have no dedicated video RAM and use a shared part of system RAM.

Memory typeGDDR6XHBM3
Maximum RAM amount24 GB64 GB
Memory bus width384 Bit3072 Bit
Memory clock speed1500 MHz1313 MHz
Memory bandwidth1.15 TB/s1,008 GB/s

Connectivity and outputs

Types and number of video connectors present on the reviewed GPUs. As a rule, data in this section is precise only for desktop reference ones (so-called Founders Edition for NVIDIA chips). OEM manufacturers may change the number and type of output ports, while for notebook cards availability of certain video outputs ports depends on the laptop model rather than on the card itself.

Display Connectors1x HDMI 2.1, 3x DisplayPort 1.4aNo outputs
HDMI+-

API compatibility

List of supported 3D and general-purpose computing APIs, including their specific versions.

DirectX12 Ultimate (12_2)N/A
Shader Model6.7N/A
OpenGL4.6N/A
OpenCL3.03.0
Vulkan1.3N/A
CUDA8.99.0

Pros & cons summary


Maximum RAM amount 24 GB 64 GB
Chip lithography 5 nm 4 nm
Power consumption (TDP) 600 Watt 700 Watt

RTX 4090 Ti has 16.7% lower power consumption.

H100 SXM5 64 GB, on the other hand, has a 166.7% higher maximum VRAM amount, and a 25% more advanced lithography process.

We couldn't decide between GeForce RTX 4090 Ti and H100 SXM5 64 GB. We've got no test results to judge.

Be aware that GeForce RTX 4090 Ti is a desktop card while H100 SXM5 64 GB is a workstation one.


Should you still have questions concerning choice between the reviewed GPUs, ask them in Comments section, and we shall answer.

Vote for your favorite

Do you think we are right or mistaken in our choice? Vote by clicking "Like" button near your favorite graphics card.


NVIDIA GeForce RTX 4090 Ti
GeForce RTX 4090 Ti
NVIDIA H100 SXM5 64 GB
H100 SXM5 64 GB

Comparisons with similar GPUs

We selected several comparisons of graphics cards with performance close to those reviewed, providing you with more options to consider.

Community ratings

Here you can see the user ratings of the compared graphics cards, as well as rate them yourself.


3.5 3330 votes

Rate GeForce RTX 4090 Ti on a scale of 1 to 5:

  • 1
  • 2
  • 3
  • 4
  • 5

No user ratings yet.

Rate H100 SXM5 64 GB on a scale of 1 to 5:

  • 1
  • 2
  • 3
  • 4
  • 5

Questions & comments

Here you can ask a question about this comparison, agree or disagree with our judgements, or report an error or mismatch.