H100 PCIe 96 GB: specs and benchmarks
Summary
NVIDIA started H100 PCIe 96 GB sales 21 March 2023. This is a Hopper architecture desktop card based on 4 nm manufacturing process and primarily aimed at designers. 96 GB of HBM3 memory clocked at 1.31 GHz are supplied, and together with 5120 Bit memory interface this creates a bandwidth of 1,681 GB/s.
Compatibility-wise, this is a dual-slot graphics card attached via PCIe 5.0 x16 interface. Its manufacturer default version has a length of 268 mm. 8-pin EPS power connector is required, and power consumption is at 700 Watt.
Primary details
Some basic facts about H100 PCIe 96 GB: architecture, market segment, release date etc.
| Place in the ranking | not rated | |
| Place by popularity | not in top-100 | |
| Architecture | Hopper (2022−2023) | |
| GPU code name | GH100 | |
| Market segment | Workstation | |
| Release date | 21 March 2023 (1 year ago) |
Detailed specifications
H100 PCIe 96 GB's specs such as number of shaders, GPU base clock, manufacturing process, texturing and calculation speed. These parameters indirectly speak of H100 PCIe 96 GB's performance, but for precise assessment you have to consider its benchmark and gaming test results.
| Pipelines / CUDA cores | 16896 | of 21760 (GeForce RTX 5090) |
| Core clock speed | 1665 MHz | of 2800 MHz (Playstation 5 Pro GPU) |
| Boost clock speed | 1837 MHz | of 3599 MHz (Radeon RX 7990 XTX) |
| Number of transistors | 80,000 million | of 208,000 million (B200 SXM 192 GB) |
| Manufacturing process technology | 4 nm | of 3 nm (Arc Graphics 140V) |
| Power consumption (TDP) | 700 Watt | of 2400 Watt (Data Center GPU Max Subsystem) |
| Texture fill rate | 969.9 | of 2,554 (Radeon Instinct MI300X) |
| Floating-point processing power | 62.08 TFLOPS | of 109.7 (GeForce RTX 5090) |
| ROPs | 24 | of 192 (Radeon RX 7900 XTX) |
| TMUs | 528 | of 1280 (Data Center GPU Max NEXT) |
| Tensor Cores | 528 | of 1216 (Radeon Instinct MI300X) |
Form factor & compatibility
This section provides details about the physical dimensions of H100 PCIe 96 GB and its compatibility with other computer components. This information is useful when selecting a computer configuration or upgrading an existing one. For desktop graphics cards, it includes details about the interface and bus (for motherboard compatibility) and additional power connectors (for power supply compatibility).
| Interface | PCIe 5.0 x16 | |
| Length | 268 mm | |
| Width | 2-slot | |
| Supplementary power connectors | 8-pin EPS |
VRAM capacity and type
Parameters of memory installed on H100 PCIe 96 GB: its type, size, bus, clock and resulting bandwidth. Note that GPUs integrated into processors have no dedicated memory and use a shared part of system RAM instead.
| Memory type | HBM3 | |
| Maximum RAM amount | 96 GB | of 294912 (Radeon Instinct MI325X) |
| Memory bus width | 5120 Bit | of 8192 Bit (Radeon Instinct MI250X) |
| Memory clock speed | 1313 MHz | of 20000 (RTX 5000 Ada Generation Mobile) |
| Memory bandwidth | 1,681 GB/s | of 5,171 GB/s (Radeon Instinct MI300X) |
Connectivity and outputs
Types and number of video connectors present on H100 PCIe 96 GB. As a rule, this section is relevant only for desktop reference graphics cards, since for notebook ones the availability of certain video outputs depends on the laptop model, while non-reference desktop models can (though not necessarily will) bear a different set of video ports.
| Display Connectors | No outputs |
API compatibility
APIs supported by H100 PCIe 96 GB, sometimes including their particular versions.
| DirectX | N/A | |
| Shader Model | N/A | |
| OpenGL | N/A | of 4.6 (GeForce RTX 4090) |
| OpenCL | 3.0 | |
| Vulkan | N/A | |
| CUDA | 9.0 |
AMD equivalent
According to our data, the closest AMD alternative to H100 PCIe 96 GB is Radeon PRO W7900.
Similar GPUs
Here is our recommendation of several graphics cards that are more or less close in performance to the one reviewed.
Recommended processors
These processors are most commonly used with H100 PCIe 96 GB according to our statistics.
