What is H100?

The H100 is a GPU chip used for AI workloads, often described as a frontier chip. As of mid-2026, its rental price has increased compared to a year earlier, and its availability has tightened following the collapse of B200 GPU supply, while older H100s remain useful for inference.

• Dec 2025 - Zain Asgar noted that newer chips like the B40 or B200 show significant performance gains over the H100, with 20-40% improvements in many cases.
• Apr 2026 - Jack Farley reported that GPU availability for B200s has collapsed, with H100s close behind.
• Apr 2026 - Philip Kiely stated that an H100 is more expensive now than it was a year ago in terms of rental basis.
• Apr 2026 - Nathan Labenz said that a frontier chip like an H100 uses about the same amount of energy when on as a microwave or electric teapot.
• Jul 2026 - Ben Pouladian said that H100s and A100s over three years old are still running and useful for inference, though not for training.