Nvidia H200 Rental Costs Surge About 160% Since January as GPU Rates Climb

Renting an Nvidia $NVDA H200 GPU rose about 160% between January 1, 2026, and mid-October, leading a broad year-to-date surge across AI compute hardware. Other Nvidia chips also saw sharp year-to-date rental increases, with the B200 up about 120%, the RTX PRO 6000 up around 65%, and the H100 up approximately 35%, while even the six-year-old A100 now rents for more than it did in January. Across tracked providers, median on-demand H200 prices sit around $4.27 to $4.94 per GPU-hour, compared to spot marketplace rates ranging from about $1.47 to $3.88 and hyperscaler averages on AWS and Azure running from about $7.91 to more than $10.60 per hour. Cloud provider Nebius raised its on-demand H200 rate by 20% from $4.50 to $5.40 per GPU-hour on October 1, 2026, while simultaneously hiking H100 rental prices by 17%. The H200 features 141 GB of HBM3e memory—1.76× the capacity of the H100—alongside 4.8 TB/s of memory bandwidth.