GPU Providers

GPU CLI runs on your keys across four clouds. Here's how to pick.

When to choose which

RunPod

The managed default. Secure Cloud, encrypted volumes, serverless.

Pick it for
  • You want one provider to standardise on
  • You need encrypted persistent volumes
  • You run production inference or serverless endpoints
gpu auth runpod

Vast.ai

Peer-to-peer marketplace. Widest GPU variety across 40+ DCs.

Pick it for
  • You want a wide marketplace of on-demand listings
  • You are experimenting with many short-lived pods
  • You can tolerate marketplace-floor pricing variance
gpu auth vast

Thunder Compute

Stable, low on-demand rates for datacenter-class H100 / A100.

Pick it for
  • You want stable on-demand H100 or A100 pricing
  • SOC 2 Type II in progress; GDPR posture matters
  • You are OK with a single Quebec datacenter
gpu auth thunder

IO

Decentralized GPU network. Broadest geographic reach, deploy-time pricing.

Pick it for
  • You want decentralized capacity across many regions
  • Ephemeral GPU VMs fit your workflow (no persistent volumes)
  • You're OK with prepaid credits and quote-at-deploy pricing
gpu auth ionet

Features

FeatureRunPodVast.aiThunderIO
Encrypted persistent volumesLUKS, ephemeral
SSH proxy (no public IP)
Serverless endpoints
Lower-cost tierCommunity CloudMarketplace
Billing granularityper-secondper-secondper-minuteprepaid
Datacenter coverage30+ regions40+ DCsQuebec, CADecentralized

Hourly pricing

GPURunPodVast.aiThunderIO
B200$5.98from $3.63N/A*
H200 SXM$3.99from $2.32N/A*
H100 NVL$3.07from $1.47N/A*
H100 SXM$2.99from $1.34N/A*
H100 PCIe$2.39from $1.54$1.38*
RTX Pro 6000 (96GB)$1.89from $0.87N/A*
A100 SXM 80GB$1.49from $0.80N/A*
A100 PCIe 80GB$1.39from $0.73$0.78*
A100 PCIe 40GBN/Afrom $0.80N/A*
L40S$0.86from $0.47$0.99*
L40$0.99from $0.40$0.89*
RTX 6000 Ada$0.77from $0.47N/A*
RTX 5090$0.99from $0.35N/A*
RTX 4090$0.69from $0.29N/A*
A40$0.44from $0.29N/A*
RTX A6000$0.49from $0.23$0.27*
RTX 3090$0.46from $0.13N/A*
L4$0.44from $0.27N/A*
RTX A5000$0.27from $0.19N/A*

* IO publishes no per-GPU rates. Pricing is quoted per deployment via the io.net API, billed from prepaid credits with a one-hour minimum, and varies with its decentralized supplier market.

RunPod prices assume Secure Cloud (the higher tier). The Community Cloud rate is usually lower. Vast.ai is a peer-to-peer marketplace, listed prices are on-demand floors set by hosts. Prices accurate as of May 2026. Rates change, check RunPod, Vast.ai, Thunder Compute & IO for live pricing.