All topicsSTATE OF AI REPORT COMPUTE INDEX.

Does high GPU utilization mean a profitable data center?

Metric definitions · reviewed October 11, 2026

No. GPU utilization, billable occupancy, and profitability measure different things. A hardware utilization metric can show that a GPU is busy without showing how much useful work it completes or what a customer pays. NVIDIA’s NVML GPU-utilization measure records the share of a sampling interval during which at least one kernel runs; it is not a percentage of peak computing performance. Profitability depends on revenue relative to the costs of providing that capacity.

How to read this finding

Ask which utilization measure is being reported: capacity reserved by customers, hours billed, time running kernels, or useful throughput relative to a workload benchmark. These measures are not interchangeable. Take-or-pay contracts can produce revenue even when a customer leaves reserved hardware idle, while a busy internal research cluster may have no external rental revenue. Neither case alone establishes a return on investment. The index records selected hardware counts and reported access, not utilization, customer payments, or operator margins.

Charts and sources

  1. NVIDIA NVML utilization definition
  2. CoreWeave 2025 annual report: committed contracts and costs
  3. Index scope

Company filings and hardware documentation reviewed October 11, 2026. Accounting examples use 2025 annual reports; vendor claims are attributed. Research citations do not measure profitability, and this index has no rental-price or resale-value series.

All data sources

Cite this page

Benaich, Nathan. “Does high GPU utilization mean a profitable data center?” State of AI Report Compute Index. Web page updated 2026-10-11; data periods as specified above.

Related questions

How long do AI chips remain useful?Can older GPUs remain competitive for inference?Does six-year GPU depreciation mean six years of profitability?What happens to GPU rental prices and resale values when new chips arrive?What determines the total cost of running AI GPUs?