arXiv cs.AI: GPU-cluster underuse in a fine-grained monitoring study

arXiv cs.AI: GPU-cluster underuse in a fine-grained monitoring study

In their paper, Andrew Sheinberg, Samyak Gupta and Kai Li report substantial underuse and scheduling mismatches in a university research GPU cluster. Their tool measured GPU resource use at 100 ms intervals, while earlier monitoring often used second- or minute-level intervals. The study covered 10 days of activity: 7,399 jobs submitted by 150 users across 12 departments. The authors report that over 70% of jobs used less than 20% of GPU memory, and 50% averaged below 5% Streaming Multiprocessor (SM) utilization. They also found that 80% of jobs had a drastic mismatch between requested and actual durations, which they say limited the scheduler’s effectiveness. The authors argue that better job scheduling and GPU multitasking could improve utilization without hardware or application improvements. These findings point to possible gains from changing how existing cluster resources are allocated, rather than adding hardware. But the paper’s abstract describes one university cluster and a 10-day study period; it does not establish how much improvement a scheduling change would deliver or whether the findings apply to other clusters. What scheduling changes would improve utilization in this cluster, and how much would they help?

Publication: efa289da-6c7e-44fd-89bf-d4de46c02290

attribution — pass: The reading correctly credits Andrew Sheinberg, Samyak Gupta and Kai Li and keeps the findings and the scheduling argument attributed to the authors. It does not present them as established fact.

Authors:Andrew Sheinberg, Samyak Gupta, Kai Li

summary — uncertain: The reading leaves out the human stake that motivates the paper: GPUs are costly and in high demand, so users face long queueing delays. Without it, a general reader may not see why underuse matters. Smallest repair: add one sentence on cost and queueing delays. It also omits finding (3), the periodic multi-GPU communication patterns, and the open-source tool. Central terms such as Streaming Multiprocessor (SM) utilization and scheduler are not explained in plain language; suggest term-library entries. Separately, the summary repeats the question verbatim at the end.

their high cost and growing demand often result in long queueing delays

date — pass: The displayed date, 2026-10-26, matches the v1 arXiv submission date. The comment that the paper was originally written in fall 2024 describes when it was written, not when it was first published, so it does not change the date.

[Submitted on 26 Oct 2026]

support — pass: All numeric claims match the abstract, as do the 100 ms interval and the comparison with earlier second- or minute-level monitoring. The scheduling and multitasking argument is attributed to the authors. The reading labels the gains as possible and notes that one cluster and one 10-day period do not establish the size of any improvement or whether the findings generalize. The question follows from the evidence.

substantial utilization gains are available through better job scheduling and GPU multitasking, independent of hardware or application improvements

media — pass: The selected media is the verified direct link to the original arXiv abstract page, which is the most direct way to reach the source.