# arXiv cs.AI: GPU-cluster underuse in a fine-grained monitoring study [Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-gpu-cluster-underuse-in-a-fine-grained-monitoring-1e148b53) In their paper, Andrew Sheinberg, Samyak Gupta and Kai Li report substantial underuse and scheduling mismatches in a university research GPU cluster. Their tool measured GPU resource use at 100 ms intervals, while earlier monitoring often used second- or minute-level intervals. The study covered 10 days of activity: 7,399 jobs submitted by 150 users across 12 departments. The authors report that over 70% of jobs used less than 20% of GPU memory, and 50% averaged below 5% Streaming Multiprocessor (SM) utilization. They also found that 80% of jobs had a drastic mismatch between requested and actual durations, which they say limited the scheduler’s effectiveness. The authors argue that better job scheduling and GPU multitasking could improve utilization without hardware or application improvements. These findings point to possible gains from changing how existing cluster resources are allocated, rather than adding hardware. But the paper’s abstract describes one university cluster and a 10-day study period; it does not establish how much improvement a scheduling change would deliver or whether the findings apply to other clusters. What scheduling changes would improve utilization in this cluster, and how much would they help? Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: Oct 26, 2026 (2026-10-26). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-05T12:17:02.811Z. First observed: 2026-10-28T04:20:33.352Z. Retrieved: 2026-10-29T20:31:05.962Z. - [Plenty of Room in the Middle: Revealing Opportunities on a GPU Cluster via Fine-Grained Monitoring](https://arxiv.org/abs/2610.36329) ## Limits The reported results concern one university research GPU cluster and a 10-day period; the abstract does not establish whether they generalize to other clusters. The abstract proposes utilization gains from better scheduling and GPU multitasking but does not report a measured improvement from implementing them. The abstract does not give details needed to assess how representative the selected 10-day period was. ## Open question What scheduling changes would improve utilization in this cluster, and how much would they help? ## Source-stated The authors analyzed a university research GPU cluster using monitoring at 100 ms intervals. > analyzing resource usage at 100 ms intervals - [Supporting source](https://arxiv.org/abs/2610.36329) ## Source-stated The paper focuses on a 10-day period containing 7,399 jobs submitted by 150 users from 12 departments. > a 10-day period with 7,399 jobs submitted by 150 users from 12 departments - [Supporting source](https://arxiv.org/abs/2610.36329) ## Source-stated The authors report that over 70% of jobs used less than 20% of GPU memory, and 50% averaged below 5% Streaming Multiprocessor (SM) utilization. > over 70% of jobs using less than 20% of GPU memory and 50% averaging below 5% Streaming Multiprocessor (SM) utilization - [Supporting source](https://arxiv.org/abs/2610.36329) ## Source-stated The authors say 80% of jobs had a major mismatch between requested and actual durations, limiting scheduler effectiveness. > 80% of jobs have a drastic mismatch between their requested and actual durations, significantly limiting the scheduler's effectiveness - [Supporting source](https://arxiv.org/abs/2610.36329) ## Source-stated The authors argue that better scheduling and GPU multitasking could increase utilization without hardware or application improvements. > substantial utilization gains are available through better job scheduling and GPU multitasking, independent of hardware or application improvements - [Supporting source](https://arxiv.org/abs/2610.36329) ## Source and contributor context Sheinberg, Andrew, Gupta, Samyak, Li, Kai · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Graphics processing unit A chip that performs many calculations at once; the main hardware used to train and run AI models. - [Definition reference](https://en.wikipedia.org/wiki/Graphics_processing_unit) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: efa289da-6c7e-44fd-89bf-d4de46c02290. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-05T12:17:02.811Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: useful\_perspective. Observation: cac82cc564639bdc9c946fe93ea9a6f67bcf306332d8eed43a69a34ee4e6b954. Source text hash: 0b509a77882fbfd8dd7e487ef6a4d0b5abdc683ce356193b4f2da34d4c9f24be. ## Revision and source-check history ### Version 1 — 2026-11-05T12:17:02.811Z In their paper, Andrew Sheinberg, Samyak Gupta and Kai Li report substantial underuse and scheduling mismatches in a university research GPU cluster. Their tool measured GPU resource use at 100 ms intervals, while earlier monitoring often used second- or minute-level intervals. The study covered 10 days of activity: 7,399 jobs submitted by 150 users across 12 departments. The authors report that over 70% of jobs used less than 20% of GPU memory, and 50% averaged below 5% Streaming Multiprocessor (SM) utilization. They also found that 80% of jobs had a drastic mismatch between requested and actual durations, which they say limited the scheduler’s effectiveness. The authors argue that better job scheduling and GPU multitasking could improve utilization without hardware or application improvements. These findings point to possible gains from changing how existing cluster resources are allocated, rather than adding hardware. But the paper’s abstract describes one university cluster and a 10-day study period; it does not establish how much improvement a scheduling change would deliver or whether the findings apply to other clusters. What scheduling changes would improve utilization in this cluster, and how much would they help? ## Original source arXiv cs.AI · Article Original source date: Oct 26, 2026 (2026-10-26). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-05T12:17:02.811Z. First observed: 2026-10-28T04:20:33.352Z. Retrieved: 2026-10-29T20:31:05.962Z. - [Plenty of Room in the Middle: Revealing Opportunities on a GPU Cluster via Fine-Grained Monitoring](https://arxiv.org/abs/2610.36329) ## Limits The reported results concern one university research GPU cluster and a 10-day period; the abstract does not establish whether they generalize to other clusters. The abstract proposes utilization gains from better scheduling and GPU multitasking but does not report a measured improvement from implementing them. The abstract does not give details needed to assess how representative the selected 10-day period was. ## Open question What scheduling changes would improve utilization in this cluster, and how much would they help? ## Source-stated The authors analyzed a university research GPU cluster using monitoring at 100 ms intervals. > analyzing resource usage at 100 ms intervals - [Supporting source](https://arxiv.org/abs/2610.36329) ## Source-stated The paper focuses on a 10-day period containing 7,399 jobs submitted by 150 users from 12 departments. > a 10-day period with 7,399 jobs submitted by 150 users from 12 departments - [Supporting source](https://arxiv.org/abs/2610.36329) ## Source-stated The authors report that over 70% of jobs used less than 20% of GPU memory, and 50% averaged below 5% Streaming Multiprocessor (SM) utilization. > over 70% of jobs using less than 20% of GPU memory and 50% averaging below 5% Streaming Multiprocessor (SM) utilization - [Supporting source](https://arxiv.org/abs/2610.36329) ## Source-stated The authors say 80% of jobs had a major mismatch between requested and actual durations, limiting scheduler effectiveness. > 80% of jobs have a drastic mismatch between their requested and actual durations, significantly limiting the scheduler's effectiveness - [Supporting source](https://arxiv.org/abs/2610.36329) ## Source-stated The authors argue that better scheduling and GPU multitasking could increase utilization without hardware or application improvements. > substantial utilization gains are available through better job scheduling and GPU multitasking, independent of hardware or application improvements - [Supporting source](https://arxiv.org/abs/2610.36329) ## Source and contributor context Sheinberg, Andrew, Gupta, Samyak, Li, Kai · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Graphics processing unit A chip that performs many calculations at once; the main hardware used to train and run AI models. - [Definition reference](https://en.wikipedia.org/wiki/Graphics_processing_unit) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: efa289da-6c7e-44fd-89bf-d4de46c02290. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-05T12:17:02.811Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: useful\_perspective. Observation: cac82cc564639bdc9c946fe93ea9a6f67bcf306332d8eed43a69a34ee4e6b954. Source text hash: 0b509a77882fbfd8dd7e487ef6a4d0b5abdc683ce356193b4f2da34d4c9f24be. ### uncertain — 2026-11-05T12:17:02.811Z — anthropic/claude-opus-5.5 Publication: efa289da-6c7e-44fd-89bf-d4de46c02290 attribution — pass: The reading correctly credits Andrew Sheinberg, Samyak Gupta and Kai Li and keeps the findings and the scheduling argument attributed to the authors. It does not present them as established fact. > Authors:Andrew Sheinberg, Samyak Gupta, Kai Li summary — uncertain: The reading leaves out the human stake that motivates the paper: GPUs are costly and in high demand, so users face long queueing delays. Without it, a general reader may not see why underuse matters. Smallest repair: add one sentence on cost and queueing delays. It also omits finding (3), the periodic multi-GPU communication patterns, and the open-source tool. Central terms such as Streaming Multiprocessor (SM) utilization and scheduler are not explained in plain language; suggest term-library entries. Separately, the summary repeats the question verbatim at the end. > their high cost and growing demand often result in long queueing delays date — pass: The displayed date, 2026-10-26, matches the v1 arXiv submission date. The comment that the paper was originally written in fall 2024 describes when it was written, not when it was first published, so it does not change the date. > \[Submitted on 26 Oct 2026\] support — pass: All numeric claims match the abstract, as do the 100 ms interval and the comparison with earlier second- or minute-level monitoring. The scheduling and multitasking argument is attributed to the authors. The reading labels the gains as possible and notes that one cluster and one 10-day period do not establish the size of any improvement or whether the findings generalize. The question follows from the evidence. > substantial utilization gains are available through better job scheduling and GPU multitasking, independent of hardware or application improvements media — pass: The selected media is the verified direct link to the original arXiv abstract page, which is the most direct way to reach the source. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/1e148b534d04321b9286021699a20ca237b77e50eab30e33016a188f2c42d4ad/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-gpu-cluster-underuse-in-a-fine-grained-monitoring-1e148b53.json)