{"id":"5c93645da8744db24b0f35d8646a7c8703b3c20b54781fc37b09edeeebb37d58","title":"arXiv cs.AI paper: AutoCompress: Automated Hardware-Guided Model Compression","argument":"The authors of AutoCompress argue that model size alone is a poor guide to whether a compressed LLM will meet the latency, throughput and memory limits of a particular workload and hardware setup. They introduce a framework that incorporates those constraints into differentiable architecture search, jointly optimizing model structure globally and by layer. Serving-engine cost models guide the framework and are validated against end-to-end latency, throughput and memory measurements.\n\nAcross three settings—local coding with long contexts, batched datacenter serving and latency-sensitive in-game interaction—the authors report higher average accuracy than the Minitron pruning framework on eight benchmarks. The reported gains vary by hardware, from 0.57 to 6.57 percentage points. In another result, they compress Nemotron 3.5 Super from 120B to 74B parameters for single-B200 BF16 serving at 128K context, retaining 95% of its mean benchmark score. These are reported evaluation results, not evidence here of performance across other models, hardware or workloads. The paper’s central idea is to design compression around the conditions of serving, rather than parameter count alone.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv abstract; it does not include the full paper’s experimental details or benchmark results. The abstract reports results for three settings and specified hardware, but does not establish performance for other models, hardware or workloads.","speaker":{"name":"Liang, Sheldon, Taghibakhshi, Ali, Muralidharan, Saurav, Sreenivas, Sharath Turuvekere, Aithal, Ashwath, Molchanov, Pavlo, Tajbakhsh, Nima","roleAtSource":"Article author"},"source":{"title":"AutoCompress: Automated Hardware-Guided Model Compression","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.08290","publishedAt":"2026-11-05","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors argue that parameter count alone does not predict latency, throughput or memory use, which vary with model architecture, workload, hardware and serving engine.","excerpt":"parameter count alone does not predict these metrics, which depend on the model architecture, workload, hardware, and serving engine.","url":"https://arxiv.org/abs/2611.08290","relationship":"Source-stated"},{"text":"AutoCompress incorporates serving constraints into differentiable architecture search and jointly optimizes global and per-layer structure.","excerpt":"jointly optimizes global and per-layer structure to produce heterogeneous architectures","url":"https://arxiv.org/abs/2611.08290","relationship":"Source-stated"},{"text":"Against Minitron, the authors report average accuracy gains across eight benchmarks of 6.57, 2.35 and 0.57 percentage points on RTX 5070, RTX 5080 and H100, respectively.","excerpt":"improves average accuracy across eight benchmarks by 6.57, 2.35, and 0.57 percentage points on RTX 5070, RTX 5080, and H100, respectively.","url":"https://arxiv.org/abs/2611.08290","relationship":"Source-stated"},{"text":"The authors report compressing Nemotron 3.5 Super from 120B to 74B parameters for single-B200 BF16 serving at 128K context while retaining 95% of its mean benchmark score.","excerpt":"compresses Nemotron 3.5 Super from 120B to 74B parameters for single-B200 BF16 serving at 128K context, retaining 95% of its mean benchmark score.","url":"https://arxiv.org/abs/2611.08290","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.08290","checkedAt":"2026-11-09T03:48:09.500Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well do the reported results carry over to models, hardware and workloads beyond the three evaluated settings?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI paper: AutoCompress: Automated Hardware-Guided Model Compression","summary":"The authors of AutoCompress argue that model size alone is a poor guide to whether a compressed LLM will meet the latency, throughput and memory limits of a particular workload and hardware setup. They introduce a framework that incorporates those constraints into differentiable architecture search, jointly optimizing model structure globally and by layer. Serving-engine cost models guide the framework and are validated against end-to-end latency, throughput and memory measurements.\n\nAcross three settings—local coding with long contexts, batched datacenter serving and latency-sensitive in-game interaction—the authors report higher average accuracy than the Minitron pruning framework on eight benchmarks. The reported gains vary by hardware, from 0.57 to 6.57 percentage points. In another result, they compress Nemotron 3.5 Super from 120B to 74B parameters for single-B200 BF16 serving at 128K context, retaining 95% of its mean benchmark score. These are reported evaluation results, not evidence here of performance across other models, hardware or workloads. The paper’s central idea is to design compression around the conditions of serving, rather than parameter count alone.","question":"How well do the reported results carry over to models, hardware and workloads beyond the three evaluated settings?","claims":[{"text":"The authors argue that parameter count alone does not predict latency, throughput or memory use, which vary with model architecture, workload, hardware and serving engine.","excerpt":"parameter count alone does not predict these metrics, which depend on the model architecture, workload, hardware, and serving engine.","support":"source-stated"},{"text":"AutoCompress incorporates serving constraints into differentiable architecture search and jointly optimizes global and per-layer structure.","excerpt":"jointly optimizes global and per-layer structure to produce heterogeneous architectures","support":"source-stated"},{"text":"Against Minitron, the authors report average accuracy gains across eight benchmarks of 6.57, 2.35 and 0.57 percentage points on RTX 5070, RTX 5080 and H100, respectively.","excerpt":"improves average accuracy across eight benchmarks by 6.57, 2.35, and 0.57 percentage points on RTX 5070, RTX 5080, and H100, respectively.","support":"source-stated"},{"text":"The authors report compressing Nemotron 3.5 Super from 120B to 74B parameters for single-B200 BF16 serving at 128K context while retaining 95% of its mean benchmark score.","excerpt":"compresses Nemotron 3.5 Super from 120B to 74B parameters for single-B200 BF16 serving at 128K context, retaining 95% of its mean benchmark score.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv abstract; it does not include the full paper’s experimental details or benchmark results.","The abstract reports results for three settings and specified hardware, but does not establish performance for other models, hardware or workloads."],"mediaId":"f7586dac4a968857e755f8e7618e1ebe811d5e3820dd345ad306c6c4df5ab9b1","correctionReason":"Corrected the description of the cost models to reflect that serving-engine cost models guide the framework and are validated against end-to-end measurements.","id":"5c93645da8744db24b0f35d8646a7c8703b3c20b54781fc37b09edeeebb37d58","publicationId":"8193d292-4c39-48b5-8940-e41e564504e9","version":1,"sourceUrl":"https://arxiv.org/abs/2611.08290","sourceTitle":"AutoCompress: Automated Hardware-Guided Model Compression","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-05","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-06T05:12:31.174Z","createdAt":"2026-11-09T03:16:33.246Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"f7586dac4a968857e755f8e7618e1ebe811d5e3820dd345ad306c6c4df5ab9b1","kind":"article","url":"https://arxiv.org/abs/2611.08290","sourceUrl":"https://arxiv.org/abs/2611.08290","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T03:03:32.402Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.08290","checkedAt":"2026-11-09T03:48:09.500Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"f7586dac4a968857e755f8e7618e1ebe811d5e3820dd345ad306c6c4df5ab9b1","confidence":0.93,"provider":"typesafe","model":"jev-1.13.0","inputHash":"fec3a899e24490191a1a5e7457315398cc755167994458252cf4b9bfa63168fd","decidedAt":"2026-11-09T03:03:33.535Z"},"provenance":{"textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observationId":"db80255b13251e71d08753949af078519db89476c60baf7e23b3640827072a00","retrievedAt":"2026-11-09T03:03:31.711Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"2ea6fb70-c628-4f69-81b6-8019efd0ee79"},"reviewer":{"model":"gpt-6-luna","runId":"48dbc0f7-70c9-46aa-8c6a-c68e79576ae6"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T03:16:33.246Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Liang, Sheldon","url":null,"kind":"unknown"},{"name":"Taghibakhshi, Ali","url":null,"kind":"unknown"},{"name":"Muralidharan, Saurav","url":null,"kind":"unknown"},{"name":"Sreenivas, Sharath Turuvekere","url":null,"kind":"unknown"},{"name":"Aithal, Ashwath","url":null,"kind":"unknown"},{"name":"Molchanov, Pavlo","url":null,"kind":"unknown"},{"name":"Tajbakhsh, Nima","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Liang, Sheldon","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Liang, Sheldon","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08290","locator":"head/meta[name=author|citation_author]"},"assertionId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:48:09.500Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df","sourceUrl":"https://arxiv.org/abs/2611.08290","contentSha256":"6da7648c4f3d3c63ead770d4bcb754802465f38d7c20a3dc75a504ac77e5757b","textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observedAt":"2026-11-09T03:48:09.500Z"}},{"actor":{"name":"Taghibakhshi, Ali","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Taghibakhshi, Ali","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08290","locator":"head/meta[name=author|citation_author]"},"assertionId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:48:09.500Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df","sourceUrl":"https://arxiv.org/abs/2611.08290","contentSha256":"6da7648c4f3d3c63ead770d4bcb754802465f38d7c20a3dc75a504ac77e5757b","textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observedAt":"2026-11-09T03:48:09.500Z"}},{"actor":{"name":"Muralidharan, Saurav","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Muralidharan, Saurav","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08290","locator":"head/meta[name=author|citation_author]"},"assertionId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:48:09.500Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df","sourceUrl":"https://arxiv.org/abs/2611.08290","contentSha256":"6da7648c4f3d3c63ead770d4bcb754802465f38d7c20a3dc75a504ac77e5757b","textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observedAt":"2026-11-09T03:48:09.500Z"}},{"actor":{"name":"Sreenivas, Sharath Turuvekere","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sreenivas, Sharath Turuvekere","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08290","locator":"head/meta[name=author|citation_author]"},"assertionId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:48:09.500Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df","sourceUrl":"https://arxiv.org/abs/2611.08290","contentSha256":"6da7648c4f3d3c63ead770d4bcb754802465f38d7c20a3dc75a504ac77e5757b","textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observedAt":"2026-11-09T03:48:09.500Z"}},{"actor":{"name":"Aithal, Ashwath","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Aithal, Ashwath","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08290","locator":"head/meta[name=author|citation_author]"},"assertionId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:48:09.500Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df","sourceUrl":"https://arxiv.org/abs/2611.08290","contentSha256":"6da7648c4f3d3c63ead770d4bcb754802465f38d7c20a3dc75a504ac77e5757b","textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observedAt":"2026-11-09T03:48:09.500Z"}},{"actor":{"name":"Molchanov, Pavlo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Molchanov, Pavlo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08290","locator":"head/meta[name=author|citation_author]"},"assertionId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:48:09.500Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df","sourceUrl":"https://arxiv.org/abs/2611.08290","contentSha256":"6da7648c4f3d3c63ead770d4bcb754802465f38d7c20a3dc75a504ac77e5757b","textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observedAt":"2026-11-09T03:48:09.500Z"}},{"actor":{"name":"Tajbakhsh, Nima","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Tajbakhsh, Nima","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08290","locator":"head/meta[name=author|citation_author]"},"assertionId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:48:09.500Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df","sourceUrl":"https://arxiv.org/abs/2611.08290","contentSha256":"6da7648c4f3d3c63ead770d4bcb754802465f38d7c20a3dc75a504ac77e5757b","textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observedAt":"2026-11-09T03:48:09.500Z"}}],"participationCoverage":{"total":7,"returned":7,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.08290","snapshotId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df","contentSha256":"6da7648c4f3d3c63ead770d4bcb754802465f38d7c20a3dc75a504ac77e5757b","textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observedAt":"2026-11-09T03:48:09.500Z","basis":"publisher-page-metadata","sourceLinks":47,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/5c93645da8744db24b0f35d8646a7c8703b3c20b54781fc37b09edeeebb37d58/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-paper-autocompress-automated-hardware-guided-model-5c93645d","formats":{"html":"/readings/arxiv-cs-ai-paper-autocompress-automated-hardware-guided-model-5c93645d","markdown":"/readings/arxiv-cs-ai-paper-autocompress-automated-hardware-guided-model-5c93645d.md","json":"/readings/arxiv-cs-ai-paper-autocompress-automated-hardware-guided-model-5c93645d.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"},{"id":"term-latency","name":"Latency","explanation":"The delay between sending a request and receiving the result.","referenceUrl":"https://developers.google.com/machine-learning/glossary#latency"},{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"},{"id":"term-parameters","name":"Model parameters","explanation":"The internal numbers a model adjusts during training; their count is a rough measure of a model's size.","referenceUrl":"https://developers.google.com/machine-learning/glossary#parameter"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"5c93645da8744db24b0f35d8646a7c8703b3c20b54781fc37b09edeeebb37d58","revision":"8193d292-4c39-48b5-8940-e41e564504e9","revisionKind":"publication-id","title":"arXiv cs.AI paper: AutoCompress: Automated Hardware-Guided Model Compression","url":"https://escapemeridian.com/readings/arxiv-cs-ai-paper-autocompress-automated-hardware-guided-model-5c93645d"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.08290","revision":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","revisionKind":"sha256-source-text","title":"AutoCompress: Automated Hardware-Guided Model Compression","url":"https://arxiv.org/abs/2611.08290"},"status":"partial","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"5c93645da8744db24b0f35d8646a7c8703b3c20b54781fc37b09edeeebb37d58","title":"arXiv cs.AI paper: AutoCompress: Automated Hardware-Guided Model Compression","argument":"The authors of AutoCompress argue that model size alone is a poor guide to whether a compressed LLM will meet the latency, throughput and memory limits of a particular workload and hardware setup. They introduce a framework that incorporates those constraints into differentiable architecture search, jointly optimizing model structure globally and by layer. Serving-engine cost models guide the framework and are validated against end-to-end latency, throughput and memory measurements.\n\nAcross three settings—local coding with long contexts, batched datacenter serving and latency-sensitive in-game interaction—the authors report higher average accuracy than the Minitron pruning framework on eight benchmarks. The reported gains vary by hardware, from 0.57 to 6.57 percentage points. In another result, they compress Nemotron 3.5 Super from 120B to 74B parameters for single-B200 BF16 serving at 128K context, retaining 95% of its mean benchmark score. These are reported evaluation results, not evidence here of performance across other models, hardware or workloads. The paper’s central idea is to design compression around the conditions of serving, rather than parameter count alone.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv abstract; it does not include the full paper’s experimental details or benchmark results. The abstract reports results for three settings and specified hardware, but does not establish performance for other models, hardware or workloads.","speaker":{"name":"Liang, Sheldon, Taghibakhshi, Ali, Muralidharan, Saurav, Sreenivas, Sharath Turuvekere, Aithal, Ashwath, Molchanov, Pavlo, Tajbakhsh, Nima","roleAtSource":"Article author"},"source":{"title":"AutoCompress: Automated Hardware-Guided Model Compression","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.08290","publishedAt":"2026-11-05","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors argue that parameter count alone does not predict latency, throughput or memory use, which vary with model architecture, workload, hardware and serving engine.","excerpt":"parameter count alone does not predict these metrics, which depend on the model architecture, workload, hardware, and serving engine.","url":"https://arxiv.org/abs/2611.08290","relationship":"Source-stated"},{"text":"AutoCompress incorporates serving constraints into differentiable architecture search and jointly optimizes global and per-layer structure.","excerpt":"jointly optimizes global and per-layer structure to produce heterogeneous architectures","url":"https://arxiv.org/abs/2611.08290","relationship":"Source-stated"},{"text":"Against Minitron, the authors report average accuracy gains across eight benchmarks of 6.57, 2.35 and 0.57 percentage points on RTX 5070, RTX 5080 and H100, respectively.","excerpt":"improves average accuracy across eight benchmarks by 6.57, 2.35, and 0.57 percentage points on RTX 5070, RTX 5080, and H100, respectively.","url":"https://arxiv.org/abs/2611.08290","relationship":"Source-stated"},{"text":"The authors report compressing Nemotron 3.5 Super from 120B to 74B parameters for single-B200 BF16 serving at 128K context while retaining 95% of its mean benchmark score.","excerpt":"compresses Nemotron 3.5 Super from 120B to 74B parameters for single-B200 BF16 serving at 128K context, retaining 95% of its mean benchmark score.","url":"https://arxiv.org/abs/2611.08290","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.08290","checkedAt":"2026-11-09T03:48:09.500Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well do the reported results carry over to models, hardware and workloads beyond the three evaluated settings?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI paper: AutoCompress: Automated Hardware-Guided Model Compression","summary":"The authors of AutoCompress argue that model size alone is a poor guide to whether a compressed LLM will meet the latency, throughput and memory limits of a particular workload and hardware setup. They introduce a framework that incorporates those constraints into differentiable architecture search, jointly optimizing model structure globally and by layer. Serving-engine cost models guide the framework and are validated against end-to-end latency, throughput and memory measurements.\n\nAcross three settings—local coding with long contexts, batched datacenter serving and latency-sensitive in-game interaction—the authors report higher average accuracy than the Minitron pruning framework on eight benchmarks. The reported gains vary by hardware, from 0.57 to 6.57 percentage points. In another result, they compress Nemotron 3.5 Super from 120B to 74B parameters for single-B200 BF16 serving at 128K context, retaining 95% of its mean benchmark score. These are reported evaluation results, not evidence here of performance across other models, hardware or workloads. The paper’s central idea is to design compression around the conditions of serving, rather than parameter count alone.","question":"How well do the reported results carry over to models, hardware and workloads beyond the three evaluated settings?","claims":[{"text":"The authors argue that parameter count alone does not predict latency, throughput or memory use, which vary with model architecture, workload, hardware and serving engine.","excerpt":"parameter count alone does not predict these metrics, which depend on the model architecture, workload, hardware, and serving engine.","support":"source-stated"},{"text":"AutoCompress incorporates serving constraints into differentiable architecture search and jointly optimizes global and per-layer structure.","excerpt":"jointly optimizes global and per-layer structure to produce heterogeneous architectures","support":"source-stated"},{"text":"Against Minitron, the authors report average accuracy gains across eight benchmarks of 6.57, 2.35 and 0.57 percentage points on RTX 5070, RTX 5080 and H100, respectively.","excerpt":"improves average accuracy across eight benchmarks by 6.57, 2.35, and 0.57 percentage points on RTX 5070, RTX 5080, and H100, respectively.","support":"source-stated"},{"text":"The authors report compressing Nemotron 3.5 Super from 120B to 74B parameters for single-B200 BF16 serving at 128K context while retaining 95% of its mean benchmark score.","excerpt":"compresses Nemotron 3.5 Super from 120B to 74B parameters for single-B200 BF16 serving at 128K context, retaining 95% of its mean benchmark score.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv abstract; it does not include the full paper’s experimental details or benchmark results.","The abstract reports results for three settings and specified hardware, but does not establish performance for other models, hardware or workloads."],"mediaId":"f7586dac4a968857e755f8e7618e1ebe811d5e3820dd345ad306c6c4df5ab9b1","correctionReason":"Corrected the description of the cost models to reflect that serving-engine cost models guide the framework and are validated against end-to-end measurements.","id":"5c93645da8744db24b0f35d8646a7c8703b3c20b54781fc37b09edeeebb37d58","publicationId":"8193d292-4c39-48b5-8940-e41e564504e9","version":1,"sourceUrl":"https://arxiv.org/abs/2611.08290","sourceTitle":"AutoCompress: Automated Hardware-Guided Model Compression","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-05","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-06T05:12:31.174Z","createdAt":"2026-11-09T03:16:33.246Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"f7586dac4a968857e755f8e7618e1ebe811d5e3820dd345ad306c6c4df5ab9b1","kind":"article","url":"https://arxiv.org/abs/2611.08290","sourceUrl":"https://arxiv.org/abs/2611.08290","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T03:03:32.402Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.08290","checkedAt":"2026-11-09T03:48:09.500Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"f7586dac4a968857e755f8e7618e1ebe811d5e3820dd345ad306c6c4df5ab9b1","confidence":0.93,"provider":"typesafe","model":"jev-1.13.0","inputHash":"fec3a899e24490191a1a5e7457315398cc755167994458252cf4b9bfa63168fd","decidedAt":"2026-11-09T03:03:33.535Z"},"provenance":{"textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observationId":"db80255b13251e71d08753949af078519db89476c60baf7e23b3640827072a00","retrievedAt":"2026-11-09T03:03:31.711Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"2ea6fb70-c628-4f69-81b6-8019efd0ee79"},"reviewer":{"model":"gpt-6-luna","runId":"48dbc0f7-70c9-46aa-8c6a-c68e79576ae6"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T03:16:33.246Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Liang, Sheldon","url":null,"kind":"unknown"},{"name":"Taghibakhshi, Ali","url":null,"kind":"unknown"},{"name":"Muralidharan, Saurav","url":null,"kind":"unknown"},{"name":"Sreenivas, Sharath Turuvekere","url":null,"kind":"unknown"},{"name":"Aithal, Ashwath","url":null,"kind":"unknown"},{"name":"Molchanov, Pavlo","url":null,"kind":"unknown"},{"name":"Tajbakhsh, Nima","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Liang, Sheldon","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Liang, Sheldon","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08290","locator":"head/meta[name=author|citation_author]"},"assertionId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:48:09.500Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df","sourceUrl":"https://arxiv.org/abs/2611.08290","contentSha256":"6da7648c4f3d3c63ead770d4bcb754802465f38d7c20a3dc75a504ac77e5757b","textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observedAt":"2026-11-09T03:48:09.500Z"}},{"actor":{"name":"Taghibakhshi, Ali","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Taghibakhshi, Ali","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08290","locator":"head/meta[name=author|citation_author]"},"assertionId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:48:09.500Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df","sourceUrl":"https://arxiv.org/abs/2611.08290","contentSha256":"6da7648c4f3d3c63ead770d4bcb754802465f38d7c20a3dc75a504ac77e5757b","textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observedAt":"2026-11-09T03:48:09.500Z"}},{"actor":{"name":"Muralidharan, Saurav","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Muralidharan, Saurav","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08290","locator":"head/meta[name=author|citation_author]"},"assertionId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:48:09.500Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df","sourceUrl":"https://arxiv.org/abs/2611.08290","contentSha256":"6da7648c4f3d3c63ead770d4bcb754802465f38d7c20a3dc75a504ac77e5757b","textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observedAt":"2026-11-09T03:48:09.500Z"}},{"actor":{"name":"Sreenivas, Sharath Turuvekere","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sreenivas, Sharath Turuvekere","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08290","locator":"head/meta[name=author|citation_author]"},"assertionId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:48:09.500Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df","sourceUrl":"https://arxiv.org/abs/2611.08290","contentSha256":"6da7648c4f3d3c63ead770d4bcb754802465f38d7c20a3dc75a504ac77e5757b","textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observedAt":"2026-11-09T03:48:09.500Z"}},{"actor":{"name":"Aithal, Ashwath","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Aithal, Ashwath","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08290","locator":"head/meta[name=author|citation_author]"},"assertionId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:48:09.500Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df","sourceUrl":"https://arxiv.org/abs/2611.08290","contentSha256":"6da7648c4f3d3c63ead770d4bcb754802465f38d7c20a3dc75a504ac77e5757b","textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observedAt":"2026-11-09T03:48:09.500Z"}},{"actor":{"name":"Molchanov, Pavlo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Molchanov, Pavlo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08290","locator":"head/meta[name=author|citation_author]"},"assertionId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:48:09.500Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df","sourceUrl":"https://arxiv.org/abs/2611.08290","contentSha256":"6da7648c4f3d3c63ead770d4bcb754802465f38d7c20a3dc75a504ac77e5757b","textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observedAt":"2026-11-09T03:48:09.500Z"}},{"actor":{"name":"Tajbakhsh, Nima","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Tajbakhsh, Nima","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08290","locator":"head/meta[name=author|citation_author]"},"assertionId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:48:09.500Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df","sourceUrl":"https://arxiv.org/abs/2611.08290","contentSha256":"6da7648c4f3d3c63ead770d4bcb754802465f38d7c20a3dc75a504ac77e5757b","textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observedAt":"2026-11-09T03:48:09.500Z"}}],"participationCoverage":{"total":7,"returned":7,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.08290","snapshotId":"533b1915f71b99edf6075e40f019f61ae860d6c66650a454290e74a31a8145df","contentSha256":"6da7648c4f3d3c63ead770d4bcb754802465f38d7c20a3dc75a504ac77e5757b","textHash":"70d21a7dd9841158a8af40d41ab242de5f5cfb6a617d4875243df0b5cc58368d","observedAt":"2026-11-09T03:48:09.500Z","basis":"publisher-page-metadata","sourceLinks":47,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/5c93645da8744db24b0f35d8646a7c8703b3c20b54781fc37b09edeeebb37d58/source"}}}],"audits":[{"publicationId":"8193d292-4c39-48b5-8940-e41e564504e9","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft consistently attributes the argument and results to the paper's authors as reported claims. It does not present them as established fact or as Escape Meridian's view, and it does not attribute the work to any unnamed organization.","excerpt":"We introduce AutoCompress, a hardware-guided compression framework that directly incorporates such constraints into differentiable architecture search."},{"dimension":"summary","status":"uncertain","explanation":"The summary is faithful, and the question follows from the evidence, but central terms go unexplained for a non-specialist. It never says in plain language what compressing or pruning an LLM means: shrinking a trained model so it runs within hardware limits. It also leaves differentiable architecture search, serving-engine cost models, latency/throughput, and the single-B200 BF16 at 128K context result unexplained. Smallest repair: add one plain sentence on what pruning does and why fitting a model to specific hardware matters, and gloss or tooltip the remaining terms.","excerpt":"LLM pruning must preserve quality while meeting hardware- and workload-specific constraints on latency, throughput, and memory."},{"dimension":"date","status":"pass","explanation":"The displayed original publication date of 2026-11-05 matches the arXiv v1 submission date. The feed date of Nov 6 is correctly not used.","excerpt":"[Submitted on 5 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"All four claims quote the abstract verbatim and preserve its figures, hardware, and scope. The draft frames the 0.57 to 6.57 point range as varying by hardware, which is accurate. Its limitations correctly note that the evidence is abstract-only and that generalization beyond the evaluated settings is not established. No benefits or costs are invented.","excerpt":"improves average accuracy across eight benchmarks by 6.57, 2.35, and 0.57 percentage points on RTX 5070, RTX 5080, and H100, respectively."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page, which is the original source itself and the most direct way to access the paper.","excerpt":null}],"createdAt":"2026-11-09T03:16:33.246Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}