{"id":"973621c8ffae13efc4f0bbde3ef3021cfcf1b21507355dab1fec2aef421f189f","title":"arXiv cs.AI: TileQuant assigns mixed precision to smaller weight tiles","argument":"Hanzhi Zhang and coauthors introduce TileQuant, a training-free framework for mixed-precision post-training quantization (PTQ) of large language models (LLMs). Instead of keeping entire columns at higher precision, TileQuant scores hardware-aligned 2D weight tiles, reflecting the authors’ argument that sensitivity can vary even within a column. Offline calibration can score tiles using input-activation-aware forward statistics or loss sensitivity; within a retention budget, the highest-scoring tiles stay at 16-bit and the rest use 8-bit. The resulting map guides reconstruction into compact weight buffers, which the kernel reuses for integer and 16-bit computation with local accumulation to reduce memory traffic. The authors report 2.66x the original model’s generation throughput and say quality is preserved across language modeling, reasoning, long-context retrieval, and question answering, with TileQuant surpassing quantized and original models on multiple tasks. The proposed approach links finer-grained precision allocation to hardware execution, rather than treating sensitivity and runtime efficiency as separate concerns. The abstract does not identify the evaluated models, hardware, or task-by-task results, so it does not show how broadly the reported throughput and quality findings apply.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract does not identify the evaluated models or hardware, or give task-by-task throughput and quality results; the reported results’ breadth cannot be assessed from this evidence alone.","speaker":{"name":"Zhang, Hanzhi, Zhang, Qiao, Cao, Qinglei, Fan, Heng, Huang, Yan, Sha, Kewei, Feng, Yunhe","roleAtSource":"Article author"},"source":{"title":"TileQuant: Tile as the Precision-Allocation Unit for LLM Mixed-Precision Post-Training Quantization","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.07217","publishedAt":"2026-11-04","dateBasis":"Date basis not provided."},"evidence":[{"text":"TileQuant assigns precision to hardware-aligned 2D weight tiles, rather than retaining whole columns at higher precision.","excerpt":"We therefore introduce TileQuant, a training-free framework that assigns precision to hardware-aligned 2D weight tiles.","url":"https://arxiv.org/abs/2611.07217","relationship":"Source-stated"},{"text":"TileQuant offers two offline calibration scoring approaches: input-activation-aware scoring from forward statistics and gradient-informed scoring from loss sensitivity.","excerpt":"Offline calibration provides input-activation-aware scoring from forward statistics for lower calibration cost and gradient-informed scoring from loss sensitivity for stronger quality preservation.","url":"https://arxiv.org/abs/2611.07217","relationship":"Source-stated"},{"text":"Within each projection’s retention budget, TileQuant keeps the highest-scoring tiles at 16-bit and uses 8-bit for the rest.","excerpt":"Within each projection's retention budget, the highest-scoring tiles remain at 16-bit and the rest use 8-bit.","url":"https://arxiv.org/abs/2611.07217","relationship":"Source-stated"},{"text":"The authors report that TileQuant reaches 2.66x the original model’s generation throughput.","excerpt":"Experiments show that TileQuant reaches 2.66x the original model's generation throughput.","url":"https://arxiv.org/abs/2611.07217","relationship":"Source-stated"},{"text":"The authors report preserved quality across four task areas and results exceeding quantized and original models on multiple tasks.","excerpt":"Across language modeling, reasoning, long-context retrieval, and question answering, it preserves quality and surpasses quantized and original models on multiple tasks.","url":"https://arxiv.org/abs/2611.07217","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.07217","checkedAt":"2026-11-08T04:38:08.080Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How do TileQuant’s reported throughput and quality results vary across the evaluated models, hardware, and tasks?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: TileQuant assigns mixed precision to smaller weight tiles","summary":"Hanzhi Zhang and coauthors introduce TileQuant, a training-free framework for mixed-precision post-training quantization (PTQ) of large language models (LLMs). Instead of keeping entire columns at higher precision, TileQuant scores hardware-aligned 2D weight tiles, reflecting the authors’ argument that sensitivity can vary even within a column. Offline calibration can score tiles using input-activation-aware forward statistics or loss sensitivity; within a retention budget, the highest-scoring tiles stay at 16-bit and the rest use 8-bit. The resulting map guides reconstruction into compact weight buffers, which the kernel reuses for integer and 16-bit computation with local accumulation to reduce memory traffic. The authors report 2.66x the original model’s generation throughput and say quality is preserved across language modeling, reasoning, long-context retrieval, and question answering, with TileQuant surpassing quantized and original models on multiple tasks. The proposed approach links finer-grained precision allocation to hardware execution, rather than treating sensitivity and runtime efficiency as separate concerns. The abstract does not identify the evaluated models, hardware, or task-by-task results, so it does not show how broadly the reported throughput and quality findings apply.","question":"How do TileQuant’s reported throughput and quality results vary across the evaluated models, hardware, and tasks?","claims":[{"text":"TileQuant assigns precision to hardware-aligned 2D weight tiles, rather than retaining whole columns at higher precision.","excerpt":"We therefore introduce TileQuant, a training-free framework that assigns precision to hardware-aligned 2D weight tiles.","support":"source-stated"},{"text":"TileQuant offers two offline calibration scoring approaches: input-activation-aware scoring from forward statistics and gradient-informed scoring from loss sensitivity.","excerpt":"Offline calibration provides input-activation-aware scoring from forward statistics for lower calibration cost and gradient-informed scoring from loss sensitivity for stronger quality preservation.","support":"source-stated"},{"text":"Within each projection’s retention budget, TileQuant keeps the highest-scoring tiles at 16-bit and uses 8-bit for the rest.","excerpt":"Within each projection's retention budget, the highest-scoring tiles remain at 16-bit and the rest use 8-bit.","support":"source-stated"},{"text":"The authors report that TileQuant reaches 2.66x the original model’s generation throughput.","excerpt":"Experiments show that TileQuant reaches 2.66x the original model's generation throughput.","support":"source-stated"},{"text":"The authors report preserved quality across four task areas and results exceeding quantized and original models on multiple tasks.","excerpt":"Across language modeling, reasoning, long-context retrieval, and question answering, it preserves quality and surpasses quantized and original models on multiple tasks.","support":"source-stated"}],"limitations":["The abstract does not identify the evaluated models or hardware, or give task-by-task throughput and quality results; the reported results’ breadth cannot be assessed from this evidence alone."],"mediaId":"6b4ec2ccffedd67d8fc8bd9b18a6b03e69142e4e828984d273a77ea3209022a8","correctionReason":null,"id":"973621c8ffae13efc4f0bbde3ef3021cfcf1b21507355dab1fec2aef421f189f","publicationId":"98bba058-ad34-4947-8ef0-bce598129cb9","version":1,"sourceUrl":"https://arxiv.org/abs/2611.07217","sourceTitle":"TileQuant: Tile as the Precision-Allocation Unit for LLM Mixed-Precision Post-Training Quantization","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-04","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-06T05:12:28.731Z","createdAt":"2026-11-08T03:34:08.684Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"6b4ec2ccffedd67d8fc8bd9b18a6b03e69142e4e828984d273a77ea3209022a8","kind":"article","url":"https://arxiv.org/abs/2611.07217","sourceUrl":"https://arxiv.org/abs/2611.07217","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-08T03:33:19.977Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.07217","checkedAt":"2026-11-08T04:38:08.080Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"6b4ec2ccffedd67d8fc8bd9b18a6b03e69142e4e828984d273a77ea3209022a8","confidence":0.93,"provider":"typesafe","model":"jev-1.13.0","inputHash":"4f66a53d294c1459c7fd3352889bd436d66530b1df5cd4cd6a941f074d4efe59","decidedAt":"2026-11-08T03:33:20.837Z"},"provenance":{"textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observationId":"d69f2590c037826d945ffc54f224512463438a0f7710908a86d919bb5de6d3ff","retrievedAt":"2026-11-08T03:33:19.841Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"723fbd10-80a3-4fbc-84ff-4c43a9cd7164"},"reviewer":{"model":"gpt-6-luna","runId":"338f9a0d-aee0-4c82-8a49-328f4a672409"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-08T03:34:08.684Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Zhang, Hanzhi","url":null,"kind":"unknown"},{"name":"Zhang, Qiao","url":null,"kind":"unknown"},{"name":"Cao, Qinglei","url":null,"kind":"unknown"},{"name":"Fan, Heng","url":null,"kind":"unknown"},{"name":"Huang, Yan","url":null,"kind":"unknown"},{"name":"Sha, Kewei","url":null,"kind":"unknown"},{"name":"Feng, Yunhe","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Zhang, Hanzhi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Hanzhi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07217","locator":"head/meta[name=author|citation_author]"},"assertionId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T04:38:08.080Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70","sourceUrl":"https://arxiv.org/abs/2611.07217","contentSha256":"6733550172324af3e0d7d1b673735f2961c23c29192dd314346e55783bd8a4cf","textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observedAt":"2026-11-08T04:38:08.080Z"}},{"actor":{"name":"Zhang, Qiao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Qiao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07217","locator":"head/meta[name=author|citation_author]"},"assertionId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T04:38:08.080Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70","sourceUrl":"https://arxiv.org/abs/2611.07217","contentSha256":"6733550172324af3e0d7d1b673735f2961c23c29192dd314346e55783bd8a4cf","textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observedAt":"2026-11-08T04:38:08.080Z"}},{"actor":{"name":"Cao, Qinglei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Cao, Qinglei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07217","locator":"head/meta[name=author|citation_author]"},"assertionId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T04:38:08.080Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70","sourceUrl":"https://arxiv.org/abs/2611.07217","contentSha256":"6733550172324af3e0d7d1b673735f2961c23c29192dd314346e55783bd8a4cf","textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observedAt":"2026-11-08T04:38:08.080Z"}},{"actor":{"name":"Fan, Heng","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Fan, Heng","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07217","locator":"head/meta[name=author|citation_author]"},"assertionId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T04:38:08.080Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70","sourceUrl":"https://arxiv.org/abs/2611.07217","contentSha256":"6733550172324af3e0d7d1b673735f2961c23c29192dd314346e55783bd8a4cf","textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observedAt":"2026-11-08T04:38:08.080Z"}},{"actor":{"name":"Huang, Yan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Huang, Yan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07217","locator":"head/meta[name=author|citation_author]"},"assertionId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T04:38:08.080Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70","sourceUrl":"https://arxiv.org/abs/2611.07217","contentSha256":"6733550172324af3e0d7d1b673735f2961c23c29192dd314346e55783bd8a4cf","textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observedAt":"2026-11-08T04:38:08.080Z"}},{"actor":{"name":"Sha, Kewei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sha, Kewei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07217","locator":"head/meta[name=author|citation_author]"},"assertionId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T04:38:08.080Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70","sourceUrl":"https://arxiv.org/abs/2611.07217","contentSha256":"6733550172324af3e0d7d1b673735f2961c23c29192dd314346e55783bd8a4cf","textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observedAt":"2026-11-08T04:38:08.080Z"}},{"actor":{"name":"Feng, Yunhe","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Feng, Yunhe","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07217","locator":"head/meta[name=author|citation_author]"},"assertionId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T04:38:08.080Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70","sourceUrl":"https://arxiv.org/abs/2611.07217","contentSha256":"6733550172324af3e0d7d1b673735f2961c23c29192dd314346e55783bd8a4cf","textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observedAt":"2026-11-08T04:38:08.080Z"}}],"participationCoverage":{"total":7,"returned":7,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.07217","snapshotId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70","contentSha256":"6733550172324af3e0d7d1b673735f2961c23c29192dd314346e55783bd8a4cf","textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observedAt":"2026-11-08T04:38:08.080Z","basis":"publisher-page-metadata","sourceLinks":48,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/973621c8ffae13efc4f0bbde3ef3021cfcf1b21507355dab1fec2aef421f189f/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-tilequant-assigns-mixed-precision-to-smaller-weight-973621c8","formats":{"html":"/readings/arxiv-cs-ai-tilequant-assigns-mixed-precision-to-smaller-weight-973621c8","markdown":"/readings/arxiv-cs-ai-tilequant-assigns-mixed-precision-to-smaller-weight-973621c8.md","json":"/readings/arxiv-cs-ai-tilequant-assigns-mixed-precision-to-smaller-weight-973621c8.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-quantization","name":"Quantization","explanation":"Storing a model's numbers at lower precision so it uses less memory and runs faster, sometimes at a cost in accuracy.","referenceUrl":"https://developers.google.com/machine-learning/glossary#quantization"},{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"973621c8ffae13efc4f0bbde3ef3021cfcf1b21507355dab1fec2aef421f189f","revision":"98bba058-ad34-4947-8ef0-bce598129cb9","revisionKind":"publication-id","title":"arXiv cs.AI: TileQuant assigns mixed precision to smaller weight tiles","url":"https://escapemeridian.com/readings/arxiv-cs-ai-tilequant-assigns-mixed-precision-to-smaller-weight-973621c8"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.07217","revision":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","revisionKind":"sha256-source-text","title":"TileQuant: Tile as the Precision-Allocation Unit for LLM Mixed-Precision Post-Training Quantization","url":"https://arxiv.org/abs/2611.07217"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"973621c8ffae13efc4f0bbde3ef3021cfcf1b21507355dab1fec2aef421f189f","title":"arXiv cs.AI: TileQuant assigns mixed precision to smaller weight tiles","argument":"Hanzhi Zhang and coauthors introduce TileQuant, a training-free framework for mixed-precision post-training quantization (PTQ) of large language models (LLMs). Instead of keeping entire columns at higher precision, TileQuant scores hardware-aligned 2D weight tiles, reflecting the authors’ argument that sensitivity can vary even within a column. Offline calibration can score tiles using input-activation-aware forward statistics or loss sensitivity; within a retention budget, the highest-scoring tiles stay at 16-bit and the rest use 8-bit. The resulting map guides reconstruction into compact weight buffers, which the kernel reuses for integer and 16-bit computation with local accumulation to reduce memory traffic. The authors report 2.66x the original model’s generation throughput and say quality is preserved across language modeling, reasoning, long-context retrieval, and question answering, with TileQuant surpassing quantized and original models on multiple tasks. The proposed approach links finer-grained precision allocation to hardware execution, rather than treating sensitivity and runtime efficiency as separate concerns. The abstract does not identify the evaluated models, hardware, or task-by-task results, so it does not show how broadly the reported throughput and quality findings apply.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract does not identify the evaluated models or hardware, or give task-by-task throughput and quality results; the reported results’ breadth cannot be assessed from this evidence alone.","speaker":{"name":"Zhang, Hanzhi, Zhang, Qiao, Cao, Qinglei, Fan, Heng, Huang, Yan, Sha, Kewei, Feng, Yunhe","roleAtSource":"Article author"},"source":{"title":"TileQuant: Tile as the Precision-Allocation Unit for LLM Mixed-Precision Post-Training Quantization","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.07217","publishedAt":"2026-11-04","dateBasis":"Date basis not provided."},"evidence":[{"text":"TileQuant assigns precision to hardware-aligned 2D weight tiles, rather than retaining whole columns at higher precision.","excerpt":"We therefore introduce TileQuant, a training-free framework that assigns precision to hardware-aligned 2D weight tiles.","url":"https://arxiv.org/abs/2611.07217","relationship":"Source-stated"},{"text":"TileQuant offers two offline calibration scoring approaches: input-activation-aware scoring from forward statistics and gradient-informed scoring from loss sensitivity.","excerpt":"Offline calibration provides input-activation-aware scoring from forward statistics for lower calibration cost and gradient-informed scoring from loss sensitivity for stronger quality preservation.","url":"https://arxiv.org/abs/2611.07217","relationship":"Source-stated"},{"text":"Within each projection’s retention budget, TileQuant keeps the highest-scoring tiles at 16-bit and uses 8-bit for the rest.","excerpt":"Within each projection's retention budget, the highest-scoring tiles remain at 16-bit and the rest use 8-bit.","url":"https://arxiv.org/abs/2611.07217","relationship":"Source-stated"},{"text":"The authors report that TileQuant reaches 2.66x the original model’s generation throughput.","excerpt":"Experiments show that TileQuant reaches 2.66x the original model's generation throughput.","url":"https://arxiv.org/abs/2611.07217","relationship":"Source-stated"},{"text":"The authors report preserved quality across four task areas and results exceeding quantized and original models on multiple tasks.","excerpt":"Across language modeling, reasoning, long-context retrieval, and question answering, it preserves quality and surpasses quantized and original models on multiple tasks.","url":"https://arxiv.org/abs/2611.07217","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.07217","checkedAt":"2026-11-08T04:38:08.080Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How do TileQuant’s reported throughput and quality results vary across the evaluated models, hardware, and tasks?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: TileQuant assigns mixed precision to smaller weight tiles","summary":"Hanzhi Zhang and coauthors introduce TileQuant, a training-free framework for mixed-precision post-training quantization (PTQ) of large language models (LLMs). Instead of keeping entire columns at higher precision, TileQuant scores hardware-aligned 2D weight tiles, reflecting the authors’ argument that sensitivity can vary even within a column. Offline calibration can score tiles using input-activation-aware forward statistics or loss sensitivity; within a retention budget, the highest-scoring tiles stay at 16-bit and the rest use 8-bit. The resulting map guides reconstruction into compact weight buffers, which the kernel reuses for integer and 16-bit computation with local accumulation to reduce memory traffic. The authors report 2.66x the original model’s generation throughput and say quality is preserved across language modeling, reasoning, long-context retrieval, and question answering, with TileQuant surpassing quantized and original models on multiple tasks. The proposed approach links finer-grained precision allocation to hardware execution, rather than treating sensitivity and runtime efficiency as separate concerns. The abstract does not identify the evaluated models, hardware, or task-by-task results, so it does not show how broadly the reported throughput and quality findings apply.","question":"How do TileQuant’s reported throughput and quality results vary across the evaluated models, hardware, and tasks?","claims":[{"text":"TileQuant assigns precision to hardware-aligned 2D weight tiles, rather than retaining whole columns at higher precision.","excerpt":"We therefore introduce TileQuant, a training-free framework that assigns precision to hardware-aligned 2D weight tiles.","support":"source-stated"},{"text":"TileQuant offers two offline calibration scoring approaches: input-activation-aware scoring from forward statistics and gradient-informed scoring from loss sensitivity.","excerpt":"Offline calibration provides input-activation-aware scoring from forward statistics for lower calibration cost and gradient-informed scoring from loss sensitivity for stronger quality preservation.","support":"source-stated"},{"text":"Within each projection’s retention budget, TileQuant keeps the highest-scoring tiles at 16-bit and uses 8-bit for the rest.","excerpt":"Within each projection's retention budget, the highest-scoring tiles remain at 16-bit and the rest use 8-bit.","support":"source-stated"},{"text":"The authors report that TileQuant reaches 2.66x the original model’s generation throughput.","excerpt":"Experiments show that TileQuant reaches 2.66x the original model's generation throughput.","support":"source-stated"},{"text":"The authors report preserved quality across four task areas and results exceeding quantized and original models on multiple tasks.","excerpt":"Across language modeling, reasoning, long-context retrieval, and question answering, it preserves quality and surpasses quantized and original models on multiple tasks.","support":"source-stated"}],"limitations":["The abstract does not identify the evaluated models or hardware, or give task-by-task throughput and quality results; the reported results’ breadth cannot be assessed from this evidence alone."],"mediaId":"6b4ec2ccffedd67d8fc8bd9b18a6b03e69142e4e828984d273a77ea3209022a8","correctionReason":null,"id":"973621c8ffae13efc4f0bbde3ef3021cfcf1b21507355dab1fec2aef421f189f","publicationId":"98bba058-ad34-4947-8ef0-bce598129cb9","version":1,"sourceUrl":"https://arxiv.org/abs/2611.07217","sourceTitle":"TileQuant: Tile as the Precision-Allocation Unit for LLM Mixed-Precision Post-Training Quantization","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-04","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-06T05:12:28.731Z","createdAt":"2026-11-08T03:34:08.684Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"6b4ec2ccffedd67d8fc8bd9b18a6b03e69142e4e828984d273a77ea3209022a8","kind":"article","url":"https://arxiv.org/abs/2611.07217","sourceUrl":"https://arxiv.org/abs/2611.07217","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-08T03:33:19.977Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.07217","checkedAt":"2026-11-08T04:38:08.080Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"6b4ec2ccffedd67d8fc8bd9b18a6b03e69142e4e828984d273a77ea3209022a8","confidence":0.93,"provider":"typesafe","model":"jev-1.13.0","inputHash":"4f66a53d294c1459c7fd3352889bd436d66530b1df5cd4cd6a941f074d4efe59","decidedAt":"2026-11-08T03:33:20.837Z"},"provenance":{"textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observationId":"d69f2590c037826d945ffc54f224512463438a0f7710908a86d919bb5de6d3ff","retrievedAt":"2026-11-08T03:33:19.841Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"723fbd10-80a3-4fbc-84ff-4c43a9cd7164"},"reviewer":{"model":"gpt-6-luna","runId":"338f9a0d-aee0-4c82-8a49-328f4a672409"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-08T03:34:08.684Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Zhang, Hanzhi","url":null,"kind":"unknown"},{"name":"Zhang, Qiao","url":null,"kind":"unknown"},{"name":"Cao, Qinglei","url":null,"kind":"unknown"},{"name":"Fan, Heng","url":null,"kind":"unknown"},{"name":"Huang, Yan","url":null,"kind":"unknown"},{"name":"Sha, Kewei","url":null,"kind":"unknown"},{"name":"Feng, Yunhe","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Zhang, Hanzhi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Hanzhi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07217","locator":"head/meta[name=author|citation_author]"},"assertionId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T04:38:08.080Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70","sourceUrl":"https://arxiv.org/abs/2611.07217","contentSha256":"6733550172324af3e0d7d1b673735f2961c23c29192dd314346e55783bd8a4cf","textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observedAt":"2026-11-08T04:38:08.080Z"}},{"actor":{"name":"Zhang, Qiao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Qiao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07217","locator":"head/meta[name=author|citation_author]"},"assertionId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T04:38:08.080Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70","sourceUrl":"https://arxiv.org/abs/2611.07217","contentSha256":"6733550172324af3e0d7d1b673735f2961c23c29192dd314346e55783bd8a4cf","textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observedAt":"2026-11-08T04:38:08.080Z"}},{"actor":{"name":"Cao, Qinglei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Cao, Qinglei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07217","locator":"head/meta[name=author|citation_author]"},"assertionId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T04:38:08.080Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70","sourceUrl":"https://arxiv.org/abs/2611.07217","contentSha256":"6733550172324af3e0d7d1b673735f2961c23c29192dd314346e55783bd8a4cf","textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observedAt":"2026-11-08T04:38:08.080Z"}},{"actor":{"name":"Fan, Heng","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Fan, Heng","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07217","locator":"head/meta[name=author|citation_author]"},"assertionId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T04:38:08.080Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70","sourceUrl":"https://arxiv.org/abs/2611.07217","contentSha256":"6733550172324af3e0d7d1b673735f2961c23c29192dd314346e55783bd8a4cf","textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observedAt":"2026-11-08T04:38:08.080Z"}},{"actor":{"name":"Huang, Yan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Huang, Yan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07217","locator":"head/meta[name=author|citation_author]"},"assertionId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T04:38:08.080Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70","sourceUrl":"https://arxiv.org/abs/2611.07217","contentSha256":"6733550172324af3e0d7d1b673735f2961c23c29192dd314346e55783bd8a4cf","textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observedAt":"2026-11-08T04:38:08.080Z"}},{"actor":{"name":"Sha, Kewei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sha, Kewei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07217","locator":"head/meta[name=author|citation_author]"},"assertionId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T04:38:08.080Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70","sourceUrl":"https://arxiv.org/abs/2611.07217","contentSha256":"6733550172324af3e0d7d1b673735f2961c23c29192dd314346e55783bd8a4cf","textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observedAt":"2026-11-08T04:38:08.080Z"}},{"actor":{"name":"Feng, Yunhe","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Feng, Yunhe","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07217","locator":"head/meta[name=author|citation_author]"},"assertionId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T04:38:08.080Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70","sourceUrl":"https://arxiv.org/abs/2611.07217","contentSha256":"6733550172324af3e0d7d1b673735f2961c23c29192dd314346e55783bd8a4cf","textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observedAt":"2026-11-08T04:38:08.080Z"}}],"participationCoverage":{"total":7,"returned":7,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.07217","snapshotId":"1a5916b69901d729e01188468f33dc9d7d93d91f60560ddc27671b9eb31a3e70","contentSha256":"6733550172324af3e0d7d1b673735f2961c23c29192dd314346e55783bd8a4cf","textHash":"8824fd9421990bf11f80467699fb24eb75b7e99a4b0572e56de86a4ecd41d48e","observedAt":"2026-11-08T04:38:08.080Z","basis":"publisher-page-metadata","sourceLinks":48,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/973621c8ffae13efc4f0bbde3ef3021cfcf1b21507355dab1fec2aef421f189f/source"}}}],"audits":[{"publicationId":"98bba058-ad34-4947-8ef0-bce598129cb9","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading correctly credits Hanzhi Zhang and coauthors and keeps the performance claims attributed ('The authors report'). The title label 'arXiv cs.AI' matches the feed publisher. The paper's primary category is cs.LG, cross-listed to cs.AI, which is consistent.","excerpt":"Authors:Hanzhi Zhang, Qiao Zhang, Qinglei Cao, Heng Fan, Yan Huang, Kewei Sha, Yunhe Feng"},{"dimension":"summary","status":"uncertain","explanation":"The summary leaves out the source's stated reason the work matters: PTQ is meant to lower LLM deployment costs. It also drops the motivating contrast that runtime outlier detection adds decoding overhead. Without these, a general reader is not told why throughput or quantization matters. Central terms (quantization, 8-bit/16-bit precision, kernel, retention budget) are not explained in plain language. Smallest repair: add one sentence stating that the abstract says PTQ reduces deployment costs by storing model weights at lower numeric precision. Minor: 'native integer' is shortened to 'integer'. The scoring cost/quality tradeoff appears only in the claims.","excerpt":"Post-training quantization (PTQ) reduces large language model (LLM) deployment costs, but preserving quality requires accounting for uneven weight sensitivity."},{"dimension":"date","status":"pass","explanation":"The originalPublished date of 2026-11-04 matches the v1 submission date on arXiv. The later feed date of Nov 6 is correctly not used.","excerpt":"[Submitted on 4 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Every claim matches the abstract verbatim and stays attributed. The 2.66x throughput figure and the quality results are presented as author reports, not as verified facts. The interpretive line linking precision allocation to hardware execution is supported by the authors' concluding sentence. The limitation and question about unidentified models, hardware and per-task results are appropriate gaps, not invented claims.","excerpt":"These results support selecting precision units that capture local sensitivity while enabling efficient hardware execution."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper. It is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-08T03:34:08.684Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}