{"id":"b43dca990d657529c8fa8c0f377026d70a5de08bb136d6dd39244d3c2bc955ce","title":"arXiv cs.AI: TableTune measures and adjusts draft-length tables for speculative decoding","argument":"Abhishek Malvankar, Paul Castro, Nick Mitchell and Lionel Villard present TableTune, a system for choosing and adjusting draft lengths in speculative decoding. A draft length is how many tokens a small drafter guesses at each step; the paper says the best length shrinks as the batch grows, while vLLM’s hand-written table does not measure or correct itself.\n\nTableTune times decoding steps across batch sizes and draft lengths, then builds a table intended to maximize throughput. Its controller tracks accepted guesses in live traffic and rebuilds the table while serving. The authors report that, on an H100, the tuned table reached at least 94% of the throughput of the best fixed draft length at every load in four of five drafter settings, and 88% in the fifth.\n\nThey also report gains in tests involving mistuned tables, workload changes and an llm-d deployment. These results suggest that measuring and adapting the table could reduce the need for operators to know the right draft length in advance. The evidence is limited to the reported comparisons and deployments; the abstract does not establish how performance varies across other hardware or workloads. How well does TableTune perform on workloads and hardware beyond those reported in the paper?","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported results compare TableTune with other ways to speculate and are tied to the paper's tested settings; the abstract does not establish performance on other hardware or workloads. The publisher-page evidence contains the abstract, not the full paper, so details of the experimental setup and evaluation are unavailable here.","speaker":{"name":"Malvankar, Abhishek, Castro, Paul, Mitchell, Nick, Villard, Lionel","roleAtSource":"Article author"},"source":{"title":"TableTune: Measured, Self-Correcting Draft-Length Tables for Dynamic Speculative Decoding","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.38968","publishedAt":"2026-10-28","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors say the best draft length shrinks as batch size grows, while vLLM lets operators specify a hand-written table that does not measure or correct itself.","excerpt":"the best draft length, the number of tokens a small drafter guesses per step, shrinks as the batch grows. vLLM lets operators set the draft length for each batch size with a hand-written table, but nothing measures or corrects that table.","url":"https://arxiv.org/abs/2610.38968","relationship":"Source-stated"},{"text":"TableTune times decoding steps for each batch size and draft length, computes a table intended to maximize throughput, and adjusts it during serving using observed accepted guesses.","excerpt":"Its tuner times the decoding step for every batch size and draft length on vLLM's own serving path and computes, in minutes, the table that maximizes throughput. Its controller, a vLLM plugin, tracks how many guesses are accepted in live traffic and rebuilds the table while serving.","url":"https://arxiv.org/abs/2610.38968","relationship":"Source-stated"},{"text":"On an H100, the authors report that the tuned table reached at least 94% of the best fixed draft length's throughput at every load in four of five drafter settings, and 88% in the fifth.","excerpt":"On an H100, the tuned table delivers at least 94% of the throughput of the best fixed draft length at every load in four of five drafter settings (88% in the fifth)","url":"https://arxiv.org/abs/2610.38968","relationship":"Source-stated"},{"text":"The paper reports throughput improvements from adjusting mistuned tables and after a workload switch, as well as gains in an llm-d deployment.","excerpt":"Starting from mistuned tables, the controller raises throughput by up to 58% (up to 45% on vLLM's default runner), and after a workload switch with the DFlash drafter it recovers 96% of a stale table's loss.","url":"https://arxiv.org/abs/2610.38968","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.38968","checkedAt":"2026-11-07T06:32:08.888Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well does TableTune perform on workloads and hardware beyond those reported in the paper?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: TableTune measures and adjusts draft-length tables for speculative decoding","summary":"Abhishek Malvankar, Paul Castro, Nick Mitchell and Lionel Villard present TableTune, a system for choosing and adjusting draft lengths in speculative decoding. A draft length is how many tokens a small drafter guesses at each step; the paper says the best length shrinks as the batch grows, while vLLM’s hand-written table does not measure or correct itself.\n\nTableTune times decoding steps across batch sizes and draft lengths, then builds a table intended to maximize throughput. Its controller tracks accepted guesses in live traffic and rebuilds the table while serving. The authors report that, on an H100, the tuned table reached at least 94% of the throughput of the best fixed draft length at every load in four of five drafter settings, and 88% in the fifth.\n\nThey also report gains in tests involving mistuned tables, workload changes and an llm-d deployment. These results suggest that measuring and adapting the table could reduce the need for operators to know the right draft length in advance. The evidence is limited to the reported comparisons and deployments; the abstract does not establish how performance varies across other hardware or workloads. How well does TableTune perform on workloads and hardware beyond those reported in the paper?","question":"How well does TableTune perform on workloads and hardware beyond those reported in the paper?","claims":[{"text":"The authors say the best draft length shrinks as batch size grows, while vLLM lets operators specify a hand-written table that does not measure or correct itself.","excerpt":"the best draft length, the number of tokens a small drafter guesses per step, shrinks as the batch grows. vLLM lets operators set the draft length for each batch size with a hand-written table, but nothing measures or corrects that table.","support":"source-stated"},{"text":"TableTune times decoding steps for each batch size and draft length, computes a table intended to maximize throughput, and adjusts it during serving using observed accepted guesses.","excerpt":"Its tuner times the decoding step for every batch size and draft length on vLLM's own serving path and computes, in minutes, the table that maximizes throughput. Its controller, a vLLM plugin, tracks how many guesses are accepted in live traffic and rebuilds the table while serving.","support":"source-stated"},{"text":"On an H100, the authors report that the tuned table reached at least 94% of the best fixed draft length's throughput at every load in four of five drafter settings, and 88% in the fifth.","excerpt":"On an H100, the tuned table delivers at least 94% of the throughput of the best fixed draft length at every load in four of five drafter settings (88% in the fifth)","support":"source-stated"},{"text":"The paper reports throughput improvements from adjusting mistuned tables and after a workload switch, as well as gains in an llm-d deployment.","excerpt":"Starting from mistuned tables, the controller raises throughput by up to 58% (up to 45% on vLLM's default runner), and after a workload switch with the DFlash drafter it recovers 96% of a stale table's loss.","support":"source-stated"}],"limitations":["The reported results compare TableTune with other ways to speculate and are tied to the paper's tested settings; the abstract does not establish performance on other hardware or workloads.","The publisher-page evidence contains the abstract, not the full paper, so details of the experimental setup and evaluation are unavailable here."],"mediaId":"a28e5b2f2b1cd9b8aa5667979e5c35c3f4111827dc5f8cf59f3eb3db5b41a7e7","correctionReason":null,"id":"b43dca990d657529c8fa8c0f377026d70a5de08bb136d6dd39244d3c2bc955ce","publicationId":"919cf774-3928-479b-803e-3d29acc5197e","version":1,"sourceUrl":"https://arxiv.org/abs/2610.38968","sourceTitle":"TableTune: Measured, Self-Correcting Draft-Length Tables for Dynamic Speculative Decoding","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-28","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-30T06:42:52.486Z","createdAt":"2026-11-07T06:00:59.261Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"a28e5b2f2b1cd9b8aa5667979e5c35c3f4111827dc5f8cf59f3eb3db5b41a7e7","kind":"article","url":"https://arxiv.org/abs/2610.38968","sourceUrl":"https://arxiv.org/abs/2610.38968","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-31T09:31:38.719Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.38968","checkedAt":"2026-11-07T06:32:08.888Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"a28e5b2f2b1cd9b8aa5667979e5c35c3f4111827dc5f8cf59f3eb3db5b41a7e7","confidence":0.91,"provider":"typesafe","model":"jev-1.13.0","inputHash":"c7b9454a421e66a9efa9904db0592d6672cbb9c654d2076fee0c00727ce3143f","decidedAt":"2026-10-31T09:31:39.328Z"},"provenance":{"textHash":"d5ca104dd139871e26298266caf0b2630dc19f0e0b9f892ad54d913f6d12419f","observationId":"383f59c058871f9f301608607500b510578516ef0c00d556f2d8bed8ef38eb62","retrievedAt":"2026-10-31T09:31:38.638Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"22501536-f756-4ba4-84c0-81872dce1086"},"reviewer":{"model":"gpt-6-luna","runId":"4df7a10b-4bfd-40d8-842d-41987ff99921"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-07T06:00:59.261Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Malvankar, Abhishek","url":null,"kind":"unknown"},{"name":"Castro, Paul","url":null,"kind":"unknown"},{"name":"Mitchell, Nick","url":null,"kind":"unknown"},{"name":"Villard, Lionel","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Malvankar, Abhishek","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Malvankar, Abhishek","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38968","locator":"head/meta[name=author|citation_author]"},"assertionId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-31T09:31:38.638Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d","sourceUrl":"https://arxiv.org/abs/2610.38968","contentSha256":"eab50101fe807959f14489a6421cf1d4475ce624e04accb9d0bc8ff86f639682","textHash":"d5ca104dd139871e26298266caf0b2630dc19f0e0b9f892ad54d913f6d12419f","observedAt":"2026-10-31T09:31:38.638Z"}},{"actor":{"name":"Castro, Paul","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Castro, Paul","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38968","locator":"head/meta[name=author|citation_author]"},"assertionId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-31T09:31:38.638Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d","sourceUrl":"https://arxiv.org/abs/2610.38968","contentSha256":"eab50101fe807959f14489a6421cf1d4475ce624e04accb9d0bc8ff86f639682","textHash":"d5ca104dd139871e26298266caf0b2630dc19f0e0b9f892ad54d913f6d12419f","observedAt":"2026-10-31T09:31:38.638Z"}},{"actor":{"name":"Mitchell, Nick","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mitchell, Nick","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38968","locator":"head/meta[name=author|citation_author]"},"assertionId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-31T09:31:38.638Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d","sourceUrl":"https://arxiv.org/abs/2610.38968","contentSha256":"eab50101fe807959f14489a6421cf1d4475ce624e04accb9d0bc8ff86f639682","textHash":"d5ca104dd139871e26298266caf0b2630dc19f0e0b9f892ad54d913f6d12419f","observedAt":"2026-10-31T09:31:38.638Z"}},{"actor":{"name":"Villard, Lionel","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Villard, Lionel","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38968","locator":"head/meta[name=author|citation_author]"},"assertionId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-31T09:31:38.638Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d","sourceUrl":"https://arxiv.org/abs/2610.38968","contentSha256":"eab50101fe807959f14489a6421cf1d4475ce624e04accb9d0bc8ff86f639682","textHash":"d5ca104dd139871e26298266caf0b2630dc19f0e0b9f892ad54d913f6d12419f","observedAt":"2026-10-31T09:31:38.638Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.38968","snapshotId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d","contentSha256":"eab50101fe807959f14489a6421cf1d4475ce624e04accb9d0bc8ff86f639682","textHash":"d5ca104dd139871e26298266caf0b2630dc19f0e0b9f892ad54d913f6d12419f","observedAt":"2026-10-31T09:31:38.638Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/b43dca990d657529c8fa8c0f377026d70a5de08bb136d6dd39244d3c2bc955ce/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-tabletune-measures-and-adjusts-draft-length-tables-b43dca99","formats":{"html":"/readings/arxiv-cs-ai-tabletune-measures-and-adjusts-draft-length-tables-b43dca99","markdown":"/readings/arxiv-cs-ai-tabletune-measures-and-adjusts-draft-length-tables-b43dca99.md","json":"/readings/arxiv-cs-ai-tabletune-measures-and-adjusts-draft-length-tables-b43dca99.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-nvidia-h100","name":"NVIDIA H100","explanation":"An NVIDIA graphics processing unit (GPU) built on the company's Hopper architecture and designed to accelerate AI workloads, including large language models.","referenceUrl":"https://www.nvidia.com/en-us/data-center/h100/"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"b43dca990d657529c8fa8c0f377026d70a5de08bb136d6dd39244d3c2bc955ce","revision":"919cf774-3928-479b-803e-3d29acc5197e","revisionKind":"publication-id","title":"arXiv cs.AI: TableTune measures and adjusts draft-length tables for speculative decoding","url":"https://escapemeridian.com/readings/arxiv-cs-ai-tabletune-measures-and-adjusts-draft-length-tables-b43dca99"},"source":{"type":"source","id":"https://arxiv.org/abs/2610.38968","revision":"d5ca104dd139871e26298266caf0b2630dc19f0e0b9f892ad54d913f6d12419f","revisionKind":"sha256-source-text","title":"TableTune: Measured, Self-Correcting Draft-Length Tables for Dynamic Speculative Decoding","url":"https://arxiv.org/abs/2610.38968"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"b43dca990d657529c8fa8c0f377026d70a5de08bb136d6dd39244d3c2bc955ce","title":"arXiv cs.AI: TableTune measures and adjusts draft-length tables for speculative decoding","argument":"Abhishek Malvankar, Paul Castro, Nick Mitchell and Lionel Villard present TableTune, a system for choosing and adjusting draft lengths in speculative decoding. A draft length is how many tokens a small drafter guesses at each step; the paper says the best length shrinks as the batch grows, while vLLM’s hand-written table does not measure or correct itself.\n\nTableTune times decoding steps across batch sizes and draft lengths, then builds a table intended to maximize throughput. Its controller tracks accepted guesses in live traffic and rebuilds the table while serving. The authors report that, on an H100, the tuned table reached at least 94% of the throughput of the best fixed draft length at every load in four of five drafter settings, and 88% in the fifth.\n\nThey also report gains in tests involving mistuned tables, workload changes and an llm-d deployment. These results suggest that measuring and adapting the table could reduce the need for operators to know the right draft length in advance. The evidence is limited to the reported comparisons and deployments; the abstract does not establish how performance varies across other hardware or workloads. How well does TableTune perform on workloads and hardware beyond those reported in the paper?","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported results compare TableTune with other ways to speculate and are tied to the paper's tested settings; the abstract does not establish performance on other hardware or workloads. The publisher-page evidence contains the abstract, not the full paper, so details of the experimental setup and evaluation are unavailable here.","speaker":{"name":"Malvankar, Abhishek, Castro, Paul, Mitchell, Nick, Villard, Lionel","roleAtSource":"Article author"},"source":{"title":"TableTune: Measured, Self-Correcting Draft-Length Tables for Dynamic Speculative Decoding","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.38968","publishedAt":"2026-10-28","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors say the best draft length shrinks as batch size grows, while vLLM lets operators specify a hand-written table that does not measure or correct itself.","excerpt":"the best draft length, the number of tokens a small drafter guesses per step, shrinks as the batch grows. vLLM lets operators set the draft length for each batch size with a hand-written table, but nothing measures or corrects that table.","url":"https://arxiv.org/abs/2610.38968","relationship":"Source-stated"},{"text":"TableTune times decoding steps for each batch size and draft length, computes a table intended to maximize throughput, and adjusts it during serving using observed accepted guesses.","excerpt":"Its tuner times the decoding step for every batch size and draft length on vLLM's own serving path and computes, in minutes, the table that maximizes throughput. Its controller, a vLLM plugin, tracks how many guesses are accepted in live traffic and rebuilds the table while serving.","url":"https://arxiv.org/abs/2610.38968","relationship":"Source-stated"},{"text":"On an H100, the authors report that the tuned table reached at least 94% of the best fixed draft length's throughput at every load in four of five drafter settings, and 88% in the fifth.","excerpt":"On an H100, the tuned table delivers at least 94% of the throughput of the best fixed draft length at every load in four of five drafter settings (88% in the fifth)","url":"https://arxiv.org/abs/2610.38968","relationship":"Source-stated"},{"text":"The paper reports throughput improvements from adjusting mistuned tables and after a workload switch, as well as gains in an llm-d deployment.","excerpt":"Starting from mistuned tables, the controller raises throughput by up to 58% (up to 45% on vLLM's default runner), and after a workload switch with the DFlash drafter it recovers 96% of a stale table's loss.","url":"https://arxiv.org/abs/2610.38968","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.38968","checkedAt":"2026-11-07T06:32:08.888Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well does TableTune perform on workloads and hardware beyond those reported in the paper?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: TableTune measures and adjusts draft-length tables for speculative decoding","summary":"Abhishek Malvankar, Paul Castro, Nick Mitchell and Lionel Villard present TableTune, a system for choosing and adjusting draft lengths in speculative decoding. A draft length is how many tokens a small drafter guesses at each step; the paper says the best length shrinks as the batch grows, while vLLM’s hand-written table does not measure or correct itself.\n\nTableTune times decoding steps across batch sizes and draft lengths, then builds a table intended to maximize throughput. Its controller tracks accepted guesses in live traffic and rebuilds the table while serving. The authors report that, on an H100, the tuned table reached at least 94% of the throughput of the best fixed draft length at every load in four of five drafter settings, and 88% in the fifth.\n\nThey also report gains in tests involving mistuned tables, workload changes and an llm-d deployment. These results suggest that measuring and adapting the table could reduce the need for operators to know the right draft length in advance. The evidence is limited to the reported comparisons and deployments; the abstract does not establish how performance varies across other hardware or workloads. How well does TableTune perform on workloads and hardware beyond those reported in the paper?","question":"How well does TableTune perform on workloads and hardware beyond those reported in the paper?","claims":[{"text":"The authors say the best draft length shrinks as batch size grows, while vLLM lets operators specify a hand-written table that does not measure or correct itself.","excerpt":"the best draft length, the number of tokens a small drafter guesses per step, shrinks as the batch grows. vLLM lets operators set the draft length for each batch size with a hand-written table, but nothing measures or corrects that table.","support":"source-stated"},{"text":"TableTune times decoding steps for each batch size and draft length, computes a table intended to maximize throughput, and adjusts it during serving using observed accepted guesses.","excerpt":"Its tuner times the decoding step for every batch size and draft length on vLLM's own serving path and computes, in minutes, the table that maximizes throughput. Its controller, a vLLM plugin, tracks how many guesses are accepted in live traffic and rebuilds the table while serving.","support":"source-stated"},{"text":"On an H100, the authors report that the tuned table reached at least 94% of the best fixed draft length's throughput at every load in four of five drafter settings, and 88% in the fifth.","excerpt":"On an H100, the tuned table delivers at least 94% of the throughput of the best fixed draft length at every load in four of five drafter settings (88% in the fifth)","support":"source-stated"},{"text":"The paper reports throughput improvements from adjusting mistuned tables and after a workload switch, as well as gains in an llm-d deployment.","excerpt":"Starting from mistuned tables, the controller raises throughput by up to 58% (up to 45% on vLLM's default runner), and after a workload switch with the DFlash drafter it recovers 96% of a stale table's loss.","support":"source-stated"}],"limitations":["The reported results compare TableTune with other ways to speculate and are tied to the paper's tested settings; the abstract does not establish performance on other hardware or workloads.","The publisher-page evidence contains the abstract, not the full paper, so details of the experimental setup and evaluation are unavailable here."],"mediaId":"a28e5b2f2b1cd9b8aa5667979e5c35c3f4111827dc5f8cf59f3eb3db5b41a7e7","correctionReason":null,"id":"b43dca990d657529c8fa8c0f377026d70a5de08bb136d6dd39244d3c2bc955ce","publicationId":"919cf774-3928-479b-803e-3d29acc5197e","version":1,"sourceUrl":"https://arxiv.org/abs/2610.38968","sourceTitle":"TableTune: Measured, Self-Correcting Draft-Length Tables for Dynamic Speculative Decoding","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-28","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-30T06:42:52.486Z","createdAt":"2026-11-07T06:00:59.261Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"a28e5b2f2b1cd9b8aa5667979e5c35c3f4111827dc5f8cf59f3eb3db5b41a7e7","kind":"article","url":"https://arxiv.org/abs/2610.38968","sourceUrl":"https://arxiv.org/abs/2610.38968","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-31T09:31:38.719Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.38968","checkedAt":"2026-11-07T06:32:08.888Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"a28e5b2f2b1cd9b8aa5667979e5c35c3f4111827dc5f8cf59f3eb3db5b41a7e7","confidence":0.91,"provider":"typesafe","model":"jev-1.13.0","inputHash":"c7b9454a421e66a9efa9904db0592d6672cbb9c654d2076fee0c00727ce3143f","decidedAt":"2026-10-31T09:31:39.328Z"},"provenance":{"textHash":"d5ca104dd139871e26298266caf0b2630dc19f0e0b9f892ad54d913f6d12419f","observationId":"383f59c058871f9f301608607500b510578516ef0c00d556f2d8bed8ef38eb62","retrievedAt":"2026-10-31T09:31:38.638Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"22501536-f756-4ba4-84c0-81872dce1086"},"reviewer":{"model":"gpt-6-luna","runId":"4df7a10b-4bfd-40d8-842d-41987ff99921"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-07T06:00:59.261Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Malvankar, Abhishek","url":null,"kind":"unknown"},{"name":"Castro, Paul","url":null,"kind":"unknown"},{"name":"Mitchell, Nick","url":null,"kind":"unknown"},{"name":"Villard, Lionel","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Malvankar, Abhishek","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Malvankar, Abhishek","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38968","locator":"head/meta[name=author|citation_author]"},"assertionId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-31T09:31:38.638Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d","sourceUrl":"https://arxiv.org/abs/2610.38968","contentSha256":"eab50101fe807959f14489a6421cf1d4475ce624e04accb9d0bc8ff86f639682","textHash":"d5ca104dd139871e26298266caf0b2630dc19f0e0b9f892ad54d913f6d12419f","observedAt":"2026-10-31T09:31:38.638Z"}},{"actor":{"name":"Castro, Paul","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Castro, Paul","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38968","locator":"head/meta[name=author|citation_author]"},"assertionId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-31T09:31:38.638Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d","sourceUrl":"https://arxiv.org/abs/2610.38968","contentSha256":"eab50101fe807959f14489a6421cf1d4475ce624e04accb9d0bc8ff86f639682","textHash":"d5ca104dd139871e26298266caf0b2630dc19f0e0b9f892ad54d913f6d12419f","observedAt":"2026-10-31T09:31:38.638Z"}},{"actor":{"name":"Mitchell, Nick","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mitchell, Nick","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38968","locator":"head/meta[name=author|citation_author]"},"assertionId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-31T09:31:38.638Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d","sourceUrl":"https://arxiv.org/abs/2610.38968","contentSha256":"eab50101fe807959f14489a6421cf1d4475ce624e04accb9d0bc8ff86f639682","textHash":"d5ca104dd139871e26298266caf0b2630dc19f0e0b9f892ad54d913f6d12419f","observedAt":"2026-10-31T09:31:38.638Z"}},{"actor":{"name":"Villard, Lionel","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Villard, Lionel","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38968","locator":"head/meta[name=author|citation_author]"},"assertionId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-31T09:31:38.638Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d","sourceUrl":"https://arxiv.org/abs/2610.38968","contentSha256":"eab50101fe807959f14489a6421cf1d4475ce624e04accb9d0bc8ff86f639682","textHash":"d5ca104dd139871e26298266caf0b2630dc19f0e0b9f892ad54d913f6d12419f","observedAt":"2026-10-31T09:31:38.638Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.38968","snapshotId":"ed512d89e0576d9e6360576f104d1c758ffeea564c3bc624cda213acb91b4d0d","contentSha256":"eab50101fe807959f14489a6421cf1d4475ce624e04accb9d0bc8ff86f639682","textHash":"d5ca104dd139871e26298266caf0b2630dc19f0e0b9f892ad54d913f6d12419f","observedAt":"2026-10-31T09:31:38.638Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/b43dca990d657529c8fa8c0f377026d70a5de08bb136d6dd39244d3c2bc955ce/source"}}}],"audits":[{"publicationId":"919cf774-3928-479b-803e-3d29acc5197e","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft correctly names the four authors and attributes the design, measurements and results to them as reported claims. The 'arXiv cs.AI' label matches the supplied publisher, even though the primary listing is cs.ET.","excerpt":"Authors:Abhishek Malvankar, Paul Castro, Nick Mitchell, Lionel Villard"},{"dimension":"summary","status":"uncertain","explanation":"A non-specialist cannot readily understand the central idea. The draft never says in plain language what speculative decoding is: a small drafter guesses tokens that the large model then checks. It also drops the source's causal mechanism, that speculation helps only while the GPU has spare compute, which is why the best length shrinks as batches grow. vLLM, batch and throughput are also unexplained. Smallest repair: add one clause on what speculative decoding does and the spare-compute condition, and identify vLLM as LLM serving software. The question and the other content are faithful.","excerpt":"Speculative decoding speeds up large language model (LLM) serving only while the GPU has spare compute, so the best draft length"},{"dimension":"date","status":"pass","explanation":"The originalPublished date of 2026-10-28 matches the v1 submission date shown on the arXiv page. It is not the later feed date.","excerpt":"[Submitted on 28 Oct 2026]"},{"dimension":"support","status":"pass","explanation":"The tuner and controller descriptions, the H100 figures (94% and 88%), and the gains with mistuned tables, workload switches and llm-d are all stated in the abstract. The inference that operators need less advance knowledge is conditional and grounded in the source. The limitations correctly note that comparisons are only against other ways to speculate.","excerpt":"without the operator having to know which length that is"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-07T06:00:59.261Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}