{"id":"a48f052b512c89a5d2553c729d9cb09a0f586c765b8b8a0d80a1396e0098bdf3","title":"arXiv cs.AI: WAKMan, a workload-aware KV cache manager","argument":"The authors of WAKMan argue that no single KV cache eviction policy works best across different mixes of language-model requests. Prefix caching reuses stored Key-Value (KV) states when requests share a prefix, reducing repeated prefill computation; eviction policy determines which states remain in limited memory.\n\nThe authors report that agentic steps tend to return within seconds and favor recency, while popular prompts and long conversations may return after many other requests and favor frequency. Across 20 mixes, they say the default LRU policy had 12% more cache hits than S3FIFO on agentic-heavy mixes, but up to 22% fewer elsewhere; even one workload parameter could change which policy performed best.\n\nWAKMan selects an eviction policy from live traffic without identifying request types or reading prompts. The authors report a 5-percentage-point average hit-rate improvement over LRU, along with the lowest mean and worst-case optimality gap among the policies they tested. These are the paper’s reported results; the abstract does not establish how the approach performs in a particular production deployment.\n\nHow does WAKMan perform on live production traffic compared with the workloads used in the paper’s evaluation?","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the paper’s abstract, which does not describe the evaluation setup or provide details needed to assess how the reported results transfer to production deployments.","speaker":{"name":"Morisetty, Suhas Kumar, Lokegaonkar, Vaibhavi, Varghese, Sachin Mathew, Harris, Wesley","roleAtSource":"Article author"},"source":{"title":"WAKMan: Workload Aware KVCache Manager","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.36355","publishedAt":"2026-10-26","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors say prefix caching reuses KV states for requests that share a prefix, reducing prefill computation, and that eviction policy matters when memory is limited.","excerpt":"Prefix caching enables a Large Language Model (LLM) servers to reuse the Key-Value (KV) states and accelerate prefill computation stage for requests that share a prefix with earlier prompts, thus reducing latency and serving cost.","url":"https://arxiv.org/abs/2610.36355","relationship":"Source-stated"},{"text":"The authors report that agentic steps tend to return within seconds and favor recency, while popular prompts and long conversations favor frequency.","excerpt":"agentic steps return within seconds and favor recency, while popular prompts and long conversations return after many other requests and favor frequency.","url":"https://arxiv.org/abs/2610.36355","relationship":"Source-stated"},{"text":"Across 20 mixes, the authors report that LRU had 12% more cache hits than S3FIFO on agentic-heavy mixes but up to 22% fewer elsewhere; a single workload parameter could change which policy won.","excerpt":"Across 20 mixes, no single policy is always best: vLLM's default strategy LRU provides 12% higher cache hits as compared to the frequency-oriented S3FIFO on agentic-heavy mixes but trails it by up to 22% elsewhere, and even a single workload parameter can flip the winner even for any particular mix.","url":"https://arxiv.org/abs/2610.36355","relationship":"Source-stated"},{"text":"WAKMan selects its eviction policy from live traffic without knowing request types or reading prompts.","excerpt":"We present WAKMan, a workload-aware KV cache manager that picks its eviction policy from live traffic without knowing request types or reading prompts.","url":"https://arxiv.org/abs/2610.36355","relationship":"Source-stated"},{"text":"The authors report that WAKMan improves hit rate over LRU by 5 percentage points on average and has the lowest mean and worst-case optimality gap among the policies.","excerpt":"It improves hit rate over LRU by 5 percentage points on average, with the lowest mean and worst-case optimality gap of all policies.","url":"https://arxiv.org/abs/2610.36355","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.36355","checkedAt":"2026-11-14T00:50:07.711Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How does WAKMan perform on live production traffic compared with the workloads used in the paper’s evaluation?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: WAKMan, a workload-aware KV cache manager","summary":"The authors of WAKMan argue that no single KV cache eviction policy works best across different mixes of language-model requests. Prefix caching reuses stored Key-Value (KV) states when requests share a prefix, reducing repeated prefill computation; eviction policy determines which states remain in limited memory.\n\nThe authors report that agentic steps tend to return within seconds and favor recency, while popular prompts and long conversations may return after many other requests and favor frequency. Across 20 mixes, they say the default LRU policy had 12% more cache hits than S3FIFO on agentic-heavy mixes, but up to 22% fewer elsewhere; even one workload parameter could change which policy performed best.\n\nWAKMan selects an eviction policy from live traffic without identifying request types or reading prompts. The authors report a 5-percentage-point average hit-rate improvement over LRU, along with the lowest mean and worst-case optimality gap among the policies they tested. These are the paper’s reported results; the abstract does not establish how the approach performs in a particular production deployment.\n\nHow does WAKMan perform on live production traffic compared with the workloads used in the paper’s evaluation?","question":"How does WAKMan perform on live production traffic compared with the workloads used in the paper’s evaluation?","claims":[{"text":"The authors say prefix caching reuses KV states for requests that share a prefix, reducing prefill computation, and that eviction policy matters when memory is limited.","excerpt":"Prefix caching enables a Large Language Model (LLM) servers to reuse the Key-Value (KV) states and accelerate prefill computation stage for requests that share a prefix with earlier prompts, thus reducing latency and serving cost.","support":"source-stated"},{"text":"The authors report that agentic steps tend to return within seconds and favor recency, while popular prompts and long conversations favor frequency.","excerpt":"agentic steps return within seconds and favor recency, while popular prompts and long conversations return after many other requests and favor frequency.","support":"source-stated"},{"text":"Across 20 mixes, the authors report that LRU had 12% more cache hits than S3FIFO on agentic-heavy mixes but up to 22% fewer elsewhere; a single workload parameter could change which policy won.","excerpt":"Across 20 mixes, no single policy is always best: vLLM's default strategy LRU provides 12% higher cache hits as compared to the frequency-oriented S3FIFO on agentic-heavy mixes but trails it by up to 22% elsewhere, and even a single workload parameter can flip the winner even for any particular mix.","support":"source-stated"},{"text":"WAKMan selects its eviction policy from live traffic without knowing request types or reading prompts.","excerpt":"We present WAKMan, a workload-aware KV cache manager that picks its eviction policy from live traffic without knowing request types or reading prompts.","support":"source-stated"},{"text":"The authors report that WAKMan improves hit rate over LRU by 5 percentage points on average and has the lowest mean and worst-case optimality gap among the policies.","excerpt":"It improves hit rate over LRU by 5 percentage points on average, with the lowest mean and worst-case optimality gap of all policies.","support":"source-stated"}],"limitations":["The supplied evidence is the paper’s abstract, which does not describe the evaluation setup or provide details needed to assess how the reported results transfer to production deployments."],"mediaId":"8b75540f94518f9a332b00c8419544d7e500638a685c21abd48f55eb7d5baed6","correctionReason":null,"id":"a48f052b512c89a5d2553c729d9cb09a0f586c765b8b8a0d80a1396e0098bdf3","publicationId":"22b76062-8d69-433d-8e12-9612e5107189","version":1,"sourceUrl":"https://arxiv.org/abs/2610.36355","sourceTitle":"WAKMan: Workload Aware KVCache Manager","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-26","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-28T08:02:48.017Z","createdAt":"2026-11-14T00:18:24.260Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"8b75540f94518f9a332b00c8419544d7e500638a685c21abd48f55eb7d5baed6","kind":"article","url":"https://arxiv.org/abs/2610.36355","sourceUrl":"https://arxiv.org/abs/2610.36355","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-30T06:17:53.091Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.36355","checkedAt":"2026-11-14T00:50:07.711Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"8b75540f94518f9a332b00c8419544d7e500638a685c21abd48f55eb7d5baed6","confidence":0.8200000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"7e3702d54207904b8b7055e185c1f222e61bbf3189d5cb754d142543569e02d9","decidedAt":"2026-10-30T06:17:53.955Z"},"provenance":{"textHash":"fccba0bed4d0678e5772af6209d1ec7d8a99dec8f1e769e3fc01e6ee4c7546a1","observationId":"9c2f3da2ae3aa8d0b2a32340c554156a3197426705c84f2708fb03c68fe9d94d","retrievedAt":"2026-10-30T06:17:52.948Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"d48ca8f3-681f-4518-83ca-5baf805af2b9"},"reviewer":{"model":"gpt-6-luna","runId":"8062d77e-2b74-44c8-8612-280de4f8e7e2"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-14T00:18:24.260Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Morisetty, Suhas Kumar","url":null,"kind":"unknown"},{"name":"Lokegaonkar, Vaibhavi","url":null,"kind":"unknown"},{"name":"Varghese, Sachin Mathew","url":null,"kind":"unknown"},{"name":"Harris, Wesley","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Morisetty, Suhas Kumar","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Morisetty, Suhas Kumar","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36355","locator":"head/meta[name=author|citation_author]"},"assertionId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T06:17:52.948Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397","sourceUrl":"https://arxiv.org/abs/2610.36355","contentSha256":"07b4b22b8bebac78a7d50c3369e4b2ebeebf88ca36fdbdccae03eaebc98c8eaf","textHash":"fccba0bed4d0678e5772af6209d1ec7d8a99dec8f1e769e3fc01e6ee4c7546a1","observedAt":"2026-10-30T06:17:52.948Z"}},{"actor":{"name":"Lokegaonkar, Vaibhavi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Lokegaonkar, Vaibhavi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36355","locator":"head/meta[name=author|citation_author]"},"assertionId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T06:17:52.948Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397","sourceUrl":"https://arxiv.org/abs/2610.36355","contentSha256":"07b4b22b8bebac78a7d50c3369e4b2ebeebf88ca36fdbdccae03eaebc98c8eaf","textHash":"fccba0bed4d0678e5772af6209d1ec7d8a99dec8f1e769e3fc01e6ee4c7546a1","observedAt":"2026-10-30T06:17:52.948Z"}},{"actor":{"name":"Varghese, Sachin Mathew","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Varghese, Sachin Mathew","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36355","locator":"head/meta[name=author|citation_author]"},"assertionId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T06:17:52.948Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397","sourceUrl":"https://arxiv.org/abs/2610.36355","contentSha256":"07b4b22b8bebac78a7d50c3369e4b2ebeebf88ca36fdbdccae03eaebc98c8eaf","textHash":"fccba0bed4d0678e5772af6209d1ec7d8a99dec8f1e769e3fc01e6ee4c7546a1","observedAt":"2026-10-30T06:17:52.948Z"}},{"actor":{"name":"Harris, Wesley","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Harris, Wesley","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36355","locator":"head/meta[name=author|citation_author]"},"assertionId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T06:17:52.948Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397","sourceUrl":"https://arxiv.org/abs/2610.36355","contentSha256":"07b4b22b8bebac78a7d50c3369e4b2ebeebf88ca36fdbdccae03eaebc98c8eaf","textHash":"fccba0bed4d0678e5772af6209d1ec7d8a99dec8f1e769e3fc01e6ee4c7546a1","observedAt":"2026-10-30T06:17:52.948Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.36355","snapshotId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397","contentSha256":"07b4b22b8bebac78a7d50c3369e4b2ebeebf88ca36fdbdccae03eaebc98c8eaf","textHash":"fccba0bed4d0678e5772af6209d1ec7d8a99dec8f1e769e3fc01e6ee4c7546a1","observedAt":"2026-10-30T06:17:52.948Z","basis":"publisher-page-metadata","sourceLinks":42,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/a48f052b512c89a5d2553c729d9cb09a0f586c765b8b8a0d80a1396e0098bdf3/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-wakman-a-workload-aware-kv-cache-manager-a48f052b","formats":{"html":"/readings/arxiv-cs-ai-wakman-a-workload-aware-kv-cache-manager-a48f052b","markdown":"/readings/arxiv-cs-ai-wakman-a-workload-aware-kv-cache-manager-a48f052b.md","json":"/readings/arxiv-cs-ai-wakman-a-workload-aware-kv-cache-manager-a48f052b.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-agentic","name":"Agentic AI","explanation":"AI systems that plan and carry out a series of steps toward a goal, often by using other software, rather than giving one answer.","referenceUrl":"https://developers.google.com/machine-learning/glossary#agentic"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"a48f052b512c89a5d2553c729d9cb09a0f586c765b8b8a0d80a1396e0098bdf3","revision":"22b76062-8d69-433d-8e12-9612e5107189","revisionKind":"publication-id","title":"arXiv cs.AI: WAKMan, a workload-aware KV cache manager","url":"https://escapemeridian.com/readings/arxiv-cs-ai-wakman-a-workload-aware-kv-cache-manager-a48f052b"},"source":{"type":"source","id":"https://arxiv.org/abs/2610.36355","revision":"fccba0bed4d0678e5772af6209d1ec7d8a99dec8f1e769e3fc01e6ee4c7546a1","revisionKind":"sha256-source-text","title":"WAKMan: Workload Aware KVCache Manager","url":"https://arxiv.org/abs/2610.36355"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"a48f052b512c89a5d2553c729d9cb09a0f586c765b8b8a0d80a1396e0098bdf3","title":"arXiv cs.AI: WAKMan, a workload-aware KV cache manager","argument":"The authors of WAKMan argue that no single KV cache eviction policy works best across different mixes of language-model requests. Prefix caching reuses stored Key-Value (KV) states when requests share a prefix, reducing repeated prefill computation; eviction policy determines which states remain in limited memory.\n\nThe authors report that agentic steps tend to return within seconds and favor recency, while popular prompts and long conversations may return after many other requests and favor frequency. Across 20 mixes, they say the default LRU policy had 12% more cache hits than S3FIFO on agentic-heavy mixes, but up to 22% fewer elsewhere; even one workload parameter could change which policy performed best.\n\nWAKMan selects an eviction policy from live traffic without identifying request types or reading prompts. The authors report a 5-percentage-point average hit-rate improvement over LRU, along with the lowest mean and worst-case optimality gap among the policies they tested. These are the paper’s reported results; the abstract does not establish how the approach performs in a particular production deployment.\n\nHow does WAKMan perform on live production traffic compared with the workloads used in the paper’s evaluation?","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the paper’s abstract, which does not describe the evaluation setup or provide details needed to assess how the reported results transfer to production deployments.","speaker":{"name":"Morisetty, Suhas Kumar, Lokegaonkar, Vaibhavi, Varghese, Sachin Mathew, Harris, Wesley","roleAtSource":"Article author"},"source":{"title":"WAKMan: Workload Aware KVCache Manager","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.36355","publishedAt":"2026-10-26","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors say prefix caching reuses KV states for requests that share a prefix, reducing prefill computation, and that eviction policy matters when memory is limited.","excerpt":"Prefix caching enables a Large Language Model (LLM) servers to reuse the Key-Value (KV) states and accelerate prefill computation stage for requests that share a prefix with earlier prompts, thus reducing latency and serving cost.","url":"https://arxiv.org/abs/2610.36355","relationship":"Source-stated"},{"text":"The authors report that agentic steps tend to return within seconds and favor recency, while popular prompts and long conversations favor frequency.","excerpt":"agentic steps return within seconds and favor recency, while popular prompts and long conversations return after many other requests and favor frequency.","url":"https://arxiv.org/abs/2610.36355","relationship":"Source-stated"},{"text":"Across 20 mixes, the authors report that LRU had 12% more cache hits than S3FIFO on agentic-heavy mixes but up to 22% fewer elsewhere; a single workload parameter could change which policy won.","excerpt":"Across 20 mixes, no single policy is always best: vLLM's default strategy LRU provides 12% higher cache hits as compared to the frequency-oriented S3FIFO on agentic-heavy mixes but trails it by up to 22% elsewhere, and even a single workload parameter can flip the winner even for any particular mix.","url":"https://arxiv.org/abs/2610.36355","relationship":"Source-stated"},{"text":"WAKMan selects its eviction policy from live traffic without knowing request types or reading prompts.","excerpt":"We present WAKMan, a workload-aware KV cache manager that picks its eviction policy from live traffic without knowing request types or reading prompts.","url":"https://arxiv.org/abs/2610.36355","relationship":"Source-stated"},{"text":"The authors report that WAKMan improves hit rate over LRU by 5 percentage points on average and has the lowest mean and worst-case optimality gap among the policies.","excerpt":"It improves hit rate over LRU by 5 percentage points on average, with the lowest mean and worst-case optimality gap of all policies.","url":"https://arxiv.org/abs/2610.36355","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.36355","checkedAt":"2026-11-14T00:50:07.711Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How does WAKMan perform on live production traffic compared with the workloads used in the paper’s evaluation?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: WAKMan, a workload-aware KV cache manager","summary":"The authors of WAKMan argue that no single KV cache eviction policy works best across different mixes of language-model requests. Prefix caching reuses stored Key-Value (KV) states when requests share a prefix, reducing repeated prefill computation; eviction policy determines which states remain in limited memory.\n\nThe authors report that agentic steps tend to return within seconds and favor recency, while popular prompts and long conversations may return after many other requests and favor frequency. Across 20 mixes, they say the default LRU policy had 12% more cache hits than S3FIFO on agentic-heavy mixes, but up to 22% fewer elsewhere; even one workload parameter could change which policy performed best.\n\nWAKMan selects an eviction policy from live traffic without identifying request types or reading prompts. The authors report a 5-percentage-point average hit-rate improvement over LRU, along with the lowest mean and worst-case optimality gap among the policies they tested. These are the paper’s reported results; the abstract does not establish how the approach performs in a particular production deployment.\n\nHow does WAKMan perform on live production traffic compared with the workloads used in the paper’s evaluation?","question":"How does WAKMan perform on live production traffic compared with the workloads used in the paper’s evaluation?","claims":[{"text":"The authors say prefix caching reuses KV states for requests that share a prefix, reducing prefill computation, and that eviction policy matters when memory is limited.","excerpt":"Prefix caching enables a Large Language Model (LLM) servers to reuse the Key-Value (KV) states and accelerate prefill computation stage for requests that share a prefix with earlier prompts, thus reducing latency and serving cost.","support":"source-stated"},{"text":"The authors report that agentic steps tend to return within seconds and favor recency, while popular prompts and long conversations favor frequency.","excerpt":"agentic steps return within seconds and favor recency, while popular prompts and long conversations return after many other requests and favor frequency.","support":"source-stated"},{"text":"Across 20 mixes, the authors report that LRU had 12% more cache hits than S3FIFO on agentic-heavy mixes but up to 22% fewer elsewhere; a single workload parameter could change which policy won.","excerpt":"Across 20 mixes, no single policy is always best: vLLM's default strategy LRU provides 12% higher cache hits as compared to the frequency-oriented S3FIFO on agentic-heavy mixes but trails it by up to 22% elsewhere, and even a single workload parameter can flip the winner even for any particular mix.","support":"source-stated"},{"text":"WAKMan selects its eviction policy from live traffic without knowing request types or reading prompts.","excerpt":"We present WAKMan, a workload-aware KV cache manager that picks its eviction policy from live traffic without knowing request types or reading prompts.","support":"source-stated"},{"text":"The authors report that WAKMan improves hit rate over LRU by 5 percentage points on average and has the lowest mean and worst-case optimality gap among the policies.","excerpt":"It improves hit rate over LRU by 5 percentage points on average, with the lowest mean and worst-case optimality gap of all policies.","support":"source-stated"}],"limitations":["The supplied evidence is the paper’s abstract, which does not describe the evaluation setup or provide details needed to assess how the reported results transfer to production deployments."],"mediaId":"8b75540f94518f9a332b00c8419544d7e500638a685c21abd48f55eb7d5baed6","correctionReason":null,"id":"a48f052b512c89a5d2553c729d9cb09a0f586c765b8b8a0d80a1396e0098bdf3","publicationId":"22b76062-8d69-433d-8e12-9612e5107189","version":1,"sourceUrl":"https://arxiv.org/abs/2610.36355","sourceTitle":"WAKMan: Workload Aware KVCache Manager","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-26","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-28T08:02:48.017Z","createdAt":"2026-11-14T00:18:24.260Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"8b75540f94518f9a332b00c8419544d7e500638a685c21abd48f55eb7d5baed6","kind":"article","url":"https://arxiv.org/abs/2610.36355","sourceUrl":"https://arxiv.org/abs/2610.36355","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-30T06:17:53.091Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.36355","checkedAt":"2026-11-14T00:50:07.711Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"8b75540f94518f9a332b00c8419544d7e500638a685c21abd48f55eb7d5baed6","confidence":0.8200000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"7e3702d54207904b8b7055e185c1f222e61bbf3189d5cb754d142543569e02d9","decidedAt":"2026-10-30T06:17:53.955Z"},"provenance":{"textHash":"fccba0bed4d0678e5772af6209d1ec7d8a99dec8f1e769e3fc01e6ee4c7546a1","observationId":"9c2f3da2ae3aa8d0b2a32340c554156a3197426705c84f2708fb03c68fe9d94d","retrievedAt":"2026-10-30T06:17:52.948Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"d48ca8f3-681f-4518-83ca-5baf805af2b9"},"reviewer":{"model":"gpt-6-luna","runId":"8062d77e-2b74-44c8-8612-280de4f8e7e2"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-14T00:18:24.260Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Morisetty, Suhas Kumar","url":null,"kind":"unknown"},{"name":"Lokegaonkar, Vaibhavi","url":null,"kind":"unknown"},{"name":"Varghese, Sachin Mathew","url":null,"kind":"unknown"},{"name":"Harris, Wesley","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Morisetty, Suhas Kumar","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Morisetty, Suhas Kumar","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36355","locator":"head/meta[name=author|citation_author]"},"assertionId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T06:17:52.948Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397","sourceUrl":"https://arxiv.org/abs/2610.36355","contentSha256":"07b4b22b8bebac78a7d50c3369e4b2ebeebf88ca36fdbdccae03eaebc98c8eaf","textHash":"fccba0bed4d0678e5772af6209d1ec7d8a99dec8f1e769e3fc01e6ee4c7546a1","observedAt":"2026-10-30T06:17:52.948Z"}},{"actor":{"name":"Lokegaonkar, Vaibhavi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Lokegaonkar, Vaibhavi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36355","locator":"head/meta[name=author|citation_author]"},"assertionId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T06:17:52.948Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397","sourceUrl":"https://arxiv.org/abs/2610.36355","contentSha256":"07b4b22b8bebac78a7d50c3369e4b2ebeebf88ca36fdbdccae03eaebc98c8eaf","textHash":"fccba0bed4d0678e5772af6209d1ec7d8a99dec8f1e769e3fc01e6ee4c7546a1","observedAt":"2026-10-30T06:17:52.948Z"}},{"actor":{"name":"Varghese, Sachin Mathew","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Varghese, Sachin Mathew","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36355","locator":"head/meta[name=author|citation_author]"},"assertionId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T06:17:52.948Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397","sourceUrl":"https://arxiv.org/abs/2610.36355","contentSha256":"07b4b22b8bebac78a7d50c3369e4b2ebeebf88ca36fdbdccae03eaebc98c8eaf","textHash":"fccba0bed4d0678e5772af6209d1ec7d8a99dec8f1e769e3fc01e6ee4c7546a1","observedAt":"2026-10-30T06:17:52.948Z"}},{"actor":{"name":"Harris, Wesley","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Harris, Wesley","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36355","locator":"head/meta[name=author|citation_author]"},"assertionId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T06:17:52.948Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397","sourceUrl":"https://arxiv.org/abs/2610.36355","contentSha256":"07b4b22b8bebac78a7d50c3369e4b2ebeebf88ca36fdbdccae03eaebc98c8eaf","textHash":"fccba0bed4d0678e5772af6209d1ec7d8a99dec8f1e769e3fc01e6ee4c7546a1","observedAt":"2026-10-30T06:17:52.948Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.36355","snapshotId":"f87dee0c88539e8a5f2cdadb7e97290d633021b9a313840b8e11e38f1daa5397","contentSha256":"07b4b22b8bebac78a7d50c3369e4b2ebeebf88ca36fdbdccae03eaebc98c8eaf","textHash":"fccba0bed4d0678e5772af6209d1ec7d8a99dec8f1e769e3fc01e6ee4c7546a1","observedAt":"2026-10-30T06:17:52.948Z","basis":"publisher-page-metadata","sourceLinks":42,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/a48f052b512c89a5d2553c729d9cb09a0f586c765b8b8a0d80a1396e0098bdf3/source"}}}],"audits":[{"publicationId":"22b76062-8d69-433d-8e12-9612e5107189","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading attributes the claims to the WAKMan paper's authors on arXiv cs.AI and keeps the results framed as reported findings. That matches the abstract and the listed authors.","excerpt":"Authors:Suhas Kumar Morisetty, Vaibhavi Lokegaonkar, Sachin Mathew Varghese, Wesley Harris"},{"dimension":"summary","status":"uncertain","explanation":"The draft says 'the default LRU policy' but drops that LRU is vLLM's default, which leaves 'default' unanchored. Repair: write 'vLLM's default LRU policy'. LRU, S3FIFO, vLLM and 'optimality gap' are central but unexplained, so a general reader cannot follow the comparison. They need term-library tooltips. The draft also omits the source's stated stake, that prefix caching reduces latency and serving cost. Repair: add that phrase. The rest of the reading is faithful and does not overstate.","excerpt":"vLLM's default strategy LRU provides 12% higher cache hits as compared to the frequency-oriented S3FIFO"},{"dimension":"date","status":"pass","explanation":"The originalPublished date of 2026-10-26 matches the v1 submission date shown on the arXiv page. The later feed date is correctly not used.","excerpt":"[Submitted on 26 Oct 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim matches the abstract. The 12% and up-to-22% figures, the 20 mixes and the 5-percentage-point gain are reported accurately. The limitation and the question about production traffic are appropriately conditional and do not invent benefits or costs.","excerpt":"It improves hit rate over LRU by 5 percentage points on average, with the lowest mean and worst-case optimality gap of all policies."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page. That page is the original source.","excerpt":null}],"createdAt":"2026-11-14T00:18:24.260Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}