{"id":"76c3f674d80e8c5cdc4dfc243855d33bdb60e6b592606714a74b55b0d5a1fc7a","title":"arXiv cs.AI: Rare, Relevant, and Still Wrong: How Memory Fails LLM Group Decisions","argument":"Anouar Imel, Imad Charradi, Abderrahman Sghir and Khalil El Khammar examine what a short memory should preserve when a group of language models discusses a decision and another model makes the final choice. They introduce CrossProfile, a benchmark that varies which agents hold supporting, misleading and irrelevant facts while keeping the facts’ wording fixed. On the benchmark, choosing rare claims or choosing claims relevant to the decision both fail in predictable ways: relevant misleading claims can survive filtering, while rare claims help only when they happen to support the answer. The authors say accuracy tracks the balance of evidence retained, rather than the selection rule alone. They also report a separate “social proof” effect: the decision model gives extra weight to facts attributed to many agents. Removing or randomly changing attribution tags raises accuracy in the classic hidden-profile configuration. In natural discussions, the authors report, evidence can be lost before memory selection begins: the full transcript performs worse than no notes. The results suggest that retaining a transcript or applying a simple memory heuristic does not necessarily preserve the evidence needed for a group decision; the benchmark and reported natural-discussion result do not establish how these effects vary across other settings.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract describes benchmark results across Qwen2.5-7B, Llama-3.1-8B and two DeepSeek models; it does not establish how the findings generalize beyond the tested models and tasks. The abstract reports a result for natural discussions but does not describe those discussions or provide details about the conditions of that comparison.","speaker":{"name":"Imel, Anouar, Charradi, Imad, Sghir, Abderrahman, Khammar, Khalil El","roleAtSource":"Article author"},"source":{"title":"Rare, Relevant, and Still Wrong: How Memory Fails LLM Group Decisions","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.37624","publishedAt":"2026-10-27","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors introduce CrossProfile, a benchmark that varies who holds supporting, decoy and irrelevant facts while holding their wording fixed.","excerpt":"a diagnostic benchmark of 60 templates with automatically verified answer keys, in which the ownership of supporting, decoy, and irrelevant facts is crossed while their text is held fixed (480 tasks)","url":"https://arxiv.org/abs/2610.37624","relationship":"Source-stated"},{"text":"On the tested models and benchmark, relevance-based selection can retain decoys, while rarest-first selection is no better than random on average.","excerpt":"Selecting by relevance readmits decoys, because decoys are on topic: even a perfect relevance filter loses 23 to 31 points to rarest-first selection in the classic hidden-profile configuration. Rarest-first selection is no better than random selection on average","url":"https://arxiv.org/abs/2610.37624","relationship":"Source-stated"},{"text":"The authors report that accuracy follows the balance of evidence retained, not the memory-selection policy by itself.","excerpt":"In both cases accuracy follows the balance of evidence the memory keeps, not the policy that kept it.","url":"https://arxiv.org/abs/2610.37624","relationship":"Source-stated"},{"text":"The authors report that decision models give extra weight to facts attributed to many agents, and that changing or removing attribution tags raises accuracy in the classic configuration.","excerpt":"Removing the attribution tags, or reassigning them at random with line order fixed, raises accuracy in the classic configuration by 13 to 24 points.","url":"https://arxiv.org/abs/2610.37624","relationship":"Source-stated"},{"text":"For natural discussions, the authors report lower accuracy from the complete transcript than from no notes.","excerpt":"In natural discussions the evidence is lost before any memory acts: the complete transcript yields lower accuracy than no notes at all.","url":"https://arxiv.org/abs/2610.37624","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.37624","checkedAt":"2026-11-14T04:34:08.935Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well do the reported effects hold beyond the CrossProfile tasks and natural discussions studied by the authors?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Rare, Relevant, and Still Wrong: How Memory Fails LLM Group Decisions","summary":"Anouar Imel, Imad Charradi, Abderrahman Sghir and Khalil El Khammar examine what a short memory should preserve when a group of language models discusses a decision and another model makes the final choice. They introduce CrossProfile, a benchmark that varies which agents hold supporting, misleading and irrelevant facts while keeping the facts’ wording fixed. On the benchmark, choosing rare claims or choosing claims relevant to the decision both fail in predictable ways: relevant misleading claims can survive filtering, while rare claims help only when they happen to support the answer. The authors say accuracy tracks the balance of evidence retained, rather than the selection rule alone. They also report a separate “social proof” effect: the decision model gives extra weight to facts attributed to many agents. Removing or randomly changing attribution tags raises accuracy in the classic hidden-profile configuration. In natural discussions, the authors report, evidence can be lost before memory selection begins: the full transcript performs worse than no notes. The results suggest that retaining a transcript or applying a simple memory heuristic does not necessarily preserve the evidence needed for a group decision; the benchmark and reported natural-discussion result do not establish how these effects vary across other settings.","question":"How well do the reported effects hold beyond the CrossProfile tasks and natural discussions studied by the authors?","claims":[{"text":"The authors introduce CrossProfile, a benchmark that varies who holds supporting, decoy and irrelevant facts while holding their wording fixed.","excerpt":"a diagnostic benchmark of 60 templates with automatically verified answer keys, in which the ownership of supporting, decoy, and irrelevant facts is crossed while their text is held fixed (480 tasks)","support":"source-stated"},{"text":"On the tested models and benchmark, relevance-based selection can retain decoys, while rarest-first selection is no better than random on average.","excerpt":"Selecting by relevance readmits decoys, because decoys are on topic: even a perfect relevance filter loses 23 to 31 points to rarest-first selection in the classic hidden-profile configuration. Rarest-first selection is no better than random selection on average","support":"source-stated"},{"text":"The authors report that accuracy follows the balance of evidence retained, not the memory-selection policy by itself.","excerpt":"In both cases accuracy follows the balance of evidence the memory keeps, not the policy that kept it.","support":"source-stated"},{"text":"The authors report that decision models give extra weight to facts attributed to many agents, and that changing or removing attribution tags raises accuracy in the classic configuration.","excerpt":"Removing the attribution tags, or reassigning them at random with line order fixed, raises accuracy in the classic configuration by 13 to 24 points.","support":"source-stated"},{"text":"For natural discussions, the authors report lower accuracy from the complete transcript than from no notes.","excerpt":"In natural discussions the evidence is lost before any memory acts: the complete transcript yields lower accuracy than no notes at all.","support":"source-stated"}],"limitations":["The abstract describes benchmark results across Qwen2.5-7B, Llama-3.1-8B and two DeepSeek models; it does not establish how the findings generalize beyond the tested models and tasks.","The abstract reports a result for natural discussions but does not describe those discussions or provide details about the conditions of that comparison."],"mediaId":"6db59b8a686567fc6320208ed1601e0c6f82a38f893d89bcb25301a9b7389ae0","correctionReason":null,"id":"76c3f674d80e8c5cdc4dfc243855d33bdb60e6b592606714a74b55b0d5a1fc7a","publicationId":"75c4ec9a-1d6e-414a-8375-d695b1dbc1c0","version":1,"sourceUrl":"https://arxiv.org/abs/2610.37624","sourceTitle":"Rare, Relevant, and Still Wrong: How Memory Fails LLM Group Decisions","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-27","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-28T05:08:35.812Z","createdAt":"2026-11-14T04:02:04.423Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"6db59b8a686567fc6320208ed1601e0c6f82a38f893d89bcb25301a9b7389ae0","kind":"article","url":"https://arxiv.org/abs/2610.37624","sourceUrl":"https://arxiv.org/abs/2610.37624","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-30T02:32:06.321Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.37624","checkedAt":"2026-11-14T04:34:08.935Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v5","mediaId":"6db59b8a686567fc6320208ed1601e0c6f82a38f893d89bcb25301a9b7389ae0","confidence":0.77,"provider":"typesafe","model":"jev-1.13.0","inputHash":"2ee4c38059727ef4521d31b5d5955c9060f811f419a64f8479666bc094f1a6d4","decidedAt":"2026-10-30T02:32:06.859Z","redecided":{"from":"stream-admission-v5","under":"stream-admission-v7+confidence-0.5"}},"provenance":{"textHash":"051473dd45ee13bc0ccc94064fe2a7882f4cff25767c36993aa22ba59c85d63d","observationId":"2bd8dfc1ac54cbb3abac0325e9b8b49a390fd966d4e9711b51f57bd4f55971b4","retrievedAt":"2026-10-30T02:32:06.246Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"7bc1a023-7afc-4f14-80cd-b2b2f461caae"},"reviewer":{"model":"gpt-6-luna","runId":"1c25fdc9-e35c-40d4-8ab9-3ddc23e4a7ce"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-14T04:02:04.423Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Imel, Anouar","url":null,"kind":"unknown"},{"name":"Charradi, Imad","url":null,"kind":"unknown"},{"name":"Sghir, Abderrahman","url":null,"kind":"unknown"},{"name":"Khammar, Khalil El","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Imel, Anouar","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Imel, Anouar","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37624","locator":"head/meta[name=author|citation_author]"},"assertionId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-14T04:18:11.661Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362","sourceUrl":"https://arxiv.org/abs/2610.37624","contentSha256":"b520f7c7eb05a2e92fb281664822904da7181e3b4c9192688b3569ec6fbcdc73","textHash":"051473dd45ee13bc0ccc94064fe2a7882f4cff25767c36993aa22ba59c85d63d","observedAt":"2026-11-14T04:18:11.661Z"}},{"actor":{"name":"Charradi, Imad","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Charradi, Imad","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37624","locator":"head/meta[name=author|citation_author]"},"assertionId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-14T04:18:11.661Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362","sourceUrl":"https://arxiv.org/abs/2610.37624","contentSha256":"b520f7c7eb05a2e92fb281664822904da7181e3b4c9192688b3569ec6fbcdc73","textHash":"051473dd45ee13bc0ccc94064fe2a7882f4cff25767c36993aa22ba59c85d63d","observedAt":"2026-11-14T04:18:11.661Z"}},{"actor":{"name":"Sghir, Abderrahman","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sghir, Abderrahman","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37624","locator":"head/meta[name=author|citation_author]"},"assertionId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-14T04:18:11.661Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362","sourceUrl":"https://arxiv.org/abs/2610.37624","contentSha256":"b520f7c7eb05a2e92fb281664822904da7181e3b4c9192688b3569ec6fbcdc73","textHash":"051473dd45ee13bc0ccc94064fe2a7882f4cff25767c36993aa22ba59c85d63d","observedAt":"2026-11-14T04:18:11.661Z"}},{"actor":{"name":"Khammar, Khalil El","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Khammar, Khalil El","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37624","locator":"head/meta[name=author|citation_author]"},"assertionId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-14T04:18:11.661Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362","sourceUrl":"https://arxiv.org/abs/2610.37624","contentSha256":"b520f7c7eb05a2e92fb281664822904da7181e3b4c9192688b3569ec6fbcdc73","textHash":"051473dd45ee13bc0ccc94064fe2a7882f4cff25767c36993aa22ba59c85d63d","observedAt":"2026-11-14T04:18:11.661Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.37624","snapshotId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362","contentSha256":"b520f7c7eb05a2e92fb281664822904da7181e3b4c9192688b3569ec6fbcdc73","textHash":"051473dd45ee13bc0ccc94064fe2a7882f4cff25767c36993aa22ba59c85d63d","observedAt":"2026-11-14T04:18:11.661Z","basis":"publisher-page-metadata","sourceLinks":45,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/76c3f674d80e8c5cdc4dfc243855d33bdb60e6b592606714a74b55b0d5a1fc7a/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-rare-relevant-and-still-wrong-how-memory-fails-llm-76c3f674","formats":{"html":"/readings/arxiv-cs-ai-rare-relevant-and-still-wrong-how-memory-fails-llm-76c3f674","markdown":"/readings/arxiv-cs-ai-rare-relevant-and-still-wrong-how-memory-fails-llm-76c3f674.md","json":"/readings/arxiv-cs-ai-rare-relevant-and-still-wrong-how-memory-fails-llm-76c3f674.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"},{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"76c3f674d80e8c5cdc4dfc243855d33bdb60e6b592606714a74b55b0d5a1fc7a","revision":"75c4ec9a-1d6e-414a-8375-d695b1dbc1c0","revisionKind":"publication-id","title":"arXiv cs.AI: Rare, Relevant, and Still Wrong: How Memory Fails LLM Group Decisions","url":"https://escapemeridian.com/readings/arxiv-cs-ai-rare-relevant-and-still-wrong-how-memory-fails-llm-76c3f674"},"source":{"type":"source","id":"https://arxiv.org/abs/2610.37624","revision":"051473dd45ee13bc0ccc94064fe2a7882f4cff25767c36993aa22ba59c85d63d","revisionKind":"sha256-source-text","title":"Rare, Relevant, and Still Wrong: How Memory Fails LLM Group Decisions","url":"https://arxiv.org/abs/2610.37624"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"76c3f674d80e8c5cdc4dfc243855d33bdb60e6b592606714a74b55b0d5a1fc7a","title":"arXiv cs.AI: Rare, Relevant, and Still Wrong: How Memory Fails LLM Group Decisions","argument":"Anouar Imel, Imad Charradi, Abderrahman Sghir and Khalil El Khammar examine what a short memory should preserve when a group of language models discusses a decision and another model makes the final choice. They introduce CrossProfile, a benchmark that varies which agents hold supporting, misleading and irrelevant facts while keeping the facts’ wording fixed. On the benchmark, choosing rare claims or choosing claims relevant to the decision both fail in predictable ways: relevant misleading claims can survive filtering, while rare claims help only when they happen to support the answer. The authors say accuracy tracks the balance of evidence retained, rather than the selection rule alone. They also report a separate “social proof” effect: the decision model gives extra weight to facts attributed to many agents. Removing or randomly changing attribution tags raises accuracy in the classic hidden-profile configuration. In natural discussions, the authors report, evidence can be lost before memory selection begins: the full transcript performs worse than no notes. The results suggest that retaining a transcript or applying a simple memory heuristic does not necessarily preserve the evidence needed for a group decision; the benchmark and reported natural-discussion result do not establish how these effects vary across other settings.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract describes benchmark results across Qwen2.5-7B, Llama-3.1-8B and two DeepSeek models; it does not establish how the findings generalize beyond the tested models and tasks. The abstract reports a result for natural discussions but does not describe those discussions or provide details about the conditions of that comparison.","speaker":{"name":"Imel, Anouar, Charradi, Imad, Sghir, Abderrahman, Khammar, Khalil El","roleAtSource":"Article author"},"source":{"title":"Rare, Relevant, and Still Wrong: How Memory Fails LLM Group Decisions","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.37624","publishedAt":"2026-10-27","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors introduce CrossProfile, a benchmark that varies who holds supporting, decoy and irrelevant facts while holding their wording fixed.","excerpt":"a diagnostic benchmark of 60 templates with automatically verified answer keys, in which the ownership of supporting, decoy, and irrelevant facts is crossed while their text is held fixed (480 tasks)","url":"https://arxiv.org/abs/2610.37624","relationship":"Source-stated"},{"text":"On the tested models and benchmark, relevance-based selection can retain decoys, while rarest-first selection is no better than random on average.","excerpt":"Selecting by relevance readmits decoys, because decoys are on topic: even a perfect relevance filter loses 23 to 31 points to rarest-first selection in the classic hidden-profile configuration. Rarest-first selection is no better than random selection on average","url":"https://arxiv.org/abs/2610.37624","relationship":"Source-stated"},{"text":"The authors report that accuracy follows the balance of evidence retained, not the memory-selection policy by itself.","excerpt":"In both cases accuracy follows the balance of evidence the memory keeps, not the policy that kept it.","url":"https://arxiv.org/abs/2610.37624","relationship":"Source-stated"},{"text":"The authors report that decision models give extra weight to facts attributed to many agents, and that changing or removing attribution tags raises accuracy in the classic configuration.","excerpt":"Removing the attribution tags, or reassigning them at random with line order fixed, raises accuracy in the classic configuration by 13 to 24 points.","url":"https://arxiv.org/abs/2610.37624","relationship":"Source-stated"},{"text":"For natural discussions, the authors report lower accuracy from the complete transcript than from no notes.","excerpt":"In natural discussions the evidence is lost before any memory acts: the complete transcript yields lower accuracy than no notes at all.","url":"https://arxiv.org/abs/2610.37624","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.37624","checkedAt":"2026-11-14T04:34:08.935Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well do the reported effects hold beyond the CrossProfile tasks and natural discussions studied by the authors?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Rare, Relevant, and Still Wrong: How Memory Fails LLM Group Decisions","summary":"Anouar Imel, Imad Charradi, Abderrahman Sghir and Khalil El Khammar examine what a short memory should preserve when a group of language models discusses a decision and another model makes the final choice. They introduce CrossProfile, a benchmark that varies which agents hold supporting, misleading and irrelevant facts while keeping the facts’ wording fixed. On the benchmark, choosing rare claims or choosing claims relevant to the decision both fail in predictable ways: relevant misleading claims can survive filtering, while rare claims help only when they happen to support the answer. The authors say accuracy tracks the balance of evidence retained, rather than the selection rule alone. They also report a separate “social proof” effect: the decision model gives extra weight to facts attributed to many agents. Removing or randomly changing attribution tags raises accuracy in the classic hidden-profile configuration. In natural discussions, the authors report, evidence can be lost before memory selection begins: the full transcript performs worse than no notes. The results suggest that retaining a transcript or applying a simple memory heuristic does not necessarily preserve the evidence needed for a group decision; the benchmark and reported natural-discussion result do not establish how these effects vary across other settings.","question":"How well do the reported effects hold beyond the CrossProfile tasks and natural discussions studied by the authors?","claims":[{"text":"The authors introduce CrossProfile, a benchmark that varies who holds supporting, decoy and irrelevant facts while holding their wording fixed.","excerpt":"a diagnostic benchmark of 60 templates with automatically verified answer keys, in which the ownership of supporting, decoy, and irrelevant facts is crossed while their text is held fixed (480 tasks)","support":"source-stated"},{"text":"On the tested models and benchmark, relevance-based selection can retain decoys, while rarest-first selection is no better than random on average.","excerpt":"Selecting by relevance readmits decoys, because decoys are on topic: even a perfect relevance filter loses 23 to 31 points to rarest-first selection in the classic hidden-profile configuration. Rarest-first selection is no better than random selection on average","support":"source-stated"},{"text":"The authors report that accuracy follows the balance of evidence retained, not the memory-selection policy by itself.","excerpt":"In both cases accuracy follows the balance of evidence the memory keeps, not the policy that kept it.","support":"source-stated"},{"text":"The authors report that decision models give extra weight to facts attributed to many agents, and that changing or removing attribution tags raises accuracy in the classic configuration.","excerpt":"Removing the attribution tags, or reassigning them at random with line order fixed, raises accuracy in the classic configuration by 13 to 24 points.","support":"source-stated"},{"text":"For natural discussions, the authors report lower accuracy from the complete transcript than from no notes.","excerpt":"In natural discussions the evidence is lost before any memory acts: the complete transcript yields lower accuracy than no notes at all.","support":"source-stated"}],"limitations":["The abstract describes benchmark results across Qwen2.5-7B, Llama-3.1-8B and two DeepSeek models; it does not establish how the findings generalize beyond the tested models and tasks.","The abstract reports a result for natural discussions but does not describe those discussions or provide details about the conditions of that comparison."],"mediaId":"6db59b8a686567fc6320208ed1601e0c6f82a38f893d89bcb25301a9b7389ae0","correctionReason":null,"id":"76c3f674d80e8c5cdc4dfc243855d33bdb60e6b592606714a74b55b0d5a1fc7a","publicationId":"75c4ec9a-1d6e-414a-8375-d695b1dbc1c0","version":1,"sourceUrl":"https://arxiv.org/abs/2610.37624","sourceTitle":"Rare, Relevant, and Still Wrong: How Memory Fails LLM Group Decisions","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-27","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-28T05:08:35.812Z","createdAt":"2026-11-14T04:02:04.423Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"6db59b8a686567fc6320208ed1601e0c6f82a38f893d89bcb25301a9b7389ae0","kind":"article","url":"https://arxiv.org/abs/2610.37624","sourceUrl":"https://arxiv.org/abs/2610.37624","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-30T02:32:06.321Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.37624","checkedAt":"2026-11-14T04:34:08.935Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v5","mediaId":"6db59b8a686567fc6320208ed1601e0c6f82a38f893d89bcb25301a9b7389ae0","confidence":0.77,"provider":"typesafe","model":"jev-1.13.0","inputHash":"2ee4c38059727ef4521d31b5d5955c9060f811f419a64f8479666bc094f1a6d4","decidedAt":"2026-10-30T02:32:06.859Z","redecided":{"from":"stream-admission-v5","under":"stream-admission-v7+confidence-0.5"}},"provenance":{"textHash":"051473dd45ee13bc0ccc94064fe2a7882f4cff25767c36993aa22ba59c85d63d","observationId":"2bd8dfc1ac54cbb3abac0325e9b8b49a390fd966d4e9711b51f57bd4f55971b4","retrievedAt":"2026-10-30T02:32:06.246Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"7bc1a023-7afc-4f14-80cd-b2b2f461caae"},"reviewer":{"model":"gpt-6-luna","runId":"1c25fdc9-e35c-40d4-8ab9-3ddc23e4a7ce"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-14T04:02:04.423Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Imel, Anouar","url":null,"kind":"unknown"},{"name":"Charradi, Imad","url":null,"kind":"unknown"},{"name":"Sghir, Abderrahman","url":null,"kind":"unknown"},{"name":"Khammar, Khalil El","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Imel, Anouar","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Imel, Anouar","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37624","locator":"head/meta[name=author|citation_author]"},"assertionId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-14T04:18:11.661Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362","sourceUrl":"https://arxiv.org/abs/2610.37624","contentSha256":"b520f7c7eb05a2e92fb281664822904da7181e3b4c9192688b3569ec6fbcdc73","textHash":"051473dd45ee13bc0ccc94064fe2a7882f4cff25767c36993aa22ba59c85d63d","observedAt":"2026-11-14T04:18:11.661Z"}},{"actor":{"name":"Charradi, Imad","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Charradi, Imad","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37624","locator":"head/meta[name=author|citation_author]"},"assertionId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-14T04:18:11.661Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362","sourceUrl":"https://arxiv.org/abs/2610.37624","contentSha256":"b520f7c7eb05a2e92fb281664822904da7181e3b4c9192688b3569ec6fbcdc73","textHash":"051473dd45ee13bc0ccc94064fe2a7882f4cff25767c36993aa22ba59c85d63d","observedAt":"2026-11-14T04:18:11.661Z"}},{"actor":{"name":"Sghir, Abderrahman","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sghir, Abderrahman","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37624","locator":"head/meta[name=author|citation_author]"},"assertionId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-14T04:18:11.661Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362","sourceUrl":"https://arxiv.org/abs/2610.37624","contentSha256":"b520f7c7eb05a2e92fb281664822904da7181e3b4c9192688b3569ec6fbcdc73","textHash":"051473dd45ee13bc0ccc94064fe2a7882f4cff25767c36993aa22ba59c85d63d","observedAt":"2026-11-14T04:18:11.661Z"}},{"actor":{"name":"Khammar, Khalil El","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Khammar, Khalil El","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37624","locator":"head/meta[name=author|citation_author]"},"assertionId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-14T04:18:11.661Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362","sourceUrl":"https://arxiv.org/abs/2610.37624","contentSha256":"b520f7c7eb05a2e92fb281664822904da7181e3b4c9192688b3569ec6fbcdc73","textHash":"051473dd45ee13bc0ccc94064fe2a7882f4cff25767c36993aa22ba59c85d63d","observedAt":"2026-11-14T04:18:11.661Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.37624","snapshotId":"ed9268404684656cae763c14c82f15061bf176edede1419f197c8c96b39f7362","contentSha256":"b520f7c7eb05a2e92fb281664822904da7181e3b4c9192688b3569ec6fbcdc73","textHash":"051473dd45ee13bc0ccc94064fe2a7882f4cff25767c36993aa22ba59c85d63d","observedAt":"2026-11-14T04:18:11.661Z","basis":"publisher-page-metadata","sourceLinks":45,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/76c3f674d80e8c5cdc4dfc243855d33bdb60e6b592606714a74b55b0d5a1fc7a/source"}}}],"audits":[{"publicationId":"75c4ec9a-1d6e-414a-8375-d695b1dbc1c0","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading names the four listed authors and attributes the findings to them as reported results, not as established fact. The arXiv cs.AI source is identified correctly.","excerpt":"Authors:Anouar Imel, Imad Charradi, Abderrahman Sghir, Khalil El Khammar"},{"dimension":"summary","status":"uncertain","explanation":"The term 'classic hidden-profile configuration' is used but never explained, so a non-specialist cannot tell what kind of task the accuracy gain applies to. The reading also drops the paper's core reason both heuristics look attractive: how widely a fact is held is confounded with whether it helps. It omits the abstract's sharpest result, that even a perfect relevance filter loses 23 to 31 points to rarest-first. Smallest repair: one plain-language clause defining hidden-profile tasks (key facts spread unevenly across group members), plus the confound sentence. The title and question are otherwise faithful.","excerpt":"On hidden-profile tasks both look attractive, because how widely a fact is held is confounded with whether it helps."},{"dimension":"date","status":"pass","explanation":"The originalPublished value, 2026-10-27, matches the arXiv v1 submission date. The later feed date was correctly not used.","excerpt":"[Submitted on 27 Oct 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim is source-stated and backed by its excerpt. The closing inference about transcripts and simple heuristics is hedged and scoped to the benchmark. Two small softenings, 'can be lost' and 'rather than the selection rule alone', do not contradict the source. The question follows from the evidence without leading.","excerpt":"In both cases accuracy follows the balance of evidence the memory keeps, not the policy that kept it."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the original arXiv abstract page, which is the actual source.","excerpt":null}],"createdAt":"2026-11-14T04:02:04.423Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}