{"id":"83a0f6bc74ed4b294b60b5ae00f95085b906d65a5af40a4e370a305587a9f6f6","title":"StateBench tests how language models track changing information across long documents","argument":"Kyle Wiggers’s article introduces StateBench, a benchmark for testing how language models track information about entities as it changes in long documents. The authors argue that tests should distinguish simple updates from harder chains of changes: missing one step can produce a wrong final answer. They compare models with different architectures and report that frontier models’ accuracy fell sharply on harder tasks as inputs grew longer, while models trained directly on the tasks showed different results. In those experiments, Gated DeltaNet and hybrid models generalized much farther than transformers on several task levels; transformers did not learn the hardest level, even with direct training. The authors say this contrast points to training as a factor for Gated DeltaNet and hybrid models, but to an architectural limitation for transformers in these tests.\n\nThe benchmark’s practical point is to locate which kinds of state tracking models handle or fail at, rather than treating state tracking as one ability. The authors hope this can guide research and training, but the results come from benchmark tasks, not demonstrations of performance in real-world documents. StateBench also assumes a fixed number of variables, whereas real tasks can introduce new entities over time. How well would its comparisons hold when a model must begin tracking people or objects that appear as a—","topicIds":["intelligence-and-discovery","work-and-agency"],"domain":"work","claimType":"attributed reading","limits":"The reported results concern benchmark tasks; the article does not demonstrate that the models perform similarly on real-world documents. The article identifies a fixed-number-of-variables assumption and says the framework does not cover new entities introduced over time. The direct-training results are from 275-million-parameter models trained on sequences of up to 256 assignments; the article’s results should not be generalized beyond the reported setups. The source page gives the byline Kyle Wiggers and the labels Ai2Comms and allenai, but does not clarify the precise authorship or attribution among them.","speaker":{"name":"Hugging Face","roleAtSource":"Publisher"},"source":{"title":"StateBench: Testing how language models track state changes over long documents","publisher":"Hugging Face","format":"Article","url":"https://huggingface.co/blog/allenai/statebench","publishedAt":"2026-11-03T17:15:21.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"The article presents StateBench as a benchmark for testing state tracking at different levels of complexity.","excerpt":"We’re introducing StateBench, a benchmark for long-context state tracking—how well language models keep track of information about entities in long documents as they evolve.","url":"https://huggingface.co/blog/allenai/statebench","relationship":"Source-stated"},{"text":"The authors report that frontier models’ accuracy declined on harder state-tracking tasks as inputs grew longer.","excerpt":"But on soluble and general finite problems, accuracy fell sharply as inputs grew longer, dropping to 13% or lower on the longest general finite problems.","url":"https://huggingface.co/blog/allenai/statebench","relationship":"Source-stated"},{"text":"In direct-training experiments, Gated DeltaNet and hybrid models generalized farther than transformers on several task levels, while transformers did not learn general finite problems.","excerpt":"Gated DeltaNet and hybrid models generalized almost perfectly on r-trivial, aperiodic, and soluble problems out to the longest sequences we tested, tens of thousands of assignments. Transformers learned the easier levels but degraded on longer sequences, and they never learned general finite probl","url":"https://huggingface.co/blog/allenai/statebench","relationship":"Source-stated"},{"text":"The article says StateBench assumes a fixed number of variables and does not cover tasks where new entities appear over time.","excerpt":"StateBench also assumes a fixed number of variables, while real tasks often introduce new entities over time.","url":"https://huggingface.co/blog/allenai/statebench","relationship":"Source-stated"},{"text":"The authors hope the benchmark will help researchers identify failures and develop training and evaluation data for capabilities that fall short.","excerpt":"We hope StateBench gives researchers a finer-grained way to find where models break down—and to build training and evaluation data for the capabilities that still fall short.","url":"https://huggingface.co/blog/allenai/statebench","relationship":"Source-stated"}],"sourceMedia":{"status":"found","sourceUrl":"https://huggingface.co/blog/allenai/statebench","checkedAt":"2026-11-10T06:54:13.361Z","items":[],"note":"Media was declared by the source, but no asset passed the supported availability checks. Open the original source to view it."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How would StateBench’s comparisons change when a document introduces new entities over time, a setting the current framework does not cover?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"StateBench tests how language models track changing information across long documents","summary":"Kyle Wiggers’s article introduces StateBench, a benchmark for testing how language models track information about entities as it changes in long documents. The authors argue that tests should distinguish simple updates from harder chains of changes: missing one step can produce a wrong final answer. They compare models with different architectures and report that frontier models’ accuracy fell sharply on harder tasks as inputs grew longer, while models trained directly on the tasks showed different results. In those experiments, Gated DeltaNet and hybrid models generalized much farther than transformers on several task levels; transformers did not learn the hardest level, even with direct training. The authors say this contrast points to training as a factor for Gated DeltaNet and hybrid models, but to an architectural limitation for transformers in these tests.\n\nThe benchmark’s practical point is to locate which kinds of state tracking models handle or fail at, rather than treating state tracking as one ability. The authors hope this can guide research and training, but the results come from benchmark tasks, not demonstrations of performance in real-world documents. StateBench also assumes a fixed number of variables, whereas real tasks can introduce new entities over time. How well would its comparisons hold when a model must begin tracking people or objects that appear as a—","question":"How would StateBench’s comparisons change when a document introduces new entities over time, a setting the current framework does not cover?","claims":[{"text":"The article presents StateBench as a benchmark for testing state tracking at different levels of complexity.","excerpt":"We’re introducing StateBench, a benchmark for long-context state tracking—how well language models keep track of information about entities in long documents as they evolve.","support":"source-stated"},{"text":"The authors report that frontier models’ accuracy declined on harder state-tracking tasks as inputs grew longer.","excerpt":"But on soluble and general finite problems, accuracy fell sharply as inputs grew longer, dropping to 13% or lower on the longest general finite problems.","support":"source-stated"},{"text":"In direct-training experiments, Gated DeltaNet and hybrid models generalized farther than transformers on several task levels, while transformers did not learn general finite problems.","excerpt":"Gated DeltaNet and hybrid models generalized almost perfectly on r-trivial, aperiodic, and soluble problems out to the longest sequences we tested, tens of thousands of assignments. Transformers learned the easier levels but degraded on longer sequences, and they never learned general finite probl","support":"source-stated"},{"text":"The article says StateBench assumes a fixed number of variables and does not cover tasks where new entities appear over time.","excerpt":"StateBench also assumes a fixed number of variables, while real tasks often introduce new entities over time.","support":"source-stated"},{"text":"The authors hope the benchmark will help researchers identify failures and develop training and evaluation data for capabilities that fall short.","excerpt":"We hope StateBench gives researchers a finer-grained way to find where models break down—and to build training and evaluation data for the capabilities that still fall short.","support":"source-stated"}],"limitations":["The reported results concern benchmark tasks; the article does not demonstrate that the models perform similarly on real-world documents.","The article identifies a fixed-number-of-variables assumption and says the framework does not cover new entities introduced over time.","The direct-training results are from 275-million-parameter models trained on sequences of up to 256 assignments; the article’s results should not be generalized beyond the reported setups.","The source page gives the byline Kyle Wiggers and the labels Ai2Comms and allenai, but does not clarify the precise authorship or attribution among them."],"mediaId":"8d86676710497099b1091deb38df79f93e8f69b79a1b2cfae325c64584a4dfbe","correctionReason":null,"id":"83a0f6bc74ed4b294b60b5ae00f95085b906d65a5af40a4e370a305587a9f6f6","publicationId":"0061d5c9-ba81-4fac-861a-e15ebe2a49d0","version":1,"sourceUrl":"https://huggingface.co/blog/allenai/statebench","sourceTitle":"StateBench: Testing how language models track state changes over long documents","publisher":"Hugging Face","publishedAt":"2026-11-03T17:15:21.000Z","originalPublished":{"value":"2026-11-03T17:15:21.000Z","precision":"instant","basis":"feed_entry"},"firstObservedAt":"2026-11-03T17:18:25.046Z","createdAt":"2026-11-10T05:51:13.914Z","historical":true,"entityIds":["hugging-face"],"topicIds":["intelligence-and-discovery","work-and-agency"],"media":[{"id":"8d86676710497099b1091deb38df79f93e8f69b79a1b2cfae325c64584a4dfbe","kind":"article","url":"https://huggingface.co/blog/allenai/statebench","sourceUrl":"https://huggingface.co/blog/allenai/statebench","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-03T17:31:31.821Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"found","sourceUrl":"https://huggingface.co/blog/allenai/statebench","checkedAt":"2026-11-10T06:54:13.361Z","items":[],"note":"Media was declared by the source, but no asset passed the supported availability checks. Open the original source to view it."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"8d86676710497099b1091deb38df79f93e8f69b79a1b2cfae325c64584a4dfbe","confidence":0.91,"provider":"typesafe","model":"jev-1.13.0","inputHash":"490c4059a35981d293297581859535ede8cdddfec673021444a4103d08eb5761","decidedAt":"2026-11-03T17:31:35.443Z"},"provenance":{"textHash":"d6ebda813ab61a636a44f8c53f15e2fe077e9f17682dbba4a6db1112cb571854","observationId":"56047ba66bbb90de2659ceacde4326406218556703c7537785adc305f399ba84","retrievedAt":"2026-11-03T17:31:31.225Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"c12d427b-9c8f-4b4e-8f31-3a83addbab0e"},"reviewer":{"model":"gpt-6-luna","runId":"703822b2-5263-4344-81d2-a4bc12c86987"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-10T05:51:13.914Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[],"authorRole":"article-author","hosts":[],"status":"missing","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[],"participationCoverage":{"total":0,"returned":0,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://huggingface.co/blog/allenai/statebench","snapshotId":"7f9e86c330dc4456344f1a10415beac4124a9ee7e4ca12489da651f8c1500dff","contentSha256":"4bbc72696e33e700316aed1d308042cef38bf61586099668bfb9f0816cef15bb","textHash":"d6ebda813ab61a636a44f8c53f15e2fe077e9f17682dbba4a6db1112cb571854","observedAt":"2026-11-03T17:31:31.225Z","basis":"publisher-page-metadata","sourceLinks":30,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/83a0f6bc74ed4b294b60b5ae00f95085b906d65a5af40a4e370a305587a9f6f6/source"}},"canonicalUrl":"https://escapemeridian.com/readings/statebench-tests-how-language-models-track-changing-information-83a0f6bc","formats":{"html":"/readings/statebench-tests-how-language-models-track-changing-information-83a0f6bc","markdown":"/readings/statebench-tests-how-language-models-track-changing-information-83a0f6bc.md","json":"/readings/statebench-tests-how-language-models-track-changing-information-83a0f6bc.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"},{"id":"term-frontier-model","name":"Frontier model","explanation":"One of the most capable AI models available at a given time; the set shifts as models improve.","referenceUrl":"https://www.gov.uk/government/publications/frontier-ai-capabilities-and-risks-discussion-paper"}],"entities":[{"id":"hugging-face","name":"Hugging Face","kind":"organization","context":"Hugging Face hosts models, datasets and software that let people share, adapt and inspect AI systems.","referenceUrls":["https://huggingface.co/blog"],"path":"/entities/hugging-face","json":"/entities/hugging-face.json","markdown":"/entities/hugging-face.md"},{"id":"time","name":"TIME","kind":"organization","context":"TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.","referenceUrls":["https://time.com/"],"path":"/entities/time","json":"/entities/time.json","markdown":"/entities/time.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"83a0f6bc74ed4b294b60b5ae00f95085b906d65a5af40a4e370a305587a9f6f6","revision":"0061d5c9-ba81-4fac-861a-e15ebe2a49d0","revisionKind":"publication-id","title":"StateBench tests how language models track changing information across long documents","url":"https://escapemeridian.com/readings/statebench-tests-how-language-models-track-changing-information-83a0f6bc"},"source":{"type":"source","id":"https://huggingface.co/blog/allenai/statebench","revision":"d6ebda813ab61a636a44f8c53f15e2fe077e9f17682dbba4a6db1112cb571854","revisionKind":"sha256-source-text","title":"StateBench: Testing how language models track state changes over long documents","url":"https://huggingface.co/blog/allenai/statebench"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"83a0f6bc74ed4b294b60b5ae00f95085b906d65a5af40a4e370a305587a9f6f6","title":"StateBench tests how language models track changing information across long documents","argument":"Kyle Wiggers’s article introduces StateBench, a benchmark for testing how language models track information about entities as it changes in long documents. The authors argue that tests should distinguish simple updates from harder chains of changes: missing one step can produce a wrong final answer. They compare models with different architectures and report that frontier models’ accuracy fell sharply on harder tasks as inputs grew longer, while models trained directly on the tasks showed different results. In those experiments, Gated DeltaNet and hybrid models generalized much farther than transformers on several task levels; transformers did not learn the hardest level, even with direct training. The authors say this contrast points to training as a factor for Gated DeltaNet and hybrid models, but to an architectural limitation for transformers in these tests.\n\nThe benchmark’s practical point is to locate which kinds of state tracking models handle or fail at, rather than treating state tracking as one ability. The authors hope this can guide research and training, but the results come from benchmark tasks, not demonstrations of performance in real-world documents. StateBench also assumes a fixed number of variables, whereas real tasks can introduce new entities over time. How well would its comparisons hold when a model must begin tracking people or objects that appear as a—","topicIds":["intelligence-and-discovery","work-and-agency"],"domain":"work","claimType":"attributed reading","limits":"The reported results concern benchmark tasks; the article does not demonstrate that the models perform similarly on real-world documents. The article identifies a fixed-number-of-variables assumption and says the framework does not cover new entities introduced over time. The direct-training results are from 275-million-parameter models trained on sequences of up to 256 assignments; the article’s results should not be generalized beyond the reported setups. The source page gives the byline Kyle Wiggers and the labels Ai2Comms and allenai, but does not clarify the precise authorship or attribution among them.","speaker":{"name":"Hugging Face","roleAtSource":"Publisher"},"source":{"title":"StateBench: Testing how language models track state changes over long documents","publisher":"Hugging Face","format":"Article","url":"https://huggingface.co/blog/allenai/statebench","publishedAt":"2026-11-03T17:15:21.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"The article presents StateBench as a benchmark for testing state tracking at different levels of complexity.","excerpt":"We’re introducing StateBench, a benchmark for long-context state tracking—how well language models keep track of information about entities in long documents as they evolve.","url":"https://huggingface.co/blog/allenai/statebench","relationship":"Source-stated"},{"text":"The authors report that frontier models’ accuracy declined on harder state-tracking tasks as inputs grew longer.","excerpt":"But on soluble and general finite problems, accuracy fell sharply as inputs grew longer, dropping to 13% or lower on the longest general finite problems.","url":"https://huggingface.co/blog/allenai/statebench","relationship":"Source-stated"},{"text":"In direct-training experiments, Gated DeltaNet and hybrid models generalized farther than transformers on several task levels, while transformers did not learn general finite problems.","excerpt":"Gated DeltaNet and hybrid models generalized almost perfectly on r-trivial, aperiodic, and soluble problems out to the longest sequences we tested, tens of thousands of assignments. Transformers learned the easier levels but degraded on longer sequences, and they never learned general finite probl","url":"https://huggingface.co/blog/allenai/statebench","relationship":"Source-stated"},{"text":"The article says StateBench assumes a fixed number of variables and does not cover tasks where new entities appear over time.","excerpt":"StateBench also assumes a fixed number of variables, while real tasks often introduce new entities over time.","url":"https://huggingface.co/blog/allenai/statebench","relationship":"Source-stated"},{"text":"The authors hope the benchmark will help researchers identify failures and develop training and evaluation data for capabilities that fall short.","excerpt":"We hope StateBench gives researchers a finer-grained way to find where models break down—and to build training and evaluation data for the capabilities that still fall short.","url":"https://huggingface.co/blog/allenai/statebench","relationship":"Source-stated"}],"sourceMedia":{"status":"found","sourceUrl":"https://huggingface.co/blog/allenai/statebench","checkedAt":"2026-11-10T06:54:13.361Z","items":[],"note":"Media was declared by the source, but no asset passed the supported availability checks. Open the original source to view it."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How would StateBench’s comparisons change when a document introduces new entities over time, a setting the current framework does not cover?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"StateBench tests how language models track changing information across long documents","summary":"Kyle Wiggers’s article introduces StateBench, a benchmark for testing how language models track information about entities as it changes in long documents. The authors argue that tests should distinguish simple updates from harder chains of changes: missing one step can produce a wrong final answer. They compare models with different architectures and report that frontier models’ accuracy fell sharply on harder tasks as inputs grew longer, while models trained directly on the tasks showed different results. In those experiments, Gated DeltaNet and hybrid models generalized much farther than transformers on several task levels; transformers did not learn the hardest level, even with direct training. The authors say this contrast points to training as a factor for Gated DeltaNet and hybrid models, but to an architectural limitation for transformers in these tests.\n\nThe benchmark’s practical point is to locate which kinds of state tracking models handle or fail at, rather than treating state tracking as one ability. The authors hope this can guide research and training, but the results come from benchmark tasks, not demonstrations of performance in real-world documents. StateBench also assumes a fixed number of variables, whereas real tasks can introduce new entities over time. How well would its comparisons hold when a model must begin tracking people or objects that appear as a—","question":"How would StateBench’s comparisons change when a document introduces new entities over time, a setting the current framework does not cover?","claims":[{"text":"The article presents StateBench as a benchmark for testing state tracking at different levels of complexity.","excerpt":"We’re introducing StateBench, a benchmark for long-context state tracking—how well language models keep track of information about entities in long documents as they evolve.","support":"source-stated"},{"text":"The authors report that frontier models’ accuracy declined on harder state-tracking tasks as inputs grew longer.","excerpt":"But on soluble and general finite problems, accuracy fell sharply as inputs grew longer, dropping to 13% or lower on the longest general finite problems.","support":"source-stated"},{"text":"In direct-training experiments, Gated DeltaNet and hybrid models generalized farther than transformers on several task levels, while transformers did not learn general finite problems.","excerpt":"Gated DeltaNet and hybrid models generalized almost perfectly on r-trivial, aperiodic, and soluble problems out to the longest sequences we tested, tens of thousands of assignments. Transformers learned the easier levels but degraded on longer sequences, and they never learned general finite probl","support":"source-stated"},{"text":"The article says StateBench assumes a fixed number of variables and does not cover tasks where new entities appear over time.","excerpt":"StateBench also assumes a fixed number of variables, while real tasks often introduce new entities over time.","support":"source-stated"},{"text":"The authors hope the benchmark will help researchers identify failures and develop training and evaluation data for capabilities that fall short.","excerpt":"We hope StateBench gives researchers a finer-grained way to find where models break down—and to build training and evaluation data for the capabilities that still fall short.","support":"source-stated"}],"limitations":["The reported results concern benchmark tasks; the article does not demonstrate that the models perform similarly on real-world documents.","The article identifies a fixed-number-of-variables assumption and says the framework does not cover new entities introduced over time.","The direct-training results are from 275-million-parameter models trained on sequences of up to 256 assignments; the article’s results should not be generalized beyond the reported setups.","The source page gives the byline Kyle Wiggers and the labels Ai2Comms and allenai, but does not clarify the precise authorship or attribution among them."],"mediaId":"8d86676710497099b1091deb38df79f93e8f69b79a1b2cfae325c64584a4dfbe","correctionReason":null,"id":"83a0f6bc74ed4b294b60b5ae00f95085b906d65a5af40a4e370a305587a9f6f6","publicationId":"0061d5c9-ba81-4fac-861a-e15ebe2a49d0","version":1,"sourceUrl":"https://huggingface.co/blog/allenai/statebench","sourceTitle":"StateBench: Testing how language models track state changes over long documents","publisher":"Hugging Face","publishedAt":"2026-11-03T17:15:21.000Z","originalPublished":{"value":"2026-11-03T17:15:21.000Z","precision":"instant","basis":"feed_entry"},"firstObservedAt":"2026-11-03T17:18:25.046Z","createdAt":"2026-11-10T05:51:13.914Z","historical":true,"entityIds":["hugging-face"],"topicIds":["intelligence-and-discovery","work-and-agency"],"media":[{"id":"8d86676710497099b1091deb38df79f93e8f69b79a1b2cfae325c64584a4dfbe","kind":"article","url":"https://huggingface.co/blog/allenai/statebench","sourceUrl":"https://huggingface.co/blog/allenai/statebench","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-03T17:31:31.821Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"found","sourceUrl":"https://huggingface.co/blog/allenai/statebench","checkedAt":"2026-11-10T06:54:13.361Z","items":[],"note":"Media was declared by the source, but no asset passed the supported availability checks. Open the original source to view it."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"8d86676710497099b1091deb38df79f93e8f69b79a1b2cfae325c64584a4dfbe","confidence":0.91,"provider":"typesafe","model":"jev-1.13.0","inputHash":"490c4059a35981d293297581859535ede8cdddfec673021444a4103d08eb5761","decidedAt":"2026-11-03T17:31:35.443Z"},"provenance":{"textHash":"d6ebda813ab61a636a44f8c53f15e2fe077e9f17682dbba4a6db1112cb571854","observationId":"56047ba66bbb90de2659ceacde4326406218556703c7537785adc305f399ba84","retrievedAt":"2026-11-03T17:31:31.225Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"c12d427b-9c8f-4b4e-8f31-3a83addbab0e"},"reviewer":{"model":"gpt-6-luna","runId":"703822b2-5263-4344-81d2-a4bc12c86987"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-10T05:51:13.914Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[],"authorRole":"article-author","hosts":[],"status":"missing","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[],"participationCoverage":{"total":0,"returned":0,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://huggingface.co/blog/allenai/statebench","snapshotId":"7f9e86c330dc4456344f1a10415beac4124a9ee7e4ca12489da651f8c1500dff","contentSha256":"4bbc72696e33e700316aed1d308042cef38bf61586099668bfb9f0816cef15bb","textHash":"d6ebda813ab61a636a44f8c53f15e2fe077e9f17682dbba4a6db1112cb571854","observedAt":"2026-11-03T17:31:31.225Z","basis":"publisher-page-metadata","sourceLinks":30,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/83a0f6bc74ed4b294b60b5ae00f95085b906d65a5af40a4e370a305587a9f6f6/source"}}}],"audits":[{"publicationId":"0061d5c9-ba81-4fac-861a-e15ebe2a49d0","verdict":"uncertain","findings":[{"dimension":"attribution","status":"uncertain","explanation":"The page bylines Kyle Wiggers but also shows the labels Ai2Comms and allenai, and the post speaks in a collective 'we' about Ai2 research. The summary credits 'Kyle Wiggers's article' and then 'the authors' without naming Ai2 (allenai) as the research actor, so readers cannot tell who did the work. The draft's own limitation notes this ambiguity. Smallest repair: identify it as an Ai2 (allenai) post bylined by Kyle Wiggers.","excerpt":"Kyle Wiggers\nAi2Comms\nallenai"},{"dimension":"summary","status":"uncertain","explanation":"The summary is truncated mid-sentence ('appear as a—'), leaving the closing thought unfinished. Central terms are also unexplained for general readers. 'Transformers', 'Gated DeltaNet' and 'hybrid' are never glossed, though the source describes these designs as carrying 'a running memory forward'. The four difficulty levels and the frontier models tested go unnamed. 'Showed different results' is vague. Smallest repair: complete the final sentence and give one plain-language gloss of the architectures, with tooltips for these terms.","excerpt":"recurrent and hybrid architectures such as Gated DeltaNet that carry a running memory forward"},{"dimension":"date","status":"pass","explanation":"The originalPublished value (2026-11-03) matches the page's stated publication date of November 3, 2026, and no earlier version is indicated.","excerpt":"Published\nNovember 3, 2026"},{"dimension":"support","status":"pass","explanation":"The claims and their excerpts are source-stated. The frontier-model decline, the direct-training results, the training-versus-architecture interpretation, the fixed-variable limitation and the authors' hopes are all supported. The limitations correctly keep benchmark results separate from real-world performance. The question follows the source's own stated open gap.","excerpt":"For Gated DeltaNet and hybrid models, the gap points to training rather than architecture; trained directly, they learned to handle state-tracking levels their pretrained counterparts couldn’t."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the original Hugging Face article, which is the most direct way to access the source.","excerpt":null}],"createdAt":"2026-11-10T05:51:13.914Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}