{"id":"d45533f08a97e3dff134741b71050f3dd1e7ae732439d6fccf7b5f71815dff48","title":"Sara Amar on MANGO Arena: same seeds, different chains","argument":"Sara Amar introduces MANGO Arena, an open-source testbed where four LLM agents run companies in a serial supply chain. It tracks the bullwhip effect—demand variability growing as orders move upstream—as well as rule-following and proposals to collude. In a pilot using three small reasoning models, demand variability grew substantially upstream, often more than under a textbook ordering policy. Rule violations were rare, and no agent proposed a money side deal. But Amar’s central warning is about evaluation: failed API calls were silently counted as “no order,” and even reruns with the same seeds and no failed calls produced large changes in upstream bullwhip. With only three demand seeds, conclusions about a disruption’s effect on a model did not survive rerunning the games. The paper reports these failures and proposes reporting practices for similar evaluations; its code, prompts and logged decisions are public. The pilot therefore illustrates how both system failures and run-to-run variation can shape apparent agent performance, while leaving the stability of findings beyond this small test unresolved.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The findings come from a pilot with three small reasoning models, two scripted reference policies, two conditions, and three demand seeds; they do not establish how results would generalize beyond those tests. The source reports that API failures affected metrics and that reruns varied, so the pilot's performance measurements require caution.","speaker":{"name":"Amar, Sara","roleAtSource":"Article author"},"source":{"title":"MANGO Arena: Same Seeds, Different Chains Evaluating LLM Agents in a Disrupted Supply Chain","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.23613","publishedAt":"2026-11-17","dateBasis":"Date basis not provided."},"evidence":[{"text":"Sara Amar introduces MANGO Arena, an open-source testbed where four LLM agents each operate a company in a serial supply chain.","excerpt":"We introduce MANGO Arena, an open-source testbed in which four LLM agents each run one company in a serial supply chain","url":"https://arxiv.org/abs/2611.23613","relationship":"Source-stated"},{"text":"MANGO Arena measures the bullwhip effect, rule adherence, and proposals to collude.","excerpt":"This lets one environment measure three things at once: an economic outcome (the bullwhip effect), rule adherence under pressure, and proposals to collude.","url":"https://arxiv.org/abs/2611.23613","relationship":"Source-stated"},{"text":"In a pilot, all LLM agents amplified demand variability upstream, often more than a textbook order-up-to policy.","excerpt":"all LLM agents amplified demand variability as it moved upstream, by 7 to 25 times at the Retailer and 13 to 179 times at the Supplier, often more than a textbook order-up-to policy.","url":"https://arxiv.org/abs/2611.23613","relationship":"Source-stated"},{"text":"The pilot recorded rare rule violations and no proposed money side deals.","excerpt":"Real rule violations were rare (at most 7 of 288 decisions per model) and no agent proposed a money side deal.","url":"https://arxiv.org/abs/2611.23613","relationship":"Source-stated"},{"text":"The authors report that API failures silently counted as “no order” decisions, while upstream bullwhip varied substantially between reruns.","excerpt":"API failures (rate limits and runaway hidden reasoning) entered the metrics silently as \"no order\" decisions. And when we reran games with the same seeds and no failed calls, upstream bullwhip changed by up to 17 times between runs.","url":"https://arxiv.org/abs/2611.23613","relationship":"Source-stated"},{"text":"The authors say that conclusions about disruption effects did not survive reruns with only three demand seeds.","excerpt":"With three seeds, conclusions about how a disruption affects a given model did not survive a rerun.","url":"https://arxiv.org/abs/2611.23613","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.23613","checkedAt":"2026-11-19T07:46:09.931Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How stable are the reported findings when the games are rerun with more demand seeds and without failed API calls?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Sara Amar on MANGO Arena: same seeds, different chains","summary":"Sara Amar introduces MANGO Arena, an open-source testbed where four LLM agents run companies in a serial supply chain. It tracks the bullwhip effect—demand variability growing as orders move upstream—as well as rule-following and proposals to collude. In a pilot using three small reasoning models, demand variability grew substantially upstream, often more than under a textbook ordering policy. Rule violations were rare, and no agent proposed a money side deal. But Amar’s central warning is about evaluation: failed API calls were silently counted as “no order,” and even reruns with the same seeds and no failed calls produced large changes in upstream bullwhip. With only three demand seeds, conclusions about a disruption’s effect on a model did not survive rerunning the games. The paper reports these failures and proposes reporting practices for similar evaluations; its code, prompts and logged decisions are public. The pilot therefore illustrates how both system failures and run-to-run variation can shape apparent agent performance, while leaving the stability of findings beyond this small test unresolved.","question":"How stable are the reported findings when the games are rerun with more demand seeds and without failed API calls?","claims":[{"text":"Sara Amar introduces MANGO Arena, an open-source testbed where four LLM agents each operate a company in a serial supply chain.","excerpt":"We introduce MANGO Arena, an open-source testbed in which four LLM agents each run one company in a serial supply chain","support":"source-stated"},{"text":"MANGO Arena measures the bullwhip effect, rule adherence, and proposals to collude.","excerpt":"This lets one environment measure three things at once: an economic outcome (the bullwhip effect), rule adherence under pressure, and proposals to collude.","support":"source-stated"},{"text":"In a pilot, all LLM agents amplified demand variability upstream, often more than a textbook order-up-to policy.","excerpt":"all LLM agents amplified demand variability as it moved upstream, by 7 to 25 times at the Retailer and 13 to 179 times at the Supplier, often more than a textbook order-up-to policy.","support":"source-stated"},{"text":"The pilot recorded rare rule violations and no proposed money side deals.","excerpt":"Real rule violations were rare (at most 7 of 288 decisions per model) and no agent proposed a money side deal.","support":"source-stated"},{"text":"The authors report that API failures silently counted as “no order” decisions, while upstream bullwhip varied substantially between reruns.","excerpt":"API failures (rate limits and runaway hidden reasoning) entered the metrics silently as \"no order\" decisions. And when we reran games with the same seeds and no failed calls, upstream bullwhip changed by up to 17 times between runs.","support":"source-stated"},{"text":"The authors say that conclusions about disruption effects did not survive reruns with only three demand seeds.","excerpt":"With three seeds, conclusions about how a disruption affects a given model did not survive a rerun.","support":"source-stated"}],"limitations":["The findings come from a pilot with three small reasoning models, two scripted reference policies, two conditions, and three demand seeds; they do not establish how results would generalize beyond those tests.","The source reports that API failures affected metrics and that reruns varied, so the pilot's performance measurements require caution."],"mediaId":"98c1e85ab01d45aa133f69cbb91857a6d2218aa0ca72c0e28061561c0cedbfc2","correctionReason":null,"id":"d45533f08a97e3dff134741b71050f3dd1e7ae732439d6fccf7b5f71815dff48","publicationId":"d634675f-1fbf-495f-85b0-6b3e2e387e41","version":1,"sourceUrl":"https://arxiv.org/abs/2611.23613","sourceTitle":"MANGO Arena: Same Seeds, Different Chains Evaluating LLM Agents in a Disrupted Supply Chain","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-17","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-19T05:04:18.159Z","createdAt":"2026-11-19T07:31:54.748Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"98c1e85ab01d45aa133f69cbb91857a6d2218aa0ca72c0e28061561c0cedbfc2","kind":"article","url":"https://arxiv.org/abs/2611.23613","sourceUrl":"https://arxiv.org/abs/2611.23613","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-19T07:30:59.217Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.23613","checkedAt":"2026-11-19T07:46:09.931Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"98c1e85ab01d45aa133f69cbb91857a6d2218aa0ca72c0e28061561c0cedbfc2","confidence":0.78,"provider":"typesafe","model":"jev-1.13.0","inputHash":"67bb5b3c6152c3b971562fd782276f512fd893eac4a6af2f70733b3a4bbd06a7","decidedAt":"2026-11-19T07:31:00.388Z"},"provenance":{"textHash":"052df621fa86eee29d87232eaf08e8e210208187a9281be3e6071840ae2b4950","observationId":"b0360fabe99f6a6fc79cc864523f390be055f91c1040a7d0f22d74f238494da5","retrievedAt":"2026-11-19T07:30:59.037Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"313f51fa-01c9-4fa3-829e-7b7d45a9bd4c"},"reviewer":{"model":"gpt-6-luna","runId":"33c4ef55-3ced-4715-865d-71e61cd41a2a"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-19T07:31:54.748Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Amar, Sara","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Amar, Sara","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Amar, Sara","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.23613","locator":"head/meta[name=author|citation_author]"},"assertionId":"d7d0b4d8794fb9dfca50bbfa071200f78dd75b46426d37cb1e89fe7d207f8a8a:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-19T07:46:09.931Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d7d0b4d8794fb9dfca50bbfa071200f78dd75b46426d37cb1e89fe7d207f8a8a","sourceUrl":"https://arxiv.org/abs/2611.23613","contentSha256":"2f79698437e12ee0d0552ac992ed9cf3fc87abde8d47b5b259b763874db6715f","textHash":"052df621fa86eee29d87232eaf08e8e210208187a9281be3e6071840ae2b4950","observedAt":"2026-11-19T07:46:09.931Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.23613","snapshotId":"d7d0b4d8794fb9dfca50bbfa071200f78dd75b46426d37cb1e89fe7d207f8a8a","contentSha256":"2f79698437e12ee0d0552ac992ed9cf3fc87abde8d47b5b259b763874db6715f","textHash":"052df621fa86eee29d87232eaf08e8e210208187a9281be3e6071840ae2b4950","observedAt":"2026-11-19T07:46:09.931Z","basis":"publisher-page-metadata","sourceLinks":40,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/d45533f08a97e3dff134741b71050f3dd1e7ae732439d6fccf7b5f71815dff48/source"}},"canonicalUrl":"https://escapemeridian.com/readings/sara-amar-on-mango-arena-same-seeds-different-chains-d45533f0","formats":{"html":"/readings/sara-amar-on-mango-arena-same-seeds-different-chains-d45533f0","markdown":"/readings/sara-amar-on-mango-arena-same-seeds-different-chains-d45533f0.md","json":"/readings/sara-amar-on-mango-arena-same-seeds-different-chains-d45533f0.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"},{"id":"term-reasoning-model","name":"Reasoning model","explanation":"A language model trained to work through a problem in written steps before it answers.","referenceUrl":"https://en.wikipedia.org/wiki/Reasoning_model"},{"id":"term-api","name":"API","explanation":"An application programming interface: a defined way for software to request data or actions from another system.","referenceUrl":"https://developer.mozilla.org/en-US/docs/Glossary/API"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"d45533f08a97e3dff134741b71050f3dd1e7ae732439d6fccf7b5f71815dff48","revision":"d634675f-1fbf-495f-85b0-6b3e2e387e41","revisionKind":"publication-id","title":"Sara Amar on MANGO Arena: same seeds, different chains","url":"https://escapemeridian.com/readings/sara-amar-on-mango-arena-same-seeds-different-chains-d45533f0"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.23613","revision":"052df621fa86eee29d87232eaf08e8e210208187a9281be3e6071840ae2b4950","revisionKind":"sha256-source-text","title":"MANGO Arena: Same Seeds, Different Chains Evaluating LLM Agents in a Disrupted Supply Chain","url":"https://arxiv.org/abs/2611.23613"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"d45533f08a97e3dff134741b71050f3dd1e7ae732439d6fccf7b5f71815dff48","title":"Sara Amar on MANGO Arena: same seeds, different chains","argument":"Sara Amar introduces MANGO Arena, an open-source testbed where four LLM agents run companies in a serial supply chain. It tracks the bullwhip effect—demand variability growing as orders move upstream—as well as rule-following and proposals to collude. In a pilot using three small reasoning models, demand variability grew substantially upstream, often more than under a textbook ordering policy. Rule violations were rare, and no agent proposed a money side deal. But Amar’s central warning is about evaluation: failed API calls were silently counted as “no order,” and even reruns with the same seeds and no failed calls produced large changes in upstream bullwhip. With only three demand seeds, conclusions about a disruption’s effect on a model did not survive rerunning the games. The paper reports these failures and proposes reporting practices for similar evaluations; its code, prompts and logged decisions are public. The pilot therefore illustrates how both system failures and run-to-run variation can shape apparent agent performance, while leaving the stability of findings beyond this small test unresolved.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The findings come from a pilot with three small reasoning models, two scripted reference policies, two conditions, and three demand seeds; they do not establish how results would generalize beyond those tests. The source reports that API failures affected metrics and that reruns varied, so the pilot's performance measurements require caution.","speaker":{"name":"Amar, Sara","roleAtSource":"Article author"},"source":{"title":"MANGO Arena: Same Seeds, Different Chains Evaluating LLM Agents in a Disrupted Supply Chain","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.23613","publishedAt":"2026-11-17","dateBasis":"Date basis not provided."},"evidence":[{"text":"Sara Amar introduces MANGO Arena, an open-source testbed where four LLM agents each operate a company in a serial supply chain.","excerpt":"We introduce MANGO Arena, an open-source testbed in which four LLM agents each run one company in a serial supply chain","url":"https://arxiv.org/abs/2611.23613","relationship":"Source-stated"},{"text":"MANGO Arena measures the bullwhip effect, rule adherence, and proposals to collude.","excerpt":"This lets one environment measure three things at once: an economic outcome (the bullwhip effect), rule adherence under pressure, and proposals to collude.","url":"https://arxiv.org/abs/2611.23613","relationship":"Source-stated"},{"text":"In a pilot, all LLM agents amplified demand variability upstream, often more than a textbook order-up-to policy.","excerpt":"all LLM agents amplified demand variability as it moved upstream, by 7 to 25 times at the Retailer and 13 to 179 times at the Supplier, often more than a textbook order-up-to policy.","url":"https://arxiv.org/abs/2611.23613","relationship":"Source-stated"},{"text":"The pilot recorded rare rule violations and no proposed money side deals.","excerpt":"Real rule violations were rare (at most 7 of 288 decisions per model) and no agent proposed a money side deal.","url":"https://arxiv.org/abs/2611.23613","relationship":"Source-stated"},{"text":"The authors report that API failures silently counted as “no order” decisions, while upstream bullwhip varied substantially between reruns.","excerpt":"API failures (rate limits and runaway hidden reasoning) entered the metrics silently as \"no order\" decisions. And when we reran games with the same seeds and no failed calls, upstream bullwhip changed by up to 17 times between runs.","url":"https://arxiv.org/abs/2611.23613","relationship":"Source-stated"},{"text":"The authors say that conclusions about disruption effects did not survive reruns with only three demand seeds.","excerpt":"With three seeds, conclusions about how a disruption affects a given model did not survive a rerun.","url":"https://arxiv.org/abs/2611.23613","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.23613","checkedAt":"2026-11-19T07:46:09.931Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How stable are the reported findings when the games are rerun with more demand seeds and without failed API calls?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Sara Amar on MANGO Arena: same seeds, different chains","summary":"Sara Amar introduces MANGO Arena, an open-source testbed where four LLM agents run companies in a serial supply chain. It tracks the bullwhip effect—demand variability growing as orders move upstream—as well as rule-following and proposals to collude. In a pilot using three small reasoning models, demand variability grew substantially upstream, often more than under a textbook ordering policy. Rule violations were rare, and no agent proposed a money side deal. But Amar’s central warning is about evaluation: failed API calls were silently counted as “no order,” and even reruns with the same seeds and no failed calls produced large changes in upstream bullwhip. With only three demand seeds, conclusions about a disruption’s effect on a model did not survive rerunning the games. The paper reports these failures and proposes reporting practices for similar evaluations; its code, prompts and logged decisions are public. The pilot therefore illustrates how both system failures and run-to-run variation can shape apparent agent performance, while leaving the stability of findings beyond this small test unresolved.","question":"How stable are the reported findings when the games are rerun with more demand seeds and without failed API calls?","claims":[{"text":"Sara Amar introduces MANGO Arena, an open-source testbed where four LLM agents each operate a company in a serial supply chain.","excerpt":"We introduce MANGO Arena, an open-source testbed in which four LLM agents each run one company in a serial supply chain","support":"source-stated"},{"text":"MANGO Arena measures the bullwhip effect, rule adherence, and proposals to collude.","excerpt":"This lets one environment measure three things at once: an economic outcome (the bullwhip effect), rule adherence under pressure, and proposals to collude.","support":"source-stated"},{"text":"In a pilot, all LLM agents amplified demand variability upstream, often more than a textbook order-up-to policy.","excerpt":"all LLM agents amplified demand variability as it moved upstream, by 7 to 25 times at the Retailer and 13 to 179 times at the Supplier, often more than a textbook order-up-to policy.","support":"source-stated"},{"text":"The pilot recorded rare rule violations and no proposed money side deals.","excerpt":"Real rule violations were rare (at most 7 of 288 decisions per model) and no agent proposed a money side deal.","support":"source-stated"},{"text":"The authors report that API failures silently counted as “no order” decisions, while upstream bullwhip varied substantially between reruns.","excerpt":"API failures (rate limits and runaway hidden reasoning) entered the metrics silently as \"no order\" decisions. And when we reran games with the same seeds and no failed calls, upstream bullwhip changed by up to 17 times between runs.","support":"source-stated"},{"text":"The authors say that conclusions about disruption effects did not survive reruns with only three demand seeds.","excerpt":"With three seeds, conclusions about how a disruption affects a given model did not survive a rerun.","support":"source-stated"}],"limitations":["The findings come from a pilot with three small reasoning models, two scripted reference policies, two conditions, and three demand seeds; they do not establish how results would generalize beyond those tests.","The source reports that API failures affected metrics and that reruns varied, so the pilot's performance measurements require caution."],"mediaId":"98c1e85ab01d45aa133f69cbb91857a6d2218aa0ca72c0e28061561c0cedbfc2","correctionReason":null,"id":"d45533f08a97e3dff134741b71050f3dd1e7ae732439d6fccf7b5f71815dff48","publicationId":"d634675f-1fbf-495f-85b0-6b3e2e387e41","version":1,"sourceUrl":"https://arxiv.org/abs/2611.23613","sourceTitle":"MANGO Arena: Same Seeds, Different Chains Evaluating LLM Agents in a Disrupted Supply Chain","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-17","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-19T05:04:18.159Z","createdAt":"2026-11-19T07:31:54.748Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"98c1e85ab01d45aa133f69cbb91857a6d2218aa0ca72c0e28061561c0cedbfc2","kind":"article","url":"https://arxiv.org/abs/2611.23613","sourceUrl":"https://arxiv.org/abs/2611.23613","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-19T07:30:59.217Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.23613","checkedAt":"2026-11-19T07:46:09.931Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"98c1e85ab01d45aa133f69cbb91857a6d2218aa0ca72c0e28061561c0cedbfc2","confidence":0.78,"provider":"typesafe","model":"jev-1.13.0","inputHash":"67bb5b3c6152c3b971562fd782276f512fd893eac4a6af2f70733b3a4bbd06a7","decidedAt":"2026-11-19T07:31:00.388Z"},"provenance":{"textHash":"052df621fa86eee29d87232eaf08e8e210208187a9281be3e6071840ae2b4950","observationId":"b0360fabe99f6a6fc79cc864523f390be055f91c1040a7d0f22d74f238494da5","retrievedAt":"2026-11-19T07:30:59.037Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"313f51fa-01c9-4fa3-829e-7b7d45a9bd4c"},"reviewer":{"model":"gpt-6-luna","runId":"33c4ef55-3ced-4715-865d-71e61cd41a2a"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-19T07:31:54.748Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Amar, Sara","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Amar, Sara","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Amar, Sara","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.23613","locator":"head/meta[name=author|citation_author]"},"assertionId":"d7d0b4d8794fb9dfca50bbfa071200f78dd75b46426d37cb1e89fe7d207f8a8a:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-19T07:46:09.931Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d7d0b4d8794fb9dfca50bbfa071200f78dd75b46426d37cb1e89fe7d207f8a8a","sourceUrl":"https://arxiv.org/abs/2611.23613","contentSha256":"2f79698437e12ee0d0552ac992ed9cf3fc87abde8d47b5b259b763874db6715f","textHash":"052df621fa86eee29d87232eaf08e8e210208187a9281be3e6071840ae2b4950","observedAt":"2026-11-19T07:46:09.931Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.23613","snapshotId":"d7d0b4d8794fb9dfca50bbfa071200f78dd75b46426d37cb1e89fe7d207f8a8a","contentSha256":"2f79698437e12ee0d0552ac992ed9cf3fc87abde8d47b5b259b763874db6715f","textHash":"052df621fa86eee29d87232eaf08e8e210208187a9281be3e6071840ae2b4950","observedAt":"2026-11-19T07:46:09.931Z","basis":"publisher-page-metadata","sourceLinks":40,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/d45533f08a97e3dff134741b71050f3dd1e7ae732439d6fccf7b5f71815dff48/source"}}}],"audits":[{"publicationId":"d634675f-1fbf-495f-85b0-6b3e2e387e41","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The paper is correctly attributed to Sara Amar, its sole listed author, on arXiv. The claims say 'the authors,' while the summary correctly uses Amar. This is a minor wording inconsistency and does not misattribute any claim.","excerpt":"Authors:Sara Amar"},{"dimension":"summary","status":"uncertain","explanation":"The summary is faithful and keeps the paper's central point about evaluation method. Two gaps limit understanding for non-specialists. First, 'seeds' and 'demand seeds' are never explained, yet the main lesson depends on them: the same fixed demand scenarios, rerun, gave very different results. Second, the 'disruption' is never identified as a supplier fire, so 'a disruption's effect' lacks context. Smallest repair: add a short gloss on seeds and name the supplier-fire condition. 'Order-up-to policy' could also use a term tooltip.","excerpt":"two conditions (with and without a supplier fire) and three demand seeds"},{"dimension":"date","status":"pass","explanation":"The original publication date of 2026-11-17 matches the v1 submission date. The feed date of Nov 19 is correctly not used.","excerpt":"[Submitted on 17 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Every claim is directly supported by the abstract. The closing interpretation, that system failures and run-to-run variation can shape apparent performance, follows from what the source reports. The limitations and the question are framed appropriately and do not turn the pilot into a general finding.","excerpt":"With three seeds, conclusions about how a disruption affects a given model did not survive a rerun."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified arXiv abstract page itself, which is the direct original source.","excerpt":null}],"createdAt":"2026-11-19T07:31:54.748Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}