{"id":"f34c7500d133403700d950ac5aa3c7665c9f1ef287bd1e39d7910931d7fdaddb","title":"arXiv cs.AI: Evaluating Governed LLM-Driven ML Experimentation: Lifecycle, Provenance, and Failure Metrics","argument":"Dowling Wong argues that judging autonomous agents that run ML experiments only by their best score misses how they got there: whether they stayed within permitted files, retained failed trials, and made keep-or-discard decisions traceable. The paper proposes evaluating experimental process alongside outcome. Its governed harness gives a control plane—not the LLM proposing changes—responsibility for each trial, including checking edit scope, deciding whether to keep or discard it, and recording it in an append-only ledger. Wong reports applying the same contract across six ML tasks and 1,445 trials. The ledger surfaced failures obscured by task scores, including a no-memory arm where all 120 trials failed, exhausted benchmark-adapter proposals, and a reset failure detected by reproducibility hashes; affected campaigns were rerun. In a matched counterfactual, a loop logging only successful trials omitted 43 of 50 trials, while the governed ledger recorded all 50. The paper also reports that memory’s effect on repeated bad proposals varies by task. Wong says the trial ledgers are released so reported numbers can be recomputed. The abstract describes results from these tasks and trials; it does not establish how the approach performs beyond them.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract reports results across six ML tasks and 1,445 trials; it does not establish how the approach performs on other tasks. The supplied evidence is the paper abstract, not the full paper; it does not provide full metric results or detailed methods.","speaker":{"name":"Wong, Dowling","roleAtSource":"Article author"},"source":{"title":"Evaluating Governed LLM-Driven ML Experimentation: Lifecycle, Provenance, and Failure Metrics","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.23678","publishedAt":"2026-11-18","dateBasis":"Date basis not provided."},"evidence":[{"text":"Wong argues that best-score-only evaluation misses whether experiments stayed within permitted files, retained failed trials, and made decisions traceable.","excerpt":"That score says nothing about how it was reached: whether the agent stayed within the files it was allowed to edit, whether failed trials were kept or silently dropped, and whether each keep or discard decision can be traced to its evidence.","url":"https://arxiv.org/abs/2611.23678","relationship":"Source-stated"},{"text":"The proposed harness gives a control plane responsibility for trial lifecycle, edit-scope checks, keep-or-discard decisions, and recording each trial in an append-only ledger.","excerpt":"A control plane, not the LLM that proposes changes, owns each trial's lifecycle, checks its edit scope, decides keep or discard, and appends one record per trial to an append-only ledger.","url":"https://arxiv.org/abs/2611.23678","relationship":"Source-stated"},{"text":"The paper reports using the same contract across six ML tasks and 1,445 trials, with ledger records exposing failures that task scores hide.","excerpt":"Across six ML tasks, from synthetic logistic regression to language-model training, and 1,445 trials, the same contract applied unchanged. The ledger exposed failures that a task score hides","url":"https://arxiv.org/abs/2611.23678","relationship":"Source-stated"},{"text":"In a matched counterfactual, logging only successful trials omitted 43 of 50 trials, whereas the governed ledger recorded all 50.","excerpt":"In a matched counterfactual, a loop that logs only successful trials left no record of 43 of 50 trials, while the governed ledger recorded all 50.","url":"https://arxiv.org/abs/2611.23678","relationship":"Source-stated"},{"text":"The reported effect of memory on repeated bad proposals depends on the task.","excerpt":"Memory ablations show that memory's effect on repeated bad proposals depends on the task.","url":"https://arxiv.org/abs/2611.23678","relationship":"Source-stated"},{"text":"Wong says releasing the trial ledgers allows the reported numbers to be recomputed.","excerpt":"We release the ledgers of all 1,445 trials, so that every number reported for them can be recomputed.","url":"https://arxiv.org/abs/2611.23678","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.23678","checkedAt":"2026-11-19T07:50:09.653Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How would the same contract perform on ML tasks beyond those evaluated in the paper?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Evaluating Governed LLM-Driven ML Experimentation: Lifecycle, Provenance, and Failure Metrics","summary":"Dowling Wong argues that judging autonomous agents that run ML experiments only by their best score misses how they got there: whether they stayed within permitted files, retained failed trials, and made keep-or-discard decisions traceable. The paper proposes evaluating experimental process alongside outcome. Its governed harness gives a control plane—not the LLM proposing changes—responsibility for each trial, including checking edit scope, deciding whether to keep or discard it, and recording it in an append-only ledger. Wong reports applying the same contract across six ML tasks and 1,445 trials. The ledger surfaced failures obscured by task scores, including a no-memory arm where all 120 trials failed, exhausted benchmark-adapter proposals, and a reset failure detected by reproducibility hashes; affected campaigns were rerun. In a matched counterfactual, a loop logging only successful trials omitted 43 of 50 trials, while the governed ledger recorded all 50. The paper also reports that memory’s effect on repeated bad proposals varies by task. Wong says the trial ledgers are released so reported numbers can be recomputed. The abstract describes results from these tasks and trials; it does not establish how the approach performs beyond them.","question":"How would the same contract perform on ML tasks beyond those evaluated in the paper?","claims":[{"text":"Wong argues that best-score-only evaluation misses whether experiments stayed within permitted files, retained failed trials, and made decisions traceable.","excerpt":"That score says nothing about how it was reached: whether the agent stayed within the files it was allowed to edit, whether failed trials were kept or silently dropped, and whether each keep or discard decision can be traced to its evidence.","support":"source-stated"},{"text":"The proposed harness gives a control plane responsibility for trial lifecycle, edit-scope checks, keep-or-discard decisions, and recording each trial in an append-only ledger.","excerpt":"A control plane, not the LLM that proposes changes, owns each trial's lifecycle, checks its edit scope, decides keep or discard, and appends one record per trial to an append-only ledger.","support":"source-stated"},{"text":"The paper reports using the same contract across six ML tasks and 1,445 trials, with ledger records exposing failures that task scores hide.","excerpt":"Across six ML tasks, from synthetic logistic regression to language-model training, and 1,445 trials, the same contract applied unchanged. The ledger exposed failures that a task score hides","support":"source-stated"},{"text":"In a matched counterfactual, logging only successful trials omitted 43 of 50 trials, whereas the governed ledger recorded all 50.","excerpt":"In a matched counterfactual, a loop that logs only successful trials left no record of 43 of 50 trials, while the governed ledger recorded all 50.","support":"source-stated"},{"text":"The reported effect of memory on repeated bad proposals depends on the task.","excerpt":"Memory ablations show that memory's effect on repeated bad proposals depends on the task.","support":"source-stated"},{"text":"Wong says releasing the trial ledgers allows the reported numbers to be recomputed.","excerpt":"We release the ledgers of all 1,445 trials, so that every number reported for them can be recomputed.","support":"source-stated"}],"limitations":["The abstract reports results across six ML tasks and 1,445 trials; it does not establish how the approach performs on other tasks.","The supplied evidence is the paper abstract, not the full paper; it does not provide full metric results or detailed methods."],"mediaId":"e2dca3baf6f62afaf1a118787237e43175313002f20b480babaed2f6c89bfa1e","correctionReason":null,"id":"f34c7500d133403700d950ac5aa3c7665c9f1ef287bd1e39d7910931d7fdaddb","publicationId":"76d2a8d7-c966-448a-824a-72d5d5c2185c","version":1,"sourceUrl":"https://arxiv.org/abs/2611.23678","sourceTitle":"Evaluating Governed LLM-Driven ML Experimentation: Lifecycle, Provenance, and Failure Metrics","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-18","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-19T05:01:30.346Z","createdAt":"2026-11-19T07:18:38.580Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"e2dca3baf6f62afaf1a118787237e43175313002f20b480babaed2f6c89bfa1e","kind":"article","url":"https://arxiv.org/abs/2611.23678","sourceUrl":"https://arxiv.org/abs/2611.23678","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-19T07:17:49.955Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.23678","checkedAt":"2026-11-19T07:50:09.653Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"e2dca3baf6f62afaf1a118787237e43175313002f20b480babaed2f6c89bfa1e","confidence":0.5800000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"c135746da4b893f53cc9dc8496ec17fa919395a5db00cc0a02411169f6842e2e","decidedAt":"2026-11-19T07:17:50.368Z"},"provenance":{"textHash":"940aa3f53eedff0b3cf3cee7ed4c29a1d240c3d0947b5c39d36b04d91791df52","observationId":"311c36647d2be2d6b55be6db4b54686c269c046a10a6253a9f35eef40db873d6","retrievedAt":"2026-11-19T07:17:49.912Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"dafc97c5-1729-43ff-8e28-121d91c25b5f"},"reviewer":{"model":"gpt-6-luna","runId":"f79ef061-aabb-45ef-8f83-2ed0944a2afc"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-19T07:18:38.580Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Wong, Dowling","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Wong, Dowling","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wong, Dowling","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.23678","locator":"head/meta[name=author|citation_author]"},"assertionId":"a5d312bd6f954c8a427b18b49a39faead0c3db8298bafa0cdd3ccebff8608e3e:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-19T07:50:09.653Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a5d312bd6f954c8a427b18b49a39faead0c3db8298bafa0cdd3ccebff8608e3e","sourceUrl":"https://arxiv.org/abs/2611.23678","contentSha256":"c609f620d029a86a64e64071e67b926d7685647896b5c9560ec94b7120dce139","textHash":"940aa3f53eedff0b3cf3cee7ed4c29a1d240c3d0947b5c39d36b04d91791df52","observedAt":"2026-11-19T07:50:09.653Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.23678","snapshotId":"a5d312bd6f954c8a427b18b49a39faead0c3db8298bafa0cdd3ccebff8608e3e","contentSha256":"c609f620d029a86a64e64071e67b926d7685647896b5c9560ec94b7120dce139","textHash":"940aa3f53eedff0b3cf3cee7ed4c29a1d240c3d0947b5c39d36b04d91791df52","observedAt":"2026-11-19T07:50:09.653Z","basis":"publisher-page-metadata","sourceLinks":41,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/f34c7500d133403700d950ac5aa3c7665c9f1ef287bd1e39d7910931d7fdaddb/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-evaluating-governed-llm-driven-ml-experimentation-f34c7500","formats":{"html":"/readings/arxiv-cs-ai-evaluating-governed-llm-driven-ml-experimentation-f34c7500","markdown":"/readings/arxiv-cs-ai-evaluating-governed-llm-driven-ml-experimentation-f34c7500.md","json":"/readings/arxiv-cs-ai-evaluating-governed-llm-driven-ml-experimentation-f34c7500.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"},{"id":"term-machine-learning","name":"Machine learning","explanation":"Methods that let computers learn patterns from examples instead of following rules written by hand.","referenceUrl":"https://developers.google.com/machine-learning/glossary#machine-learning"},{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"},{"id":"term-counterfactual","name":"Counterfactual","explanation":"An argument or scenario that considers what would have resulted if events had gone differently from how they actually did, such as if a policy had never been adopted; as an adjective, relating to this kind of thinking about what did not happen but could have.","referenceUrl":"https://dictionary.cambridge.org/dictionary/english/counterfactual"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"f34c7500d133403700d950ac5aa3c7665c9f1ef287bd1e39d7910931d7fdaddb","revision":"76d2a8d7-c966-448a-824a-72d5d5c2185c","revisionKind":"publication-id","title":"arXiv cs.AI: Evaluating Governed LLM-Driven ML Experimentation: Lifecycle, Provenance, and Failure Metrics","url":"https://escapemeridian.com/readings/arxiv-cs-ai-evaluating-governed-llm-driven-ml-experimentation-f34c7500"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.23678","revision":"940aa3f53eedff0b3cf3cee7ed4c29a1d240c3d0947b5c39d36b04d91791df52","revisionKind":"sha256-source-text","title":"Evaluating Governed LLM-Driven ML Experimentation: Lifecycle, Provenance, and Failure Metrics","url":"https://arxiv.org/abs/2611.23678"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"f34c7500d133403700d950ac5aa3c7665c9f1ef287bd1e39d7910931d7fdaddb","title":"arXiv cs.AI: Evaluating Governed LLM-Driven ML Experimentation: Lifecycle, Provenance, and Failure Metrics","argument":"Dowling Wong argues that judging autonomous agents that run ML experiments only by their best score misses how they got there: whether they stayed within permitted files, retained failed trials, and made keep-or-discard decisions traceable. The paper proposes evaluating experimental process alongside outcome. Its governed harness gives a control plane—not the LLM proposing changes—responsibility for each trial, including checking edit scope, deciding whether to keep or discard it, and recording it in an append-only ledger. Wong reports applying the same contract across six ML tasks and 1,445 trials. The ledger surfaced failures obscured by task scores, including a no-memory arm where all 120 trials failed, exhausted benchmark-adapter proposals, and a reset failure detected by reproducibility hashes; affected campaigns were rerun. In a matched counterfactual, a loop logging only successful trials omitted 43 of 50 trials, while the governed ledger recorded all 50. The paper also reports that memory’s effect on repeated bad proposals varies by task. Wong says the trial ledgers are released so reported numbers can be recomputed. The abstract describes results from these tasks and trials; it does not establish how the approach performs beyond them.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract reports results across six ML tasks and 1,445 trials; it does not establish how the approach performs on other tasks. The supplied evidence is the paper abstract, not the full paper; it does not provide full metric results or detailed methods.","speaker":{"name":"Wong, Dowling","roleAtSource":"Article author"},"source":{"title":"Evaluating Governed LLM-Driven ML Experimentation: Lifecycle, Provenance, and Failure Metrics","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.23678","publishedAt":"2026-11-18","dateBasis":"Date basis not provided."},"evidence":[{"text":"Wong argues that best-score-only evaluation misses whether experiments stayed within permitted files, retained failed trials, and made decisions traceable.","excerpt":"That score says nothing about how it was reached: whether the agent stayed within the files it was allowed to edit, whether failed trials were kept or silently dropped, and whether each keep or discard decision can be traced to its evidence.","url":"https://arxiv.org/abs/2611.23678","relationship":"Source-stated"},{"text":"The proposed harness gives a control plane responsibility for trial lifecycle, edit-scope checks, keep-or-discard decisions, and recording each trial in an append-only ledger.","excerpt":"A control plane, not the LLM that proposes changes, owns each trial's lifecycle, checks its edit scope, decides keep or discard, and appends one record per trial to an append-only ledger.","url":"https://arxiv.org/abs/2611.23678","relationship":"Source-stated"},{"text":"The paper reports using the same contract across six ML tasks and 1,445 trials, with ledger records exposing failures that task scores hide.","excerpt":"Across six ML tasks, from synthetic logistic regression to language-model training, and 1,445 trials, the same contract applied unchanged. The ledger exposed failures that a task score hides","url":"https://arxiv.org/abs/2611.23678","relationship":"Source-stated"},{"text":"In a matched counterfactual, logging only successful trials omitted 43 of 50 trials, whereas the governed ledger recorded all 50.","excerpt":"In a matched counterfactual, a loop that logs only successful trials left no record of 43 of 50 trials, while the governed ledger recorded all 50.","url":"https://arxiv.org/abs/2611.23678","relationship":"Source-stated"},{"text":"The reported effect of memory on repeated bad proposals depends on the task.","excerpt":"Memory ablations show that memory's effect on repeated bad proposals depends on the task.","url":"https://arxiv.org/abs/2611.23678","relationship":"Source-stated"},{"text":"Wong says releasing the trial ledgers allows the reported numbers to be recomputed.","excerpt":"We release the ledgers of all 1,445 trials, so that every number reported for them can be recomputed.","url":"https://arxiv.org/abs/2611.23678","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.23678","checkedAt":"2026-11-19T07:50:09.653Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How would the same contract perform on ML tasks beyond those evaluated in the paper?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Evaluating Governed LLM-Driven ML Experimentation: Lifecycle, Provenance, and Failure Metrics","summary":"Dowling Wong argues that judging autonomous agents that run ML experiments only by their best score misses how they got there: whether they stayed within permitted files, retained failed trials, and made keep-or-discard decisions traceable. The paper proposes evaluating experimental process alongside outcome. Its governed harness gives a control plane—not the LLM proposing changes—responsibility for each trial, including checking edit scope, deciding whether to keep or discard it, and recording it in an append-only ledger. Wong reports applying the same contract across six ML tasks and 1,445 trials. The ledger surfaced failures obscured by task scores, including a no-memory arm where all 120 trials failed, exhausted benchmark-adapter proposals, and a reset failure detected by reproducibility hashes; affected campaigns were rerun. In a matched counterfactual, a loop logging only successful trials omitted 43 of 50 trials, while the governed ledger recorded all 50. The paper also reports that memory’s effect on repeated bad proposals varies by task. Wong says the trial ledgers are released so reported numbers can be recomputed. The abstract describes results from these tasks and trials; it does not establish how the approach performs beyond them.","question":"How would the same contract perform on ML tasks beyond those evaluated in the paper?","claims":[{"text":"Wong argues that best-score-only evaluation misses whether experiments stayed within permitted files, retained failed trials, and made decisions traceable.","excerpt":"That score says nothing about how it was reached: whether the agent stayed within the files it was allowed to edit, whether failed trials were kept or silently dropped, and whether each keep or discard decision can be traced to its evidence.","support":"source-stated"},{"text":"The proposed harness gives a control plane responsibility for trial lifecycle, edit-scope checks, keep-or-discard decisions, and recording each trial in an append-only ledger.","excerpt":"A control plane, not the LLM that proposes changes, owns each trial's lifecycle, checks its edit scope, decides keep or discard, and appends one record per trial to an append-only ledger.","support":"source-stated"},{"text":"The paper reports using the same contract across six ML tasks and 1,445 trials, with ledger records exposing failures that task scores hide.","excerpt":"Across six ML tasks, from synthetic logistic regression to language-model training, and 1,445 trials, the same contract applied unchanged. The ledger exposed failures that a task score hides","support":"source-stated"},{"text":"In a matched counterfactual, logging only successful trials omitted 43 of 50 trials, whereas the governed ledger recorded all 50.","excerpt":"In a matched counterfactual, a loop that logs only successful trials left no record of 43 of 50 trials, while the governed ledger recorded all 50.","support":"source-stated"},{"text":"The reported effect of memory on repeated bad proposals depends on the task.","excerpt":"Memory ablations show that memory's effect on repeated bad proposals depends on the task.","support":"source-stated"},{"text":"Wong says releasing the trial ledgers allows the reported numbers to be recomputed.","excerpt":"We release the ledgers of all 1,445 trials, so that every number reported for them can be recomputed.","support":"source-stated"}],"limitations":["The abstract reports results across six ML tasks and 1,445 trials; it does not establish how the approach performs on other tasks.","The supplied evidence is the paper abstract, not the full paper; it does not provide full metric results or detailed methods."],"mediaId":"e2dca3baf6f62afaf1a118787237e43175313002f20b480babaed2f6c89bfa1e","correctionReason":null,"id":"f34c7500d133403700d950ac5aa3c7665c9f1ef287bd1e39d7910931d7fdaddb","publicationId":"76d2a8d7-c966-448a-824a-72d5d5c2185c","version":1,"sourceUrl":"https://arxiv.org/abs/2611.23678","sourceTitle":"Evaluating Governed LLM-Driven ML Experimentation: Lifecycle, Provenance, and Failure Metrics","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-18","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-19T05:01:30.346Z","createdAt":"2026-11-19T07:18:38.580Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"e2dca3baf6f62afaf1a118787237e43175313002f20b480babaed2f6c89bfa1e","kind":"article","url":"https://arxiv.org/abs/2611.23678","sourceUrl":"https://arxiv.org/abs/2611.23678","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-19T07:17:49.955Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.23678","checkedAt":"2026-11-19T07:50:09.653Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"e2dca3baf6f62afaf1a118787237e43175313002f20b480babaed2f6c89bfa1e","confidence":0.5800000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"c135746da4b893f53cc9dc8496ec17fa919395a5db00cc0a02411169f6842e2e","decidedAt":"2026-11-19T07:17:50.368Z"},"provenance":{"textHash":"940aa3f53eedff0b3cf3cee7ed4c29a1d240c3d0947b5c39d36b04d91791df52","observationId":"311c36647d2be2d6b55be6db4b54686c269c046a10a6253a9f35eef40db873d6","retrievedAt":"2026-11-19T07:17:49.912Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"dafc97c5-1729-43ff-8e28-121d91c25b5f"},"reviewer":{"model":"gpt-6-luna","runId":"f79ef061-aabb-45ef-8f83-2ed0944a2afc"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-19T07:18:38.580Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Wong, Dowling","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Wong, Dowling","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wong, Dowling","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.23678","locator":"head/meta[name=author|citation_author]"},"assertionId":"a5d312bd6f954c8a427b18b49a39faead0c3db8298bafa0cdd3ccebff8608e3e:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-19T07:50:09.653Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a5d312bd6f954c8a427b18b49a39faead0c3db8298bafa0cdd3ccebff8608e3e","sourceUrl":"https://arxiv.org/abs/2611.23678","contentSha256":"c609f620d029a86a64e64071e67b926d7685647896b5c9560ec94b7120dce139","textHash":"940aa3f53eedff0b3cf3cee7ed4c29a1d240c3d0947b5c39d36b04d91791df52","observedAt":"2026-11-19T07:50:09.653Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.23678","snapshotId":"a5d312bd6f954c8a427b18b49a39faead0c3db8298bafa0cdd3ccebff8608e3e","contentSha256":"c609f620d029a86a64e64071e67b926d7685647896b5c9560ec94b7120dce139","textHash":"940aa3f53eedff0b3cf3cee7ed4c29a1d240c3d0947b5c39d36b04d91791df52","observedAt":"2026-11-19T07:50:09.653Z","basis":"publisher-page-metadata","sourceLinks":41,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/f34c7500d133403700d950ac5aa3c7665c9f1ef287bd1e39d7910931d7fdaddb/source"}}}],"audits":[{"publicationId":"76d2a8d7-c966-448a-824a-72d5d5c2185c","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The arXiv page lists Dowling Wong as the sole author. Attributing the abstract's 'we' claims and arguments to Wong is accurate, and the reading keeps them as reported claims rather than established facts.","excerpt":"Authors:Dowling Wong"},{"dimension":"summary","status":"uncertain","explanation":"The reading is faithful but has two gaps. First, it omits the paper's named contribution: governance metrics (invalid-action rate, repeated-bad rate, provenance completeness) computed from the ledger. The title highlights these as 'Failure Metrics'. Smallest repair: add one sentence naming them. Second, central terms are left unexplained for a general reader: control plane, contract, no-memory arm, matched counterfactual and memory ablations. The question relies on 'the same contract' without saying what it is. Smallest repair: add plain glosses or tooltips, e.g. a control plane as separate supervising software.","excerpt":"Governance metrics such as the invalid-action rate, the repeated-bad rate and provenance completeness are computed from that ledger."},{"dimension":"date","status":"pass","explanation":"originalPublished is 2026-11-18. This matches the v1 submission date on arXiv. The feed date of Nov 19 is later and is correctly not used.","excerpt":"[Submitted on 18 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim and summary detail matches the abstract: the 1,445 trials, six tasks, 120 failed no-memory trials, 43 of 50 unlogged trials, reruns and the ledger release. The limitations correctly note that the evidence is the abstract only and that results may not generalize. The draft states no unsupported benefits or costs.","excerpt":"In a matched counterfactual, a loop that logs only successful trials left no record of 43 of 50 trials, while the governed ledger recorded all 50."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper. It is the most direct way for a reader to access the source.","excerpt":null}],"createdAt":"2026-11-19T07:18:38.580Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}