{"id":"7d12b8d8e83a8c90f68058ecac4fccbe8256eae52c21dc71e27c9dedac2cc34c","title":"arXiv: Inference after coding agents and correcting for agents’ search","argument":"Florian Gunsilius, David Van Dijcke and Kaspar Wüthrich argue that AI coding agents can search through data and possible analyses in ways that threaten classical inference. Because an agent can choose an analysis and estimate its result, the authors describe this as a new form of post-selection inference. The chance of finding a statistically favorable result can be shaped by the search that produced it. In simulations using data with zero effects, four frontier agents reported significant p-values between 54% and 98% of the time when asked to produce a compelling finding.\n\nThe authors propose resetting and replaying an agent’s analysis on data subsamples to estimate how often it selects that analysis when the result looks favorable. For agents with stable selection behavior, they say this produces a test that is asymptotically valid and consistent conditional on selection. They report that the correction brought false rejection rates close to the nominal 5% in simulations, and illustrate it with applications from two published papers. The proposal addresses a tension: agents may make empirical research more capable, while ordinary significance tests may mislead if they ignore how the analysis was selected. The abstract does not establish how reliably the method works beyond the reported simulations and applications.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv abstract, not the full paper; details of the procedure, simulations and applications are not available here. The reported 54%–98% rates are from simulated data with zero effects and a prompt to produce a compelling finding; they are not a measure of agents’ error rates in all empirical research. The abstract conditions its validity claim on stable selection behavior but does not specify how stability is assessed or how the correction performs when behavior is unstable. The abstract says the method is illustrated on applications from two published papers, but does not identify those papers or describe the results.","speaker":{"name":"Gunsilius, Florian, Van Dijcke, David, Wüthrich, Kaspar","roleAtSource":"Article author"},"source":{"title":"Inference after coding agents","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.23174","publishedAt":"2026-11-17","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors argue that coding agents’ open-ended search and ability to replay analysis create a new form of post-selection inference that threatens classical inference.","excerpt":"coding agents carrying out empirical research introduce a new type of post-selection inference that combines human-like, open-ended search over an implicit space of estimators with programmatic replayability","url":"https://arxiv.org/abs/2611.23174","relationship":"Source-stated"},{"text":"In simulations with zero effects, four frontier agents reported significant p-values 54% to 98% of the time when asked for a compelling finding.","excerpt":"on simulated data with zero effects, four frontier agents report significant p-values between 54% and 98% of the time when asked to produce a compelling finding.","url":"https://arxiv.org/abs/2611.23174","relationship":"Source-stated"},{"text":"The proposed correction replays an agent’s completed analysis on data subsamples to estimate its tendency to select that analysis when it looks statistically favorable.","excerpt":"we reset and replay it on subsamples of the data to estimate the agent's relative probability of selecting that analysis when it looks statistically favorable.","url":"https://arxiv.org/abs/2611.23174","relationship":"Source-stated"},{"text":"The authors say the corrected test is asymptotically valid and consistent conditional on selection for agents with stable selection behavior.","excerpt":"For agents with stable selection behavior, the resulting corrected test is asymptotically valid and consistent conditional on selection.","url":"https://arxiv.org/abs/2611.23174","relationship":"Source-stated"},{"text":"In simulations, the authors report that their correction brought high false rejection rates close to the nominal 5%.","excerpt":"In simulations, the correction robustly lowers the high false rejection rates to near the nominal 5%.","url":"https://arxiv.org/abs/2611.23174","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.23174","checkedAt":"2026-11-18T13:50:11.837Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well does the replay-based correction work when an agent’s selection behavior is not stable?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv: Inference after coding agents and correcting for agents’ search","summary":"Florian Gunsilius, David Van Dijcke and Kaspar Wüthrich argue that AI coding agents can search through data and possible analyses in ways that threaten classical inference. Because an agent can choose an analysis and estimate its result, the authors describe this as a new form of post-selection inference. The chance of finding a statistically favorable result can be shaped by the search that produced it. In simulations using data with zero effects, four frontier agents reported significant p-values between 54% and 98% of the time when asked to produce a compelling finding.\n\nThe authors propose resetting and replaying an agent’s analysis on data subsamples to estimate how often it selects that analysis when the result looks favorable. For agents with stable selection behavior, they say this produces a test that is asymptotically valid and consistent conditional on selection. They report that the correction brought false rejection rates close to the nominal 5% in simulations, and illustrate it with applications from two published papers. The proposal addresses a tension: agents may make empirical research more capable, while ordinary significance tests may mislead if they ignore how the analysis was selected. The abstract does not establish how reliably the method works beyond the reported simulations and applications.","question":"How well does the replay-based correction work when an agent’s selection behavior is not stable?","claims":[{"text":"The authors argue that coding agents’ open-ended search and ability to replay analysis create a new form of post-selection inference that threatens classical inference.","excerpt":"coding agents carrying out empirical research introduce a new type of post-selection inference that combines human-like, open-ended search over an implicit space of estimators with programmatic replayability","support":"source-stated"},{"text":"In simulations with zero effects, four frontier agents reported significant p-values 54% to 98% of the time when asked for a compelling finding.","excerpt":"on simulated data with zero effects, four frontier agents report significant p-values between 54% and 98% of the time when asked to produce a compelling finding.","support":"source-stated"},{"text":"The proposed correction replays an agent’s completed analysis on data subsamples to estimate its tendency to select that analysis when it looks statistically favorable.","excerpt":"we reset and replay it on subsamples of the data to estimate the agent's relative probability of selecting that analysis when it looks statistically favorable.","support":"source-stated"},{"text":"The authors say the corrected test is asymptotically valid and consistent conditional on selection for agents with stable selection behavior.","excerpt":"For agents with stable selection behavior, the resulting corrected test is asymptotically valid and consistent conditional on selection.","support":"source-stated"},{"text":"In simulations, the authors report that their correction brought high false rejection rates close to the nominal 5%.","excerpt":"In simulations, the correction robustly lowers the high false rejection rates to near the nominal 5%.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv abstract, not the full paper; details of the procedure, simulations and applications are not available here.","The reported 54%–98% rates are from simulated data with zero effects and a prompt to produce a compelling finding; they are not a measure of agents’ error rates in all empirical research.","The abstract conditions its validity claim on stable selection behavior but does not specify how stability is assessed or how the correction performs when behavior is unstable.","The abstract says the method is illustrated on applications from two published papers, but does not identify those papers or describe the results."],"mediaId":"bbf26c066481ba67e7c583ee9208592aac26289a2f958d5d831199ef54cdc69b","correctionReason":null,"id":"7d12b8d8e83a8c90f68058ecac4fccbe8256eae52c21dc71e27c9dedac2cc34c","publicationId":"a36ae0fd-7c01-438f-89d8-4ca424422ce5","version":1,"sourceUrl":"https://arxiv.org/abs/2611.23174","sourceTitle":"Inference after coding agents","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-17","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-18T05:16:05.939Z","createdAt":"2026-11-18T13:18:44.365Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"bbf26c066481ba67e7c583ee9208592aac26289a2f958d5d831199ef54cdc69b","kind":"article","url":"https://arxiv.org/abs/2611.23174","sourceUrl":"https://arxiv.org/abs/2611.23174","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-18T13:17:48.745Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.23174","checkedAt":"2026-11-18T13:50:11.837Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"bbf26c066481ba67e7c583ee9208592aac26289a2f958d5d831199ef54cdc69b","confidence":0.7999999999999999,"provider":"typesafe","model":"jev-1.13.0","inputHash":"b57c76b9f6024a490b28a7847a41fa105bbf85afe573d1302d51bfcf5e61bbc8","decidedAt":"2026-11-18T13:17:50.270Z"},"provenance":{"textHash":"7a60259014998edb31edb726972dea6455328e689c91482924fd435525e296ee","observationId":"9dd158395064afaa126e455ece2f3b4fe1a0c8c51b31f2fe786683dcebc0dc36","retrievedAt":"2026-11-18T13:17:48.476Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"ccb1cc3d-9c05-44c3-8620-056205d370da"},"reviewer":{"model":"gpt-6-luna","runId":"84d4e0f4-e8f6-4a8d-8348-3e4d54445224"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-18T13:18:44.365Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Gunsilius, Florian","url":null,"kind":"unknown"},{"name":"Van Dijcke, David","url":null,"kind":"unknown"},{"name":"Wüthrich, Kaspar","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Gunsilius, Florian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gunsilius, Florian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.23174","locator":"head/meta[name=author|citation_author]"},"assertionId":"d0523988dbedcdae49fcbb4208074643e37f1a6eb8cbba8906128591be30f9fa:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:50:11.837Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d0523988dbedcdae49fcbb4208074643e37f1a6eb8cbba8906128591be30f9fa","sourceUrl":"https://arxiv.org/abs/2611.23174","contentSha256":"a1e2a4f389ecfa6bca0098b2bc96bb189a2d78ed2fb9b5e27c22d820c30b7867","textHash":"7a60259014998edb31edb726972dea6455328e689c91482924fd435525e296ee","observedAt":"2026-11-18T13:50:11.837Z"}},{"actor":{"name":"Van Dijcke, David","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Van Dijcke, David","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.23174","locator":"head/meta[name=author|citation_author]"},"assertionId":"d0523988dbedcdae49fcbb4208074643e37f1a6eb8cbba8906128591be30f9fa:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:50:11.837Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d0523988dbedcdae49fcbb4208074643e37f1a6eb8cbba8906128591be30f9fa","sourceUrl":"https://arxiv.org/abs/2611.23174","contentSha256":"a1e2a4f389ecfa6bca0098b2bc96bb189a2d78ed2fb9b5e27c22d820c30b7867","textHash":"7a60259014998edb31edb726972dea6455328e689c91482924fd435525e296ee","observedAt":"2026-11-18T13:50:11.837Z"}},{"actor":{"name":"Wüthrich, Kaspar","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wüthrich, Kaspar","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.23174","locator":"head/meta[name=author|citation_author]"},"assertionId":"d0523988dbedcdae49fcbb4208074643e37f1a6eb8cbba8906128591be30f9fa:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:50:11.837Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d0523988dbedcdae49fcbb4208074643e37f1a6eb8cbba8906128591be30f9fa","sourceUrl":"https://arxiv.org/abs/2611.23174","contentSha256":"a1e2a4f389ecfa6bca0098b2bc96bb189a2d78ed2fb9b5e27c22d820c30b7867","textHash":"7a60259014998edb31edb726972dea6455328e689c91482924fd435525e296ee","observedAt":"2026-11-18T13:50:11.837Z"}}],"participationCoverage":{"total":3,"returned":3,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.23174","snapshotId":"d0523988dbedcdae49fcbb4208074643e37f1a6eb8cbba8906128591be30f9fa","contentSha256":"a1e2a4f389ecfa6bca0098b2bc96bb189a2d78ed2fb9b5e27c22d820c30b7867","textHash":"7a60259014998edb31edb726972dea6455328e689c91482924fd435525e296ee","observedAt":"2026-11-18T13:50:11.837Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/7d12b8d8e83a8c90f68058ecac4fccbe8256eae52c21dc71e27c9dedac2cc34c/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-inference-after-coding-agents-and-correcting-for-agents-7d12b8d8","formats":{"html":"/readings/arxiv-inference-after-coding-agents-and-correcting-for-agents-7d12b8d8","markdown":"/readings/arxiv-inference-after-coding-agents-and-correcting-for-agents-7d12b8d8.md","json":"/readings/arxiv-inference-after-coding-agents-and-correcting-for-agents-7d12b8d8.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-statistical-significance","name":"Statistical significance","explanation":"A test of whether a result is unlikely to be due to chance alone; it does not say how large or important an effect is.","referenceUrl":"https://en.wikipedia.org/wiki/Statistical_significance"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"},{"id":"time","name":"TIME","kind":"organization","context":"TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.","referenceUrls":["https://time.com/"],"path":"/entities/time","json":"/entities/time.json","markdown":"/entities/time.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"7d12b8d8e83a8c90f68058ecac4fccbe8256eae52c21dc71e27c9dedac2cc34c","revision":"a36ae0fd-7c01-438f-89d8-4ca424422ce5","revisionKind":"publication-id","title":"arXiv: Inference after coding agents and correcting for agents’ search","url":"https://escapemeridian.com/readings/arxiv-inference-after-coding-agents-and-correcting-for-agents-7d12b8d8"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.23174","revision":"7a60259014998edb31edb726972dea6455328e689c91482924fd435525e296ee","revisionKind":"sha256-source-text","title":"Inference after coding agents","url":"https://arxiv.org/abs/2611.23174"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"7d12b8d8e83a8c90f68058ecac4fccbe8256eae52c21dc71e27c9dedac2cc34c","title":"arXiv: Inference after coding agents and correcting for agents’ search","argument":"Florian Gunsilius, David Van Dijcke and Kaspar Wüthrich argue that AI coding agents can search through data and possible analyses in ways that threaten classical inference. Because an agent can choose an analysis and estimate its result, the authors describe this as a new form of post-selection inference. The chance of finding a statistically favorable result can be shaped by the search that produced it. In simulations using data with zero effects, four frontier agents reported significant p-values between 54% and 98% of the time when asked to produce a compelling finding.\n\nThe authors propose resetting and replaying an agent’s analysis on data subsamples to estimate how often it selects that analysis when the result looks favorable. For agents with stable selection behavior, they say this produces a test that is asymptotically valid and consistent conditional on selection. They report that the correction brought false rejection rates close to the nominal 5% in simulations, and illustrate it with applications from two published papers. The proposal addresses a tension: agents may make empirical research more capable, while ordinary significance tests may mislead if they ignore how the analysis was selected. The abstract does not establish how reliably the method works beyond the reported simulations and applications.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv abstract, not the full paper; details of the procedure, simulations and applications are not available here. The reported 54%–98% rates are from simulated data with zero effects and a prompt to produce a compelling finding; they are not a measure of agents’ error rates in all empirical research. The abstract conditions its validity claim on stable selection behavior but does not specify how stability is assessed or how the correction performs when behavior is unstable. The abstract says the method is illustrated on applications from two published papers, but does not identify those papers or describe the results.","speaker":{"name":"Gunsilius, Florian, Van Dijcke, David, Wüthrich, Kaspar","roleAtSource":"Article author"},"source":{"title":"Inference after coding agents","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.23174","publishedAt":"2026-11-17","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors argue that coding agents’ open-ended search and ability to replay analysis create a new form of post-selection inference that threatens classical inference.","excerpt":"coding agents carrying out empirical research introduce a new type of post-selection inference that combines human-like, open-ended search over an implicit space of estimators with programmatic replayability","url":"https://arxiv.org/abs/2611.23174","relationship":"Source-stated"},{"text":"In simulations with zero effects, four frontier agents reported significant p-values 54% to 98% of the time when asked for a compelling finding.","excerpt":"on simulated data with zero effects, four frontier agents report significant p-values between 54% and 98% of the time when asked to produce a compelling finding.","url":"https://arxiv.org/abs/2611.23174","relationship":"Source-stated"},{"text":"The proposed correction replays an agent’s completed analysis on data subsamples to estimate its tendency to select that analysis when it looks statistically favorable.","excerpt":"we reset and replay it on subsamples of the data to estimate the agent's relative probability of selecting that analysis when it looks statistically favorable.","url":"https://arxiv.org/abs/2611.23174","relationship":"Source-stated"},{"text":"The authors say the corrected test is asymptotically valid and consistent conditional on selection for agents with stable selection behavior.","excerpt":"For agents with stable selection behavior, the resulting corrected test is asymptotically valid and consistent conditional on selection.","url":"https://arxiv.org/abs/2611.23174","relationship":"Source-stated"},{"text":"In simulations, the authors report that their correction brought high false rejection rates close to the nominal 5%.","excerpt":"In simulations, the correction robustly lowers the high false rejection rates to near the nominal 5%.","url":"https://arxiv.org/abs/2611.23174","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.23174","checkedAt":"2026-11-18T13:50:11.837Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well does the replay-based correction work when an agent’s selection behavior is not stable?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv: Inference after coding agents and correcting for agents’ search","summary":"Florian Gunsilius, David Van Dijcke and Kaspar Wüthrich argue that AI coding agents can search through data and possible analyses in ways that threaten classical inference. Because an agent can choose an analysis and estimate its result, the authors describe this as a new form of post-selection inference. The chance of finding a statistically favorable result can be shaped by the search that produced it. In simulations using data with zero effects, four frontier agents reported significant p-values between 54% and 98% of the time when asked to produce a compelling finding.\n\nThe authors propose resetting and replaying an agent’s analysis on data subsamples to estimate how often it selects that analysis when the result looks favorable. For agents with stable selection behavior, they say this produces a test that is asymptotically valid and consistent conditional on selection. They report that the correction brought false rejection rates close to the nominal 5% in simulations, and illustrate it with applications from two published papers. The proposal addresses a tension: agents may make empirical research more capable, while ordinary significance tests may mislead if they ignore how the analysis was selected. The abstract does not establish how reliably the method works beyond the reported simulations and applications.","question":"How well does the replay-based correction work when an agent’s selection behavior is not stable?","claims":[{"text":"The authors argue that coding agents’ open-ended search and ability to replay analysis create a new form of post-selection inference that threatens classical inference.","excerpt":"coding agents carrying out empirical research introduce a new type of post-selection inference that combines human-like, open-ended search over an implicit space of estimators with programmatic replayability","support":"source-stated"},{"text":"In simulations with zero effects, four frontier agents reported significant p-values 54% to 98% of the time when asked for a compelling finding.","excerpt":"on simulated data with zero effects, four frontier agents report significant p-values between 54% and 98% of the time when asked to produce a compelling finding.","support":"source-stated"},{"text":"The proposed correction replays an agent’s completed analysis on data subsamples to estimate its tendency to select that analysis when it looks statistically favorable.","excerpt":"we reset and replay it on subsamples of the data to estimate the agent's relative probability of selecting that analysis when it looks statistically favorable.","support":"source-stated"},{"text":"The authors say the corrected test is asymptotically valid and consistent conditional on selection for agents with stable selection behavior.","excerpt":"For agents with stable selection behavior, the resulting corrected test is asymptotically valid and consistent conditional on selection.","support":"source-stated"},{"text":"In simulations, the authors report that their correction brought high false rejection rates close to the nominal 5%.","excerpt":"In simulations, the correction robustly lowers the high false rejection rates to near the nominal 5%.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv abstract, not the full paper; details of the procedure, simulations and applications are not available here.","The reported 54%–98% rates are from simulated data with zero effects and a prompt to produce a compelling finding; they are not a measure of agents’ error rates in all empirical research.","The abstract conditions its validity claim on stable selection behavior but does not specify how stability is assessed or how the correction performs when behavior is unstable.","The abstract says the method is illustrated on applications from two published papers, but does not identify those papers or describe the results."],"mediaId":"bbf26c066481ba67e7c583ee9208592aac26289a2f958d5d831199ef54cdc69b","correctionReason":null,"id":"7d12b8d8e83a8c90f68058ecac4fccbe8256eae52c21dc71e27c9dedac2cc34c","publicationId":"a36ae0fd-7c01-438f-89d8-4ca424422ce5","version":1,"sourceUrl":"https://arxiv.org/abs/2611.23174","sourceTitle":"Inference after coding agents","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-17","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-18T05:16:05.939Z","createdAt":"2026-11-18T13:18:44.365Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"bbf26c066481ba67e7c583ee9208592aac26289a2f958d5d831199ef54cdc69b","kind":"article","url":"https://arxiv.org/abs/2611.23174","sourceUrl":"https://arxiv.org/abs/2611.23174","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-18T13:17:48.745Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.23174","checkedAt":"2026-11-18T13:50:11.837Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"bbf26c066481ba67e7c583ee9208592aac26289a2f958d5d831199ef54cdc69b","confidence":0.7999999999999999,"provider":"typesafe","model":"jev-1.13.0","inputHash":"b57c76b9f6024a490b28a7847a41fa105bbf85afe573d1302d51bfcf5e61bbc8","decidedAt":"2026-11-18T13:17:50.270Z"},"provenance":{"textHash":"7a60259014998edb31edb726972dea6455328e689c91482924fd435525e296ee","observationId":"9dd158395064afaa126e455ece2f3b4fe1a0c8c51b31f2fe786683dcebc0dc36","retrievedAt":"2026-11-18T13:17:48.476Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"ccb1cc3d-9c05-44c3-8620-056205d370da"},"reviewer":{"model":"gpt-6-luna","runId":"84d4e0f4-e8f6-4a8d-8348-3e4d54445224"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-18T13:18:44.365Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Gunsilius, Florian","url":null,"kind":"unknown"},{"name":"Van Dijcke, David","url":null,"kind":"unknown"},{"name":"Wüthrich, Kaspar","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Gunsilius, Florian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gunsilius, Florian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.23174","locator":"head/meta[name=author|citation_author]"},"assertionId":"d0523988dbedcdae49fcbb4208074643e37f1a6eb8cbba8906128591be30f9fa:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:50:11.837Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d0523988dbedcdae49fcbb4208074643e37f1a6eb8cbba8906128591be30f9fa","sourceUrl":"https://arxiv.org/abs/2611.23174","contentSha256":"a1e2a4f389ecfa6bca0098b2bc96bb189a2d78ed2fb9b5e27c22d820c30b7867","textHash":"7a60259014998edb31edb726972dea6455328e689c91482924fd435525e296ee","observedAt":"2026-11-18T13:50:11.837Z"}},{"actor":{"name":"Van Dijcke, David","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Van Dijcke, David","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.23174","locator":"head/meta[name=author|citation_author]"},"assertionId":"d0523988dbedcdae49fcbb4208074643e37f1a6eb8cbba8906128591be30f9fa:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:50:11.837Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d0523988dbedcdae49fcbb4208074643e37f1a6eb8cbba8906128591be30f9fa","sourceUrl":"https://arxiv.org/abs/2611.23174","contentSha256":"a1e2a4f389ecfa6bca0098b2bc96bb189a2d78ed2fb9b5e27c22d820c30b7867","textHash":"7a60259014998edb31edb726972dea6455328e689c91482924fd435525e296ee","observedAt":"2026-11-18T13:50:11.837Z"}},{"actor":{"name":"Wüthrich, Kaspar","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wüthrich, Kaspar","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.23174","locator":"head/meta[name=author|citation_author]"},"assertionId":"d0523988dbedcdae49fcbb4208074643e37f1a6eb8cbba8906128591be30f9fa:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:50:11.837Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d0523988dbedcdae49fcbb4208074643e37f1a6eb8cbba8906128591be30f9fa","sourceUrl":"https://arxiv.org/abs/2611.23174","contentSha256":"a1e2a4f389ecfa6bca0098b2bc96bb189a2d78ed2fb9b5e27c22d820c30b7867","textHash":"7a60259014998edb31edb726972dea6455328e689c91482924fd435525e296ee","observedAt":"2026-11-18T13:50:11.837Z"}}],"participationCoverage":{"total":3,"returned":3,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.23174","snapshotId":"d0523988dbedcdae49fcbb4208074643e37f1a6eb8cbba8906128591be30f9fa","contentSha256":"a1e2a4f389ecfa6bca0098b2bc96bb189a2d78ed2fb9b5e27c22d820c30b7867","textHash":"7a60259014998edb31edb726972dea6455328e689c91482924fd435525e296ee","observedAt":"2026-11-18T13:50:11.837Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/7d12b8d8e83a8c90f68058ecac4fccbe8256eae52c21dc71e27c9dedac2cc34c/source"}}}],"audits":[{"publicationId":"a36ae0fd-7c01-438f-89d8-4ca424422ce5","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft correctly attributes the paper to Florian Gunsilius, David Van Dijcke and Kaspar Wüthrich, and frames its arguments and results as the authors' claims rather than established fact.","excerpt":"Authors:Florian Gunsilius, David Van Dijcke, Kaspar Wüthrich"},{"dimension":"summary","status":"uncertain","explanation":"The sentence 'Because an agent can choose an analysis and estimate its result' misstates what the authors say is new. Humans also choose and estimate. The novelty is human-like, open-ended search combined with programmatic replayability of both selection and estimation, which also motivates the replay correction. Smallest repair: name that combination. Central terms (classical inference, p-values, asymptotically valid, nominal 5%) need term-library tooltips. The draft also omits the authors' point that the correction is learned from the black-box agent's actual choices, so it stays valid as AI evolves.","excerpt":"combines human-like, open-ended search over an implicit space of estimators with programmatic replayability of both the selection and the estimation process"},{"dimension":"date","status":"pass","explanation":"The originalPublished date of 2026-11-17 matches the arXiv v1 submission date. The feed date of 2026-11-18 is correctly not used.","excerpt":"[Submitted on 17 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"All claims match the abstract's wording and conditions, including zero-effect simulated data, the compelling-finding prompt, the stable-selection condition and the simulation-only result. The stated tension is supported by the source's 'vast potential' framing. The limitations and the question about unstable behavior follow from the stated condition without overreaching.","excerpt":"while the potential of coding agents for science is vast, their use in hypothesis testing poses a substantial threat to classical inference"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page, which is the original source.","excerpt":null}],"createdAt":"2026-11-18T13:18:44.365Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}