{"id":"c4b349a44cc02c3dcdf1b2bdef284e13a4837eb28ff0864c793567669988c45d","title":"Can Coding Agents Write and Transpile Unit Tests","argument":"Authors Gil Pasternak, AJ Langley, Tom Yotam and Ellie Kitanidis examine whether coding agents can write tests and translate them between programming languages. They focus on a source of trust in coding assistants: passing tests, which agents often write themselves. In a benchmark of three coding agents, each using a frontier model with high reasoning effort, the authors report that agent-written tests exceeded human-written suites on traditional coverage measures. They also report that this advantage was uneven: test quality fell sharply as project size grew, and much of the coverage advantage came from writing more tests. Agentic test translation looked strong in aggregate but remained inconsistent and unreliable, they say. Escape Meridian interpretation: these findings complicate reliance on passing tests as a sign of confidence when agents write the tests being used to judge their work. The abstract does not provide project sizes, individual results or detailed metrics, limiting how fully readers can assess the reported effects.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the paper’s abstract and does not give project sizes, individual results or detailed metrics for assessing the reported effects. The abstract does not specify how the authors measured test quality or test translation.","speaker":{"name":"Pasternak, Gil, Langley, AJ, Yotam, Tom, Kitanidis, Ellie","roleAtSource":"Article author"},"source":{"title":"Can Coding Agents Write and Transpile Unit Tests","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.21797","publishedAt":"2026-11-16","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors benchmarked three coding agents, each using a frontier model with high reasoning effort.","excerpt":"We benchmark three popular coding agents, each evaluated with a native frontier model and high reasoning effort.","url":"https://arxiv.org/abs/2611.21797","relationship":"Source-stated"},{"text":"The authors report that agent-written test suites exceeded human-written suites on traditional coverage measures.","excerpt":"coding agents far exceed human written suites on traditional measures of coverage.","url":"https://arxiv.org/abs/2611.21797","relationship":"Source-stated"},{"text":"The authors say test quality declined sharply with project size, and that more tests accounted for much of the coverage advantage.","excerpt":"agent test quality degrades sharply with project size, and much of the advantage lies in a greater number of written tests.","url":"https://arxiv.org/abs/2611.21797","relationship":"Source-stated"},{"text":"The authors characterize test translation by agents as inconsistent and unreliable despite strong aggregate results.","excerpt":"agentic test translation---while seemingly strong in aggregate---remains inconsistent and unreliable.","url":"https://arxiv.org/abs/2611.21797","relationship":"Source-stated"},{"text":"Passing tests may not establish confidence in agent-written code when the agents also write the tests; this is an interpretation of the authors’ stated concern and findings.","excerpt":"Much of this trust rests on passing tests, which are often written by the coding agents themselves.","url":"https://arxiv.org/abs/2611.21797","relationship":"Escape Meridian interpretation"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.21797","checkedAt":"2026-11-18T15:52:10.545Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How did the authors measure test quality and test translation, and how did those results vary across project sizes?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Can Coding Agents Write and Transpile Unit Tests","summary":"Authors Gil Pasternak, AJ Langley, Tom Yotam and Ellie Kitanidis examine whether coding agents can write tests and translate them between programming languages. They focus on a source of trust in coding assistants: passing tests, which agents often write themselves. In a benchmark of three coding agents, each using a frontier model with high reasoning effort, the authors report that agent-written tests exceeded human-written suites on traditional coverage measures. They also report that this advantage was uneven: test quality fell sharply as project size grew, and much of the coverage advantage came from writing more tests. Agentic test translation looked strong in aggregate but remained inconsistent and unreliable, they say. Escape Meridian interpretation: these findings complicate reliance on passing tests as a sign of confidence when agents write the tests being used to judge their work. The abstract does not provide project sizes, individual results or detailed metrics, limiting how fully readers can assess the reported effects.","question":"How did the authors measure test quality and test translation, and how did those results vary across project sizes?","claims":[{"text":"The authors benchmarked three coding agents, each using a frontier model with high reasoning effort.","excerpt":"We benchmark three popular coding agents, each evaluated with a native frontier model and high reasoning effort.","support":"source-stated"},{"text":"The authors report that agent-written test suites exceeded human-written suites on traditional coverage measures.","excerpt":"coding agents far exceed human written suites on traditional measures of coverage.","support":"source-stated"},{"text":"The authors say test quality declined sharply with project size, and that more tests accounted for much of the coverage advantage.","excerpt":"agent test quality degrades sharply with project size, and much of the advantage lies in a greater number of written tests.","support":"source-stated"},{"text":"The authors characterize test translation by agents as inconsistent and unreliable despite strong aggregate results.","excerpt":"agentic test translation---while seemingly strong in aggregate---remains inconsistent and unreliable.","support":"source-stated"},{"text":"Passing tests may not establish confidence in agent-written code when the agents also write the tests; this is an interpretation of the authors’ stated concern and findings.","excerpt":"Much of this trust rests on passing tests, which are often written by the coding agents themselves.","support":"interpretation"}],"limitations":["The supplied evidence is the paper’s abstract and does not give project sizes, individual results or detailed metrics for assessing the reported effects.","The abstract does not specify how the authors measured test quality or test translation."],"mediaId":"ef7229ce6baed53a58aa5b2e0f9cd88474e61a36d5c03c5434c5abfa9ec76ba5","correctionReason":null,"id":"c4b349a44cc02c3dcdf1b2bdef284e13a4837eb28ff0864c793567669988c45d","publicationId":"8f0bd417-2c81-42d6-8266-ae737ae33948","version":1,"sourceUrl":"https://arxiv.org/abs/2611.21797","sourceTitle":"Can Coding Agents Write and Transpile Unit Tests","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-16","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-18T05:13:48.565Z","createdAt":"2026-11-18T14:48:58.699Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"ef7229ce6baed53a58aa5b2e0f9cd88474e61a36d5c03c5434c5abfa9ec76ba5","kind":"article","url":"https://arxiv.org/abs/2611.21797","sourceUrl":"https://arxiv.org/abs/2611.21797","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-18T14:48:03.637Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.21797","checkedAt":"2026-11-18T15:52:10.545Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"ef7229ce6baed53a58aa5b2e0f9cd88474e61a36d5c03c5434c5abfa9ec76ba5","confidence":0.78,"provider":"typesafe","model":"jev-1.13.0","inputHash":"ad4a45fd9f77f9a5f21dac0b911ab4075c9312a737fce0d6068f181eb6524914","decidedAt":"2026-11-18T14:48:05.592Z"},"provenance":{"textHash":"2ff3cd06859baae4317c1aaaf574ea7fb3cac08f5b79c8cf821e83fc2784f911","observationId":"91391d95b49b50a272f3cb1e250f25ea4dabf5712066cf337fa726761cbadd2c","retrievedAt":"2026-11-18T14:48:03.374Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"0b7b2dec-cd2c-400b-819f-dcf98019c766"},"reviewer":{"model":"gpt-6-luna","runId":"2e073c45-2574-466c-8b9a-ab760207ef0f"}},"audit":{"status":"passed","reviewedAt":"2026-11-18T14:48:58.699Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Pasternak, Gil","url":null,"kind":"unknown"},{"name":"Langley, AJ","url":null,"kind":"unknown"},{"name":"Yotam, Tom","url":null,"kind":"unknown"},{"name":"Kitanidis, Ellie","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Pasternak, Gil","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Pasternak, Gil","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21797","locator":"head/meta[name=author|citation_author]"},"assertionId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:52:10.545Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732","sourceUrl":"https://arxiv.org/abs/2611.21797","contentSha256":"d3b8ab302a74a64fab43b5fac09e529eb3188773f02a11ccd8b7bdd3a3b6126e","textHash":"2ff3cd06859baae4317c1aaaf574ea7fb3cac08f5b79c8cf821e83fc2784f911","observedAt":"2026-11-18T15:52:10.545Z"}},{"actor":{"name":"Langley, AJ","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Langley, AJ","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21797","locator":"head/meta[name=author|citation_author]"},"assertionId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:52:10.545Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732","sourceUrl":"https://arxiv.org/abs/2611.21797","contentSha256":"d3b8ab302a74a64fab43b5fac09e529eb3188773f02a11ccd8b7bdd3a3b6126e","textHash":"2ff3cd06859baae4317c1aaaf574ea7fb3cac08f5b79c8cf821e83fc2784f911","observedAt":"2026-11-18T15:52:10.545Z"}},{"actor":{"name":"Yotam, Tom","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Yotam, Tom","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21797","locator":"head/meta[name=author|citation_author]"},"assertionId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:52:10.545Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732","sourceUrl":"https://arxiv.org/abs/2611.21797","contentSha256":"d3b8ab302a74a64fab43b5fac09e529eb3188773f02a11ccd8b7bdd3a3b6126e","textHash":"2ff3cd06859baae4317c1aaaf574ea7fb3cac08f5b79c8cf821e83fc2784f911","observedAt":"2026-11-18T15:52:10.545Z"}},{"actor":{"name":"Kitanidis, Ellie","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kitanidis, Ellie","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21797","locator":"head/meta[name=author|citation_author]"},"assertionId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:52:10.545Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732","sourceUrl":"https://arxiv.org/abs/2611.21797","contentSha256":"d3b8ab302a74a64fab43b5fac09e529eb3188773f02a11ccd8b7bdd3a3b6126e","textHash":"2ff3cd06859baae4317c1aaaf574ea7fb3cac08f5b79c8cf821e83fc2784f911","observedAt":"2026-11-18T15:52:10.545Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.21797","snapshotId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732","contentSha256":"d3b8ab302a74a64fab43b5fac09e529eb3188773f02a11ccd8b7bdd3a3b6126e","textHash":"2ff3cd06859baae4317c1aaaf574ea7fb3cac08f5b79c8cf821e83fc2784f911","observedAt":"2026-11-18T15:52:10.545Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/c4b349a44cc02c3dcdf1b2bdef284e13a4837eb28ff0864c793567669988c45d/source"}},"canonicalUrl":"https://escapemeridian.com/readings/can-coding-agents-write-and-transpile-unit-tests-c4b349a4","formats":{"html":"/readings/can-coding-agents-write-and-transpile-unit-tests-c4b349a4","markdown":"/readings/can-coding-agents-write-and-transpile-unit-tests-c4b349a4.md","json":"/readings/can-coding-agents-write-and-transpile-unit-tests-c4b349a4.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"},{"id":"term-frontier-model","name":"Frontier model","explanation":"One of the most capable AI models available at a given time; the set shifts as models improve.","referenceUrl":"https://www.gov.uk/government/publications/frontier-ai-capabilities-and-risks-discussion-paper"},{"id":"term-agentic","name":"Agentic AI","explanation":"AI systems that plan and carry out a series of steps toward a goal, often by using other software, rather than giving one answer.","referenceUrl":"https://developers.google.com/machine-learning/glossary#agentic"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"c4b349a44cc02c3dcdf1b2bdef284e13a4837eb28ff0864c793567669988c45d","revision":"8f0bd417-2c81-42d6-8266-ae737ae33948","revisionKind":"publication-id","title":"Can Coding Agents Write and Transpile Unit Tests","url":"https://escapemeridian.com/readings/can-coding-agents-write-and-transpile-unit-tests-c4b349a4"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.21797","revision":"2ff3cd06859baae4317c1aaaf574ea7fb3cac08f5b79c8cf821e83fc2784f911","revisionKind":"sha256-source-text","title":"Can Coding Agents Write and Transpile Unit Tests","url":"https://arxiv.org/abs/2611.21797"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"c4b349a44cc02c3dcdf1b2bdef284e13a4837eb28ff0864c793567669988c45d","title":"Can Coding Agents Write and Transpile Unit Tests","argument":"Authors Gil Pasternak, AJ Langley, Tom Yotam and Ellie Kitanidis examine whether coding agents can write tests and translate them between programming languages. They focus on a source of trust in coding assistants: passing tests, which agents often write themselves. In a benchmark of three coding agents, each using a frontier model with high reasoning effort, the authors report that agent-written tests exceeded human-written suites on traditional coverage measures. They also report that this advantage was uneven: test quality fell sharply as project size grew, and much of the coverage advantage came from writing more tests. Agentic test translation looked strong in aggregate but remained inconsistent and unreliable, they say. Escape Meridian interpretation: these findings complicate reliance on passing tests as a sign of confidence when agents write the tests being used to judge their work. The abstract does not provide project sizes, individual results or detailed metrics, limiting how fully readers can assess the reported effects.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the paper’s abstract and does not give project sizes, individual results or detailed metrics for assessing the reported effects. The abstract does not specify how the authors measured test quality or test translation.","speaker":{"name":"Pasternak, Gil, Langley, AJ, Yotam, Tom, Kitanidis, Ellie","roleAtSource":"Article author"},"source":{"title":"Can Coding Agents Write and Transpile Unit Tests","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.21797","publishedAt":"2026-11-16","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors benchmarked three coding agents, each using a frontier model with high reasoning effort.","excerpt":"We benchmark three popular coding agents, each evaluated with a native frontier model and high reasoning effort.","url":"https://arxiv.org/abs/2611.21797","relationship":"Source-stated"},{"text":"The authors report that agent-written test suites exceeded human-written suites on traditional coverage measures.","excerpt":"coding agents far exceed human written suites on traditional measures of coverage.","url":"https://arxiv.org/abs/2611.21797","relationship":"Source-stated"},{"text":"The authors say test quality declined sharply with project size, and that more tests accounted for much of the coverage advantage.","excerpt":"agent test quality degrades sharply with project size, and much of the advantage lies in a greater number of written tests.","url":"https://arxiv.org/abs/2611.21797","relationship":"Source-stated"},{"text":"The authors characterize test translation by agents as inconsistent and unreliable despite strong aggregate results.","excerpt":"agentic test translation---while seemingly strong in aggregate---remains inconsistent and unreliable.","url":"https://arxiv.org/abs/2611.21797","relationship":"Source-stated"},{"text":"Passing tests may not establish confidence in agent-written code when the agents also write the tests; this is an interpretation of the authors’ stated concern and findings.","excerpt":"Much of this trust rests on passing tests, which are often written by the coding agents themselves.","url":"https://arxiv.org/abs/2611.21797","relationship":"Escape Meridian interpretation"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.21797","checkedAt":"2026-11-18T15:52:10.545Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How did the authors measure test quality and test translation, and how did those results vary across project sizes?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Can Coding Agents Write and Transpile Unit Tests","summary":"Authors Gil Pasternak, AJ Langley, Tom Yotam and Ellie Kitanidis examine whether coding agents can write tests and translate them between programming languages. They focus on a source of trust in coding assistants: passing tests, which agents often write themselves. In a benchmark of three coding agents, each using a frontier model with high reasoning effort, the authors report that agent-written tests exceeded human-written suites on traditional coverage measures. They also report that this advantage was uneven: test quality fell sharply as project size grew, and much of the coverage advantage came from writing more tests. Agentic test translation looked strong in aggregate but remained inconsistent and unreliable, they say. Escape Meridian interpretation: these findings complicate reliance on passing tests as a sign of confidence when agents write the tests being used to judge their work. The abstract does not provide project sizes, individual results or detailed metrics, limiting how fully readers can assess the reported effects.","question":"How did the authors measure test quality and test translation, and how did those results vary across project sizes?","claims":[{"text":"The authors benchmarked three coding agents, each using a frontier model with high reasoning effort.","excerpt":"We benchmark three popular coding agents, each evaluated with a native frontier model and high reasoning effort.","support":"source-stated"},{"text":"The authors report that agent-written test suites exceeded human-written suites on traditional coverage measures.","excerpt":"coding agents far exceed human written suites on traditional measures of coverage.","support":"source-stated"},{"text":"The authors say test quality declined sharply with project size, and that more tests accounted for much of the coverage advantage.","excerpt":"agent test quality degrades sharply with project size, and much of the advantage lies in a greater number of written tests.","support":"source-stated"},{"text":"The authors characterize test translation by agents as inconsistent and unreliable despite strong aggregate results.","excerpt":"agentic test translation---while seemingly strong in aggregate---remains inconsistent and unreliable.","support":"source-stated"},{"text":"Passing tests may not establish confidence in agent-written code when the agents also write the tests; this is an interpretation of the authors’ stated concern and findings.","excerpt":"Much of this trust rests on passing tests, which are often written by the coding agents themselves.","support":"interpretation"}],"limitations":["The supplied evidence is the paper’s abstract and does not give project sizes, individual results or detailed metrics for assessing the reported effects.","The abstract does not specify how the authors measured test quality or test translation."],"mediaId":"ef7229ce6baed53a58aa5b2e0f9cd88474e61a36d5c03c5434c5abfa9ec76ba5","correctionReason":null,"id":"c4b349a44cc02c3dcdf1b2bdef284e13a4837eb28ff0864c793567669988c45d","publicationId":"8f0bd417-2c81-42d6-8266-ae737ae33948","version":1,"sourceUrl":"https://arxiv.org/abs/2611.21797","sourceTitle":"Can Coding Agents Write and Transpile Unit Tests","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-16","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-18T05:13:48.565Z","createdAt":"2026-11-18T14:48:58.699Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"ef7229ce6baed53a58aa5b2e0f9cd88474e61a36d5c03c5434c5abfa9ec76ba5","kind":"article","url":"https://arxiv.org/abs/2611.21797","sourceUrl":"https://arxiv.org/abs/2611.21797","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-18T14:48:03.637Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.21797","checkedAt":"2026-11-18T15:52:10.545Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"ef7229ce6baed53a58aa5b2e0f9cd88474e61a36d5c03c5434c5abfa9ec76ba5","confidence":0.78,"provider":"typesafe","model":"jev-1.13.0","inputHash":"ad4a45fd9f77f9a5f21dac0b911ab4075c9312a737fce0d6068f181eb6524914","decidedAt":"2026-11-18T14:48:05.592Z"},"provenance":{"textHash":"2ff3cd06859baae4317c1aaaf574ea7fb3cac08f5b79c8cf821e83fc2784f911","observationId":"91391d95b49b50a272f3cb1e250f25ea4dabf5712066cf337fa726761cbadd2c","retrievedAt":"2026-11-18T14:48:03.374Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"0b7b2dec-cd2c-400b-819f-dcf98019c766"},"reviewer":{"model":"gpt-6-luna","runId":"2e073c45-2574-466c-8b9a-ab760207ef0f"}},"audit":{"status":"passed","reviewedAt":"2026-11-18T14:48:58.699Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Pasternak, Gil","url":null,"kind":"unknown"},{"name":"Langley, AJ","url":null,"kind":"unknown"},{"name":"Yotam, Tom","url":null,"kind":"unknown"},{"name":"Kitanidis, Ellie","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Pasternak, Gil","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Pasternak, Gil","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21797","locator":"head/meta[name=author|citation_author]"},"assertionId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:52:10.545Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732","sourceUrl":"https://arxiv.org/abs/2611.21797","contentSha256":"d3b8ab302a74a64fab43b5fac09e529eb3188773f02a11ccd8b7bdd3a3b6126e","textHash":"2ff3cd06859baae4317c1aaaf574ea7fb3cac08f5b79c8cf821e83fc2784f911","observedAt":"2026-11-18T15:52:10.545Z"}},{"actor":{"name":"Langley, AJ","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Langley, AJ","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21797","locator":"head/meta[name=author|citation_author]"},"assertionId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:52:10.545Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732","sourceUrl":"https://arxiv.org/abs/2611.21797","contentSha256":"d3b8ab302a74a64fab43b5fac09e529eb3188773f02a11ccd8b7bdd3a3b6126e","textHash":"2ff3cd06859baae4317c1aaaf574ea7fb3cac08f5b79c8cf821e83fc2784f911","observedAt":"2026-11-18T15:52:10.545Z"}},{"actor":{"name":"Yotam, Tom","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Yotam, Tom","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21797","locator":"head/meta[name=author|citation_author]"},"assertionId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:52:10.545Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732","sourceUrl":"https://arxiv.org/abs/2611.21797","contentSha256":"d3b8ab302a74a64fab43b5fac09e529eb3188773f02a11ccd8b7bdd3a3b6126e","textHash":"2ff3cd06859baae4317c1aaaf574ea7fb3cac08f5b79c8cf821e83fc2784f911","observedAt":"2026-11-18T15:52:10.545Z"}},{"actor":{"name":"Kitanidis, Ellie","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kitanidis, Ellie","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21797","locator":"head/meta[name=author|citation_author]"},"assertionId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:52:10.545Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732","sourceUrl":"https://arxiv.org/abs/2611.21797","contentSha256":"d3b8ab302a74a64fab43b5fac09e529eb3188773f02a11ccd8b7bdd3a3b6126e","textHash":"2ff3cd06859baae4317c1aaaf574ea7fb3cac08f5b79c8cf821e83fc2784f911","observedAt":"2026-11-18T15:52:10.545Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.21797","snapshotId":"9a63ed68cb280cd5cc9cf95a78e9d5d80a92b325b02fe4c2382f3be5ca150732","contentSha256":"d3b8ab302a74a64fab43b5fac09e529eb3188773f02a11ccd8b7bdd3a3b6126e","textHash":"2ff3cd06859baae4317c1aaaf574ea7fb3cac08f5b79c8cf821e83fc2784f911","observedAt":"2026-11-18T15:52:10.545Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/c4b349a44cc02c3dcdf1b2bdef284e13a4837eb28ff0864c793567669988c45d/source"}}}],"audits":[{"publicationId":"8f0bd417-2c81-42d6-8266-ae737ae33948","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading names the four listed authors and attributes the findings to them with phrases such as 'the authors report' and 'they say.' The interpretive sentence is explicitly labeled as Escape Meridian interpretation.","excerpt":"Authors:Gil Pasternak, AJ Langley, Tom Yotam, Ellie Kitanidis"},{"dimension":"summary","status":"pass","explanation":"The reading leads with the question the authors study and the trust problem they raise. It then gives the benchmark setup, the coverage result, its caveats and the translation finding, and it explains transpiling in plain words. 'Coverage,' 'frontier model' and 'reasoning effort' are kept as exact terms and should get tooltips; a coverage tooltip (how much of the code tests exercise) is suggested. Minor fidelity loss: the source says agents 'far exceed' human suites. Restoring 'far' would preserve that force. The question asks about a real gap in the abstract.","excerpt":"we find that coding agents far exceed human written suites on traditional measures of coverage"},{"dimension":"date","status":"pass","explanation":"originalPublished is 2026-11-16, which matches the arXiv v1 submission date. The 2026-11-18 feed date is correctly not used.","excerpt":"[Submitted on 16 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each source-stated claim matches the abstract. The interpretation that agent-written passing tests complicate confidence is labeled, conditional and anchored to the authors' own framing. The limitations accurately note that the abstract gives no metrics or project sizes. No benefits or costs are invented.","excerpt":"Much of this trust rests on passing tests, which are often written by the coding agents themselves."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page. It is the most direct way to reach the source.","excerpt":null}],"createdAt":"2026-11-18T14:48:58.699Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}