{"id":"dca88e64d37b07d512dd6cbf626fad27bfa86b496e881de3c9f4a203ef8d86bf","title":"arXiv cs.AI paper proposes an open-world test for financial agents","argument":"Yupeng Cao and coauthors introduce FINCOSMOS, an open-world evaluation paradigm for agents doing financial work. Unlike benchmarks that fix the task, data, or timeline, FINCOSMOS gives a simulated user a hidden strategy and shares it only when the agent asks. The agent must acquire data from the Web, build its own backtest under a data cutoff, and deliver verifiable results. Programs check point-in-time correctness and recompute reported metrics; the delivered strategy is checked against the hidden specification. A run counts as accepted only if the user is satisfied and none of 15 veto checks fails. In 150 sessions involving four coding agents and a model without tools, no session was accepted. Every session signed off by the simulated user failed a program check, and agents raised only 54–64% of details they had not been told. Human experts attributed 88.33% of failures to the agents. The authors also report that, with FINCOSMOS feedback, an agent with persistent memory learned all ten tasks. As an Escape Meridian interpretation, these results make the paper’s concern concrete: a financial report can look convincing while relying on an unasked-for strategy, unverified data, or a backtest that uses the future. The evidence comes from this evaluation; it does not establish how agents perform in financial work outside it.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported results are from 150 sessions involving four coding agents and a model without tools; the evidence does not establish performance in financial work outside this evaluation. The abstract reports that an agent with persistent memory learned all ten tasks with FINCOSMOS feedback, but does not describe those tasks or the learning procedure in detail.","speaker":{"name":"Cao, Yupeng, Peng, Xueqing, Qian, Lingfei, Li, Haohang, Yu, Yangyang, Xu, Anke, Cao, Wenbo, Wang, Yan, Jiang, Yuechen, Wang, Yuyan, Xie, Zhuohan, Chen, Yankai, Li, Zehan, Huang, Jimin, Liu, Xue, Nie, Jian-Yun, Ananiadou, Sophia","roleAtSource":"Article author"},"source":{"title":"FINCOSMOS: An Open-World Evaluation Paradigm for Agents in Finance","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.07464","publishedAt":"2026-11-05","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose FINCOSMOS, an open-world evaluation paradigm for agents doing financial work, in which agents must obtain Web data and build a backtest under a data cutoff.","excerpt":"We introduce FINCOSMOS, an open-world evaluation paradigm for agents doing financial work. A simulated user holds a hidden strategy sampled from a compositional grammar and reveals it only when asked.","url":"https://arxiv.org/abs/2611.07464","relationship":"Source-stated"},{"text":"FINCOSMOS checks reported financial work programmatically and accepts a run only when the simulated user is satisfied and none of 15 veto checks fails.","excerpt":"Programs verify point-in-time correctness and recompute every reported metric, the delivered strategy is checked against the hidden specification, and a run is accepted only when the user is satisfied and none of 15 veto checks fails.","url":"https://arxiv.org/abs/2611.07464","relationship":"Source-stated"},{"text":"In the reported 150 sessions, no session was accepted; every simulated-user sign-off failed a program check, and agents raised only 54–64% of details they were not told.","excerpt":"Across four coding agents and a model without tools in 150 sessions, no session is accepted: every session that the simulated user signed off fails a program check, and agents raise only 54--64\\% of the details they were not told.","url":"https://arxiv.org/abs/2611.07464","relationship":"Source-stated"},{"text":"The authors report that human experts attributed 88.33% of failures to agents, and that an agent with persistent memory learned all ten tasks with FINCOSMOS feedback.","excerpt":"Human experts attribute 88.33\\% of failures to the agents. With FINCOSMOS feedback, an agent with persistent memory learned all ten tasks.","url":"https://arxiv.org/abs/2611.07464","relationship":"Source-stated"},{"text":"The evaluation illustrates the authors’ concern that financial work can yield convincing reports despite strategy, data, or timing errors.","excerpt":"a strategy the user never asked for, unverified data, or a backtest that uses the future yields a report as convincing as a correct one.","url":"https://arxiv.org/abs/2611.07464","relationship":"Escape Meridian interpretation"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.07464","checkedAt":"2026-11-08T20:28:06.446Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What did the agent with persistent memory do to learn all ten tasks with FINCOSMOS feedback?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI paper proposes an open-world test for financial agents","summary":"Yupeng Cao and coauthors introduce FINCOSMOS, an open-world evaluation paradigm for agents doing financial work. Unlike benchmarks that fix the task, data, or timeline, FINCOSMOS gives a simulated user a hidden strategy and shares it only when the agent asks. The agent must acquire data from the Web, build its own backtest under a data cutoff, and deliver verifiable results. Programs check point-in-time correctness and recompute reported metrics; the delivered strategy is checked against the hidden specification. A run counts as accepted only if the user is satisfied and none of 15 veto checks fails. In 150 sessions involving four coding agents and a model without tools, no session was accepted. Every session signed off by the simulated user failed a program check, and agents raised only 54–64% of details they had not been told. Human experts attributed 88.33% of failures to the agents. The authors also report that, with FINCOSMOS feedback, an agent with persistent memory learned all ten tasks. As an Escape Meridian interpretation, these results make the paper’s concern concrete: a financial report can look convincing while relying on an unasked-for strategy, unverified data, or a backtest that uses the future. The evidence comes from this evaluation; it does not establish how agents perform in financial work outside it.","question":"What did the agent with persistent memory do to learn all ten tasks with FINCOSMOS feedback?","claims":[{"text":"The authors propose FINCOSMOS, an open-world evaluation paradigm for agents doing financial work, in which agents must obtain Web data and build a backtest under a data cutoff.","excerpt":"We introduce FINCOSMOS, an open-world evaluation paradigm for agents doing financial work. A simulated user holds a hidden strategy sampled from a compositional grammar and reveals it only when asked.","support":"source-stated"},{"text":"FINCOSMOS checks reported financial work programmatically and accepts a run only when the simulated user is satisfied and none of 15 veto checks fails.","excerpt":"Programs verify point-in-time correctness and recompute every reported metric, the delivered strategy is checked against the hidden specification, and a run is accepted only when the user is satisfied and none of 15 veto checks fails.","support":"source-stated"},{"text":"In the reported 150 sessions, no session was accepted; every simulated-user sign-off failed a program check, and agents raised only 54–64% of details they were not told.","excerpt":"Across four coding agents and a model without tools in 150 sessions, no session is accepted: every session that the simulated user signed off fails a program check, and agents raise only 54--64\\% of the details they were not told.","support":"source-stated"},{"text":"The authors report that human experts attributed 88.33% of failures to agents, and that an agent with persistent memory learned all ten tasks with FINCOSMOS feedback.","excerpt":"Human experts attribute 88.33\\% of failures to the agents. With FINCOSMOS feedback, an agent with persistent memory learned all ten tasks.","support":"source-stated"},{"text":"The evaluation illustrates the authors’ concern that financial work can yield convincing reports despite strategy, data, or timing errors.","excerpt":"a strategy the user never asked for, unverified data, or a backtest that uses the future yields a report as convincing as a correct one.","support":"interpretation"}],"limitations":["The reported results are from 150 sessions involving four coding agents and a model without tools; the evidence does not establish performance in financial work outside this evaluation.","The abstract reports that an agent with persistent memory learned all ten tasks with FINCOSMOS feedback, but does not describe those tasks or the learning procedure in detail."],"mediaId":"8038b228ad5a266b93a77ec9546dd73e82d2414f03468913971bb7da68629276","correctionReason":null,"id":"dca88e64d37b07d512dd6cbf626fad27bfa86b496e881de3c9f4a203ef8d86bf","publicationId":"3800a478-5f84-4ab3-89ff-e0863b9acba9","version":1,"sourceUrl":"https://arxiv.org/abs/2611.07464","sourceTitle":"FINCOSMOS: An Open-World Evaluation Paradigm for Agents in Finance","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-05","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-06T05:12:38.913Z","createdAt":"2026-11-08T19:24:11.077Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"8038b228ad5a266b93a77ec9546dd73e82d2414f03468913971bb7da68629276","kind":"article","url":"https://arxiv.org/abs/2611.07464","sourceUrl":"https://arxiv.org/abs/2611.07464","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-08T19:17:06.889Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.07464","checkedAt":"2026-11-08T20:28:06.446Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"8038b228ad5a266b93a77ec9546dd73e82d2414f03468913971bb7da68629276","confidence":0.79,"provider":"typesafe","model":"jev-1.13.0","inputHash":"af76cf3be94d920e055b61be8a06234e3f0db10bc5e0928050c86ee26baf7594","decidedAt":"2026-11-08T19:17:07.639Z"},"provenance":{"textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observationId":"ed999760e82736ca485a173e9f04bb01f28531153cc5ea786aafeb7c15a4ad12","retrievedAt":"2026-11-08T19:17:06.783Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"0c6c41dc-39ac-461d-822c-153ec51bae66"},"reviewer":{"model":"gpt-6-luna","runId":"e071d522-dc68-41eb-8acd-1856edd25bb4"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-08T19:24:11.077Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Cao, Yupeng","url":null,"kind":"unknown"},{"name":"Peng, Xueqing","url":null,"kind":"unknown"},{"name":"Qian, Lingfei","url":null,"kind":"unknown"},{"name":"Li, Haohang","url":null,"kind":"unknown"},{"name":"Yu, Yangyang","url":null,"kind":"unknown"},{"name":"Xu, Anke","url":null,"kind":"unknown"},{"name":"Cao, Wenbo","url":null,"kind":"unknown"},{"name":"Wang, Yan","url":null,"kind":"unknown"},{"name":"Jiang, Yuechen","url":null,"kind":"unknown"},{"name":"Wang, Yuyan","url":null,"kind":"unknown"},{"name":"Xie, Zhuohan","url":null,"kind":"unknown"},{"name":"Chen, Yankai","url":null,"kind":"unknown"},{"name":"Li, Zehan","url":null,"kind":"unknown"},{"name":"Huang, Jimin","url":null,"kind":"unknown"},{"name":"Liu, Xue","url":null,"kind":"unknown"},{"name":"Nie, Jian-Yun","url":null,"kind":"unknown"},{"name":"Ananiadou, Sophia","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Cao, Yupeng","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Cao, Yupeng","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Peng, Xueqing","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Peng, Xueqing","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Qian, Lingfei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Qian, Lingfei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Li, Haohang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Li, Haohang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Yu, Yangyang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Yu, Yangyang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Xu, Anke","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Xu, Anke","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Cao, Wenbo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Cao, Wenbo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Wang, Yan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Yan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Jiang, Yuechen","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jiang, Yuechen","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:8","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Wang, Yuyan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Yuyan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:9","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Xie, Zhuohan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Xie, Zhuohan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:10","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Chen, Yankai","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chen, Yankai","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:11","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Li, Zehan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Li, Zehan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:12","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Huang, Jimin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Huang, Jimin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:13","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Liu, Xue","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Liu, Xue","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:14","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Nie, Jian-Yun","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Nie, Jian-Yun","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:15","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Ananiadou, Sophia","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ananiadou, Sophia","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:16","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}}],"participationCoverage":{"total":17,"returned":17,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.07464","snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z","basis":"publisher-page-metadata","sourceLinks":58,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/dca88e64d37b07d512dd6cbf626fad27bfa86b496e881de3c9f4a203ef8d86bf/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-paper-proposes-an-open-world-test-for-financial-dca88e64","formats":{"html":"/readings/arxiv-cs-ai-paper-proposes-an-open-world-test-for-financial-dca88e64","markdown":"/readings/arxiv-cs-ai-paper-proposes-an-open-world-test-for-financial-dca88e64.md","json":"/readings/arxiv-cs-ai-paper-proposes-an-open-world-test-for-financial-dca88e64.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"},{"id":"time","name":"TIME","kind":"organization","context":"TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.","referenceUrls":["https://time.com/"],"path":"/entities/time","json":"/entities/time.json","markdown":"/entities/time.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"dca88e64d37b07d512dd6cbf626fad27bfa86b496e881de3c9f4a203ef8d86bf","revision":"3800a478-5f84-4ab3-89ff-e0863b9acba9","revisionKind":"publication-id","title":"arXiv cs.AI paper proposes an open-world test for financial agents","url":"https://escapemeridian.com/readings/arxiv-cs-ai-paper-proposes-an-open-world-test-for-financial-dca88e64"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.07464","revision":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","revisionKind":"sha256-source-text","title":"FINCOSMOS: An Open-World Evaluation Paradigm for Agents in Finance","url":"https://arxiv.org/abs/2611.07464"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"dca88e64d37b07d512dd6cbf626fad27bfa86b496e881de3c9f4a203ef8d86bf","title":"arXiv cs.AI paper proposes an open-world test for financial agents","argument":"Yupeng Cao and coauthors introduce FINCOSMOS, an open-world evaluation paradigm for agents doing financial work. Unlike benchmarks that fix the task, data, or timeline, FINCOSMOS gives a simulated user a hidden strategy and shares it only when the agent asks. The agent must acquire data from the Web, build its own backtest under a data cutoff, and deliver verifiable results. Programs check point-in-time correctness and recompute reported metrics; the delivered strategy is checked against the hidden specification. A run counts as accepted only if the user is satisfied and none of 15 veto checks fails. In 150 sessions involving four coding agents and a model without tools, no session was accepted. Every session signed off by the simulated user failed a program check, and agents raised only 54–64% of details they had not been told. Human experts attributed 88.33% of failures to the agents. The authors also report that, with FINCOSMOS feedback, an agent with persistent memory learned all ten tasks. As an Escape Meridian interpretation, these results make the paper’s concern concrete: a financial report can look convincing while relying on an unasked-for strategy, unverified data, or a backtest that uses the future. The evidence comes from this evaluation; it does not establish how agents perform in financial work outside it.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported results are from 150 sessions involving four coding agents and a model without tools; the evidence does not establish performance in financial work outside this evaluation. The abstract reports that an agent with persistent memory learned all ten tasks with FINCOSMOS feedback, but does not describe those tasks or the learning procedure in detail.","speaker":{"name":"Cao, Yupeng, Peng, Xueqing, Qian, Lingfei, Li, Haohang, Yu, Yangyang, Xu, Anke, Cao, Wenbo, Wang, Yan, Jiang, Yuechen, Wang, Yuyan, Xie, Zhuohan, Chen, Yankai, Li, Zehan, Huang, Jimin, Liu, Xue, Nie, Jian-Yun, Ananiadou, Sophia","roleAtSource":"Article author"},"source":{"title":"FINCOSMOS: An Open-World Evaluation Paradigm for Agents in Finance","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.07464","publishedAt":"2026-11-05","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose FINCOSMOS, an open-world evaluation paradigm for agents doing financial work, in which agents must obtain Web data and build a backtest under a data cutoff.","excerpt":"We introduce FINCOSMOS, an open-world evaluation paradigm for agents doing financial work. A simulated user holds a hidden strategy sampled from a compositional grammar and reveals it only when asked.","url":"https://arxiv.org/abs/2611.07464","relationship":"Source-stated"},{"text":"FINCOSMOS checks reported financial work programmatically and accepts a run only when the simulated user is satisfied and none of 15 veto checks fails.","excerpt":"Programs verify point-in-time correctness and recompute every reported metric, the delivered strategy is checked against the hidden specification, and a run is accepted only when the user is satisfied and none of 15 veto checks fails.","url":"https://arxiv.org/abs/2611.07464","relationship":"Source-stated"},{"text":"In the reported 150 sessions, no session was accepted; every simulated-user sign-off failed a program check, and agents raised only 54–64% of details they were not told.","excerpt":"Across four coding agents and a model without tools in 150 sessions, no session is accepted: every session that the simulated user signed off fails a program check, and agents raise only 54--64\\% of the details they were not told.","url":"https://arxiv.org/abs/2611.07464","relationship":"Source-stated"},{"text":"The authors report that human experts attributed 88.33% of failures to agents, and that an agent with persistent memory learned all ten tasks with FINCOSMOS feedback.","excerpt":"Human experts attribute 88.33\\% of failures to the agents. With FINCOSMOS feedback, an agent with persistent memory learned all ten tasks.","url":"https://arxiv.org/abs/2611.07464","relationship":"Source-stated"},{"text":"The evaluation illustrates the authors’ concern that financial work can yield convincing reports despite strategy, data, or timing errors.","excerpt":"a strategy the user never asked for, unverified data, or a backtest that uses the future yields a report as convincing as a correct one.","url":"https://arxiv.org/abs/2611.07464","relationship":"Escape Meridian interpretation"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.07464","checkedAt":"2026-11-08T20:28:06.446Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What did the agent with persistent memory do to learn all ten tasks with FINCOSMOS feedback?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI paper proposes an open-world test for financial agents","summary":"Yupeng Cao and coauthors introduce FINCOSMOS, an open-world evaluation paradigm for agents doing financial work. Unlike benchmarks that fix the task, data, or timeline, FINCOSMOS gives a simulated user a hidden strategy and shares it only when the agent asks. The agent must acquire data from the Web, build its own backtest under a data cutoff, and deliver verifiable results. Programs check point-in-time correctness and recompute reported metrics; the delivered strategy is checked against the hidden specification. A run counts as accepted only if the user is satisfied and none of 15 veto checks fails. In 150 sessions involving four coding agents and a model without tools, no session was accepted. Every session signed off by the simulated user failed a program check, and agents raised only 54–64% of details they had not been told. Human experts attributed 88.33% of failures to the agents. The authors also report that, with FINCOSMOS feedback, an agent with persistent memory learned all ten tasks. As an Escape Meridian interpretation, these results make the paper’s concern concrete: a financial report can look convincing while relying on an unasked-for strategy, unverified data, or a backtest that uses the future. The evidence comes from this evaluation; it does not establish how agents perform in financial work outside it.","question":"What did the agent with persistent memory do to learn all ten tasks with FINCOSMOS feedback?","claims":[{"text":"The authors propose FINCOSMOS, an open-world evaluation paradigm for agents doing financial work, in which agents must obtain Web data and build a backtest under a data cutoff.","excerpt":"We introduce FINCOSMOS, an open-world evaluation paradigm for agents doing financial work. A simulated user holds a hidden strategy sampled from a compositional grammar and reveals it only when asked.","support":"source-stated"},{"text":"FINCOSMOS checks reported financial work programmatically and accepts a run only when the simulated user is satisfied and none of 15 veto checks fails.","excerpt":"Programs verify point-in-time correctness and recompute every reported metric, the delivered strategy is checked against the hidden specification, and a run is accepted only when the user is satisfied and none of 15 veto checks fails.","support":"source-stated"},{"text":"In the reported 150 sessions, no session was accepted; every simulated-user sign-off failed a program check, and agents raised only 54–64% of details they were not told.","excerpt":"Across four coding agents and a model without tools in 150 sessions, no session is accepted: every session that the simulated user signed off fails a program check, and agents raise only 54--64\\% of the details they were not told.","support":"source-stated"},{"text":"The authors report that human experts attributed 88.33% of failures to agents, and that an agent with persistent memory learned all ten tasks with FINCOSMOS feedback.","excerpt":"Human experts attribute 88.33\\% of failures to the agents. With FINCOSMOS feedback, an agent with persistent memory learned all ten tasks.","support":"source-stated"},{"text":"The evaluation illustrates the authors’ concern that financial work can yield convincing reports despite strategy, data, or timing errors.","excerpt":"a strategy the user never asked for, unverified data, or a backtest that uses the future yields a report as convincing as a correct one.","support":"interpretation"}],"limitations":["The reported results are from 150 sessions involving four coding agents and a model without tools; the evidence does not establish performance in financial work outside this evaluation.","The abstract reports that an agent with persistent memory learned all ten tasks with FINCOSMOS feedback, but does not describe those tasks or the learning procedure in detail."],"mediaId":"8038b228ad5a266b93a77ec9546dd73e82d2414f03468913971bb7da68629276","correctionReason":null,"id":"dca88e64d37b07d512dd6cbf626fad27bfa86b496e881de3c9f4a203ef8d86bf","publicationId":"3800a478-5f84-4ab3-89ff-e0863b9acba9","version":1,"sourceUrl":"https://arxiv.org/abs/2611.07464","sourceTitle":"FINCOSMOS: An Open-World Evaluation Paradigm for Agents in Finance","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-05","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-06T05:12:38.913Z","createdAt":"2026-11-08T19:24:11.077Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"8038b228ad5a266b93a77ec9546dd73e82d2414f03468913971bb7da68629276","kind":"article","url":"https://arxiv.org/abs/2611.07464","sourceUrl":"https://arxiv.org/abs/2611.07464","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-08T19:17:06.889Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.07464","checkedAt":"2026-11-08T20:28:06.446Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"8038b228ad5a266b93a77ec9546dd73e82d2414f03468913971bb7da68629276","confidence":0.79,"provider":"typesafe","model":"jev-1.13.0","inputHash":"af76cf3be94d920e055b61be8a06234e3f0db10bc5e0928050c86ee26baf7594","decidedAt":"2026-11-08T19:17:07.639Z"},"provenance":{"textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observationId":"ed999760e82736ca485a173e9f04bb01f28531153cc5ea786aafeb7c15a4ad12","retrievedAt":"2026-11-08T19:17:06.783Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"0c6c41dc-39ac-461d-822c-153ec51bae66"},"reviewer":{"model":"gpt-6-luna","runId":"e071d522-dc68-41eb-8acd-1856edd25bb4"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-08T19:24:11.077Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Cao, Yupeng","url":null,"kind":"unknown"},{"name":"Peng, Xueqing","url":null,"kind":"unknown"},{"name":"Qian, Lingfei","url":null,"kind":"unknown"},{"name":"Li, Haohang","url":null,"kind":"unknown"},{"name":"Yu, Yangyang","url":null,"kind":"unknown"},{"name":"Xu, Anke","url":null,"kind":"unknown"},{"name":"Cao, Wenbo","url":null,"kind":"unknown"},{"name":"Wang, Yan","url":null,"kind":"unknown"},{"name":"Jiang, Yuechen","url":null,"kind":"unknown"},{"name":"Wang, Yuyan","url":null,"kind":"unknown"},{"name":"Xie, Zhuohan","url":null,"kind":"unknown"},{"name":"Chen, Yankai","url":null,"kind":"unknown"},{"name":"Li, Zehan","url":null,"kind":"unknown"},{"name":"Huang, Jimin","url":null,"kind":"unknown"},{"name":"Liu, Xue","url":null,"kind":"unknown"},{"name":"Nie, Jian-Yun","url":null,"kind":"unknown"},{"name":"Ananiadou, Sophia","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Cao, Yupeng","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Cao, Yupeng","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Peng, Xueqing","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Peng, Xueqing","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Qian, Lingfei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Qian, Lingfei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Li, Haohang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Li, Haohang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Yu, Yangyang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Yu, Yangyang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Xu, Anke","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Xu, Anke","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Cao, Wenbo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Cao, Wenbo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Wang, Yan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Yan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Jiang, Yuechen","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jiang, Yuechen","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:8","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Wang, Yuyan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Yuyan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:9","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Xie, Zhuohan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Xie, Zhuohan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:10","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Chen, Yankai","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chen, Yankai","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:11","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Li, Zehan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Li, Zehan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:12","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Huang, Jimin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Huang, Jimin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:13","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Liu, Xue","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Liu, Xue","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:14","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Nie, Jian-Yun","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Nie, Jian-Yun","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:15","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}},{"actor":{"name":"Ananiadou, Sophia","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ananiadou, Sophia","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07464","locator":"head/meta[name=author|citation_author]"},"assertionId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190:participation:16","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T20:28:06.446Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","sourceUrl":"https://arxiv.org/abs/2611.07464","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z"}}],"participationCoverage":{"total":17,"returned":17,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.07464","snapshotId":"8ac07a6536c691e49d8f308fc2c2c955251cf41e36a697a722a48111ad684190","contentSha256":"efed40b12ba856942de0f5ce624d7445ccb7b7fb02de7a9f959ce03445317703","textHash":"c3afa81a89f4895026b220d790c3204b1fb137d2b9f7a6c7dc46cf6a6c5d3bf3","observedAt":"2026-11-08T20:28:06.446Z","basis":"publisher-page-metadata","sourceLinks":58,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/dca88e64d37b07d512dd6cbf626fad27bfa86b496e881de3c9f4a203ef8d86bf/source"}}}],"audits":[{"publicationId":"3800a478-5f84-4ab3-89ff-e0863b9acba9","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft attributes FINCOSMOS to Yupeng Cao and coauthors in an arXiv cs.AI paper. This matches the author list. Results are framed as reported by the authors, and the Escape Meridian interpretation is labeled as such.","excerpt":"Authors:Yupeng Cao, Xueqing Peng, Lingfei Qian, Haohang Li"},{"dimension":"summary","status":"uncertain","explanation":"The summary is faithful, and the title and question fit the source. However, central finance terms are never explained in plain language: backtest (testing a strategy on past data), data cutoff, point-in-time correctness and veto checks. Without them, a non-specialist cannot see why a backtest that uses the future is a silent failure. Smallest repair: add a brief plain-language gloss of backtest and data cutoff, or term-library tooltips. The draft also omits that the agent receives no data, which is minor but explains why it must use the Web.","excerpt":"The agent receives no data, so it must acquire data from the Web, build its own backtest under a data cutoff, and deliver verifiable results."},{"dimension":"date","status":"pass","explanation":"The originalPublished date of 2026-11-05 matches the v1 submission date. It is not the later feed date of 2026-11-06.","excerpt":"[Submitted on 5 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"All numeric claims match the abstract: 150 sessions, four coding agents plus a model without tools, zero accepted sessions, 54–64%, 88.33%, ten tasks and 15 veto checks. The interpretation is labeled, tied to the authors' stated concern, and bounded by a limitation against generalizing beyond the evaluation. No benefits or costs are invented.","excerpt":"Across four coding agents and a model without tools in 150 sessions, no session is accepted: every session that the simulated user signed off fails a program check"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified, direct arXiv abstract page for this paper, which is the original source. It is relevant and easy to access.","excerpt":null}],"createdAt":"2026-11-08T19:24:11.077Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}