{"id":"9e714f3c453f6142ff9d802d1464f14eb1a4d2f7139a1e1d8a976014e525635f","title":"arXiv: FinMultiHopQA tests how evidence structure affects financial question answering","argument":"The authors of FinMultiHopQA introduce a benchmark for financial questions that require combining evidence across filing sections, fiscal years and peer companies. Built from FinReflectKG, a temporally indexed financial knowledge graph derived from SEC 10-K filings, it contains 15,600 qualitative and quantitative questions. The authors also use the benchmark to test whether reasoning LLMs answer consistently when the same evidence is presented in different ways. They report that judged correctness is lower with less-structured presentations, especially for quantitative cross-company reasoning and 3-hop branch motifs. In their account, reasoning capacity alone does not fully offset the effects of evidence structure. They say KG-linked presentation also uses fewer input tokens by design. The benchmark and associated provenance annotations, model outputs, evaluation records and technical documentation are released. The abstract describes benchmark results, not how well they predict performance on financial questions outside this evaluation.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv page abstract and comments, not the paper's detailed evaluation tables or methods; it does not provide result sizes or comparisons by model. The abstract reports benchmark evaluation results but does not establish how they generalize to financial questions outside the benchmark.","speaker":{"name":"Arun, Abhinav, Harsh, Reetu Raj, Sarmah, Bhaskarjit, Pasquali, Stefano","roleAtSource":"Article author"},"source":{"title":"FinMultiHopQA: A KG-Grounded Multi-Hop Financial QA Benchmark for Evidence-Driven Reasoning","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2510.02906","publishedAt":"2025-10-03","dateBasis":"Date basis not provided."},"evidence":[{"text":"FinMultiHopQA contains 15,600 qualitative and quantitative financial questions grounded in FinReflectKG, a temporally indexed financial knowledge graph derived from SEC 10-K filings.","excerpt":"a benchmark of 15,600 qualitative and quantitative questions, grounded in FinReflectKG, a temporally indexed financial knowledge graph derived from SEC 10-K filings","url":"https://arxiv.org/abs/2510.02906","relationship":"Source-stated"},{"text":"The authors vary the presentation of the same underlying evidence to test whether reasoning LLMs' performance depends on evidence structure.","excerpt":"hold each question's underlying evidence constant while varying only its presentation - embedding it in noisy surrounding context or changing its order","url":"https://arxiv.org/abs/2510.02906","relationship":"Source-stated"},{"text":"The authors report consistently lower judged correctness under less-structured presentations, most sharply for quantitative cross-company reasoning and 3-hop branch motifs.","excerpt":"judged correctness remains consistently lower under less-structured presentations of the same evidence - most sharply for quantitative cross-company reasoning and 3-hop branch motifs","url":"https://arxiv.org/abs/2510.02906","relationship":"Source-stated"},{"text":"The authors say KG-linked presentation uses fewer input tokens by design.","excerpt":"KG-linked presentation also uses fewer input tokens by design.","url":"https://arxiv.org/abs/2510.02906","relationship":"Source-stated"},{"text":"The paper releases the benchmark, provenance annotations, model outputs, evaluation records and supporting technical documentation.","excerpt":"We release the benchmark, provenance annotations, model outputs, evaluation records, and supporting technical documentation.","url":"https://arxiv.org/abs/2510.02906","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2510.02906","checkedAt":"2026-11-08T05:50:09.305Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How do the reported differences in judged correctness vary across the six evidence presentations and evaluated models?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv: FinMultiHopQA tests how evidence structure affects financial question answering","summary":"The authors of FinMultiHopQA introduce a benchmark for financial questions that require combining evidence across filing sections, fiscal years and peer companies. Built from FinReflectKG, a temporally indexed financial knowledge graph derived from SEC 10-K filings, it contains 15,600 qualitative and quantitative questions. The authors also use the benchmark to test whether reasoning LLMs answer consistently when the same evidence is presented in different ways. They report that judged correctness is lower with less-structured presentations, especially for quantitative cross-company reasoning and 3-hop branch motifs. In their account, reasoning capacity alone does not fully offset the effects of evidence structure. They say KG-linked presentation also uses fewer input tokens by design. The benchmark and associated provenance annotations, model outputs, evaluation records and technical documentation are released. The abstract describes benchmark results, not how well they predict performance on financial questions outside this evaluation.","question":"How do the reported differences in judged correctness vary across the six evidence presentations and evaluated models?","claims":[{"text":"FinMultiHopQA contains 15,600 qualitative and quantitative financial questions grounded in FinReflectKG, a temporally indexed financial knowledge graph derived from SEC 10-K filings.","excerpt":"a benchmark of 15,600 qualitative and quantitative questions, grounded in FinReflectKG, a temporally indexed financial knowledge graph derived from SEC 10-K filings","support":"source-stated"},{"text":"The authors vary the presentation of the same underlying evidence to test whether reasoning LLMs' performance depends on evidence structure.","excerpt":"hold each question's underlying evidence constant while varying only its presentation - embedding it in noisy surrounding context or changing its order","support":"source-stated"},{"text":"The authors report consistently lower judged correctness under less-structured presentations, most sharply for quantitative cross-company reasoning and 3-hop branch motifs.","excerpt":"judged correctness remains consistently lower under less-structured presentations of the same evidence - most sharply for quantitative cross-company reasoning and 3-hop branch motifs","support":"source-stated"},{"text":"The authors say KG-linked presentation uses fewer input tokens by design.","excerpt":"KG-linked presentation also uses fewer input tokens by design.","support":"source-stated"},{"text":"The paper releases the benchmark, provenance annotations, model outputs, evaluation records and supporting technical documentation.","excerpt":"We release the benchmark, provenance annotations, model outputs, evaluation records, and supporting technical documentation.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv page abstract and comments, not the paper's detailed evaluation tables or methods; it does not provide result sizes or comparisons by model.","The abstract reports benchmark evaluation results but does not establish how they generalize to financial questions outside the benchmark."],"mediaId":"eaf0c77055923f724e52d326bd47200ae69b1258f28dad7e7d97bed93a31f18a","correctionReason":null,"id":"9e714f3c453f6142ff9d802d1464f14eb1a4d2f7139a1e1d8a976014e525635f","publicationId":"e8ef0851-3953-4e91-8471-b58061e9f114","version":1,"sourceUrl":"https://arxiv.org/abs/2510.02906","sourceTitle":"FinMultiHopQA: A KG-Grounded Multi-Hop Financial QA Benchmark for Evidence-Driven Reasoning","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2025-10-03","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-06T05:01:01.486Z","createdAt":"2026-11-08T05:18:51.115Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"eaf0c77055923f724e52d326bd47200ae69b1258f28dad7e7d97bed93a31f18a","kind":"article","url":"https://arxiv.org/abs/2510.02906","sourceUrl":"https://arxiv.org/abs/2510.02906","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-08T05:18:10.837Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2510.02906","checkedAt":"2026-11-08T05:50:09.305Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"eaf0c77055923f724e52d326bd47200ae69b1258f28dad7e7d97bed93a31f18a","confidence":0.86,"provider":"typesafe","model":"jev-1.13.0","inputHash":"eb105f8ca0e34d04a30d357c95a48f3dbc016b7266fc5d8d13d46b6623b2698d","decidedAt":"2026-11-08T05:18:11.614Z"},"provenance":{"textHash":"8e1e744e32a236ab7c81ef19401ef88b0f2c9e641d30f2e36b600ce4b5d729cc","observationId":"20097dcdefcdbf92533f1a0b09cc54c406176632a63e6740c31ff07560bb52a8","retrievedAt":"2026-11-08T05:18:10.696Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"274d6e43-64c4-48b6-81c7-0edcaeb04fa0"},"reviewer":{"model":"gpt-6-luna","runId":"5c736d04-1a12-4fd8-8444-9bc327757db3"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-08T05:18:51.115Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Arun, Abhinav","url":null,"kind":"unknown"},{"name":"Harsh, Reetu Raj","url":null,"kind":"unknown"},{"name":"Sarmah, Bhaskarjit","url":null,"kind":"unknown"},{"name":"Pasquali, Stefano","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Arun, Abhinav","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Arun, Abhinav","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2510.02906","locator":"head/meta[name=author|citation_author]"},"assertionId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:50:09.305Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f","sourceUrl":"https://arxiv.org/abs/2510.02906","contentSha256":"20762cbafe7bceab0cdbb76026280628b166ec696ddaaa83970d5408dc375ff7","textHash":"8e1e744e32a236ab7c81ef19401ef88b0f2c9e641d30f2e36b600ce4b5d729cc","observedAt":"2026-11-08T05:50:09.305Z"}},{"actor":{"name":"Harsh, Reetu Raj","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Harsh, Reetu Raj","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2510.02906","locator":"head/meta[name=author|citation_author]"},"assertionId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:50:09.305Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f","sourceUrl":"https://arxiv.org/abs/2510.02906","contentSha256":"20762cbafe7bceab0cdbb76026280628b166ec696ddaaa83970d5408dc375ff7","textHash":"8e1e744e32a236ab7c81ef19401ef88b0f2c9e641d30f2e36b600ce4b5d729cc","observedAt":"2026-11-08T05:50:09.305Z"}},{"actor":{"name":"Sarmah, Bhaskarjit","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sarmah, Bhaskarjit","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2510.02906","locator":"head/meta[name=author|citation_author]"},"assertionId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:50:09.305Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f","sourceUrl":"https://arxiv.org/abs/2510.02906","contentSha256":"20762cbafe7bceab0cdbb76026280628b166ec696ddaaa83970d5408dc375ff7","textHash":"8e1e744e32a236ab7c81ef19401ef88b0f2c9e641d30f2e36b600ce4b5d729cc","observedAt":"2026-11-08T05:50:09.305Z"}},{"actor":{"name":"Pasquali, Stefano","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Pasquali, Stefano","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2510.02906","locator":"head/meta[name=author|citation_author]"},"assertionId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:50:09.305Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f","sourceUrl":"https://arxiv.org/abs/2510.02906","contentSha256":"20762cbafe7bceab0cdbb76026280628b166ec696ddaaa83970d5408dc375ff7","textHash":"8e1e744e32a236ab7c81ef19401ef88b0f2c9e641d30f2e36b600ce4b5d729cc","observedAt":"2026-11-08T05:50:09.305Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2510.02906","snapshotId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f","contentSha256":"20762cbafe7bceab0cdbb76026280628b166ec696ddaaa83970d5408dc375ff7","textHash":"8e1e744e32a236ab7c81ef19401ef88b0f2c9e641d30f2e36b600ce4b5d729cc","observedAt":"2026-11-08T05:50:09.305Z","basis":"publisher-page-metadata","sourceLinks":45,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/9e714f3c453f6142ff9d802d1464f14eb1a4d2f7139a1e1d8a976014e525635f/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-finmultihopqa-tests-how-evidence-structure-affects-9e714f3c","formats":{"html":"/readings/arxiv-finmultihopqa-tests-how-evidence-structure-affects-9e714f3c","markdown":"/readings/arxiv-finmultihopqa-tests-how-evidence-structure-affects-9e714f3c.md","json":"/readings/arxiv-finmultihopqa-tests-how-evidence-structure-affects-9e714f3c.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"},{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"},{"id":"term-tokens","name":"Model tokens","explanation":"Small chunks of text, often parts of words, that a language model reads and writes; usage and prices are often counted in tokens.","referenceUrl":"https://developers.google.com/machine-learning/glossary#token"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"9e714f3c453f6142ff9d802d1464f14eb1a4d2f7139a1e1d8a976014e525635f","revision":"e8ef0851-3953-4e91-8471-b58061e9f114","revisionKind":"publication-id","title":"arXiv: FinMultiHopQA tests how evidence structure affects financial question answering","url":"https://escapemeridian.com/readings/arxiv-finmultihopqa-tests-how-evidence-structure-affects-9e714f3c"},"source":{"type":"source","id":"https://arxiv.org/abs/2510.02906","revision":"8e1e744e32a236ab7c81ef19401ef88b0f2c9e641d30f2e36b600ce4b5d729cc","revisionKind":"sha256-source-text","title":"FinMultiHopQA: A KG-Grounded Multi-Hop Financial QA Benchmark for Evidence-Driven Reasoning","url":"https://arxiv.org/abs/2510.02906"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"9e714f3c453f6142ff9d802d1464f14eb1a4d2f7139a1e1d8a976014e525635f","title":"arXiv: FinMultiHopQA tests how evidence structure affects financial question answering","argument":"The authors of FinMultiHopQA introduce a benchmark for financial questions that require combining evidence across filing sections, fiscal years and peer companies. Built from FinReflectKG, a temporally indexed financial knowledge graph derived from SEC 10-K filings, it contains 15,600 qualitative and quantitative questions. The authors also use the benchmark to test whether reasoning LLMs answer consistently when the same evidence is presented in different ways. They report that judged correctness is lower with less-structured presentations, especially for quantitative cross-company reasoning and 3-hop branch motifs. In their account, reasoning capacity alone does not fully offset the effects of evidence structure. They say KG-linked presentation also uses fewer input tokens by design. The benchmark and associated provenance annotations, model outputs, evaluation records and technical documentation are released. The abstract describes benchmark results, not how well they predict performance on financial questions outside this evaluation.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv page abstract and comments, not the paper's detailed evaluation tables or methods; it does not provide result sizes or comparisons by model. The abstract reports benchmark evaluation results but does not establish how they generalize to financial questions outside the benchmark.","speaker":{"name":"Arun, Abhinav, Harsh, Reetu Raj, Sarmah, Bhaskarjit, Pasquali, Stefano","roleAtSource":"Article author"},"source":{"title":"FinMultiHopQA: A KG-Grounded Multi-Hop Financial QA Benchmark for Evidence-Driven Reasoning","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2510.02906","publishedAt":"2025-10-03","dateBasis":"Date basis not provided."},"evidence":[{"text":"FinMultiHopQA contains 15,600 qualitative and quantitative financial questions grounded in FinReflectKG, a temporally indexed financial knowledge graph derived from SEC 10-K filings.","excerpt":"a benchmark of 15,600 qualitative and quantitative questions, grounded in FinReflectKG, a temporally indexed financial knowledge graph derived from SEC 10-K filings","url":"https://arxiv.org/abs/2510.02906","relationship":"Source-stated"},{"text":"The authors vary the presentation of the same underlying evidence to test whether reasoning LLMs' performance depends on evidence structure.","excerpt":"hold each question's underlying evidence constant while varying only its presentation - embedding it in noisy surrounding context or changing its order","url":"https://arxiv.org/abs/2510.02906","relationship":"Source-stated"},{"text":"The authors report consistently lower judged correctness under less-structured presentations, most sharply for quantitative cross-company reasoning and 3-hop branch motifs.","excerpt":"judged correctness remains consistently lower under less-structured presentations of the same evidence - most sharply for quantitative cross-company reasoning and 3-hop branch motifs","url":"https://arxiv.org/abs/2510.02906","relationship":"Source-stated"},{"text":"The authors say KG-linked presentation uses fewer input tokens by design.","excerpt":"KG-linked presentation also uses fewer input tokens by design.","url":"https://arxiv.org/abs/2510.02906","relationship":"Source-stated"},{"text":"The paper releases the benchmark, provenance annotations, model outputs, evaluation records and supporting technical documentation.","excerpt":"We release the benchmark, provenance annotations, model outputs, evaluation records, and supporting technical documentation.","url":"https://arxiv.org/abs/2510.02906","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2510.02906","checkedAt":"2026-11-08T05:50:09.305Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How do the reported differences in judged correctness vary across the six evidence presentations and evaluated models?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv: FinMultiHopQA tests how evidence structure affects financial question answering","summary":"The authors of FinMultiHopQA introduce a benchmark for financial questions that require combining evidence across filing sections, fiscal years and peer companies. Built from FinReflectKG, a temporally indexed financial knowledge graph derived from SEC 10-K filings, it contains 15,600 qualitative and quantitative questions. The authors also use the benchmark to test whether reasoning LLMs answer consistently when the same evidence is presented in different ways. They report that judged correctness is lower with less-structured presentations, especially for quantitative cross-company reasoning and 3-hop branch motifs. In their account, reasoning capacity alone does not fully offset the effects of evidence structure. They say KG-linked presentation also uses fewer input tokens by design. The benchmark and associated provenance annotations, model outputs, evaluation records and technical documentation are released. The abstract describes benchmark results, not how well they predict performance on financial questions outside this evaluation.","question":"How do the reported differences in judged correctness vary across the six evidence presentations and evaluated models?","claims":[{"text":"FinMultiHopQA contains 15,600 qualitative and quantitative financial questions grounded in FinReflectKG, a temporally indexed financial knowledge graph derived from SEC 10-K filings.","excerpt":"a benchmark of 15,600 qualitative and quantitative questions, grounded in FinReflectKG, a temporally indexed financial knowledge graph derived from SEC 10-K filings","support":"source-stated"},{"text":"The authors vary the presentation of the same underlying evidence to test whether reasoning LLMs' performance depends on evidence structure.","excerpt":"hold each question's underlying evidence constant while varying only its presentation - embedding it in noisy surrounding context or changing its order","support":"source-stated"},{"text":"The authors report consistently lower judged correctness under less-structured presentations, most sharply for quantitative cross-company reasoning and 3-hop branch motifs.","excerpt":"judged correctness remains consistently lower under less-structured presentations of the same evidence - most sharply for quantitative cross-company reasoning and 3-hop branch motifs","support":"source-stated"},{"text":"The authors say KG-linked presentation uses fewer input tokens by design.","excerpt":"KG-linked presentation also uses fewer input tokens by design.","support":"source-stated"},{"text":"The paper releases the benchmark, provenance annotations, model outputs, evaluation records and supporting technical documentation.","excerpt":"We release the benchmark, provenance annotations, model outputs, evaluation records, and supporting technical documentation.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv page abstract and comments, not the paper's detailed evaluation tables or methods; it does not provide result sizes or comparisons by model.","The abstract reports benchmark evaluation results but does not establish how they generalize to financial questions outside the benchmark."],"mediaId":"eaf0c77055923f724e52d326bd47200ae69b1258f28dad7e7d97bed93a31f18a","correctionReason":null,"id":"9e714f3c453f6142ff9d802d1464f14eb1a4d2f7139a1e1d8a976014e525635f","publicationId":"e8ef0851-3953-4e91-8471-b58061e9f114","version":1,"sourceUrl":"https://arxiv.org/abs/2510.02906","sourceTitle":"FinMultiHopQA: A KG-Grounded Multi-Hop Financial QA Benchmark for Evidence-Driven Reasoning","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2025-10-03","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-06T05:01:01.486Z","createdAt":"2026-11-08T05:18:51.115Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"eaf0c77055923f724e52d326bd47200ae69b1258f28dad7e7d97bed93a31f18a","kind":"article","url":"https://arxiv.org/abs/2510.02906","sourceUrl":"https://arxiv.org/abs/2510.02906","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-08T05:18:10.837Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2510.02906","checkedAt":"2026-11-08T05:50:09.305Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"eaf0c77055923f724e52d326bd47200ae69b1258f28dad7e7d97bed93a31f18a","confidence":0.86,"provider":"typesafe","model":"jev-1.13.0","inputHash":"eb105f8ca0e34d04a30d357c95a48f3dbc016b7266fc5d8d13d46b6623b2698d","decidedAt":"2026-11-08T05:18:11.614Z"},"provenance":{"textHash":"8e1e744e32a236ab7c81ef19401ef88b0f2c9e641d30f2e36b600ce4b5d729cc","observationId":"20097dcdefcdbf92533f1a0b09cc54c406176632a63e6740c31ff07560bb52a8","retrievedAt":"2026-11-08T05:18:10.696Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"274d6e43-64c4-48b6-81c7-0edcaeb04fa0"},"reviewer":{"model":"gpt-6-luna","runId":"5c736d04-1a12-4fd8-8444-9bc327757db3"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-08T05:18:51.115Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Arun, Abhinav","url":null,"kind":"unknown"},{"name":"Harsh, Reetu Raj","url":null,"kind":"unknown"},{"name":"Sarmah, Bhaskarjit","url":null,"kind":"unknown"},{"name":"Pasquali, Stefano","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Arun, Abhinav","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Arun, Abhinav","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2510.02906","locator":"head/meta[name=author|citation_author]"},"assertionId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:50:09.305Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f","sourceUrl":"https://arxiv.org/abs/2510.02906","contentSha256":"20762cbafe7bceab0cdbb76026280628b166ec696ddaaa83970d5408dc375ff7","textHash":"8e1e744e32a236ab7c81ef19401ef88b0f2c9e641d30f2e36b600ce4b5d729cc","observedAt":"2026-11-08T05:50:09.305Z"}},{"actor":{"name":"Harsh, Reetu Raj","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Harsh, Reetu Raj","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2510.02906","locator":"head/meta[name=author|citation_author]"},"assertionId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:50:09.305Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f","sourceUrl":"https://arxiv.org/abs/2510.02906","contentSha256":"20762cbafe7bceab0cdbb76026280628b166ec696ddaaa83970d5408dc375ff7","textHash":"8e1e744e32a236ab7c81ef19401ef88b0f2c9e641d30f2e36b600ce4b5d729cc","observedAt":"2026-11-08T05:50:09.305Z"}},{"actor":{"name":"Sarmah, Bhaskarjit","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sarmah, Bhaskarjit","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2510.02906","locator":"head/meta[name=author|citation_author]"},"assertionId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:50:09.305Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f","sourceUrl":"https://arxiv.org/abs/2510.02906","contentSha256":"20762cbafe7bceab0cdbb76026280628b166ec696ddaaa83970d5408dc375ff7","textHash":"8e1e744e32a236ab7c81ef19401ef88b0f2c9e641d30f2e36b600ce4b5d729cc","observedAt":"2026-11-08T05:50:09.305Z"}},{"actor":{"name":"Pasquali, Stefano","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Pasquali, Stefano","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2510.02906","locator":"head/meta[name=author|citation_author]"},"assertionId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:50:09.305Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f","sourceUrl":"https://arxiv.org/abs/2510.02906","contentSha256":"20762cbafe7bceab0cdbb76026280628b166ec696ddaaa83970d5408dc375ff7","textHash":"8e1e744e32a236ab7c81ef19401ef88b0f2c9e641d30f2e36b600ce4b5d729cc","observedAt":"2026-11-08T05:50:09.305Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2510.02906","snapshotId":"9fe7478a3e9c4d296df9b8daab7efcc337f447daf8e0079df7dac7113ceba04f","contentSha256":"20762cbafe7bceab0cdbb76026280628b166ec696ddaaa83970d5408dc375ff7","textHash":"8e1e744e32a236ab7c81ef19401ef88b0f2c9e641d30f2e36b600ce4b5d729cc","observedAt":"2026-11-08T05:50:09.305Z","basis":"publisher-page-metadata","sourceLinks":45,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/9e714f3c453f6142ff9d802d1464f14eb1a4d2f7139a1e1d8a976014e525635f/source"}}}],"audits":[{"publicationId":"e8ef0851-3953-4e91-8471-b58061e9f114","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading attributes the benchmark, experiments and conclusions to the paper's authors on arXiv. It frames the results as reported findings rather than established facts.","excerpt":"Authors:Abhinav Arun, Reetu Raj Harsh, Bhaskarjit Sarmah, Stefano Pasquali"},{"dimension":"summary","status":"uncertain","explanation":"The main idea is faithful: the same evidence, presented differently, produced lower judged correctness when it was less structured. A non-specialist may still get lost in two places. First, 'KG-linked presentation' never expands KG or says how it differs from the other presentations. Second, 'less-structured presentations' is not explained as embedding the evidence in noisy surrounding context or changing its order, which is the core mechanism. Smallest repair: say what the presentations vary, and add term-library tooltips for knowledge graph (KG), 3-hop branch motifs, input tokens, reasoning LLMs and SEC 10-K filings.","excerpt":"embedding it in noisy surrounding context or changing its order"},{"dimension":"date","status":"pass","explanation":"originalPublished 2025-10-03 matches the v1 submission date. The 2026 v2 revision and the feed date are correctly not used.","excerpt":"Submitted on 3 Oct 2025 (v1), last revised 4 Nov 2026 (this version, v2)"},{"dimension":"support","status":"pass","explanation":"Every claim is directly supported by the abstract, with exact excerpts. The draft's closing caveat about generalization is labeled as a limit of the abstract and adds no unsupported claim. The question asks about an unresolved detail (the six presentations) that the evidence raises.","excerpt":"using six such presentations, we test whether reasoning LLMs' performance depends on evidence structure"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-08T05:18:51.115Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}