{"id":"9c7d185935e40eeab75d4ad6f9f1e14456a2cc192275461adad5a8abe1039950","title":"arXiv: Authors argue clinical diagnosis tests what LLMs ask, not just infer","argument":"Federico Ravenda and coauthors introduce Hx2Dx ARENA, an interactive benchmark in which LLMs move through simulated clinical cases by taking a history, examining the patient and requesting tests. They argue that static evaluations—where a case already presents the relevant findings—miss a central part of diagnosis: gathering the evidence in the first place. In their benchmark, every evaluated model loses diagnostic accuracy compared with the static setting, and performance varies considerably across models. The authors say targeted questions that build a more complete clinical picture account for much of both the gap between models and the loss of accuracy. Their key distinction is that LLMs may reason well once relevant data are available while remaining limited in deciding what information to seek. The authors call closing that gap a prerequisite for safe integration into real-world diagnostic workflows. The result makes question-asking, rather than inference alone, a focus for evaluating clinical reasoning; the reported evidence comes from simulated encounters, not real-world deployment.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract describes simulated encounters and does not report evaluation in real-world diagnostic workflows; the benchmark results therefore do not establish how models perform in clinical deployment. The abstract does not name the evaluated models or provide detailed results for individual models or configurations.","speaker":{"name":"Ravenda, Federico, Cesarini, Mirko, Montagnani, Daniele, Karpenko, Volodymyr, Mira, Antonietta, Raballo, Andrea","roleAtSource":"Article author"},"source":{"title":"Hx2Dx: From Anamnesis to Diagnosis - A Multimodal Arena for Conversational Clinical Reasoning in LLMs","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.14122","publishedAt":"2026-11-10","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors introduce Hx2Dx ARENA, an interactive benchmark of simulated clinical cases that proceeds from presentation through history taking, examination and diagnostic workup.","excerpt":"Each case is a simulated encounter that proceeds from initial presentation through history taking and physical examination to diagnostic workup.","url":"https://arxiv.org/abs/2611.14122","relationship":"Source-stated"},{"text":"The authors contrast interactive diagnosis with static evaluations, which provide a case with relevant findings already selected.","excerpt":"Such evaluations measure inference over already selected evidence; the evaluations do not account for the inquiry used to obtain it.","url":"https://arxiv.org/abs/2611.14122","relationship":"Source-stated"},{"text":"The authors report that every evaluated model has lower diagnostic accuracy in the interactive setting than in the static setting.","excerpt":"Performance varies considerably across models in the interactive setting, and every model loses diagnostic accuracy relative to the static setting","url":"https://arxiv.org/abs/2611.14122","relationship":"Source-stated"},{"text":"The authors say targeted questions that build a more complete clinical picture account for much of the performance gap and accuracy loss.","excerpt":"diagnosis improves as questions become more targeted and build a more complete clinical picture.","url":"https://arxiv.org/abs/2611.14122","relationship":"Source-stated"},{"text":"The authors argue that LLMs remain limited in hypothesis-driven information gathering, even when they can reason well with relevant data available.","excerpt":"LLMs thus reason well once the relevant data are available but remain limited in hypothesis-driven information gathering, in knowing what to ask in order to know.","url":"https://arxiv.org/abs/2611.14122","relationship":"Source-stated"},{"text":"The authors describe closing the information-gathering gap as a prerequisite for safe integration into real-world diagnostic workflows.","excerpt":"Closing this gap is a prerequisite for their safe integration into real-world diagnostic workflows.","url":"https://arxiv.org/abs/2611.14122","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.14122","checkedAt":"2026-11-12T04:32:10.029Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well do the simulated encounters represent the inquiry clinicians use in practice?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv: Authors argue clinical diagnosis tests what LLMs ask, not just infer","summary":"Federico Ravenda and coauthors introduce Hx2Dx ARENA, an interactive benchmark in which LLMs move through simulated clinical cases by taking a history, examining the patient and requesting tests. They argue that static evaluations—where a case already presents the relevant findings—miss a central part of diagnosis: gathering the evidence in the first place. In their benchmark, every evaluated model loses diagnostic accuracy compared with the static setting, and performance varies considerably across models. The authors say targeted questions that build a more complete clinical picture account for much of both the gap between models and the loss of accuracy. Their key distinction is that LLMs may reason well once relevant data are available while remaining limited in deciding what information to seek. The authors call closing that gap a prerequisite for safe integration into real-world diagnostic workflows. The result makes question-asking, rather than inference alone, a focus for evaluating clinical reasoning; the reported evidence comes from simulated encounters, not real-world deployment.","question":"How well do the simulated encounters represent the inquiry clinicians use in practice?","claims":[{"text":"The authors introduce Hx2Dx ARENA, an interactive benchmark of simulated clinical cases that proceeds from presentation through history taking, examination and diagnostic workup.","excerpt":"Each case is a simulated encounter that proceeds from initial presentation through history taking and physical examination to diagnostic workup.","support":"source-stated"},{"text":"The authors contrast interactive diagnosis with static evaluations, which provide a case with relevant findings already selected.","excerpt":"Such evaluations measure inference over already selected evidence; the evaluations do not account for the inquiry used to obtain it.","support":"source-stated"},{"text":"The authors report that every evaluated model has lower diagnostic accuracy in the interactive setting than in the static setting.","excerpt":"Performance varies considerably across models in the interactive setting, and every model loses diagnostic accuracy relative to the static setting","support":"source-stated"},{"text":"The authors say targeted questions that build a more complete clinical picture account for much of the performance gap and accuracy loss.","excerpt":"diagnosis improves as questions become more targeted and build a more complete clinical picture.","support":"source-stated"},{"text":"The authors argue that LLMs remain limited in hypothesis-driven information gathering, even when they can reason well with relevant data available.","excerpt":"LLMs thus reason well once the relevant data are available but remain limited in hypothesis-driven information gathering, in knowing what to ask in order to know.","support":"source-stated"},{"text":"The authors describe closing the information-gathering gap as a prerequisite for safe integration into real-world diagnostic workflows.","excerpt":"Closing this gap is a prerequisite for their safe integration into real-world diagnostic workflows.","support":"source-stated"}],"limitations":["The abstract describes simulated encounters and does not report evaluation in real-world diagnostic workflows; the benchmark results therefore do not establish how models perform in clinical deployment.","The abstract does not name the evaluated models or provide detailed results for individual models or configurations."],"mediaId":"cb881b09ad4f96c62555f8a3a77820f72994478cc0a596c4e9f863e9e3a7c024","correctionReason":null,"id":"9c7d185935e40eeab75d4ad6f9f1e14456a2cc192275461adad5a8abe1039950","publicationId":"906ffc64-7d53-4ec4-8b8d-f82cdf89974c","version":1,"sourceUrl":"https://arxiv.org/abs/2611.14122","sourceTitle":"Hx2Dx: From Anamnesis to Diagnosis - A Multimodal Arena for Conversational Clinical Reasoning in LLMs","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-10","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-11T05:09:34.741Z","createdAt":"2026-11-12T04:01:10.069Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"cb881b09ad4f96c62555f8a3a77820f72994478cc0a596c4e9f863e9e3a7c024","kind":"article","url":"https://arxiv.org/abs/2611.14122","sourceUrl":"https://arxiv.org/abs/2611.14122","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-12T03:50:00.548Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.14122","checkedAt":"2026-11-12T04:32:10.029Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v6","mediaId":"cb881b09ad4f96c62555f8a3a77820f72994478cc0a596c4e9f863e9e3a7c024","confidence":0.7000000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"3af75da153adcb4465659c55c1f9e5ec63403c78d98472b691650d217383a757","decidedAt":"2026-11-12T03:50:02.770Z"},"provenance":{"textHash":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","observationId":"ef61845e71a3370b7fcfc7c19ab69913c99503a9bf4ea73fe2a2cdd59582d7bd","retrievedAt":"2026-11-12T03:50:00.233Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"19069ae4-1f30-4c09-82dc-f8de5df229df"},"reviewer":{"model":"gpt-6-luna","runId":"feb2d383-ee48-4c81-87f6-c0fe4a8f4fc8"}},"audit":{"status":"passed","reviewedAt":"2026-11-12T04:01:10.069Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Ravenda, Federico","url":null,"kind":"unknown"},{"name":"Cesarini, Mirko","url":null,"kind":"unknown"},{"name":"Montagnani, Daniele","url":null,"kind":"unknown"},{"name":"Karpenko, Volodymyr","url":null,"kind":"unknown"},{"name":"Mira, Antonietta","url":null,"kind":"unknown"},{"name":"Raballo, Andrea","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Ravenda, Federico","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ravenda, Federico","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14122","locator":"head/meta[name=author|citation_author]"},"assertionId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T04:32:10.029Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0","sourceUrl":"https://arxiv.org/abs/2611.14122","contentSha256":"2d94c7ef84db405030de3cb56001d61ea520a8d22ec01962bc78e211ae291f14","textHash":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","observedAt":"2026-11-12T04:32:10.029Z"}},{"actor":{"name":"Cesarini, Mirko","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Cesarini, Mirko","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14122","locator":"head/meta[name=author|citation_author]"},"assertionId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T04:32:10.029Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0","sourceUrl":"https://arxiv.org/abs/2611.14122","contentSha256":"2d94c7ef84db405030de3cb56001d61ea520a8d22ec01962bc78e211ae291f14","textHash":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","observedAt":"2026-11-12T04:32:10.029Z"}},{"actor":{"name":"Montagnani, Daniele","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Montagnani, Daniele","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14122","locator":"head/meta[name=author|citation_author]"},"assertionId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T04:32:10.029Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0","sourceUrl":"https://arxiv.org/abs/2611.14122","contentSha256":"2d94c7ef84db405030de3cb56001d61ea520a8d22ec01962bc78e211ae291f14","textHash":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","observedAt":"2026-11-12T04:32:10.029Z"}},{"actor":{"name":"Karpenko, Volodymyr","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Karpenko, Volodymyr","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14122","locator":"head/meta[name=author|citation_author]"},"assertionId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T04:32:10.029Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0","sourceUrl":"https://arxiv.org/abs/2611.14122","contentSha256":"2d94c7ef84db405030de3cb56001d61ea520a8d22ec01962bc78e211ae291f14","textHash":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","observedAt":"2026-11-12T04:32:10.029Z"}},{"actor":{"name":"Mira, Antonietta","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mira, Antonietta","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14122","locator":"head/meta[name=author|citation_author]"},"assertionId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T04:32:10.029Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0","sourceUrl":"https://arxiv.org/abs/2611.14122","contentSha256":"2d94c7ef84db405030de3cb56001d61ea520a8d22ec01962bc78e211ae291f14","textHash":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","observedAt":"2026-11-12T04:32:10.029Z"}},{"actor":{"name":"Raballo, Andrea","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Raballo, Andrea","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14122","locator":"head/meta[name=author|citation_author]"},"assertionId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T04:32:10.029Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0","sourceUrl":"https://arxiv.org/abs/2611.14122","contentSha256":"2d94c7ef84db405030de3cb56001d61ea520a8d22ec01962bc78e211ae291f14","textHash":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","observedAt":"2026-11-12T04:32:10.029Z"}}],"participationCoverage":{"total":6,"returned":6,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.14122","snapshotId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0","contentSha256":"2d94c7ef84db405030de3cb56001d61ea520a8d22ec01962bc78e211ae291f14","textHash":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","observedAt":"2026-11-12T04:32:10.029Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/9c7d185935e40eeab75d4ad6f9f1e14456a2cc192275461adad5a8abe1039950/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-authors-argue-clinical-diagnosis-tests-what-llms-ask-not-9c7d1859","formats":{"html":"/readings/arxiv-authors-argue-clinical-diagnosis-tests-what-llms-ask-not-9c7d1859","markdown":"/readings/arxiv-authors-argue-clinical-diagnosis-tests-what-llms-ask-not-9c7d1859.md","json":"/readings/arxiv-authors-argue-clinical-diagnosis-tests-what-llms-ask-not-9c7d1859.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"},{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"9c7d185935e40eeab75d4ad6f9f1e14456a2cc192275461adad5a8abe1039950","revision":"906ffc64-7d53-4ec4-8b8d-f82cdf89974c","revisionKind":"publication-id","title":"arXiv: Authors argue clinical diagnosis tests what LLMs ask, not just infer","url":"https://escapemeridian.com/readings/arxiv-authors-argue-clinical-diagnosis-tests-what-llms-ask-not-9c7d1859"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.14122","revision":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","revisionKind":"sha256-source-text","title":"Hx2Dx: From Anamnesis to Diagnosis - A Multimodal Arena for Conversational Clinical Reasoning in LLMs","url":"https://arxiv.org/abs/2611.14122"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"9c7d185935e40eeab75d4ad6f9f1e14456a2cc192275461adad5a8abe1039950","title":"arXiv: Authors argue clinical diagnosis tests what LLMs ask, not just infer","argument":"Federico Ravenda and coauthors introduce Hx2Dx ARENA, an interactive benchmark in which LLMs move through simulated clinical cases by taking a history, examining the patient and requesting tests. They argue that static evaluations—where a case already presents the relevant findings—miss a central part of diagnosis: gathering the evidence in the first place. In their benchmark, every evaluated model loses diagnostic accuracy compared with the static setting, and performance varies considerably across models. The authors say targeted questions that build a more complete clinical picture account for much of both the gap between models and the loss of accuracy. Their key distinction is that LLMs may reason well once relevant data are available while remaining limited in deciding what information to seek. The authors call closing that gap a prerequisite for safe integration into real-world diagnostic workflows. The result makes question-asking, rather than inference alone, a focus for evaluating clinical reasoning; the reported evidence comes from simulated encounters, not real-world deployment.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract describes simulated encounters and does not report evaluation in real-world diagnostic workflows; the benchmark results therefore do not establish how models perform in clinical deployment. The abstract does not name the evaluated models or provide detailed results for individual models or configurations.","speaker":{"name":"Ravenda, Federico, Cesarini, Mirko, Montagnani, Daniele, Karpenko, Volodymyr, Mira, Antonietta, Raballo, Andrea","roleAtSource":"Article author"},"source":{"title":"Hx2Dx: From Anamnesis to Diagnosis - A Multimodal Arena for Conversational Clinical Reasoning in LLMs","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.14122","publishedAt":"2026-11-10","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors introduce Hx2Dx ARENA, an interactive benchmark of simulated clinical cases that proceeds from presentation through history taking, examination and diagnostic workup.","excerpt":"Each case is a simulated encounter that proceeds from initial presentation through history taking and physical examination to diagnostic workup.","url":"https://arxiv.org/abs/2611.14122","relationship":"Source-stated"},{"text":"The authors contrast interactive diagnosis with static evaluations, which provide a case with relevant findings already selected.","excerpt":"Such evaluations measure inference over already selected evidence; the evaluations do not account for the inquiry used to obtain it.","url":"https://arxiv.org/abs/2611.14122","relationship":"Source-stated"},{"text":"The authors report that every evaluated model has lower diagnostic accuracy in the interactive setting than in the static setting.","excerpt":"Performance varies considerably across models in the interactive setting, and every model loses diagnostic accuracy relative to the static setting","url":"https://arxiv.org/abs/2611.14122","relationship":"Source-stated"},{"text":"The authors say targeted questions that build a more complete clinical picture account for much of the performance gap and accuracy loss.","excerpt":"diagnosis improves as questions become more targeted and build a more complete clinical picture.","url":"https://arxiv.org/abs/2611.14122","relationship":"Source-stated"},{"text":"The authors argue that LLMs remain limited in hypothesis-driven information gathering, even when they can reason well with relevant data available.","excerpt":"LLMs thus reason well once the relevant data are available but remain limited in hypothesis-driven information gathering, in knowing what to ask in order to know.","url":"https://arxiv.org/abs/2611.14122","relationship":"Source-stated"},{"text":"The authors describe closing the information-gathering gap as a prerequisite for safe integration into real-world diagnostic workflows.","excerpt":"Closing this gap is a prerequisite for their safe integration into real-world diagnostic workflows.","url":"https://arxiv.org/abs/2611.14122","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.14122","checkedAt":"2026-11-12T04:32:10.029Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well do the simulated encounters represent the inquiry clinicians use in practice?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv: Authors argue clinical diagnosis tests what LLMs ask, not just infer","summary":"Federico Ravenda and coauthors introduce Hx2Dx ARENA, an interactive benchmark in which LLMs move through simulated clinical cases by taking a history, examining the patient and requesting tests. They argue that static evaluations—where a case already presents the relevant findings—miss a central part of diagnosis: gathering the evidence in the first place. In their benchmark, every evaluated model loses diagnostic accuracy compared with the static setting, and performance varies considerably across models. The authors say targeted questions that build a more complete clinical picture account for much of both the gap between models and the loss of accuracy. Their key distinction is that LLMs may reason well once relevant data are available while remaining limited in deciding what information to seek. The authors call closing that gap a prerequisite for safe integration into real-world diagnostic workflows. The result makes question-asking, rather than inference alone, a focus for evaluating clinical reasoning; the reported evidence comes from simulated encounters, not real-world deployment.","question":"How well do the simulated encounters represent the inquiry clinicians use in practice?","claims":[{"text":"The authors introduce Hx2Dx ARENA, an interactive benchmark of simulated clinical cases that proceeds from presentation through history taking, examination and diagnostic workup.","excerpt":"Each case is a simulated encounter that proceeds from initial presentation through history taking and physical examination to diagnostic workup.","support":"source-stated"},{"text":"The authors contrast interactive diagnosis with static evaluations, which provide a case with relevant findings already selected.","excerpt":"Such evaluations measure inference over already selected evidence; the evaluations do not account for the inquiry used to obtain it.","support":"source-stated"},{"text":"The authors report that every evaluated model has lower diagnostic accuracy in the interactive setting than in the static setting.","excerpt":"Performance varies considerably across models in the interactive setting, and every model loses diagnostic accuracy relative to the static setting","support":"source-stated"},{"text":"The authors say targeted questions that build a more complete clinical picture account for much of the performance gap and accuracy loss.","excerpt":"diagnosis improves as questions become more targeted and build a more complete clinical picture.","support":"source-stated"},{"text":"The authors argue that LLMs remain limited in hypothesis-driven information gathering, even when they can reason well with relevant data available.","excerpt":"LLMs thus reason well once the relevant data are available but remain limited in hypothesis-driven information gathering, in knowing what to ask in order to know.","support":"source-stated"},{"text":"The authors describe closing the information-gathering gap as a prerequisite for safe integration into real-world diagnostic workflows.","excerpt":"Closing this gap is a prerequisite for their safe integration into real-world diagnostic workflows.","support":"source-stated"}],"limitations":["The abstract describes simulated encounters and does not report evaluation in real-world diagnostic workflows; the benchmark results therefore do not establish how models perform in clinical deployment.","The abstract does not name the evaluated models or provide detailed results for individual models or configurations."],"mediaId":"cb881b09ad4f96c62555f8a3a77820f72994478cc0a596c4e9f863e9e3a7c024","correctionReason":null,"id":"9c7d185935e40eeab75d4ad6f9f1e14456a2cc192275461adad5a8abe1039950","publicationId":"906ffc64-7d53-4ec4-8b8d-f82cdf89974c","version":1,"sourceUrl":"https://arxiv.org/abs/2611.14122","sourceTitle":"Hx2Dx: From Anamnesis to Diagnosis - A Multimodal Arena for Conversational Clinical Reasoning in LLMs","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-10","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-11T05:09:34.741Z","createdAt":"2026-11-12T04:01:10.069Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"cb881b09ad4f96c62555f8a3a77820f72994478cc0a596c4e9f863e9e3a7c024","kind":"article","url":"https://arxiv.org/abs/2611.14122","sourceUrl":"https://arxiv.org/abs/2611.14122","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-12T03:50:00.548Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.14122","checkedAt":"2026-11-12T04:32:10.029Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v6","mediaId":"cb881b09ad4f96c62555f8a3a77820f72994478cc0a596c4e9f863e9e3a7c024","confidence":0.7000000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"3af75da153adcb4465659c55c1f9e5ec63403c78d98472b691650d217383a757","decidedAt":"2026-11-12T03:50:02.770Z"},"provenance":{"textHash":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","observationId":"ef61845e71a3370b7fcfc7c19ab69913c99503a9bf4ea73fe2a2cdd59582d7bd","retrievedAt":"2026-11-12T03:50:00.233Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"19069ae4-1f30-4c09-82dc-f8de5df229df"},"reviewer":{"model":"gpt-6-luna","runId":"feb2d383-ee48-4c81-87f6-c0fe4a8f4fc8"}},"audit":{"status":"passed","reviewedAt":"2026-11-12T04:01:10.069Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Ravenda, Federico","url":null,"kind":"unknown"},{"name":"Cesarini, Mirko","url":null,"kind":"unknown"},{"name":"Montagnani, Daniele","url":null,"kind":"unknown"},{"name":"Karpenko, Volodymyr","url":null,"kind":"unknown"},{"name":"Mira, Antonietta","url":null,"kind":"unknown"},{"name":"Raballo, Andrea","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Ravenda, Federico","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ravenda, Federico","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14122","locator":"head/meta[name=author|citation_author]"},"assertionId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T04:32:10.029Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0","sourceUrl":"https://arxiv.org/abs/2611.14122","contentSha256":"2d94c7ef84db405030de3cb56001d61ea520a8d22ec01962bc78e211ae291f14","textHash":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","observedAt":"2026-11-12T04:32:10.029Z"}},{"actor":{"name":"Cesarini, Mirko","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Cesarini, Mirko","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14122","locator":"head/meta[name=author|citation_author]"},"assertionId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T04:32:10.029Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0","sourceUrl":"https://arxiv.org/abs/2611.14122","contentSha256":"2d94c7ef84db405030de3cb56001d61ea520a8d22ec01962bc78e211ae291f14","textHash":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","observedAt":"2026-11-12T04:32:10.029Z"}},{"actor":{"name":"Montagnani, Daniele","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Montagnani, Daniele","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14122","locator":"head/meta[name=author|citation_author]"},"assertionId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T04:32:10.029Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0","sourceUrl":"https://arxiv.org/abs/2611.14122","contentSha256":"2d94c7ef84db405030de3cb56001d61ea520a8d22ec01962bc78e211ae291f14","textHash":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","observedAt":"2026-11-12T04:32:10.029Z"}},{"actor":{"name":"Karpenko, Volodymyr","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Karpenko, Volodymyr","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14122","locator":"head/meta[name=author|citation_author]"},"assertionId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T04:32:10.029Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0","sourceUrl":"https://arxiv.org/abs/2611.14122","contentSha256":"2d94c7ef84db405030de3cb56001d61ea520a8d22ec01962bc78e211ae291f14","textHash":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","observedAt":"2026-11-12T04:32:10.029Z"}},{"actor":{"name":"Mira, Antonietta","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mira, Antonietta","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14122","locator":"head/meta[name=author|citation_author]"},"assertionId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T04:32:10.029Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0","sourceUrl":"https://arxiv.org/abs/2611.14122","contentSha256":"2d94c7ef84db405030de3cb56001d61ea520a8d22ec01962bc78e211ae291f14","textHash":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","observedAt":"2026-11-12T04:32:10.029Z"}},{"actor":{"name":"Raballo, Andrea","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Raballo, Andrea","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14122","locator":"head/meta[name=author|citation_author]"},"assertionId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T04:32:10.029Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0","sourceUrl":"https://arxiv.org/abs/2611.14122","contentSha256":"2d94c7ef84db405030de3cb56001d61ea520a8d22ec01962bc78e211ae291f14","textHash":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","observedAt":"2026-11-12T04:32:10.029Z"}}],"participationCoverage":{"total":6,"returned":6,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.14122","snapshotId":"c330ef2c08ea9553d1ba746b1836313c1c95132398c00daf10584c2d07b2fbe0","contentSha256":"2d94c7ef84db405030de3cb56001d61ea520a8d22ec01962bc78e211ae291f14","textHash":"4487979c3ce234a3b1716bb37e955e0552e794da85d2b7dee8693d293e494b2d","observedAt":"2026-11-12T04:32:10.029Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/9c7d185935e40eeab75d4ad6f9f1e14456a2cc192275461adad5a8abe1039950/source"}}}],"audits":[{"publicationId":"906ffc64-7d53-4ec4-8b8d-f82cdf89974c","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading correctly credits Federico Ravenda and coauthors for introducing Hx2Dx ARENA. The arguments about static evaluations, lost accuracy and information gathering remain attributed to the authors rather than presented as established fact.","excerpt":"Authors:Federico Ravenda, Mirko Cesarini, Daniele Montagnani, Volodymyr Karpenko, Antonietta Mira, Andrea Raballo"},{"dimension":"summary","status":"pass","explanation":"A general reader can follow the summary. It explains static versus interactive evaluation and the simulated steps of history taking, examination and tests, and it states the central thesis. Minor: 'may reason well' slightly softens the source's direct 'LLMs thus reason well'; dropping 'may' would restore the authors' force. It also omits the 1,000 NEJM cases. Neither prevents understanding. The question is a genuine open issue about how well the simulation represents real practice.","excerpt":"LLMs thus reason well once the relevant data are available but remain limited in hypothesis-driven information gathering, in knowing what to ask in order to know."},{"dimension":"date","status":"pass","explanation":"The originalPublished date, 2026-11-10, matches the arXiv v1 submission date. It is not the later feed date.","excerpt":"[Submitted on 10 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim matches the abstract. The excerpt for claim 4 shows the improvement trend, while the 'accounts for much' wording comes from the adjacent sentence; it is still supported. The closing framing about simulated rather than deployed evidence and the limitations are grounded and conditional. No benefits or costs are invented.","excerpt":"The ability to ask the right questions accounts for much of both the gap between models and the loss of accuracy"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified arXiv abstract page for this paper. It is the direct original source.","excerpt":null}],"createdAt":"2026-11-12T04:01:10.069Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}