{"id":"d284d3acaf2c34b26f87f9842fabe357ef2a7f8e936e7e8fda9460c002d4900a","title":"arXiv cs.AI: Researchers introduce Synthetic Hospital, a synthetic benchmark for clinical AI","argument":"The authors introduce Synthetic Hospital, an open, fully synthetic benchmark of longitudinal EHRs, designed to test whether AI models can track patient information across encounters. They argue that real EHR data is difficult to share openly and lacks verifiable ground truth: records show what clinicians documented, not necessarily everything that happened.\n\nSynthetic Hospital contains 1,268 patients and 5,602 encounters. Its diagnoses, findings and temporal relations are grounded in standard ontologies, with provenance linking them to public medical-education material. A simulated hospital record system provides access through interfaces that mirror real EHR infrastructure.\n\nIn a blinded review, physicians identified the benchmark’s records as synthetic or real at near-chance rates. Yet the authors report that even the best model misses roughly half of clinically relevant findings when summarizing a chart. That model matched the mean of seven physicians on a matched subset when reconstructing longitudinal problem lists, but scored below the best physician. The authors present these results as evidence that the benchmark is a difficult test of clinical AI performance.\n\nThe abstract does not establish how performance on this synthetic benchmark relates to performance in real clinical workflows.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract reports benchmark results but does not establish how performance on synthetic records predicts performance in real clinical workflows. The abstract does not describe the benchmark's coverage of patient populations or clinical settings; its generalizability beyond the reported evaluation is therefore unclear.","speaker":{"name":"Park, Christine, Chen, Valerie, Dettmers, Tim","roleAtSource":"Article author"},"source":{"title":"Synthetic Hospital: An Open, Verifiable, Physician-Validated Longitudinal EHR Benchmark","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2609.30027","publishedAt":"2026-09-24","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors introduce Synthetic Hospital as an open, fully synthetic benchmark for longitudinal EHRs, intended to address barriers to sharing real records and establishing verifiable ground truth.","excerpt":"We introduce Synthetic Hospital, an open, fully synthetic, fact-grounded longitudinal EHR benchmark that resolves the open sharing and verifiable ground truth barriers.","url":"https://arxiv.org/abs/2609.30027","relationship":"Source-stated"},{"text":"The benchmark contains 1,268 longitudinal patients and 5,602 encounters, grounded in ontologies and linked to public medical-education material.","excerpt":"it comprises 1,268 longitudinal patients and 5,602 encounters, where every diagnosis, finding, and temporal relation is grounded in standard ontologies","url":"https://arxiv.org/abs/2609.30027","relationship":"Source-stated"},{"text":"Physicians distinguished the benchmark's records from real patient charts at near-chance rates in a blinded review.","excerpt":"In a blinded review, physicians distinguished its records from real patient charts at near-chance rates (53%).","url":"https://arxiv.org/abs/2609.30027","relationship":"Source-stated"},{"text":"The best model matched the mean of seven physicians on a matched subset for reconstructing a longitudinal problem list, but fell below the best physician.","excerpt":"the best model reconstructs a patient's longitudinal problem list with a severity-weighted F1 of 0.73, level with the mean of seven physicians on a matched subset but well below the best of them (0.89)","url":"https://arxiv.org/abs/2609.30027","relationship":"Source-stated"},{"text":"The authors report that models miss roughly half of clinically relevant findings when summarizing charts.","excerpt":"misses roughly half of clinically relevant findings when summarizing a chart","url":"https://arxiv.org/abs/2609.30027","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2609.30027","checkedAt":"2026-11-14T05:36:12.482Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well does performance on Synthetic Hospital predict model performance on real patient records and in clinical workflows?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Researchers introduce Synthetic Hospital, a synthetic benchmark for clinical AI","summary":"The authors introduce Synthetic Hospital, an open, fully synthetic benchmark of longitudinal EHRs, designed to test whether AI models can track patient information across encounters. They argue that real EHR data is difficult to share openly and lacks verifiable ground truth: records show what clinicians documented, not necessarily everything that happened.\n\nSynthetic Hospital contains 1,268 patients and 5,602 encounters. Its diagnoses, findings and temporal relations are grounded in standard ontologies, with provenance linking them to public medical-education material. A simulated hospital record system provides access through interfaces that mirror real EHR infrastructure.\n\nIn a blinded review, physicians identified the benchmark’s records as synthetic or real at near-chance rates. Yet the authors report that even the best model misses roughly half of clinically relevant findings when summarizing a chart. That model matched the mean of seven physicians on a matched subset when reconstructing longitudinal problem lists, but scored below the best physician. The authors present these results as evidence that the benchmark is a difficult test of clinical AI performance.\n\nThe abstract does not establish how performance on this synthetic benchmark relates to performance in real clinical workflows.","question":"How well does performance on Synthetic Hospital predict model performance on real patient records and in clinical workflows?","claims":[{"text":"The authors introduce Synthetic Hospital as an open, fully synthetic benchmark for longitudinal EHRs, intended to address barriers to sharing real records and establishing verifiable ground truth.","excerpt":"We introduce Synthetic Hospital, an open, fully synthetic, fact-grounded longitudinal EHR benchmark that resolves the open sharing and verifiable ground truth barriers.","support":"source-stated"},{"text":"The benchmark contains 1,268 longitudinal patients and 5,602 encounters, grounded in ontologies and linked to public medical-education material.","excerpt":"it comprises 1,268 longitudinal patients and 5,602 encounters, where every diagnosis, finding, and temporal relation is grounded in standard ontologies","support":"source-stated"},{"text":"Physicians distinguished the benchmark's records from real patient charts at near-chance rates in a blinded review.","excerpt":"In a blinded review, physicians distinguished its records from real patient charts at near-chance rates (53%).","support":"source-stated"},{"text":"The best model matched the mean of seven physicians on a matched subset for reconstructing a longitudinal problem list, but fell below the best physician.","excerpt":"the best model reconstructs a patient's longitudinal problem list with a severity-weighted F1 of 0.73, level with the mean of seven physicians on a matched subset but well below the best of them (0.89)","support":"source-stated"},{"text":"The authors report that models miss roughly half of clinically relevant findings when summarizing charts.","excerpt":"misses roughly half of clinically relevant findings when summarizing a chart","support":"source-stated"}],"limitations":["The abstract reports benchmark results but does not establish how performance on synthetic records predicts performance in real clinical workflows.","The abstract does not describe the benchmark's coverage of patient populations or clinical settings; its generalizability beyond the reported evaluation is therefore unclear."],"mediaId":"1309a5a6b4f3c486936df729d284d21ec18f478b83b51bc32b54f1006602976c","correctionReason":null,"id":"d284d3acaf2c34b26f87f9842fabe357ef2a7f8e936e7e8fda9460c002d4900a","publicationId":"07cc7b09-ec20-45e0-8288-c732ce478df9","version":1,"sourceUrl":"https://arxiv.org/abs/2609.30027","sourceTitle":"Synthetic Hospital: An Open, Verifiable, Physician-Validated Longitudinal EHR Benchmark","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-09-24","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-09-25T07:40:35.728Z","createdAt":"2026-11-14T05:05:39.816Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"1309a5a6b4f3c486936df729d284d21ec18f478b83b51bc32b54f1006602976c","kind":"article","url":"https://arxiv.org/abs/2609.30027","sourceUrl":"https://arxiv.org/abs/2609.30027","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-30T21:31:38.127Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2609.30027","checkedAt":"2026-11-14T05:36:12.482Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"1309a5a6b4f3c486936df729d284d21ec18f478b83b51bc32b54f1006602976c","confidence":0.9,"provider":"typesafe","model":"jev-1.13.0","inputHash":"a1301baa018b33fa22bc49836395e54c0e1560ba150c375b0271e216f76d6037","decidedAt":"2026-10-30T21:31:38.972Z"},"provenance":{"textHash":"e351d1201e997647059a5b3e42ef66ec9a415484c9ae395e094c3d9ee25da52e","observationId":"0a2a28ce773e4370d3e29c27f3f6e47974c28d830f5a0d91556b0861a7d549dd","retrievedAt":"2026-10-30T21:31:38.023Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"de079b0a-3229-493f-863a-b8c28fdbc1d5"},"reviewer":{"model":"gpt-6-luna","runId":"7459ccff-d544-4323-8a0a-f3e74ed35e5a"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-14T05:05:39.816Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Park, Christine","url":null,"kind":"unknown"},{"name":"Chen, Valerie","url":null,"kind":"unknown"},{"name":"Dettmers, Tim","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Park, Christine","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Park, Christine","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2609.30027","locator":"head/meta[name=author|citation_author]"},"assertionId":"b8f4d1b456fb59c623e01ad3a266e45446f596b74a9598cc5d6a07f6cacebbe9:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-14T05:36:12.482Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b8f4d1b456fb59c623e01ad3a266e45446f596b74a9598cc5d6a07f6cacebbe9","sourceUrl":"https://arxiv.org/abs/2609.30027","contentSha256":"152e3848100da7d7ae6df7411215893b7b304e0227a8a7970e699583a8b56e2e","textHash":"e351d1201e997647059a5b3e42ef66ec9a415484c9ae395e094c3d9ee25da52e","observedAt":"2026-11-14T05:36:12.482Z"}},{"actor":{"name":"Chen, Valerie","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chen, Valerie","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2609.30027","locator":"head/meta[name=author|citation_author]"},"assertionId":"b8f4d1b456fb59c623e01ad3a266e45446f596b74a9598cc5d6a07f6cacebbe9:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-14T05:36:12.482Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b8f4d1b456fb59c623e01ad3a266e45446f596b74a9598cc5d6a07f6cacebbe9","sourceUrl":"https://arxiv.org/abs/2609.30027","contentSha256":"152e3848100da7d7ae6df7411215893b7b304e0227a8a7970e699583a8b56e2e","textHash":"e351d1201e997647059a5b3e42ef66ec9a415484c9ae395e094c3d9ee25da52e","observedAt":"2026-11-14T05:36:12.482Z"}},{"actor":{"name":"Dettmers, Tim","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Dettmers, Tim","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2609.30027","locator":"head/meta[name=author|citation_author]"},"assertionId":"b8f4d1b456fb59c623e01ad3a266e45446f596b74a9598cc5d6a07f6cacebbe9:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-14T05:36:12.482Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b8f4d1b456fb59c623e01ad3a266e45446f596b74a9598cc5d6a07f6cacebbe9","sourceUrl":"https://arxiv.org/abs/2609.30027","contentSha256":"152e3848100da7d7ae6df7411215893b7b304e0227a8a7970e699583a8b56e2e","textHash":"e351d1201e997647059a5b3e42ef66ec9a415484c9ae395e094c3d9ee25da52e","observedAt":"2026-11-14T05:36:12.482Z"}}],"participationCoverage":{"total":3,"returned":3,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2609.30027","snapshotId":"b8f4d1b456fb59c623e01ad3a266e45446f596b74a9598cc5d6a07f6cacebbe9","contentSha256":"152e3848100da7d7ae6df7411215893b7b304e0227a8a7970e699583a8b56e2e","textHash":"e351d1201e997647059a5b3e42ef66ec9a415484c9ae395e094c3d9ee25da52e","observedAt":"2026-11-14T05:36:12.482Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/d284d3acaf2c34b26f87f9842fabe357ef2a7f8e936e7e8fda9460c002d4900a/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-researchers-introduce-synthetic-hospital-a-d284d3ac","formats":{"html":"/readings/arxiv-cs-ai-researchers-introduce-synthetic-hospital-a-d284d3ac","markdown":"/readings/arxiv-cs-ai-researchers-introduce-synthetic-hospital-a-d284d3ac.md","json":"/readings/arxiv-cs-ai-researchers-introduce-synthetic-hospital-a-d284d3ac.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"d284d3acaf2c34b26f87f9842fabe357ef2a7f8e936e7e8fda9460c002d4900a","revision":"07cc7b09-ec20-45e0-8288-c732ce478df9","revisionKind":"publication-id","title":"arXiv cs.AI: Researchers introduce Synthetic Hospital, a synthetic benchmark for clinical AI","url":"https://escapemeridian.com/readings/arxiv-cs-ai-researchers-introduce-synthetic-hospital-a-d284d3ac"},"source":{"type":"source","id":"https://arxiv.org/abs/2609.30027","revision":"e351d1201e997647059a5b3e42ef66ec9a415484c9ae395e094c3d9ee25da52e","revisionKind":"sha256-source-text","title":"Synthetic Hospital: An Open, Verifiable, Physician-Validated Longitudinal EHR Benchmark","url":"https://arxiv.org/abs/2609.30027"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"d284d3acaf2c34b26f87f9842fabe357ef2a7f8e936e7e8fda9460c002d4900a","title":"arXiv cs.AI: Researchers introduce Synthetic Hospital, a synthetic benchmark for clinical AI","argument":"The authors introduce Synthetic Hospital, an open, fully synthetic benchmark of longitudinal EHRs, designed to test whether AI models can track patient information across encounters. They argue that real EHR data is difficult to share openly and lacks verifiable ground truth: records show what clinicians documented, not necessarily everything that happened.\n\nSynthetic Hospital contains 1,268 patients and 5,602 encounters. Its diagnoses, findings and temporal relations are grounded in standard ontologies, with provenance linking them to public medical-education material. A simulated hospital record system provides access through interfaces that mirror real EHR infrastructure.\n\nIn a blinded review, physicians identified the benchmark’s records as synthetic or real at near-chance rates. Yet the authors report that even the best model misses roughly half of clinically relevant findings when summarizing a chart. That model matched the mean of seven physicians on a matched subset when reconstructing longitudinal problem lists, but scored below the best physician. The authors present these results as evidence that the benchmark is a difficult test of clinical AI performance.\n\nThe abstract does not establish how performance on this synthetic benchmark relates to performance in real clinical workflows.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract reports benchmark results but does not establish how performance on synthetic records predicts performance in real clinical workflows. The abstract does not describe the benchmark's coverage of patient populations or clinical settings; its generalizability beyond the reported evaluation is therefore unclear.","speaker":{"name":"Park, Christine, Chen, Valerie, Dettmers, Tim","roleAtSource":"Article author"},"source":{"title":"Synthetic Hospital: An Open, Verifiable, Physician-Validated Longitudinal EHR Benchmark","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2609.30027","publishedAt":"2026-09-24","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors introduce Synthetic Hospital as an open, fully synthetic benchmark for longitudinal EHRs, intended to address barriers to sharing real records and establishing verifiable ground truth.","excerpt":"We introduce Synthetic Hospital, an open, fully synthetic, fact-grounded longitudinal EHR benchmark that resolves the open sharing and verifiable ground truth barriers.","url":"https://arxiv.org/abs/2609.30027","relationship":"Source-stated"},{"text":"The benchmark contains 1,268 longitudinal patients and 5,602 encounters, grounded in ontologies and linked to public medical-education material.","excerpt":"it comprises 1,268 longitudinal patients and 5,602 encounters, where every diagnosis, finding, and temporal relation is grounded in standard ontologies","url":"https://arxiv.org/abs/2609.30027","relationship":"Source-stated"},{"text":"Physicians distinguished the benchmark's records from real patient charts at near-chance rates in a blinded review.","excerpt":"In a blinded review, physicians distinguished its records from real patient charts at near-chance rates (53%).","url":"https://arxiv.org/abs/2609.30027","relationship":"Source-stated"},{"text":"The best model matched the mean of seven physicians on a matched subset for reconstructing a longitudinal problem list, but fell below the best physician.","excerpt":"the best model reconstructs a patient's longitudinal problem list with a severity-weighted F1 of 0.73, level with the mean of seven physicians on a matched subset but well below the best of them (0.89)","url":"https://arxiv.org/abs/2609.30027","relationship":"Source-stated"},{"text":"The authors report that models miss roughly half of clinically relevant findings when summarizing charts.","excerpt":"misses roughly half of clinically relevant findings when summarizing a chart","url":"https://arxiv.org/abs/2609.30027","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2609.30027","checkedAt":"2026-11-14T05:36:12.482Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well does performance on Synthetic Hospital predict model performance on real patient records and in clinical workflows?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Researchers introduce Synthetic Hospital, a synthetic benchmark for clinical AI","summary":"The authors introduce Synthetic Hospital, an open, fully synthetic benchmark of longitudinal EHRs, designed to test whether AI models can track patient information across encounters. They argue that real EHR data is difficult to share openly and lacks verifiable ground truth: records show what clinicians documented, not necessarily everything that happened.\n\nSynthetic Hospital contains 1,268 patients and 5,602 encounters. Its diagnoses, findings and temporal relations are grounded in standard ontologies, with provenance linking them to public medical-education material. A simulated hospital record system provides access through interfaces that mirror real EHR infrastructure.\n\nIn a blinded review, physicians identified the benchmark’s records as synthetic or real at near-chance rates. Yet the authors report that even the best model misses roughly half of clinically relevant findings when summarizing a chart. That model matched the mean of seven physicians on a matched subset when reconstructing longitudinal problem lists, but scored below the best physician. The authors present these results as evidence that the benchmark is a difficult test of clinical AI performance.\n\nThe abstract does not establish how performance on this synthetic benchmark relates to performance in real clinical workflows.","question":"How well does performance on Synthetic Hospital predict model performance on real patient records and in clinical workflows?","claims":[{"text":"The authors introduce Synthetic Hospital as an open, fully synthetic benchmark for longitudinal EHRs, intended to address barriers to sharing real records and establishing verifiable ground truth.","excerpt":"We introduce Synthetic Hospital, an open, fully synthetic, fact-grounded longitudinal EHR benchmark that resolves the open sharing and verifiable ground truth barriers.","support":"source-stated"},{"text":"The benchmark contains 1,268 longitudinal patients and 5,602 encounters, grounded in ontologies and linked to public medical-education material.","excerpt":"it comprises 1,268 longitudinal patients and 5,602 encounters, where every diagnosis, finding, and temporal relation is grounded in standard ontologies","support":"source-stated"},{"text":"Physicians distinguished the benchmark's records from real patient charts at near-chance rates in a blinded review.","excerpt":"In a blinded review, physicians distinguished its records from real patient charts at near-chance rates (53%).","support":"source-stated"},{"text":"The best model matched the mean of seven physicians on a matched subset for reconstructing a longitudinal problem list, but fell below the best physician.","excerpt":"the best model reconstructs a patient's longitudinal problem list with a severity-weighted F1 of 0.73, level with the mean of seven physicians on a matched subset but well below the best of them (0.89)","support":"source-stated"},{"text":"The authors report that models miss roughly half of clinically relevant findings when summarizing charts.","excerpt":"misses roughly half of clinically relevant findings when summarizing a chart","support":"source-stated"}],"limitations":["The abstract reports benchmark results but does not establish how performance on synthetic records predicts performance in real clinical workflows.","The abstract does not describe the benchmark's coverage of patient populations or clinical settings; its generalizability beyond the reported evaluation is therefore unclear."],"mediaId":"1309a5a6b4f3c486936df729d284d21ec18f478b83b51bc32b54f1006602976c","correctionReason":null,"id":"d284d3acaf2c34b26f87f9842fabe357ef2a7f8e936e7e8fda9460c002d4900a","publicationId":"07cc7b09-ec20-45e0-8288-c732ce478df9","version":1,"sourceUrl":"https://arxiv.org/abs/2609.30027","sourceTitle":"Synthetic Hospital: An Open, Verifiable, Physician-Validated Longitudinal EHR Benchmark","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-09-24","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-09-25T07:40:35.728Z","createdAt":"2026-11-14T05:05:39.816Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"1309a5a6b4f3c486936df729d284d21ec18f478b83b51bc32b54f1006602976c","kind":"article","url":"https://arxiv.org/abs/2609.30027","sourceUrl":"https://arxiv.org/abs/2609.30027","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-30T21:31:38.127Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2609.30027","checkedAt":"2026-11-14T05:36:12.482Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"1309a5a6b4f3c486936df729d284d21ec18f478b83b51bc32b54f1006602976c","confidence":0.9,"provider":"typesafe","model":"jev-1.13.0","inputHash":"a1301baa018b33fa22bc49836395e54c0e1560ba150c375b0271e216f76d6037","decidedAt":"2026-10-30T21:31:38.972Z"},"provenance":{"textHash":"e351d1201e997647059a5b3e42ef66ec9a415484c9ae395e094c3d9ee25da52e","observationId":"0a2a28ce773e4370d3e29c27f3f6e47974c28d830f5a0d91556b0861a7d549dd","retrievedAt":"2026-10-30T21:31:38.023Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"de079b0a-3229-493f-863a-b8c28fdbc1d5"},"reviewer":{"model":"gpt-6-luna","runId":"7459ccff-d544-4323-8a0a-f3e74ed35e5a"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-14T05:05:39.816Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Park, Christine","url":null,"kind":"unknown"},{"name":"Chen, Valerie","url":null,"kind":"unknown"},{"name":"Dettmers, Tim","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Park, Christine","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Park, Christine","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2609.30027","locator":"head/meta[name=author|citation_author]"},"assertionId":"b8f4d1b456fb59c623e01ad3a266e45446f596b74a9598cc5d6a07f6cacebbe9:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-14T05:36:12.482Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b8f4d1b456fb59c623e01ad3a266e45446f596b74a9598cc5d6a07f6cacebbe9","sourceUrl":"https://arxiv.org/abs/2609.30027","contentSha256":"152e3848100da7d7ae6df7411215893b7b304e0227a8a7970e699583a8b56e2e","textHash":"e351d1201e997647059a5b3e42ef66ec9a415484c9ae395e094c3d9ee25da52e","observedAt":"2026-11-14T05:36:12.482Z"}},{"actor":{"name":"Chen, Valerie","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chen, Valerie","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2609.30027","locator":"head/meta[name=author|citation_author]"},"assertionId":"b8f4d1b456fb59c623e01ad3a266e45446f596b74a9598cc5d6a07f6cacebbe9:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-14T05:36:12.482Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b8f4d1b456fb59c623e01ad3a266e45446f596b74a9598cc5d6a07f6cacebbe9","sourceUrl":"https://arxiv.org/abs/2609.30027","contentSha256":"152e3848100da7d7ae6df7411215893b7b304e0227a8a7970e699583a8b56e2e","textHash":"e351d1201e997647059a5b3e42ef66ec9a415484c9ae395e094c3d9ee25da52e","observedAt":"2026-11-14T05:36:12.482Z"}},{"actor":{"name":"Dettmers, Tim","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Dettmers, Tim","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2609.30027","locator":"head/meta[name=author|citation_author]"},"assertionId":"b8f4d1b456fb59c623e01ad3a266e45446f596b74a9598cc5d6a07f6cacebbe9:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-14T05:36:12.482Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b8f4d1b456fb59c623e01ad3a266e45446f596b74a9598cc5d6a07f6cacebbe9","sourceUrl":"https://arxiv.org/abs/2609.30027","contentSha256":"152e3848100da7d7ae6df7411215893b7b304e0227a8a7970e699583a8b56e2e","textHash":"e351d1201e997647059a5b3e42ef66ec9a415484c9ae395e094c3d9ee25da52e","observedAt":"2026-11-14T05:36:12.482Z"}}],"participationCoverage":{"total":3,"returned":3,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2609.30027","snapshotId":"b8f4d1b456fb59c623e01ad3a266e45446f596b74a9598cc5d6a07f6cacebbe9","contentSha256":"152e3848100da7d7ae6df7411215893b7b304e0227a8a7970e699583a8b56e2e","textHash":"e351d1201e997647059a5b3e42ef66ec9a415484c9ae395e094c3d9ee25da52e","observedAt":"2026-11-14T05:36:12.482Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/d284d3acaf2c34b26f87f9842fabe357ef2a7f8e936e7e8fda9460c002d4900a/source"}}}],"audits":[{"publicationId":"07cc7b09-ec20-45e0-8288-c732ce478df9","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft attributes the benchmark, its design rationale and its results to the paper's authors (Park, Chen, Dettmers) on arXiv cs.AI. The 'difficult test' conclusion is correctly framed as the authors' own presentation, not as an established fact.","excerpt":"Authors:Christine Park, Valerie Chen, Tim Dettmers"},{"dimension":"summary","status":"uncertain","explanation":"Two gaps affect a lay reader. First, 'EHR' is never expanded to 'electronic health record', though it is the central term; add the expansion or a tooltip. Second, the draft omits the authors' framing of why this matters: frontier models are rarely used clinically because realistic benchmarks are scarce. One clause can restore it. It also softens 'well below the best' to 'below' and drops 'none approaches ceiling' and the 0.73 vs 0.89 gap. Smallest repair: restore 'well below' and note the result covers 10 models.","excerpt":"Frontier language models are rarely used in clinical workflows because the realistic, longitudinal benchmarks needed to develop them are scarce."},{"dimension":"date","status":"pass","explanation":"originalPublished 2026-09-24 matches the v1 submission date, not the later v2 revision (27 Oct) or the feed date (29 Oct).","excerpt":"[Submitted on 24 Sep 2026 (v1), last revised 27 Oct 2026 (this version, v2)]"},{"dimension":"support","status":"pass","explanation":"Counts, grounding, blinded review and model-versus-physician comparisons match the abstract. Claim 5 says 'models miss roughly half', but the abstract attributes this to the best model. This is a minor broadening; the summary body states it correctly. The limitations and the question are appropriately conditional and do not overstate real-world reliability.","excerpt":"misses roughly half of clinically relevant findings when summarizing a chart"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified arXiv abstract page for this paper. It is the direct original source.","excerpt":null}],"createdAt":"2026-11-14T05:05:39.816Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}