Gurram, Bhaskar · Nov 8, 2026
Bhaskar Gurram’s arXiv paper tests whether medical vision-language models use the image
Markdown · JSON · Original source
Bhaskar Gurram argues that medical vision-language models can answer closed clinical questions from the wording alone, rather than from the image. His Evidence Framework compares lesion erasures with matched control edits and uses additional controls to distinguish visual discrimination from changes in the answer threshold. In the reported main test, nine claimed 41.1% to 61.6% of erased lesions; MedScope-4B claimed 9.6%. The paper says physician readers supported automated erasure in colonoscopy, but across all sources called a finding present on 54.7% of pooled erased reads. That result limits what unverified erasure can certify: an erased image does not always provide a reliable label for whether a finding was present. Across the tested training and system arms and decision policies, the authors report that apparent utility gains came from shifting the answer threshold, not improving held-out discrimination. They also report that retraining with pneumothorax patients in every stage found pneumothoraxes on new patients after an external-cohort failure. In Escape Meridian’s reading, these experiments distinguish a model’s answer tendency from its ability to discriminate visual evidence, but the reported results do not by themselves establish performance in clinical use.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 8, 2026 (2026-11-08).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-19T09:46:46.996Z. First observed: 2026-11-11T05:06:31.372Z. Retrieved: 2026-11-19T09:34:06.183Z.
Referenced by
Recorded citations in public readings. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The evidence is the abstract, which reports selected results but does not provide the full methods or results needed to assess the experiments in detail. The abstract says physician readers called a finding present on 54.7% of pooled erased reads across all sources; it does not identify the source-specific rates for those reads. Reported test results do not establish performance in clinical use.
Open question
How well do the framework’s findings on edits and held-out discrimination carry over to clinical images and decisions beyond the reported tests?
Source-stated
Gurram argues that medical VLMs may answer closed clinical questions based on the question rather than the image, and introduces a framework to test evidence sensitivity using matched counterfactual controls.
Medical vision-language models (VLMs) asked closed clinical questions ("Is there a polyp?") can score well by relying on the question rather than the image
Source-stated
On 507 main-test cases, nine frontier VLMs claimed 41.1% to 61.6% of erased lesions, while MedScope-4B claimed 9.6%.
Across 507 main-test cases (1,115 views), nine frontier VLMs claim 41.1% to 61.6% of erased lesions
Source-stated
Physician readers supported automated erasure in colonoscopy, but across all sources called a finding present on 54.7% of pooled erased reads, which the authors say limits what unverified erasure can certify.
but call a finding present on 54.7% of pooled erased reads across all sources, which bounds what unverified erasure can certify.
Source-stated
Across 12 pre-registered training or system arms and 270 screened decision policies, the authors report that apparent utility gains came from shifting the threshold rather than improving held-out discrimination.
every apparent utility gain comes from shifting the threshold rather than improving held-out discrimination
Source-stated
The authors report that retraining with pneumothorax patients in every stage found 53% of pneumothoraxes on new patients, after a 0/48 failure on an external cohort.
We also report a 0/48 pneumothorax failure on an external cohort; retraining with pneumothorax patients in every stage finds 53% of pneumothoraxes on new patients
Escape Meridian interpretation
The findings concern the paper’s reported tests; the abstract does not establish how the framework or model performs in clinical use.
Across 507 main-test cases (1,115 views), nine frontier VLMs claim 41.1% to 61.6% of erased lesions
Source and contributor context
Gurram, Bhaskar · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Counterfactual
An argument or scenario that considers what would have resulted if events had gone differently from how they actually did, such as if a policy had never been adopted; as an adjective, relating to this kind of thinking about what did not happen but could have.
Frontier model
One of the most capable AI models available at a given time; the set shifts as models improve.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: f0d7239d-0275-4d49-8d3f-f35ae266674b.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-19T09:46:46.996Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 1aa5fde5fc21750d9e7e3ed863c10bd183fbe26ffcc7ae2418d8edbba44f78d9. Source text hash: 0adedda269f00451b405370c1493814690bf60b105be1b951bf15278d898f6b9.
Revision and source-check history
Version 1 · 2026-11-19T09:46:46.996Z
Bhaskar Gurram’s arXiv paper tests whether medical vision-language models use the image
Bhaskar Gurram argues that medical vision-language models can answer closed clinical questions from the wording alone, rather than from the image. His Evidence Framework compares lesion erasures with matched control edits and uses additional controls to distinguish visual discrimination from changes in the answer threshold. In the reported main test, nine claimed 41.1% to 61.6% of erased lesions; MedScope-4B claimed 9.6%. The paper says physician readers supported automated erasure in colonoscopy, but across all sources called a finding present on 54.7% of pooled erased reads. That result limits what unverified erasure can certify: an erased image does not always provide a reliable label for whether a finding was present. Across the tested training and system arms and decision policies, the authors report that apparent utility gains came from shifting the answer threshold, not improving held-out discrimination. They also report that retraining with pneumothorax patients in every stage found pneumothoraxes on new patients after an external-cohort failure. In Escape Meridian’s reading, these experiments distinguish a model’s answer tendency from its ability to discriminate visual evidence, but the reported results do not by themselves establish performance in clinical use.
Original source
cs.AI · Article
Source details
Original source date: Nov 8, 2026 (2026-11-08).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-19T09:46:46.996Z. First observed: 2026-11-11T05:06:31.372Z. Retrieved: 2026-11-19T09:34:06.183Z.
Limits
The evidence is the abstract, which reports selected results but does not provide the full methods or results needed to assess the experiments in detail. The abstract says physician readers called a finding present on 54.7% of pooled erased reads across all sources; it does not identify the source-specific rates for those reads. Reported test results do not establish performance in clinical use.
Open question
How well do the framework’s findings on edits and held-out discrimination carry over to clinical images and decisions beyond the reported tests?
Source-stated
Gurram argues that medical VLMs may answer closed clinical questions based on the question rather than the image, and introduces a framework to test evidence sensitivity using matched counterfactual controls.
Medical vision-language models (VLMs) asked closed clinical questions ("Is there a polyp?") can score well by relying on the question rather than the image
Source-stated
On 507 main-test cases, nine frontier VLMs claimed 41.1% to 61.6% of erased lesions, while MedScope-4B claimed 9.6%.
Across 507 main-test cases (1,115 views), nine frontier VLMs claim 41.1% to 61.6% of erased lesions
Source-stated
Physician readers supported automated erasure in colonoscopy, but across all sources called a finding present on 54.7% of pooled erased reads, which the authors say limits what unverified erasure can certify.
but call a finding present on 54.7% of pooled erased reads across all sources, which bounds what unverified erasure can certify.
Source-stated
Across 12 pre-registered training or system arms and 270 screened decision policies, the authors report that apparent utility gains came from shifting the threshold rather than improving held-out discrimination.
every apparent utility gain comes from shifting the threshold rather than improving held-out discrimination
Source-stated
The authors report that retraining with pneumothorax patients in every stage found 53% of pneumothoraxes on new patients, after a 0/48 failure on an external cohort.
We also report a 0/48 pneumothorax failure on an external cohort; retraining with pneumothorax patients in every stage finds 53% of pneumothoraxes on new patients
Escape Meridian interpretation
The findings concern the paper’s reported tests; the abstract does not establish how the framework or model performs in clinical use.
Across 507 main-test cases (1,115 views), nine frontier VLMs claim 41.1% to 61.6% of erased lesions
Source and contributor context
Gurram, Bhaskar · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Counterfactual
An argument or scenario that considers what would have resulted if events had gone differently from how they actually did, such as if a policy had never been adopted; as an adjective, relating to this kind of thinking about what did not happen but could have.
Frontier model
One of the most capable AI models available at a given time; the set shifts as models improve.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: f0d7239d-0275-4d49-8d3f-f35ae266674b.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-19T09:46:46.996Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 1aa5fde5fc21750d9e7e3ed863c10bd183fbe26ffcc7ae2418d8edbba44f78d9. Source text hash: 0adedda269f00451b405370c1493814690bf60b105be1b951bf15278d898f6b9.
uncertain · 2026-11-19T09:46:46.996Z · anthropic/claude-opus-5.5
Publication: f0d7239d-0275-4d49-8d3f-f35ae266674b
attribution — pass: The paper is correctly attributed to Bhaskar Gurram, the sole listed author, on arXiv. The draft switches between 'Gurram' and 'the authors'. That is a minor inconsistency and does not misattribute any claim. The source's findings stay framed as reported results.
Authors:Bhaskar Gurram
summary — uncertain: Two gaps affect understanding. First, MedScope-4B is presented without saying what it is: per the abstract, a Qwen3.5-4B agent trained on automatically built counterfactual trajectories. Without that, the central 9.6% contrast is opaque. Second, 'claimed erased lesions', 'held-out discrimination' and 'answer threshold' are left unexplained for general readers. The pneumothorax sentence also drops the 53% figure, so 'found pneumothoraxes' may read as fuller recovery than reported. Smallest repair: identify MedScope-4B, gloss 'claim an erased lesion' as saying a removed lesion is still present, and restore the 53%.
MedScope-4B, a Qwen3.5-4B agent trained on automatically built counterfactual trajectories, claims 9.6%
date — pass: originalPublished is 2026-11-08, which matches the v1 submission date. It correctly ignores the 17 Nov v2 revision and the 19 Nov feed date.
Submitted on 8 Nov 2026 (v1), last revised 17 Nov 2026
support — pass: Each claim matches the abstract: the 507 cases, the 41.1-61.6% vs 9.6% claim rates, the 54.7% pooled physician reads, the threshold-only utility gains, and the 0/48 failure with 53% after retraining. The Escape Meridian interpretation is labeled and conditional. It does not overstate clinical performance.
every apparent utility gain comes from shifting the threshold rather than improving held-out discrimination
media — pass: The selected media is the verified direct arXiv abstract page for this paper. It is the most direct access to the source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
An argument or scenario that considers what would have resulted if events had gone differently from how they actually did, such as if a policy had never been adopted; as an adjective, relating to this kind of thinking about what did not happen but could have.
Definition referenceOne of the most capable AI models available at a given time; the set shifts as models improve.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivAn argument or scenario that considers what would have resulted if events had gone differently from how they actually did, such as if a policy had never been adopted; as an adjective, relating to this kind of thinking about what did not happen but could have.
Definition referenceAn argument or scenario that considers what would have resulted if events had gone differently from how they actually did, such as if a policy had never been adopted; as an adjective, relating to this kind of thinking about what did not happen but could have.
Definition referenceOne of the most capable AI models available at a given time; the set shifts as models improve.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivAn argument or scenario that considers what would have resulted if events had gone differently from how they actually did, such as if a policy had never been adopted; as an adjective, relating to this kind of thinking about what did not happen but could have.
Definition reference