{"id":"85cc31937d9e283573ab0866904eaaed2e85080b8a92961a7cfb8f198a5290a9","title":"arXiv cs.AI: Multimodal Fusion Methods for Whole-Slide Images and Clinical Data in Inflammatory Bowel Disease","argument":"The paper’s authors present a framework for comparing ways to combine histology from whole-slide images with clinical data when predicting remission outcomes for newly diagnosed inflammatory bowel disease patients. They say such methods are rarely compared under identical conditions across different clinical endpoints. Their framework tests 15 interchangeable fusion methods, using image and clinical representations with a shared output dimension and prediction head, except for decision-level methods. In a prospective cohort, the best method reached macro-F1 of 0.57–0.75 and outperformed models using either modality alone in four of six scenarios. The strongest result varied by outcome and input. The authors also measure image reliance by the drop in balanced accuracy when the slide embedding is removed: it tended to be highest for histological remission and lowest for endoscopic remission. Methods with similar accuracy could rely on slide images to very different degrees. That distinction matters to interpreting what the models use, but the abstract does not establish how these results would translate beyond the studied cohort.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract does not report the cohort size or results from cohorts beyond the prospective cohort studied. The reported macro-F1 range and comparisons concern the described prediction scenarios; the abstract does not establish performance in clinical use.","speaker":{"name":"Banerjee, Ankana, van der Giezen, Mark, Aasprong, Ole Gunnar, Janssen, Emiel A. M., Steinsbø, Øyvind, Grimstad, Tore, Engan, Kjersti","roleAtSource":"Article author"},"source":{"title":"Multimodal Fusion Methods for Whole-Slide Images and Clinical Data in Inflammatory Bowel Disease","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.05579","publishedAt":"2026-11-03","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors say comparisons of multimodal fusion methods across endpoints and under identical conditions are rare.","excerpt":"fusion methods are rarely compared under identical conditions and across different clinical endpoints.","url":"https://arxiv.org/abs/2611.05579","relationship":"Source-stated"},{"text":"The authors test 15 fusion methods in a modular framework, with a shared output dimension and prediction head except for decision-level methods.","excerpt":"fed into 15 interchangeable fusion methods with a shared output dimension and prediction head (except decision-level methods).","url":"https://arxiv.org/abs/2611.05579","relationship":"Source-stated"},{"text":"In a prospective cohort of newly diagnosed inflammatory bowel disease patients, the best fusion method reached macro-F1 of 0.57–0.75 and beat single-modality models in four of six scenarios.","excerpt":"The best fusion method reached macro-F1 of 0.57-0.75, outperforming both single-modality models in four of six scenarios","url":"https://arxiv.org/abs/2611.05579","relationship":"Source-stated"},{"text":"The authors report that image reliance tended to be highest for histological remission and lowest for endoscopic remission; methods with similar accuracy could rely on slide images to different degrees.","excerpt":"Image reliance, the drop in balanced accuracy when the slide embedding is removed, tended to follow the remission type - highest for histological and lowest for endoscopic remission; methods with similar accuracy relied on the slide to very different degrees.","url":"https://arxiv.org/abs/2611.05579","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.05579","checkedAt":"2026-11-10T01:54:10.863Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How would the reported performance and differences in image reliance hold up in cohorts beyond the prospective cohort studied?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Multimodal Fusion Methods for Whole-Slide Images and Clinical Data in Inflammatory Bowel Disease","summary":"The paper’s authors present a framework for comparing ways to combine histology from whole-slide images with clinical data when predicting remission outcomes for newly diagnosed inflammatory bowel disease patients. They say such methods are rarely compared under identical conditions across different clinical endpoints. Their framework tests 15 interchangeable fusion methods, using image and clinical representations with a shared output dimension and prediction head, except for decision-level methods. In a prospective cohort, the best method reached macro-F1 of 0.57–0.75 and outperformed models using either modality alone in four of six scenarios. The strongest result varied by outcome and input. The authors also measure image reliance by the drop in balanced accuracy when the slide embedding is removed: it tended to be highest for histological remission and lowest for endoscopic remission. Methods with similar accuracy could rely on slide images to very different degrees. That distinction matters to interpreting what the models use, but the abstract does not establish how these results would translate beyond the studied cohort.","question":"How would the reported performance and differences in image reliance hold up in cohorts beyond the prospective cohort studied?","claims":[{"text":"The authors say comparisons of multimodal fusion methods across endpoints and under identical conditions are rare.","excerpt":"fusion methods are rarely compared under identical conditions and across different clinical endpoints.","support":"source-stated"},{"text":"The authors test 15 fusion methods in a modular framework, with a shared output dimension and prediction head except for decision-level methods.","excerpt":"fed into 15 interchangeable fusion methods with a shared output dimension and prediction head (except decision-level methods).","support":"source-stated"},{"text":"In a prospective cohort of newly diagnosed inflammatory bowel disease patients, the best fusion method reached macro-F1 of 0.57–0.75 and beat single-modality models in four of six scenarios.","excerpt":"The best fusion method reached macro-F1 of 0.57-0.75, outperforming both single-modality models in four of six scenarios","support":"source-stated"},{"text":"The authors report that image reliance tended to be highest for histological remission and lowest for endoscopic remission; methods with similar accuracy could rely on slide images to different degrees.","excerpt":"Image reliance, the drop in balanced accuracy when the slide embedding is removed, tended to follow the remission type - highest for histological and lowest for endoscopic remission; methods with similar accuracy relied on the slide to very different degrees.","support":"source-stated"}],"limitations":["The abstract does not report the cohort size or results from cohorts beyond the prospective cohort studied.","The reported macro-F1 range and comparisons concern the described prediction scenarios; the abstract does not establish performance in clinical use."],"mediaId":"0de2744a384b908da1c1d2dc135d7af437984c3d785a11c0b618bd72c6729ca9","correctionReason":null,"id":"85cc31937d9e283573ab0866904eaaed2e85080b8a92961a7cfb8f198a5290a9","publicationId":"f4a236aa-67fc-4a43-8cfa-8caedc975cb7","version":1,"sourceUrl":"https://arxiv.org/abs/2611.05579","sourceTitle":"Multimodal Fusion Methods for Whole-Slide Images and Clinical Data in Inflammatory Bowel Disease","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-03","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-05T05:06:36.436Z","createdAt":"2026-11-10T01:38:10.065Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"0de2744a384b908da1c1d2dc135d7af437984c3d785a11c0b618bd72c6729ca9","kind":"article","url":"https://arxiv.org/abs/2611.05579","sourceUrl":"https://arxiv.org/abs/2611.05579","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-10T01:34:47.000Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.05579","checkedAt":"2026-11-10T01:54:10.863Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"0de2744a384b908da1c1d2dc135d7af437984c3d785a11c0b618bd72c6729ca9","confidence":0.66,"provider":"typesafe","model":"jev-1.13.0","inputHash":"77bd072ca583a56082691ed746b6f8d17be2b77b38fb9c3bd366ec113f074170","decidedAt":"2026-11-10T01:34:49.903Z"},"provenance":{"textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observationId":"b1083a7b29bf5af0d2f6616438fc4922ee9893367ccca51ba5923153c6d34c21","retrievedAt":"2026-11-10T01:34:46.517Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"5b79b004-0a13-4f6b-8d96-7434458accd1"},"reviewer":{"model":"gpt-6-luna","runId":"1e02be1f-e9a2-4d3f-8658-33c4723e558d"}},"audit":{"status":"passed","reviewedAt":"2026-11-10T01:38:10.065Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Banerjee, Ankana","url":null,"kind":"unknown"},{"name":"van der Giezen, Mark","url":null,"kind":"unknown"},{"name":"Aasprong, Ole Gunnar","url":null,"kind":"unknown"},{"name":"Janssen, Emiel A. M.","url":null,"kind":"unknown"},{"name":"Steinsbø, Øyvind","url":null,"kind":"unknown"},{"name":"Grimstad, Tore","url":null,"kind":"unknown"},{"name":"Engan, Kjersti","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Banerjee, Ankana","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Banerjee, Ankana","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.05579","locator":"head/meta[name=author|citation_author]"},"assertionId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T01:54:10.863Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c","sourceUrl":"https://arxiv.org/abs/2611.05579","contentSha256":"8179823d1fa8a3b636f73595e5c551dd052bb8d948adc422bde184b5cdb84605","textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observedAt":"2026-11-10T01:54:10.863Z"}},{"actor":{"name":"van der Giezen, Mark","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"van der Giezen, Mark","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.05579","locator":"head/meta[name=author|citation_author]"},"assertionId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T01:54:10.863Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c","sourceUrl":"https://arxiv.org/abs/2611.05579","contentSha256":"8179823d1fa8a3b636f73595e5c551dd052bb8d948adc422bde184b5cdb84605","textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observedAt":"2026-11-10T01:54:10.863Z"}},{"actor":{"name":"Aasprong, Ole Gunnar","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Aasprong, Ole Gunnar","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.05579","locator":"head/meta[name=author|citation_author]"},"assertionId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T01:54:10.863Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c","sourceUrl":"https://arxiv.org/abs/2611.05579","contentSha256":"8179823d1fa8a3b636f73595e5c551dd052bb8d948adc422bde184b5cdb84605","textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observedAt":"2026-11-10T01:54:10.863Z"}},{"actor":{"name":"Janssen, Emiel A. M.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Janssen, Emiel A. M.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.05579","locator":"head/meta[name=author|citation_author]"},"assertionId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T01:54:10.863Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c","sourceUrl":"https://arxiv.org/abs/2611.05579","contentSha256":"8179823d1fa8a3b636f73595e5c551dd052bb8d948adc422bde184b5cdb84605","textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observedAt":"2026-11-10T01:54:10.863Z"}},{"actor":{"name":"Steinsbø, Øyvind","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Steinsbø, Øyvind","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.05579","locator":"head/meta[name=author|citation_author]"},"assertionId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T01:54:10.863Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c","sourceUrl":"https://arxiv.org/abs/2611.05579","contentSha256":"8179823d1fa8a3b636f73595e5c551dd052bb8d948adc422bde184b5cdb84605","textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observedAt":"2026-11-10T01:54:10.863Z"}},{"actor":{"name":"Grimstad, Tore","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Grimstad, Tore","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.05579","locator":"head/meta[name=author|citation_author]"},"assertionId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T01:54:10.863Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c","sourceUrl":"https://arxiv.org/abs/2611.05579","contentSha256":"8179823d1fa8a3b636f73595e5c551dd052bb8d948adc422bde184b5cdb84605","textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observedAt":"2026-11-10T01:54:10.863Z"}},{"actor":{"name":"Engan, Kjersti","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Engan, Kjersti","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.05579","locator":"head/meta[name=author|citation_author]"},"assertionId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T01:54:10.863Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c","sourceUrl":"https://arxiv.org/abs/2611.05579","contentSha256":"8179823d1fa8a3b636f73595e5c551dd052bb8d948adc422bde184b5cdb84605","textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observedAt":"2026-11-10T01:54:10.863Z"}}],"participationCoverage":{"total":7,"returned":7,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.05579","snapshotId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c","contentSha256":"8179823d1fa8a3b636f73595e5c551dd052bb8d948adc422bde184b5cdb84605","textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observedAt":"2026-11-10T01:54:10.863Z","basis":"publisher-page-metadata","sourceLinks":47,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/85cc31937d9e283573ab0866904eaaed2e85080b8a92961a7cfb8f198a5290a9/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-multimodal-fusion-methods-for-whole-slide-images-85cc3193","formats":{"html":"/readings/arxiv-cs-ai-multimodal-fusion-methods-for-whole-slide-images-85cc3193","markdown":"/readings/arxiv-cs-ai-multimodal-fusion-methods-for-whole-slide-images-85cc3193.md","json":"/readings/arxiv-cs-ai-multimodal-fusion-methods-for-whole-slide-images-85cc3193.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-multimodal-model","name":"Multimodal model","explanation":"A model that works with more than one kind of input or output, such as text, images and audio.","referenceUrl":"https://developers.google.com/machine-learning/glossary#multimodal-model"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"85cc31937d9e283573ab0866904eaaed2e85080b8a92961a7cfb8f198a5290a9","revision":"f4a236aa-67fc-4a43-8cfa-8caedc975cb7","revisionKind":"publication-id","title":"arXiv cs.AI: Multimodal Fusion Methods for Whole-Slide Images and Clinical Data in Inflammatory Bowel Disease","url":"https://escapemeridian.com/readings/arxiv-cs-ai-multimodal-fusion-methods-for-whole-slide-images-85cc3193"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.05579","revision":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","revisionKind":"sha256-source-text","title":"Multimodal Fusion Methods for Whole-Slide Images and Clinical Data in Inflammatory Bowel Disease","url":"https://arxiv.org/abs/2611.05579"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"85cc31937d9e283573ab0866904eaaed2e85080b8a92961a7cfb8f198a5290a9","title":"arXiv cs.AI: Multimodal Fusion Methods for Whole-Slide Images and Clinical Data in Inflammatory Bowel Disease","argument":"The paper’s authors present a framework for comparing ways to combine histology from whole-slide images with clinical data when predicting remission outcomes for newly diagnosed inflammatory bowel disease patients. They say such methods are rarely compared under identical conditions across different clinical endpoints. Their framework tests 15 interchangeable fusion methods, using image and clinical representations with a shared output dimension and prediction head, except for decision-level methods. In a prospective cohort, the best method reached macro-F1 of 0.57–0.75 and outperformed models using either modality alone in four of six scenarios. The strongest result varied by outcome and input. The authors also measure image reliance by the drop in balanced accuracy when the slide embedding is removed: it tended to be highest for histological remission and lowest for endoscopic remission. Methods with similar accuracy could rely on slide images to very different degrees. That distinction matters to interpreting what the models use, but the abstract does not establish how these results would translate beyond the studied cohort.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract does not report the cohort size or results from cohorts beyond the prospective cohort studied. The reported macro-F1 range and comparisons concern the described prediction scenarios; the abstract does not establish performance in clinical use.","speaker":{"name":"Banerjee, Ankana, van der Giezen, Mark, Aasprong, Ole Gunnar, Janssen, Emiel A. M., Steinsbø, Øyvind, Grimstad, Tore, Engan, Kjersti","roleAtSource":"Article author"},"source":{"title":"Multimodal Fusion Methods for Whole-Slide Images and Clinical Data in Inflammatory Bowel Disease","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.05579","publishedAt":"2026-11-03","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors say comparisons of multimodal fusion methods across endpoints and under identical conditions are rare.","excerpt":"fusion methods are rarely compared under identical conditions and across different clinical endpoints.","url":"https://arxiv.org/abs/2611.05579","relationship":"Source-stated"},{"text":"The authors test 15 fusion methods in a modular framework, with a shared output dimension and prediction head except for decision-level methods.","excerpt":"fed into 15 interchangeable fusion methods with a shared output dimension and prediction head (except decision-level methods).","url":"https://arxiv.org/abs/2611.05579","relationship":"Source-stated"},{"text":"In a prospective cohort of newly diagnosed inflammatory bowel disease patients, the best fusion method reached macro-F1 of 0.57–0.75 and beat single-modality models in four of six scenarios.","excerpt":"The best fusion method reached macro-F1 of 0.57-0.75, outperforming both single-modality models in four of six scenarios","url":"https://arxiv.org/abs/2611.05579","relationship":"Source-stated"},{"text":"The authors report that image reliance tended to be highest for histological remission and lowest for endoscopic remission; methods with similar accuracy could rely on slide images to different degrees.","excerpt":"Image reliance, the drop in balanced accuracy when the slide embedding is removed, tended to follow the remission type - highest for histological and lowest for endoscopic remission; methods with similar accuracy relied on the slide to very different degrees.","url":"https://arxiv.org/abs/2611.05579","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.05579","checkedAt":"2026-11-10T01:54:10.863Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How would the reported performance and differences in image reliance hold up in cohorts beyond the prospective cohort studied?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Multimodal Fusion Methods for Whole-Slide Images and Clinical Data in Inflammatory Bowel Disease","summary":"The paper’s authors present a framework for comparing ways to combine histology from whole-slide images with clinical data when predicting remission outcomes for newly diagnosed inflammatory bowel disease patients. They say such methods are rarely compared under identical conditions across different clinical endpoints. Their framework tests 15 interchangeable fusion methods, using image and clinical representations with a shared output dimension and prediction head, except for decision-level methods. In a prospective cohort, the best method reached macro-F1 of 0.57–0.75 and outperformed models using either modality alone in four of six scenarios. The strongest result varied by outcome and input. The authors also measure image reliance by the drop in balanced accuracy when the slide embedding is removed: it tended to be highest for histological remission and lowest for endoscopic remission. Methods with similar accuracy could rely on slide images to very different degrees. That distinction matters to interpreting what the models use, but the abstract does not establish how these results would translate beyond the studied cohort.","question":"How would the reported performance and differences in image reliance hold up in cohorts beyond the prospective cohort studied?","claims":[{"text":"The authors say comparisons of multimodal fusion methods across endpoints and under identical conditions are rare.","excerpt":"fusion methods are rarely compared under identical conditions and across different clinical endpoints.","support":"source-stated"},{"text":"The authors test 15 fusion methods in a modular framework, with a shared output dimension and prediction head except for decision-level methods.","excerpt":"fed into 15 interchangeable fusion methods with a shared output dimension and prediction head (except decision-level methods).","support":"source-stated"},{"text":"In a prospective cohort of newly diagnosed inflammatory bowel disease patients, the best fusion method reached macro-F1 of 0.57–0.75 and beat single-modality models in four of six scenarios.","excerpt":"The best fusion method reached macro-F1 of 0.57-0.75, outperforming both single-modality models in four of six scenarios","support":"source-stated"},{"text":"The authors report that image reliance tended to be highest for histological remission and lowest for endoscopic remission; methods with similar accuracy could rely on slide images to different degrees.","excerpt":"Image reliance, the drop in balanced accuracy when the slide embedding is removed, tended to follow the remission type - highest for histological and lowest for endoscopic remission; methods with similar accuracy relied on the slide to very different degrees.","support":"source-stated"}],"limitations":["The abstract does not report the cohort size or results from cohorts beyond the prospective cohort studied.","The reported macro-F1 range and comparisons concern the described prediction scenarios; the abstract does not establish performance in clinical use."],"mediaId":"0de2744a384b908da1c1d2dc135d7af437984c3d785a11c0b618bd72c6729ca9","correctionReason":null,"id":"85cc31937d9e283573ab0866904eaaed2e85080b8a92961a7cfb8f198a5290a9","publicationId":"f4a236aa-67fc-4a43-8cfa-8caedc975cb7","version":1,"sourceUrl":"https://arxiv.org/abs/2611.05579","sourceTitle":"Multimodal Fusion Methods for Whole-Slide Images and Clinical Data in Inflammatory Bowel Disease","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-03","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-05T05:06:36.436Z","createdAt":"2026-11-10T01:38:10.065Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"0de2744a384b908da1c1d2dc135d7af437984c3d785a11c0b618bd72c6729ca9","kind":"article","url":"https://arxiv.org/abs/2611.05579","sourceUrl":"https://arxiv.org/abs/2611.05579","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-10T01:34:47.000Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.05579","checkedAt":"2026-11-10T01:54:10.863Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"0de2744a384b908da1c1d2dc135d7af437984c3d785a11c0b618bd72c6729ca9","confidence":0.66,"provider":"typesafe","model":"jev-1.13.0","inputHash":"77bd072ca583a56082691ed746b6f8d17be2b77b38fb9c3bd366ec113f074170","decidedAt":"2026-11-10T01:34:49.903Z"},"provenance":{"textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observationId":"b1083a7b29bf5af0d2f6616438fc4922ee9893367ccca51ba5923153c6d34c21","retrievedAt":"2026-11-10T01:34:46.517Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"5b79b004-0a13-4f6b-8d96-7434458accd1"},"reviewer":{"model":"gpt-6-luna","runId":"1e02be1f-e9a2-4d3f-8658-33c4723e558d"}},"audit":{"status":"passed","reviewedAt":"2026-11-10T01:38:10.065Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Banerjee, Ankana","url":null,"kind":"unknown"},{"name":"van der Giezen, Mark","url":null,"kind":"unknown"},{"name":"Aasprong, Ole Gunnar","url":null,"kind":"unknown"},{"name":"Janssen, Emiel A. M.","url":null,"kind":"unknown"},{"name":"Steinsbø, Øyvind","url":null,"kind":"unknown"},{"name":"Grimstad, Tore","url":null,"kind":"unknown"},{"name":"Engan, Kjersti","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Banerjee, Ankana","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Banerjee, Ankana","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.05579","locator":"head/meta[name=author|citation_author]"},"assertionId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T01:54:10.863Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c","sourceUrl":"https://arxiv.org/abs/2611.05579","contentSha256":"8179823d1fa8a3b636f73595e5c551dd052bb8d948adc422bde184b5cdb84605","textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observedAt":"2026-11-10T01:54:10.863Z"}},{"actor":{"name":"van der Giezen, Mark","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"van der Giezen, Mark","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.05579","locator":"head/meta[name=author|citation_author]"},"assertionId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T01:54:10.863Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c","sourceUrl":"https://arxiv.org/abs/2611.05579","contentSha256":"8179823d1fa8a3b636f73595e5c551dd052bb8d948adc422bde184b5cdb84605","textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observedAt":"2026-11-10T01:54:10.863Z"}},{"actor":{"name":"Aasprong, Ole Gunnar","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Aasprong, Ole Gunnar","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.05579","locator":"head/meta[name=author|citation_author]"},"assertionId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T01:54:10.863Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c","sourceUrl":"https://arxiv.org/abs/2611.05579","contentSha256":"8179823d1fa8a3b636f73595e5c551dd052bb8d948adc422bde184b5cdb84605","textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observedAt":"2026-11-10T01:54:10.863Z"}},{"actor":{"name":"Janssen, Emiel A. M.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Janssen, Emiel A. M.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.05579","locator":"head/meta[name=author|citation_author]"},"assertionId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T01:54:10.863Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c","sourceUrl":"https://arxiv.org/abs/2611.05579","contentSha256":"8179823d1fa8a3b636f73595e5c551dd052bb8d948adc422bde184b5cdb84605","textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observedAt":"2026-11-10T01:54:10.863Z"}},{"actor":{"name":"Steinsbø, Øyvind","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Steinsbø, Øyvind","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.05579","locator":"head/meta[name=author|citation_author]"},"assertionId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T01:54:10.863Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c","sourceUrl":"https://arxiv.org/abs/2611.05579","contentSha256":"8179823d1fa8a3b636f73595e5c551dd052bb8d948adc422bde184b5cdb84605","textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observedAt":"2026-11-10T01:54:10.863Z"}},{"actor":{"name":"Grimstad, Tore","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Grimstad, Tore","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.05579","locator":"head/meta[name=author|citation_author]"},"assertionId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T01:54:10.863Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c","sourceUrl":"https://arxiv.org/abs/2611.05579","contentSha256":"8179823d1fa8a3b636f73595e5c551dd052bb8d948adc422bde184b5cdb84605","textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observedAt":"2026-11-10T01:54:10.863Z"}},{"actor":{"name":"Engan, Kjersti","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Engan, Kjersti","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.05579","locator":"head/meta[name=author|citation_author]"},"assertionId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T01:54:10.863Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c","sourceUrl":"https://arxiv.org/abs/2611.05579","contentSha256":"8179823d1fa8a3b636f73595e5c551dd052bb8d948adc422bde184b5cdb84605","textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observedAt":"2026-11-10T01:54:10.863Z"}}],"participationCoverage":{"total":7,"returned":7,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.05579","snapshotId":"1116f391023e14bb3c26bd076a47be98d039ecb9262c0448a1e37e08022eb31c","contentSha256":"8179823d1fa8a3b636f73595e5c551dd052bb8d948adc422bde184b5cdb84605","textHash":"4930350563174b025076bde9f7cb5e8bd67d79261ac390daed40ed9d3e7db395","observedAt":"2026-11-10T01:54:10.863Z","basis":"publisher-page-metadata","sourceLinks":47,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/85cc31937d9e283573ab0866904eaaed2e85080b8a92961a7cfb8f198a5290a9/source"}}}],"audits":[{"publicationId":"f4a236aa-67fc-4a43-8cfa-8caedc975cb7","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading attributes the framework, comparisons and results to the paper's authors, and keeps them as reported findings rather than established facts. The arXiv listing names the authors and the Stavanger/Bergen/Greenwich affiliations. The paper's primary category is cs.CV, but it is cross-listed in cs.AI, so the 'arXiv cs.AI' publisher label is acceptable.","excerpt":"Authors:Ankana Banerjee (1), Mark van der Giezen (1, 2, 3), Ole Gunnar Aasprong (2), Emiel A. M. Janssen (1, 2), Øyvind Steinsbø (2, 4), Tore Grimstad (2, 4), Kjersti Engan (1)"},{"dimension":"summary","status":"pass","explanation":"The summary faithfully conveys the motivation, the 15-method framework, the macro-F1 range, the four-of-six result and the image-reliance finding, and it explains image reliance in plain terms. A lay reader can grasp the core idea: comparing ways to combine slide images and clinical data to predict IBD remission. Smallest fixes: add tooltips for macro-F1, embedding and decision-level methods, and attach 'shared output dimension and prediction head' to the fusion methods rather than to the representations, as the abstract does. None of these block understanding.","excerpt":"fed into 15 interchangeable fusion methods with a shared output dimension and prediction head (except decision-level methods)."},{"dimension":"date","status":"pass","explanation":"The originalPublished value, 2026-11-03, matches the v1 submission date on arXiv. The 2026-11-05 feed date is correctly not used.","excerpt":"[Submitted on 3 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim's excerpt is verbatim and supports the claim. The limitations are accurate: the abstract gives no cohort size and no external validation. The closing interpretation (similar accuracy with different slide reliance matters for understanding what models use) follows from the source's statement and is hedged. The question about other cohorts is a genuine open issue, not a leading claim.","excerpt":"methods with similar accuracy relied on the slide to very different degrees."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified arXiv abstract page for this paper, which is the direct original source.","excerpt":null}],"createdAt":"2026-11-10T01:38:10.065Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}