{"id":"7ca54fdef9804fef9b2ae8a315f4d313115e63ac398239d9eac2ecf13e514649","title":"arXiv cs.AI: CounterFactual Retrieval for Evidence-Aware Individual Animal Identification","argument":"The authors argue that high retrieval accuracy alone cannot show whether an animal-identification model recognizes the animal or relies on clues correlated with its identity, such as the background or silhouette. They introduce Counterfactual Foreground Retrieval (CFR), an evaluation protocol that compares the same query-gallery task across three views: the full image, the animal foreground alone, and a shortcut-only view with the animal removed. The resulting evidence profile is meant to show both how well a model retrieves matches and how much of its identity signal remains when the animal itself is absent. This matters because a strong score on original images may conceal reliance on shortcuts; CFR makes those different sources of signal separately measurable. The authors also report releasing around 0.5M masks for 34 datasets, along with code for mask generation and CFR evaluation. The abstract describes the protocol and its intended measurements, but does not report evaluation results showing how particular models perform under the three views.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence is the paper’s arXiv page and abstract; it does not provide results showing how particular models perform under CFR. The abstract describes the shortcut-only view as measuring identity signal recoverable from background, or silhouette; it does not give further detail about how that view is constructed.","speaker":{"name":"Upadhyay, Ankit K., Algasov, Aleksandr, Nepovinnykh, Ekaterina, Zolotarev, Fedor, Eerola, Tuomas, Kälviäinen, Heikki, Stewart, Charles V., Picek, Lukas","roleAtSource":"Article author"},"source":{"title":"CounterFactual Retrieval for Evidence-Aware Individual Animal Identification","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.06864","publishedAt":"2026-11-04","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors say high retrieval accuracy does not establish whether a model relies on animal features or identity-correlated shortcuts.","excerpt":"high retrieval accuracy does not show whether a model used animal features or identity-correlated shortcuts","url":"https://arxiv.org/abs/2611.06864","relationship":"Source-stated"},{"text":"The authors introduce CFR, which evaluates the same query-gallery task using full-image, foreground-only, and shortcut-only views.","excerpt":"CFR evaluates the same query-gallery task under different views: full image, foreground-only, and shortcut-only.","url":"https://arxiv.org/abs/2611.06864","relationship":"Source-stated"},{"text":"The authors say the views measure original-image performance, retrieval supported by the foreground, and identity signal recoverable after removing the animal.","excerpt":"how well the model performs on the original images, how much of that performance remains when only the animal is visible, and how much identity signal remains recoverable when the animal is removed.","url":"https://arxiv.org/abs/2611.06864","relationship":"Source-stated"},{"text":"The authors report releasing around 0.5M masks for 34 datasets and code for mask generation and CFR evaluation.","excerpt":"We release around 0.5M masks for 34 datasets and code for mask generation and CFR evaluation.","url":"https://arxiv.org/abs/2611.06864","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.06864","checkedAt":"2026-11-09T12:04:08.645Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How do models’ retrieval results differ across the full-image, foreground-only, and shortcut-only views?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: CounterFactual Retrieval for Evidence-Aware Individual Animal Identification","summary":"The authors argue that high retrieval accuracy alone cannot show whether an animal-identification model recognizes the animal or relies on clues correlated with its identity, such as the background or silhouette. They introduce Counterfactual Foreground Retrieval (CFR), an evaluation protocol that compares the same query-gallery task across three views: the full image, the animal foreground alone, and a shortcut-only view with the animal removed. The resulting evidence profile is meant to show both how well a model retrieves matches and how much of its identity signal remains when the animal itself is absent. This matters because a strong score on original images may conceal reliance on shortcuts; CFR makes those different sources of signal separately measurable. The authors also report releasing around 0.5M masks for 34 datasets, along with code for mask generation and CFR evaluation. The abstract describes the protocol and its intended measurements, but does not report evaluation results showing how particular models perform under the three views.","question":"How do models’ retrieval results differ across the full-image, foreground-only, and shortcut-only views?","claims":[{"text":"The authors say high retrieval accuracy does not establish whether a model relies on animal features or identity-correlated shortcuts.","excerpt":"high retrieval accuracy does not show whether a model used animal features or identity-correlated shortcuts","support":"source-stated"},{"text":"The authors introduce CFR, which evaluates the same query-gallery task using full-image, foreground-only, and shortcut-only views.","excerpt":"CFR evaluates the same query-gallery task under different views: full image, foreground-only, and shortcut-only.","support":"source-stated"},{"text":"The authors say the views measure original-image performance, retrieval supported by the foreground, and identity signal recoverable after removing the animal.","excerpt":"how well the model performs on the original images, how much of that performance remains when only the animal is visible, and how much identity signal remains recoverable when the animal is removed.","support":"source-stated"},{"text":"The authors report releasing around 0.5M masks for 34 datasets and code for mask generation and CFR evaluation.","excerpt":"We release around 0.5M masks for 34 datasets and code for mask generation and CFR evaluation.","support":"source-stated"}],"limitations":["The evidence is the paper’s arXiv page and abstract; it does not provide results showing how particular models perform under CFR.","The abstract describes the shortcut-only view as measuring identity signal recoverable from background, or silhouette; it does not give further detail about how that view is constructed."],"mediaId":"580052a06535789fb374a1ec3b10fc4403aa1b67639f98f19b3557b8b6555f79","correctionReason":null,"id":"7ca54fdef9804fef9b2ae8a315f4d313115e63ac398239d9eac2ecf13e514649","publicationId":"52090f56-21c8-4fc8-81c9-652a32a77a5c","version":1,"sourceUrl":"https://arxiv.org/abs/2611.06864","sourceTitle":"CounterFactual Retrieval for Evidence-Aware Individual Animal Identification","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-04","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-05T05:03:30.682Z","createdAt":"2026-11-09T11:01:48.415Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"580052a06535789fb374a1ec3b10fc4403aa1b67639f98f19b3557b8b6555f79","kind":"article","url":"https://arxiv.org/abs/2611.06864","sourceUrl":"https://arxiv.org/abs/2611.06864","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T10:54:58.496Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.06864","checkedAt":"2026-11-09T12:04:08.645Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"580052a06535789fb374a1ec3b10fc4403aa1b67639f98f19b3557b8b6555f79","confidence":0.75,"provider":"typesafe","model":"jev-1.13.0","inputHash":"bd7fba51a90a63add8f2bbe97125c96eca2d837fa6fa2cce7881495b3e274aa4","decidedAt":"2026-11-09T10:54:59.195Z"},"provenance":{"textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observationId":"4bc60174e99ebb86d0ce6d71151fb8483e35a898a8721c8b222c7352c5dac891","retrievedAt":"2026-11-09T10:54:58.394Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"54f7b4fa-5bf2-49f9-859c-b6f5f103755e"},"reviewer":{"model":"gpt-6-luna","runId":"5ac1c05e-cd0f-41f5-8abe-96566a2fc736"}},"audit":{"status":"passed","reviewedAt":"2026-11-09T11:01:48.415Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Upadhyay, Ankit K.","url":null,"kind":"unknown"},{"name":"Algasov, Aleksandr","url":null,"kind":"unknown"},{"name":"Nepovinnykh, Ekaterina","url":null,"kind":"unknown"},{"name":"Zolotarev, Fedor","url":null,"kind":"unknown"},{"name":"Eerola, Tuomas","url":null,"kind":"unknown"},{"name":"Kälviäinen, Heikki","url":null,"kind":"unknown"},{"name":"Stewart, Charles V.","url":null,"kind":"unknown"},{"name":"Picek, Lukas","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Upadhyay, Ankit K.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Upadhyay, Ankit K.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06864","locator":"head/meta[name=author|citation_author]"},"assertionId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:04:08.645Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","sourceUrl":"https://arxiv.org/abs/2611.06864","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z"}},{"actor":{"name":"Algasov, Aleksandr","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Algasov, Aleksandr","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06864","locator":"head/meta[name=author|citation_author]"},"assertionId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:04:08.645Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","sourceUrl":"https://arxiv.org/abs/2611.06864","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z"}},{"actor":{"name":"Nepovinnykh, Ekaterina","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Nepovinnykh, Ekaterina","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06864","locator":"head/meta[name=author|citation_author]"},"assertionId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:04:08.645Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","sourceUrl":"https://arxiv.org/abs/2611.06864","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z"}},{"actor":{"name":"Zolotarev, Fedor","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zolotarev, Fedor","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06864","locator":"head/meta[name=author|citation_author]"},"assertionId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:04:08.645Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","sourceUrl":"https://arxiv.org/abs/2611.06864","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z"}},{"actor":{"name":"Eerola, Tuomas","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Eerola, Tuomas","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06864","locator":"head/meta[name=author|citation_author]"},"assertionId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:04:08.645Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","sourceUrl":"https://arxiv.org/abs/2611.06864","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z"}},{"actor":{"name":"Kälviäinen, Heikki","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kälviäinen, Heikki","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06864","locator":"head/meta[name=author|citation_author]"},"assertionId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:04:08.645Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","sourceUrl":"https://arxiv.org/abs/2611.06864","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z"}},{"actor":{"name":"Stewart, Charles V.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Stewart, Charles V.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06864","locator":"head/meta[name=author|citation_author]"},"assertionId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:04:08.645Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","sourceUrl":"https://arxiv.org/abs/2611.06864","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z"}},{"actor":{"name":"Picek, Lukas","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Picek, Lukas","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06864","locator":"head/meta[name=author|citation_author]"},"assertionId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:04:08.645Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","sourceUrl":"https://arxiv.org/abs/2611.06864","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.06864","snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z","basis":"publisher-page-metadata","sourceLinks":48,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/7ca54fdef9804fef9b2ae8a315f4d313115e63ac398239d9eac2ecf13e514649/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-counterfactual-retrieval-for-evidence-aware-7ca54fde","formats":{"html":"/readings/arxiv-cs-ai-counterfactual-retrieval-for-evidence-aware-7ca54fde","markdown":"/readings/arxiv-cs-ai-counterfactual-retrieval-for-evidence-aware-7ca54fde.md","json":"/readings/arxiv-cs-ai-counterfactual-retrieval-for-evidence-aware-7ca54fde.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-counterfactual","name":"Counterfactual","explanation":"An argument or scenario that considers what would have resulted if events had gone differently from how they actually did, such as if a policy had never been adopted; as an adjective, relating to this kind of thinking about what did not happen but could have.","referenceUrl":"https://dictionary.cambridge.org/dictionary/english/counterfactual"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"7ca54fdef9804fef9b2ae8a315f4d313115e63ac398239d9eac2ecf13e514649","revision":"52090f56-21c8-4fc8-81c9-652a32a77a5c","revisionKind":"publication-id","title":"arXiv cs.AI: CounterFactual Retrieval for Evidence-Aware Individual Animal Identification","url":"https://escapemeridian.com/readings/arxiv-cs-ai-counterfactual-retrieval-for-evidence-aware-7ca54fde"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.06864","revision":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","revisionKind":"sha256-source-text","title":"CounterFactual Retrieval for Evidence-Aware Individual Animal Identification","url":"https://arxiv.org/abs/2611.06864"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"7ca54fdef9804fef9b2ae8a315f4d313115e63ac398239d9eac2ecf13e514649","title":"arXiv cs.AI: CounterFactual Retrieval for Evidence-Aware Individual Animal Identification","argument":"The authors argue that high retrieval accuracy alone cannot show whether an animal-identification model recognizes the animal or relies on clues correlated with its identity, such as the background or silhouette. They introduce Counterfactual Foreground Retrieval (CFR), an evaluation protocol that compares the same query-gallery task across three views: the full image, the animal foreground alone, and a shortcut-only view with the animal removed. The resulting evidence profile is meant to show both how well a model retrieves matches and how much of its identity signal remains when the animal itself is absent. This matters because a strong score on original images may conceal reliance on shortcuts; CFR makes those different sources of signal separately measurable. The authors also report releasing around 0.5M masks for 34 datasets, along with code for mask generation and CFR evaluation. The abstract describes the protocol and its intended measurements, but does not report evaluation results showing how particular models perform under the three views.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence is the paper’s arXiv page and abstract; it does not provide results showing how particular models perform under CFR. The abstract describes the shortcut-only view as measuring identity signal recoverable from background, or silhouette; it does not give further detail about how that view is constructed.","speaker":{"name":"Upadhyay, Ankit K., Algasov, Aleksandr, Nepovinnykh, Ekaterina, Zolotarev, Fedor, Eerola, Tuomas, Kälviäinen, Heikki, Stewart, Charles V., Picek, Lukas","roleAtSource":"Article author"},"source":{"title":"CounterFactual Retrieval for Evidence-Aware Individual Animal Identification","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.06864","publishedAt":"2026-11-04","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors say high retrieval accuracy does not establish whether a model relies on animal features or identity-correlated shortcuts.","excerpt":"high retrieval accuracy does not show whether a model used animal features or identity-correlated shortcuts","url":"https://arxiv.org/abs/2611.06864","relationship":"Source-stated"},{"text":"The authors introduce CFR, which evaluates the same query-gallery task using full-image, foreground-only, and shortcut-only views.","excerpt":"CFR evaluates the same query-gallery task under different views: full image, foreground-only, and shortcut-only.","url":"https://arxiv.org/abs/2611.06864","relationship":"Source-stated"},{"text":"The authors say the views measure original-image performance, retrieval supported by the foreground, and identity signal recoverable after removing the animal.","excerpt":"how well the model performs on the original images, how much of that performance remains when only the animal is visible, and how much identity signal remains recoverable when the animal is removed.","url":"https://arxiv.org/abs/2611.06864","relationship":"Source-stated"},{"text":"The authors report releasing around 0.5M masks for 34 datasets and code for mask generation and CFR evaluation.","excerpt":"We release around 0.5M masks for 34 datasets and code for mask generation and CFR evaluation.","url":"https://arxiv.org/abs/2611.06864","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.06864","checkedAt":"2026-11-09T12:04:08.645Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How do models’ retrieval results differ across the full-image, foreground-only, and shortcut-only views?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: CounterFactual Retrieval for Evidence-Aware Individual Animal Identification","summary":"The authors argue that high retrieval accuracy alone cannot show whether an animal-identification model recognizes the animal or relies on clues correlated with its identity, such as the background or silhouette. They introduce Counterfactual Foreground Retrieval (CFR), an evaluation protocol that compares the same query-gallery task across three views: the full image, the animal foreground alone, and a shortcut-only view with the animal removed. The resulting evidence profile is meant to show both how well a model retrieves matches and how much of its identity signal remains when the animal itself is absent. This matters because a strong score on original images may conceal reliance on shortcuts; CFR makes those different sources of signal separately measurable. The authors also report releasing around 0.5M masks for 34 datasets, along with code for mask generation and CFR evaluation. The abstract describes the protocol and its intended measurements, but does not report evaluation results showing how particular models perform under the three views.","question":"How do models’ retrieval results differ across the full-image, foreground-only, and shortcut-only views?","claims":[{"text":"The authors say high retrieval accuracy does not establish whether a model relies on animal features or identity-correlated shortcuts.","excerpt":"high retrieval accuracy does not show whether a model used animal features or identity-correlated shortcuts","support":"source-stated"},{"text":"The authors introduce CFR, which evaluates the same query-gallery task using full-image, foreground-only, and shortcut-only views.","excerpt":"CFR evaluates the same query-gallery task under different views: full image, foreground-only, and shortcut-only.","support":"source-stated"},{"text":"The authors say the views measure original-image performance, retrieval supported by the foreground, and identity signal recoverable after removing the animal.","excerpt":"how well the model performs on the original images, how much of that performance remains when only the animal is visible, and how much identity signal remains recoverable when the animal is removed.","support":"source-stated"},{"text":"The authors report releasing around 0.5M masks for 34 datasets and code for mask generation and CFR evaluation.","excerpt":"We release around 0.5M masks for 34 datasets and code for mask generation and CFR evaluation.","support":"source-stated"}],"limitations":["The evidence is the paper’s arXiv page and abstract; it does not provide results showing how particular models perform under CFR.","The abstract describes the shortcut-only view as measuring identity signal recoverable from background, or silhouette; it does not give further detail about how that view is constructed."],"mediaId":"580052a06535789fb374a1ec3b10fc4403aa1b67639f98f19b3557b8b6555f79","correctionReason":null,"id":"7ca54fdef9804fef9b2ae8a315f4d313115e63ac398239d9eac2ecf13e514649","publicationId":"52090f56-21c8-4fc8-81c9-652a32a77a5c","version":1,"sourceUrl":"https://arxiv.org/abs/2611.06864","sourceTitle":"CounterFactual Retrieval for Evidence-Aware Individual Animal Identification","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-04","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-05T05:03:30.682Z","createdAt":"2026-11-09T11:01:48.415Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"580052a06535789fb374a1ec3b10fc4403aa1b67639f98f19b3557b8b6555f79","kind":"article","url":"https://arxiv.org/abs/2611.06864","sourceUrl":"https://arxiv.org/abs/2611.06864","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T10:54:58.496Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.06864","checkedAt":"2026-11-09T12:04:08.645Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"580052a06535789fb374a1ec3b10fc4403aa1b67639f98f19b3557b8b6555f79","confidence":0.75,"provider":"typesafe","model":"jev-1.13.0","inputHash":"bd7fba51a90a63add8f2bbe97125c96eca2d837fa6fa2cce7881495b3e274aa4","decidedAt":"2026-11-09T10:54:59.195Z"},"provenance":{"textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observationId":"4bc60174e99ebb86d0ce6d71151fb8483e35a898a8721c8b222c7352c5dac891","retrievedAt":"2026-11-09T10:54:58.394Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"54f7b4fa-5bf2-49f9-859c-b6f5f103755e"},"reviewer":{"model":"gpt-6-luna","runId":"5ac1c05e-cd0f-41f5-8abe-96566a2fc736"}},"audit":{"status":"passed","reviewedAt":"2026-11-09T11:01:48.415Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Upadhyay, Ankit K.","url":null,"kind":"unknown"},{"name":"Algasov, Aleksandr","url":null,"kind":"unknown"},{"name":"Nepovinnykh, Ekaterina","url":null,"kind":"unknown"},{"name":"Zolotarev, Fedor","url":null,"kind":"unknown"},{"name":"Eerola, Tuomas","url":null,"kind":"unknown"},{"name":"Kälviäinen, Heikki","url":null,"kind":"unknown"},{"name":"Stewart, Charles V.","url":null,"kind":"unknown"},{"name":"Picek, Lukas","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Upadhyay, Ankit K.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Upadhyay, Ankit K.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06864","locator":"head/meta[name=author|citation_author]"},"assertionId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:04:08.645Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","sourceUrl":"https://arxiv.org/abs/2611.06864","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z"}},{"actor":{"name":"Algasov, Aleksandr","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Algasov, Aleksandr","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06864","locator":"head/meta[name=author|citation_author]"},"assertionId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:04:08.645Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","sourceUrl":"https://arxiv.org/abs/2611.06864","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z"}},{"actor":{"name":"Nepovinnykh, Ekaterina","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Nepovinnykh, Ekaterina","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06864","locator":"head/meta[name=author|citation_author]"},"assertionId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:04:08.645Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","sourceUrl":"https://arxiv.org/abs/2611.06864","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z"}},{"actor":{"name":"Zolotarev, Fedor","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zolotarev, Fedor","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06864","locator":"head/meta[name=author|citation_author]"},"assertionId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:04:08.645Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","sourceUrl":"https://arxiv.org/abs/2611.06864","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z"}},{"actor":{"name":"Eerola, Tuomas","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Eerola, Tuomas","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06864","locator":"head/meta[name=author|citation_author]"},"assertionId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:04:08.645Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","sourceUrl":"https://arxiv.org/abs/2611.06864","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z"}},{"actor":{"name":"Kälviäinen, Heikki","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kälviäinen, Heikki","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06864","locator":"head/meta[name=author|citation_author]"},"assertionId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:04:08.645Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","sourceUrl":"https://arxiv.org/abs/2611.06864","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z"}},{"actor":{"name":"Stewart, Charles V.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Stewart, Charles V.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06864","locator":"head/meta[name=author|citation_author]"},"assertionId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:04:08.645Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","sourceUrl":"https://arxiv.org/abs/2611.06864","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z"}},{"actor":{"name":"Picek, Lukas","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Picek, Lukas","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06864","locator":"head/meta[name=author|citation_author]"},"assertionId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:04:08.645Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","sourceUrl":"https://arxiv.org/abs/2611.06864","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.06864","snapshotId":"fbe47c1ec3587ed67543e439d7b90bd0b28c6dac6a9d5a737a07e097f71a1f59","contentSha256":"33a90a388c1804d6cb585e9712eec6f256a2fbe24bbd241c8cfca90f70a13dce","textHash":"2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2","observedAt":"2026-11-09T12:04:08.645Z","basis":"publisher-page-metadata","sourceLinks":48,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/7ca54fdef9804fef9b2ae8a315f4d313115e63ac398239d9eac2ecf13e514649/source"}}}],"audits":[{"publicationId":"52090f56-21c8-4fc8-81c9-652a32a77a5c","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The paper's arguments and its release claims are attributed to the authors. The arXiv cs.AI publisher label matches the source page. No source assertion is presented as an established fact or as an Escape Meridian opinion.","excerpt":"We address this with Counterfactual Foreground Retrieval (CFR), an evidence-aware evaluation protocol."},{"dimension":"summary","status":"pass","explanation":"The reading opens with the authors' argument and explains CFR's three views in plain terms. It states the significance the source supports: a high score may hide reliance on shortcuts. It also notes that the abstract gives no model results. The terms query-gallery and masks are kept exactly and remain usable in context. Tooltip entries for both would help non-specialist readers. The question is a genuine open issue that follows from the abstract.","excerpt":"This turns a retrieval score into an evidence profile"},{"dimension":"date","status":"pass","explanation":"The originalPublished value of 2026-11-04 matches the v1 submission date on arXiv. It is not the later feed date of 2026-11-05.","excerpt":"[Submitted on 4 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim's excerpt is verbatim from the abstract and supports it. The significance sentence restates the authors' stated rationale and does not claim a demonstrated benefit. The limitations correctly note that the abstract reports no performance results.","excerpt":"shortcut-only view measure how much identity signal is recoverable from background, or silhouette"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page, which is the original source.","excerpt":null}],"createdAt":"2026-11-09T11:01:48.415Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}