Upadhyay, Ankit K., Algasov, Aleksandr, Nepovinnykh, Ekaterina, Zolotarev, Fedor, Eerola, Tuomas, Kälviäinen, Heikki, Stewart, Charles V., Picek, Lukas · Nov 4, 2026
arXiv cs.AI: CounterFactual Retrieval for Evidence-Aware Individual Animal Identification
Markdown · JSON · Original source
The authors argue that high retrieval accuracy alone cannot show whether an animal-identification model recognizes the animal or relies on clues correlated with its identity, such as the background or silhouette. They introduce Foreground Retrieval (CFR), an evaluation protocol that compares the same query-gallery task across three views: the full image, the animal foreground alone, and a shortcut-only view with the animal removed. The resulting evidence profile is meant to show both how well a model retrieves matches and how much of its identity signal remains when the animal itself is absent. This matters because a strong score on original images may conceal reliance on shortcuts; CFR makes those different sources of signal separately measurable. The authors also report releasing around 0.5M masks for 34 datasets, along with code for mask generation and CFR evaluation. The abstract describes the protocol and its intended measurements, but does not report evaluation results showing how particular models perform under the three views.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 4, 2026 (2026-11-04).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-09T11:01:48.415Z. First observed: 2026-11-05T05:03:30.682Z. Retrieved: 2026-11-09T10:54:58.394Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The evidence is the paper’s page and abstract; it does not provide results showing how particular models perform under CFR. The abstract describes the shortcut-only view as measuring identity signal recoverable from background, or silhouette; it does not give further detail about how that view is constructed.
Open question
How do models’ retrieval results differ across the full-image, foreground-only, and shortcut-only views?
Source-stated
The authors say high retrieval accuracy does not establish whether a model relies on animal features or identity-correlated shortcuts.
high retrieval accuracy does not show whether a model used animal features or identity-correlated shortcuts
Source-stated
The authors introduce CFR, which evaluates the same query-gallery task using full-image, foreground-only, and shortcut-only views.
CFR evaluates the same query-gallery task under different views: full image, foreground-only, and shortcut-only.
Source-stated
The authors say the views measure original-image performance, retrieval supported by the foreground, and identity signal recoverable after removing the animal.
how well the model performs on the original images, how much of that performance remains when only the animal is visible, and how much identity signal remains recoverable when the animal is removed.
Source-stated
The authors report releasing around 0.5M masks for 34 datasets and code for mask generation and CFR evaluation.
We release around 0.5M masks for 34 datasets and code for mask generation and CFR evaluation.
Source and contributor context
Upadhyay, Ankit K., Algasov, Aleksandr, Nepovinnykh, Ekaterina, Zolotarev, Fedor, Eerola, Tuomas, Kälviäinen, Heikki, Stewart, Charles V., Picek, Lukas · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Counterfactual
An argument or scenario that considers what would have resulted if events had gone differently from how they actually did, such as if a policy had never been adopted; as an adjective, relating to this kind of thinking about what did not happen but could have.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 52090f56-21c8-4fc8-81c9-652a32a77a5c.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: passed by anthropic/claude-opus-5.5 on 2026-11-09T11:01:48.415Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 4bc60174e99ebb86d0ce6d71151fb8483e35a898a8721c8b222c7352c5dac891. Source text hash: 2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2.
Revision and source-check history
Version 1 · 2026-11-09T11:01:48.415Z
arXiv cs.AI: CounterFactual Retrieval for Evidence-Aware Individual Animal Identification
The authors argue that high retrieval accuracy alone cannot show whether an animal-identification model recognizes the animal or relies on clues correlated with its identity, such as the background or silhouette. They introduce Foreground Retrieval (CFR), an evaluation protocol that compares the same query-gallery task across three views: the full image, the animal foreground alone, and a shortcut-only view with the animal removed. The resulting evidence profile is meant to show both how well a model retrieves matches and how much of its identity signal remains when the animal itself is absent. This matters because a strong score on original images may conceal reliance on shortcuts; CFR makes those different sources of signal separately measurable. The authors also report releasing around 0.5M masks for 34 datasets, along with code for mask generation and CFR evaluation. The abstract describes the protocol and its intended measurements, but does not report evaluation results showing how particular models perform under the three views.
Original source
cs.AI · Article
Source details
Original source date: Nov 4, 2026 (2026-11-04).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-09T11:01:48.415Z. First observed: 2026-11-05T05:03:30.682Z. Retrieved: 2026-11-09T10:54:58.394Z.
Limits
The evidence is the paper’s page and abstract; it does not provide results showing how particular models perform under CFR. The abstract describes the shortcut-only view as measuring identity signal recoverable from background, or silhouette; it does not give further detail about how that view is constructed.
Open question
How do models’ retrieval results differ across the full-image, foreground-only, and shortcut-only views?
Source-stated
The authors say high retrieval accuracy does not establish whether a model relies on animal features or identity-correlated shortcuts.
high retrieval accuracy does not show whether a model used animal features or identity-correlated shortcuts
Source-stated
The authors introduce CFR, which evaluates the same query-gallery task using full-image, foreground-only, and shortcut-only views.
CFR evaluates the same query-gallery task under different views: full image, foreground-only, and shortcut-only.
Source-stated
The authors say the views measure original-image performance, retrieval supported by the foreground, and identity signal recoverable after removing the animal.
how well the model performs on the original images, how much of that performance remains when only the animal is visible, and how much identity signal remains recoverable when the animal is removed.
Source-stated
The authors report releasing around 0.5M masks for 34 datasets and code for mask generation and CFR evaluation.
We release around 0.5M masks for 34 datasets and code for mask generation and CFR evaluation.
Source and contributor context
Upadhyay, Ankit K., Algasov, Aleksandr, Nepovinnykh, Ekaterina, Zolotarev, Fedor, Eerola, Tuomas, Kälviäinen, Heikki, Stewart, Charles V., Picek, Lukas · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Counterfactual
An argument or scenario that considers what would have resulted if events had gone differently from how they actually did, such as if a policy had never been adopted; as an adjective, relating to this kind of thinking about what did not happen but could have.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 52090f56-21c8-4fc8-81c9-652a32a77a5c.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: passed by anthropic/claude-opus-5.5 on 2026-11-09T11:01:48.415Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 4bc60174e99ebb86d0ce6d71151fb8483e35a898a8721c8b222c7352c5dac891. Source text hash: 2787ce07b5fe41584887319883e8092e57a352a93ba264629cf57c562f6bb2b2.
passed · 2026-11-09T11:01:48.415Z · anthropic/claude-opus-5.5
Publication: 52090f56-21c8-4fc8-81c9-652a32a77a5c
attribution — pass: The paper's arguments and its release claims are attributed to the authors. The arXiv cs.AI publisher label matches the source page. No source assertion is presented as an established fact or as an Escape Meridian opinion.
We address this with Counterfactual Foreground Retrieval (CFR), an evidence-aware evaluation protocol.
summary — pass: The reading opens with the authors' argument and explains CFR's three views in plain terms. It states the significance the source supports: a high score may hide reliance on shortcuts. It also notes that the abstract gives no model results. The terms query-gallery and masks are kept exactly and remain usable in context. Tooltip entries for both would help non-specialist readers. The question is a genuine open issue that follows from the abstract.
This turns a retrieval score into an evidence profile
date — pass: The originalPublished value of 2026-11-04 matches the v1 submission date on arXiv. It is not the later feed date of 2026-11-05.
[Submitted on 4 Nov 2026]
support — pass: Each claim's excerpt is verbatim from the abstract and supports it. The significance sentence restates the authors' stated rationale and does not claim a demonstrated benefit. The limitations correctly note that the abstract reports no performance results.
shortcut-only view measure how much identity signal is recoverable from background, or silhouette
media — pass: The selected media is the verified direct link to the arXiv abstract page, which is the original source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
An argument or scenario that considers what would have resulted if events had gone differently from how they actually did, such as if a policy had never been adopted; as an adjective, relating to this kind of thinking about what did not happen but could have.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivAn argument or scenario that considers what would have resulted if events had gone differently from how they actually did, such as if a policy had never been adopted; as an adjective, relating to this kind of thinking about what did not happen but could have.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv