Rayeed, S M, Ma, Qian, Stewart, Charles V., Ma, Yao · Nov 3, 2026
arXiv cs.AI: Bio-VQA tests how finely vision-language models see biology
Markdown · JSON · Original source
Authors S M Rayeed, Qian Ma, Charles V. Stewart and Yao Ma introduce Bio-VQA, a for testing vision-language models (VLMs) on biological images. It spans hierarchical taxonomic reasoning, fine-grained attribute grounding, quantitative spatial reasoning and individual re-identification: identifying an organism, its traits and location, and whether it has appeared before. The benchmark contains 1.86M questions over 217K images from 11 public datasets, and uses graded scoring so near-misses count for more than distant errors. In evaluations of 18 , the authors report that general visual capabilities do not transfer well to biological organisms. The best model counted animals exactly in 41.7% of images containing 2 to 10 individuals, less than half its accuracy on everyday objects at the same counts. Taxonomic accuracy fell from 0.72 at phylum to 0.12 at scientific name, while scaling helped mostly at coarse ranks. On trait size measurement, 15 models did no better than an image-blind baseline; under adversarial conditions, 17 fell below chance at re-identification. The authors hope Bio-VQA becomes a standard test of how well VLM capabilities transfer to biology. The abstract reports benchmark results; how they relate to performance in biodiversity monitoring remains unclear.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 3, 2026 (2026-11-03).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-10T01:53:54.691Z. First observed: 2026-11-05T05:06:32.942Z. Retrieved: 2026-11-10T01:53:09.242Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The reported evaluations cover 18 ranging from 3.75B to 38.4B parameters; the abstract does not report results for other models. The source gives results, including re-identification under adversarial conditions, but does not report performance in biodiversity monitoring settings.
Open question
How do the models’ Bio-VQA results compare with their performance in biodiversity monitoring?
Source-stated
The authors present Bio-VQA as a benchmark spanning four aspects of biological visual understanding, with 1.86M questions over 217K images from 11 public datasets.
Bio-VQA contains 1.86M questions over 217K images from 11 public datasets
Source-stated
The authors report that the best evaluated model counted animals exactly in 41.7% of images containing 2 to 10 individuals, less than half its accuracy on everyday objects at the same counts.
the best model counts animals exactly on 41.7% of images with 2 to 10 individuals, less than half its accuracy on everyday objects at the same counts
Source-stated
The authors report taxonomic accuracy falling from 0.72 at phylum to 0.12 at scientific name, and say scaling helps mostly at coarse ranks.
Taxonomic accuracy falls to one sixth, from 0.72 at phylum to 0.12 at scientific name, and scaling helps mostly at coarse ranks.
Source-stated
The authors report that 15 of 18 models did no better than an image-blind baseline on trait size measurement, and 17 fell below chance at re-identification under adversarial conditions.
On trait size measurement, 15 of the 18 models do no better than an image-blind baseline that predicts one fixed number for every specimen, and on re-identification, 17 of the 18 models fall below chance under adversarial conditions.
Escape Meridian interpretation
The abstract reports benchmark results but does not provide a comparison with performance in biodiversity monitoring settings.
In biodiversity monitoring, a single image raises several questions: which taxon, how many, which trait, and whether the individual has been seen before.
Source and contributor context
Rayeed, S M, Ma, Qian, Stewart, Charles V., Ma, Yao · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Open weights
A model whose trained numbers are published so others can download, run and inspect it; the license and training data may still be restricted.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 9f05e99e-1587-4343-8185-287ebaeeaa69.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-10T01:53:54.691Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: a087b8ffe9a2c2223abcf10e0449086d18203ef0a4082d7c096fb94199d88c73. Source text hash: 141fec236cc4bfcc5e0a59a203968ea75fc06d65019b2223d3b3e1d569eb2c3d.
Revision and source-check history
Version 1 · 2026-11-10T01:53:54.691Z
arXiv cs.AI: Bio-VQA tests how finely vision-language models see biology
Authors S M Rayeed, Qian Ma, Charles V. Stewart and Yao Ma introduce Bio-VQA, a for testing vision-language models (VLMs) on biological images. It spans hierarchical taxonomic reasoning, fine-grained attribute grounding, quantitative spatial reasoning and individual re-identification: identifying an organism, its traits and location, and whether it has appeared before. The benchmark contains 1.86M questions over 217K images from 11 public datasets, and uses graded scoring so near-misses count for more than distant errors. In evaluations of 18 , the authors report that general visual capabilities do not transfer well to biological organisms. The best model counted animals exactly in 41.7% of images containing 2 to 10 individuals, less than half its accuracy on everyday objects at the same counts. Taxonomic accuracy fell from 0.72 at phylum to 0.12 at scientific name, while scaling helped mostly at coarse ranks. On trait size measurement, 15 models did no better than an image-blind baseline; under adversarial conditions, 17 fell below chance at re-identification. The authors hope Bio-VQA becomes a standard test of how well VLM capabilities transfer to biology. The abstract reports benchmark results; how they relate to performance in biodiversity monitoring remains unclear.
Original source
cs.AI · Article
Source details
Original source date: Nov 3, 2026 (2026-11-03).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-10T01:53:54.691Z. First observed: 2026-11-05T05:06:32.942Z. Retrieved: 2026-11-10T01:53:09.242Z.
Limits
The reported evaluations cover 18 ranging from 3.75B to 38.4B parameters; the abstract does not report results for other models. The source gives results, including re-identification under adversarial conditions, but does not report performance in biodiversity monitoring settings.
Open question
How do the models’ Bio-VQA results compare with their performance in biodiversity monitoring?
Source-stated
The authors present Bio-VQA as a benchmark spanning four aspects of biological visual understanding, with 1.86M questions over 217K images from 11 public datasets.
Bio-VQA contains 1.86M questions over 217K images from 11 public datasets
Source-stated
The authors report that the best evaluated model counted animals exactly in 41.7% of images containing 2 to 10 individuals, less than half its accuracy on everyday objects at the same counts.
the best model counts animals exactly on 41.7% of images with 2 to 10 individuals, less than half its accuracy on everyday objects at the same counts
Source-stated
The authors report taxonomic accuracy falling from 0.72 at phylum to 0.12 at scientific name, and say scaling helps mostly at coarse ranks.
Taxonomic accuracy falls to one sixth, from 0.72 at phylum to 0.12 at scientific name, and scaling helps mostly at coarse ranks.
Source-stated
The authors report that 15 of 18 models did no better than an image-blind baseline on trait size measurement, and 17 fell below chance at re-identification under adversarial conditions.
On trait size measurement, 15 of the 18 models do no better than an image-blind baseline that predicts one fixed number for every specimen, and on re-identification, 17 of the 18 models fall below chance under adversarial conditions.
Escape Meridian interpretation
The abstract reports benchmark results but does not provide a comparison with performance in biodiversity monitoring settings.
In biodiversity monitoring, a single image raises several questions: which taxon, how many, which trait, and whether the individual has been seen before.
Source and contributor context
Rayeed, S M, Ma, Qian, Stewart, Charles V., Ma, Yao · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Open weights
A model whose trained numbers are published so others can download, run and inspect it; the license and training data may still be restricted.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 9f05e99e-1587-4343-8185-287ebaeeaa69.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-10T01:53:54.691Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: a087b8ffe9a2c2223abcf10e0449086d18203ef0a4082d7c096fb94199d88c73. Source text hash: 141fec236cc4bfcc5e0a59a203968ea75fc06d65019b2223d3b3e1d569eb2c3d.
uncertain · 2026-11-10T01:53:54.691Z · anthropic/claude-opus-5.5
Publication: 9f05e99e-1587-4343-8185-287ebaeeaa69
attribution — pass: The benchmark and findings are attributed to the named authors (S M Rayeed, Qian Ma, Charles V. Stewart, Yao Ma) and framed as their reports. The paper is primarily cs.CV and cross-listed to cs.AI, so the arXiv cs.AI label is acceptable.
Authors:S M Rayeed, Qian Ma, Charles V. Stewart, Yao Ma
summary — uncertain: Mostly faithful, but it weakens the authors' force. (1) The source says capabilities "do not transfer"; the draft says "do not transfer well". Smallest repair: drop "well". (2) It omits two central results: the failures persist across a tenfold range of model size, and the widening gap to the specialist BioCLIP-2 (1.2x at class, 2x at scientific name). Smallest repair: add one sentence on each. (3) "Image-blind baseline" is not explained; the source defines it as predicting one fixed number for every specimen. Smallest repair: add that definition. (4) The gloss "location" for spatial reasoning drops the source's counting example ("how many").
These failures persist across a tenfold range of model size.
date — pass: The originalPublished date of 2026-11-03 matches the v1 submission date. The 2026-11-05 feed date is correctly not used.
[Submitted on 3 Nov 2026]
support — uncertain: The numeric claims match the abstract exactly, and the interpretation claim correctly notes that no real-world monitoring comparison is reported. However, the plain-language gloss of the four aspects as "its traits and location" is not supported. The source's own example lists counting ("how many") for the spatial aspect, not location. Smallest repair: change "location" to "how many there are".
which taxon, how many, which trait, and whether the individual has been seen before
media — pass: The selected media item is the verified direct link to the arXiv abstract page of this paper, so it is the original source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA model whose trained numbers are published so others can download, run and inspect it; the license and training data may still be restricted.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA model whose trained numbers are published so others can download, run and inspect it; the license and training data may still be restricted.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA model whose trained numbers are published so others can download, run and inspect it; the license and training data may still be restricted.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA model whose trained numbers are published so others can download, run and inspect it; the license and training data may still be restricted.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition reference