Wang, Yanchen, Aharon, Lenny, Zhu, Wangshu, Daruwalla, Kyle, Zhang, Linghua, Zou, Jiaru, Chettih, Selmaan, Hou, Helen, Paninski, Liam, Whiteway, Matthew R · Jun 1, 2026
arXiv q-bio.NC: BEAST3D learns 3D representations of animal behavior from multi-view video
Markdown · JSON · Original source
The authors of BEAST3D present a self-supervised framework for learning 3D visual representations from unlabeled, calibrated multi-view video of animals. The approach uses a vision transformer to predict 3D Gaussian splats, reconstructs held-out views through differentiable rendering, and segments the animal from the background. The authors say it can reconstruct 3D structure with as few as four views by using known camera parameters, addressing a constraint of laboratory recordings where dense overlapping viewpoints are seldom available. They report evaluations across four species and say the learned viewpoint-invariant features transfer to novel view synthesis, multi-view pose estimation, and neural encoding. These tasks respectively assess the representations through new views, provide keypoint trajectories used in behavioral analysis, and relate behavioral features to simultaneously recorded neural activity. Escape Meridian interpretation: If the reported transfer holds in lab settings, the framework could help researchers extract 3D behavior from sparse multi-view recordings without extensive manual pose annotation. The abstract does not establish how performance varies across species or experimental settings.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
q-bio.NC · Article
- BEAST3D: Animal behavioral analysis and neural encoding from multi-view video via Gaussian splatting
Source details
Original source date: Jun 1, 2026 (2026-06-01).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-08T20:04:13.619Z. First observed: 2026-11-06T05:00:40.417Z. Retrieved: 2026-11-08T20:03:24.150Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The supplied abstract does not report evaluation metrics or results broken down by species, task, or experimental setting. The potential value for researchers extracting 3D behavior from sparse recordings is an inference from the authors’ account of the method and its stated tasks.
Open question
How does BEAST3D’s performance vary across the four species and the three downstream tasks?
Source-stated
The authors introduce BEAST3D, a self-supervised pretraining framework that learns 3D visual representations from unlabeled, calibrated multi-view video.
a self-supervised pretraining framework that learns 3D visual representations from unlabeled, calibrated multi-view video.
Source-stated
BEAST3D predicts 3D Gaussian splats, reconstructs held-out views through differentiable rendering, and segments the animal from the background.
predict 3D Gaussian splats that reconstruct held-out views through differentiable rendering, while simultaneously segmenting the animal from the background.
Source-stated
The authors say BEAST3D reconstructs 3D structure with as few as four views by conditioning on known camera parameters.
BEAST3D reconstructs 3D structure with as few as four views by conditioning directly on known camera parameters
Source-stated
The authors report evaluation across four species and transfer to novel view synthesis, multi-view pose estimation, and neural encoding.
Through comprehensive evaluation across four species, we demonstrate that BEAST3D produces rich, viewpoint-invariant features that transfer effectively to three downstream tasks
Escape Meridian interpretation
The abstract does not specify how results compare by species or downstream task.
Through comprehensive evaluation across four species, we demonstrate that BEAST3D produces rich, viewpoint-invariant features that transfer effectively to three downstream tasks
Source and contributor context
Wang, Yanchen, Aharon, Lenny, Zhu, Wangshu, Daruwalla, Kyle, Zhang, Linghua, Zou, Jiaru, Chettih, Selmaan, Hou, Helen, Paninski, Liam, Whiteway, Matthew R · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Pre-training
A model's initial training on a large dataset, before further adaptation for particular uses.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: dcff2c20-6c8b-4981-85ae-02b4368e8f21.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: passed by anthropic/claude-opus-5.5 on 2026-11-08T20:04:13.619Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 56b1ab300bbb459a24eecf3cd78a335599d503dc2560cb9ae7ec437da20f8050. Source text hash: 81f1cbfe4e7c0f8a5247eca65cdc6dba34e678b6c71fa004382b8ba53f7079ff.
Revision and source-check history
Version 1 · 2026-11-08T20:04:13.619Z
arXiv q-bio.NC: BEAST3D learns 3D representations of animal behavior from multi-view video
The authors of BEAST3D present a self-supervised framework for learning 3D visual representations from unlabeled, calibrated multi-view video of animals. The approach uses a vision transformer to predict 3D Gaussian splats, reconstructs held-out views through differentiable rendering, and segments the animal from the background. The authors say it can reconstruct 3D structure with as few as four views by using known camera parameters, addressing a constraint of laboratory recordings where dense overlapping viewpoints are seldom available. They report evaluations across four species and say the learned viewpoint-invariant features transfer to novel view synthesis, multi-view pose estimation, and neural encoding. These tasks respectively assess the representations through new views, provide keypoint trajectories used in behavioral analysis, and relate behavioral features to simultaneously recorded neural activity. Escape Meridian interpretation: If the reported transfer holds in lab settings, the framework could help researchers extract 3D behavior from sparse multi-view recordings without extensive manual pose annotation. The abstract does not establish how performance varies across species or experimental settings.
Original source
q-bio.NC · Article
- BEAST3D: Animal behavioral analysis and neural encoding from multi-view video via Gaussian splatting
Source details
Original source date: Jun 1, 2026 (2026-06-01).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-08T20:04:13.619Z. First observed: 2026-11-06T05:00:40.417Z. Retrieved: 2026-11-08T20:03:24.150Z.
Limits
The supplied abstract does not report evaluation metrics or results broken down by species, task, or experimental setting. The potential value for researchers extracting 3D behavior from sparse recordings is an inference from the authors’ account of the method and its stated tasks.
Open question
How does BEAST3D’s performance vary across the four species and the three downstream tasks?
Source-stated
The authors introduce BEAST3D, a self-supervised pretraining framework that learns 3D visual representations from unlabeled, calibrated multi-view video.
a self-supervised pretraining framework that learns 3D visual representations from unlabeled, calibrated multi-view video.
Source-stated
BEAST3D predicts 3D Gaussian splats, reconstructs held-out views through differentiable rendering, and segments the animal from the background.
predict 3D Gaussian splats that reconstruct held-out views through differentiable rendering, while simultaneously segmenting the animal from the background.
Source-stated
The authors say BEAST3D reconstructs 3D structure with as few as four views by conditioning on known camera parameters.
BEAST3D reconstructs 3D structure with as few as four views by conditioning directly on known camera parameters
Source-stated
The authors report evaluation across four species and transfer to novel view synthesis, multi-view pose estimation, and neural encoding.
Through comprehensive evaluation across four species, we demonstrate that BEAST3D produces rich, viewpoint-invariant features that transfer effectively to three downstream tasks
Escape Meridian interpretation
The abstract does not specify how results compare by species or downstream task.
Through comprehensive evaluation across four species, we demonstrate that BEAST3D produces rich, viewpoint-invariant features that transfer effectively to three downstream tasks
Source and contributor context
Wang, Yanchen, Aharon, Lenny, Zhu, Wangshu, Daruwalla, Kyle, Zhang, Linghua, Zou, Jiaru, Chettih, Selmaan, Hou, Helen, Paninski, Liam, Whiteway, Matthew R · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Pre-training
A model's initial training on a large dataset, before further adaptation for particular uses.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: dcff2c20-6c8b-4981-85ae-02b4368e8f21.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: passed by anthropic/claude-opus-5.5 on 2026-11-08T20:04:13.619Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 56b1ab300bbb459a24eecf3cd78a335599d503dc2560cb9ae7ec437da20f8050. Source text hash: 81f1cbfe4e7c0f8a5247eca65cdc6dba34e678b6c71fa004382b8ba53f7079ff.
passed · 2026-11-08T20:04:13.619Z · anthropic/claude-opus-5.5
Publication: dcff2c20-6c8b-4981-85ae-02b4368e8f21
attribution — pass: The reading attributes the method and its results to the paper's authors with phrases such as 'The authors say' and 'They report.' It labels the Escape Meridian inference separately. The title correctly names the arXiv q-bio.NC listing.
Authors:Yanchen Wang, Lenny Aharon, Wangshu Zhu, Kyle Daruwalla, Linghua Zhang, Jiaru Zou, Selmaan Chettih, Helen Hou, Liam Paninski, Matthew R Whiteway
summary — pass: The summary faithfully conveys the abstract: self-supervised pretraining, Gaussian splats, held-out view reconstruction, segmentation, the four-view sparse setting, four species and three downstream tasks. It explains each task in plain terms. Technical terms are kept exactly, as the term-library tooltips policy requires. The question follows from a real gap in the abstract and is not leading.
Supervised pose estimation requires extensive manual annotation, while general-purpose 3D reconstruction models trained on generic scene datasets fail on the specialized imagery and sparse-view setting of laboratory experiments.
date — pass: originalPublished is 2026-06-01, which matches the v1 submission date. It is not the 5 Nov 2026 v2 revision or the November feed date.
Submitted on 1 Jun 2026 (v1), last revised 5 Nov 2026 (this version, v2)
support — pass: Each claim matches a verbatim excerpt from the abstract. The labeled interpretation is conditional ('If the reported transfer holds') and rests on the abstract's contrast with annotation-heavy supervised pose estimation. The stated limitations correctly note that the abstract gives no per-species or per-task metrics.
BEAST3D reconstructs 3D structure with as few as four views by conditioning directly on known camera parameters
media — pass: The selected media is the verified arXiv abstract page for this paper, which is the direct original source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A model's initial training on a large dataset, before further adaptation for particular uses.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA model's initial training on a large dataset, before further adaptation for particular uses.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv