# arXiv q-bio.NC: SOMA: A Benchmark for Fine-Grained Egocentric Behavior and Body-Motion Understanding [Canonical reading](https://escapemeridian.com/readings/arxiv-q-bio-nc-soma-a-benchmark-for-fine-grained-egocentric-6a70f124) The authors of SOMA introduce a benchmark for assessing whether multimodal large language models (MLLMs) can understand fine-grained body motion in egocentric video, where the viewer sees only part of the body. They say existing evaluations focus mainly on objects, scenes, and broad actions, leaving this ability poorly assessed. SOMA contains 1,632 human-verified questions spanning body configuration, motion dynamics, and temporal reasoning. On the benchmark, humans achieved 68.5% accuracy, while the strongest MLLM tested, Qwen3.6-27B, achieved 50.0% in zero-shot evaluation, meaning it was tested without task-specific examples. The authors report errors including misreading the wearer’s body, misjudging event timing, favoring the right hand, and under-counting repetitions. The authors also introduce aligned video, body motion, and language training data, along with a multimodal baseline that learns from these inputs together. The abstract does not report whether this training approach improves benchmark performance. Escape Meridian’s interpretation is that SOMA offers a way to examine specific body-motion skills, but its scores alone do not establish how models would perform when assisting people outside the evaluation. The authors say the benchmark, training data, and code will be released; the abstract does not provide a release date. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv q-bio.NC · Article Original source date: Oct 26, 2026 (2026-10-26). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-06T18:01:08.225Z. First observed: 2026-10-28T04:12:44.271Z. Retrieved: 2026-10-29T15:31:25.600Z. - [SOMA: A Benchmark for Fine-Grained Egocentric Behavior and Body-Motion Understanding](https://arxiv.org/abs/2610.36384) ## Limits The evidence is the paper’s abstract; it does not provide benchmark task details, evaluation procedures, or results for the introduced training dataset and multimodal baseline. The reported benchmark accuracies do not establish how models or people perform in real-world assistance settings. The authors say the benchmark, training data, and code will be released, but the abstract gives no release date. ## Open question Does training with SOMA’s aligned video, body motion, and language data improve performance on held-out egocentric video questions? ## Source-stated SOMA is a benchmark for fine-grained body-motion understanding from egocentric video, organized around three capability axes. > comprising 1,632 human-verified questions across three capability axes: body configuration, motion dynamics, and temporal reasoning. - [Supporting source](https://arxiv.org/abs/2610.36384) ## Source-stated In the reported evaluation, humans outperformed the strongest tested MLLM, which was evaluated in zero-shot conditions. > humans also find this task difficult from video alone (68.5% accuracy), yet clearly outperform the strongest MLLM (Qwen3.6-27B), which reaches 50.0% zero-shot accuracy. - [Supporting source](https://arxiv.org/abs/2610.36384) ## Source-stated The authors report several error patterns, including misreading the wearer's body and misjudging event timing. > MLLMs often misread the wearer's own body, misjudge events in time, and are prone to biases such as favoring the right hand or under-counting repetitions. - [Supporting source](https://arxiv.org/abs/2610.36384) ## Escape Meridian interpretation The authors introduce aligned training data and a multimodal baseline, but the abstract does not state whether the baseline improves performance. > we introduce a training dataset of aligned video, body motion, and language supervision, and a multimodal baseline that jointly learns from these modalities. - [Supporting source](https://arxiv.org/abs/2610.36384) ## Source and contributor context Tashkovska, Matea, Ouerghemi, Naël, Qi, Haozhe, Mathis, Alexander · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## Multimodal model A model that works with more than one kind of input or output, such as text, images and audio. - [Definition reference](https://developers.google.com/machine-learning/glossary#multimodal-model) ## Large language model A language model with many learned numerical settings, used to process and generate language. - [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model) ## Zero-shot Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot). - [Definition reference](https://developers.google.com/machine-learning/glossary#zero-shot-prompting) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 100821f7-0be1-4697-8d59-e5ec15e2b557. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-06T18:01:08.225Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: bde0bd5edf02d2c92141ac82fef2db0262615d07829acebbc2bee9347543b878. Source text hash: d5c6bb0955b1024741336ee0c9ea5ca34927a4e5ccf1bd69b46facd600dcaf01. ## Revision and source-check history ### Version 1 — 2026-11-06T18:01:08.225Z The authors of SOMA introduce a benchmark for assessing whether multimodal large language models (MLLMs) can understand fine-grained body motion in egocentric video, where the viewer sees only part of the body. They say existing evaluations focus mainly on objects, scenes, and broad actions, leaving this ability poorly assessed. SOMA contains 1,632 human-verified questions spanning body configuration, motion dynamics, and temporal reasoning. On the benchmark, humans achieved 68.5% accuracy, while the strongest MLLM tested, Qwen3.6-27B, achieved 50.0% in zero-shot evaluation, meaning it was tested without task-specific examples. The authors report errors including misreading the wearer’s body, misjudging event timing, favoring the right hand, and under-counting repetitions. The authors also introduce aligned video, body motion, and language training data, along with a multimodal baseline that learns from these inputs together. The abstract does not report whether this training approach improves benchmark performance. Escape Meridian’s interpretation is that SOMA offers a way to examine specific body-motion skills, but its scores alone do not establish how models would perform when assisting people outside the evaluation. The authors say the benchmark, training data, and code will be released; the abstract does not provide a release date. ## Original source arXiv q-bio.NC · Article Original source date: Oct 26, 2026 (2026-10-26). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-06T18:01:08.225Z. First observed: 2026-10-28T04:12:44.271Z. Retrieved: 2026-10-29T15:31:25.600Z. - [SOMA: A Benchmark for Fine-Grained Egocentric Behavior and Body-Motion Understanding](https://arxiv.org/abs/2610.36384) ## Limits The evidence is the paper’s abstract; it does not provide benchmark task details, evaluation procedures, or results for the introduced training dataset and multimodal baseline. The reported benchmark accuracies do not establish how models or people perform in real-world assistance settings. The authors say the benchmark, training data, and code will be released, but the abstract gives no release date. ## Open question Does training with SOMA’s aligned video, body motion, and language data improve performance on held-out egocentric video questions? ## Source-stated SOMA is a benchmark for fine-grained body-motion understanding from egocentric video, organized around three capability axes. > comprising 1,632 human-verified questions across three capability axes: body configuration, motion dynamics, and temporal reasoning. - [Supporting source](https://arxiv.org/abs/2610.36384) ## Source-stated In the reported evaluation, humans outperformed the strongest tested MLLM, which was evaluated in zero-shot conditions. > humans also find this task difficult from video alone (68.5% accuracy), yet clearly outperform the strongest MLLM (Qwen3.6-27B), which reaches 50.0% zero-shot accuracy. - [Supporting source](https://arxiv.org/abs/2610.36384) ## Source-stated The authors report several error patterns, including misreading the wearer's body and misjudging event timing. > MLLMs often misread the wearer's own body, misjudge events in time, and are prone to biases such as favoring the right hand or under-counting repetitions. - [Supporting source](https://arxiv.org/abs/2610.36384) ## Escape Meridian interpretation The authors introduce aligned training data and a multimodal baseline, but the abstract does not state whether the baseline improves performance. > we introduce a training dataset of aligned video, body motion, and language supervision, and a multimodal baseline that jointly learns from these modalities. - [Supporting source](https://arxiv.org/abs/2610.36384) ## Source and contributor context Tashkovska, Matea, Ouerghemi, Naël, Qi, Haozhe, Mathis, Alexander · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## Multimodal model A model that works with more than one kind of input or output, such as text, images and audio. - [Definition reference](https://developers.google.com/machine-learning/glossary#multimodal-model) ## Large language model A language model with many learned numerical settings, used to process and generate language. - [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model) ## Zero-shot Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot). - [Definition reference](https://developers.google.com/machine-learning/glossary#zero-shot-prompting) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 100821f7-0be1-4697-8d59-e5ec15e2b557. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-06T18:01:08.225Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: bde0bd5edf02d2c92141ac82fef2db0262615d07829acebbc2bee9347543b878. Source text hash: d5c6bb0955b1024741336ee0c9ea5ca34927a4e5ccf1bd69b46facd600dcaf01. ### passed — 2026-11-06T18:01:08.225Z — anthropic/claude-opus-5.5 Publication: 100821f7-0be1-4697-8d59-e5ec15e2b557 attribution — pass: Claims are attributed to the paper's authors, whether 'the authors say' or 'the authors report', and the interpretive sentence is labeled as Escape Meridian's interpretation. The 'arXiv q-bio.NC' title prefix matches the feed publisher; the paper's primary category is cs.CV, with a cross-listing in q-bio.NC. The authors are not named, but this does not misattribute anything. > Authors:Matea Tashkovska, Naël Ouerghemi, Haozhe Qi, Alexander Mathis summary — pass: The summary leads with what SOMA is and why the authors built it. It explains MLLM, egocentric video and zero-shot in plain language. It covers the three capability axes, the human and model scores, the error patterns and the training resources. It could have kept the source's note that humans also found the task difficult, but the 68.5% figure is preserved. The question follows from a real gap in the evidence. > This is especially challenging from the egocentric perspective, in which the body is only partially visible and motion must be inferred from occluded and temporally distributed cues. date — pass: The originalPublished date of 2026-10-26 matches the v1 submission date. The feed date of 2026-10-29 is correctly not used. > \[Submitted on 26 Oct 2026\] support — pass: The figures (1,632 questions, 37 models, 68.5% versus 50.0%, Qwen3.6-27B) and the error patterns match the abstract. The draft accurately notes that the abstract reports no results for the training dataset or baseline; the abstract states only an aim to narrow the gap. The interpretation that benchmark scores do not establish real-world assistance performance is labeled and hedged. The release of materials is reported as a stated intention. > To narrow the gap to human performance and support further progress, we introduce a training dataset of aligned video, body motion, and language supervision media — pass: The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/6a70f1248e43f44b80e871fafebbc678f23c6d16a68879d921ac33b9e70e91b9/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-q-bio-nc-soma-a-benchmark-for-fine-grained-egocentric-6a70f124.json)