{"id":"65d1bfa9ea36b4bf42184f0e2c30693671c5d1d116a04a12b8cd48934c74589e","title":"arXiv cs.AI: CoMPAS3D: A Dataset and Benchmark for Interactive Motion","argument":"The authors of CoMPAS3D argue that interactive motion systems need evaluation that can judge not only how bodies move, but whether their movements make sense within a shared vocabulary. They propose partner salsa as a test domain: dancers respond to one another in real time, using recognizable moves and community-validated judging criteria. The paper introduces a motion-capture dataset of improvised partner salsa and a benchmark for move classification, proficiency estimation, and follower generation. Its measures combine motion quality, objective measures of whether moves are legible and appropriate to a dancer’s proficiency, and expert judgments of timing, musicality, technique, difficulty, partnering, and originality. The authors report that fine-tuned vision-language models perform well on ground-truth sequences and correlate with subjective expert judgments. When they apply their objective measures to Duolando and InterGen, the authors find a large gap between ground-truth and generated dances; expert evaluations across six dimensions corroborate that result. The work’s central argument is that judging interactive motion requires attention to meaning and suitability, not just movement patterns. Its evidence comes from salsa data and these reported evaluations; how well the measures and findings extend beyond that setting remains open.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The available evidence is the arXiv abstract; it does not give details of the evaluation methods or numerical results behind the reported performance, correlations, or gap. The reported benchmark and comparison concern improvised partner salsa and the named systems; the abstract does not establish how far the findings generalize beyond them.","speaker":{"name":"Burkanova, Bermet, Etesam, Yasaman, Yazdian, Payam Jome, Evans, Trinity, Zhang, Chuxuan, Stanley, Zoe, Tuttösí, Paige, Lim, Angelica","roleAtSource":"Article author"},"source":{"title":"CoMPAS3D: A Dataset and Benchmark for Interactive Motion","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2507.19684","publishedAt":"2025-07-25","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors argue that existing interactive-motion evaluations do not assess whether generated responses are valid or appropriate within a shared movement vocabulary.","excerpt":"do not assess whether generated reactive motions are valid or appropriate within a shared movement vocabulary","url":"https://arxiv.org/abs/2507.19684","relationship":"Source-stated"},{"text":"The paper presents improvised partner salsa as an interactive evaluation domain with a move vocabulary and community-validated judging criteria.","excerpt":"Salsa is interactive, dyadic, and governed by a move vocabulary and community-validated judging criteria","url":"https://arxiv.org/abs/2507.19684","relationship":"Source-stated"},{"text":"CoMPAS3D combines motion-capture data, objective metrics, and six competition-based subjective dimensions.","excerpt":"a motion capture dataset of improvised partner salsa dance and an evaluation framework covering kinematic quality, two objective metrics (move legibility and proficiency appropriateness), and six competition-based subjective dimensions","url":"https://arxiv.org/abs/2507.19684","relationship":"Source-stated"},{"text":"The authors report that fine-tuned vision-language models perform well on ground-truth sequences and correlate with subjective expert judgments.","excerpt":"Fine-tuned vision-language models perform well on ground-truth sequences and correlate with subjective expert judgments","url":"https://arxiv.org/abs/2507.19684","relationship":"Source-stated"},{"text":"Applied to Duolando and InterGen, the objective metrics show a large gap between ground-truth and generated dances, which expert evaluations corroborate.","excerpt":"our objective metrics reveal a large gap between ground-truth and generated dances, corroborated by expert human evaluations across six judging dimensions.","url":"https://arxiv.org/abs/2507.19684","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2507.19684","checkedAt":"2026-11-09T03:34:09.169Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well do the reported model performance and correlations with expert judgments hold beyond the ground-truth sequences and salsa benchmark described in the abstract?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: CoMPAS3D: A Dataset and Benchmark for Interactive Motion","summary":"The authors of CoMPAS3D argue that interactive motion systems need evaluation that can judge not only how bodies move, but whether their movements make sense within a shared vocabulary. They propose partner salsa as a test domain: dancers respond to one another in real time, using recognizable moves and community-validated judging criteria. The paper introduces a motion-capture dataset of improvised partner salsa and a benchmark for move classification, proficiency estimation, and follower generation. Its measures combine motion quality, objective measures of whether moves are legible and appropriate to a dancer’s proficiency, and expert judgments of timing, musicality, technique, difficulty, partnering, and originality. The authors report that fine-tuned vision-language models perform well on ground-truth sequences and correlate with subjective expert judgments. When they apply their objective measures to Duolando and InterGen, the authors find a large gap between ground-truth and generated dances; expert evaluations across six dimensions corroborate that result. The work’s central argument is that judging interactive motion requires attention to meaning and suitability, not just movement patterns. Its evidence comes from salsa data and these reported evaluations; how well the measures and findings extend beyond that setting remains open.","question":"How well do the reported model performance and correlations with expert judgments hold beyond the ground-truth sequences and salsa benchmark described in the abstract?","claims":[{"text":"The authors argue that existing interactive-motion evaluations do not assess whether generated responses are valid or appropriate within a shared movement vocabulary.","excerpt":"do not assess whether generated reactive motions are valid or appropriate within a shared movement vocabulary","support":"source-stated"},{"text":"The paper presents improvised partner salsa as an interactive evaluation domain with a move vocabulary and community-validated judging criteria.","excerpt":"Salsa is interactive, dyadic, and governed by a move vocabulary and community-validated judging criteria","support":"source-stated"},{"text":"CoMPAS3D combines motion-capture data, objective metrics, and six competition-based subjective dimensions.","excerpt":"a motion capture dataset of improvised partner salsa dance and an evaluation framework covering kinematic quality, two objective metrics (move legibility and proficiency appropriateness), and six competition-based subjective dimensions","support":"source-stated"},{"text":"The authors report that fine-tuned vision-language models perform well on ground-truth sequences and correlate with subjective expert judgments.","excerpt":"Fine-tuned vision-language models perform well on ground-truth sequences and correlate with subjective expert judgments","support":"source-stated"},{"text":"Applied to Duolando and InterGen, the objective metrics show a large gap between ground-truth and generated dances, which expert evaluations corroborate.","excerpt":"our objective metrics reveal a large gap between ground-truth and generated dances, corroborated by expert human evaluations across six judging dimensions.","support":"source-stated"}],"limitations":["The available evidence is the arXiv abstract; it does not give details of the evaluation methods or numerical results behind the reported performance, correlations, or gap.","The reported benchmark and comparison concern improvised partner salsa and the named systems; the abstract does not establish how far the findings generalize beyond them."],"mediaId":"d69220e97d2d7aa980609560374099c1fefdfe3959c6a5ae909a321a04f7a7cf","correctionReason":null,"id":"65d1bfa9ea36b4bf42184f0e2c30693671c5d1d116a04a12b8cd48934c74589e","publicationId":"eb378053-ccfa-4555-8e4e-9f27cffd7f68","version":1,"sourceUrl":"https://arxiv.org/abs/2507.19684","sourceTitle":"CoMPAS3D: A Dataset and Benchmark for Interactive Motion","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2025-07-25","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-06T05:12:42.956Z","createdAt":"2026-11-09T03:02:19.654Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"d69220e97d2d7aa980609560374099c1fefdfe3959c6a5ae909a321a04f7a7cf","kind":"article","url":"https://arxiv.org/abs/2507.19684","sourceUrl":"https://arxiv.org/abs/2507.19684","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T03:01:23.576Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2507.19684","checkedAt":"2026-11-09T03:34:09.169Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"d69220e97d2d7aa980609560374099c1fefdfe3959c6a5ae909a321a04f7a7cf","confidence":0.72,"provider":"typesafe","model":"jev-1.13.0","inputHash":"bcfac9f9a1267006e5c0ff0b2facc55e5b2bd13bcca9f7cb255522e4bea48da1","decidedAt":"2026-11-09T03:01:25.648Z"},"provenance":{"textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observationId":"fecbc3c2ce6e11ad8706ce7cdfc8b5915700bfc559abf175b363499504077e98","retrievedAt":"2026-11-09T03:01:23.283Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"b77cb185-8b4d-4ced-821a-2e02dee316f7"},"reviewer":{"model":"gpt-6-luna","runId":"909ec8b2-25c9-4e61-870b-6efc541d1d1d"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T03:02:19.654Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Burkanova, Bermet","url":null,"kind":"unknown"},{"name":"Etesam, Yasaman","url":null,"kind":"unknown"},{"name":"Yazdian, Payam Jome","url":null,"kind":"unknown"},{"name":"Evans, Trinity","url":null,"kind":"unknown"},{"name":"Zhang, Chuxuan","url":null,"kind":"unknown"},{"name":"Stanley, Zoe","url":null,"kind":"unknown"},{"name":"Tuttösí, Paige","url":null,"kind":"unknown"},{"name":"Lim, Angelica","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Burkanova, Bermet","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Burkanova, Bermet","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2507.19684","locator":"head/meta[name=author|citation_author]"},"assertionId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:34:09.169Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","sourceUrl":"https://arxiv.org/abs/2507.19684","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z"}},{"actor":{"name":"Etesam, Yasaman","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Etesam, Yasaman","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2507.19684","locator":"head/meta[name=author|citation_author]"},"assertionId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:34:09.169Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","sourceUrl":"https://arxiv.org/abs/2507.19684","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z"}},{"actor":{"name":"Yazdian, Payam Jome","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Yazdian, Payam Jome","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2507.19684","locator":"head/meta[name=author|citation_author]"},"assertionId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:34:09.169Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","sourceUrl":"https://arxiv.org/abs/2507.19684","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z"}},{"actor":{"name":"Evans, Trinity","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Evans, Trinity","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2507.19684","locator":"head/meta[name=author|citation_author]"},"assertionId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:34:09.169Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","sourceUrl":"https://arxiv.org/abs/2507.19684","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z"}},{"actor":{"name":"Zhang, Chuxuan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Chuxuan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2507.19684","locator":"head/meta[name=author|citation_author]"},"assertionId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:34:09.169Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","sourceUrl":"https://arxiv.org/abs/2507.19684","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z"}},{"actor":{"name":"Stanley, Zoe","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Stanley, Zoe","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2507.19684","locator":"head/meta[name=author|citation_author]"},"assertionId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:34:09.169Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","sourceUrl":"https://arxiv.org/abs/2507.19684","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z"}},{"actor":{"name":"Tuttösí, Paige","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Tuttösí, Paige","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2507.19684","locator":"head/meta[name=author|citation_author]"},"assertionId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:34:09.169Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","sourceUrl":"https://arxiv.org/abs/2507.19684","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z"}},{"actor":{"name":"Lim, Angelica","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Lim, Angelica","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2507.19684","locator":"head/meta[name=author|citation_author]"},"assertionId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:34:09.169Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","sourceUrl":"https://arxiv.org/abs/2507.19684","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2507.19684","snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z","basis":"publisher-page-metadata","sourceLinks":53,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/65d1bfa9ea36b4bf42184f0e2c30693671c5d1d116a04a12b8cd48934c74589e/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-compas3d-a-dataset-and-benchmark-for-interactive-65d1bfa9","formats":{"html":"/readings/arxiv-cs-ai-compas3d-a-dataset-and-benchmark-for-interactive-65d1bfa9","markdown":"/readings/arxiv-cs-ai-compas3d-a-dataset-and-benchmark-for-interactive-65d1bfa9.md","json":"/readings/arxiv-cs-ai-compas3d-a-dataset-and-benchmark-for-interactive-65d1bfa9.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"},{"id":"term-fine-tuning","name":"Fine-tuning","explanation":"Further training of an existing model to adapt it to a particular task or use.","referenceUrl":"https://developers.google.com/machine-learning/glossary#fine-tuning"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"},{"id":"time","name":"TIME","kind":"organization","context":"TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.","referenceUrls":["https://time.com/"],"path":"/entities/time","json":"/entities/time.json","markdown":"/entities/time.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"65d1bfa9ea36b4bf42184f0e2c30693671c5d1d116a04a12b8cd48934c74589e","revision":"eb378053-ccfa-4555-8e4e-9f27cffd7f68","revisionKind":"publication-id","title":"arXiv cs.AI: CoMPAS3D: A Dataset and Benchmark for Interactive Motion","url":"https://escapemeridian.com/readings/arxiv-cs-ai-compas3d-a-dataset-and-benchmark-for-interactive-65d1bfa9"},"source":{"type":"source","id":"https://arxiv.org/abs/2507.19684","revision":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","revisionKind":"sha256-source-text","title":"CoMPAS3D: A Dataset and Benchmark for Interactive Motion","url":"https://arxiv.org/abs/2507.19684"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"65d1bfa9ea36b4bf42184f0e2c30693671c5d1d116a04a12b8cd48934c74589e","title":"arXiv cs.AI: CoMPAS3D: A Dataset and Benchmark for Interactive Motion","argument":"The authors of CoMPAS3D argue that interactive motion systems need evaluation that can judge not only how bodies move, but whether their movements make sense within a shared vocabulary. They propose partner salsa as a test domain: dancers respond to one another in real time, using recognizable moves and community-validated judging criteria. The paper introduces a motion-capture dataset of improvised partner salsa and a benchmark for move classification, proficiency estimation, and follower generation. Its measures combine motion quality, objective measures of whether moves are legible and appropriate to a dancer’s proficiency, and expert judgments of timing, musicality, technique, difficulty, partnering, and originality. The authors report that fine-tuned vision-language models perform well on ground-truth sequences and correlate with subjective expert judgments. When they apply their objective measures to Duolando and InterGen, the authors find a large gap between ground-truth and generated dances; expert evaluations across six dimensions corroborate that result. The work’s central argument is that judging interactive motion requires attention to meaning and suitability, not just movement patterns. Its evidence comes from salsa data and these reported evaluations; how well the measures and findings extend beyond that setting remains open.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The available evidence is the arXiv abstract; it does not give details of the evaluation methods or numerical results behind the reported performance, correlations, or gap. The reported benchmark and comparison concern improvised partner salsa and the named systems; the abstract does not establish how far the findings generalize beyond them.","speaker":{"name":"Burkanova, Bermet, Etesam, Yasaman, Yazdian, Payam Jome, Evans, Trinity, Zhang, Chuxuan, Stanley, Zoe, Tuttösí, Paige, Lim, Angelica","roleAtSource":"Article author"},"source":{"title":"CoMPAS3D: A Dataset and Benchmark for Interactive Motion","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2507.19684","publishedAt":"2025-07-25","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors argue that existing interactive-motion evaluations do not assess whether generated responses are valid or appropriate within a shared movement vocabulary.","excerpt":"do not assess whether generated reactive motions are valid or appropriate within a shared movement vocabulary","url":"https://arxiv.org/abs/2507.19684","relationship":"Source-stated"},{"text":"The paper presents improvised partner salsa as an interactive evaluation domain with a move vocabulary and community-validated judging criteria.","excerpt":"Salsa is interactive, dyadic, and governed by a move vocabulary and community-validated judging criteria","url":"https://arxiv.org/abs/2507.19684","relationship":"Source-stated"},{"text":"CoMPAS3D combines motion-capture data, objective metrics, and six competition-based subjective dimensions.","excerpt":"a motion capture dataset of improvised partner salsa dance and an evaluation framework covering kinematic quality, two objective metrics (move legibility and proficiency appropriateness), and six competition-based subjective dimensions","url":"https://arxiv.org/abs/2507.19684","relationship":"Source-stated"},{"text":"The authors report that fine-tuned vision-language models perform well on ground-truth sequences and correlate with subjective expert judgments.","excerpt":"Fine-tuned vision-language models perform well on ground-truth sequences and correlate with subjective expert judgments","url":"https://arxiv.org/abs/2507.19684","relationship":"Source-stated"},{"text":"Applied to Duolando and InterGen, the objective metrics show a large gap between ground-truth and generated dances, which expert evaluations corroborate.","excerpt":"our objective metrics reveal a large gap between ground-truth and generated dances, corroborated by expert human evaluations across six judging dimensions.","url":"https://arxiv.org/abs/2507.19684","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2507.19684","checkedAt":"2026-11-09T03:34:09.169Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well do the reported model performance and correlations with expert judgments hold beyond the ground-truth sequences and salsa benchmark described in the abstract?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: CoMPAS3D: A Dataset and Benchmark for Interactive Motion","summary":"The authors of CoMPAS3D argue that interactive motion systems need evaluation that can judge not only how bodies move, but whether their movements make sense within a shared vocabulary. They propose partner salsa as a test domain: dancers respond to one another in real time, using recognizable moves and community-validated judging criteria. The paper introduces a motion-capture dataset of improvised partner salsa and a benchmark for move classification, proficiency estimation, and follower generation. Its measures combine motion quality, objective measures of whether moves are legible and appropriate to a dancer’s proficiency, and expert judgments of timing, musicality, technique, difficulty, partnering, and originality. The authors report that fine-tuned vision-language models perform well on ground-truth sequences and correlate with subjective expert judgments. When they apply their objective measures to Duolando and InterGen, the authors find a large gap between ground-truth and generated dances; expert evaluations across six dimensions corroborate that result. The work’s central argument is that judging interactive motion requires attention to meaning and suitability, not just movement patterns. Its evidence comes from salsa data and these reported evaluations; how well the measures and findings extend beyond that setting remains open.","question":"How well do the reported model performance and correlations with expert judgments hold beyond the ground-truth sequences and salsa benchmark described in the abstract?","claims":[{"text":"The authors argue that existing interactive-motion evaluations do not assess whether generated responses are valid or appropriate within a shared movement vocabulary.","excerpt":"do not assess whether generated reactive motions are valid or appropriate within a shared movement vocabulary","support":"source-stated"},{"text":"The paper presents improvised partner salsa as an interactive evaluation domain with a move vocabulary and community-validated judging criteria.","excerpt":"Salsa is interactive, dyadic, and governed by a move vocabulary and community-validated judging criteria","support":"source-stated"},{"text":"CoMPAS3D combines motion-capture data, objective metrics, and six competition-based subjective dimensions.","excerpt":"a motion capture dataset of improvised partner salsa dance and an evaluation framework covering kinematic quality, two objective metrics (move legibility and proficiency appropriateness), and six competition-based subjective dimensions","support":"source-stated"},{"text":"The authors report that fine-tuned vision-language models perform well on ground-truth sequences and correlate with subjective expert judgments.","excerpt":"Fine-tuned vision-language models perform well on ground-truth sequences and correlate with subjective expert judgments","support":"source-stated"},{"text":"Applied to Duolando and InterGen, the objective metrics show a large gap between ground-truth and generated dances, which expert evaluations corroborate.","excerpt":"our objective metrics reveal a large gap between ground-truth and generated dances, corroborated by expert human evaluations across six judging dimensions.","support":"source-stated"}],"limitations":["The available evidence is the arXiv abstract; it does not give details of the evaluation methods or numerical results behind the reported performance, correlations, or gap.","The reported benchmark and comparison concern improvised partner salsa and the named systems; the abstract does not establish how far the findings generalize beyond them."],"mediaId":"d69220e97d2d7aa980609560374099c1fefdfe3959c6a5ae909a321a04f7a7cf","correctionReason":null,"id":"65d1bfa9ea36b4bf42184f0e2c30693671c5d1d116a04a12b8cd48934c74589e","publicationId":"eb378053-ccfa-4555-8e4e-9f27cffd7f68","version":1,"sourceUrl":"https://arxiv.org/abs/2507.19684","sourceTitle":"CoMPAS3D: A Dataset and Benchmark for Interactive Motion","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2025-07-25","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-06T05:12:42.956Z","createdAt":"2026-11-09T03:02:19.654Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"d69220e97d2d7aa980609560374099c1fefdfe3959c6a5ae909a321a04f7a7cf","kind":"article","url":"https://arxiv.org/abs/2507.19684","sourceUrl":"https://arxiv.org/abs/2507.19684","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T03:01:23.576Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2507.19684","checkedAt":"2026-11-09T03:34:09.169Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"d69220e97d2d7aa980609560374099c1fefdfe3959c6a5ae909a321a04f7a7cf","confidence":0.72,"provider":"typesafe","model":"jev-1.13.0","inputHash":"bcfac9f9a1267006e5c0ff0b2facc55e5b2bd13bcca9f7cb255522e4bea48da1","decidedAt":"2026-11-09T03:01:25.648Z"},"provenance":{"textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observationId":"fecbc3c2ce6e11ad8706ce7cdfc8b5915700bfc559abf175b363499504077e98","retrievedAt":"2026-11-09T03:01:23.283Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"b77cb185-8b4d-4ced-821a-2e02dee316f7"},"reviewer":{"model":"gpt-6-luna","runId":"909ec8b2-25c9-4e61-870b-6efc541d1d1d"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T03:02:19.654Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Burkanova, Bermet","url":null,"kind":"unknown"},{"name":"Etesam, Yasaman","url":null,"kind":"unknown"},{"name":"Yazdian, Payam Jome","url":null,"kind":"unknown"},{"name":"Evans, Trinity","url":null,"kind":"unknown"},{"name":"Zhang, Chuxuan","url":null,"kind":"unknown"},{"name":"Stanley, Zoe","url":null,"kind":"unknown"},{"name":"Tuttösí, Paige","url":null,"kind":"unknown"},{"name":"Lim, Angelica","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Burkanova, Bermet","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Burkanova, Bermet","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2507.19684","locator":"head/meta[name=author|citation_author]"},"assertionId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:34:09.169Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","sourceUrl":"https://arxiv.org/abs/2507.19684","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z"}},{"actor":{"name":"Etesam, Yasaman","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Etesam, Yasaman","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2507.19684","locator":"head/meta[name=author|citation_author]"},"assertionId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:34:09.169Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","sourceUrl":"https://arxiv.org/abs/2507.19684","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z"}},{"actor":{"name":"Yazdian, Payam Jome","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Yazdian, Payam Jome","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2507.19684","locator":"head/meta[name=author|citation_author]"},"assertionId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:34:09.169Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","sourceUrl":"https://arxiv.org/abs/2507.19684","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z"}},{"actor":{"name":"Evans, Trinity","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Evans, Trinity","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2507.19684","locator":"head/meta[name=author|citation_author]"},"assertionId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:34:09.169Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","sourceUrl":"https://arxiv.org/abs/2507.19684","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z"}},{"actor":{"name":"Zhang, Chuxuan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Chuxuan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2507.19684","locator":"head/meta[name=author|citation_author]"},"assertionId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:34:09.169Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","sourceUrl":"https://arxiv.org/abs/2507.19684","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z"}},{"actor":{"name":"Stanley, Zoe","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Stanley, Zoe","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2507.19684","locator":"head/meta[name=author|citation_author]"},"assertionId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:34:09.169Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","sourceUrl":"https://arxiv.org/abs/2507.19684","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z"}},{"actor":{"name":"Tuttösí, Paige","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Tuttösí, Paige","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2507.19684","locator":"head/meta[name=author|citation_author]"},"assertionId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:34:09.169Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","sourceUrl":"https://arxiv.org/abs/2507.19684","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z"}},{"actor":{"name":"Lim, Angelica","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Lim, Angelica","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2507.19684","locator":"head/meta[name=author|citation_author]"},"assertionId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:34:09.169Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","sourceUrl":"https://arxiv.org/abs/2507.19684","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2507.19684","snapshotId":"08cd0995725bcb60680fbdd48b3163b0cdd441bc14d59344d7fb10bd9bf07e5e","contentSha256":"6d03195e120168301bb6b7be929de5e44958fa3c981d37067388edf779249ae8","textHash":"288ad4681015ef71e19ee622ff3df9c93abcb8b2adf45e8d94b79a0842b2f155","observedAt":"2026-11-09T03:34:09.169Z","basis":"publisher-page-metadata","sourceLinks":53,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/65d1bfa9ea36b4bf42184f0e2c30693671c5d1d116a04a12b8cd48934c74589e/source"}}}],"audits":[{"publicationId":"eb378053-ccfa-4555-8e4e-9f27cffd7f68","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft consistently attributes the arguments and findings to the paper's authors and presents the results as reported claims rather than established fact. The arXiv cs.AI label matches the feed publisher, and the paper is cross-listed in cs.AI.","excerpt":"Authors:Bermet Burkanova, Yasaman Etesam, Payam Jome Yazdian, Trinity Evans, Chuxuan Zhang, Zoe Stanley, Paige Tuttösí, Angelica Lim"},{"dimension":"summary","status":"uncertain","explanation":"The summary is faithful, but key context is missing for a non-specialist. (1) It drops the source's motivation, socially interactive humanoids that adapt to a human partner, and replaces it with vague 'interactive motion systems'. (2) It does not say that the fine-tuned vision-language models are being proposed as measurement tools; the abstract says this is what their performance suggests. (3) It leaves 'ground-truth sequences', 'follower generation' and Duolando/InterGen unexplained. The smallest repair is to name the humanoid goal, state the VLM-as-evaluator point and gloss those terms.","excerpt":"Socially interactive humanoids aim to interact with humans through their bodies, adapting in real time to a partner's movement, intent, and abilities."},{"dimension":"date","status":"pass","explanation":"The originalPublished date of 2025-07-25 matches the v1 submission. It correctly ignores the later v3 revision (5 Nov 2026) and the November 2026 feed entry.","excerpt":"[Submitted on 25 Jul 2025 (v1), last revised 5 Nov 2026 (this version, v3)]"},{"dimension":"support","status":"pass","explanation":"Each claim matches a verbatim excerpt from the abstract. The limitations accurately note that only the abstract is available and that generalization beyond salsa is open. The question follows from the evidence without assuming an answer, and no benefits or costs are invented.","excerpt":"Applied to Duolando and InterGen, our objective metrics reveal a large gap between ground-truth and generated dances, corroborated by expert human evaluations across six judging dimensions."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page of this paper, which is the original source. No better source media was found.","excerpt":null}],"createdAt":"2026-11-09T03:02:19.654Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}