# arXiv q-bio.NC: CogArena tests multimodal agents in interactive behavioral experiments [Canonical reading](https://escapemeridian.com/readings/arxiv-q-bio-nc-cogarena-tests-multimodal-agents-in-interactive-84a0b82b) In their paper, Kianté Fernandez and coauthors introduce CogArena, a benchmark that tests AI agents on ten experiments from the social and behavioral sciences. Rather than presenting the tasks as text prompts, the benchmark has agents use a web browser with the visual stimuli and response interfaces used by online participants. Its scoring checks whether an agent finishes a task, how accurately it performs, and whether its data show behavioral signatures—the patterns each experiment reliably produces in people. The authors report that, across four multimodal models tested ten times per task, many sessions did not finish; completed sessions reproduced some signatures reliably and others not at all. They argue that task completion and reproducing human behavioral patterns are different capabilities, relevant to concerns about AI-generated data entering online research datasets. The paper provides the tasks, scoring code, and a public leaderboard. The abstract does not identify which experiments or signatures were reproduced reliably, or quantify how often online datasets are affected by AI agents. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv q-bio.NC · Article Original source date: Oct 27, 2026 (2026-10-27). Date basis: Date basis not provided. Added to Escape Meridian: 2026-10-29T16:02:51.260Z. First observed: 2026-10-28T04:12:43.668Z. Retrieved: 2026-10-29T16:02:02.456Z. - [CogArena: Benchmarking Multimodal Agents on Interactive Behavioral Experiments](https://arxiv.org/abs/2610.36484) ## Limits The abstract does not specify which experimental paradigms or behavioral signatures were reproduced reliably, or provide rates of completion and reproduction. The abstract raises concerns about contamination of online research datasets but does not quantify its prevalence or establish the extent of any contamination. The reported evaluation covers four multimodal models; the abstract does not name them or establish how results generalize to other models. ## Open question Which experiments and behavioral signatures did the tested agents reproduce reliably, and how often do AI agents contribute data to online research datasets? ## Source-stated The paper introduces CogArena, a benchmark of ten experiments from the social and behavioral sciences, conducted through a browser interface. > We introduce CogArena, a benchmark of ten experimental paradigms from the social and behavioral sciences. - [Supporting source](https://arxiv.org/abs/2610.36484) ## Source-stated CogArena presents the experiments through visual stimuli and response interfaces like those used by online participants, rather than reducing them to text prompts. > Agents complete the experiments through a standard web browser, working with the same visual stimuli and response interfaces that online participants use. - [Supporting source](https://arxiv.org/abs/2610.36484) ## Source-stated The scoring procedure separately assesses task completion, accuracy, and whether the agent's data show behavioral signatures found in people. > A three-level scoring procedure evaluates whether the agent completed the task, how accurately it performed, and whether its data show the behavioral signatures each paradigm reliably produces in people. - [Supporting source](https://arxiv.org/abs/2610.36484) ## Source-stated The authors report that many sessions did not finish; completed sessions reproduced some behavioral signatures reliably and others not at all. > Many sessions did not finish, and those that did reproduced some signatures reliably and others not at all. - [Supporting source](https://arxiv.org/abs/2610.36484) ## Source-stated The evaluation covered four multimodal models, with each run ten times per task. > Across four multimodal models, each run ten times per task - [Supporting source](https://arxiv.org/abs/2610.36484) ## Source-stated The authors say completing an experiment and reproducing its behavioral signatures are different things. > finishing an experiment and reproducing its signatures are different things. - [Supporting source](https://arxiv.org/abs/2610.36484) ## Source-stated The authors cite concerns that AI agents completing online behavioral tasks could contaminate datasets in social and behavioral sciences. > AI agents can now complete online behavioral tasks and produce human-like data, which raises concerns that online datasets in the social and behavioral sciences are increasingly open to contamination. - [Supporting source](https://arxiv.org/abs/2610.36484) ## Source and contributor context Fernandez, Kianté, Chen, Caitlin, Zhou, Jialu, Sadowski, Bartek, Miceli, Anthony C., Krajbich, Ian · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Multimodal model A model that works with more than one kind of input or output, such as text, images and audio. - [Definition reference](https://developers.google.com/machine-learning/glossary#multimodal-model) ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 81253fe6-93e9-4f21-8f54-d63af3bb0893. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-10-29T16:02:51.260Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 2b774935e83722b4d2b2e717850a15fa7f3e840ae4e7079ba9d6fbd9b8672e76. Source text hash: 72ef4958775535c8165b796e3ada361bbc0435bdf59365eec9c531b608e35cd4. ## Revision and source-check history ### Version 1 — 2026-10-29T16:02:51.260Z In their paper, Kianté Fernandez and coauthors introduce CogArena, a benchmark that tests AI agents on ten experiments from the social and behavioral sciences. Rather than presenting the tasks as text prompts, the benchmark has agents use a web browser with the visual stimuli and response interfaces used by online participants. Its scoring checks whether an agent finishes a task, how accurately it performs, and whether its data show behavioral signatures—the patterns each experiment reliably produces in people. The authors report that, across four multimodal models tested ten times per task, many sessions did not finish; completed sessions reproduced some signatures reliably and others not at all. They argue that task completion and reproducing human behavioral patterns are different capabilities, relevant to concerns about AI-generated data entering online research datasets. The paper provides the tasks, scoring code, and a public leaderboard. The abstract does not identify which experiments or signatures were reproduced reliably, or quantify how often online datasets are affected by AI agents. ## Original source arXiv q-bio.NC · Article Original source date: Oct 27, 2026 (2026-10-27). Date basis: Date basis not provided. Added to Escape Meridian: 2026-10-29T16:02:51.260Z. First observed: 2026-10-28T04:12:43.668Z. Retrieved: 2026-10-29T16:02:02.456Z. - [CogArena: Benchmarking Multimodal Agents on Interactive Behavioral Experiments](https://arxiv.org/abs/2610.36484) ## Limits The abstract does not specify which experimental paradigms or behavioral signatures were reproduced reliably, or provide rates of completion and reproduction. The abstract raises concerns about contamination of online research datasets but does not quantify its prevalence or establish the extent of any contamination. The reported evaluation covers four multimodal models; the abstract does not name them or establish how results generalize to other models. ## Open question Which experiments and behavioral signatures did the tested agents reproduce reliably, and how often do AI agents contribute data to online research datasets? ## Source-stated The paper introduces CogArena, a benchmark of ten experiments from the social and behavioral sciences, conducted through a browser interface. > We introduce CogArena, a benchmark of ten experimental paradigms from the social and behavioral sciences. - [Supporting source](https://arxiv.org/abs/2610.36484) ## Source-stated CogArena presents the experiments through visual stimuli and response interfaces like those used by online participants, rather than reducing them to text prompts. > Agents complete the experiments through a standard web browser, working with the same visual stimuli and response interfaces that online participants use. - [Supporting source](https://arxiv.org/abs/2610.36484) ## Source-stated The scoring procedure separately assesses task completion, accuracy, and whether the agent's data show behavioral signatures found in people. > A three-level scoring procedure evaluates whether the agent completed the task, how accurately it performed, and whether its data show the behavioral signatures each paradigm reliably produces in people. - [Supporting source](https://arxiv.org/abs/2610.36484) ## Source-stated The authors report that many sessions did not finish; completed sessions reproduced some behavioral signatures reliably and others not at all. > Many sessions did not finish, and those that did reproduced some signatures reliably and others not at all. - [Supporting source](https://arxiv.org/abs/2610.36484) ## Source-stated The evaluation covered four multimodal models, with each run ten times per task. > Across four multimodal models, each run ten times per task - [Supporting source](https://arxiv.org/abs/2610.36484) ## Source-stated The authors say completing an experiment and reproducing its behavioral signatures are different things. > finishing an experiment and reproducing its signatures are different things. - [Supporting source](https://arxiv.org/abs/2610.36484) ## Source-stated The authors cite concerns that AI agents completing online behavioral tasks could contaminate datasets in social and behavioral sciences. > AI agents can now complete online behavioral tasks and produce human-like data, which raises concerns that online datasets in the social and behavioral sciences are increasingly open to contamination. - [Supporting source](https://arxiv.org/abs/2610.36484) ## Source and contributor context Fernandez, Kianté, Chen, Caitlin, Zhou, Jialu, Sadowski, Bartek, Miceli, Anthony C., Krajbich, Ian · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Multimodal model A model that works with more than one kind of input or output, such as text, images and audio. - [Definition reference](https://developers.google.com/machine-learning/glossary#multimodal-model) ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 81253fe6-93e9-4f21-8f54-d63af3bb0893. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-10-29T16:02:51.260Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 2b774935e83722b4d2b2e717850a15fa7f3e840ae4e7079ba9d6fbd9b8672e76. Source text hash: 72ef4958775535c8165b796e3ada361bbc0435bdf59365eec9c531b608e35cd4. ### passed — 2026-10-29T16:02:51.260Z — anthropic/claude-opus-5.5 Publication: 81253fe6-93e9-4f21-8f54-d63af3bb0893 attribution — pass: The paper and its claims are correctly attributed to Kianté Fernandez and coauthors on arXiv. The page lists cs.AI as primary and q-bio.NC as a cross-list, so the publisher label is acceptable. > Authors:Kianté Fernandez, Caitlin Chen, Jialu Zhou, Bartek Sadowski, Anthony C. Miceli, Ian Krajbich summary — pass: The summary explains the benchmark, the browser-based setup and the three-level scoring, and defines behavioral signatures in plain language. It reports the findings faithfully, ties them to the contamination concern stated in the source and notes what the abstract leaves unknown. The question follows from those gaps. > we find that finishing an experiment and reproducing its signatures are different things. date — pass: The originalPublished date, 2026-10-27, matches the v1 submission date. The feed date of 2026-10-29 is later and was correctly not used. > \[Submitted on 27 Oct 2026\] support — pass: Each claim is supported by an exact abstract excerpt. The contamination concern stays attributed and unquantified, and no real-world reliability or benefit is overstated. > Many sessions did not finish, and those that did reproduced some signatures reliably and others not at all. media — pass: The selected media is the verified direct link to the arXiv abstract page, which is the original source. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/84a0b82bda73fc3c011615e23154c1a5832bd592c78d0e216d5876336c44ed87/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-q-bio-nc-cogarena-tests-multimodal-agents-in-interactive-84a0b82b.json)