# arXiv cs.AI: More Agents, More Samples, or More Thinking?

[Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-more-agents-more-samples-or-more-thinking-977b11c8)

Seyed Mahmoud Sajjadi Mohammadabadi argues that evaluations can make multi-agent language models look better by comparing them with a single greedy pass, which confounds coordination with sample multiplicity and inference compute. The paper synthesizes nine empirical evaluations comprising 516 unique multi-agent configurations. Against baselines matched on sample count or resource budget, multi-agent systems average lower accuracy, and the result remains negative across sensitivity checks. Accuracy equals or falls below the baseline in 74% of comparable contrasts. The author also reports that moving from a greedy pass to a sampled baseline shifts accuracy differences downward on average. The paper’s explanation is that communication adds no information when agents share identical evidence; positive returns require partitioned evidence, external verification, or error diversity across models. It offers a reviewer checklist and accounting utilities. The comparisons make the choice of baseline central to interpreting claims about multi-agent performance; the findings are based on the evaluations synthesized in the paper.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

## Original source

arXiv cs.AI · Article

Original source date: Nov 13, 2026 (2026-11-13).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-16T07:18:01.998Z. First observed: 2026-11-16T05:01:10.541Z. Retrieved: 2026-11-16T07:17:12.939Z.

- [More Agents, More Samples, or More Thinking? Untangling Coordination, Ensembling, and Test-Time Compute in Multi-Agent LLMs](https://arxiv.org/abs/2611.17610)

## Limits

The evidence is a synthesis of nine primary empirical evaluations; the supplied abstract does not establish how well the findings generalize beyond those evaluations.


## Open question

How do the results vary across the nine evaluations when multi-agent systems are compared with baselines matched on sample count or resource budget?


## Source-stated

The author argues that comparing multi-agent language models only with a single greedy pass confounds coordination with sample multiplicity and inference compute.

> This practice confounds coordination with sample multiplicity and inference compute.

- [Supporting source](https://arxiv.org/abs/2611.17610)

## Source-stated

Across baselines matched on sample count or resource budget, multi-agent systems average lower accuracy, and the result remains negative across sensitivity checks.

> When evaluated against baselines matched on sample count (Category B) or resource budget (Category C), multi-agent systems average -0.042 in accuracy, and multilevel random effects modeling on the log odds scale remains negative across sensitivity checks.

- [Supporting source](https://arxiv.org/abs/2611.17610)

## Source-stated

In 74% of comparable contrasts, multi-agent accuracy equals or falls below the baseline.

> Multi-agent accuracy equals or falls below the baseline in 74% of these comparable contrasts

- [Supporting source](https://arxiv.org/abs/2611.17610)

## Source-stated

The author says communication adds no information when agents share identical evidence, and identifies partitioned evidence, external verification, or error diversity across models as conditions for positive returns.

> Because communication adds no information when agents share identical evidence, positive returns require partitioned evidence, external verification, or error diversity across models.

- [Supporting source](https://arxiv.org/abs/2611.17610)

## Source-stated

The paper synthesizes nine empirical evaluations comprising 516 unique multi-agent configurations.

> We synthesize nine primary empirical evaluations comprising 516 unique multi-agent configurations

- [Supporting source](https://arxiv.org/abs/2611.17610)

## Source and contributor context

Mohammadabadi, Seyed Mahmoud Sajjadi · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.


## Source media

No suitable media was found by the supported page extraction.


## Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.


## Model inference

Using a trained model to produce a prediction or response to new input.

- [Definition reference](https://developers.google.com/machine-learning/glossary#inference)

## arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

- [Explore this context](/entities/arxiv)
- [Reference](https://arxiv.org/)
- [Reference](https://info.arxiv.org/help/api/index.html)

## Editorial provenance

Version 1. Publication ID: 616b4678-8ef1-4975-8c44-b73adc703a90.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-16T07:18:01.998Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material\_development.

Observation: 493dd5f2fac96192ae28adaaef5969fcf8b3d4e36ec79e0387fc704314c59f75. Source text hash: cdf0d1939968c627a4c887fb30ef5a3c47118910ee12378a09db7b3733e6aa4d.


## Revision and source-check history

### Version 1 — 2026-11-16T07:18:01.998Z

Seyed Mahmoud Sajjadi Mohammadabadi argues that evaluations can make multi-agent language models look better by comparing them with a single greedy pass, which confounds coordination with sample multiplicity and inference compute. The paper synthesizes nine empirical evaluations comprising 516 unique multi-agent configurations. Against baselines matched on sample count or resource budget, multi-agent systems average lower accuracy, and the result remains negative across sensitivity checks. Accuracy equals or falls below the baseline in 74% of comparable contrasts. The author also reports that moving from a greedy pass to a sampled baseline shifts accuracy differences downward on average. The paper’s explanation is that communication adds no information when agents share identical evidence; positive returns require partitioned evidence, external verification, or error diversity across models. It offers a reviewer checklist and accounting utilities. The comparisons make the choice of baseline central to interpreting claims about multi-agent performance; the findings are based on the evaluations synthesized in the paper.

## Original source

arXiv cs.AI · Article

Original source date: Nov 13, 2026 (2026-11-13).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-16T07:18:01.998Z. First observed: 2026-11-16T05:01:10.541Z. Retrieved: 2026-11-16T07:17:12.939Z.

- [More Agents, More Samples, or More Thinking? Untangling Coordination, Ensembling, and Test-Time Compute in Multi-Agent LLMs](https://arxiv.org/abs/2611.17610)

## Limits

The evidence is a synthesis of nine primary empirical evaluations; the supplied abstract does not establish how well the findings generalize beyond those evaluations.


## Open question

How do the results vary across the nine evaluations when multi-agent systems are compared with baselines matched on sample count or resource budget?


## Source-stated

The author argues that comparing multi-agent language models only with a single greedy pass confounds coordination with sample multiplicity and inference compute.

> This practice confounds coordination with sample multiplicity and inference compute.

- [Supporting source](https://arxiv.org/abs/2611.17610)

## Source-stated

Across baselines matched on sample count or resource budget, multi-agent systems average lower accuracy, and the result remains negative across sensitivity checks.

> When evaluated against baselines matched on sample count (Category B) or resource budget (Category C), multi-agent systems average -0.042 in accuracy, and multilevel random effects modeling on the log odds scale remains negative across sensitivity checks.

- [Supporting source](https://arxiv.org/abs/2611.17610)

## Source-stated

In 74% of comparable contrasts, multi-agent accuracy equals or falls below the baseline.

> Multi-agent accuracy equals or falls below the baseline in 74% of these comparable contrasts

- [Supporting source](https://arxiv.org/abs/2611.17610)

## Source-stated

The author says communication adds no information when agents share identical evidence, and identifies partitioned evidence, external verification, or error diversity across models as conditions for positive returns.

> Because communication adds no information when agents share identical evidence, positive returns require partitioned evidence, external verification, or error diversity across models.

- [Supporting source](https://arxiv.org/abs/2611.17610)

## Source-stated

The paper synthesizes nine empirical evaluations comprising 516 unique multi-agent configurations.

> We synthesize nine primary empirical evaluations comprising 516 unique multi-agent configurations

- [Supporting source](https://arxiv.org/abs/2611.17610)

## Source and contributor context

Mohammadabadi, Seyed Mahmoud Sajjadi · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.


## Source media

No suitable media was found by the supported page extraction.


## Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.


## Model inference

Using a trained model to produce a prediction or response to new input.

- [Definition reference](https://developers.google.com/machine-learning/glossary#inference)

## arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

- [Explore this context](/entities/arxiv)
- [Reference](https://arxiv.org/)
- [Reference](https://info.arxiv.org/help/api/index.html)

## Editorial provenance

Version 1. Publication ID: 616b4678-8ef1-4975-8c44-b73adc703a90.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-16T07:18:01.998Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material\_development.

Observation: 493dd5f2fac96192ae28adaaef5969fcf8b3d4e36ec79e0387fc704314c59f75. Source text hash: cdf0d1939968c627a4c887fb30ef5a3c47118910ee12378a09db7b3733e6aa4d.


### uncertain — 2026-11-16T07:18:01.998Z — anthropic/claude-opus-5.5

Publication: 616b4678-8ef1-4975-8c44-b73adc703a90

attribution — pass: The reading correctly attributes the paper and its argument to Seyed Mahmoud Sajjadi Mohammadabadi on arXiv cs.AI. Findings are framed as the author's or paper's claims, not as established fact.

> Authors:Seyed Mahmoud Sajjadi Mohammadabadi

summary — uncertain: The core argument is faithful, but central jargon is left unexplained for a general reader: 'multi-agent language models,' 'single greedy pass,' 'sample multiplicity,' 'inference compute,' 'baseline,' 'partitioned evidence,' and 'error diversity.' Without plain-language glosses or tooltips, a non-specialist cannot tell why a greedy-pass comparison is unfair. The reading also omits that results were negative overall even against single-pass baselines (near zero without the largest study) and that study means were nonpositive in almost all studies. Smallest repair: add one-line plain glosses for greedy pass, sampled baseline and multi-agent setup.

> Against baselines with a single pass (Category A), multi-agent accuracy differences are negative overall and near zero when omitting the largest contributing study.

date — pass: The originalPublished date of 2026-11-13 matches the arXiv v1 submission date. It is not the later feed date.

> \[Submitted on 13 Nov 2026\]

support — pass: Each claim matches an exact abstract excerpt. The 'look better' framing is reasonably supported by the reported -0.038 shift when moving from greedy to sampled baselines. The closing interpretation stays within the evidence, and the limitation appropriately flags uncertainty about generalization. One minor scope gap: the downward shift applies only to studies reporting both baselines.

> Across studies reporting both baselines, moving from a greedy pass to a sampled baseline shifts accuracy differences by -0.038 on average.

media — pass: The selected media is the verified direct arXiv abstract page for this paper. It is the most direct way to access the source.

## Recorded references

Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter.

No public references recorded here yet.

[Reference data (JSON)](/readings/977b11c80323bd89941da7fe53d7b10e41669c98c52c43360b34b76c8313aea1/references.json)

## Corrections and challenges

[Send a correction or an opposing source](https://escapemeridian.com/corrections/)

[JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-more-agents-more-samples-or-more-thinking-977b11c8.json)
