Sharma, Robin, Suchdev, Parisa · Nov 17, 2026
arXiv cs.AI: How OpenAI and Anthropic agents interpret user priorities
Markdown · JSON · Original source
Robin Sharma and Parisa Suchdev examine how two web research agents interpret a user's stated priority when comparing Microsoft and Alphabet as businesses. In 36 runs, prompts asked the agents to focus on growth or resilience, or gave no priority. The authors report that 21 of the 24 reports given a priority focused on it, but the criteria behind the judgments varied. For growth, reports that ranked the companies considered risk or predictability and favored Microsoft; reports judged growth by its pace and favored Alphabet. For resilience, reports also used partly different criteria, and most named Microsoft as more resilient. Among the search and source measures tested, only the Anthropic agent's search wording differed detectably between conditions. The authors argue that evaluating a report's focus or accuracy alone may miss how its criteria shape its judgments. They suggest interfaces could let users see and adjust those criteria.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 17, 2026 (2026-11-17).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-18T17:19:26.325Z. First observed: 2026-11-18T05:04:05.244Z. Retrieved: 2026-11-18T17:18:43.217Z.
Referenced by
Recorded citations in public readings. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The abstract describes 36 runs involving two agents and a comparison of Microsoft and Alphabet; it does not establish how the findings generalize to other agents, topics, or research tasks. The abstract reports that criteria varied but does not give the criteria used in every individual report.
Open question
What criteria did the agents use in individual reports, beyond the differences summarized for growth and resilience?
Source-stated
The authors tested two web research agents on comparisons of Microsoft and Alphabet, with prompts emphasizing growth, resilience, or no priority.
In 36 runs, the agents compared Microsoft and Alphabet as businesses. Prompts asked for special attention to growth or resilience, or gave no priority.
Source-stated
Most reports given a priority focused on it, but the criteria used to apply that priority differed.
Of the 24 reports given a priority, 21 focused on it, but their criteria varied.
Source-stated
For growth, OpenAI reports that ranked the companies considered risk or predictability and favored Microsoft, while Anthropic reports judged growth by pace and favored Alphabet.
Under the growth priority, OpenAI reports that ranked the companies accounted for risk or predictability and favored Microsoft, while the Anthropic ones judged growth by its pace and favored Alphabet.
Source-stated
For resilience, reports used partly different criteria, and most named Microsoft as more resilient.
Under the resilience priority, reports used partly different criteria, and most named Microsoft as the more resilient company.
Source-stated
The authors recommend evaluating the criteria behind reports' judgments, not only their focus or accuracy, and suggest interfaces could expose and let users adjust those criteria.
These findings suggest evaluations should examine the criteria behind a report's judgements, not only its focus or accuracy. Interfaces could let users see and adjust those criteria.
Source and contributor context
Sharma, Robin, Suchdev, Parisa · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
OpenAI
OpenAI develops AI models and products and publishes research, release announcements and evaluations.
Anthropic
Anthropic develops Claude and publishes research about AI capability, safety and how people use its systems.
Editorial provenance
Version 1. Publication ID: 16a030d3-abdd-42a0-8874-8fed0caf78a9.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-18T17:19:26.325Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: useful_perspective.
Observation: 07faa16c4bd5ec03a10626a00fdb94b0b7c363e93807b0cd398c1f9c754cd587. Source text hash: 7034f1f8d6d639b859c7259ab434b83c7420f906da5aa88d00a6624fe27722ce.
Revision and source-check history
Version 1 · 2026-11-18T17:19:26.325Z
arXiv cs.AI: How OpenAI and Anthropic agents interpret user priorities
Robin Sharma and Parisa Suchdev examine how two web research agents interpret a user's stated priority when comparing Microsoft and Alphabet as businesses. In 36 runs, prompts asked the agents to focus on growth or resilience, or gave no priority. The authors report that 21 of the 24 reports given a priority focused on it, but the criteria behind the judgments varied. For growth, reports that ranked the companies considered risk or predictability and favored Microsoft; reports judged growth by its pace and favored Alphabet. For resilience, reports also used partly different criteria, and most named Microsoft as more resilient. Among the search and source measures tested, only the Anthropic agent's search wording differed detectably between conditions. The authors argue that evaluating a report's focus or accuracy alone may miss how its criteria shape its judgments. They suggest interfaces could let users see and adjust those criteria.
Original source
cs.AI · Article
Source details
Original source date: Nov 17, 2026 (2026-11-17).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-18T17:19:26.325Z. First observed: 2026-11-18T05:04:05.244Z. Retrieved: 2026-11-18T17:18:43.217Z.
Limits
The abstract describes 36 runs involving two agents and a comparison of Microsoft and Alphabet; it does not establish how the findings generalize to other agents, topics, or research tasks. The abstract reports that criteria varied but does not give the criteria used in every individual report.
Open question
What criteria did the agents use in individual reports, beyond the differences summarized for growth and resilience?
Source-stated
The authors tested two web research agents on comparisons of Microsoft and Alphabet, with prompts emphasizing growth, resilience, or no priority.
In 36 runs, the agents compared Microsoft and Alphabet as businesses. Prompts asked for special attention to growth or resilience, or gave no priority.
Source-stated
Most reports given a priority focused on it, but the criteria used to apply that priority differed.
Of the 24 reports given a priority, 21 focused on it, but their criteria varied.
Source-stated
For growth, OpenAI reports that ranked the companies considered risk or predictability and favored Microsoft, while Anthropic reports judged growth by pace and favored Alphabet.
Under the growth priority, OpenAI reports that ranked the companies accounted for risk or predictability and favored Microsoft, while the Anthropic ones judged growth by its pace and favored Alphabet.
Source-stated
For resilience, reports used partly different criteria, and most named Microsoft as more resilient.
Under the resilience priority, reports used partly different criteria, and most named Microsoft as the more resilient company.
Source-stated
The authors recommend evaluating the criteria behind reports' judgments, not only their focus or accuracy, and suggest interfaces could expose and let users adjust those criteria.
These findings suggest evaluations should examine the criteria behind a report's judgements, not only its focus or accuracy. Interfaces could let users see and adjust those criteria.
Source and contributor context
Sharma, Robin, Suchdev, Parisa · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
OpenAI
OpenAI develops AI models and products and publishes research, release announcements and evaluations.
Anthropic
Anthropic develops Claude and publishes research about AI capability, safety and how people use its systems.
Editorial provenance
Version 1. Publication ID: 16a030d3-abdd-42a0-8874-8fed0caf78a9.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-18T17:19:26.325Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: useful_perspective.
Observation: 07faa16c4bd5ec03a10626a00fdb94b0b7c363e93807b0cd398c1f9c754cd587. Source text hash: 7034f1f8d6d639b859c7259ab434b83c7420f906da5aa88d00a6624fe27722ce.
uncertain · 2026-11-18T17:19:26.325Z · anthropic/claude-opus-5.5
Publication: 16a030d3-abdd-42a0-8874-8fed0caf78a9
attribution — uncertain: Robin Sharma and Parisa Suchdev are correctly named as the authors, and the findings are attributed to them. However, the title's phrase 'OpenAI and Anthropic agents' may imply the agents are products made by those companies. The source says only that the agents were 'built on OpenAI and Anthropic models'. The summary never states this. Smallest repair: say 'agents built on OpenAI and Anthropic models' in the title or summary.
We examine how two such agents, built on OpenAI and Anthropic models, interpret a stated priority.
summary — uncertain: The summary faithfully tracks the abstract, including the 21 of 24 result, the split on growth and resilience, and the authors' proposal. However, it never explains 'web research agents' in plain language. The source defines them as systems that gather information online and write cited reports, including financial analysis. A non-specialist may not understand the central actor without this. The question is substantive and grounded in the evidence. Smallest repair: add the source's one-line definition.
Web research agents gather information online and write cited reports, including financial analysis.
date — pass: originalPublished 2026-11-17 matches the arXiv v1 submission date. It is not the 2026-11-18 feed date.
[Submitted on 17 Nov 2026]
support — pass: Each claim is directly supported by the abstract, and the limitations are accurate. The softened phrasing 'may miss how its criteria shape its judgments' stays within the authors' suggestion. The summary presents the interface idea as a suggestion, not as a demonstrated benefit.
These findings suggest evaluations should examine the criteria behind a report's judgements, not only its focus or accuracy.
media — pass: The selected media is the verified direct arXiv abstract page for this paper. It is the most direct access to the source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
OpenAI develops AI models and products and publishes research, release announcements and evaluations.
Explore OpenAIAnthropic develops Claude and publishes research about AI capability, safety and how people use its systems.
Explore AnthropicarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivOpenAI develops AI models and products and publishes research, release announcements and evaluations.
Explore OpenAIAnthropic develops Claude and publishes research about AI capability, safety and how people use its systems.
Explore AnthropicarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv