Wasson, Katelyn A., Song, Kiwon, Jennings III, James M., Currie, Brittney, Sokratous, Konstantina, Stober, Clintin P. · Nov 6, 2026
arXiv cs.AI: Do large language models rank moral values? A transitivity test of moral competence
Markdown · JSON · Original source
The authors argue that strong performance on morality does not show that a can weigh competing moral values in a decision. They test a minimal condition for that ability: whether the model’s moral choices can be represented by an ordinal ranking, an ordering of values. Such a ranking requires transitivity: if one value is preferred to a second, and the second to a third, the first must also be preferred to the third. The authors presented models with pairwise trade-offs between moral value violations in vignettes and derived choice probabilities from first-token distributions. They report that most choice sets admitted weak or unstable orderings when compared with three stochastic transitive choice models. They also report that aggregating responses—a common practice in LLM moral evaluation—produced transitive structure that matched no individual choice set. The distinction matters for how moral evaluations are interpreted: according to the authors, producing appropriate benchmark answers is not enough to establish that choices are structured for weighing values. They argue that evaluations should establish this structure before asking whether choices are aligned. The supplied abstract does not identify the models or describe the choice sets in detail, so it does not show how the reported results vary across models or scenarios.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 6, 2026 (2026-11-06).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-12T10:02:58.590Z. First observed: 2026-11-10T08:33:49.835Z. Retrieved: 2026-11-12T10:02:06.706Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The supplied source text contains the abstract but does not identify the tested models or provide details of the vignette choice sets, limiting assessment of how the findings vary across models or scenarios.
Open question
Which model-specific and choice-set results underlie the finding that most choice sets admitted weak or unstable orderings?
Source-stated
The authors distinguish moral performance on benchmarks from moral competence in weighing competing values; benchmark performance alone does not establish competence.
producing appropriate outputs on these benchmarks (moral performance) does not establish that an LLM weighs competing moral values at stake in a decision
Source-stated
The authors test whether an ordinal ranking can represent LLM moral choices, a minimal necessary condition for weighing values, and note that such a ranking requires transitivity.
Such a ranking requires transitivity.
Source-stated
The authors presented LLMs with pairwise trade-offs among moral value violations in vignette choice sets and extracted choice probabilities from first-token distributions.
we presented LLMs with pairwise trade-offs among moral value violations in vignette choice sets and extracted resulting choice probabilities from first-token distributions
Source-stated
Compared with three stochastic transitive choice models, most choice sets admitted weak or unstable orderings.
Tested against three stochastic transitive choice models, most choice sets admitted weak or unstable orderings.
Source-stated
The authors report that aggregating responses produced transitive structure matching no individual choice set.
Aggregating an LLM's responses, a common practice in LLM moral evaluation, produced transitive structure that matched no individual choice set.
Source-stated
The authors argue that evaluations should establish whether choices are structured before assessing whether they are aligned.
Evaluations of AI morality should establish that choices are structured before asking whether they are aligned.
Source and contributor context
Wasson, Katelyn A., Song, Kiwon, Jennings III, James M., Currie, Brittney, Sokratous, Konstantina, Stober, Clintin P. · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Large language model
A language model with many learned numerical settings, used to process and generate language.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: dc3edc06-54a7-45fd-8675-36766e9600c7.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: passed by anthropic/claude-opus-5.5 on 2026-11-12T10:02:58.590Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 050b07d5fdb2bf8d3d73ccdf9ce7c07472e7726d28f25869d4d5f8297a71dc90. Source text hash: 05cfd2b60366d639087f5f00949b8f60240fade1da604102209a5962a6f5faaa.
Revision and source-check history
Version 1 · 2026-11-12T10:02:58.590Z
arXiv cs.AI: Do large language models rank moral values? A transitivity test of moral competence
The authors argue that strong performance on morality does not show that a can weigh competing moral values in a decision. They test a minimal condition for that ability: whether the model’s moral choices can be represented by an ordinal ranking, an ordering of values. Such a ranking requires transitivity: if one value is preferred to a second, and the second to a third, the first must also be preferred to the third. The authors presented models with pairwise trade-offs between moral value violations in vignettes and derived choice probabilities from first-token distributions. They report that most choice sets admitted weak or unstable orderings when compared with three stochastic transitive choice models. They also report that aggregating responses—a common practice in LLM moral evaluation—produced transitive structure that matched no individual choice set. The distinction matters for how moral evaluations are interpreted: according to the authors, producing appropriate benchmark answers is not enough to establish that choices are structured for weighing values. They argue that evaluations should establish this structure before asking whether choices are aligned. The supplied abstract does not identify the models or describe the choice sets in detail, so it does not show how the reported results vary across models or scenarios.
Original source
cs.AI · Article
Source details
Original source date: Nov 6, 2026 (2026-11-06).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-12T10:02:58.590Z. First observed: 2026-11-10T08:33:49.835Z. Retrieved: 2026-11-12T10:02:06.706Z.
Limits
The supplied source text contains the abstract but does not identify the tested models or provide details of the vignette choice sets, limiting assessment of how the findings vary across models or scenarios.
Open question
Which model-specific and choice-set results underlie the finding that most choice sets admitted weak or unstable orderings?
Source-stated
The authors distinguish moral performance on benchmarks from moral competence in weighing competing values; benchmark performance alone does not establish competence.
producing appropriate outputs on these benchmarks (moral performance) does not establish that an LLM weighs competing moral values at stake in a decision
Source-stated
The authors test whether an ordinal ranking can represent LLM moral choices, a minimal necessary condition for weighing values, and note that such a ranking requires transitivity.
Such a ranking requires transitivity.
Source-stated
The authors presented LLMs with pairwise trade-offs among moral value violations in vignette choice sets and extracted choice probabilities from first-token distributions.
we presented LLMs with pairwise trade-offs among moral value violations in vignette choice sets and extracted resulting choice probabilities from first-token distributions
Source-stated
Compared with three stochastic transitive choice models, most choice sets admitted weak or unstable orderings.
Tested against three stochastic transitive choice models, most choice sets admitted weak or unstable orderings.
Source-stated
The authors report that aggregating responses produced transitive structure matching no individual choice set.
Aggregating an LLM's responses, a common practice in LLM moral evaluation, produced transitive structure that matched no individual choice set.
Source-stated
The authors argue that evaluations should establish whether choices are structured before assessing whether they are aligned.
Evaluations of AI morality should establish that choices are structured before asking whether they are aligned.
Source and contributor context
Wasson, Katelyn A., Song, Kiwon, Jennings III, James M., Currie, Brittney, Sokratous, Konstantina, Stober, Clintin P. · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Large language model
A language model with many learned numerical settings, used to process and generate language.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: dc3edc06-54a7-45fd-8675-36766e9600c7.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: passed by anthropic/claude-opus-5.5 on 2026-11-12T10:02:58.590Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 050b07d5fdb2bf8d3d73ccdf9ce7c07472e7726d28f25869d4d5f8297a71dc90. Source text hash: 05cfd2b60366d639087f5f00949b8f60240fade1da604102209a5962a6f5faaa.
passed · 2026-11-12T10:02:58.590Z · anthropic/claude-opus-5.5
Publication: dc3edc06-54a7-45fd-8675-36766e9600c7
attribution — pass: The reading consistently attributes the argument, method and findings to 'the authors' of the arXiv paper. It keeps their conclusions as their claims rather than as established facts or Escape Meridian's views.
Authors:Katelyn A. Wasson, Kiwon Song, James M. Jennings III, Brittney Currie, Konstantina Sokratous, Clintin P. Stober
summary — pass: The reading faithfully covers the abstract: performance versus competence, the transitivity test, the method, both findings and the call to check structure before alignment. It explains ordinal ranking and transitivity plainly. Optional tooltips: stochastic transitive choice models, first-token distributions, vignette, alignment. Smallest repair: add the abstract's opening stake that LLMs are increasingly used to support decisions requiring moral consideration. The question addresses a real gap.
LLMs are increasingly used to support decisions that require moral consideration.
date — pass: The originalPublished date of 2026-11-06 matches the arXiv v1 submission date. The feed date of November 10 is correctly not used.
[Submitted on 6 Nov 2026]
support — pass: Every claim is quoted almost verbatim from the abstract and attributed to the authors. The stated limitation is accurate, because the abstract does not name the tested models. No benefits, costs or forecasts are invented.
Aggregating an LLM's responses, a common practice in LLM moral evaluation, produced transitive structure that matched no individual choice set.
media — pass: The selected media is the verified direct link to the arXiv abstract page, which is the original source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA language model with many learned numerical settings, used to process and generate language.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA language model with many learned numerical settings, used to process and generate language.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv