# arXiv cs.AI: Do large language models rank moral values? A transitivity test of moral competence [Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-do-large-language-models-rank-moral-values-a-631b69ad) The authors argue that strong performance on morality benchmarks does not show that a large language model can weigh competing moral values in a decision. They test a minimal condition for that ability: whether the model’s moral choices can be represented by an ordinal ranking, an ordering of values. Such a ranking requires transitivity: if one value is preferred to a second, and the second to a third, the first must also be preferred to the third. The authors presented models with pairwise trade-offs between moral value violations in vignettes and derived choice probabilities from first-token distributions. They report that most choice sets admitted weak or unstable orderings when compared with three stochastic transitive choice models. They also report that aggregating responses—a common practice in LLM moral evaluation—produced transitive structure that matched no individual choice set. The distinction matters for how moral evaluations are interpreted: according to the authors, producing appropriate benchmark answers is not enough to establish that choices are structured for weighing values. They argue that evaluations should establish this structure before asking whether choices are aligned. The supplied abstract does not identify the models or describe the choice sets in detail, so it does not show how the reported results vary across models or scenarios. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: Nov 6, 2026 (2026-11-06). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-12T10:02:58.590Z. First observed: 2026-11-10T08:33:49.835Z. Retrieved: 2026-11-12T10:02:06.706Z. - [Do large language models rank moral values? A transitivity test of moral competence](https://arxiv.org/abs/2611.10265) ## Limits The supplied source text contains the abstract but does not identify the tested models or provide details of the vignette choice sets, limiting assessment of how the findings vary across models or scenarios. ## Open question Which model-specific and choice-set results underlie the finding that most choice sets admitted weak or unstable orderings? ## Source-stated The authors distinguish moral performance on benchmarks from moral competence in weighing competing values; benchmark performance alone does not establish competence. > producing appropriate outputs on these benchmarks (moral performance) does not establish that an LLM weighs competing moral values at stake in a decision - [Supporting source](https://arxiv.org/abs/2611.10265) ## Source-stated The authors test whether an ordinal ranking can represent LLM moral choices, a minimal necessary condition for weighing values, and note that such a ranking requires transitivity. > Such a ranking requires transitivity. - [Supporting source](https://arxiv.org/abs/2611.10265) ## Source-stated The authors presented LLMs with pairwise trade-offs among moral value violations in vignette choice sets and extracted choice probabilities from first-token distributions. > we presented LLMs with pairwise trade-offs among moral value violations in vignette choice sets and extracted resulting choice probabilities from first-token distributions - [Supporting source](https://arxiv.org/abs/2611.10265) ## Source-stated Compared with three stochastic transitive choice models, most choice sets admitted weak or unstable orderings. > Tested against three stochastic transitive choice models, most choice sets admitted weak or unstable orderings. - [Supporting source](https://arxiv.org/abs/2611.10265) ## Source-stated The authors report that aggregating responses produced transitive structure matching no individual choice set. > Aggregating an LLM's responses, a common practice in LLM moral evaluation, produced transitive structure that matched no individual choice set. - [Supporting source](https://arxiv.org/abs/2611.10265) ## Source-stated The authors argue that evaluations should establish whether choices are structured before assessing whether they are aligned. > Evaluations of AI morality should establish that choices are structured before asking whether they are aligned. - [Supporting source](https://arxiv.org/abs/2611.10265) ## Source and contributor context Wasson, Katelyn A., Song, Kiwon, Jennings III, James M., Currie, Brittney, Sokratous, Konstantina, Stober, Clintin P. · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Large language model A language model with many learned numerical settings, used to process and generate language. - [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model) ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: dc3edc06-54a7-45fd-8675-36766e9600c7. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-12T10:02:58.590Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 050b07d5fdb2bf8d3d73ccdf9ce7c07472e7726d28f25869d4d5f8297a71dc90. Source text hash: 05cfd2b60366d639087f5f00949b8f60240fade1da604102209a5962a6f5faaa. ## Revision and source-check history ### Version 1 — 2026-11-12T10:02:58.590Z The authors argue that strong performance on morality benchmarks does not show that a large language model can weigh competing moral values in a decision. They test a minimal condition for that ability: whether the model’s moral choices can be represented by an ordinal ranking, an ordering of values. Such a ranking requires transitivity: if one value is preferred to a second, and the second to a third, the first must also be preferred to the third. The authors presented models with pairwise trade-offs between moral value violations in vignettes and derived choice probabilities from first-token distributions. They report that most choice sets admitted weak or unstable orderings when compared with three stochastic transitive choice models. They also report that aggregating responses—a common practice in LLM moral evaluation—produced transitive structure that matched no individual choice set. The distinction matters for how moral evaluations are interpreted: according to the authors, producing appropriate benchmark answers is not enough to establish that choices are structured for weighing values. They argue that evaluations should establish this structure before asking whether choices are aligned. The supplied abstract does not identify the models or describe the choice sets in detail, so it does not show how the reported results vary across models or scenarios. ## Original source arXiv cs.AI · Article Original source date: Nov 6, 2026 (2026-11-06). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-12T10:02:58.590Z. First observed: 2026-11-10T08:33:49.835Z. Retrieved: 2026-11-12T10:02:06.706Z. - [Do large language models rank moral values? A transitivity test of moral competence](https://arxiv.org/abs/2611.10265) ## Limits The supplied source text contains the abstract but does not identify the tested models or provide details of the vignette choice sets, limiting assessment of how the findings vary across models or scenarios. ## Open question Which model-specific and choice-set results underlie the finding that most choice sets admitted weak or unstable orderings? ## Source-stated The authors distinguish moral performance on benchmarks from moral competence in weighing competing values; benchmark performance alone does not establish competence. > producing appropriate outputs on these benchmarks (moral performance) does not establish that an LLM weighs competing moral values at stake in a decision - [Supporting source](https://arxiv.org/abs/2611.10265) ## Source-stated The authors test whether an ordinal ranking can represent LLM moral choices, a minimal necessary condition for weighing values, and note that such a ranking requires transitivity. > Such a ranking requires transitivity. - [Supporting source](https://arxiv.org/abs/2611.10265) ## Source-stated The authors presented LLMs with pairwise trade-offs among moral value violations in vignette choice sets and extracted choice probabilities from first-token distributions. > we presented LLMs with pairwise trade-offs among moral value violations in vignette choice sets and extracted resulting choice probabilities from first-token distributions - [Supporting source](https://arxiv.org/abs/2611.10265) ## Source-stated Compared with three stochastic transitive choice models, most choice sets admitted weak or unstable orderings. > Tested against three stochastic transitive choice models, most choice sets admitted weak or unstable orderings. - [Supporting source](https://arxiv.org/abs/2611.10265) ## Source-stated The authors report that aggregating responses produced transitive structure matching no individual choice set. > Aggregating an LLM's responses, a common practice in LLM moral evaluation, produced transitive structure that matched no individual choice set. - [Supporting source](https://arxiv.org/abs/2611.10265) ## Source-stated The authors argue that evaluations should establish whether choices are structured before assessing whether they are aligned. > Evaluations of AI morality should establish that choices are structured before asking whether they are aligned. - [Supporting source](https://arxiv.org/abs/2611.10265) ## Source and contributor context Wasson, Katelyn A., Song, Kiwon, Jennings III, James M., Currie, Brittney, Sokratous, Konstantina, Stober, Clintin P. · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Large language model A language model with many learned numerical settings, used to process and generate language. - [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model) ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: dc3edc06-54a7-45fd-8675-36766e9600c7. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-12T10:02:58.590Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 050b07d5fdb2bf8d3d73ccdf9ce7c07472e7726d28f25869d4d5f8297a71dc90. Source text hash: 05cfd2b60366d639087f5f00949b8f60240fade1da604102209a5962a6f5faaa. ### passed — 2026-11-12T10:02:58.590Z — anthropic/claude-opus-5.5 Publication: dc3edc06-54a7-45fd-8675-36766e9600c7 attribution — pass: The reading consistently attributes the argument, method and findings to 'the authors' of the arXiv paper. It keeps their conclusions as their claims rather than as established facts or Escape Meridian's views. > Authors:Katelyn A. Wasson, Kiwon Song, James M. Jennings III, Brittney Currie, Konstantina Sokratous, Clintin P. Stober summary — pass: The reading faithfully covers the abstract: performance versus competence, the transitivity test, the method, both findings and the call to check structure before alignment. It explains ordinal ranking and transitivity plainly. Optional tooltips: stochastic transitive choice models, first-token distributions, vignette, alignment. Smallest repair: add the abstract's opening stake that LLMs are increasingly used to support decisions requiring moral consideration. The question addresses a real gap. > LLMs are increasingly used to support decisions that require moral consideration. date — pass: The originalPublished date of 2026-11-06 matches the arXiv v1 submission date. The feed date of November 10 is correctly not used. > \[Submitted on 6 Nov 2026\] support — pass: Every claim is quoted almost verbatim from the abstract and attributed to the authors. The stated limitation is accurate, because the abstract does not name the tested models. No benefits, costs or forecasts are invented. > Aggregating an LLM's responses, a common practice in LLM moral evaluation, produced transitive structure that matched no individual choice set. media — pass: The selected media is the verified direct link to the arXiv abstract page, which is the original source. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/631b69ad79e5f65c05ed41279e9f53305d17422126963f1b47e718cb92a34d65/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-do-large-language-models-rank-moral-values-a-631b69ad.json)