# arXiv cs.AI: NormGym: Evaluating Normative Competence through Social Interaction [Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-normgym-evaluating-normative-competence-through-61669070) The authors introduce NormGym, an interactive benchmark for testing whether agents can learn previously unknown norms through social interaction. In its scenarios, an agent must pursue its own task while inferring a hidden norm from behavior and sanctions in a multi-agent community, then apply it in new situations. The authors say this tests more than recognizing or applying norms an agent may already know: it must distinguish what is possible from what is permitted and infer expectations from interaction. They report that the strongest evaluated large language model achieved a 55.3% joint task-and-compliance success rate. Their analysis says models sometimes change their behavior after being sanctioned, but struggle to infer the underlying norm from other agents’ behavior and the sanctions those agents receive. They also report that fine-tuning may be insufficient to improve normative competence. The authors conclude that current models lack a robust, transferable capability for acquiring normative knowledge through social interaction. The abstract describes the benchmark and findings but does not give the evaluation methods or results by norm and environment. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: Nov 5, 2026 (2026-11-05). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-13T00:01:59.810Z. First observed: 2026-11-09T05:04:22.961Z. Retrieved: 2026-11-13T00:01:07.053Z. - [NormGym: Evaluating Normative Competence through Social Interaction](https://arxiv.org/abs/2611.08613) ## Limits The supplied evidence is the paper’s abstract; it does not provide evaluation methods or results broken down by norm and environment. ## Open question What approaches, if any, would help agents infer norms from other agents’ behavior and sanctions, rather than mainly changing behavior after their own actions are sanctioned? ## Source-stated The authors introduce NormGym to evaluate whether agents can acquire previously unknown norms through social interaction while pursuing their own task. > a newcomer must infer a hidden, arbitrary norm while pursuing its own task in a multi-agent community - [Supporting source](https://arxiv.org/abs/2611.08613) ## Source-stated The authors say success requires agents to distinguish what is possible from what is permitted, infer a norm from behavior and sanctions, and apply it in new situations. > Success requires distinguishing what is possible from what is permitted, inferring the norm from observed behavior and sanctions, and applying it in new situations. - [Supporting source](https://arxiv.org/abs/2611.08613) ## Source-stated The strongest evaluated large language model achieved a 55.3% joint task-and-compliance success rate, according to the authors. > the strongest evaluated LLM achieves a joint task-and-compliance success rate of 55.3%. - [Supporting source](https://arxiv.org/abs/2611.08613) ## Source-stated The authors report that models can sometimes change behavior after sanctions for their own actions, but struggle to infer norms from other agents’ behavior and sanctions. > models can sometimes revise their behavior following sanctions for their own actions, but struggle to use other agents' behavior and the sanctions they receive to infer the underlying norm. - [Supporting source](https://arxiv.org/abs/2611.08613) ## Source-stated The authors report that fine-tuning may be insufficient to improve normative competence. > fine-tuning models may be insufficient to improve normative competence. - [Supporting source](https://arxiv.org/abs/2611.08613) ## Source-stated The authors conclude that current models lack a robust, transferable capability for acquiring normative knowledge through social interaction. > current models lack a robust, transferable capability for acquiring normative knowledge through social interaction. - [Supporting source](https://arxiv.org/abs/2611.08613) ## Source and contributor context Li, Binze, Zhang, Zihuan, Baek, Seokhyun, Hadfield, Gillian K., Shu, Tianmin · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## Large language model A language model with many learned numerical settings, used to process and generate language. - [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model) ## Fine-tuning Further training of an existing model to adapt it to a particular task or use. - [Definition reference](https://developers.google.com/machine-learning/glossary#fine-tuning) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 50b172c7-eea6-4473-85f1-9c1106312cad. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-13T00:01:59.810Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 944b0c04484dc8050a827c5456647597d0384fda0edc284f2bd7bf50d1b32bab. Source text hash: b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d. ## Revision and source-check history ### Version 1 — 2026-11-13T00:01:59.810Z The authors introduce NormGym, an interactive benchmark for testing whether agents can learn previously unknown norms through social interaction. In its scenarios, an agent must pursue its own task while inferring a hidden norm from behavior and sanctions in a multi-agent community, then apply it in new situations. The authors say this tests more than recognizing or applying norms an agent may already know: it must distinguish what is possible from what is permitted and infer expectations from interaction. They report that the strongest evaluated large language model achieved a 55.3% joint task-and-compliance success rate. Their analysis says models sometimes change their behavior after being sanctioned, but struggle to infer the underlying norm from other agents’ behavior and the sanctions those agents receive. They also report that fine-tuning may be insufficient to improve normative competence. The authors conclude that current models lack a robust, transferable capability for acquiring normative knowledge through social interaction. The abstract describes the benchmark and findings but does not give the evaluation methods or results by norm and environment. ## Original source arXiv cs.AI · Article Original source date: Nov 5, 2026 (2026-11-05). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-13T00:01:59.810Z. First observed: 2026-11-09T05:04:22.961Z. Retrieved: 2026-11-13T00:01:07.053Z. - [NormGym: Evaluating Normative Competence through Social Interaction](https://arxiv.org/abs/2611.08613) ## Limits The supplied evidence is the paper’s abstract; it does not provide evaluation methods or results broken down by norm and environment. ## Open question What approaches, if any, would help agents infer norms from other agents’ behavior and sanctions, rather than mainly changing behavior after their own actions are sanctioned? ## Source-stated The authors introduce NormGym to evaluate whether agents can acquire previously unknown norms through social interaction while pursuing their own task. > a newcomer must infer a hidden, arbitrary norm while pursuing its own task in a multi-agent community - [Supporting source](https://arxiv.org/abs/2611.08613) ## Source-stated The authors say success requires agents to distinguish what is possible from what is permitted, infer a norm from behavior and sanctions, and apply it in new situations. > Success requires distinguishing what is possible from what is permitted, inferring the norm from observed behavior and sanctions, and applying it in new situations. - [Supporting source](https://arxiv.org/abs/2611.08613) ## Source-stated The strongest evaluated large language model achieved a 55.3% joint task-and-compliance success rate, according to the authors. > the strongest evaluated LLM achieves a joint task-and-compliance success rate of 55.3%. - [Supporting source](https://arxiv.org/abs/2611.08613) ## Source-stated The authors report that models can sometimes change behavior after sanctions for their own actions, but struggle to infer norms from other agents’ behavior and sanctions. > models can sometimes revise their behavior following sanctions for their own actions, but struggle to use other agents' behavior and the sanctions they receive to infer the underlying norm. - [Supporting source](https://arxiv.org/abs/2611.08613) ## Source-stated The authors report that fine-tuning may be insufficient to improve normative competence. > fine-tuning models may be insufficient to improve normative competence. - [Supporting source](https://arxiv.org/abs/2611.08613) ## Source-stated The authors conclude that current models lack a robust, transferable capability for acquiring normative knowledge through social interaction. > current models lack a robust, transferable capability for acquiring normative knowledge through social interaction. - [Supporting source](https://arxiv.org/abs/2611.08613) ## Source and contributor context Li, Binze, Zhang, Zihuan, Baek, Seokhyun, Hadfield, Gillian K., Shu, Tianmin · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## Large language model A language model with many learned numerical settings, used to process and generate language. - [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model) ## Fine-tuning Further training of an existing model to adapt it to a particular task or use. - [Definition reference](https://developers.google.com/machine-learning/glossary#fine-tuning) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 50b172c7-eea6-4473-85f1-9c1106312cad. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-13T00:01:59.810Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 944b0c04484dc8050a827c5456647597d0384fda0edc284f2bd7bf50d1b32bab. Source text hash: b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d. ### uncertain — 2026-11-13T00:01:59.810Z — anthropic/claude-opus-5.5 Publication: 50b172c7-eea6-4473-85f1-9c1106312cad attribution — pass: The reading attributes NormGym, the 55.3% result, the sanction findings, the fine-tuning finding and the conclusion to the paper's authors. It does not present these as established fact or as Escape Meridian's view. The authors listed in the evidence match an arXiv cs.AI submission. > Authors:Binze Li, Zihuan Zhang, Seokhyun Baek, Gillian K. Hadfield, Tianmin Shu summary — uncertain: The reading is accurate, but it omits two things a general reader needs. First, 'normative competence' is a central term that appears in the summary's later sentences without its source definition. Second, it drops the source's stated stake: this ability is essential for agents operating in unfamiliar human communities. Without these, a non-specialist may not understand what is measured or why the 55.3% result matters. Smallest repair: add the source's definition (inferring socially enforced expectations from interaction and adjusting behavior) and its reason for importance, attributed to the authors. Also add a term-library tooltip for 'fine-tuning'. > Normative competence, the ability to infer socially enforced expectations from interaction and adjust behavior accordingly, is essential for agents operating in unfamiliar human communities. date — pass: The value in evidence.originalPublished, 2026-11-05, matches the arXiv v1 submission date. It is not the later feed date of 2026-11-09. > \[Submitted on 5 Nov 2026\] support — pass: Each claim matches its verbatim excerpt from the abstract. The 'may be insufficient' hedge is preserved. The question follows directly from the reported own-sanction versus others'-sanction gap and does not presuppose an answer. The limitation correctly notes that the evidence is an abstract without per-norm or per-environment results. > models can sometimes revise their behavior following sanctions for their own actions, but struggle to use other agents' behavior and the sanctions they receive to infer the underlying norm. media — pass: The selected media ID is the verified direct link to the original arXiv abstract page. This is the most direct way for readers to reach the source. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/616690703d8ab2ff65109683a2ab0fd6d725447c32c1012bc3f0572f94395838/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-normgym-evaluating-normative-competence-through-61669070.json)