{"id":"616690703d8ab2ff65109683a2ab0fd6d725447c32c1012bc3f0572f94395838","title":"arXiv cs.AI: NormGym: Evaluating Normative Competence through Social Interaction","argument":"The authors introduce NormGym, an interactive benchmark for testing whether agents can learn previously unknown norms through social interaction. In its scenarios, an agent must pursue its own task while inferring a hidden norm from behavior and sanctions in a multi-agent community, then apply it in new situations. The authors say this tests more than recognizing or applying norms an agent may already know: it must distinguish what is possible from what is permitted and infer expectations from interaction. They report that the strongest evaluated large language model achieved a 55.3% joint task-and-compliance success rate. Their analysis says models sometimes change their behavior after being sanctioned, but struggle to infer the underlying norm from other agents’ behavior and the sanctions those agents receive. They also report that fine-tuning may be insufficient to improve normative competence. The authors conclude that current models lack a robust, transferable capability for acquiring normative knowledge through social interaction. The abstract describes the benchmark and findings but does not give the evaluation methods or results by norm and environment.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the paper’s abstract; it does not provide evaluation methods or results broken down by norm and environment.","speaker":{"name":"Li, Binze, Zhang, Zihuan, Baek, Seokhyun, Hadfield, Gillian K., Shu, Tianmin","roleAtSource":"Article author"},"source":{"title":"NormGym: Evaluating Normative Competence through Social Interaction","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.08613","publishedAt":"2026-11-05","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors introduce NormGym to evaluate whether agents can acquire previously unknown norms through social interaction while pursuing their own task.","excerpt":"a newcomer must infer a hidden, arbitrary norm while pursuing its own task in a multi-agent community","url":"https://arxiv.org/abs/2611.08613","relationship":"Source-stated"},{"text":"The authors say success requires agents to distinguish what is possible from what is permitted, infer a norm from behavior and sanctions, and apply it in new situations.","excerpt":"Success requires distinguishing what is possible from what is permitted, inferring the norm from observed behavior and sanctions, and applying it in new situations.","url":"https://arxiv.org/abs/2611.08613","relationship":"Source-stated"},{"text":"The strongest evaluated large language model achieved a 55.3% joint task-and-compliance success rate, according to the authors.","excerpt":"the strongest evaluated LLM achieves a joint task-and-compliance success rate of 55.3%.","url":"https://arxiv.org/abs/2611.08613","relationship":"Source-stated"},{"text":"The authors report that models can sometimes change behavior after sanctions for their own actions, but struggle to infer norms from other agents’ behavior and sanctions.","excerpt":"models can sometimes revise their behavior following sanctions for their own actions, but struggle to use other agents' behavior and the sanctions they receive to infer the underlying norm.","url":"https://arxiv.org/abs/2611.08613","relationship":"Source-stated"},{"text":"The authors report that fine-tuning may be insufficient to improve normative competence.","excerpt":"fine-tuning models may be insufficient to improve normative competence.","url":"https://arxiv.org/abs/2611.08613","relationship":"Source-stated"},{"text":"The authors conclude that current models lack a robust, transferable capability for acquiring normative knowledge through social interaction.","excerpt":"current models lack a robust, transferable capability for acquiring normative knowledge through social interaction.","url":"https://arxiv.org/abs/2611.08613","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.08613","checkedAt":"2026-11-13T01:04:08.254Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What approaches, if any, would help agents infer norms from other agents’ behavior and sanctions, rather than mainly changing behavior after their own actions are sanctioned?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: NormGym: Evaluating Normative Competence through Social Interaction","summary":"The authors introduce NormGym, an interactive benchmark for testing whether agents can learn previously unknown norms through social interaction. In its scenarios, an agent must pursue its own task while inferring a hidden norm from behavior and sanctions in a multi-agent community, then apply it in new situations. The authors say this tests more than recognizing or applying norms an agent may already know: it must distinguish what is possible from what is permitted and infer expectations from interaction. They report that the strongest evaluated large language model achieved a 55.3% joint task-and-compliance success rate. Their analysis says models sometimes change their behavior after being sanctioned, but struggle to infer the underlying norm from other agents’ behavior and the sanctions those agents receive. They also report that fine-tuning may be insufficient to improve normative competence. The authors conclude that current models lack a robust, transferable capability for acquiring normative knowledge through social interaction. The abstract describes the benchmark and findings but does not give the evaluation methods or results by norm and environment.","question":"What approaches, if any, would help agents infer norms from other agents’ behavior and sanctions, rather than mainly changing behavior after their own actions are sanctioned?","claims":[{"text":"The authors introduce NormGym to evaluate whether agents can acquire previously unknown norms through social interaction while pursuing their own task.","excerpt":"a newcomer must infer a hidden, arbitrary norm while pursuing its own task in a multi-agent community","support":"source-stated"},{"text":"The authors say success requires agents to distinguish what is possible from what is permitted, infer a norm from behavior and sanctions, and apply it in new situations.","excerpt":"Success requires distinguishing what is possible from what is permitted, inferring the norm from observed behavior and sanctions, and applying it in new situations.","support":"source-stated"},{"text":"The strongest evaluated large language model achieved a 55.3% joint task-and-compliance success rate, according to the authors.","excerpt":"the strongest evaluated LLM achieves a joint task-and-compliance success rate of 55.3%.","support":"source-stated"},{"text":"The authors report that models can sometimes change behavior after sanctions for their own actions, but struggle to infer norms from other agents’ behavior and sanctions.","excerpt":"models can sometimes revise their behavior following sanctions for their own actions, but struggle to use other agents' behavior and the sanctions they receive to infer the underlying norm.","support":"source-stated"},{"text":"The authors report that fine-tuning may be insufficient to improve normative competence.","excerpt":"fine-tuning models may be insufficient to improve normative competence.","support":"source-stated"},{"text":"The authors conclude that current models lack a robust, transferable capability for acquiring normative knowledge through social interaction.","excerpt":"current models lack a robust, transferable capability for acquiring normative knowledge through social interaction.","support":"source-stated"}],"limitations":["The supplied evidence is the paper’s abstract; it does not provide evaluation methods or results broken down by norm and environment."],"mediaId":"69ce3e7f06d8c845ebe1af9e53b01efbf412d422407b608352d16e531e176078","correctionReason":null,"id":"616690703d8ab2ff65109683a2ab0fd6d725447c32c1012bc3f0572f94395838","publicationId":"50b172c7-eea6-4473-85f1-9c1106312cad","version":1,"sourceUrl":"https://arxiv.org/abs/2611.08613","sourceTitle":"NormGym: Evaluating Normative Competence through Social Interaction","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-05","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-09T05:04:22.961Z","createdAt":"2026-11-13T00:01:59.810Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"69ce3e7f06d8c845ebe1af9e53b01efbf412d422407b608352d16e531e176078","kind":"article","url":"https://arxiv.org/abs/2611.08613","sourceUrl":"https://arxiv.org/abs/2611.08613","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-13T00:01:07.177Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.08613","checkedAt":"2026-11-13T01:04:08.254Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v6","mediaId":"69ce3e7f06d8c845ebe1af9e53b01efbf412d422407b608352d16e531e176078","confidence":0.6100000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"5bc472465ba573f117870bf6783e315b9eef7123488a7d341305631a02aa164a","decidedAt":"2026-11-13T00:01:08.354Z"},"provenance":{"textHash":"b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d","observationId":"944b0c04484dc8050a827c5456647597d0384fda0edc284f2bd7bf50d1b32bab","retrievedAt":"2026-11-13T00:01:07.053Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"95db5ff1-ac62-41c3-8b70-937e240a0812"},"reviewer":{"model":"gpt-6-luna","runId":"1aaf027f-1339-4a23-811c-5c65dadc6a66"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-13T00:01:59.810Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Li, Binze","url":null,"kind":"unknown"},{"name":"Zhang, Zihuan","url":null,"kind":"unknown"},{"name":"Baek, Seokhyun","url":null,"kind":"unknown"},{"name":"Hadfield, Gillian K.","url":null,"kind":"unknown"},{"name":"Shu, Tianmin","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Li, Binze","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Li, Binze","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08613","locator":"head/meta[name=author|citation_author]"},"assertionId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T01:04:08.254Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f","sourceUrl":"https://arxiv.org/abs/2611.08613","contentSha256":"1a4540473520c0cafbf431ea29e0bb3fe0572812693a0a12df4045c45c670d38","textHash":"b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d","observedAt":"2026-11-13T01:04:08.254Z"}},{"actor":{"name":"Zhang, Zihuan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Zihuan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08613","locator":"head/meta[name=author|citation_author]"},"assertionId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T01:04:08.254Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f","sourceUrl":"https://arxiv.org/abs/2611.08613","contentSha256":"1a4540473520c0cafbf431ea29e0bb3fe0572812693a0a12df4045c45c670d38","textHash":"b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d","observedAt":"2026-11-13T01:04:08.254Z"}},{"actor":{"name":"Baek, Seokhyun","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Baek, Seokhyun","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08613","locator":"head/meta[name=author|citation_author]"},"assertionId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T01:04:08.254Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f","sourceUrl":"https://arxiv.org/abs/2611.08613","contentSha256":"1a4540473520c0cafbf431ea29e0bb3fe0572812693a0a12df4045c45c670d38","textHash":"b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d","observedAt":"2026-11-13T01:04:08.254Z"}},{"actor":{"name":"Hadfield, Gillian K.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Hadfield, Gillian K.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08613","locator":"head/meta[name=author|citation_author]"},"assertionId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T01:04:08.254Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f","sourceUrl":"https://arxiv.org/abs/2611.08613","contentSha256":"1a4540473520c0cafbf431ea29e0bb3fe0572812693a0a12df4045c45c670d38","textHash":"b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d","observedAt":"2026-11-13T01:04:08.254Z"}},{"actor":{"name":"Shu, Tianmin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Shu, Tianmin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08613","locator":"head/meta[name=author|citation_author]"},"assertionId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T01:04:08.254Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f","sourceUrl":"https://arxiv.org/abs/2611.08613","contentSha256":"1a4540473520c0cafbf431ea29e0bb3fe0572812693a0a12df4045c45c670d38","textHash":"b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d","observedAt":"2026-11-13T01:04:08.254Z"}}],"participationCoverage":{"total":5,"returned":5,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.08613","snapshotId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f","contentSha256":"1a4540473520c0cafbf431ea29e0bb3fe0572812693a0a12df4045c45c670d38","textHash":"b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d","observedAt":"2026-11-13T01:04:08.254Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/616690703d8ab2ff65109683a2ab0fd6d725447c32c1012bc3f0572f94395838/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-normgym-evaluating-normative-competence-through-61669070","formats":{"html":"/readings/arxiv-cs-ai-normgym-evaluating-normative-competence-through-61669070","markdown":"/readings/arxiv-cs-ai-normgym-evaluating-normative-competence-through-61669070.md","json":"/readings/arxiv-cs-ai-normgym-evaluating-normative-competence-through-61669070.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"},{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"},{"id":"term-fine-tuning","name":"Fine-tuning","explanation":"Further training of an existing model to adapt it to a particular task or use.","referenceUrl":"https://developers.google.com/machine-learning/glossary#fine-tuning"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"616690703d8ab2ff65109683a2ab0fd6d725447c32c1012bc3f0572f94395838","revision":"50b172c7-eea6-4473-85f1-9c1106312cad","revisionKind":"publication-id","title":"arXiv cs.AI: NormGym: Evaluating Normative Competence through Social Interaction","url":"https://escapemeridian.com/readings/arxiv-cs-ai-normgym-evaluating-normative-competence-through-61669070"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.08613","revision":"b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d","revisionKind":"sha256-source-text","title":"NormGym: Evaluating Normative Competence through Social Interaction","url":"https://arxiv.org/abs/2611.08613"},"status":"partial","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"616690703d8ab2ff65109683a2ab0fd6d725447c32c1012bc3f0572f94395838","title":"arXiv cs.AI: NormGym: Evaluating Normative Competence through Social Interaction","argument":"The authors introduce NormGym, an interactive benchmark for testing whether agents can learn previously unknown norms through social interaction. In its scenarios, an agent must pursue its own task while inferring a hidden norm from behavior and sanctions in a multi-agent community, then apply it in new situations. The authors say this tests more than recognizing or applying norms an agent may already know: it must distinguish what is possible from what is permitted and infer expectations from interaction. They report that the strongest evaluated large language model achieved a 55.3% joint task-and-compliance success rate. Their analysis says models sometimes change their behavior after being sanctioned, but struggle to infer the underlying norm from other agents’ behavior and the sanctions those agents receive. They also report that fine-tuning may be insufficient to improve normative competence. The authors conclude that current models lack a robust, transferable capability for acquiring normative knowledge through social interaction. The abstract describes the benchmark and findings but does not give the evaluation methods or results by norm and environment.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the paper’s abstract; it does not provide evaluation methods or results broken down by norm and environment.","speaker":{"name":"Li, Binze, Zhang, Zihuan, Baek, Seokhyun, Hadfield, Gillian K., Shu, Tianmin","roleAtSource":"Article author"},"source":{"title":"NormGym: Evaluating Normative Competence through Social Interaction","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.08613","publishedAt":"2026-11-05","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors introduce NormGym to evaluate whether agents can acquire previously unknown norms through social interaction while pursuing their own task.","excerpt":"a newcomer must infer a hidden, arbitrary norm while pursuing its own task in a multi-agent community","url":"https://arxiv.org/abs/2611.08613","relationship":"Source-stated"},{"text":"The authors say success requires agents to distinguish what is possible from what is permitted, infer a norm from behavior and sanctions, and apply it in new situations.","excerpt":"Success requires distinguishing what is possible from what is permitted, inferring the norm from observed behavior and sanctions, and applying it in new situations.","url":"https://arxiv.org/abs/2611.08613","relationship":"Source-stated"},{"text":"The strongest evaluated large language model achieved a 55.3% joint task-and-compliance success rate, according to the authors.","excerpt":"the strongest evaluated LLM achieves a joint task-and-compliance success rate of 55.3%.","url":"https://arxiv.org/abs/2611.08613","relationship":"Source-stated"},{"text":"The authors report that models can sometimes change behavior after sanctions for their own actions, but struggle to infer norms from other agents’ behavior and sanctions.","excerpt":"models can sometimes revise their behavior following sanctions for their own actions, but struggle to use other agents' behavior and the sanctions they receive to infer the underlying norm.","url":"https://arxiv.org/abs/2611.08613","relationship":"Source-stated"},{"text":"The authors report that fine-tuning may be insufficient to improve normative competence.","excerpt":"fine-tuning models may be insufficient to improve normative competence.","url":"https://arxiv.org/abs/2611.08613","relationship":"Source-stated"},{"text":"The authors conclude that current models lack a robust, transferable capability for acquiring normative knowledge through social interaction.","excerpt":"current models lack a robust, transferable capability for acquiring normative knowledge through social interaction.","url":"https://arxiv.org/abs/2611.08613","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.08613","checkedAt":"2026-11-13T01:04:08.254Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What approaches, if any, would help agents infer norms from other agents’ behavior and sanctions, rather than mainly changing behavior after their own actions are sanctioned?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: NormGym: Evaluating Normative Competence through Social Interaction","summary":"The authors introduce NormGym, an interactive benchmark for testing whether agents can learn previously unknown norms through social interaction. In its scenarios, an agent must pursue its own task while inferring a hidden norm from behavior and sanctions in a multi-agent community, then apply it in new situations. The authors say this tests more than recognizing or applying norms an agent may already know: it must distinguish what is possible from what is permitted and infer expectations from interaction. They report that the strongest evaluated large language model achieved a 55.3% joint task-and-compliance success rate. Their analysis says models sometimes change their behavior after being sanctioned, but struggle to infer the underlying norm from other agents’ behavior and the sanctions those agents receive. They also report that fine-tuning may be insufficient to improve normative competence. The authors conclude that current models lack a robust, transferable capability for acquiring normative knowledge through social interaction. The abstract describes the benchmark and findings but does not give the evaluation methods or results by norm and environment.","question":"What approaches, if any, would help agents infer norms from other agents’ behavior and sanctions, rather than mainly changing behavior after their own actions are sanctioned?","claims":[{"text":"The authors introduce NormGym to evaluate whether agents can acquire previously unknown norms through social interaction while pursuing their own task.","excerpt":"a newcomer must infer a hidden, arbitrary norm while pursuing its own task in a multi-agent community","support":"source-stated"},{"text":"The authors say success requires agents to distinguish what is possible from what is permitted, infer a norm from behavior and sanctions, and apply it in new situations.","excerpt":"Success requires distinguishing what is possible from what is permitted, inferring the norm from observed behavior and sanctions, and applying it in new situations.","support":"source-stated"},{"text":"The strongest evaluated large language model achieved a 55.3% joint task-and-compliance success rate, according to the authors.","excerpt":"the strongest evaluated LLM achieves a joint task-and-compliance success rate of 55.3%.","support":"source-stated"},{"text":"The authors report that models can sometimes change behavior after sanctions for their own actions, but struggle to infer norms from other agents’ behavior and sanctions.","excerpt":"models can sometimes revise their behavior following sanctions for their own actions, but struggle to use other agents' behavior and the sanctions they receive to infer the underlying norm.","support":"source-stated"},{"text":"The authors report that fine-tuning may be insufficient to improve normative competence.","excerpt":"fine-tuning models may be insufficient to improve normative competence.","support":"source-stated"},{"text":"The authors conclude that current models lack a robust, transferable capability for acquiring normative knowledge through social interaction.","excerpt":"current models lack a robust, transferable capability for acquiring normative knowledge through social interaction.","support":"source-stated"}],"limitations":["The supplied evidence is the paper’s abstract; it does not provide evaluation methods or results broken down by norm and environment."],"mediaId":"69ce3e7f06d8c845ebe1af9e53b01efbf412d422407b608352d16e531e176078","correctionReason":null,"id":"616690703d8ab2ff65109683a2ab0fd6d725447c32c1012bc3f0572f94395838","publicationId":"50b172c7-eea6-4473-85f1-9c1106312cad","version":1,"sourceUrl":"https://arxiv.org/abs/2611.08613","sourceTitle":"NormGym: Evaluating Normative Competence through Social Interaction","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-05","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-09T05:04:22.961Z","createdAt":"2026-11-13T00:01:59.810Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"69ce3e7f06d8c845ebe1af9e53b01efbf412d422407b608352d16e531e176078","kind":"article","url":"https://arxiv.org/abs/2611.08613","sourceUrl":"https://arxiv.org/abs/2611.08613","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-13T00:01:07.177Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.08613","checkedAt":"2026-11-13T01:04:08.254Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v6","mediaId":"69ce3e7f06d8c845ebe1af9e53b01efbf412d422407b608352d16e531e176078","confidence":0.6100000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"5bc472465ba573f117870bf6783e315b9eef7123488a7d341305631a02aa164a","decidedAt":"2026-11-13T00:01:08.354Z"},"provenance":{"textHash":"b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d","observationId":"944b0c04484dc8050a827c5456647597d0384fda0edc284f2bd7bf50d1b32bab","retrievedAt":"2026-11-13T00:01:07.053Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"95db5ff1-ac62-41c3-8b70-937e240a0812"},"reviewer":{"model":"gpt-6-luna","runId":"1aaf027f-1339-4a23-811c-5c65dadc6a66"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-13T00:01:59.810Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Li, Binze","url":null,"kind":"unknown"},{"name":"Zhang, Zihuan","url":null,"kind":"unknown"},{"name":"Baek, Seokhyun","url":null,"kind":"unknown"},{"name":"Hadfield, Gillian K.","url":null,"kind":"unknown"},{"name":"Shu, Tianmin","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Li, Binze","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Li, Binze","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08613","locator":"head/meta[name=author|citation_author]"},"assertionId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T01:04:08.254Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f","sourceUrl":"https://arxiv.org/abs/2611.08613","contentSha256":"1a4540473520c0cafbf431ea29e0bb3fe0572812693a0a12df4045c45c670d38","textHash":"b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d","observedAt":"2026-11-13T01:04:08.254Z"}},{"actor":{"name":"Zhang, Zihuan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Zihuan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08613","locator":"head/meta[name=author|citation_author]"},"assertionId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T01:04:08.254Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f","sourceUrl":"https://arxiv.org/abs/2611.08613","contentSha256":"1a4540473520c0cafbf431ea29e0bb3fe0572812693a0a12df4045c45c670d38","textHash":"b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d","observedAt":"2026-11-13T01:04:08.254Z"}},{"actor":{"name":"Baek, Seokhyun","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Baek, Seokhyun","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08613","locator":"head/meta[name=author|citation_author]"},"assertionId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T01:04:08.254Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f","sourceUrl":"https://arxiv.org/abs/2611.08613","contentSha256":"1a4540473520c0cafbf431ea29e0bb3fe0572812693a0a12df4045c45c670d38","textHash":"b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d","observedAt":"2026-11-13T01:04:08.254Z"}},{"actor":{"name":"Hadfield, Gillian K.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Hadfield, Gillian K.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08613","locator":"head/meta[name=author|citation_author]"},"assertionId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T01:04:08.254Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f","sourceUrl":"https://arxiv.org/abs/2611.08613","contentSha256":"1a4540473520c0cafbf431ea29e0bb3fe0572812693a0a12df4045c45c670d38","textHash":"b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d","observedAt":"2026-11-13T01:04:08.254Z"}},{"actor":{"name":"Shu, Tianmin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Shu, Tianmin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08613","locator":"head/meta[name=author|citation_author]"},"assertionId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T01:04:08.254Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f","sourceUrl":"https://arxiv.org/abs/2611.08613","contentSha256":"1a4540473520c0cafbf431ea29e0bb3fe0572812693a0a12df4045c45c670d38","textHash":"b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d","observedAt":"2026-11-13T01:04:08.254Z"}}],"participationCoverage":{"total":5,"returned":5,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.08613","snapshotId":"27f007f8dfcad26ed5b9c161c8ff5ddbe20a1b5a0e0d257c5db6b85cdaac7a3f","contentSha256":"1a4540473520c0cafbf431ea29e0bb3fe0572812693a0a12df4045c45c670d38","textHash":"b8133757a0d1181138b70c5f19084daaf1a545982e3abb45331a881a11fb227d","observedAt":"2026-11-13T01:04:08.254Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/616690703d8ab2ff65109683a2ab0fd6d725447c32c1012bc3f0572f94395838/source"}}}],"audits":[{"publicationId":"50b172c7-eea6-4473-85f1-9c1106312cad","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading attributes NormGym, the 55.3% result, the sanction findings, the fine-tuning finding and the conclusion to the paper's authors. It does not present these as established fact or as Escape Meridian's view. The authors listed in the evidence match an arXiv cs.AI submission.","excerpt":"Authors:Binze Li, Zihuan Zhang, Seokhyun Baek, Gillian K. Hadfield, Tianmin Shu"},{"dimension":"summary","status":"uncertain","explanation":"The reading is accurate, but it omits two things a general reader needs. First, 'normative competence' is a central term that appears in the summary's later sentences without its source definition. Second, it drops the source's stated stake: this ability is essential for agents operating in unfamiliar human communities. Without these, a non-specialist may not understand what is measured or why the 55.3% result matters. Smallest repair: add the source's definition (inferring socially enforced expectations from interaction and adjusting behavior) and its reason for importance, attributed to the authors. Also add a term-library tooltip for 'fine-tuning'.","excerpt":"Normative competence, the ability to infer socially enforced expectations from interaction and adjust behavior accordingly, is essential for agents operating in unfamiliar human communities."},{"dimension":"date","status":"pass","explanation":"The value in evidence.originalPublished, 2026-11-05, matches the arXiv v1 submission date. It is not the later feed date of 2026-11-09.","excerpt":"[Submitted on 5 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim matches its verbatim excerpt from the abstract. The 'may be insufficient' hedge is preserved. The question follows directly from the reported own-sanction versus others'-sanction gap and does not presuppose an answer. The limitation correctly notes that the evidence is an abstract without per-norm or per-environment results.","excerpt":"models can sometimes revise their behavior following sanctions for their own actions, but struggle to use other agents' behavior and the sanctions they receive to infer the underlying norm."},{"dimension":"media","status":"pass","explanation":"The selected media ID is the verified direct link to the original arXiv abstract page. This is the most direct way for readers to reach the source.","excerpt":null}],"createdAt":"2026-11-13T00:01:59.810Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}