{"id":"784ba4a468562824e3e961998478c0c2a692f1bd4cfec7723b759707d669b8e6","title":"arXiv: SAVeR²: Reasoning-based Safety Alignment for Large Reasoning Models via Verifiable Rewards","argument":"The authors of SAVeR² argue that safety alignment for Large Reasoning Models (LRMs) can use the models’ own reasoning, rather than treating reasoning only as a source of risk or a cost to safety. Their method breaks safety objectives into four fine-grained verifiable reward signals, selects training data according to difficulty, and uses reasoning-preserving gradient projection to resolve conflicts between safety and reasoning gradients. The authors say this approach addresses weaknesses in existing alignment methods, including poor adversarial generalization and coarse-grained rewards that may not faithfully reflect safety. They say the reasoning-preserving gradient projection mechanism effectively eliminates the “safety tax” on reasoning. They report experiments on models ranging from 1.5B to 671B, with superior safety performance and lower over-refusal rates across multiple benchmarks, without compromising general reasoning capabilities. Escape Meridian interpretation: if borne out beyond those evaluations, the approach could help make reasoning models safer without making them more likely to refuse acceptable requests. The abstract does not establish how well these results transfer to other settings.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence is the paper abstract, which reports experimental outcomes but does not give the benchmark names, evaluation details, or results by model. The abstract’s claims about improved safety, reduced over-refusal, and no compromise to general reasoning are the authors’ reported findings, not independently established here.","speaker":{"name":"Sun, Yichen, Liu, Qirui, Wang, Yan, Lin, Jianan, Jiang, Linbo, Wang, Shiyu, Wang, Zhibo, Chu, Zhixuan","roleAtSource":"Article author"},"source":{"title":"SAVeR$^2$: Reasoning-based Safety Alignment for Large Reasoning Models via Verifiable Rewards","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.07482","publishedAt":"2026-11-05","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors define LRM safety as requiring non-malicious reasoning and answers, safety consistency, and explicit intent identification.","excerpt":"We formalize LRM safety objectives as requiring non-malicious reasoning and answers, safety consistency, and explicit intent identification.","url":"https://arxiv.org/abs/2611.07482","relationship":"Source-stated"},{"text":"The authors say existing alignment methods have poor adversarial generalization, impose a “safety tax” on reasoning, and use unfaithful coarse-grained rewards.","excerpt":"existing alignment methods suffer from poor adversarial generalization, a significant ``safety tax'' on reasoning, and unfaithful coarse-grained rewards","url":"https://arxiv.org/abs/2611.07482","relationship":"Source-stated"},{"text":"SAVeR² uses four fine-grained verifiable reward signals, difficulty-aware data selection, and reasoning-preserving gradient projection to address conflicts between safety and reasoning gradients.","excerpt":"decomposes the safety objective into four fine-grained verifiable reward signals and utilizes a difficulty-aware data selection strategy to stabilize training. Crucially, we introduce a reasoning-preserving gradient projection mechanism","url":"https://arxiv.org/abs/2611.07482","relationship":"Source-stated"},{"text":"The authors report that experiments across models from 1.5B to 671B showed higher safety performance and lower over-refusal rates across multiple benchmarks, without compromising general reasoning capabilities.","excerpt":"Extensive experiments on models ranging from 1.5B to 671B demonstrate that SAVeR$^2$ achieves superior safety performance and significantly lower over-refusal rates across multiple benchmarks without compromising general reasoning capabilities.","url":"https://arxiv.org/abs/2611.07482","relationship":"Source-stated"},{"text":"If the reported results extend beyond the evaluated benchmarks, SAVeR² could help improve safety without increasing refusals of acceptable requests.","excerpt":"significantly lower over-refusal rates across multiple benchmarks without compromising general reasoning capabilities","url":"https://arxiv.org/abs/2611.07482","relationship":"Escape Meridian interpretation"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.07482","checkedAt":"2026-11-08T18:38:07.530Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Which adversarial settings and benchmarks were used to evaluate SAVeR², and how well do its reported results hold beyond them?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv: SAVeR²: Reasoning-based Safety Alignment for Large Reasoning Models via Verifiable Rewards","summary":"The authors of SAVeR² argue that safety alignment for Large Reasoning Models (LRMs) can use the models’ own reasoning, rather than treating reasoning only as a source of risk or a cost to safety. Their method breaks safety objectives into four fine-grained verifiable reward signals, selects training data according to difficulty, and uses reasoning-preserving gradient projection to resolve conflicts between safety and reasoning gradients. The authors say this approach addresses weaknesses in existing alignment methods, including poor adversarial generalization and coarse-grained rewards that may not faithfully reflect safety. They say the reasoning-preserving gradient projection mechanism effectively eliminates the “safety tax” on reasoning. They report experiments on models ranging from 1.5B to 671B, with superior safety performance and lower over-refusal rates across multiple benchmarks, without compromising general reasoning capabilities. Escape Meridian interpretation: if borne out beyond those evaluations, the approach could help make reasoning models safer without making them more likely to refuse acceptable requests. The abstract does not establish how well these results transfer to other settings.","question":"Which adversarial settings and benchmarks were used to evaluate SAVeR², and how well do its reported results hold beyond them?","claims":[{"text":"The authors define LRM safety as requiring non-malicious reasoning and answers, safety consistency, and explicit intent identification.","excerpt":"We formalize LRM safety objectives as requiring non-malicious reasoning and answers, safety consistency, and explicit intent identification.","support":"source-stated"},{"text":"The authors say existing alignment methods have poor adversarial generalization, impose a “safety tax” on reasoning, and use unfaithful coarse-grained rewards.","excerpt":"existing alignment methods suffer from poor adversarial generalization, a significant ``safety tax'' on reasoning, and unfaithful coarse-grained rewards","support":"source-stated"},{"text":"SAVeR² uses four fine-grained verifiable reward signals, difficulty-aware data selection, and reasoning-preserving gradient projection to address conflicts between safety and reasoning gradients.","excerpt":"decomposes the safety objective into four fine-grained verifiable reward signals and utilizes a difficulty-aware data selection strategy to stabilize training. Crucially, we introduce a reasoning-preserving gradient projection mechanism","support":"source-stated"},{"text":"The authors report that experiments across models from 1.5B to 671B showed higher safety performance and lower over-refusal rates across multiple benchmarks, without compromising general reasoning capabilities.","excerpt":"Extensive experiments on models ranging from 1.5B to 671B demonstrate that SAVeR$^2$ achieves superior safety performance and significantly lower over-refusal rates across multiple benchmarks without compromising general reasoning capabilities.","support":"source-stated"},{"text":"If the reported results extend beyond the evaluated benchmarks, SAVeR² could help improve safety without increasing refusals of acceptable requests.","excerpt":"significantly lower over-refusal rates across multiple benchmarks without compromising general reasoning capabilities","support":"interpretation"}],"limitations":["The evidence is the paper abstract, which reports experimental outcomes but does not give the benchmark names, evaluation details, or results by model.","The abstract’s claims about improved safety, reduced over-refusal, and no compromise to general reasoning are the authors’ reported findings, not independently established here."],"mediaId":"6f9c13c1ac01872ff85c82e3fa9eebc3004eb8c83e8377bd43c78b39b52d921e","correctionReason":null,"id":"784ba4a468562824e3e961998478c0c2a692f1bd4cfec7723b759707d669b8e6","publicationId":"8be04382-24da-4b53-81d0-f6fa61c4d411","version":1,"sourceUrl":"https://arxiv.org/abs/2611.07482","sourceTitle":"SAVeR$^2$: Reasoning-based Safety Alignment for Large Reasoning Models via Verifiable Rewards","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-05","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-06T05:10:20.674Z","createdAt":"2026-11-08T18:07:50.523Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"6f9c13c1ac01872ff85c82e3fa9eebc3004eb8c83e8377bd43c78b39b52d921e","kind":"article","url":"https://arxiv.org/abs/2611.07482","sourceUrl":"https://arxiv.org/abs/2611.07482","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-08T17:54:57.317Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.07482","checkedAt":"2026-11-08T18:38:07.530Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"6f9c13c1ac01872ff85c82e3fa9eebc3004eb8c83e8377bd43c78b39b52d921e","confidence":0.87,"provider":"typesafe","model":"jev-1.13.0","inputHash":"01fda959432109f2aae8bb8cdf0caa524f3fadd3edd405327b4b90d1007b6c46","decidedAt":"2026-11-08T17:54:59.885Z"},"provenance":{"textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observationId":"a0c7dc1c5d793af03e5705bfbd20be813b53b04cd859ee74c46d887a78387ea7","retrievedAt":"2026-11-08T17:54:57.146Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"45263e14-ca46-45be-8a48-26c0612001f4"},"reviewer":{"model":"gpt-6-luna","runId":"ff1975e4-3195-4eb3-8015-82dec3c01ccf"}},"audit":{"status":"passed","reviewedAt":"2026-11-08T18:07:50.523Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Sun, Yichen","url":null,"kind":"unknown"},{"name":"Liu, Qirui","url":null,"kind":"unknown"},{"name":"Wang, Yan","url":null,"kind":"unknown"},{"name":"Lin, Jianan","url":null,"kind":"unknown"},{"name":"Jiang, Linbo","url":null,"kind":"unknown"},{"name":"Wang, Shiyu","url":null,"kind":"unknown"},{"name":"Wang, Zhibo","url":null,"kind":"unknown"},{"name":"Chu, Zhixuan","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Sun, Yichen","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sun, Yichen","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07482","locator":"head/meta[name=author|citation_author]"},"assertionId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T18:38:07.530Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","sourceUrl":"https://arxiv.org/abs/2611.07482","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z"}},{"actor":{"name":"Liu, Qirui","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Liu, Qirui","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07482","locator":"head/meta[name=author|citation_author]"},"assertionId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T18:38:07.530Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","sourceUrl":"https://arxiv.org/abs/2611.07482","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z"}},{"actor":{"name":"Wang, Yan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Yan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07482","locator":"head/meta[name=author|citation_author]"},"assertionId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T18:38:07.530Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","sourceUrl":"https://arxiv.org/abs/2611.07482","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z"}},{"actor":{"name":"Lin, Jianan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Lin, Jianan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07482","locator":"head/meta[name=author|citation_author]"},"assertionId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T18:38:07.530Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","sourceUrl":"https://arxiv.org/abs/2611.07482","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z"}},{"actor":{"name":"Jiang, Linbo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jiang, Linbo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07482","locator":"head/meta[name=author|citation_author]"},"assertionId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T18:38:07.530Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","sourceUrl":"https://arxiv.org/abs/2611.07482","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z"}},{"actor":{"name":"Wang, Shiyu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Shiyu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07482","locator":"head/meta[name=author|citation_author]"},"assertionId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T18:38:07.530Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","sourceUrl":"https://arxiv.org/abs/2611.07482","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z"}},{"actor":{"name":"Wang, Zhibo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Zhibo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07482","locator":"head/meta[name=author|citation_author]"},"assertionId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T18:38:07.530Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","sourceUrl":"https://arxiv.org/abs/2611.07482","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z"}},{"actor":{"name":"Chu, Zhixuan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chu, Zhixuan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07482","locator":"head/meta[name=author|citation_author]"},"assertionId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T18:38:07.530Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","sourceUrl":"https://arxiv.org/abs/2611.07482","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.07482","snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z","basis":"publisher-page-metadata","sourceLinks":46,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/784ba4a468562824e3e961998478c0c2a692f1bd4cfec7723b759707d669b8e6/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-saver2-reasoning-based-safety-alignment-for-large-784ba4a4","formats":{"html":"/readings/arxiv-saver2-reasoning-based-safety-alignment-for-large-784ba4a4","markdown":"/readings/arxiv-saver2-reasoning-based-safety-alignment-for-large-784ba4a4.md","json":"/readings/arxiv-saver2-reasoning-based-safety-alignment-for-large-784ba4a4.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-reasoning-model","name":"Reasoning model","explanation":"A language model trained to work through a problem in written steps before it answers.","referenceUrl":"https://en.wikipedia.org/wiki/Reasoning_model"},{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"784ba4a468562824e3e961998478c0c2a692f1bd4cfec7723b759707d669b8e6","revision":"8be04382-24da-4b53-81d0-f6fa61c4d411","revisionKind":"publication-id","title":"arXiv: SAVeR²: Reasoning-based Safety Alignment for Large Reasoning Models via Verifiable Rewards","url":"https://escapemeridian.com/readings/arxiv-saver2-reasoning-based-safety-alignment-for-large-784ba4a4"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.07482","revision":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","revisionKind":"sha256-source-text","title":"SAVeR$^2$: Reasoning-based Safety Alignment for Large Reasoning Models via Verifiable Rewards","url":"https://arxiv.org/abs/2611.07482"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"784ba4a468562824e3e961998478c0c2a692f1bd4cfec7723b759707d669b8e6","title":"arXiv: SAVeR²: Reasoning-based Safety Alignment for Large Reasoning Models via Verifiable Rewards","argument":"The authors of SAVeR² argue that safety alignment for Large Reasoning Models (LRMs) can use the models’ own reasoning, rather than treating reasoning only as a source of risk or a cost to safety. Their method breaks safety objectives into four fine-grained verifiable reward signals, selects training data according to difficulty, and uses reasoning-preserving gradient projection to resolve conflicts between safety and reasoning gradients. The authors say this approach addresses weaknesses in existing alignment methods, including poor adversarial generalization and coarse-grained rewards that may not faithfully reflect safety. They say the reasoning-preserving gradient projection mechanism effectively eliminates the “safety tax” on reasoning. They report experiments on models ranging from 1.5B to 671B, with superior safety performance and lower over-refusal rates across multiple benchmarks, without compromising general reasoning capabilities. Escape Meridian interpretation: if borne out beyond those evaluations, the approach could help make reasoning models safer without making them more likely to refuse acceptable requests. The abstract does not establish how well these results transfer to other settings.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence is the paper abstract, which reports experimental outcomes but does not give the benchmark names, evaluation details, or results by model. The abstract’s claims about improved safety, reduced over-refusal, and no compromise to general reasoning are the authors’ reported findings, not independently established here.","speaker":{"name":"Sun, Yichen, Liu, Qirui, Wang, Yan, Lin, Jianan, Jiang, Linbo, Wang, Shiyu, Wang, Zhibo, Chu, Zhixuan","roleAtSource":"Article author"},"source":{"title":"SAVeR$^2$: Reasoning-based Safety Alignment for Large Reasoning Models via Verifiable Rewards","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.07482","publishedAt":"2026-11-05","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors define LRM safety as requiring non-malicious reasoning and answers, safety consistency, and explicit intent identification.","excerpt":"We formalize LRM safety objectives as requiring non-malicious reasoning and answers, safety consistency, and explicit intent identification.","url":"https://arxiv.org/abs/2611.07482","relationship":"Source-stated"},{"text":"The authors say existing alignment methods have poor adversarial generalization, impose a “safety tax” on reasoning, and use unfaithful coarse-grained rewards.","excerpt":"existing alignment methods suffer from poor adversarial generalization, a significant ``safety tax'' on reasoning, and unfaithful coarse-grained rewards","url":"https://arxiv.org/abs/2611.07482","relationship":"Source-stated"},{"text":"SAVeR² uses four fine-grained verifiable reward signals, difficulty-aware data selection, and reasoning-preserving gradient projection to address conflicts between safety and reasoning gradients.","excerpt":"decomposes the safety objective into four fine-grained verifiable reward signals and utilizes a difficulty-aware data selection strategy to stabilize training. Crucially, we introduce a reasoning-preserving gradient projection mechanism","url":"https://arxiv.org/abs/2611.07482","relationship":"Source-stated"},{"text":"The authors report that experiments across models from 1.5B to 671B showed higher safety performance and lower over-refusal rates across multiple benchmarks, without compromising general reasoning capabilities.","excerpt":"Extensive experiments on models ranging from 1.5B to 671B demonstrate that SAVeR$^2$ achieves superior safety performance and significantly lower over-refusal rates across multiple benchmarks without compromising general reasoning capabilities.","url":"https://arxiv.org/abs/2611.07482","relationship":"Source-stated"},{"text":"If the reported results extend beyond the evaluated benchmarks, SAVeR² could help improve safety without increasing refusals of acceptable requests.","excerpt":"significantly lower over-refusal rates across multiple benchmarks without compromising general reasoning capabilities","url":"https://arxiv.org/abs/2611.07482","relationship":"Escape Meridian interpretation"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.07482","checkedAt":"2026-11-08T18:38:07.530Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Which adversarial settings and benchmarks were used to evaluate SAVeR², and how well do its reported results hold beyond them?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv: SAVeR²: Reasoning-based Safety Alignment for Large Reasoning Models via Verifiable Rewards","summary":"The authors of SAVeR² argue that safety alignment for Large Reasoning Models (LRMs) can use the models’ own reasoning, rather than treating reasoning only as a source of risk or a cost to safety. Their method breaks safety objectives into four fine-grained verifiable reward signals, selects training data according to difficulty, and uses reasoning-preserving gradient projection to resolve conflicts between safety and reasoning gradients. The authors say this approach addresses weaknesses in existing alignment methods, including poor adversarial generalization and coarse-grained rewards that may not faithfully reflect safety. They say the reasoning-preserving gradient projection mechanism effectively eliminates the “safety tax” on reasoning. They report experiments on models ranging from 1.5B to 671B, with superior safety performance and lower over-refusal rates across multiple benchmarks, without compromising general reasoning capabilities. Escape Meridian interpretation: if borne out beyond those evaluations, the approach could help make reasoning models safer without making them more likely to refuse acceptable requests. The abstract does not establish how well these results transfer to other settings.","question":"Which adversarial settings and benchmarks were used to evaluate SAVeR², and how well do its reported results hold beyond them?","claims":[{"text":"The authors define LRM safety as requiring non-malicious reasoning and answers, safety consistency, and explicit intent identification.","excerpt":"We formalize LRM safety objectives as requiring non-malicious reasoning and answers, safety consistency, and explicit intent identification.","support":"source-stated"},{"text":"The authors say existing alignment methods have poor adversarial generalization, impose a “safety tax” on reasoning, and use unfaithful coarse-grained rewards.","excerpt":"existing alignment methods suffer from poor adversarial generalization, a significant ``safety tax'' on reasoning, and unfaithful coarse-grained rewards","support":"source-stated"},{"text":"SAVeR² uses four fine-grained verifiable reward signals, difficulty-aware data selection, and reasoning-preserving gradient projection to address conflicts between safety and reasoning gradients.","excerpt":"decomposes the safety objective into four fine-grained verifiable reward signals and utilizes a difficulty-aware data selection strategy to stabilize training. Crucially, we introduce a reasoning-preserving gradient projection mechanism","support":"source-stated"},{"text":"The authors report that experiments across models from 1.5B to 671B showed higher safety performance and lower over-refusal rates across multiple benchmarks, without compromising general reasoning capabilities.","excerpt":"Extensive experiments on models ranging from 1.5B to 671B demonstrate that SAVeR$^2$ achieves superior safety performance and significantly lower over-refusal rates across multiple benchmarks without compromising general reasoning capabilities.","support":"source-stated"},{"text":"If the reported results extend beyond the evaluated benchmarks, SAVeR² could help improve safety without increasing refusals of acceptable requests.","excerpt":"significantly lower over-refusal rates across multiple benchmarks without compromising general reasoning capabilities","support":"interpretation"}],"limitations":["The evidence is the paper abstract, which reports experimental outcomes but does not give the benchmark names, evaluation details, or results by model.","The abstract’s claims about improved safety, reduced over-refusal, and no compromise to general reasoning are the authors’ reported findings, not independently established here."],"mediaId":"6f9c13c1ac01872ff85c82e3fa9eebc3004eb8c83e8377bd43c78b39b52d921e","correctionReason":null,"id":"784ba4a468562824e3e961998478c0c2a692f1bd4cfec7723b759707d669b8e6","publicationId":"8be04382-24da-4b53-81d0-f6fa61c4d411","version":1,"sourceUrl":"https://arxiv.org/abs/2611.07482","sourceTitle":"SAVeR$^2$: Reasoning-based Safety Alignment for Large Reasoning Models via Verifiable Rewards","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-05","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-06T05:10:20.674Z","createdAt":"2026-11-08T18:07:50.523Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"6f9c13c1ac01872ff85c82e3fa9eebc3004eb8c83e8377bd43c78b39b52d921e","kind":"article","url":"https://arxiv.org/abs/2611.07482","sourceUrl":"https://arxiv.org/abs/2611.07482","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-08T17:54:57.317Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.07482","checkedAt":"2026-11-08T18:38:07.530Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"6f9c13c1ac01872ff85c82e3fa9eebc3004eb8c83e8377bd43c78b39b52d921e","confidence":0.87,"provider":"typesafe","model":"jev-1.13.0","inputHash":"01fda959432109f2aae8bb8cdf0caa524f3fadd3edd405327b4b90d1007b6c46","decidedAt":"2026-11-08T17:54:59.885Z"},"provenance":{"textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observationId":"a0c7dc1c5d793af03e5705bfbd20be813b53b04cd859ee74c46d887a78387ea7","retrievedAt":"2026-11-08T17:54:57.146Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"45263e14-ca46-45be-8a48-26c0612001f4"},"reviewer":{"model":"gpt-6-luna","runId":"ff1975e4-3195-4eb3-8015-82dec3c01ccf"}},"audit":{"status":"passed","reviewedAt":"2026-11-08T18:07:50.523Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Sun, Yichen","url":null,"kind":"unknown"},{"name":"Liu, Qirui","url":null,"kind":"unknown"},{"name":"Wang, Yan","url":null,"kind":"unknown"},{"name":"Lin, Jianan","url":null,"kind":"unknown"},{"name":"Jiang, Linbo","url":null,"kind":"unknown"},{"name":"Wang, Shiyu","url":null,"kind":"unknown"},{"name":"Wang, Zhibo","url":null,"kind":"unknown"},{"name":"Chu, Zhixuan","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Sun, Yichen","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sun, Yichen","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07482","locator":"head/meta[name=author|citation_author]"},"assertionId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T18:38:07.530Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","sourceUrl":"https://arxiv.org/abs/2611.07482","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z"}},{"actor":{"name":"Liu, Qirui","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Liu, Qirui","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07482","locator":"head/meta[name=author|citation_author]"},"assertionId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T18:38:07.530Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","sourceUrl":"https://arxiv.org/abs/2611.07482","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z"}},{"actor":{"name":"Wang, Yan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Yan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07482","locator":"head/meta[name=author|citation_author]"},"assertionId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T18:38:07.530Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","sourceUrl":"https://arxiv.org/abs/2611.07482","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z"}},{"actor":{"name":"Lin, Jianan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Lin, Jianan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07482","locator":"head/meta[name=author|citation_author]"},"assertionId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T18:38:07.530Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","sourceUrl":"https://arxiv.org/abs/2611.07482","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z"}},{"actor":{"name":"Jiang, Linbo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jiang, Linbo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07482","locator":"head/meta[name=author|citation_author]"},"assertionId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T18:38:07.530Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","sourceUrl":"https://arxiv.org/abs/2611.07482","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z"}},{"actor":{"name":"Wang, Shiyu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Shiyu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07482","locator":"head/meta[name=author|citation_author]"},"assertionId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T18:38:07.530Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","sourceUrl":"https://arxiv.org/abs/2611.07482","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z"}},{"actor":{"name":"Wang, Zhibo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Zhibo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07482","locator":"head/meta[name=author|citation_author]"},"assertionId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T18:38:07.530Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","sourceUrl":"https://arxiv.org/abs/2611.07482","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z"}},{"actor":{"name":"Chu, Zhixuan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chu, Zhixuan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.07482","locator":"head/meta[name=author|citation_author]"},"assertionId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T18:38:07.530Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","sourceUrl":"https://arxiv.org/abs/2611.07482","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.07482","snapshotId":"129c16ccd23730cdce01d1e76a54eed95fdd387bd997b0c0cca3d9264d0a5774","contentSha256":"132d11eaf94332c390d0890391f5c21bd2f0bb976975322efea1e344fbc809e5","textHash":"31658139ffc3e64fc590f4e3edd71ea9a65f02e2395d942d13720b439fce2f42","observedAt":"2026-11-08T18:38:07.530Z","basis":"publisher-page-metadata","sourceLinks":46,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/784ba4a468562824e3e961998478c0c2a692f1bd4cfec7723b759707d669b8e6/source"}}}],"audits":[{"publicationId":"8be04382-24da-4b53-81d0-f6fa61c4d411","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading attributes the method, the critique of existing alignment methods and the experimental results to the paper's authors on arXiv. Claims stay framed as what the authors argue, say or report. The Escape Meridian interpretation is labeled and kept separate from the authors' claims.","excerpt":"Authors:Yichen Sun, Qirui Liu, Yan Wang, Jianan Lin, Linbo Jiang, Shiyu Wang, Zhibo Wang, Zhixuan Chu"},{"dimension":"summary","status":"pass","explanation":"The reading accurately covers the abstract's argument: existing methods neglect the model's own reasoning for safety, and SAVeR2 has three components. It also preserves the strong claim of 'effectively eliminating the safety tax'. A non-specialist can follow the core development: a training method meant to make reasoning models safer without hurting reasoning or increasing over-refusal. Technical terms are kept exactly. Optional tooltips for safety tax, verifiable reward, gradient projection and the parameter units in 1.5B to 671B would further aid readers, but their absence does not block understanding.","excerpt":"primarily due to their neglect of the LRM's intrinsic reasoning capabilities for safety"},{"dimension":"date","status":"pass","explanation":"The originalPublished date, 2026-11-05, matches the arXiv v1 submission date shown in the source. This is the first submission, not a later revision.","excerpt":"[Submitted on 5 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim matches the abstract and is presented as source-stated. The interpretation is explicitly conditional and supported by the reported lower over-refusal rates. The limitations correctly note that benchmark names and per-model results are absent. The question follows from that gap without asserting a conclusion.","excerpt":"achieves superior safety performance and significantly lower over-refusal rates across multiple benchmarks without compromising general reasoning capabilities"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified arXiv abstract page for this paper. It is the direct original source and the most relevant link available.","excerpt":null}],"createdAt":"2026-11-08T18:07:50.523Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}