{"id":"95a4bc741026df037751a2f56177169e3ad57c094af217c28ac6b3f7aa414b71","title":"arXiv cs.AI: Preference-Guided Adversarial Policy Optimization for Long-Tail Robust Driving","argument":"The authors present ADV-0, a framework for training autonomous-driving systems against rare but safety-critical scenarios. They argue that existing adversarial training methods separate scenario generation from policy optimization and use heuristic surrogates, which can misalign the attacker's objective with the driving policy's objective and miss changing failure modes. ADV-0 instead models the driving policy and adversarial agent as defender and attacker in a zero-sum Markov game, aligning the attacker's utility with the defender's objective. The authors use iterative preference learning to approximate the optimal adversary distribution and describe the approach as algorithm-agnostic. They say ADV-0 converges to a Nash Equilibrium and maximizes a certified lower bound on real-world performance. Experiments, according to the authors, expose diverse safety-critical failures and improve the generalizability of learned policies and motion planners against unseen long-tail risks. The abstract does not give experiment settings or measurements, so it does not show how those reported improvements were assessed.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv page's abstract and metadata; it does not include experiment settings, measurements, or detailed results supporting the reported improvements. The abstract's statements about convergence and a certified lower bound are the authors' claims; the supplied evidence does not provide their derivations or conditions.","speaker":{"name":"Nie, Tong, Tang, Yihong, He, Junlin, Mei, Yuewen, Sun, Jie, Sun, Lijun, Ma, Wei, Sun, Jian","roleAtSource":"Article author"},"source":{"title":"Preference-Guided Adversarial Policy Optimization for Long-Tail Robust Driving","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2603.15221","publishedAt":"2026-03-16","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose ADV-0 to address robustness to rare, safety-critical driving scenarios.","excerpt":"Deploying autonomous driving systems requires robustness against long-tail scenarios that are rare but safety-critical.","url":"https://arxiv.org/abs/2603.15221","relationship":"Source-stated"},{"text":"The authors say existing methods can misalign scenario generation and policy optimization and miss failure modes as policies evolve.","excerpt":"This leads to objective misalignment and fails to capture the shifting failure modes of evolving policies.","url":"https://arxiv.org/abs/2603.15221","relationship":"Source-stated"},{"text":"ADV-0 models the driving policy and adversarial agent as defender and attacker in a zero-sum Markov game.","excerpt":"treats the interaction between driving policy (defender) and adversarial agent (attacker) as a zero-sum Markov game.","url":"https://arxiv.org/abs/2603.15221","relationship":"Source-stated"},{"text":"The authors describe iterative preference learning as a tractable way to approximate the optimal adversary distribution.","excerpt":"we cast dynamic adversary evolution as iterative preference learning, efficiently approximating this optimum","url":"https://arxiv.org/abs/2603.15221","relationship":"Source-stated"},{"text":"The authors report that ADV-0 converges to a Nash Equilibrium and maximizes a certified lower bound on real-world performance.","excerpt":"ADV-0 converges to a Nash Equilibrium and maximizes a certified lower bound on real-world performance.","url":"https://arxiv.org/abs/2603.15221","relationship":"Source-stated"},{"text":"The authors report that experiments expose safety-critical failures and improve generalizability against unseen long-tail risks.","excerpt":"it effectively exposes diverse safety-critical failures and greatly enhances the generalizability of both learned policies and motion planners against unseen long-tail risks.","url":"https://arxiv.org/abs/2603.15221","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2603.15221","checkedAt":"2026-11-09T04:42:09.078Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What experiment settings and measurements support the reported improvements in generalizability against unseen long-tail risks?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Preference-Guided Adversarial Policy Optimization for Long-Tail Robust Driving","summary":"The authors present ADV-0, a framework for training autonomous-driving systems against rare but safety-critical scenarios. They argue that existing adversarial training methods separate scenario generation from policy optimization and use heuristic surrogates, which can misalign the attacker's objective with the driving policy's objective and miss changing failure modes. ADV-0 instead models the driving policy and adversarial agent as defender and attacker in a zero-sum Markov game, aligning the attacker's utility with the defender's objective. The authors use iterative preference learning to approximate the optimal adversary distribution and describe the approach as algorithm-agnostic. They say ADV-0 converges to a Nash Equilibrium and maximizes a certified lower bound on real-world performance. Experiments, according to the authors, expose diverse safety-critical failures and improve the generalizability of learned policies and motion planners against unseen long-tail risks. The abstract does not give experiment settings or measurements, so it does not show how those reported improvements were assessed.","question":"What experiment settings and measurements support the reported improvements in generalizability against unseen long-tail risks?","claims":[{"text":"The authors propose ADV-0 to address robustness to rare, safety-critical driving scenarios.","excerpt":"Deploying autonomous driving systems requires robustness against long-tail scenarios that are rare but safety-critical.","support":"source-stated"},{"text":"The authors say existing methods can misalign scenario generation and policy optimization and miss failure modes as policies evolve.","excerpt":"This leads to objective misalignment and fails to capture the shifting failure modes of evolving policies.","support":"source-stated"},{"text":"ADV-0 models the driving policy and adversarial agent as defender and attacker in a zero-sum Markov game.","excerpt":"treats the interaction between driving policy (defender) and adversarial agent (attacker) as a zero-sum Markov game.","support":"source-stated"},{"text":"The authors describe iterative preference learning as a tractable way to approximate the optimal adversary distribution.","excerpt":"we cast dynamic adversary evolution as iterative preference learning, efficiently approximating this optimum","support":"source-stated"},{"text":"The authors report that ADV-0 converges to a Nash Equilibrium and maximizes a certified lower bound on real-world performance.","excerpt":"ADV-0 converges to a Nash Equilibrium and maximizes a certified lower bound on real-world performance.","support":"source-stated"},{"text":"The authors report that experiments expose safety-critical failures and improve generalizability against unseen long-tail risks.","excerpt":"it effectively exposes diverse safety-critical failures and greatly enhances the generalizability of both learned policies and motion planners against unseen long-tail risks.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv page's abstract and metadata; it does not include experiment settings, measurements, or detailed results supporting the reported improvements.","The abstract's statements about convergence and a certified lower bound are the authors' claims; the supplied evidence does not provide their derivations or conditions."],"mediaId":"a0886e23619f8e0cee89830410907e52514c71cc6c5208afcaeef77e953c8778","correctionReason":null,"id":"95a4bc741026df037751a2f56177169e3ad57c094af217c28ac6b3f7aa414b71","publicationId":"aa6e1e1e-9b6b-4487-887c-d19673a30a91","version":1,"sourceUrl":"https://arxiv.org/abs/2603.15221","sourceTitle":"Preference-Guided Adversarial Policy Optimization for Long-Tail Robust Driving","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-03-16","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-06T05:03:39.154Z","createdAt":"2026-11-09T03:39:04.017Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"a0886e23619f8e0cee89830410907e52514c71cc6c5208afcaeef77e953c8778","kind":"article","url":"https://arxiv.org/abs/2603.15221","sourceUrl":"https://arxiv.org/abs/2603.15221","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T03:38:22.115Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2603.15221","checkedAt":"2026-11-09T04:42:09.078Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"a0886e23619f8e0cee89830410907e52514c71cc6c5208afcaeef77e953c8778","confidence":0.71,"provider":"typesafe","model":"jev-1.13.0","inputHash":"3fd296d27a1ec92536f566861cb0501e612ac5fd9a685dfa08b19b8250cb2e82","decidedAt":"2026-11-09T03:38:22.875Z"},"provenance":{"textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observationId":"4f6b1f935b8056012d036b190796e5393eba459e620439342c0556e78df02e31","retrievedAt":"2026-11-09T03:38:21.986Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"5614cc21-2406-4e04-8a56-cfcbfd697aa6"},"reviewer":{"model":"gpt-6-luna","runId":"6a940b03-8e1c-468d-8f60-7305cb3a3cbd"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T03:39:04.017Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Nie, Tong","url":null,"kind":"unknown"},{"name":"Tang, Yihong","url":null,"kind":"unknown"},{"name":"He, Junlin","url":null,"kind":"unknown"},{"name":"Mei, Yuewen","url":null,"kind":"unknown"},{"name":"Sun, Jie","url":null,"kind":"unknown"},{"name":"Sun, Lijun","url":null,"kind":"unknown"},{"name":"Ma, Wei","url":null,"kind":"unknown"},{"name":"Sun, Jian","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Nie, Tong","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Nie, Tong","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.15221","locator":"head/meta[name=author|citation_author]"},"assertionId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T04:42:09.078Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","sourceUrl":"https://arxiv.org/abs/2603.15221","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z"}},{"actor":{"name":"Tang, Yihong","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Tang, Yihong","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.15221","locator":"head/meta[name=author|citation_author]"},"assertionId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T04:42:09.078Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","sourceUrl":"https://arxiv.org/abs/2603.15221","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z"}},{"actor":{"name":"He, Junlin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"He, Junlin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.15221","locator":"head/meta[name=author|citation_author]"},"assertionId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T04:42:09.078Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","sourceUrl":"https://arxiv.org/abs/2603.15221","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z"}},{"actor":{"name":"Mei, Yuewen","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mei, Yuewen","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.15221","locator":"head/meta[name=author|citation_author]"},"assertionId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T04:42:09.078Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","sourceUrl":"https://arxiv.org/abs/2603.15221","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z"}},{"actor":{"name":"Sun, Jie","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sun, Jie","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.15221","locator":"head/meta[name=author|citation_author]"},"assertionId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T04:42:09.078Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","sourceUrl":"https://arxiv.org/abs/2603.15221","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z"}},{"actor":{"name":"Sun, Lijun","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sun, Lijun","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.15221","locator":"head/meta[name=author|citation_author]"},"assertionId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T04:42:09.078Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","sourceUrl":"https://arxiv.org/abs/2603.15221","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z"}},{"actor":{"name":"Ma, Wei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ma, Wei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.15221","locator":"head/meta[name=author|citation_author]"},"assertionId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T04:42:09.078Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","sourceUrl":"https://arxiv.org/abs/2603.15221","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z"}},{"actor":{"name":"Sun, Jian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sun, Jian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.15221","locator":"head/meta[name=author|citation_author]"},"assertionId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T04:42:09.078Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","sourceUrl":"https://arxiv.org/abs/2603.15221","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2603.15221","snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z","basis":"publisher-page-metadata","sourceLinks":50,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/95a4bc741026df037751a2f56177169e3ad57c094af217c28ac6b3f7aa414b71/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-preference-guided-adversarial-policy-optimization-95a4bc74","formats":{"html":"/readings/arxiv-cs-ai-preference-guided-adversarial-policy-optimization-95a4bc74","markdown":"/readings/arxiv-cs-ai-preference-guided-adversarial-policy-optimization-95a4bc74.md","json":"/readings/arxiv-cs-ai-preference-guided-adversarial-policy-optimization-95a4bc74.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"95a4bc741026df037751a2f56177169e3ad57c094af217c28ac6b3f7aa414b71","revision":"aa6e1e1e-9b6b-4487-887c-d19673a30a91","revisionKind":"publication-id","title":"arXiv cs.AI: Preference-Guided Adversarial Policy Optimization for Long-Tail Robust Driving","url":"https://escapemeridian.com/readings/arxiv-cs-ai-preference-guided-adversarial-policy-optimization-95a4bc74"},"source":{"type":"source","id":"https://arxiv.org/abs/2603.15221","revision":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","revisionKind":"sha256-source-text","title":"Preference-Guided Adversarial Policy Optimization for Long-Tail Robust Driving","url":"https://arxiv.org/abs/2603.15221"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"95a4bc741026df037751a2f56177169e3ad57c094af217c28ac6b3f7aa414b71","title":"arXiv cs.AI: Preference-Guided Adversarial Policy Optimization for Long-Tail Robust Driving","argument":"The authors present ADV-0, a framework for training autonomous-driving systems against rare but safety-critical scenarios. They argue that existing adversarial training methods separate scenario generation from policy optimization and use heuristic surrogates, which can misalign the attacker's objective with the driving policy's objective and miss changing failure modes. ADV-0 instead models the driving policy and adversarial agent as defender and attacker in a zero-sum Markov game, aligning the attacker's utility with the defender's objective. The authors use iterative preference learning to approximate the optimal adversary distribution and describe the approach as algorithm-agnostic. They say ADV-0 converges to a Nash Equilibrium and maximizes a certified lower bound on real-world performance. Experiments, according to the authors, expose diverse safety-critical failures and improve the generalizability of learned policies and motion planners against unseen long-tail risks. The abstract does not give experiment settings or measurements, so it does not show how those reported improvements were assessed.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv page's abstract and metadata; it does not include experiment settings, measurements, or detailed results supporting the reported improvements. The abstract's statements about convergence and a certified lower bound are the authors' claims; the supplied evidence does not provide their derivations or conditions.","speaker":{"name":"Nie, Tong, Tang, Yihong, He, Junlin, Mei, Yuewen, Sun, Jie, Sun, Lijun, Ma, Wei, Sun, Jian","roleAtSource":"Article author"},"source":{"title":"Preference-Guided Adversarial Policy Optimization for Long-Tail Robust Driving","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2603.15221","publishedAt":"2026-03-16","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose ADV-0 to address robustness to rare, safety-critical driving scenarios.","excerpt":"Deploying autonomous driving systems requires robustness against long-tail scenarios that are rare but safety-critical.","url":"https://arxiv.org/abs/2603.15221","relationship":"Source-stated"},{"text":"The authors say existing methods can misalign scenario generation and policy optimization and miss failure modes as policies evolve.","excerpt":"This leads to objective misalignment and fails to capture the shifting failure modes of evolving policies.","url":"https://arxiv.org/abs/2603.15221","relationship":"Source-stated"},{"text":"ADV-0 models the driving policy and adversarial agent as defender and attacker in a zero-sum Markov game.","excerpt":"treats the interaction between driving policy (defender) and adversarial agent (attacker) as a zero-sum Markov game.","url":"https://arxiv.org/abs/2603.15221","relationship":"Source-stated"},{"text":"The authors describe iterative preference learning as a tractable way to approximate the optimal adversary distribution.","excerpt":"we cast dynamic adversary evolution as iterative preference learning, efficiently approximating this optimum","url":"https://arxiv.org/abs/2603.15221","relationship":"Source-stated"},{"text":"The authors report that ADV-0 converges to a Nash Equilibrium and maximizes a certified lower bound on real-world performance.","excerpt":"ADV-0 converges to a Nash Equilibrium and maximizes a certified lower bound on real-world performance.","url":"https://arxiv.org/abs/2603.15221","relationship":"Source-stated"},{"text":"The authors report that experiments expose safety-critical failures and improve generalizability against unseen long-tail risks.","excerpt":"it effectively exposes diverse safety-critical failures and greatly enhances the generalizability of both learned policies and motion planners against unseen long-tail risks.","url":"https://arxiv.org/abs/2603.15221","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2603.15221","checkedAt":"2026-11-09T04:42:09.078Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What experiment settings and measurements support the reported improvements in generalizability against unseen long-tail risks?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Preference-Guided Adversarial Policy Optimization for Long-Tail Robust Driving","summary":"The authors present ADV-0, a framework for training autonomous-driving systems against rare but safety-critical scenarios. They argue that existing adversarial training methods separate scenario generation from policy optimization and use heuristic surrogates, which can misalign the attacker's objective with the driving policy's objective and miss changing failure modes. ADV-0 instead models the driving policy and adversarial agent as defender and attacker in a zero-sum Markov game, aligning the attacker's utility with the defender's objective. The authors use iterative preference learning to approximate the optimal adversary distribution and describe the approach as algorithm-agnostic. They say ADV-0 converges to a Nash Equilibrium and maximizes a certified lower bound on real-world performance. Experiments, according to the authors, expose diverse safety-critical failures and improve the generalizability of learned policies and motion planners against unseen long-tail risks. The abstract does not give experiment settings or measurements, so it does not show how those reported improvements were assessed.","question":"What experiment settings and measurements support the reported improvements in generalizability against unseen long-tail risks?","claims":[{"text":"The authors propose ADV-0 to address robustness to rare, safety-critical driving scenarios.","excerpt":"Deploying autonomous driving systems requires robustness against long-tail scenarios that are rare but safety-critical.","support":"source-stated"},{"text":"The authors say existing methods can misalign scenario generation and policy optimization and miss failure modes as policies evolve.","excerpt":"This leads to objective misalignment and fails to capture the shifting failure modes of evolving policies.","support":"source-stated"},{"text":"ADV-0 models the driving policy and adversarial agent as defender and attacker in a zero-sum Markov game.","excerpt":"treats the interaction between driving policy (defender) and adversarial agent (attacker) as a zero-sum Markov game.","support":"source-stated"},{"text":"The authors describe iterative preference learning as a tractable way to approximate the optimal adversary distribution.","excerpt":"we cast dynamic adversary evolution as iterative preference learning, efficiently approximating this optimum","support":"source-stated"},{"text":"The authors report that ADV-0 converges to a Nash Equilibrium and maximizes a certified lower bound on real-world performance.","excerpt":"ADV-0 converges to a Nash Equilibrium and maximizes a certified lower bound on real-world performance.","support":"source-stated"},{"text":"The authors report that experiments expose safety-critical failures and improve generalizability against unseen long-tail risks.","excerpt":"it effectively exposes diverse safety-critical failures and greatly enhances the generalizability of both learned policies and motion planners against unseen long-tail risks.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv page's abstract and metadata; it does not include experiment settings, measurements, or detailed results supporting the reported improvements.","The abstract's statements about convergence and a certified lower bound are the authors' claims; the supplied evidence does not provide their derivations or conditions."],"mediaId":"a0886e23619f8e0cee89830410907e52514c71cc6c5208afcaeef77e953c8778","correctionReason":null,"id":"95a4bc741026df037751a2f56177169e3ad57c094af217c28ac6b3f7aa414b71","publicationId":"aa6e1e1e-9b6b-4487-887c-d19673a30a91","version":1,"sourceUrl":"https://arxiv.org/abs/2603.15221","sourceTitle":"Preference-Guided Adversarial Policy Optimization for Long-Tail Robust Driving","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-03-16","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-06T05:03:39.154Z","createdAt":"2026-11-09T03:39:04.017Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"a0886e23619f8e0cee89830410907e52514c71cc6c5208afcaeef77e953c8778","kind":"article","url":"https://arxiv.org/abs/2603.15221","sourceUrl":"https://arxiv.org/abs/2603.15221","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T03:38:22.115Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2603.15221","checkedAt":"2026-11-09T04:42:09.078Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"a0886e23619f8e0cee89830410907e52514c71cc6c5208afcaeef77e953c8778","confidence":0.71,"provider":"typesafe","model":"jev-1.13.0","inputHash":"3fd296d27a1ec92536f566861cb0501e612ac5fd9a685dfa08b19b8250cb2e82","decidedAt":"2026-11-09T03:38:22.875Z"},"provenance":{"textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observationId":"4f6b1f935b8056012d036b190796e5393eba459e620439342c0556e78df02e31","retrievedAt":"2026-11-09T03:38:21.986Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"5614cc21-2406-4e04-8a56-cfcbfd697aa6"},"reviewer":{"model":"gpt-6-luna","runId":"6a940b03-8e1c-468d-8f60-7305cb3a3cbd"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T03:39:04.017Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Nie, Tong","url":null,"kind":"unknown"},{"name":"Tang, Yihong","url":null,"kind":"unknown"},{"name":"He, Junlin","url":null,"kind":"unknown"},{"name":"Mei, Yuewen","url":null,"kind":"unknown"},{"name":"Sun, Jie","url":null,"kind":"unknown"},{"name":"Sun, Lijun","url":null,"kind":"unknown"},{"name":"Ma, Wei","url":null,"kind":"unknown"},{"name":"Sun, Jian","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Nie, Tong","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Nie, Tong","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.15221","locator":"head/meta[name=author|citation_author]"},"assertionId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T04:42:09.078Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","sourceUrl":"https://arxiv.org/abs/2603.15221","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z"}},{"actor":{"name":"Tang, Yihong","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Tang, Yihong","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.15221","locator":"head/meta[name=author|citation_author]"},"assertionId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T04:42:09.078Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","sourceUrl":"https://arxiv.org/abs/2603.15221","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z"}},{"actor":{"name":"He, Junlin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"He, Junlin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.15221","locator":"head/meta[name=author|citation_author]"},"assertionId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T04:42:09.078Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","sourceUrl":"https://arxiv.org/abs/2603.15221","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z"}},{"actor":{"name":"Mei, Yuewen","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mei, Yuewen","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.15221","locator":"head/meta[name=author|citation_author]"},"assertionId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T04:42:09.078Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","sourceUrl":"https://arxiv.org/abs/2603.15221","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z"}},{"actor":{"name":"Sun, Jie","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sun, Jie","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.15221","locator":"head/meta[name=author|citation_author]"},"assertionId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T04:42:09.078Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","sourceUrl":"https://arxiv.org/abs/2603.15221","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z"}},{"actor":{"name":"Sun, Lijun","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sun, Lijun","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.15221","locator":"head/meta[name=author|citation_author]"},"assertionId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T04:42:09.078Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","sourceUrl":"https://arxiv.org/abs/2603.15221","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z"}},{"actor":{"name":"Ma, Wei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ma, Wei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.15221","locator":"head/meta[name=author|citation_author]"},"assertionId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T04:42:09.078Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","sourceUrl":"https://arxiv.org/abs/2603.15221","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z"}},{"actor":{"name":"Sun, Jian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sun, Jian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.15221","locator":"head/meta[name=author|citation_author]"},"assertionId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T04:42:09.078Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","sourceUrl":"https://arxiv.org/abs/2603.15221","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2603.15221","snapshotId":"9e45320b382b2f272829604b3fd11db352602ffcc900c86c7a0163a1eb130530","contentSha256":"621d4c8b10fc517f7647a6278ec71f5cc708bd88fbfbca99baff4c4d93ac5d9c","textHash":"04082fab0ae84a0c6450e3d9623948b88a1080209ee36afd1cb909cbb113ae04","observedAt":"2026-11-09T04:42:09.078Z","basis":"publisher-page-metadata","sourceLinks":50,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/95a4bc741026df037751a2f56177169e3ad57c094af217c28ac6b3f7aa414b71/source"}}}],"audits":[{"publicationId":"aa6e1e1e-9b6b-4487-887c-d19673a30a91","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading consistently attributes the framework, critique, theoretical claims, and experimental claims to the paper's authors. The arXiv listing is cross-listed in cs.AI, so the publisher label is acceptable. The NeurIPS 2026 acceptance note is omitted but not misattributed.","excerpt":"Authors:Tong Nie, Yihong Tang, Junlin He, Yuewen Mei, Jie Sun, Lijun Sun, Wei Ma, Jian Sun"},{"dimension":"summary","status":"uncertain","explanation":"The summary is faithful, but its central steps rely on unexplained jargon: zero-sum Markov game, Nash Equilibrium, heuristic surrogates, policy optimization, iterative preference learning, and certified lower bound. A general reader may not grasp that the attacker generates challenging traffic scenarios for the driving system. Smallest repair: briefly explain this attacker role and add term-library tooltips. Separately, the reading turns greatly enhances into improve, which softens the authors' claim; restoring their wording would preserve its force.","excerpt":"treats the interaction between driving policy (defender) and adversarial agent (attacker) as a zero-sum Markov game"},{"dimension":"date","status":"pass","explanation":"The displayed originalPublished date, 2026-03-16, matches the v1 submission date. It is not the date of the later v2 revision or the feed entry.","excerpt":"[Submitted on 16 Mar 2026 (v1), last revised 5 Nov 2026 (this version, v2)]"},{"dimension":"support","status":"pass","explanation":"Each claim is source-stated and carries a matching verbatim excerpt. The theoretical and experimental results remain framed as the authors' claims. The limitations and question correctly note that the abstract gives no experiment settings or measurements. The reading makes no unsupported claims of benefit or harm.","excerpt":"Theoretically, ADV-0 converges to a Nash Equilibrium and maximizes a certified lower bound on real-world performance."},{"dimension":"media","status":"pass","explanation":"The selected media item is the verified arXiv abstract page for this paper. It is the direct original source.","excerpt":null}],"createdAt":"2026-11-09T03:39:04.017Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}