arXiv cs.AI: Constraint Dependency Graph Retrieval for Compliance Detection on Long SKILL Documents

arXiv cs.AI: Constraint Dependency Graph Retrieval for Compliance Detection on Long SKILL Documents

Shuaitao Zhao and coauthors present SkillCDG, a framework for checking whether LLM agents follow enterprise SKILL documents: standard operating procedures that state conditions to verify and actions to take before an operation proceeds. They argue that long, cross-referenced documents can exceed small deployed auditors’ context budgets, while similarity-based retrieval may bring in irrelevant rules and omit mandatory prerequisites. SkillCDG represents each atomic rule as a graph node anchored to its source text, with mandatory prerequisite relations as edges. Policy-generated keywords select seed rules; dependency closure then selects their prerequisites within the deployment’s context budget. The authors describe the resulting rule context as compact and conditionally complete. They also describe training retrieval with group-relative policy optimization and using selective on-policy distillation to focus teacher supervision on high-entropy reasoning tokens, while always including verdict and termination tokens. The authors report improved accuracy and F1 over full-document and retrieval-based baselines across three enterprise datasets and two public benchmarks. The abstract gives no effect sizes or dataset details, so it does not show how large the gains were or how well they would carry over to other compliance settings.

Publication: 17ee3cac-4419-4334-8b27-68df4dce7c83

attribution — pass: The reading credits Shuaitao Zhao and coauthors, matching the arXiv author list. It keeps the framing, method and results attributed to the authors ('They argue', 'The authors describe', 'The authors report'). It does not present the reported gains as established fact.

Authors:Shuaitao Zhao, Feng Ni, Lichao Ma, Yuchen Wei, Shuaike Li, Jiaye Lin, Fei Han, Yang Wei, Lu Pan

summary — pass: The reading leads with the actor and the development, a compliance-detection framework, and defines SKILL documents in plain language. It explains the problem: long documents overflow small auditors, and similarity retrieval misses prerequisites. The graph approach is described accurately and the 'conditionally complete' qualifier is kept. Terms such as GRPO, on-policy distillation and F1 stay exact and suit tooltips; they are secondary to the central idea. The reading omits that the two-stage audit gives no trainable signal for retrieval, which is minor. The title mirrors the source, and the question is a genuine open issue.

shifting rule retrieval from similarity-based matching to closure-based selection under the deployment's context budget

date — pass: originalPublished is 2026-10-31. This matches the v1 submission date on the arXiv page, not the later feed date of 2026-11-03.

[Submitted on 31 Oct 2026]

support — pass: Each claim matches the abstract and uses verbatim excerpts. The reading correctly says the abstract gives no effect sizes or dataset details. It frames transfer to other compliance settings as unknown rather than implied. It invents no beneficiaries, costs or deployment outcomes, and does not turn benchmark gains into real-world reliability.

Experiments on three enterprise datasets and two public benchmarks show that SkillCDG improves accuracy and F1 over the full-document and retrieval-based baselines.

media — pass: The selected media is the verified candidate ID linking directly to the arXiv abstract page, which is the original source. No better source media was found.