# arXiv paper tests retrieval of Saudi statutory articles [Canonical reading](https://escapemeridian.com/readings/arxiv-paper-tests-retrieval-of-saudi-statutory-articles-b559fe1b) Zarah Shibli, Areej Alhothali and Lulwah Alharigy compare methods for retrieving Saudi statutory articles from Arabic judicial narratives. Their paper describes a “narrative-to-legal-rule abstraction gap”: lengthy case narratives must be matched to short articles expressing general legal rules. On a benchmark of 200 synthetic cases and 381 articles from Saudi Arabia’s Family Law and Law of Evidence, the authors compare BM25, dense encoders, fusion methods and their proposed Decompose-and-Refine (DaR) pipeline. DaR uses a large language model to split each narrative into disputed legal issues and create three retrieval channels for each issue: a statute-style paraphrase, legal keywords and a candidate taxonomy chapter. The results differ sharply by law. Without decomposition, the Qwen3-Embedding-8B dense encoder has the best overall MRR@10 among the non-decomposed systems, but its score for Evidence articles is much lower than for Family Law. With DaR, the authors report higher MRR@10 for both: 0.696 for Evidence and 0.864 for Family Law. They argue this makes one retriever effective across the two laws in their benchmark, where different laws otherwise favor different retrieval strategies. Escape Meridian interpretation: these results concern retrieval rankings on synthetic cases and do not establish how the approach would perform on real judicial narratives. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: Oct 28, 2026 (2026-10-28). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-11T03:39:27.749Z. First observed: 2026-10-30T06:43:03.845Z. Retrieved: 2026-10-31T09:32:15.215Z. - [Statutory Article Retrieval from Arabic Judicial Narratives: Family Law and Law of Evidence in Saudi Arabia](https://arxiv.org/abs/2610.38336) ## Limits The reported benchmark consists of 200 synthetic cases, so the evidence provided does not establish performance on real judicial narratives. The evaluation covers articles from the Family Law and the Law of Evidence; the abstract does not report results for other areas of Saudi law. ## Open question How would DaR’s retrieval results compare on real Saudi judicial narratives? ## Source-stated The authors frame the task as matching long Arabic judicial narratives to concise statutory articles that express abstract rules. > long factual narratives must be mapped to concise articles that express abstract legal rules, creating a narrative-to-legal-rule abstraction gap. - [Supporting source](https://arxiv.org/abs/2610.38336) ## Source-stated The comparison uses 200 synthetic Saudi Arabic judicial cases and 381 articles from two areas of Saudi law. > a benchmark of 200 synthetic Saudi Arabic judicial cases and 381 articles from the Family Law and the Law of Evidence - [Supporting source](https://arxiv.org/abs/2610.38336) ## Source-stated DaR splits each narrative into disputed legal issues and generates three retrieval channels for each issue. > a large language model splits each narrative into disputed legal issues and generates, for each issue, three retrieval channels - [Supporting source](https://arxiv.org/abs/2610.38336) ## Source-stated Without decomposition, the instructed Qwen3-Embedding-8B dense encoder has the best overall MRR@10 among the tested non-decomposed systems, but its Evidence score is much lower. > reaches an MRR@10 of 0.849, the best result of any non-decomposed system. Under per-law scoring, this advantage reflects Family Law only: restricted to Evidence articles, the same encoder drops to an MRR@10 of 0.087 - [Supporting source](https://arxiv.org/abs/2610.38336) ## Source-stated The authors report that DaR raises Evidence MRR@10 to 0.696 and Family MRR@10 to 0.864. > DaR changes this picture, raising Evidence MRR@10 to 0.696 and Family MRR@10 to 0.864. - [Supporting source](https://arxiv.org/abs/2610.38336) ## Escape Meridian interpretation Because the benchmark is synthetic, these reported retrieval results do not by themselves show how DaR performs on real judicial narratives. > a benchmark of 200 synthetic Saudi Arabic judicial cases - [Supporting source](https://arxiv.org/abs/2610.38336) ## Source and contributor context Shibli, Zarah, Alhothali, Areej, Alharigy, Lulwah · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## Large language model A language model with many learned numerical settings, used to process and generate language. - [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 36e0fb64-3f36-4ba8-89b7-8e86996175e2. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-11T03:39:27.749Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 7e94527f9e1e8de6b15f9a3b1bdda4dbf3fe51c4481cff6db92d91bdfe126f7c. Source text hash: 054a926303a4630529e76f76a796a47115c05f386eaa01381ddf49583c094a18. ## Revision and source-check history ### Version 1 — 2026-11-11T03:39:27.749Z Zarah Shibli, Areej Alhothali and Lulwah Alharigy compare methods for retrieving Saudi statutory articles from Arabic judicial narratives. Their paper describes a “narrative-to-legal-rule abstraction gap”: lengthy case narratives must be matched to short articles expressing general legal rules. On a benchmark of 200 synthetic cases and 381 articles from Saudi Arabia’s Family Law and Law of Evidence, the authors compare BM25, dense encoders, fusion methods and their proposed Decompose-and-Refine (DaR) pipeline. DaR uses a large language model to split each narrative into disputed legal issues and create three retrieval channels for each issue: a statute-style paraphrase, legal keywords and a candidate taxonomy chapter. The results differ sharply by law. Without decomposition, the Qwen3-Embedding-8B dense encoder has the best overall MRR@10 among the non-decomposed systems, but its score for Evidence articles is much lower than for Family Law. With DaR, the authors report higher MRR@10 for both: 0.696 for Evidence and 0.864 for Family Law. They argue this makes one retriever effective across the two laws in their benchmark, where different laws otherwise favor different retrieval strategies. Escape Meridian interpretation: these results concern retrieval rankings on synthetic cases and do not establish how the approach would perform on real judicial narratives. ## Original source arXiv cs.AI · Article Original source date: Oct 28, 2026 (2026-10-28). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-11T03:39:27.749Z. First observed: 2026-10-30T06:43:03.845Z. Retrieved: 2026-10-31T09:32:15.215Z. - [Statutory Article Retrieval from Arabic Judicial Narratives: Family Law and Law of Evidence in Saudi Arabia](https://arxiv.org/abs/2610.38336) ## Limits The reported benchmark consists of 200 synthetic cases, so the evidence provided does not establish performance on real judicial narratives. The evaluation covers articles from the Family Law and the Law of Evidence; the abstract does not report results for other areas of Saudi law. ## Open question How would DaR’s retrieval results compare on real Saudi judicial narratives? ## Source-stated The authors frame the task as matching long Arabic judicial narratives to concise statutory articles that express abstract rules. > long factual narratives must be mapped to concise articles that express abstract legal rules, creating a narrative-to-legal-rule abstraction gap. - [Supporting source](https://arxiv.org/abs/2610.38336) ## Source-stated The comparison uses 200 synthetic Saudi Arabic judicial cases and 381 articles from two areas of Saudi law. > a benchmark of 200 synthetic Saudi Arabic judicial cases and 381 articles from the Family Law and the Law of Evidence - [Supporting source](https://arxiv.org/abs/2610.38336) ## Source-stated DaR splits each narrative into disputed legal issues and generates three retrieval channels for each issue. > a large language model splits each narrative into disputed legal issues and generates, for each issue, three retrieval channels - [Supporting source](https://arxiv.org/abs/2610.38336) ## Source-stated Without decomposition, the instructed Qwen3-Embedding-8B dense encoder has the best overall MRR@10 among the tested non-decomposed systems, but its Evidence score is much lower. > reaches an MRR@10 of 0.849, the best result of any non-decomposed system. Under per-law scoring, this advantage reflects Family Law only: restricted to Evidence articles, the same encoder drops to an MRR@10 of 0.087 - [Supporting source](https://arxiv.org/abs/2610.38336) ## Source-stated The authors report that DaR raises Evidence MRR@10 to 0.696 and Family MRR@10 to 0.864. > DaR changes this picture, raising Evidence MRR@10 to 0.696 and Family MRR@10 to 0.864. - [Supporting source](https://arxiv.org/abs/2610.38336) ## Escape Meridian interpretation Because the benchmark is synthetic, these reported retrieval results do not by themselves show how DaR performs on real judicial narratives. > a benchmark of 200 synthetic Saudi Arabic judicial cases - [Supporting source](https://arxiv.org/abs/2610.38336) ## Source and contributor context Shibli, Zarah, Alhothali, Areej, Alharigy, Lulwah · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## Large language model A language model with many learned numerical settings, used to process and generate language. - [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 36e0fb64-3f36-4ba8-89b7-8e86996175e2. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-11T03:39:27.749Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 7e94527f9e1e8de6b15f9a3b1bdda4dbf3fe51c4481cff6db92d91bdfe126f7c. Source text hash: 054a926303a4630529e76f76a796a47115c05f386eaa01381ddf49583c094a18. ### uncertain — 2026-11-11T03:39:27.749Z — anthropic/claude-opus-5.5 Publication: 36e0fb64-3f36-4ba8-89b7-8e86996175e2 attribution — pass: The draft correctly credits the paper to Zarah Shibli, Areej Alhothali and Lulwah Alharigy. It frames the problem, method and results as the authors' reports and arguments, not as established fact. > Authors:Zarah Shibli, Areej Alhothali, Lulwah Alharigy summary — uncertain: The headline result depends on MRR@10, but the draft never explains it. It also leaves BM25, dense encoders, fusion and retrieval channels unexplained, so a non-specialist cannot tell whether 0.696 is good. The draft drops the striking 0.087 Evidence score (0.207 with fusion), which weakens the paper's core contrast. It also does not say why retrieval matters: grounding legal reasoning in authoritative statutes. Smallest repair: briefly explain MRR@10 as a ranking score that is higher when the correct article appears near the top of the first ten results. Then include 0.849 overall versus 0.087 for Evidence, and add the paper's grounding rationale. > restricted to Evidence articles, the same encoder drops to an MRR@10 of 0.087, and fusion with BM25 raises it only to 0.207 date — pass: The originalPublished date of 2026-10-28 matches the arXiv v1 submission date. The later feed date was correctly not used. > \[Submitted on 28 Oct 2026\] support — pass: The figures, benchmark size, DaR mechanism and per-law contrast match the abstract. Saying DaR makes one retriever "effective" across both laws slightly paraphrases "achieves the best MRR@10 on both," but stays within the source. The synthetic-data caveat is clearly labeled as Escape Meridian interpretation. The question follows from the evidence without assuming an answer. > Without decomposition, the two laws favor different strategies; under DaR, the same retriever achieves the best MRR@10 on both. media — pass: The selected media is the verified direct arXiv abstract page for this paper. It is the most direct way to reach the source. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/b559fe1b57f3a40a88a1794c8914da5f1be36525effdb807cbe27ac9e153c465/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-paper-tests-retrieval-of-saudi-statutory-articles-b559fe1b.json)