Escape Meridian

Kawano, Seiya, Marusaki, Koji, Nonaka, Hirofumi, Yoshino, Koichiro · Nov 17, 2026

arXiv: Teaching Language Models to Narrow Boolean Patent Searches from Search Feedback

Markdown · JSON · Original source

Seiya Kawano, Koji Marusaki, Hirofumi Nonaka and Koichiro Yoshino describe a way to train language models to make patent searches easier to screen. Patent searchers use Boolean queries—searches built from terms and logical operators—and adjust them to find relevant documents while reducing the candidate set. The authors distilled 38,397 Japan Patent Office search reports into executable strategies and compared two forms of offline adaptation, training from scored examples rather than live search feedback. One form rewards whole strategies; the other gives credit to query lines that retain a citation while shrinking the set. On shared rollouts, line-level credit performed better on screening measures: iterated, it reduced the median citation-containing set from 768 to under 50 and put more citations in sets under 100 documents than expert strategies, but with lower recall. Strategy-level preference learning reached near-complete recall, and the authors describe the approaches as complementary. The tradeoff matters for prior-art searches: smaller sets may be easier to screen, while lower recall means fewer relevant citations are found. The abstract reports these evaluation results but does not give the size of the recall reduction.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

arXiv cs.AIArticle · arxiv.orgOpen original source

Original source

cs.AI · Article

Source details

Original source date: Nov 17, 2026 (2026-11-17).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-18T13:03:15.895Z. First observed: 2026-11-18T05:22:20.665Z. Retrieved: 2026-11-18T13:02:26.788Z.

Referenced by

Recorded citations in public readings. A reference alone does not establish agreement or influence.

No public references recorded here yet.

Reference data (JSON)

Limits

The abstract reports lower recall for the iterated line-level approach but does not quantify the reduction. The abstract does not provide details of the evaluation beyond its stated measures and comparisons.

Open question

How much recall is lost when line-level credit reduces the citation-containing sets, and how does that tradeoff compare across the two forms of adaptation?

Source-stated

The authors distilled Japan Patent Office search reports into executable expert strategies and evaluated generated strategies using citation recall and the size of sets containing citations.

We distill 38,397 Japan Patent Office search reports into executable expert strategies, re-execute them, and evaluate generated strategies by citation recall and the smallest set containing each citation.

Source-stated

Prompted models produced valid, high-recall strategies, but their candidate sets remained too large to screen.

Prompted models write valid, high-recall strategies but leave citations in sets too large to screen.

Source-stated

The authors compared offline adaptation using strategy-level scores with line-level credit for narrowing while preserving citations.

strategy-level learning from a screening-aware strategy score, and line-level learning from citation-preserving narrowing credit

Source-stated

On shared rollouts, line-level credit improved screening measures, sharply reducing median citation-containing set size while achieving lower recall than experts on the reported comparison.

iterated, it cuts the median citation-containing set from 768 to under 50 and places more citations in sets under 100 documents than experts, at lower recall.

Source-stated

Strategy-level preference learning reached near-complete recall, and the authors characterize the two approaches as complementary.

Strategy-level preference learning reaches near-complete recall; the two forms are complementary.

Source and contributor context

Kawano, Seiya, Marusaki, Koji, Nonaka, Hirofumi, Yoshino, Koichiro · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

Editorial provenance

Version 1. Publication ID: 68292357-1a97-460d-8a9e-c638410842ea.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-18T13:03:15.895Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: f2cd1896884041c5babcc5e9d89552e5dda9015b303b095371dc78c2225edb9c. Source text hash: 57bdac33d1923b59209763de1ade278068cc216ac3b57f46e3d457937b245cdb.

Revision and source-check history

Version 1 · 2026-11-18T13:03:15.895Z

arXiv: Teaching Language Models to Narrow Boolean Patent Searches from Search Feedback

Seiya Kawano, Koji Marusaki, Hirofumi Nonaka and Koichiro Yoshino describe a way to train language models to make patent searches easier to screen. Patent searchers use Boolean queries—searches built from terms and logical operators—and adjust them to find relevant documents while reducing the candidate set. The authors distilled 38,397 Japan Patent Office search reports into executable strategies and compared two forms of offline adaptation, training from scored examples rather than live search feedback. One form rewards whole strategies; the other gives credit to query lines that retain a citation while shrinking the set. On shared rollouts, line-level credit performed better on screening measures: iterated, it reduced the median citation-containing set from 768 to under 50 and put more citations in sets under 100 documents than expert strategies, but with lower recall. Strategy-level preference learning reached near-complete recall, and the authors describe the approaches as complementary. The tradeoff matters for prior-art searches: smaller sets may be easier to screen, while lower recall means fewer relevant citations are found. The abstract reports these evaluation results but does not give the size of the recall reduction.

Original source

cs.AI · Article

Source details

Original source date: Nov 17, 2026 (2026-11-17).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-18T13:03:15.895Z. First observed: 2026-11-18T05:22:20.665Z. Retrieved: 2026-11-18T13:02:26.788Z.

Limits

The abstract reports lower recall for the iterated line-level approach but does not quantify the reduction. The abstract does not provide details of the evaluation beyond its stated measures and comparisons.

Open question

How much recall is lost when line-level credit reduces the citation-containing sets, and how does that tradeoff compare across the two forms of adaptation?

Source-stated

The authors distilled Japan Patent Office search reports into executable expert strategies and evaluated generated strategies using citation recall and the size of sets containing citations.

We distill 38,397 Japan Patent Office search reports into executable expert strategies, re-execute them, and evaluate generated strategies by citation recall and the smallest set containing each citation.

Source-stated

Prompted models produced valid, high-recall strategies, but their candidate sets remained too large to screen.

Prompted models write valid, high-recall strategies but leave citations in sets too large to screen.

Source-stated

The authors compared offline adaptation using strategy-level scores with line-level credit for narrowing while preserving citations.

strategy-level learning from a screening-aware strategy score, and line-level learning from citation-preserving narrowing credit

Source-stated

On shared rollouts, line-level credit improved screening measures, sharply reducing median citation-containing set size while achieving lower recall than experts on the reported comparison.

iterated, it cuts the median citation-containing set from 768 to under 50 and places more citations in sets under 100 documents than experts, at lower recall.

Source-stated

Strategy-level preference learning reached near-complete recall, and the authors characterize the two approaches as complementary.

Strategy-level preference learning reaches near-complete recall; the two forms are complementary.

Source and contributor context

Kawano, Seiya, Marusaki, Koji, Nonaka, Hirofumi, Yoshino, Koichiro · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

Editorial provenance

Version 1. Publication ID: 68292357-1a97-460d-8a9e-c638410842ea.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-18T13:03:15.895Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: f2cd1896884041c5babcc5e9d89552e5dda9015b303b095371dc78c2225edb9c. Source text hash: 57bdac33d1923b59209763de1ade278068cc216ac3b57f46e3d457937b245cdb.

uncertain · 2026-11-18T13:03:15.895Z · anthropic/claude-opus-5.5

Publication: 68292357-1a97-460d-8a9e-c638410842ea

attribution — pass: The reading correctly attributes the work to the four listed authors and keeps the results framed as their reported findings.

Authors:Seiya Kawano, Koji Marusaki, Hirofumi Nonaka, Koichiro Yoshino

summary — uncertain: The summary follows the abstract, but several central terms are unexplained for non-specialists. These include prior-art search, citation (the documents cited in examiner search reports), recall and rollouts. The gloss of offline adaptation as training 'rather than live search feedback' is an inference; the paper's title says it learns from search feedback. Smallest repair: explain that citations are the examiner-cited documents and that recall is the share of them found. Then describe the training as learning offline from scored rollouts, without contrasting it with search feedback.

We adapt a generator offline from scored rollouts in two forms

date — pass: The originalPublished date, 2026-11-17, matches the arXiv submission date for v1.

[Submitted on 17 Nov 2026]

support — uncertain: Most claims are source-stated. Claim 4, however, says line-level credit achieved 'lower recall than experts'. The abstract only says 'at lower recall' and does not specify the comparison point; it could be experts, prompted models or the strategy-level method. Smallest repair: say 'at lower recall', without naming experts as the baseline.

places more citations in sets under 100 documents than experts, at lower recall.

media — pass: The selected media is the verified direct arXiv abstract page for this paper.

Challenge or correct this reading

Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.