Kawano, Seiya, Marusaki, Koji, Nonaka, Hirofumi, Yoshino, Koichiro · Nov 17, 2026
arXiv: Teaching Language Models to Narrow Boolean Patent Searches from Search Feedback
Markdown · JSON · Original source
Seiya Kawano, Koji Marusaki, Hirofumi Nonaka and Koichiro Yoshino describe a way to train language models to make patent searches easier to screen. Patent searchers use Boolean queries—searches built from terms and logical operators—and adjust them to find relevant documents while reducing the candidate set. The authors distilled 38,397 Japan Patent Office search reports into executable strategies and compared two forms of offline adaptation, training from scored examples rather than live search feedback. One form rewards whole strategies; the other gives credit to query lines that retain a citation while shrinking the set. On shared rollouts, line-level credit performed better on screening measures: iterated, it reduced the median citation-containing set from 768 to under 50 and put more citations in sets under 100 documents than expert strategies, but with lower recall. Strategy-level preference learning reached near-complete recall, and the authors describe the approaches as complementary. The tradeoff matters for prior-art searches: smaller sets may be easier to screen, while lower recall means fewer relevant citations are found. The abstract reports these evaluation results but does not give the size of the recall reduction.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 17, 2026 (2026-11-17).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-18T13:03:15.895Z. First observed: 2026-11-18T05:22:20.665Z. Retrieved: 2026-11-18T13:02:26.788Z.
Referenced by
Recorded citations in public readings. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The abstract reports lower recall for the iterated line-level approach but does not quantify the reduction. The abstract does not provide details of the evaluation beyond its stated measures and comparisons.
Open question
How much recall is lost when line-level credit reduces the citation-containing sets, and how does that tradeoff compare across the two forms of adaptation?
Source-stated
The authors distilled Japan Patent Office search reports into executable expert strategies and evaluated generated strategies using citation recall and the size of sets containing citations.
We distill 38,397 Japan Patent Office search reports into executable expert strategies, re-execute them, and evaluate generated strategies by citation recall and the smallest set containing each citation.
Source-stated
Prompted models produced valid, high-recall strategies, but their candidate sets remained too large to screen.
Prompted models write valid, high-recall strategies but leave citations in sets too large to screen.
Source-stated
The authors compared offline adaptation using strategy-level scores with line-level credit for narrowing while preserving citations.
strategy-level learning from a screening-aware strategy score, and line-level learning from citation-preserving narrowing credit
Source-stated
On shared rollouts, line-level credit improved screening measures, sharply reducing median citation-containing set size while achieving lower recall than experts on the reported comparison.
iterated, it cuts the median citation-containing set from 768 to under 50 and places more citations in sets under 100 documents than experts, at lower recall.
Source-stated
Strategy-level preference learning reached near-complete recall, and the authors characterize the two approaches as complementary.
Strategy-level preference learning reaches near-complete recall; the two forms are complementary.
Source and contributor context
Kawano, Seiya, Marusaki, Koji, Nonaka, Hirofumi, Yoshino, Koichiro · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 68292357-1a97-460d-8a9e-c638410842ea.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-18T13:03:15.895Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: f2cd1896884041c5babcc5e9d89552e5dda9015b303b095371dc78c2225edb9c. Source text hash: 57bdac33d1923b59209763de1ade278068cc216ac3b57f46e3d457937b245cdb.
Revision and source-check history
Version 1 · 2026-11-18T13:03:15.895Z
arXiv: Teaching Language Models to Narrow Boolean Patent Searches from Search Feedback
Seiya Kawano, Koji Marusaki, Hirofumi Nonaka and Koichiro Yoshino describe a way to train language models to make patent searches easier to screen. Patent searchers use Boolean queries—searches built from terms and logical operators—and adjust them to find relevant documents while reducing the candidate set. The authors distilled 38,397 Japan Patent Office search reports into executable strategies and compared two forms of offline adaptation, training from scored examples rather than live search feedback. One form rewards whole strategies; the other gives credit to query lines that retain a citation while shrinking the set. On shared rollouts, line-level credit performed better on screening measures: iterated, it reduced the median citation-containing set from 768 to under 50 and put more citations in sets under 100 documents than expert strategies, but with lower recall. Strategy-level preference learning reached near-complete recall, and the authors describe the approaches as complementary. The tradeoff matters for prior-art searches: smaller sets may be easier to screen, while lower recall means fewer relevant citations are found. The abstract reports these evaluation results but does not give the size of the recall reduction.
Original source
cs.AI · Article
Source details
Original source date: Nov 17, 2026 (2026-11-17).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-18T13:03:15.895Z. First observed: 2026-11-18T05:22:20.665Z. Retrieved: 2026-11-18T13:02:26.788Z.
Limits
The abstract reports lower recall for the iterated line-level approach but does not quantify the reduction. The abstract does not provide details of the evaluation beyond its stated measures and comparisons.
Open question
How much recall is lost when line-level credit reduces the citation-containing sets, and how does that tradeoff compare across the two forms of adaptation?
Source-stated
The authors distilled Japan Patent Office search reports into executable expert strategies and evaluated generated strategies using citation recall and the size of sets containing citations.
We distill 38,397 Japan Patent Office search reports into executable expert strategies, re-execute them, and evaluate generated strategies by citation recall and the smallest set containing each citation.
Source-stated
Prompted models produced valid, high-recall strategies, but their candidate sets remained too large to screen.
Prompted models write valid, high-recall strategies but leave citations in sets too large to screen.
Source-stated
The authors compared offline adaptation using strategy-level scores with line-level credit for narrowing while preserving citations.
strategy-level learning from a screening-aware strategy score, and line-level learning from citation-preserving narrowing credit
Source-stated
On shared rollouts, line-level credit improved screening measures, sharply reducing median citation-containing set size while achieving lower recall than experts on the reported comparison.
iterated, it cuts the median citation-containing set from 768 to under 50 and places more citations in sets under 100 documents than experts, at lower recall.
Source-stated
Strategy-level preference learning reached near-complete recall, and the authors characterize the two approaches as complementary.
Strategy-level preference learning reaches near-complete recall; the two forms are complementary.
Source and contributor context
Kawano, Seiya, Marusaki, Koji, Nonaka, Hirofumi, Yoshino, Koichiro · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 68292357-1a97-460d-8a9e-c638410842ea.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-18T13:03:15.895Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: f2cd1896884041c5babcc5e9d89552e5dda9015b303b095371dc78c2225edb9c. Source text hash: 57bdac33d1923b59209763de1ade278068cc216ac3b57f46e3d457937b245cdb.
uncertain · 2026-11-18T13:03:15.895Z · anthropic/claude-opus-5.5
Publication: 68292357-1a97-460d-8a9e-c638410842ea
attribution — pass: The reading correctly attributes the work to the four listed authors and keeps the results framed as their reported findings.
Authors:Seiya Kawano, Koji Marusaki, Hirofumi Nonaka, Koichiro Yoshino
summary — uncertain: The summary follows the abstract, but several central terms are unexplained for non-specialists. These include prior-art search, citation (the documents cited in examiner search reports), recall and rollouts. The gloss of offline adaptation as training 'rather than live search feedback' is an inference; the paper's title says it learns from search feedback. Smallest repair: explain that citations are the examiner-cited documents and that recall is the share of them found. Then describe the training as learning offline from scored rollouts, without contrasting it with search feedback.
We adapt a generator offline from scored rollouts in two forms
date — pass: The originalPublished date, 2026-11-17, matches the arXiv submission date for v1.
[Submitted on 17 Nov 2026]
support — uncertain: Most claims are source-stated. Claim 4, however, says line-level credit achieved 'lower recall than experts'. The abstract only says 'at lower recall' and does not specify the comparison point; it could be experts, prompted models or the strategy-level method. Smallest repair: say 'at lower recall', without naming experts as the baseline.
places more citations in sets under 100 documents than experts, at lower recall.
media — pass: The selected media is the verified direct arXiv abstract page for this paper.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv