Wang, Bingchao, Jing, Yongcheng, Wang, Chengyu, Huang, Jun, Yang, Jie, Liu, Wei, Tao, Dacheng · Oct 27, 2026
Wang and coauthors propose adaptive zooming for GUI grounding
Markdown · JSON · Original source
In an paper, Bingchao Wang and coauthors argue that GUI grounding on high-resolution screens often fails on small targets, and that common zooming methods do not adapt zoom to target size or check and revisit incorrect answers. They propose AdaGround, a training-free framework that estimates target size to set zoom, uses a Yes/No verifier to keep or reject zooms and trigger another grounding attempt, and can abstain after an existence query. A third component composes spreadsheet cells from their headers. The authors report that, on Qwen3-VL models, AdaGround improves accuracy over the backbone by 7.4 to 20.6 points on OSWorld-G and ScreenSpot-Pro, and that gains carry over to held-out UI-Vision. They also say it surpasses state-of-the-art training-free zooming methods and many trained GUI models. These are results reported in the paper’s abstract; the supplied page does not provide details needed to assess the experiments or how the results relate to real-world use. How does the verifier’s performance affect the reported gains and the decision to abstain?
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Oct 27, 2026 (2026-10-27).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-14T04:03:12.722Z. First observed: 2026-10-28T07:14:37.613Z. Retrieved: 2026-10-30T23:20:00.299Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The supplied evidence is the abstract and page text, not the paper’s experimental details; it does not show how the were run or support conclusions about real-world performance. The abstract reports results on Qwen3-VL models but does not specify the verifier’s performance or how it affects the gains and abstention decisions.
Open question
How does the verifier’s performance affect the reported gains and the decision to abstain?
Source-stated
The authors say existing zooming pipelines do not adapt zoom to target size, accept zoomed answers unconditionally, and do not revisit wrong answers.
most existing zooming pipelines do not match the zoom to the target's size, accept the zoomed answer unconditionally and never revisit a wrong answer
Source-stated
AdaGround uses an estimate of target size to set zoom parameters and a Yes/No verifier to guide refinement, re-grounding, and abstention.
uses one marked-click Yes/No verifier to keep or reject each zoom, choose between zoom chains, trigger re-grounding and, with an existence query, decide when to abstain
Source-stated
The authors report accuracy improvements over the backbone of 7.4 to 20.6 points on OSWorld-G and ScreenSpot-Pro, with gains carrying over to held-out UI-Vision.
improving accuracy over the backbone by 7.4 to 20.6 points on OSWorld-G and ScreenSpot-Pro, and its gains carry over to held-out UI-Vision
Escape Meridian interpretation
The supplied abstract does not provide experimental details sufficient to assess the reported results or their relationship to real-world use.
On Qwen3-VL models, AdaGround surpasses state-of-the-art training-free zooming methods and many trained GUI models
Source and contributor context
Wang, Bingchao, Jing, Yongcheng, Wang, Chengyu, Huang, Jun, Yang, Jie, Liu, Wei, Tao, Dacheng · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 3689da61-e519-45be-862a-e211e3c4307b.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-14T04:03:12.722Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 6d9fcb68cc8f79ceedd11c58b6922e5472ba53ca9aedb4edb3063579f0144341. Source text hash: 0a097a6c7366bbf4c4c05cd6b2fa702c7d259bef7dcb18bd064a1336a45b306c.
Revision and source-check history
Version 1 · 2026-11-14T04:03:12.722Z
Wang and coauthors propose adaptive zooming for GUI grounding
In an paper, Bingchao Wang and coauthors argue that GUI grounding on high-resolution screens often fails on small targets, and that common zooming methods do not adapt zoom to target size or check and revisit incorrect answers. They propose AdaGround, a training-free framework that estimates target size to set zoom, uses a Yes/No verifier to keep or reject zooms and trigger another grounding attempt, and can abstain after an existence query. A third component composes spreadsheet cells from their headers. The authors report that, on Qwen3-VL models, AdaGround improves accuracy over the backbone by 7.4 to 20.6 points on OSWorld-G and ScreenSpot-Pro, and that gains carry over to held-out UI-Vision. They also say it surpasses state-of-the-art training-free zooming methods and many trained GUI models. These are results reported in the paper’s abstract; the supplied page does not provide details needed to assess the experiments or how the results relate to real-world use. How does the verifier’s performance affect the reported gains and the decision to abstain?
Original source
cs.AI · Article
Source details
Original source date: Oct 27, 2026 (2026-10-27).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-14T04:03:12.722Z. First observed: 2026-10-28T07:14:37.613Z. Retrieved: 2026-10-30T23:20:00.299Z.
Limits
The supplied evidence is the abstract and page text, not the paper’s experimental details; it does not show how the were run or support conclusions about real-world performance. The abstract reports results on Qwen3-VL models but does not specify the verifier’s performance or how it affects the gains and abstention decisions.
Open question
How does the verifier’s performance affect the reported gains and the decision to abstain?
Source-stated
The authors say existing zooming pipelines do not adapt zoom to target size, accept zoomed answers unconditionally, and do not revisit wrong answers.
most existing zooming pipelines do not match the zoom to the target's size, accept the zoomed answer unconditionally and never revisit a wrong answer
Source-stated
AdaGround uses an estimate of target size to set zoom parameters and a Yes/No verifier to guide refinement, re-grounding, and abstention.
uses one marked-click Yes/No verifier to keep or reject each zoom, choose between zoom chains, trigger re-grounding and, with an existence query, decide when to abstain
Source-stated
The authors report accuracy improvements over the backbone of 7.4 to 20.6 points on OSWorld-G and ScreenSpot-Pro, with gains carrying over to held-out UI-Vision.
improving accuracy over the backbone by 7.4 to 20.6 points on OSWorld-G and ScreenSpot-Pro, and its gains carry over to held-out UI-Vision
Escape Meridian interpretation
The supplied abstract does not provide experimental details sufficient to assess the reported results or their relationship to real-world use.
On Qwen3-VL models, AdaGround surpasses state-of-the-art training-free zooming methods and many trained GUI models
Source and contributor context
Wang, Bingchao, Jing, Yongcheng, Wang, Chengyu, Huang, Jun, Yang, Jie, Liu, Wei, Tao, Dacheng · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 3689da61-e519-45be-862a-e211e3c4307b.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-14T04:03:12.722Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 6d9fcb68cc8f79ceedd11c58b6922e5472ba53ca9aedb4edb3063579f0144341. Source text hash: 0a097a6c7366bbf4c4c05cd6b2fa702c7d259bef7dcb18bd064a1336a45b306c.
uncertain · 2026-11-14T04:03:12.722Z · anthropic/claude-opus-5.5
Publication: 3689da61-e519-45be-862a-e211e3c4307b
attribution — pass: The reading attributes the problem framing, method and results to Bingchao Wang and coauthors in an arXiv paper. It presents benchmark gains as reported by the authors, not as established facts.
Authors:Bingchao Wang, Yongcheng Jing, Chengyu Wang, Jun Huang, Jie Yang, Wei Liu, Dacheng Tao
summary — uncertain: The summary is faithful, but its central term, GUI grounding, is never explained in plain language. A general reader will not know it means an AI model locating the on-screen element it is told to act on. Training-free, backbone and Qwen3-VL are also unexplained, and the reading never says why the task matters. Smallest repair: add one plain sentence defining GUI grounding, and say what training-free means here (no model retraining). Then tooltip the other terms.
GUI grounding on high-resolution screens fails mostly on small targets, and zooming in is a common training-free remedy.
date — pass: The originalPublished date of 2026-10-27 matches the arXiv v1 submission date. The later feed date is correctly not used.
[Submitted on 27 Oct 2026]
support — pass: Each claim is source-stated and has a matching excerpt. The limitation about missing experimental detail is properly framed as interpretation. The question about verifier performance follows from the verifier's central role in the method and does not presuppose an answer. No benefits or costs are invented.
uses one marked-click Yes/No verifier to keep or reject each zoom, choose between zoom chains, trigger re-grounding and, with an existence query, decide when to abstain
media — pass: The selected media is the verified direct link to the original arXiv abstract page. This is the most direct access to the source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition reference