Wang, Bingchao, Jing, Yongcheng, Liu, Shunyu, Wang, Chengyu, Huang, Jun, Yang, Jie, Liu, Wei, Tao, Dacheng · Oct 27, 2026
arXiv: GUI-JEPA: Candidate-Conditioned JEPA Latents for Mobile GUI Agents
Markdown · JSON · Original source
In a paper by Bingchao Wang and coauthors, the authors introduce GUI-JEPA, a mobile GUI agent policy that selects actions using latent representations rather than generating action text token by token. A latent representation is an internal encoding used by a model; JEPA is the architecture named in the paper’s title and abstract. The authors say the policy predicts a representation for each candidate action and scores the candidates in one batched pass, without decoding tokens. They report that, on AndroidControl and on the same , GUI-JEPA was 2.8–4.0x faster than a Qwen2.5-VL-7B agent they with the same inputs. They also report 86–92% of that agent’s in-distribution accuracy using 6% of its parameters. These results suggest a possible speed and memory advantage for this approach in the tested setting, but the abstract does not establish how it performs across other apps, devices or conditions. Does GUI-JEPA retain its reported speed and accuracy when tested beyond AndroidControl and the paper’s in-distribution setting?
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Oct 27, 2026 (2026-10-27).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-06T00:32:06.935Z. First observed: 2026-10-28T08:46:32.247Z. Retrieved: 2026-10-30T02:32:59.628Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The reported speed and accuracy comparison in the abstract is on AndroidControl and against one Qwen2.5-VL-7B agent using the same inputs. The abstract reports in-distribution accuracy; it does not establish performance across other apps, devices or conditions.
Open question
Does GUI-JEPA retain its reported speed and accuracy when tested beyond AndroidControl and the paper’s in-distribution setting?
Source-stated
The authors present GUI-JEPA as a decoder-free policy for selecting actions for mobile GUI agents using JEPA latents.
we propose GUI-JEPA, to our knowledge the first decoder-free GUI agent policy built on a Joint-Embedding Predictive Architecture (JEPA)
Source-stated
The policy predicts a latent for each candidate action and scores the candidates together without token decoding.
letting lightweight heads score all candidates against the instruction in a single batched pass, without decoding a token.
Source-stated
On AndroidControl, the authors report GUI-JEPA ran 2.8–4.0x faster on the same GPU than their fine-tuned Qwen2.5-VL-7B comparison agent.
On AndroidControl, GUI-JEPA is 2.8-4.0x faster on the same GPU than a Qwen2.5-VL-7B agent we fine-tune with the same inputs
Source-stated
The authors report GUI-JEPA reached 86–92% of the comparison agent’s in-distribution accuracy with 6% of its parameters.
while reaching 86-92% of its in-distribution accuracy with 6% of its parameters.
Source and contributor context
Wang, Bingchao, Jing, Yongcheng, Liu, Shunyu, Wang, Chengyu, Huang, Jun, Yang, Jie, Liu, Wei, Tao, Dacheng · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Graphics processing unit
A chip that performs many calculations at once; the main hardware used to train and run AI models.
Fine-tuning
Further training of an existing model to adapt it to a particular task or use.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 389b9f8d-2c27-43a2-8d31-432649c1700b.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-06T00:32:06.935Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 7d6ffcab577286b76a5f8e53e569d0800eb48cf6e393d02a813e0e829302fd2a. Source text hash: 5a6e79d5efabe9e0b2501abb7eda77bac1a63e533c7ac878763c929fde83239a.
Revision and source-check history
Version 1 · 2026-11-06T00:32:06.935Z
arXiv: GUI-JEPA: Candidate-Conditioned JEPA Latents for Mobile GUI Agents
In a paper by Bingchao Wang and coauthors, the authors introduce GUI-JEPA, a mobile GUI agent policy that selects actions using latent representations rather than generating action text token by token. A latent representation is an internal encoding used by a model; JEPA is the architecture named in the paper’s title and abstract. The authors say the policy predicts a representation for each candidate action and scores the candidates in one batched pass, without decoding tokens. They report that, on AndroidControl and on the same , GUI-JEPA was 2.8–4.0x faster than a Qwen2.5-VL-7B agent they with the same inputs. They also report 86–92% of that agent’s in-distribution accuracy using 6% of its parameters. These results suggest a possible speed and memory advantage for this approach in the tested setting, but the abstract does not establish how it performs across other apps, devices or conditions. Does GUI-JEPA retain its reported speed and accuracy when tested beyond AndroidControl and the paper’s in-distribution setting?
Original source
cs.AI · Article
Source details
Original source date: Oct 27, 2026 (2026-10-27).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-06T00:32:06.935Z. First observed: 2026-10-28T08:46:32.247Z. Retrieved: 2026-10-30T02:32:59.628Z.
Limits
The reported speed and accuracy comparison in the abstract is on AndroidControl and against one Qwen2.5-VL-7B agent using the same inputs. The abstract reports in-distribution accuracy; it does not establish performance across other apps, devices or conditions.
Open question
Does GUI-JEPA retain its reported speed and accuracy when tested beyond AndroidControl and the paper’s in-distribution setting?
Source-stated
The authors present GUI-JEPA as a decoder-free policy for selecting actions for mobile GUI agents using JEPA latents.
we propose GUI-JEPA, to our knowledge the first decoder-free GUI agent policy built on a Joint-Embedding Predictive Architecture (JEPA)
Source-stated
The policy predicts a latent for each candidate action and scores the candidates together without token decoding.
letting lightweight heads score all candidates against the instruction in a single batched pass, without decoding a token.
Source-stated
On AndroidControl, the authors report GUI-JEPA ran 2.8–4.0x faster on the same GPU than their fine-tuned Qwen2.5-VL-7B comparison agent.
On AndroidControl, GUI-JEPA is 2.8-4.0x faster on the same GPU than a Qwen2.5-VL-7B agent we fine-tune with the same inputs
Source-stated
The authors report GUI-JEPA reached 86–92% of the comparison agent’s in-distribution accuracy with 6% of its parameters.
while reaching 86-92% of its in-distribution accuracy with 6% of its parameters.
Source and contributor context
Wang, Bingchao, Jing, Yongcheng, Liu, Shunyu, Wang, Chengyu, Huang, Jun, Yang, Jie, Liu, Wei, Tao, Dacheng · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Graphics processing unit
A chip that performs many calculations at once; the main hardware used to train and run AI models.
Fine-tuning
Further training of an existing model to adapt it to a particular task or use.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 389b9f8d-2c27-43a2-8d31-432649c1700b.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-06T00:32:06.935Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 7d6ffcab577286b76a5f8e53e569d0800eb48cf6e393d02a813e0e829302fd2a. Source text hash: 5a6e79d5efabe9e0b2501abb7eda77bac1a63e533c7ac878763c929fde83239a.
uncertain · 2026-11-06T00:32:06.935Z · anthropic/claude-opus-5.5
Publication: 389b9f8d-2c27-43a2-8d31-432649c1700b
attribution — pass: The reading attributes the work to Bingchao Wang and coauthors, which matches the listed authors. Results are framed as what the authors report, not as established fact.
Authors:Bingchao Wang, Yongcheng Jing, Shunyu Liu, Chengyu Wang, Jun Huang, Jie Yang, Wei Liu, Dacheng Tao
summary — uncertain: The reading is faithful, but central terms are not explained for a general reader. 'Mobile GUI agent' is never defined (AI that operates phone app screens). JEPA is only called 'the architecture named in the paper's title', which is circular; its full name, Joint-Embedding Predictive Architecture, and its pretraining on unlabelled screenshots are missing. AndroidControl and 'in-distribution' are also unexplained. It also omits the abstract's notable finding that a randomly initialised predictor does as well as a pretrained one. Smallest repair: add one-clause plain definitions of these terms and mention that ablation finding.
a randomly initialised predictor does just as well as one pretrained on screen dynamics
date — pass: originalPublished 2026-10-27 matches the arXiv v1 submission date, not the later feed date.
[Submitted on 27 Oct 2026]
support — pass: The speed, accuracy and parameter figures are quoted accurately with their conditions: AndroidControl, same GPU, same inputs, and in-distribution. The 'possible speed and memory advantage' is hedged and consistent with the abstract's memory framing and the 6% parameter figure. The closing question follows from the single-benchmark scope.
On AndroidControl, GUI-JEPA is 2.8-4.0x faster on the same GPU than a Qwen2.5-VL-7B agent we fine-tune with the same inputs, while reaching 86-92% of its in-distribution accuracy with 6% of its parameters.
media — pass: The selected media is the verified arXiv abstract page for this paper, the direct original source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A chip that performs many calculations at once; the main hardware used to train and run AI models.
Definition referenceFurther training of an existing model to adapt it to a particular task or use.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivFurther training of an existing model to adapt it to a particular task or use.
Definition referenceA chip that performs many calculations at once; the main hardware used to train and run AI models.
Definition referenceFurther training of an existing model to adapt it to a particular task or use.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivFurther training of an existing model to adapt it to a particular task or use.
Definition reference