{"id":"c76b3b22fe714430a106ef72d38e2e033dcb0ae4d028bda9c3056e862ed50577","title":"arXiv cs.AI: Online Dense Reinforcement Learning for UI Navigation","argument":"Peitong Duan and coauthors propose training UI navigation agents directly on live iOS applications. They argue this could address two shortcomings: frontier vision-language models have high inference costs, while smaller models trained on static trajectories can fail to recover from errors.\n\nTheir framework separates planning from UI grounding and uses an LLM-as-a-Judge for step-level feedback and a final task-completion reward. The authors combine these signals with Proximal Policy Optimization (PPO) and introduce GiGPPO, which they say improves critic stability by using reward signals from visually similar states.\n\nThe authors report that their agents outperform supervised fine-tuning (SFT) and terminal-only reinforcement-learning baselines on UINavBench, iOSWorld, and AndroidWorld. They report nearly a sevenfold improvement over the SFT baseline in out-of-distribution generalization to Android environments for their 8B agents, and say the agents outperform Gemini-3.5-Flash and tie with Gemini-3.1-Pro on real iOS applications. These are reported evaluation results; the abstract does not establish performance in everyday use.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence is the arXiv abstract; it does not include benchmark scores, experimental details, or enough information to assess how the reported results vary across tasks. The abstract reports evaluations on benchmarks and real iOS applications but does not establish performance in everyday use. The abstract identifies high inference costs as a problem for frontier vision-language models but does not quantify those costs or compare them with the proposed agents.","speaker":{"name":"Duan, Peitong, Gatmiry, Khashayar, Nichols, Jeffrey, Bengio, Samy, Abbe, Emmanuel","roleAtSource":"Article author"},"source":{"title":"Online Dense Reinforcement Learning with Planning-Grounding Agent for UI Navigation on Live IOS Apps","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.39264","publishedAt":"2026-10-29","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose an online reinforcement-learning framework that trains UI navigation agents directly on live iOS applications.","excerpt":"we propose a novel online reinforcement learning framework that trains UI navigation agents directly on live iOS applications.","url":"https://arxiv.org/abs/2610.39264","relationship":"Source-stated"},{"text":"The framework separates planning and UI grounding, and uses an LLM-as-a-Judge for step-level and terminal reward signals.","excerpt":"We rely on an LLM-as-a-Judge to provide comprehensive reward signals, combining dense, step-level feedback to evaluate intermediate progress with a terminal reward for overall task completion.","url":"https://arxiv.org/abs/2610.39264","relationship":"Source-stated"},{"text":"The authors introduce GiGPPO, which they say improves critic stability by using reward signals from visually similar states across concurrent trajectories.","excerpt":"we introduce GiGPPO, a novel neighbor-conditioned value estimation method that improves critic stability by leveraging reward signals from visually similar states across concurrent trajectories.","url":"https://arxiv.org/abs/2610.39264","relationship":"Source-stated"},{"text":"The authors report that their agents outperform SFT and terminal-only RL baselines on UINavBench, iOSWorld, and AndroidWorld.","excerpt":"Evaluations on rigorous benchmarks, including UINavBench, iOSWorld, and AndroidWorld, demonstrate that our online RL trained agents substantially outperform both SFT and terminal-only RL baselines","url":"https://arxiv.org/abs/2610.39264","relationship":"Source-stated"},{"text":"The authors report nearly a sevenfold improvement over the SFT baseline for 8B agents in out-of-distribution generalization to Android environments.","excerpt":"our 8B RL agents achieve nearly a sevenfold improvement over the SFT baseline in out-of-distribution generalization to Android environments","url":"https://arxiv.org/abs/2610.39264","relationship":"Source-stated"},{"text":"The authors say their agents outperform Gemini-3.5-Flash and tie with Gemini-3.1-Pro on real iOS applications.","excerpt":"while outperforming Gemini-3.5-Flash and tying with Gemini-3.1-Pro on real iOS applications.","url":"https://arxiv.org/abs/2610.39264","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.39264","checkedAt":"2026-11-13T09:24:11.405Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How do the reported gains hold up across different tasks and live apps beyond the evaluations described in the abstract?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Online Dense Reinforcement Learning for UI Navigation","summary":"Peitong Duan and coauthors propose training UI navigation agents directly on live iOS applications. They argue this could address two shortcomings: frontier vision-language models have high inference costs, while smaller models trained on static trajectories can fail to recover from errors.\n\nTheir framework separates planning from UI grounding and uses an LLM-as-a-Judge for step-level feedback and a final task-completion reward. The authors combine these signals with Proximal Policy Optimization (PPO) and introduce GiGPPO, which they say improves critic stability by using reward signals from visually similar states.\n\nThe authors report that their agents outperform supervised fine-tuning (SFT) and terminal-only reinforcement-learning baselines on UINavBench, iOSWorld, and AndroidWorld. They report nearly a sevenfold improvement over the SFT baseline in out-of-distribution generalization to Android environments for their 8B agents, and say the agents outperform Gemini-3.5-Flash and tie with Gemini-3.1-Pro on real iOS applications. These are reported evaluation results; the abstract does not establish performance in everyday use.","question":"How do the reported gains hold up across different tasks and live apps beyond the evaluations described in the abstract?","claims":[{"text":"The authors propose an online reinforcement-learning framework that trains UI navigation agents directly on live iOS applications.","excerpt":"we propose a novel online reinforcement learning framework that trains UI navigation agents directly on live iOS applications.","support":"source-stated"},{"text":"The framework separates planning and UI grounding, and uses an LLM-as-a-Judge for step-level and terminal reward signals.","excerpt":"We rely on an LLM-as-a-Judge to provide comprehensive reward signals, combining dense, step-level feedback to evaluate intermediate progress with a terminal reward for overall task completion.","support":"source-stated"},{"text":"The authors introduce GiGPPO, which they say improves critic stability by using reward signals from visually similar states across concurrent trajectories.","excerpt":"we introduce GiGPPO, a novel neighbor-conditioned value estimation method that improves critic stability by leveraging reward signals from visually similar states across concurrent trajectories.","support":"source-stated"},{"text":"The authors report that their agents outperform SFT and terminal-only RL baselines on UINavBench, iOSWorld, and AndroidWorld.","excerpt":"Evaluations on rigorous benchmarks, including UINavBench, iOSWorld, and AndroidWorld, demonstrate that our online RL trained agents substantially outperform both SFT and terminal-only RL baselines","support":"source-stated"},{"text":"The authors report nearly a sevenfold improvement over the SFT baseline for 8B agents in out-of-distribution generalization to Android environments.","excerpt":"our 8B RL agents achieve nearly a sevenfold improvement over the SFT baseline in out-of-distribution generalization to Android environments","support":"source-stated"},{"text":"The authors say their agents outperform Gemini-3.5-Flash and tie with Gemini-3.1-Pro on real iOS applications.","excerpt":"while outperforming Gemini-3.5-Flash and tying with Gemini-3.1-Pro on real iOS applications.","support":"source-stated"}],"limitations":["The evidence is the arXiv abstract; it does not include benchmark scores, experimental details, or enough information to assess how the reported results vary across tasks.","The abstract reports evaluations on benchmarks and real iOS applications but does not establish performance in everyday use.","The abstract identifies high inference costs as a problem for frontier vision-language models but does not quantify those costs or compare them with the proposed agents."],"mediaId":"397ec68d1b530d3cfc7862b30f72c3b8d88da2173b5a1a412191c6bac254d435","correctionReason":null,"id":"c76b3b22fe714430a106ef72d38e2e033dcb0ae4d028bda9c3056e862ed50577","publicationId":"d32e94ab-c6f0-409c-8692-9956502681dc","version":1,"sourceUrl":"https://arxiv.org/abs/2610.39264","sourceTitle":"Online Dense Reinforcement Learning with Planning-Grounding Agent for UI Navigation on Live IOS Apps","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-29","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-30T06:45:38.292Z","createdAt":"2026-11-13T07:17:53.149Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"397ec68d1b530d3cfc7862b30f72c3b8d88da2173b5a1a412191c6bac254d435","kind":"article","url":"https://arxiv.org/abs/2610.39264","sourceUrl":"https://arxiv.org/abs/2610.39264","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-31T10:33:02.631Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.39264","checkedAt":"2026-11-13T09:24:11.405Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"397ec68d1b530d3cfc7862b30f72c3b8d88da2173b5a1a412191c6bac254d435","confidence":0.93,"provider":"typesafe","model":"jev-1.13.0","inputHash":"a35e3e34fb77f5a6b8c34e43c92d776798fcdf82e05d8fc7eedc23406622da42","decidedAt":"2026-10-31T10:33:03.341Z"},"provenance":{"textHash":"ca3aed14080904e2a6b2b5c0333de9cdfa714bb309618f7edcbc488b81db9ba7","observationId":"8cef9760f7d494143cf9db245ca39d0d4179db4f4271611824e51cd6f0f0844f","retrievedAt":"2026-10-31T10:33:02.566Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"c81a7d11-f20a-4bd8-8cb6-8a649553ebe3"},"reviewer":{"model":"gpt-6-luna","runId":"4a06ca21-39b2-4353-80b5-61fb96b7d2ea"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-13T07:17:53.149Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Duan, Peitong","url":null,"kind":"unknown"},{"name":"Gatmiry, Khashayar","url":null,"kind":"unknown"},{"name":"Nichols, Jeffrey","url":null,"kind":"unknown"},{"name":"Bengio, Samy","url":null,"kind":"unknown"},{"name":"Abbe, Emmanuel","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Duan, Peitong","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Duan, Peitong","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.39264","locator":"head/meta[name=author|citation_author]"},"assertionId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T09:24:11.405Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc","sourceUrl":"https://arxiv.org/abs/2610.39264","contentSha256":"bf5ca7ec51e1290959832fcf8cbca128ef3fd7b53e3d5b7ed5902fedfc27b7ee","textHash":"ca3aed14080904e2a6b2b5c0333de9cdfa714bb309618f7edcbc488b81db9ba7","observedAt":"2026-11-13T09:24:11.405Z"}},{"actor":{"name":"Gatmiry, Khashayar","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gatmiry, Khashayar","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.39264","locator":"head/meta[name=author|citation_author]"},"assertionId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T09:24:11.405Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc","sourceUrl":"https://arxiv.org/abs/2610.39264","contentSha256":"bf5ca7ec51e1290959832fcf8cbca128ef3fd7b53e3d5b7ed5902fedfc27b7ee","textHash":"ca3aed14080904e2a6b2b5c0333de9cdfa714bb309618f7edcbc488b81db9ba7","observedAt":"2026-11-13T09:24:11.405Z"}},{"actor":{"name":"Nichols, Jeffrey","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Nichols, Jeffrey","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.39264","locator":"head/meta[name=author|citation_author]"},"assertionId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T09:24:11.405Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc","sourceUrl":"https://arxiv.org/abs/2610.39264","contentSha256":"bf5ca7ec51e1290959832fcf8cbca128ef3fd7b53e3d5b7ed5902fedfc27b7ee","textHash":"ca3aed14080904e2a6b2b5c0333de9cdfa714bb309618f7edcbc488b81db9ba7","observedAt":"2026-11-13T09:24:11.405Z"}},{"actor":{"name":"Bengio, Samy","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Bengio, Samy","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.39264","locator":"head/meta[name=author|citation_author]"},"assertionId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T09:24:11.405Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc","sourceUrl":"https://arxiv.org/abs/2610.39264","contentSha256":"bf5ca7ec51e1290959832fcf8cbca128ef3fd7b53e3d5b7ed5902fedfc27b7ee","textHash":"ca3aed14080904e2a6b2b5c0333de9cdfa714bb309618f7edcbc488b81db9ba7","observedAt":"2026-11-13T09:24:11.405Z"}},{"actor":{"name":"Abbe, Emmanuel","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Abbe, Emmanuel","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.39264","locator":"head/meta[name=author|citation_author]"},"assertionId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T09:24:11.405Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc","sourceUrl":"https://arxiv.org/abs/2610.39264","contentSha256":"bf5ca7ec51e1290959832fcf8cbca128ef3fd7b53e3d5b7ed5902fedfc27b7ee","textHash":"ca3aed14080904e2a6b2b5c0333de9cdfa714bb309618f7edcbc488b81db9ba7","observedAt":"2026-11-13T09:24:11.405Z"}}],"participationCoverage":{"total":5,"returned":5,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.39264","snapshotId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc","contentSha256":"bf5ca7ec51e1290959832fcf8cbca128ef3fd7b53e3d5b7ed5902fedfc27b7ee","textHash":"ca3aed14080904e2a6b2b5c0333de9cdfa714bb309618f7edcbc488b81db9ba7","observedAt":"2026-11-13T09:24:11.405Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/c76b3b22fe714430a106ef72d38e2e033dcb0ae4d028bda9c3056e862ed50577/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-online-dense-reinforcement-learning-for-ui-c76b3b22","formats":{"html":"/readings/arxiv-cs-ai-online-dense-reinforcement-learning-for-ui-c76b3b22","markdown":"/readings/arxiv-cs-ai-online-dense-reinforcement-learning-for-ui-c76b3b22.md","json":"/readings/arxiv-cs-ai-online-dense-reinforcement-learning-for-ui-c76b3b22.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-reinforcement-learning","name":"Reinforcement learning","explanation":"Training by trial and error, in which a system is rewarded for the outcomes its designers want.","referenceUrl":"https://developers.google.com/machine-learning/glossary#reinforcement-learning-rl"},{"id":"term-inference","name":"Model inference","explanation":"Using a trained model to produce a prediction or response to new input.","referenceUrl":"https://developers.google.com/machine-learning/glossary#inference"},{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"},{"id":"term-fine-tuning","name":"Fine-tuning","explanation":"Further training of an existing model to adapt it to a particular task or use.","referenceUrl":"https://developers.google.com/machine-learning/glossary#fine-tuning"},{"id":"term-distribution-shift","name":"Distribution shift","explanation":"A change between the data a model was trained on and the data it meets in use, which can lower its accuracy.","referenceUrl":"https://en.wikipedia.org/wiki/Domain_adaptation"},{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"c76b3b22fe714430a106ef72d38e2e033dcb0ae4d028bda9c3056e862ed50577","revision":"d32e94ab-c6f0-409c-8692-9956502681dc","revisionKind":"publication-id","title":"arXiv cs.AI: Online Dense Reinforcement Learning for UI Navigation","url":"https://escapemeridian.com/readings/arxiv-cs-ai-online-dense-reinforcement-learning-for-ui-c76b3b22"},"source":{"type":"source","id":"https://arxiv.org/abs/2610.39264","revision":"ca3aed14080904e2a6b2b5c0333de9cdfa714bb309618f7edcbc488b81db9ba7","revisionKind":"sha256-source-text","title":"Online Dense Reinforcement Learning with Planning-Grounding Agent for UI Navigation on Live IOS Apps","url":"https://arxiv.org/abs/2610.39264"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"c76b3b22fe714430a106ef72d38e2e033dcb0ae4d028bda9c3056e862ed50577","title":"arXiv cs.AI: Online Dense Reinforcement Learning for UI Navigation","argument":"Peitong Duan and coauthors propose training UI navigation agents directly on live iOS applications. They argue this could address two shortcomings: frontier vision-language models have high inference costs, while smaller models trained on static trajectories can fail to recover from errors.\n\nTheir framework separates planning from UI grounding and uses an LLM-as-a-Judge for step-level feedback and a final task-completion reward. The authors combine these signals with Proximal Policy Optimization (PPO) and introduce GiGPPO, which they say improves critic stability by using reward signals from visually similar states.\n\nThe authors report that their agents outperform supervised fine-tuning (SFT) and terminal-only reinforcement-learning baselines on UINavBench, iOSWorld, and AndroidWorld. They report nearly a sevenfold improvement over the SFT baseline in out-of-distribution generalization to Android environments for their 8B agents, and say the agents outperform Gemini-3.5-Flash and tie with Gemini-3.1-Pro on real iOS applications. These are reported evaluation results; the abstract does not establish performance in everyday use.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence is the arXiv abstract; it does not include benchmark scores, experimental details, or enough information to assess how the reported results vary across tasks. The abstract reports evaluations on benchmarks and real iOS applications but does not establish performance in everyday use. The abstract identifies high inference costs as a problem for frontier vision-language models but does not quantify those costs or compare them with the proposed agents.","speaker":{"name":"Duan, Peitong, Gatmiry, Khashayar, Nichols, Jeffrey, Bengio, Samy, Abbe, Emmanuel","roleAtSource":"Article author"},"source":{"title":"Online Dense Reinforcement Learning with Planning-Grounding Agent for UI Navigation on Live IOS Apps","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.39264","publishedAt":"2026-10-29","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose an online reinforcement-learning framework that trains UI navigation agents directly on live iOS applications.","excerpt":"we propose a novel online reinforcement learning framework that trains UI navigation agents directly on live iOS applications.","url":"https://arxiv.org/abs/2610.39264","relationship":"Source-stated"},{"text":"The framework separates planning and UI grounding, and uses an LLM-as-a-Judge for step-level and terminal reward signals.","excerpt":"We rely on an LLM-as-a-Judge to provide comprehensive reward signals, combining dense, step-level feedback to evaluate intermediate progress with a terminal reward for overall task completion.","url":"https://arxiv.org/abs/2610.39264","relationship":"Source-stated"},{"text":"The authors introduce GiGPPO, which they say improves critic stability by using reward signals from visually similar states across concurrent trajectories.","excerpt":"we introduce GiGPPO, a novel neighbor-conditioned value estimation method that improves critic stability by leveraging reward signals from visually similar states across concurrent trajectories.","url":"https://arxiv.org/abs/2610.39264","relationship":"Source-stated"},{"text":"The authors report that their agents outperform SFT and terminal-only RL baselines on UINavBench, iOSWorld, and AndroidWorld.","excerpt":"Evaluations on rigorous benchmarks, including UINavBench, iOSWorld, and AndroidWorld, demonstrate that our online RL trained agents substantially outperform both SFT and terminal-only RL baselines","url":"https://arxiv.org/abs/2610.39264","relationship":"Source-stated"},{"text":"The authors report nearly a sevenfold improvement over the SFT baseline for 8B agents in out-of-distribution generalization to Android environments.","excerpt":"our 8B RL agents achieve nearly a sevenfold improvement over the SFT baseline in out-of-distribution generalization to Android environments","url":"https://arxiv.org/abs/2610.39264","relationship":"Source-stated"},{"text":"The authors say their agents outperform Gemini-3.5-Flash and tie with Gemini-3.1-Pro on real iOS applications.","excerpt":"while outperforming Gemini-3.5-Flash and tying with Gemini-3.1-Pro on real iOS applications.","url":"https://arxiv.org/abs/2610.39264","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.39264","checkedAt":"2026-11-13T09:24:11.405Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How do the reported gains hold up across different tasks and live apps beyond the evaluations described in the abstract?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Online Dense Reinforcement Learning for UI Navigation","summary":"Peitong Duan and coauthors propose training UI navigation agents directly on live iOS applications. They argue this could address two shortcomings: frontier vision-language models have high inference costs, while smaller models trained on static trajectories can fail to recover from errors.\n\nTheir framework separates planning from UI grounding and uses an LLM-as-a-Judge for step-level feedback and a final task-completion reward. The authors combine these signals with Proximal Policy Optimization (PPO) and introduce GiGPPO, which they say improves critic stability by using reward signals from visually similar states.\n\nThe authors report that their agents outperform supervised fine-tuning (SFT) and terminal-only reinforcement-learning baselines on UINavBench, iOSWorld, and AndroidWorld. They report nearly a sevenfold improvement over the SFT baseline in out-of-distribution generalization to Android environments for their 8B agents, and say the agents outperform Gemini-3.5-Flash and tie with Gemini-3.1-Pro on real iOS applications. These are reported evaluation results; the abstract does not establish performance in everyday use.","question":"How do the reported gains hold up across different tasks and live apps beyond the evaluations described in the abstract?","claims":[{"text":"The authors propose an online reinforcement-learning framework that trains UI navigation agents directly on live iOS applications.","excerpt":"we propose a novel online reinforcement learning framework that trains UI navigation agents directly on live iOS applications.","support":"source-stated"},{"text":"The framework separates planning and UI grounding, and uses an LLM-as-a-Judge for step-level and terminal reward signals.","excerpt":"We rely on an LLM-as-a-Judge to provide comprehensive reward signals, combining dense, step-level feedback to evaluate intermediate progress with a terminal reward for overall task completion.","support":"source-stated"},{"text":"The authors introduce GiGPPO, which they say improves critic stability by using reward signals from visually similar states across concurrent trajectories.","excerpt":"we introduce GiGPPO, a novel neighbor-conditioned value estimation method that improves critic stability by leveraging reward signals from visually similar states across concurrent trajectories.","support":"source-stated"},{"text":"The authors report that their agents outperform SFT and terminal-only RL baselines on UINavBench, iOSWorld, and AndroidWorld.","excerpt":"Evaluations on rigorous benchmarks, including UINavBench, iOSWorld, and AndroidWorld, demonstrate that our online RL trained agents substantially outperform both SFT and terminal-only RL baselines","support":"source-stated"},{"text":"The authors report nearly a sevenfold improvement over the SFT baseline for 8B agents in out-of-distribution generalization to Android environments.","excerpt":"our 8B RL agents achieve nearly a sevenfold improvement over the SFT baseline in out-of-distribution generalization to Android environments","support":"source-stated"},{"text":"The authors say their agents outperform Gemini-3.5-Flash and tie with Gemini-3.1-Pro on real iOS applications.","excerpt":"while outperforming Gemini-3.5-Flash and tying with Gemini-3.1-Pro on real iOS applications.","support":"source-stated"}],"limitations":["The evidence is the arXiv abstract; it does not include benchmark scores, experimental details, or enough information to assess how the reported results vary across tasks.","The abstract reports evaluations on benchmarks and real iOS applications but does not establish performance in everyday use.","The abstract identifies high inference costs as a problem for frontier vision-language models but does not quantify those costs or compare them with the proposed agents."],"mediaId":"397ec68d1b530d3cfc7862b30f72c3b8d88da2173b5a1a412191c6bac254d435","correctionReason":null,"id":"c76b3b22fe714430a106ef72d38e2e033dcb0ae4d028bda9c3056e862ed50577","publicationId":"d32e94ab-c6f0-409c-8692-9956502681dc","version":1,"sourceUrl":"https://arxiv.org/abs/2610.39264","sourceTitle":"Online Dense Reinforcement Learning with Planning-Grounding Agent for UI Navigation on Live IOS Apps","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-29","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-30T06:45:38.292Z","createdAt":"2026-11-13T07:17:53.149Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"397ec68d1b530d3cfc7862b30f72c3b8d88da2173b5a1a412191c6bac254d435","kind":"article","url":"https://arxiv.org/abs/2610.39264","sourceUrl":"https://arxiv.org/abs/2610.39264","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-31T10:33:02.631Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.39264","checkedAt":"2026-11-13T09:24:11.405Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"397ec68d1b530d3cfc7862b30f72c3b8d88da2173b5a1a412191c6bac254d435","confidence":0.93,"provider":"typesafe","model":"jev-1.13.0","inputHash":"a35e3e34fb77f5a6b8c34e43c92d776798fcdf82e05d8fc7eedc23406622da42","decidedAt":"2026-10-31T10:33:03.341Z"},"provenance":{"textHash":"ca3aed14080904e2a6b2b5c0333de9cdfa714bb309618f7edcbc488b81db9ba7","observationId":"8cef9760f7d494143cf9db245ca39d0d4179db4f4271611824e51cd6f0f0844f","retrievedAt":"2026-10-31T10:33:02.566Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"c81a7d11-f20a-4bd8-8cb6-8a649553ebe3"},"reviewer":{"model":"gpt-6-luna","runId":"4a06ca21-39b2-4353-80b5-61fb96b7d2ea"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-13T07:17:53.149Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Duan, Peitong","url":null,"kind":"unknown"},{"name":"Gatmiry, Khashayar","url":null,"kind":"unknown"},{"name":"Nichols, Jeffrey","url":null,"kind":"unknown"},{"name":"Bengio, Samy","url":null,"kind":"unknown"},{"name":"Abbe, Emmanuel","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Duan, Peitong","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Duan, Peitong","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.39264","locator":"head/meta[name=author|citation_author]"},"assertionId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T09:24:11.405Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc","sourceUrl":"https://arxiv.org/abs/2610.39264","contentSha256":"bf5ca7ec51e1290959832fcf8cbca128ef3fd7b53e3d5b7ed5902fedfc27b7ee","textHash":"ca3aed14080904e2a6b2b5c0333de9cdfa714bb309618f7edcbc488b81db9ba7","observedAt":"2026-11-13T09:24:11.405Z"}},{"actor":{"name":"Gatmiry, Khashayar","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gatmiry, Khashayar","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.39264","locator":"head/meta[name=author|citation_author]"},"assertionId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T09:24:11.405Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc","sourceUrl":"https://arxiv.org/abs/2610.39264","contentSha256":"bf5ca7ec51e1290959832fcf8cbca128ef3fd7b53e3d5b7ed5902fedfc27b7ee","textHash":"ca3aed14080904e2a6b2b5c0333de9cdfa714bb309618f7edcbc488b81db9ba7","observedAt":"2026-11-13T09:24:11.405Z"}},{"actor":{"name":"Nichols, Jeffrey","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Nichols, Jeffrey","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.39264","locator":"head/meta[name=author|citation_author]"},"assertionId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T09:24:11.405Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc","sourceUrl":"https://arxiv.org/abs/2610.39264","contentSha256":"bf5ca7ec51e1290959832fcf8cbca128ef3fd7b53e3d5b7ed5902fedfc27b7ee","textHash":"ca3aed14080904e2a6b2b5c0333de9cdfa714bb309618f7edcbc488b81db9ba7","observedAt":"2026-11-13T09:24:11.405Z"}},{"actor":{"name":"Bengio, Samy","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Bengio, Samy","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.39264","locator":"head/meta[name=author|citation_author]"},"assertionId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T09:24:11.405Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc","sourceUrl":"https://arxiv.org/abs/2610.39264","contentSha256":"bf5ca7ec51e1290959832fcf8cbca128ef3fd7b53e3d5b7ed5902fedfc27b7ee","textHash":"ca3aed14080904e2a6b2b5c0333de9cdfa714bb309618f7edcbc488b81db9ba7","observedAt":"2026-11-13T09:24:11.405Z"}},{"actor":{"name":"Abbe, Emmanuel","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Abbe, Emmanuel","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.39264","locator":"head/meta[name=author|citation_author]"},"assertionId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T09:24:11.405Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc","sourceUrl":"https://arxiv.org/abs/2610.39264","contentSha256":"bf5ca7ec51e1290959832fcf8cbca128ef3fd7b53e3d5b7ed5902fedfc27b7ee","textHash":"ca3aed14080904e2a6b2b5c0333de9cdfa714bb309618f7edcbc488b81db9ba7","observedAt":"2026-11-13T09:24:11.405Z"}}],"participationCoverage":{"total":5,"returned":5,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.39264","snapshotId":"850d6f74185ebe7335cbf0ed627eb80f670b11f048667df1e15d5055c210facc","contentSha256":"bf5ca7ec51e1290959832fcf8cbca128ef3fd7b53e3d5b7ed5902fedfc27b7ee","textHash":"ca3aed14080904e2a6b2b5c0333de9cdfa714bb309618f7edcbc488b81db9ba7","observedAt":"2026-11-13T09:24:11.405Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/c76b3b22fe714430a106ef72d38e2e033dcb0ae4d028bda9c3056e862ed50577/source"}}}],"audits":[{"publicationId":"d32e94ab-c6f0-409c-8692-9956502681dc","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft correctly credits Peitong Duan and coauthors, and the listed authors match the page. Results and claims are consistently framed as what the authors propose, report or say, including the GiGPPO stability claim and the Gemini comparisons.","excerpt":"Authors:Peitong Duan, Khashayar Gatmiry, Jeffrey Nichols, Samy Bengio, Emmanuel Abbe"},{"dimension":"summary","status":"uncertain","explanation":"The draft is faithful, but a non-specialist may miss the central stakes. It never plainly says that UI navigation agents are AI systems that operate app screens to complete tasks. It also does not tie the 8B size, meaning a smaller model, back to the authors' cost motivation, so the Gemini comparison is hard to read as the point of the paper. Smallest repair: add a plain gloss of UI navigation agent, say the 8B agents are much smaller models, and mention the hundreds of concurrent virtual iOS devices. Terms like UI grounding, LLM-as-a-Judge, PPO and critic stability need term-library tooltips.","excerpt":"While frontier vision-language models demonstrate strong capabilities in user interface (UI) navigation, their high inference costs prohibit everyday use."},{"dimension":"date","status":"pass","explanation":"The draft's originalPublished date, 2026-10-29, matches the arXiv v1 submission date. The later feed date is correctly not used.","excerpt":"[Submitted on 29 Oct 2026]"},{"dimension":"support","status":"pass","explanation":"Every claim matches the abstract. The limitations and the question correctly avoid treating benchmark results or the cost motivation as demonstrated everyday benefit. The draft adds no unsupported benefits or costs.","excerpt":"our 8B RL agents achieve nearly a sevenfold improvement over the SFT baseline in out-of-distribution generalization to Android environments"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access point to the source.","excerpt":null}],"createdAt":"2026-11-13T07:17:53.149Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}