Jo, Youngjin, Kim, Jihwan, Choi, Minseok, Choi, Kwanghoon, Kang, Jusung, Kim, Jaein · Nov 10, 2026
arXiv cs.AI: Benchmarking Vendor-Guided Optimizations on Edge NPUs
Markdown · JSON · Original source
In an cs.AI abstract, the authors argue that Edge NPU performance depends on more than hardware: model transformation and the deployment pipeline also matter. They compare three configurations across four edge NPUs and three vision workloads. Baseline is compared with VG-NPU, which preserves common model I/O and host-side processing, and VG-E2E, which follows the vendor-native deployment pipeline. The authors report that VG-NPU improves both accuracy and Runtime-call in 10 of 12 NPU–workload combinations. VG-E2E reduces System-level latency in all combinations, but improves accuracy in only four. Its additional System-level latency reduction over VG-NPU ranges from 10.4–70.7%. The authors also report that NPU-level and End-to-End performance rankings do not always match. Their central point is that evaluation method matters: isolating model transformation and measuring the full deployment pipeline capture different performance outcomes. The abstract reports results for these configurations and workloads; it does not identify the individual NPUs or workloads.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 10, 2026 (2026-11-10).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-11T17:46:55.995Z. First observed: 2026-11-11T05:09:40.527Z. Retrieved: 2026-11-11T17:36:40.931Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The abstract reports results for four edge NPUs and three vision workloads, but does not identify them or provide further methodological detail.
Open question
Would the reported differences between NPU-level and End-to-End rankings also appear with other edge NPUs or vision workloads?
Source-stated
The authors say Edge NPU performance depends on hardware capabilities as well as model transformation and the deployment pipeline.
Edge NPU performance depends not only on hardware capabilities, but also on model transformation and the overall deployment pipeline.
Source-stated
The authors compare three configurations across four edge NPUs and three vision workloads; VG-NPU preserves common model I/O and host-side processing, while VG-E2E follows the vendor-native deployment pipeline.
We apply this methodology to four edge NPUs and three vision workloads.
Source-stated
VG-NPU improves accuracy and Runtime-call latency in 10 of 12 NPU–workload combinations; VG-E2E reduces System-level latency in all combinations but improves accuracy in four.
VG-NPU improves both accuracy and Runtime-call latency in 10 of 12 NPU--workload combinations, whereas VG-E2E reduces System-level latency in all combinations but improves accuracy in only four.
Source-stated
The authors report that NPU-level and End-to-End rankings do not always match, and that VG-E2E further reduces System-level latency by 10.4–70.7% compared with VG-NPU.
NPU-level performance rankings do not always match End-to-End rankings, and VG-E2E provides an additional 10.4--70.7\% reduction in System-level latency over VG-NPU.
Source and contributor context
Jo, Youngjin, Kim, Jihwan, Choi, Minseok, Choi, Kwanghoon, Kang, Jusung, Kim, Jaein · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Latency
The delay between sending a request and receiving the result.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: e22171bb-843c-4fba-8da0-4ed986584b94.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-11T17:46:55.995Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: ffc6add220db210179f627b0ed91941a72e661712bad1c14e2d0ab17cc3a2905. Source text hash: 3a1b0fb66cbea5a08968695a7d19e477e9c712dbc22168d24eee06866d77bae3.
Revision and source-check history
Version 1 · 2026-11-11T17:46:55.995Z
arXiv cs.AI: Benchmarking Vendor-Guided Optimizations on Edge NPUs
In an cs.AI abstract, the authors argue that Edge NPU performance depends on more than hardware: model transformation and the deployment pipeline also matter. They compare three configurations across four edge NPUs and three vision workloads. Baseline is compared with VG-NPU, which preserves common model I/O and host-side processing, and VG-E2E, which follows the vendor-native deployment pipeline. The authors report that VG-NPU improves both accuracy and Runtime-call in 10 of 12 NPU–workload combinations. VG-E2E reduces System-level latency in all combinations, but improves accuracy in only four. Its additional System-level latency reduction over VG-NPU ranges from 10.4–70.7%. The authors also report that NPU-level and End-to-End performance rankings do not always match. Their central point is that evaluation method matters: isolating model transformation and measuring the full deployment pipeline capture different performance outcomes. The abstract reports results for these configurations and workloads; it does not identify the individual NPUs or workloads.
Original source
cs.AI · Article
Source details
Original source date: Nov 10, 2026 (2026-11-10).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-11T17:46:55.995Z. First observed: 2026-11-11T05:09:40.527Z. Retrieved: 2026-11-11T17:36:40.931Z.
Limits
The abstract reports results for four edge NPUs and three vision workloads, but does not identify them or provide further methodological detail.
Open question
Would the reported differences between NPU-level and End-to-End rankings also appear with other edge NPUs or vision workloads?
Source-stated
The authors say Edge NPU performance depends on hardware capabilities as well as model transformation and the deployment pipeline.
Edge NPU performance depends not only on hardware capabilities, but also on model transformation and the overall deployment pipeline.
Source-stated
The authors compare three configurations across four edge NPUs and three vision workloads; VG-NPU preserves common model I/O and host-side processing, while VG-E2E follows the vendor-native deployment pipeline.
We apply this methodology to four edge NPUs and three vision workloads.
Source-stated
VG-NPU improves accuracy and Runtime-call latency in 10 of 12 NPU–workload combinations; VG-E2E reduces System-level latency in all combinations but improves accuracy in four.
VG-NPU improves both accuracy and Runtime-call latency in 10 of 12 NPU--workload combinations, whereas VG-E2E reduces System-level latency in all combinations but improves accuracy in only four.
Source-stated
The authors report that NPU-level and End-to-End rankings do not always match, and that VG-E2E further reduces System-level latency by 10.4–70.7% compared with VG-NPU.
NPU-level performance rankings do not always match End-to-End rankings, and VG-E2E provides an additional 10.4--70.7\% reduction in System-level latency over VG-NPU.
Source and contributor context
Jo, Youngjin, Kim, Jihwan, Choi, Minseok, Choi, Kwanghoon, Kang, Jusung, Kim, Jaein · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Latency
The delay between sending a request and receiving the result.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: e22171bb-843c-4fba-8da0-4ed986584b94.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-11T17:46:55.995Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: ffc6add220db210179f627b0ed91941a72e661712bad1c14e2d0ab17cc3a2905. Source text hash: 3a1b0fb66cbea5a08968695a7d19e477e9c712dbc22168d24eee06866d77bae3.
uncertain · 2026-11-11T17:46:55.995Z · anthropic/claude-opus-5.5
Publication: e22171bb-843c-4fba-8da0-4ed986584b94
attribution — pass: The reading attributes the findings to the paper's authors in an arXiv cs.AI abstract, which matches the source. Results are framed as author-reported, not as established facts.
Authors:Youngjin Jo, Jihwan Kim, Minseok Choi, Kwanghoon Choi, Jusung Kang, Jaein Kim
summary — uncertain: The numbers are faithful, but a non-specialist cannot readily tell what is being measured. Edge NPU (AI accelerator chips in devices) and vendor-guided (chipmaker-recommended optimization) are central but unexplained in the text, and no tooltip is indicated. The summary also drops the paper's stated stakes: comparing heterogeneous commercial Edge NPU platforms in practice, where NPU-only rankings can mislead. Smallest repair: briefly gloss Edge NPU and vendor-guided, or flag tooltips for them, and restore the platform-comparison purpose in the central-point sentence.
when comparing heterogeneous commercial Edge NPU platforms in practice
date — pass: originalPublished is 2026-11-10, which matches the v1 submission date on arXiv. The feed date of Nov 11 is later.
[Submitted on 10 Nov 2026]
support — pass: All claims match the abstract: the 10 of 12 combinations, latency reduced in all combinations, accuracy improved in four, the 10.4–70.7% additional reduction, and the ranking mismatch. The limitation about unidentified NPUs and workloads is accurate. The question follows from the evidence and is not leading.
VG-E2E provides an additional 10.4--70.7\% reduction in System-level latency over VG-NPU
media — pass: The selected media is the verified direct link to the arXiv abstract page of the source itself.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivThe delay between sending a request and receiving the result.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivThe delay between sending a request and receiving the result.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv