Park, Jungmin, Kim, Eunha, Kim, Wooseop, Cho, Seongjoon, Cha, Byungho · Nov 19, 2026
arXiv cs.AI: What tests and reviews miss in post-quantum hardware
Markdown · JSON · Original source
The authors argue that when agents generate hardware and also produce its tests and reviews, those checks need evidence independent of the agents’ own work. Their seven-stage workflow counts a verification gate only if it can fail on negative controls and fault mutants, and audits the evidence with netlist mutants, flaw replays, and formal checks. They applied it while porting an -KEM-768/ML-DSA-65 accelerator to a Zynq UltraScale+ key-custody card. All six operations were byte-exact on the board, but across three RTL modules, existing simulation gates killed only 76% of 399 tool-selected netlist mutants. Specification-derived tests raised the fresh-draw decapsulation kill rate from 48% to 74%. In pre-registered single-model replays, module-scoped review caught every known verifier flaw in all 54 sessions; undirected whole-design review caught the two flaws in only 3/6 and 1/6 sessions. But scoped review detected planted key-custody flaws in only 3/20 sessions, while formal checks flagged every one in the replay. The authors conclude that their study needed author-independent mutants for test gates, module-level scoping for LLM review, and formal checks for custody invariants. Their results concern one design port and defined replay conditions; they do not establish how the workflow performs on other designs.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 19, 2026 (2026-11-19).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-20T05:33:56.637Z. First observed: 2026-11-20T05:07:44.712Z. Retrieved: 2026-11-20T05:33:04.371Z.
Referenced by
Recorded citations in public readings. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The reported results concern one post-quantum design port, three RTL modules, and specified replay conditions; the abstract does not establish how the workflow performs on other designs. The paper reports 85 interface-applicable ACVP cases out of 285, so the reported pass result does not cover all 285 cases. The abstract reports a 300 MHz board implementation but does not provide further performance comparisons.
Open question
How well would the authors’ verification workflow detect flaws in other hardware designs beyond the port and replay conditions studied here?
Source-stated
The authors propose a seven-stage verification-gated workflow and argue that a gate should count only if it can fail on negative controls and fault mutants.
a gate counts only if shown able to fail on negative controls and fault mutants
Source-stated
The workflow was used to port an ML-KEM-768/ML-DSA-65 accelerator to a Zynq UltraScale+ key-custody card; all six operations were byte-exact on the board.
all six operations are byte-exact on the board
Source-stated
Across three RTL modules, existing simulation gates killed 76% of 399 tool-selected netlist mutants; specification-derived tests raised the fresh-draw decapsulation kill rate from 48% to 74%.
existing simulation gates kill only 76% of 399 tool-selected netlist mutants; specification-derived tests guided by the survivors raise the fresh-draw decapsulation kill rate from 48% to 74%.
Source-stated
In pre-registered single-model replays, module-scoped review caught every known verifier flaw in all 54 sessions, while undirected whole-design review caught the two flaws in only 3/6 and 1/6 sessions.
module-scoped review catches every known flaw in all 54 sessions
Source-stated
Scoped review detected planted key-custody flaws in only 3/20 sessions, while formal checks flagged every one in that replay.
formal checks (one added for the replay) flag every one
Source-stated
The authors conclude that trustworthy agentic hardware in their study needed author-independent mutants, module-level scoping for LLM review, and formal checks for custody invariants.
trustworthy agentic hardware needed author-independent mutants for test gates, module-level scoping for LLM review, and formal checks for custody invariants.
Source and contributor context
Park, Jungmin, Kim, Eunha, Kim, Wooseop, Cho, Seongjoon, Cha, Byungho · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Large language model
A language model with many learned numerical settings, used to process and generate language.
Machine learning
Methods that let computers learn patterns from examples instead of following rules written by hand.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
NIST
NIST is a US measurement and standards agency that develops ways to assess and manage risks from AI.
Editorial provenance
Version 1. Publication ID: 66e8bd1f-8741-43cc-87af-fa89436b3305.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-20T05:33:56.637Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 51182902222d02bb6f98dbda64a403fb8e71f7b72f539d30702c11dea62bdb86. Source text hash: 2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc.
Revision and source-check history
Version 1 · 2026-11-20T05:33:56.637Z
arXiv cs.AI: What tests and reviews miss in post-quantum hardware
The authors argue that when agents generate hardware and also produce its tests and reviews, those checks need evidence independent of the agents’ own work. Their seven-stage workflow counts a verification gate only if it can fail on negative controls and fault mutants, and audits the evidence with netlist mutants, flaw replays, and formal checks. They applied it while porting an -KEM-768/ML-DSA-65 accelerator to a Zynq UltraScale+ key-custody card. All six operations were byte-exact on the board, but across three RTL modules, existing simulation gates killed only 76% of 399 tool-selected netlist mutants. Specification-derived tests raised the fresh-draw decapsulation kill rate from 48% to 74%. In pre-registered single-model replays, module-scoped review caught every known verifier flaw in all 54 sessions; undirected whole-design review caught the two flaws in only 3/6 and 1/6 sessions. But scoped review detected planted key-custody flaws in only 3/20 sessions, while formal checks flagged every one in the replay. The authors conclude that their study needed author-independent mutants for test gates, module-level scoping for LLM review, and formal checks for custody invariants. Their results concern one design port and defined replay conditions; they do not establish how the workflow performs on other designs.
Original source
cs.AI · Article
Source details
Original source date: Nov 19, 2026 (2026-11-19).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-20T05:33:56.637Z. First observed: 2026-11-20T05:07:44.712Z. Retrieved: 2026-11-20T05:33:04.371Z.
Limits
The reported results concern one post-quantum design port, three RTL modules, and specified replay conditions; the abstract does not establish how the workflow performs on other designs. The paper reports 85 interface-applicable ACVP cases out of 285, so the reported pass result does not cover all 285 cases. The abstract reports a 300 MHz board implementation but does not provide further performance comparisons.
Open question
How well would the authors’ verification workflow detect flaws in other hardware designs beyond the port and replay conditions studied here?
Source-stated
The authors propose a seven-stage verification-gated workflow and argue that a gate should count only if it can fail on negative controls and fault mutants.
a gate counts only if shown able to fail on negative controls and fault mutants
Source-stated
The workflow was used to port an ML-KEM-768/ML-DSA-65 accelerator to a Zynq UltraScale+ key-custody card; all six operations were byte-exact on the board.
all six operations are byte-exact on the board
Source-stated
Across three RTL modules, existing simulation gates killed 76% of 399 tool-selected netlist mutants; specification-derived tests raised the fresh-draw decapsulation kill rate from 48% to 74%.
existing simulation gates kill only 76% of 399 tool-selected netlist mutants; specification-derived tests guided by the survivors raise the fresh-draw decapsulation kill rate from 48% to 74%.
Source-stated
In pre-registered single-model replays, module-scoped review caught every known verifier flaw in all 54 sessions, while undirected whole-design review caught the two flaws in only 3/6 and 1/6 sessions.
module-scoped review catches every known flaw in all 54 sessions
Source-stated
Scoped review detected planted key-custody flaws in only 3/20 sessions, while formal checks flagged every one in that replay.
formal checks (one added for the replay) flag every one
Source-stated
The authors conclude that trustworthy agentic hardware in their study needed author-independent mutants, module-level scoping for LLM review, and formal checks for custody invariants.
trustworthy agentic hardware needed author-independent mutants for test gates, module-level scoping for LLM review, and formal checks for custody invariants.
Source and contributor context
Park, Jungmin, Kim, Eunha, Kim, Wooseop, Cho, Seongjoon, Cha, Byungho · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Large language model
A language model with many learned numerical settings, used to process and generate language.
Machine learning
Methods that let computers learn patterns from examples instead of following rules written by hand.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
NIST
NIST is a US measurement and standards agency that develops ways to assess and manage risks from AI.
Editorial provenance
Version 1. Publication ID: 66e8bd1f-8741-43cc-87af-fa89436b3305.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-20T05:33:56.637Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 51182902222d02bb6f98dbda64a403fb8e71f7b72f539d30702c11dea62bdb86. Source text hash: 2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc.
uncertain · 2026-11-20T05:33:56.637Z · anthropic/claude-opus-5.5
Publication: 66e8bd1f-8741-43cc-87af-fa89436b3305
attribution — pass: The reading attributes the workflow, results and conclusions to the paper's authors. It labels the source as arXiv and does not present the findings as established facts or as Escape Meridian's view.
We present our seven-stage verification-gated workflow, evolved during a post-quantum design port
summary — uncertain: The figures match the abstract, but a non-specialist cannot follow the central result. Terms such as RTL, netlist mutants, 'kill rate', fresh-draw decapsulation, post-quantum, ML-KEM/ML-DSA and formal checks are unexplained. A reader cannot tell that killing a mutant means a test catching a deliberately injected fault. The thesis that passing module tests overstate verification strength is only implied; stating it would fix that. Two smaller repairs: note that one formal check was added for the replay, and say the new tests were guided by surviving mutants. Add tooltips or one plain-language gloss for mutants and kill rate.
However, passing module tests overstate the verification strength.
date — pass: originalPublished is 2026-11-19, which matches the arXiv v1 submission date. The feed date of 2026-11-20 is correctly not used.
[Submitted on 19 Nov 2026]
support — pass: Each claim matches its excerpt. The limitations, including the 85-of-285 ACVP scope and the single design port, and the question follow from the abstract without inventing benefits or costs. There is a minor narrowing: the source says module-scoped review caught 'every known flaw', while the draft says 'every known verifier flaw'. This is close enough not to contradict the source.
module-scoped review catches every known flaw in all 54 sessions
media — pass: The selected media is the verified arXiv abstract page for this paper. It is the direct original source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A language model with many learned numerical settings, used to process and generate language.
Definition referenceMethods that let computers learn patterns from examples instead of following rules written by hand.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivNIST is a US measurement and standards agency that develops ways to assess and manage risks from AI.
Explore NISTA language model with many learned numerical settings, used to process and generate language.
Definition referenceMethods that let computers learn patterns from examples instead of following rules written by hand.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivNIST is a US measurement and standards agency that develops ways to assess and manage risks from AI.
Explore NIST