Escape Meridian

Park, Jungmin, Kim, Eunha, Kim, Wooseop, Cho, Seongjoon, Cha, Byungho · Nov 19, 2026

arXiv cs.AI: What tests and reviews miss in post-quantum hardware

Markdown · JSON · Original source

The authors argue that when agents generate hardware and also produce its tests and reviews, those checks need evidence independent of the agents’ own work. Their seven-stage workflow counts a verification gate only if it can fail on negative controls and fault mutants, and audits the evidence with netlist mutants, flaw replays, and formal checks. They applied it while porting an -KEM-768/ML-DSA-65 accelerator to a Zynq UltraScale+ key-custody card. All six operations were byte-exact on the board, but across three RTL modules, existing simulation gates killed only 76% of 399 tool-selected netlist mutants. Specification-derived tests raised the fresh-draw decapsulation kill rate from 48% to 74%. In pre-registered single-model replays, module-scoped review caught every known verifier flaw in all 54 sessions; undirected whole-design review caught the two flaws in only 3/6 and 1/6 sessions. But scoped review detected planted key-custody flaws in only 3/20 sessions, while formal checks flagged every one in the replay. The authors conclude that their study needed author-independent mutants for test gates, module-level scoping for LLM review, and formal checks for custody invariants. Their results concern one design port and defined replay conditions; they do not establish how the workflow performs on other designs.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

arXiv cs.AIArticle · arxiv.orgOpen original source

Original source

cs.AI · Article

Source details

Original source date: Nov 19, 2026 (2026-11-19).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-20T05:33:56.637Z. First observed: 2026-11-20T05:07:44.712Z. Retrieved: 2026-11-20T05:33:04.371Z.

Referenced by

Recorded citations in public readings. A reference alone does not establish agreement or influence.

No public references recorded here yet.

Reference data (JSON)

Limits

The reported results concern one post-quantum design port, three RTL modules, and specified replay conditions; the abstract does not establish how the workflow performs on other designs. The paper reports 85 interface-applicable ACVP cases out of 285, so the reported pass result does not cover all 285 cases. The abstract reports a 300 MHz board implementation but does not provide further performance comparisons.

Open question

How well would the authors’ verification workflow detect flaws in other hardware designs beyond the port and replay conditions studied here?

Source-stated

The authors propose a seven-stage verification-gated workflow and argue that a gate should count only if it can fail on negative controls and fault mutants.

a gate counts only if shown able to fail on negative controls and fault mutants

Source-stated

The workflow was used to port an ML-KEM-768/ML-DSA-65 accelerator to a Zynq UltraScale+ key-custody card; all six operations were byte-exact on the board.

all six operations are byte-exact on the board

Source-stated

Across three RTL modules, existing simulation gates killed 76% of 399 tool-selected netlist mutants; specification-derived tests raised the fresh-draw decapsulation kill rate from 48% to 74%.

existing simulation gates kill only 76% of 399 tool-selected netlist mutants; specification-derived tests guided by the survivors raise the fresh-draw decapsulation kill rate from 48% to 74%.

Source-stated

In pre-registered single-model replays, module-scoped review caught every known verifier flaw in all 54 sessions, while undirected whole-design review caught the two flaws in only 3/6 and 1/6 sessions.

module-scoped review catches every known flaw in all 54 sessions

Source-stated

Scoped review detected planted key-custody flaws in only 3/20 sessions, while formal checks flagged every one in that replay.

formal checks (one added for the replay) flag every one

Source-stated

The authors conclude that trustworthy agentic hardware in their study needed author-independent mutants, module-level scoping for LLM review, and formal checks for custody invariants.

trustworthy agentic hardware needed author-independent mutants for test gates, module-level scoping for LLM review, and formal checks for custody invariants.

Source and contributor context

Park, Jungmin, Kim, Eunha, Kim, Wooseop, Cho, Seongjoon, Cha, Byungho · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Large language model

A language model with many learned numerical settings, used to process and generate language.

Machine learning

Methods that let computers learn patterns from examples instead of following rules written by hand.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

NIST

NIST is a US measurement and standards agency that develops ways to assess and manage risks from AI.

Editorial provenance

Version 1. Publication ID: 66e8bd1f-8741-43cc-87af-fa89436b3305.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-20T05:33:56.637Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: 51182902222d02bb6f98dbda64a403fb8e71f7b72f539d30702c11dea62bdb86. Source text hash: 2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc.

Revision and source-check history

Version 1 · 2026-11-20T05:33:56.637Z

arXiv cs.AI: What tests and reviews miss in post-quantum hardware

The authors argue that when agents generate hardware and also produce its tests and reviews, those checks need evidence independent of the agents’ own work. Their seven-stage workflow counts a verification gate only if it can fail on negative controls and fault mutants, and audits the evidence with netlist mutants, flaw replays, and formal checks. They applied it while porting an -KEM-768/ML-DSA-65 accelerator to a Zynq UltraScale+ key-custody card. All six operations were byte-exact on the board, but across three RTL modules, existing simulation gates killed only 76% of 399 tool-selected netlist mutants. Specification-derived tests raised the fresh-draw decapsulation kill rate from 48% to 74%. In pre-registered single-model replays, module-scoped review caught every known verifier flaw in all 54 sessions; undirected whole-design review caught the two flaws in only 3/6 and 1/6 sessions. But scoped review detected planted key-custody flaws in only 3/20 sessions, while formal checks flagged every one in the replay. The authors conclude that their study needed author-independent mutants for test gates, module-level scoping for LLM review, and formal checks for custody invariants. Their results concern one design port and defined replay conditions; they do not establish how the workflow performs on other designs.

Original source

cs.AI · Article

Source details

Original source date: Nov 19, 2026 (2026-11-19).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-20T05:33:56.637Z. First observed: 2026-11-20T05:07:44.712Z. Retrieved: 2026-11-20T05:33:04.371Z.

Limits

The reported results concern one post-quantum design port, three RTL modules, and specified replay conditions; the abstract does not establish how the workflow performs on other designs. The paper reports 85 interface-applicable ACVP cases out of 285, so the reported pass result does not cover all 285 cases. The abstract reports a 300 MHz board implementation but does not provide further performance comparisons.

Open question

How well would the authors’ verification workflow detect flaws in other hardware designs beyond the port and replay conditions studied here?

Source-stated

The authors propose a seven-stage verification-gated workflow and argue that a gate should count only if it can fail on negative controls and fault mutants.

a gate counts only if shown able to fail on negative controls and fault mutants

Source-stated

The workflow was used to port an ML-KEM-768/ML-DSA-65 accelerator to a Zynq UltraScale+ key-custody card; all six operations were byte-exact on the board.

all six operations are byte-exact on the board

Source-stated

Across three RTL modules, existing simulation gates killed 76% of 399 tool-selected netlist mutants; specification-derived tests raised the fresh-draw decapsulation kill rate from 48% to 74%.

existing simulation gates kill only 76% of 399 tool-selected netlist mutants; specification-derived tests guided by the survivors raise the fresh-draw decapsulation kill rate from 48% to 74%.

Source-stated

In pre-registered single-model replays, module-scoped review caught every known verifier flaw in all 54 sessions, while undirected whole-design review caught the two flaws in only 3/6 and 1/6 sessions.

module-scoped review catches every known flaw in all 54 sessions

Source-stated

Scoped review detected planted key-custody flaws in only 3/20 sessions, while formal checks flagged every one in that replay.

formal checks (one added for the replay) flag every one

Source-stated

The authors conclude that trustworthy agentic hardware in their study needed author-independent mutants, module-level scoping for LLM review, and formal checks for custody invariants.

trustworthy agentic hardware needed author-independent mutants for test gates, module-level scoping for LLM review, and formal checks for custody invariants.

Source and contributor context

Park, Jungmin, Kim, Eunha, Kim, Wooseop, Cho, Seongjoon, Cha, Byungho · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Large language model

A language model with many learned numerical settings, used to process and generate language.

Machine learning

Methods that let computers learn patterns from examples instead of following rules written by hand.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

NIST

NIST is a US measurement and standards agency that develops ways to assess and manage risks from AI.

Editorial provenance

Version 1. Publication ID: 66e8bd1f-8741-43cc-87af-fa89436b3305.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-20T05:33:56.637Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: 51182902222d02bb6f98dbda64a403fb8e71f7b72f539d30702c11dea62bdb86. Source text hash: 2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc.

uncertain · 2026-11-20T05:33:56.637Z · anthropic/claude-opus-5.5

Publication: 66e8bd1f-8741-43cc-87af-fa89436b3305

attribution — pass: The reading attributes the workflow, results and conclusions to the paper's authors. It labels the source as arXiv and does not present the findings as established facts or as Escape Meridian's view.

We present our seven-stage verification-gated workflow, evolved during a post-quantum design port

summary — uncertain: The figures match the abstract, but a non-specialist cannot follow the central result. Terms such as RTL, netlist mutants, 'kill rate', fresh-draw decapsulation, post-quantum, ML-KEM/ML-DSA and formal checks are unexplained. A reader cannot tell that killing a mutant means a test catching a deliberately injected fault. The thesis that passing module tests overstate verification strength is only implied; stating it would fix that. Two smaller repairs: note that one formal check was added for the replay, and say the new tests were guided by surviving mutants. Add tooltips or one plain-language gloss for mutants and kill rate.

However, passing module tests overstate the verification strength.

date — pass: originalPublished is 2026-11-19, which matches the arXiv v1 submission date. The feed date of 2026-11-20 is correctly not used.

[Submitted on 19 Nov 2026]

support — pass: Each claim matches its excerpt. The limitations, including the 85-of-285 ACVP scope and the single design port, and the question follow from the abstract without inventing benefits or costs. There is a minor narrowing: the source says module-scoped review caught 'every known flaw', while the draft says 'every known verifier flaw'. This is close enough not to contradict the source.

module-scoped review catches every known flaw in all 54 sessions

media — pass: The selected media is the verified arXiv abstract page for this paper. It is the direct original source.

Challenge or correct this reading

Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.