{"id":"ab075cb12d7b832c2fe4128d472ca2cb2ee1efc141f040d91d161cac1cd826c6","title":"arXiv cs.AI: What tests and reviews miss in post-quantum hardware","argument":"The authors argue that when LLM agents generate hardware and also produce its tests and reviews, those checks need evidence independent of the agents’ own work. Their seven-stage workflow counts a verification gate only if it can fail on negative controls and fault mutants, and audits the evidence with netlist mutants, flaw replays, and formal checks. They applied it while porting an ML-KEM-768/ML-DSA-65 accelerator to a Zynq UltraScale+ key-custody card. All six operations were byte-exact on the board, but across three RTL modules, existing simulation gates killed only 76% of 399 tool-selected netlist mutants. Specification-derived tests raised the fresh-draw decapsulation kill rate from 48% to 74%. In pre-registered single-model replays, module-scoped review caught every known verifier flaw in all 54 sessions; undirected whole-design review caught the two flaws in only 3/6 and 1/6 sessions. But scoped review detected planted key-custody flaws in only 3/20 sessions, while formal checks flagged every one in the replay. The authors conclude that their study needed author-independent mutants for test gates, module-level scoping for LLM review, and formal checks for custody invariants. Their results concern one design port and defined replay conditions; they do not establish how the workflow performs on other designs.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported results concern one post-quantum design port, three RTL modules, and specified replay conditions; the abstract does not establish how the workflow performs on other designs. The paper reports 85 interface-applicable NIST ACVP cases out of 285, so the reported pass result does not cover all 285 cases. The abstract reports a 300 MHz board implementation but does not provide further performance comparisons.","speaker":{"name":"Park, Jungmin, Kim, Eunha, Kim, Wooseop, Cho, Seongjoon, Cha, Byungho","roleAtSource":"Article author"},"source":{"title":"From FIPS to FPGA with LLM Agents: Measuring What Tests and Reviews Miss in Post-Quantum Cryptographic Hardware","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.25339","publishedAt":"2026-11-19","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose a seven-stage verification-gated workflow and argue that a gate should count only if it can fail on negative controls and fault mutants.","excerpt":"a gate counts only if shown able to fail on negative controls and fault mutants","url":"https://arxiv.org/abs/2611.25339","relationship":"Source-stated"},{"text":"The workflow was used to port an ML-KEM-768/ML-DSA-65 accelerator to a Zynq UltraScale+ key-custody card; all six operations were byte-exact on the board.","excerpt":"all six operations are byte-exact on the board","url":"https://arxiv.org/abs/2611.25339","relationship":"Source-stated"},{"text":"Across three RTL modules, existing simulation gates killed 76% of 399 tool-selected netlist mutants; specification-derived tests raised the fresh-draw decapsulation kill rate from 48% to 74%.","excerpt":"existing simulation gates kill only 76% of 399 tool-selected netlist mutants; specification-derived tests guided by the survivors raise the fresh-draw decapsulation kill rate from 48% to 74%.","url":"https://arxiv.org/abs/2611.25339","relationship":"Source-stated"},{"text":"In pre-registered single-model replays, module-scoped review caught every known verifier flaw in all 54 sessions, while undirected whole-design review caught the two flaws in only 3/6 and 1/6 sessions.","excerpt":"module-scoped review catches every known flaw in all 54 sessions","url":"https://arxiv.org/abs/2611.25339","relationship":"Source-stated"},{"text":"Scoped review detected planted key-custody flaws in only 3/20 sessions, while formal checks flagged every one in that replay.","excerpt":"formal checks (one added for the replay) flag every one","url":"https://arxiv.org/abs/2611.25339","relationship":"Source-stated"},{"text":"The authors conclude that trustworthy agentic hardware in their study needed author-independent mutants, module-level scoping for LLM review, and formal checks for custody invariants.","excerpt":"trustworthy agentic hardware needed author-independent mutants for test gates, module-level scoping for LLM review, and formal checks for custody invariants.","url":"https://arxiv.org/abs/2611.25339","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.25339","checkedAt":"2026-11-20T22:36:09.413Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well would the authors’ verification workflow detect flaws in other hardware designs beyond the port and replay conditions studied here?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: What tests and reviews miss in post-quantum hardware","summary":"The authors argue that when LLM agents generate hardware and also produce its tests and reviews, those checks need evidence independent of the agents’ own work. Their seven-stage workflow counts a verification gate only if it can fail on negative controls and fault mutants, and audits the evidence with netlist mutants, flaw replays, and formal checks. They applied it while porting an ML-KEM-768/ML-DSA-65 accelerator to a Zynq UltraScale+ key-custody card. All six operations were byte-exact on the board, but across three RTL modules, existing simulation gates killed only 76% of 399 tool-selected netlist mutants. Specification-derived tests raised the fresh-draw decapsulation kill rate from 48% to 74%. In pre-registered single-model replays, module-scoped review caught every known verifier flaw in all 54 sessions; undirected whole-design review caught the two flaws in only 3/6 and 1/6 sessions. But scoped review detected planted key-custody flaws in only 3/20 sessions, while formal checks flagged every one in the replay. The authors conclude that their study needed author-independent mutants for test gates, module-level scoping for LLM review, and formal checks for custody invariants. Their results concern one design port and defined replay conditions; they do not establish how the workflow performs on other designs.","question":"How well would the authors’ verification workflow detect flaws in other hardware designs beyond the port and replay conditions studied here?","claims":[{"text":"The authors propose a seven-stage verification-gated workflow and argue that a gate should count only if it can fail on negative controls and fault mutants.","excerpt":"a gate counts only if shown able to fail on negative controls and fault mutants","support":"source-stated"},{"text":"The workflow was used to port an ML-KEM-768/ML-DSA-65 accelerator to a Zynq UltraScale+ key-custody card; all six operations were byte-exact on the board.","excerpt":"all six operations are byte-exact on the board","support":"source-stated"},{"text":"Across three RTL modules, existing simulation gates killed 76% of 399 tool-selected netlist mutants; specification-derived tests raised the fresh-draw decapsulation kill rate from 48% to 74%.","excerpt":"existing simulation gates kill only 76% of 399 tool-selected netlist mutants; specification-derived tests guided by the survivors raise the fresh-draw decapsulation kill rate from 48% to 74%.","support":"source-stated"},{"text":"In pre-registered single-model replays, module-scoped review caught every known verifier flaw in all 54 sessions, while undirected whole-design review caught the two flaws in only 3/6 and 1/6 sessions.","excerpt":"module-scoped review catches every known flaw in all 54 sessions","support":"source-stated"},{"text":"Scoped review detected planted key-custody flaws in only 3/20 sessions, while formal checks flagged every one in that replay.","excerpt":"formal checks (one added for the replay) flag every one","support":"source-stated"},{"text":"The authors conclude that trustworthy agentic hardware in their study needed author-independent mutants, module-level scoping for LLM review, and formal checks for custody invariants.","excerpt":"trustworthy agentic hardware needed author-independent mutants for test gates, module-level scoping for LLM review, and formal checks for custody invariants.","support":"source-stated"}],"limitations":["The reported results concern one post-quantum design port, three RTL modules, and specified replay conditions; the abstract does not establish how the workflow performs on other designs.","The paper reports 85 interface-applicable NIST ACVP cases out of 285, so the reported pass result does not cover all 285 cases.","The abstract reports a 300 MHz board implementation but does not provide further performance comparisons."],"mediaId":"0bdb02af4cf207987cebbd5ae0b0b8c6ef42582b1879d1c02fd2adb0ccb440de","correctionReason":null,"id":"ab075cb12d7b832c2fe4128d472ca2cb2ee1efc141f040d91d161cac1cd826c6","publicationId":"66e8bd1f-8741-43cc-87af-fa89436b3305","version":1,"sourceUrl":"https://arxiv.org/abs/2611.25339","sourceTitle":"From FIPS to FPGA with LLM Agents: Measuring What Tests and Reviews Miss in Post-Quantum Cryptographic Hardware","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-19","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-20T05:07:44.712Z","createdAt":"2026-11-20T05:33:56.637Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"0bdb02af4cf207987cebbd5ae0b0b8c6ef42582b1879d1c02fd2adb0ccb440de","kind":"article","url":"https://arxiv.org/abs/2611.25339","sourceUrl":"https://arxiv.org/abs/2611.25339","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-20T05:33:04.627Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.25339","checkedAt":"2026-11-20T22:36:09.413Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"0bdb02af4cf207987cebbd5ae0b0b8c6ef42582b1879d1c02fd2adb0ccb440de","confidence":0.69,"provider":"typesafe","model":"jev-1.13.0","inputHash":"03cd39421ece88bdbfaf17bb92972268d5bd9db8aad2e29b608a63cce31ec379","decidedAt":"2026-11-20T05:33:06.360Z"},"provenance":{"textHash":"2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc","observationId":"51182902222d02bb6f98dbda64a403fb8e71f7b72f539d30702c11dea62bdb86","retrievedAt":"2026-11-20T05:33:04.371Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"0801462d-12eb-42b5-8232-20bf3c7f2eb1"},"reviewer":{"model":"gpt-6-luna","runId":"9fcc5fb2-20ad-4de9-86a3-6a8f5821f274"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-20T05:33:56.637Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Park, Jungmin","url":null,"kind":"unknown"},{"name":"Kim, Eunha","url":null,"kind":"unknown"},{"name":"Kim, Wooseop","url":null,"kind":"unknown"},{"name":"Cho, Seongjoon","url":null,"kind":"unknown"},{"name":"Cha, Byungho","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Park, Jungmin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Park, Jungmin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25339","locator":"head/meta[name=author|citation_author]"},"assertionId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-20T22:36:09.413Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e","sourceUrl":"https://arxiv.org/abs/2611.25339","contentSha256":"5b20c3609e1227982f44997e0bde0540c51e44ba7ff952743c8cb99fd8d6b4dc","textHash":"2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc","observedAt":"2026-11-20T22:36:09.413Z"}},{"actor":{"name":"Kim, Eunha","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kim, Eunha","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25339","locator":"head/meta[name=author|citation_author]"},"assertionId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-20T22:36:09.413Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e","sourceUrl":"https://arxiv.org/abs/2611.25339","contentSha256":"5b20c3609e1227982f44997e0bde0540c51e44ba7ff952743c8cb99fd8d6b4dc","textHash":"2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc","observedAt":"2026-11-20T22:36:09.413Z"}},{"actor":{"name":"Kim, Wooseop","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kim, Wooseop","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25339","locator":"head/meta[name=author|citation_author]"},"assertionId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-20T22:36:09.413Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e","sourceUrl":"https://arxiv.org/abs/2611.25339","contentSha256":"5b20c3609e1227982f44997e0bde0540c51e44ba7ff952743c8cb99fd8d6b4dc","textHash":"2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc","observedAt":"2026-11-20T22:36:09.413Z"}},{"actor":{"name":"Cho, Seongjoon","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Cho, Seongjoon","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25339","locator":"head/meta[name=author|citation_author]"},"assertionId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-20T22:36:09.413Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e","sourceUrl":"https://arxiv.org/abs/2611.25339","contentSha256":"5b20c3609e1227982f44997e0bde0540c51e44ba7ff952743c8cb99fd8d6b4dc","textHash":"2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc","observedAt":"2026-11-20T22:36:09.413Z"}},{"actor":{"name":"Cha, Byungho","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Cha, Byungho","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25339","locator":"head/meta[name=author|citation_author]"},"assertionId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-20T22:36:09.413Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e","sourceUrl":"https://arxiv.org/abs/2611.25339","contentSha256":"5b20c3609e1227982f44997e0bde0540c51e44ba7ff952743c8cb99fd8d6b4dc","textHash":"2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc","observedAt":"2026-11-20T22:36:09.413Z"}}],"participationCoverage":{"total":5,"returned":5,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.25339","snapshotId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e","contentSha256":"5b20c3609e1227982f44997e0bde0540c51e44ba7ff952743c8cb99fd8d6b4dc","textHash":"2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc","observedAt":"2026-11-20T22:36:09.413Z","basis":"publisher-page-metadata","sourceLinks":45,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/ab075cb12d7b832c2fe4128d472ca2cb2ee1efc141f040d91d161cac1cd826c6/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-what-tests-and-reviews-miss-in-post-quantum-hardware-ab075cb1","formats":{"html":"/readings/arxiv-cs-ai-what-tests-and-reviews-miss-in-post-quantum-hardware-ab075cb1","markdown":"/readings/arxiv-cs-ai-what-tests-and-reviews-miss-in-post-quantum-hardware-ab075cb1.md","json":"/readings/arxiv-cs-ai-what-tests-and-reviews-miss-in-post-quantum-hardware-ab075cb1.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"},{"id":"term-machine-learning","name":"Machine learning","explanation":"Methods that let computers learn patterns from examples instead of following rules written by hand.","referenceUrl":"https://developers.google.com/machine-learning/glossary#machine-learning"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"},{"id":"nist","name":"NIST","kind":"organization","context":"NIST is a US measurement and standards agency that develops ways to assess and manage risks from AI.","referenceUrls":["https://www.nist.gov/","https://www.nist.gov/itl/ai-risk-management-framework"],"path":"/entities/nist","json":"/entities/nist.json","markdown":"/entities/nist.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"ab075cb12d7b832c2fe4128d472ca2cb2ee1efc141f040d91d161cac1cd826c6","revision":"66e8bd1f-8741-43cc-87af-fa89436b3305","revisionKind":"publication-id","title":"arXiv cs.AI: What tests and reviews miss in post-quantum hardware","url":"https://escapemeridian.com/readings/arxiv-cs-ai-what-tests-and-reviews-miss-in-post-quantum-hardware-ab075cb1"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.25339","revision":"2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc","revisionKind":"sha256-source-text","title":"From FIPS to FPGA with LLM Agents: Measuring What Tests and Reviews Miss in Post-Quantum Cryptographic Hardware","url":"https://arxiv.org/abs/2611.25339"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"ab075cb12d7b832c2fe4128d472ca2cb2ee1efc141f040d91d161cac1cd826c6","title":"arXiv cs.AI: What tests and reviews miss in post-quantum hardware","argument":"The authors argue that when LLM agents generate hardware and also produce its tests and reviews, those checks need evidence independent of the agents’ own work. Their seven-stage workflow counts a verification gate only if it can fail on negative controls and fault mutants, and audits the evidence with netlist mutants, flaw replays, and formal checks. They applied it while porting an ML-KEM-768/ML-DSA-65 accelerator to a Zynq UltraScale+ key-custody card. All six operations were byte-exact on the board, but across three RTL modules, existing simulation gates killed only 76% of 399 tool-selected netlist mutants. Specification-derived tests raised the fresh-draw decapsulation kill rate from 48% to 74%. In pre-registered single-model replays, module-scoped review caught every known verifier flaw in all 54 sessions; undirected whole-design review caught the two flaws in only 3/6 and 1/6 sessions. But scoped review detected planted key-custody flaws in only 3/20 sessions, while formal checks flagged every one in the replay. The authors conclude that their study needed author-independent mutants for test gates, module-level scoping for LLM review, and formal checks for custody invariants. Their results concern one design port and defined replay conditions; they do not establish how the workflow performs on other designs.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported results concern one post-quantum design port, three RTL modules, and specified replay conditions; the abstract does not establish how the workflow performs on other designs. The paper reports 85 interface-applicable NIST ACVP cases out of 285, so the reported pass result does not cover all 285 cases. The abstract reports a 300 MHz board implementation but does not provide further performance comparisons.","speaker":{"name":"Park, Jungmin, Kim, Eunha, Kim, Wooseop, Cho, Seongjoon, Cha, Byungho","roleAtSource":"Article author"},"source":{"title":"From FIPS to FPGA with LLM Agents: Measuring What Tests and Reviews Miss in Post-Quantum Cryptographic Hardware","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.25339","publishedAt":"2026-11-19","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose a seven-stage verification-gated workflow and argue that a gate should count only if it can fail on negative controls and fault mutants.","excerpt":"a gate counts only if shown able to fail on negative controls and fault mutants","url":"https://arxiv.org/abs/2611.25339","relationship":"Source-stated"},{"text":"The workflow was used to port an ML-KEM-768/ML-DSA-65 accelerator to a Zynq UltraScale+ key-custody card; all six operations were byte-exact on the board.","excerpt":"all six operations are byte-exact on the board","url":"https://arxiv.org/abs/2611.25339","relationship":"Source-stated"},{"text":"Across three RTL modules, existing simulation gates killed 76% of 399 tool-selected netlist mutants; specification-derived tests raised the fresh-draw decapsulation kill rate from 48% to 74%.","excerpt":"existing simulation gates kill only 76% of 399 tool-selected netlist mutants; specification-derived tests guided by the survivors raise the fresh-draw decapsulation kill rate from 48% to 74%.","url":"https://arxiv.org/abs/2611.25339","relationship":"Source-stated"},{"text":"In pre-registered single-model replays, module-scoped review caught every known verifier flaw in all 54 sessions, while undirected whole-design review caught the two flaws in only 3/6 and 1/6 sessions.","excerpt":"module-scoped review catches every known flaw in all 54 sessions","url":"https://arxiv.org/abs/2611.25339","relationship":"Source-stated"},{"text":"Scoped review detected planted key-custody flaws in only 3/20 sessions, while formal checks flagged every one in that replay.","excerpt":"formal checks (one added for the replay) flag every one","url":"https://arxiv.org/abs/2611.25339","relationship":"Source-stated"},{"text":"The authors conclude that trustworthy agentic hardware in their study needed author-independent mutants, module-level scoping for LLM review, and formal checks for custody invariants.","excerpt":"trustworthy agentic hardware needed author-independent mutants for test gates, module-level scoping for LLM review, and formal checks for custody invariants.","url":"https://arxiv.org/abs/2611.25339","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.25339","checkedAt":"2026-11-20T22:36:09.413Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well would the authors’ verification workflow detect flaws in other hardware designs beyond the port and replay conditions studied here?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: What tests and reviews miss in post-quantum hardware","summary":"The authors argue that when LLM agents generate hardware and also produce its tests and reviews, those checks need evidence independent of the agents’ own work. Their seven-stage workflow counts a verification gate only if it can fail on negative controls and fault mutants, and audits the evidence with netlist mutants, flaw replays, and formal checks. They applied it while porting an ML-KEM-768/ML-DSA-65 accelerator to a Zynq UltraScale+ key-custody card. All six operations were byte-exact on the board, but across three RTL modules, existing simulation gates killed only 76% of 399 tool-selected netlist mutants. Specification-derived tests raised the fresh-draw decapsulation kill rate from 48% to 74%. In pre-registered single-model replays, module-scoped review caught every known verifier flaw in all 54 sessions; undirected whole-design review caught the two flaws in only 3/6 and 1/6 sessions. But scoped review detected planted key-custody flaws in only 3/20 sessions, while formal checks flagged every one in the replay. The authors conclude that their study needed author-independent mutants for test gates, module-level scoping for LLM review, and formal checks for custody invariants. Their results concern one design port and defined replay conditions; they do not establish how the workflow performs on other designs.","question":"How well would the authors’ verification workflow detect flaws in other hardware designs beyond the port and replay conditions studied here?","claims":[{"text":"The authors propose a seven-stage verification-gated workflow and argue that a gate should count only if it can fail on negative controls and fault mutants.","excerpt":"a gate counts only if shown able to fail on negative controls and fault mutants","support":"source-stated"},{"text":"The workflow was used to port an ML-KEM-768/ML-DSA-65 accelerator to a Zynq UltraScale+ key-custody card; all six operations were byte-exact on the board.","excerpt":"all six operations are byte-exact on the board","support":"source-stated"},{"text":"Across three RTL modules, existing simulation gates killed 76% of 399 tool-selected netlist mutants; specification-derived tests raised the fresh-draw decapsulation kill rate from 48% to 74%.","excerpt":"existing simulation gates kill only 76% of 399 tool-selected netlist mutants; specification-derived tests guided by the survivors raise the fresh-draw decapsulation kill rate from 48% to 74%.","support":"source-stated"},{"text":"In pre-registered single-model replays, module-scoped review caught every known verifier flaw in all 54 sessions, while undirected whole-design review caught the two flaws in only 3/6 and 1/6 sessions.","excerpt":"module-scoped review catches every known flaw in all 54 sessions","support":"source-stated"},{"text":"Scoped review detected planted key-custody flaws in only 3/20 sessions, while formal checks flagged every one in that replay.","excerpt":"formal checks (one added for the replay) flag every one","support":"source-stated"},{"text":"The authors conclude that trustworthy agentic hardware in their study needed author-independent mutants, module-level scoping for LLM review, and formal checks for custody invariants.","excerpt":"trustworthy agentic hardware needed author-independent mutants for test gates, module-level scoping for LLM review, and formal checks for custody invariants.","support":"source-stated"}],"limitations":["The reported results concern one post-quantum design port, three RTL modules, and specified replay conditions; the abstract does not establish how the workflow performs on other designs.","The paper reports 85 interface-applicable NIST ACVP cases out of 285, so the reported pass result does not cover all 285 cases.","The abstract reports a 300 MHz board implementation but does not provide further performance comparisons."],"mediaId":"0bdb02af4cf207987cebbd5ae0b0b8c6ef42582b1879d1c02fd2adb0ccb440de","correctionReason":null,"id":"ab075cb12d7b832c2fe4128d472ca2cb2ee1efc141f040d91d161cac1cd826c6","publicationId":"66e8bd1f-8741-43cc-87af-fa89436b3305","version":1,"sourceUrl":"https://arxiv.org/abs/2611.25339","sourceTitle":"From FIPS to FPGA with LLM Agents: Measuring What Tests and Reviews Miss in Post-Quantum Cryptographic Hardware","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-19","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-20T05:07:44.712Z","createdAt":"2026-11-20T05:33:56.637Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"0bdb02af4cf207987cebbd5ae0b0b8c6ef42582b1879d1c02fd2adb0ccb440de","kind":"article","url":"https://arxiv.org/abs/2611.25339","sourceUrl":"https://arxiv.org/abs/2611.25339","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-20T05:33:04.627Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.25339","checkedAt":"2026-11-20T22:36:09.413Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"0bdb02af4cf207987cebbd5ae0b0b8c6ef42582b1879d1c02fd2adb0ccb440de","confidence":0.69,"provider":"typesafe","model":"jev-1.13.0","inputHash":"03cd39421ece88bdbfaf17bb92972268d5bd9db8aad2e29b608a63cce31ec379","decidedAt":"2026-11-20T05:33:06.360Z"},"provenance":{"textHash":"2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc","observationId":"51182902222d02bb6f98dbda64a403fb8e71f7b72f539d30702c11dea62bdb86","retrievedAt":"2026-11-20T05:33:04.371Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"0801462d-12eb-42b5-8232-20bf3c7f2eb1"},"reviewer":{"model":"gpt-6-luna","runId":"9fcc5fb2-20ad-4de9-86a3-6a8f5821f274"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-20T05:33:56.637Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Park, Jungmin","url":null,"kind":"unknown"},{"name":"Kim, Eunha","url":null,"kind":"unknown"},{"name":"Kim, Wooseop","url":null,"kind":"unknown"},{"name":"Cho, Seongjoon","url":null,"kind":"unknown"},{"name":"Cha, Byungho","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Park, Jungmin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Park, Jungmin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25339","locator":"head/meta[name=author|citation_author]"},"assertionId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-20T22:36:09.413Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e","sourceUrl":"https://arxiv.org/abs/2611.25339","contentSha256":"5b20c3609e1227982f44997e0bde0540c51e44ba7ff952743c8cb99fd8d6b4dc","textHash":"2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc","observedAt":"2026-11-20T22:36:09.413Z"}},{"actor":{"name":"Kim, Eunha","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kim, Eunha","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25339","locator":"head/meta[name=author|citation_author]"},"assertionId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-20T22:36:09.413Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e","sourceUrl":"https://arxiv.org/abs/2611.25339","contentSha256":"5b20c3609e1227982f44997e0bde0540c51e44ba7ff952743c8cb99fd8d6b4dc","textHash":"2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc","observedAt":"2026-11-20T22:36:09.413Z"}},{"actor":{"name":"Kim, Wooseop","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kim, Wooseop","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25339","locator":"head/meta[name=author|citation_author]"},"assertionId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-20T22:36:09.413Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e","sourceUrl":"https://arxiv.org/abs/2611.25339","contentSha256":"5b20c3609e1227982f44997e0bde0540c51e44ba7ff952743c8cb99fd8d6b4dc","textHash":"2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc","observedAt":"2026-11-20T22:36:09.413Z"}},{"actor":{"name":"Cho, Seongjoon","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Cho, Seongjoon","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25339","locator":"head/meta[name=author|citation_author]"},"assertionId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-20T22:36:09.413Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e","sourceUrl":"https://arxiv.org/abs/2611.25339","contentSha256":"5b20c3609e1227982f44997e0bde0540c51e44ba7ff952743c8cb99fd8d6b4dc","textHash":"2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc","observedAt":"2026-11-20T22:36:09.413Z"}},{"actor":{"name":"Cha, Byungho","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Cha, Byungho","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25339","locator":"head/meta[name=author|citation_author]"},"assertionId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-20T22:36:09.413Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e","sourceUrl":"https://arxiv.org/abs/2611.25339","contentSha256":"5b20c3609e1227982f44997e0bde0540c51e44ba7ff952743c8cb99fd8d6b4dc","textHash":"2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc","observedAt":"2026-11-20T22:36:09.413Z"}}],"participationCoverage":{"total":5,"returned":5,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.25339","snapshotId":"61fa9a96e240a76c5955aa46b3c6068239347cdbf59d5de08e5ffd0ba355b82e","contentSha256":"5b20c3609e1227982f44997e0bde0540c51e44ba7ff952743c8cb99fd8d6b4dc","textHash":"2645abebd02098aca0a124444114dd6e2a25fee0726eb5b65058d46d90f92abc","observedAt":"2026-11-20T22:36:09.413Z","basis":"publisher-page-metadata","sourceLinks":45,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/ab075cb12d7b832c2fe4128d472ca2cb2ee1efc141f040d91d161cac1cd826c6/source"}}}],"audits":[{"publicationId":"66e8bd1f-8741-43cc-87af-fa89436b3305","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading attributes the workflow, results and conclusions to the paper's authors. It labels the source as arXiv and does not present the findings as established facts or as Escape Meridian's view.","excerpt":"We present our seven-stage verification-gated workflow, evolved during a post-quantum design port"},{"dimension":"summary","status":"uncertain","explanation":"The figures match the abstract, but a non-specialist cannot follow the central result. Terms such as RTL, netlist mutants, 'kill rate', fresh-draw decapsulation, post-quantum, ML-KEM/ML-DSA and formal checks are unexplained. A reader cannot tell that killing a mutant means a test catching a deliberately injected fault. The thesis that passing module tests overstate verification strength is only implied; stating it would fix that. Two smaller repairs: note that one formal check was added for the replay, and say the new tests were guided by surviving mutants. Add tooltips or one plain-language gloss for mutants and kill rate.","excerpt":"However, passing module tests overstate the verification strength."},{"dimension":"date","status":"pass","explanation":"originalPublished is 2026-11-19, which matches the arXiv v1 submission date. The feed date of 2026-11-20 is correctly not used.","excerpt":"[Submitted on 19 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim matches its excerpt. The limitations, including the 85-of-285 ACVP scope and the single design port, and the question follow from the abstract without inventing benefits or costs. There is a minor narrowing: the source says module-scoped review caught 'every known flaw', while the draft says 'every known verifier flaw'. This is close enough not to contradict the source.","excerpt":"module-scoped review catches every known flaw in all 54 sessions"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified arXiv abstract page for this paper. It is the direct original source.","excerpt":null}],"createdAt":"2026-11-20T05:33:56.637Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}