{"id":"14c9fcc82fe4ec3b65194f1ce7893281c9990ac962f0bee25be108806bf953f0","title":"Giacomo Greco derives a transformer head from a maximum-entropy model of language","argument":"Giacomo Greco argues that the transformer architecture can emerge from a maximum-entropy model of language. In this approach, sentences are treated as empirical measures of tokens, and a language as a probability law over those measures. Starting from a prior that sentences carry no structure, the model selects the law closest to that prior while matching an observed sentence-level statistic. Greco says a statistic built to capture token interactions yields the softmax choice rule, with the attention cross-moment as its mean parameter. In the derivation, the query–key matrix and value matrix arise as multipliers for different constraints, so they are untied. For ordered sentences, a masked reference choice rule produces causal masking; with a next-token cross-moment, the score equals one causally masked attention head. The paper also discusses multi-head attention, weight-tied unembedding, and a heuristic interpretation of residual blocks as projected Langevin steps. The argument offers a statistical account of how familiar transformer components fit together; the supplied abstract does not report an empirical test of how well this model describes language in practice.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv abstract, not the paper's full derivation; details of the model and its assumptions are therefore unavailable here. The abstract describes a statistical derivation but does not report an empirical evaluation of how well the model describes language in practice.","speaker":{"name":"Greco, Giacomo","roleAtSource":"Article author"},"source":{"title":"Emergence of the transformer architecture as the score of entropic laws of random measures","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.39614","publishedAt":"2026-10-29","dateBasis":"Date basis not provided."},"evidence":[{"text":"Greco presents the transformer architecture as emerging from a maximum-entropy model in which sentences are empirical measures of tokens and language is a law over those measures.","excerpt":"the transformer architecture emerges as the score of last-token laws in a natural statistical model of language, where sentences are empirical measures of tokens, a language is a law on $P(S^d)$","url":"https://arxiv.org/abs/2610.39614","relationship":"Source-stated"},{"text":"The model selects the law closest in relative entropy to a structure-free prior while matching an observed sentence-level statistic.","excerpt":"By the maximum-entropy principle, we select the law closest to this prior in relative entropy among those reproducing an observed sentence-level statistic.","url":"https://arxiv.org/abs/2610.39614","relationship":"Source-stated"},{"text":"Greco says a statistic designed to capture token interactions yields the softmax choice rule, with the attention cross-moment as its mean parameter.","excerpt":"This procedure gives the softmax choice rule, with the attention cross-moment as its mean parameter.","url":"https://arxiv.org/abs/2610.39614","relationship":"Source-stated"},{"text":"In the model, the query–key matrix and value matrix serve as multipliers for different constraints and are therefore untied.","excerpt":"The query--key matrix is then the Lagrange multiplier of a maximum-entropy problem inside each sentence, and the value matrix the multiplier of the constraint over the language, so that the two are untied.","url":"https://arxiv.org/abs/2610.39614","relationship":"Source-stated"},{"text":"For ordered sentences, Greco says causal masking follows from the masked reference choice rule; adding a next-token cross-moment makes the score equal one causally masked attention head.","excerpt":"For ordered sentences, causal masking follows from the masked reference choice rule, and with a next-token cross-moment the score equals one causally masked attention head.","url":"https://arxiv.org/abs/2610.39614","relationship":"Source-stated"},{"text":"The abstract also discusses multi-head attention, weight-tied unembedding, and a heuristic interpretation of residual blocks.","excerpt":"We also discuss multi-head attention, weight-tied unembedding, and a heuristic reading of residual blocks as projected Langevin steps.","url":"https://arxiv.org/abs/2610.39614","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.39614","checkedAt":"2026-11-11T08:54:07.528Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How does the paper establish that its chosen sentence-level statistic captures token interactions in language?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Giacomo Greco derives a transformer head from a maximum-entropy model of language","summary":"Giacomo Greco argues that the transformer architecture can emerge from a maximum-entropy model of language. In this approach, sentences are treated as empirical measures of tokens, and a language as a probability law over those measures. Starting from a prior that sentences carry no structure, the model selects the law closest to that prior while matching an observed sentence-level statistic. Greco says a statistic built to capture token interactions yields the softmax choice rule, with the attention cross-moment as its mean parameter. In the derivation, the query–key matrix and value matrix arise as multipliers for different constraints, so they are untied. For ordered sentences, a masked reference choice rule produces causal masking; with a next-token cross-moment, the score equals one causally masked attention head. The paper also discusses multi-head attention, weight-tied unembedding, and a heuristic interpretation of residual blocks as projected Langevin steps. The argument offers a statistical account of how familiar transformer components fit together; the supplied abstract does not report an empirical test of how well this model describes language in practice.","question":"How does the paper establish that its chosen sentence-level statistic captures token interactions in language?","claims":[{"text":"Greco presents the transformer architecture as emerging from a maximum-entropy model in which sentences are empirical measures of tokens and language is a law over those measures.","excerpt":"the transformer architecture emerges as the score of last-token laws in a natural statistical model of language, where sentences are empirical measures of tokens, a language is a law on $P(S^d)$","support":"source-stated"},{"text":"The model selects the law closest in relative entropy to a structure-free prior while matching an observed sentence-level statistic.","excerpt":"By the maximum-entropy principle, we select the law closest to this prior in relative entropy among those reproducing an observed sentence-level statistic.","support":"source-stated"},{"text":"Greco says a statistic designed to capture token interactions yields the softmax choice rule, with the attention cross-moment as its mean parameter.","excerpt":"This procedure gives the softmax choice rule, with the attention cross-moment as its mean parameter.","support":"source-stated"},{"text":"In the model, the query–key matrix and value matrix serve as multipliers for different constraints and are therefore untied.","excerpt":"The query--key matrix is then the Lagrange multiplier of a maximum-entropy problem inside each sentence, and the value matrix the multiplier of the constraint over the language, so that the two are untied.","support":"source-stated"},{"text":"For ordered sentences, Greco says causal masking follows from the masked reference choice rule; adding a next-token cross-moment makes the score equal one causally masked attention head.","excerpt":"For ordered sentences, causal masking follows from the masked reference choice rule, and with a next-token cross-moment the score equals one causally masked attention head.","support":"source-stated"},{"text":"The abstract also discusses multi-head attention, weight-tied unembedding, and a heuristic interpretation of residual blocks.","excerpt":"We also discuss multi-head attention, weight-tied unembedding, and a heuristic reading of residual blocks as projected Langevin steps.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv abstract, not the paper's full derivation; details of the model and its assumptions are therefore unavailable here.","The abstract describes a statistical derivation but does not report an empirical evaluation of how well the model describes language in practice."],"mediaId":"b608a02ad92a3d0cf1f1ee4bd5c5c31a07e84c87de575dde9d436f0534666fdb","correctionReason":null,"id":"14c9fcc82fe4ec3b65194f1ce7893281c9990ac962f0bee25be108806bf953f0","publicationId":"20c22bb7-b8b2-4d29-8db0-d881d60902c0","version":1,"sourceUrl":"https://arxiv.org/abs/2610.39614","sourceTitle":"Emergence of the transformer architecture as the score of entropic laws of random measures","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-29","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-30T06:45:24.893Z","createdAt":"2026-11-11T08:22:57.764Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"b608a02ad92a3d0cf1f1ee4bd5c5c31a07e84c87de575dde9d436f0534666fdb","kind":"article","url":"https://arxiv.org/abs/2610.39614","sourceUrl":"https://arxiv.org/abs/2610.39614","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-31T04:32:14.839Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.39614","checkedAt":"2026-11-11T08:54:07.528Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v5","mediaId":"b608a02ad92a3d0cf1f1ee4bd5c5c31a07e84c87de575dde9d436f0534666fdb","confidence":0.65,"provider":"typesafe","model":"jev-1.13.0","inputHash":"0aa24a361921eeea7001c3a6179e0bd215f5ab3f7a71e33d93c5240a6ce59d61","decidedAt":"2026-10-31T04:32:16.014Z","redecided":{"from":"stream-admission-v5","under":"stream-admission-v5+confidence-0.5"}},"provenance":{"textHash":"0f5c0be8bc26703f7d609914d1757441820c24ec6f7cca8c2681de19f971b4c5","observationId":"3f2ae9993f06b5ce04345066d4e68d10f4626fcbbab538773ac019fc2b78ad8c","retrievedAt":"2026-10-31T04:32:14.666Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"c83ec1b4-9b32-41fd-8061-2d1d791a1b43"},"reviewer":{"model":"gpt-6-luna","runId":"a52c094f-816f-47d5-86ef-f40137a2049f"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-11T08:22:57.764Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Greco, Giacomo","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Greco, Giacomo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Greco, Giacomo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.39614","locator":"head/meta[name=author|citation_author]"},"assertionId":"b71022ebaa812b187e3d7904630596079907622bfdf806f5bbb542e9fb5da946:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.528Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b71022ebaa812b187e3d7904630596079907622bfdf806f5bbb542e9fb5da946","sourceUrl":"https://arxiv.org/abs/2610.39614","contentSha256":"967cf97a3249ac7a67f07a9e776d997de72a96e138eb3c203d34a560f0cb287a","textHash":"0f5c0be8bc26703f7d609914d1757441820c24ec6f7cca8c2681de19f971b4c5","observedAt":"2026-11-11T08:54:07.528Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.39614","snapshotId":"b71022ebaa812b187e3d7904630596079907622bfdf806f5bbb542e9fb5da946","contentSha256":"967cf97a3249ac7a67f07a9e776d997de72a96e138eb3c203d34a560f0cb287a","textHash":"0f5c0be8bc26703f7d609914d1757441820c24ec6f7cca8c2681de19f971b4c5","observedAt":"2026-11-11T08:54:07.528Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/14c9fcc82fe4ec3b65194f1ce7893281c9990ac962f0bee25be108806bf953f0/source"}},"canonicalUrl":"https://escapemeridian.com/readings/giacomo-greco-derives-a-transformer-head-from-a-maximum-entropy-14c9fcc8","formats":{"html":"/readings/giacomo-greco-derives-a-transformer-head-from-a-maximum-entropy-14c9fcc8","markdown":"/readings/giacomo-greco-derives-a-transformer-head-from-a-maximum-entropy-14c9fcc8.md","json":"/readings/giacomo-greco-derives-a-transformer-head-from-a-maximum-entropy-14c9fcc8.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-transformer","name":"Transformer architecture","explanation":"The neural-network design behind most current language models; it weighs how each part of the input relates to the others.","referenceUrl":"https://developers.google.com/machine-learning/glossary#transformer"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"14c9fcc82fe4ec3b65194f1ce7893281c9990ac962f0bee25be108806bf953f0","revision":"20c22bb7-b8b2-4d29-8db0-d881d60902c0","revisionKind":"publication-id","title":"Giacomo Greco derives a transformer head from a maximum-entropy model of language","url":"https://escapemeridian.com/readings/giacomo-greco-derives-a-transformer-head-from-a-maximum-entropy-14c9fcc8"},"source":{"type":"source","id":"https://arxiv.org/abs/2610.39614","revision":"0f5c0be8bc26703f7d609914d1757441820c24ec6f7cca8c2681de19f971b4c5","revisionKind":"sha256-source-text","title":"Emergence of the transformer architecture as the score of entropic laws of random measures","url":"https://arxiv.org/abs/2610.39614"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"14c9fcc82fe4ec3b65194f1ce7893281c9990ac962f0bee25be108806bf953f0","title":"Giacomo Greco derives a transformer head from a maximum-entropy model of language","argument":"Giacomo Greco argues that the transformer architecture can emerge from a maximum-entropy model of language. In this approach, sentences are treated as empirical measures of tokens, and a language as a probability law over those measures. Starting from a prior that sentences carry no structure, the model selects the law closest to that prior while matching an observed sentence-level statistic. Greco says a statistic built to capture token interactions yields the softmax choice rule, with the attention cross-moment as its mean parameter. In the derivation, the query–key matrix and value matrix arise as multipliers for different constraints, so they are untied. For ordered sentences, a masked reference choice rule produces causal masking; with a next-token cross-moment, the score equals one causally masked attention head. The paper also discusses multi-head attention, weight-tied unembedding, and a heuristic interpretation of residual blocks as projected Langevin steps. The argument offers a statistical account of how familiar transformer components fit together; the supplied abstract does not report an empirical test of how well this model describes language in practice.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv abstract, not the paper's full derivation; details of the model and its assumptions are therefore unavailable here. The abstract describes a statistical derivation but does not report an empirical evaluation of how well the model describes language in practice.","speaker":{"name":"Greco, Giacomo","roleAtSource":"Article author"},"source":{"title":"Emergence of the transformer architecture as the score of entropic laws of random measures","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.39614","publishedAt":"2026-10-29","dateBasis":"Date basis not provided."},"evidence":[{"text":"Greco presents the transformer architecture as emerging from a maximum-entropy model in which sentences are empirical measures of tokens and language is a law over those measures.","excerpt":"the transformer architecture emerges as the score of last-token laws in a natural statistical model of language, where sentences are empirical measures of tokens, a language is a law on $P(S^d)$","url":"https://arxiv.org/abs/2610.39614","relationship":"Source-stated"},{"text":"The model selects the law closest in relative entropy to a structure-free prior while matching an observed sentence-level statistic.","excerpt":"By the maximum-entropy principle, we select the law closest to this prior in relative entropy among those reproducing an observed sentence-level statistic.","url":"https://arxiv.org/abs/2610.39614","relationship":"Source-stated"},{"text":"Greco says a statistic designed to capture token interactions yields the softmax choice rule, with the attention cross-moment as its mean parameter.","excerpt":"This procedure gives the softmax choice rule, with the attention cross-moment as its mean parameter.","url":"https://arxiv.org/abs/2610.39614","relationship":"Source-stated"},{"text":"In the model, the query–key matrix and value matrix serve as multipliers for different constraints and are therefore untied.","excerpt":"The query--key matrix is then the Lagrange multiplier of a maximum-entropy problem inside each sentence, and the value matrix the multiplier of the constraint over the language, so that the two are untied.","url":"https://arxiv.org/abs/2610.39614","relationship":"Source-stated"},{"text":"For ordered sentences, Greco says causal masking follows from the masked reference choice rule; adding a next-token cross-moment makes the score equal one causally masked attention head.","excerpt":"For ordered sentences, causal masking follows from the masked reference choice rule, and with a next-token cross-moment the score equals one causally masked attention head.","url":"https://arxiv.org/abs/2610.39614","relationship":"Source-stated"},{"text":"The abstract also discusses multi-head attention, weight-tied unembedding, and a heuristic interpretation of residual blocks.","excerpt":"We also discuss multi-head attention, weight-tied unembedding, and a heuristic reading of residual blocks as projected Langevin steps.","url":"https://arxiv.org/abs/2610.39614","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.39614","checkedAt":"2026-11-11T08:54:07.528Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How does the paper establish that its chosen sentence-level statistic captures token interactions in language?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Giacomo Greco derives a transformer head from a maximum-entropy model of language","summary":"Giacomo Greco argues that the transformer architecture can emerge from a maximum-entropy model of language. In this approach, sentences are treated as empirical measures of tokens, and a language as a probability law over those measures. Starting from a prior that sentences carry no structure, the model selects the law closest to that prior while matching an observed sentence-level statistic. Greco says a statistic built to capture token interactions yields the softmax choice rule, with the attention cross-moment as its mean parameter. In the derivation, the query–key matrix and value matrix arise as multipliers for different constraints, so they are untied. For ordered sentences, a masked reference choice rule produces causal masking; with a next-token cross-moment, the score equals one causally masked attention head. The paper also discusses multi-head attention, weight-tied unembedding, and a heuristic interpretation of residual blocks as projected Langevin steps. The argument offers a statistical account of how familiar transformer components fit together; the supplied abstract does not report an empirical test of how well this model describes language in practice.","question":"How does the paper establish that its chosen sentence-level statistic captures token interactions in language?","claims":[{"text":"Greco presents the transformer architecture as emerging from a maximum-entropy model in which sentences are empirical measures of tokens and language is a law over those measures.","excerpt":"the transformer architecture emerges as the score of last-token laws in a natural statistical model of language, where sentences are empirical measures of tokens, a language is a law on $P(S^d)$","support":"source-stated"},{"text":"The model selects the law closest in relative entropy to a structure-free prior while matching an observed sentence-level statistic.","excerpt":"By the maximum-entropy principle, we select the law closest to this prior in relative entropy among those reproducing an observed sentence-level statistic.","support":"source-stated"},{"text":"Greco says a statistic designed to capture token interactions yields the softmax choice rule, with the attention cross-moment as its mean parameter.","excerpt":"This procedure gives the softmax choice rule, with the attention cross-moment as its mean parameter.","support":"source-stated"},{"text":"In the model, the query–key matrix and value matrix serve as multipliers for different constraints and are therefore untied.","excerpt":"The query--key matrix is then the Lagrange multiplier of a maximum-entropy problem inside each sentence, and the value matrix the multiplier of the constraint over the language, so that the two are untied.","support":"source-stated"},{"text":"For ordered sentences, Greco says causal masking follows from the masked reference choice rule; adding a next-token cross-moment makes the score equal one causally masked attention head.","excerpt":"For ordered sentences, causal masking follows from the masked reference choice rule, and with a next-token cross-moment the score equals one causally masked attention head.","support":"source-stated"},{"text":"The abstract also discusses multi-head attention, weight-tied unembedding, and a heuristic interpretation of residual blocks.","excerpt":"We also discuss multi-head attention, weight-tied unembedding, and a heuristic reading of residual blocks as projected Langevin steps.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv abstract, not the paper's full derivation; details of the model and its assumptions are therefore unavailable here.","The abstract describes a statistical derivation but does not report an empirical evaluation of how well the model describes language in practice."],"mediaId":"b608a02ad92a3d0cf1f1ee4bd5c5c31a07e84c87de575dde9d436f0534666fdb","correctionReason":null,"id":"14c9fcc82fe4ec3b65194f1ce7893281c9990ac962f0bee25be108806bf953f0","publicationId":"20c22bb7-b8b2-4d29-8db0-d881d60902c0","version":1,"sourceUrl":"https://arxiv.org/abs/2610.39614","sourceTitle":"Emergence of the transformer architecture as the score of entropic laws of random measures","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-29","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-30T06:45:24.893Z","createdAt":"2026-11-11T08:22:57.764Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"b608a02ad92a3d0cf1f1ee4bd5c5c31a07e84c87de575dde9d436f0534666fdb","kind":"article","url":"https://arxiv.org/abs/2610.39614","sourceUrl":"https://arxiv.org/abs/2610.39614","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-31T04:32:14.839Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.39614","checkedAt":"2026-11-11T08:54:07.528Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v5","mediaId":"b608a02ad92a3d0cf1f1ee4bd5c5c31a07e84c87de575dde9d436f0534666fdb","confidence":0.65,"provider":"typesafe","model":"jev-1.13.0","inputHash":"0aa24a361921eeea7001c3a6179e0bd215f5ab3f7a71e33d93c5240a6ce59d61","decidedAt":"2026-10-31T04:32:16.014Z","redecided":{"from":"stream-admission-v5","under":"stream-admission-v5+confidence-0.5"}},"provenance":{"textHash":"0f5c0be8bc26703f7d609914d1757441820c24ec6f7cca8c2681de19f971b4c5","observationId":"3f2ae9993f06b5ce04345066d4e68d10f4626fcbbab538773ac019fc2b78ad8c","retrievedAt":"2026-10-31T04:32:14.666Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"c83ec1b4-9b32-41fd-8061-2d1d791a1b43"},"reviewer":{"model":"gpt-6-luna","runId":"a52c094f-816f-47d5-86ef-f40137a2049f"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-11T08:22:57.764Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Greco, Giacomo","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Greco, Giacomo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Greco, Giacomo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.39614","locator":"head/meta[name=author|citation_author]"},"assertionId":"b71022ebaa812b187e3d7904630596079907622bfdf806f5bbb542e9fb5da946:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.528Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b71022ebaa812b187e3d7904630596079907622bfdf806f5bbb542e9fb5da946","sourceUrl":"https://arxiv.org/abs/2610.39614","contentSha256":"967cf97a3249ac7a67f07a9e776d997de72a96e138eb3c203d34a560f0cb287a","textHash":"0f5c0be8bc26703f7d609914d1757441820c24ec6f7cca8c2681de19f971b4c5","observedAt":"2026-11-11T08:54:07.528Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.39614","snapshotId":"b71022ebaa812b187e3d7904630596079907622bfdf806f5bbb542e9fb5da946","contentSha256":"967cf97a3249ac7a67f07a9e776d997de72a96e138eb3c203d34a560f0cb287a","textHash":"0f5c0be8bc26703f7d609914d1757441820c24ec6f7cca8c2681de19f971b4c5","observedAt":"2026-11-11T08:54:07.528Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/14c9fcc82fe4ec3b65194f1ce7893281c9990ac962f0bee25be108806bf953f0/source"}}}],"audits":[{"publicationId":"20c22bb7-b8b2-4d29-8db0-d881d60902c0","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading consistently attributes the claims to Giacomo Greco, the sole listed author. It frames them as what Greco argues or says rather than as established fact.","excerpt":"Authors:Giacomo Greco"},{"dimension":"summary","status":"uncertain","explanation":"The draft is faithful but hard to follow for a non-specialist. The lead drops the paper's precise thesis: the transformer emerges 'as the score of last-token laws.' The word 'score' then appears later without explanation. Central terms such as transformer head, softmax, attention cross-moment, untied, causal masking and Langevin steps also appear with no plain gloss or flagged tooltip. Smallest repairs: restore 'as the score of last-token laws' in the lead. Add a one-line plain-language sense of what a transformer and an attention head are. Ensure tooltips exist for score, maximum-entropy principle and causal masking.","excerpt":"We show that the transformer architecture emerges as the score of last-token laws in a natural statistical model of language"},{"dimension":"date","status":"pass","explanation":"The originalPublished date, 2026-10-29, matches the arXiv v1 submission date. The later feed date was correctly not used.","excerpt":"[Submitted on 29 Oct 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim is a close paraphrase of the abstract. 'Heuristic' is preserved for residual blocks. The closing interpretation is modest. The limitation noting that no empirical test appears in the abstract is accurate. No benefits, costs or forecasts are invented.","excerpt":"We also discuss multi-head attention, weight-tied unembedding, and a heuristic reading of residual blocks as projected Langevin steps."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified arXiv abstract page for this paper, which is the direct original source.","excerpt":null}],"createdAt":"2026-11-11T08:22:57.764Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}