{"id":"fc11f22d32dcce8f55e8f23940bbb56b7deac1d6e48a69c2036d2d2746ae9ddd","title":"David Lopez-Paz argues truth should be judged by invariance","argument":"David Lopez-Paz argues that likelihood—the probability of an event under a model—should not decide whether a statement is true. Unlikely events happen, he notes, while frequently repeated statements can be false. He proposes judging truth by whether a statement remains invariant across relevant transformations of the environment, rather than by its probability under a single distribution. The paper connects this view to out-of-distribution generalization and invariant learning, and sketches how language models might test invariance at inference time. It also discusses implications for continual learning. The argument shifts attention from how likely a model finds a statement to whether it holds across relevant changes in context. The abstract does not establish how those transformations should be selected or whether this approach improves truth judgments in practice.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv abstract, not the paper's full argument or details of its proposed tests. The abstract does not specify which environmental transformations count as relevant or report results showing that inference-time invariance tests improve truth judgments.","speaker":{"name":"Lopez-Paz, David","roleAtSource":"Article author"},"source":{"title":"Against All Likelihood","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.09385","publishedAt":"2026-11-06","dateBasis":"Date basis not provided."},"evidence":[{"text":"Lopez-Paz argues that likelihood is neither necessary nor sufficient for truth.","excerpt":"likelihood is neither necessary nor sufficient for truth.","url":"https://arxiv.org/abs/2611.09385","relationship":"Source-stated"},{"text":"He argues that truth should be judged by invariance across relevant environmental transformations, not probability under a single distribution.","excerpt":"the truth of a statement should be judged not by its probability under a single distribution, but by its invariance across relevant transformations of the environment.","url":"https://arxiv.org/abs/2611.09385","relationship":"Source-stated"},{"text":"The paper connects its proposal to out-of-distribution generalization and invariant learning, and sketches inference-time tests with language models.","excerpt":"We connect this view to machine learning literature on out-of-distribution generalization and invariant learning, sketch how invariance could be tested at inference time with language models","url":"https://arxiv.org/abs/2611.09385","relationship":"Source-stated"},{"text":"The paper discusses implications for continual learning.","excerpt":"and discuss implications for continual learning.","url":"https://arxiv.org/abs/2611.09385","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.09385","checkedAt":"2026-11-09T07:48:06.527Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Which transformations does Lopez-Paz consider relevant, and how could invariance testing at inference time show whether a statement remains true across them?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"David Lopez-Paz argues truth should be judged by invariance","summary":"David Lopez-Paz argues that likelihood—the probability of an event under a model—should not decide whether a statement is true. Unlikely events happen, he notes, while frequently repeated statements can be false. He proposes judging truth by whether a statement remains invariant across relevant transformations of the environment, rather than by its probability under a single distribution. The paper connects this view to out-of-distribution generalization and invariant learning, and sketches how language models might test invariance at inference time. It also discusses implications for continual learning. The argument shifts attention from how likely a model finds a statement to whether it holds across relevant changes in context. The abstract does not establish how those transformations should be selected or whether this approach improves truth judgments in practice.","question":"Which transformations does Lopez-Paz consider relevant, and how could invariance testing at inference time show whether a statement remains true across them?","claims":[{"text":"Lopez-Paz argues that likelihood is neither necessary nor sufficient for truth.","excerpt":"likelihood is neither necessary nor sufficient for truth.","support":"source-stated"},{"text":"He argues that truth should be judged by invariance across relevant environmental transformations, not probability under a single distribution.","excerpt":"the truth of a statement should be judged not by its probability under a single distribution, but by its invariance across relevant transformations of the environment.","support":"source-stated"},{"text":"The paper connects its proposal to out-of-distribution generalization and invariant learning, and sketches inference-time tests with language models.","excerpt":"We connect this view to machine learning literature on out-of-distribution generalization and invariant learning, sketch how invariance could be tested at inference time with language models","support":"source-stated"},{"text":"The paper discusses implications for continual learning.","excerpt":"and discuss implications for continual learning.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv abstract, not the paper's full argument or details of its proposed tests.","The abstract does not specify which environmental transformations count as relevant or report results showing that inference-time invariance tests improve truth judgments."],"mediaId":"890bbfaca98a14763db9d2ef16edf43f0111656a3bc0c6bc82c93fb20a152461","correctionReason":null,"id":"fc11f22d32dcce8f55e8f23940bbb56b7deac1d6e48a69c2036d2d2746ae9ddd","publicationId":"563c22ec-b54f-4c9c-88d1-6236e93a9a5d","version":1,"sourceUrl":"https://arxiv.org/abs/2611.09385","sourceTitle":"Against All Likelihood","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-06","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-09T05:07:22.903Z","createdAt":"2026-11-09T07:16:33.158Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"890bbfaca98a14763db9d2ef16edf43f0111656a3bc0c6bc82c93fb20a152461","kind":"article","url":"https://arxiv.org/abs/2611.09385","sourceUrl":"https://arxiv.org/abs/2611.09385","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T06:46:34.820Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.09385","checkedAt":"2026-11-09T07:48:06.527Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v5","mediaId":"890bbfaca98a14763db9d2ef16edf43f0111656a3bc0c6bc82c93fb20a152461","confidence":0.71,"provider":"typesafe","model":"jev-1.13.0","inputHash":"ef2313c160105c6a94e6c0b6213a445a54a4d95c96d7080008267dc065207d7b","decidedAt":"2026-11-09T06:46:36.422Z"},"provenance":{"textHash":"51daf788cef70087ac8749ec1152c0d3700f0166e89b9256d1bfb1c8260bd86c","observationId":"e4cd6559d1d2b1e87bf2c4918453513eeb5a6b9b9d6d22cfcf3d010165b6f028","retrievedAt":"2026-11-09T06:46:34.569Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"651c716f-9499-43eb-8c31-4fefb080a77c"},"reviewer":{"model":"gpt-6-luna","runId":"b316e19f-241f-4603-8827-ad6161054bd1"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T07:16:33.158Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Lopez-Paz, David","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Lopez-Paz, David","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Lopez-Paz, David","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.09385","locator":"head/meta[name=author|citation_author]"},"assertionId":"25e08ba21e09f42bd6021b23fe31a00d5839f535f287c82b89618556819b09d8:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T07:48:06.527Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"25e08ba21e09f42bd6021b23fe31a00d5839f535f287c82b89618556819b09d8","sourceUrl":"https://arxiv.org/abs/2611.09385","contentSha256":"1646d121ac870d9530823883dab1078670dde94b4ccd14c935787958fba689dc","textHash":"51daf788cef70087ac8749ec1152c0d3700f0166e89b9256d1bfb1c8260bd86c","observedAt":"2026-11-09T07:48:06.527Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.09385","snapshotId":"25e08ba21e09f42bd6021b23fe31a00d5839f535f287c82b89618556819b09d8","contentSha256":"1646d121ac870d9530823883dab1078670dde94b4ccd14c935787958fba689dc","textHash":"51daf788cef70087ac8749ec1152c0d3700f0166e89b9256d1bfb1c8260bd86c","observedAt":"2026-11-09T07:48:06.527Z","basis":"publisher-page-metadata","sourceLinks":39,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/fc11f22d32dcce8f55e8f23940bbb56b7deac1d6e48a69c2036d2d2746ae9ddd/source"}},"canonicalUrl":"https://escapemeridian.com/readings/david-lopez-paz-argues-truth-should-be-judged-by-invariance-fc11f22d","formats":{"html":"/readings/david-lopez-paz-argues-truth-should-be-judged-by-invariance-fc11f22d","markdown":"/readings/david-lopez-paz-argues-truth-should-be-judged-by-invariance-fc11f22d.md","json":"/readings/david-lopez-paz-argues-truth-should-be-judged-by-invariance-fc11f22d.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-distribution-shift","name":"Distribution shift","explanation":"A change between the data a model was trained on and the data it meets in use, which can lower its accuracy.","referenceUrl":"https://en.wikipedia.org/wiki/Domain_adaptation"},{"id":"term-continual-learning","name":"Continual learning","explanation":"A model improving from new experience after deployment, the way a new employee learns on the job, without full retraining.","referenceUrl":"https://en.wikipedia.org/wiki/Incremental_learning"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"},{"id":"time","name":"TIME","kind":"organization","context":"TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.","referenceUrls":["https://time.com/"],"path":"/entities/time","json":"/entities/time.json","markdown":"/entities/time.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"fc11f22d32dcce8f55e8f23940bbb56b7deac1d6e48a69c2036d2d2746ae9ddd","revision":"563c22ec-b54f-4c9c-88d1-6236e93a9a5d","revisionKind":"publication-id","title":"David Lopez-Paz argues truth should be judged by invariance","url":"https://escapemeridian.com/readings/david-lopez-paz-argues-truth-should-be-judged-by-invariance-fc11f22d"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.09385","revision":"51daf788cef70087ac8749ec1152c0d3700f0166e89b9256d1bfb1c8260bd86c","revisionKind":"sha256-source-text","title":"Against All Likelihood","url":"https://arxiv.org/abs/2611.09385"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"fc11f22d32dcce8f55e8f23940bbb56b7deac1d6e48a69c2036d2d2746ae9ddd","title":"David Lopez-Paz argues truth should be judged by invariance","argument":"David Lopez-Paz argues that likelihood—the probability of an event under a model—should not decide whether a statement is true. Unlikely events happen, he notes, while frequently repeated statements can be false. He proposes judging truth by whether a statement remains invariant across relevant transformations of the environment, rather than by its probability under a single distribution. The paper connects this view to out-of-distribution generalization and invariant learning, and sketches how language models might test invariance at inference time. It also discusses implications for continual learning. The argument shifts attention from how likely a model finds a statement to whether it holds across relevant changes in context. The abstract does not establish how those transformations should be selected or whether this approach improves truth judgments in practice.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv abstract, not the paper's full argument or details of its proposed tests. The abstract does not specify which environmental transformations count as relevant or report results showing that inference-time invariance tests improve truth judgments.","speaker":{"name":"Lopez-Paz, David","roleAtSource":"Article author"},"source":{"title":"Against All Likelihood","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.09385","publishedAt":"2026-11-06","dateBasis":"Date basis not provided."},"evidence":[{"text":"Lopez-Paz argues that likelihood is neither necessary nor sufficient for truth.","excerpt":"likelihood is neither necessary nor sufficient for truth.","url":"https://arxiv.org/abs/2611.09385","relationship":"Source-stated"},{"text":"He argues that truth should be judged by invariance across relevant environmental transformations, not probability under a single distribution.","excerpt":"the truth of a statement should be judged not by its probability under a single distribution, but by its invariance across relevant transformations of the environment.","url":"https://arxiv.org/abs/2611.09385","relationship":"Source-stated"},{"text":"The paper connects its proposal to out-of-distribution generalization and invariant learning, and sketches inference-time tests with language models.","excerpt":"We connect this view to machine learning literature on out-of-distribution generalization and invariant learning, sketch how invariance could be tested at inference time with language models","url":"https://arxiv.org/abs/2611.09385","relationship":"Source-stated"},{"text":"The paper discusses implications for continual learning.","excerpt":"and discuss implications for continual learning.","url":"https://arxiv.org/abs/2611.09385","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.09385","checkedAt":"2026-11-09T07:48:06.527Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Which transformations does Lopez-Paz consider relevant, and how could invariance testing at inference time show whether a statement remains true across them?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"David Lopez-Paz argues truth should be judged by invariance","summary":"David Lopez-Paz argues that likelihood—the probability of an event under a model—should not decide whether a statement is true. Unlikely events happen, he notes, while frequently repeated statements can be false. He proposes judging truth by whether a statement remains invariant across relevant transformations of the environment, rather than by its probability under a single distribution. The paper connects this view to out-of-distribution generalization and invariant learning, and sketches how language models might test invariance at inference time. It also discusses implications for continual learning. The argument shifts attention from how likely a model finds a statement to whether it holds across relevant changes in context. The abstract does not establish how those transformations should be selected or whether this approach improves truth judgments in practice.","question":"Which transformations does Lopez-Paz consider relevant, and how could invariance testing at inference time show whether a statement remains true across them?","claims":[{"text":"Lopez-Paz argues that likelihood is neither necessary nor sufficient for truth.","excerpt":"likelihood is neither necessary nor sufficient for truth.","support":"source-stated"},{"text":"He argues that truth should be judged by invariance across relevant environmental transformations, not probability under a single distribution.","excerpt":"the truth of a statement should be judged not by its probability under a single distribution, but by its invariance across relevant transformations of the environment.","support":"source-stated"},{"text":"The paper connects its proposal to out-of-distribution generalization and invariant learning, and sketches inference-time tests with language models.","excerpt":"We connect this view to machine learning literature on out-of-distribution generalization and invariant learning, sketch how invariance could be tested at inference time with language models","support":"source-stated"},{"text":"The paper discusses implications for continual learning.","excerpt":"and discuss implications for continual learning.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv abstract, not the paper's full argument or details of its proposed tests.","The abstract does not specify which environmental transformations count as relevant or report results showing that inference-time invariance tests improve truth judgments."],"mediaId":"890bbfaca98a14763db9d2ef16edf43f0111656a3bc0c6bc82c93fb20a152461","correctionReason":null,"id":"fc11f22d32dcce8f55e8f23940bbb56b7deac1d6e48a69c2036d2d2746ae9ddd","publicationId":"563c22ec-b54f-4c9c-88d1-6236e93a9a5d","version":1,"sourceUrl":"https://arxiv.org/abs/2611.09385","sourceTitle":"Against All Likelihood","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-06","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-09T05:07:22.903Z","createdAt":"2026-11-09T07:16:33.158Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"890bbfaca98a14763db9d2ef16edf43f0111656a3bc0c6bc82c93fb20a152461","kind":"article","url":"https://arxiv.org/abs/2611.09385","sourceUrl":"https://arxiv.org/abs/2611.09385","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T06:46:34.820Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.09385","checkedAt":"2026-11-09T07:48:06.527Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v5","mediaId":"890bbfaca98a14763db9d2ef16edf43f0111656a3bc0c6bc82c93fb20a152461","confidence":0.71,"provider":"typesafe","model":"jev-1.13.0","inputHash":"ef2313c160105c6a94e6c0b6213a445a54a4d95c96d7080008267dc065207d7b","decidedAt":"2026-11-09T06:46:36.422Z"},"provenance":{"textHash":"51daf788cef70087ac8749ec1152c0d3700f0166e89b9256d1bfb1c8260bd86c","observationId":"e4cd6559d1d2b1e87bf2c4918453513eeb5a6b9b9d6d22cfcf3d010165b6f028","retrievedAt":"2026-11-09T06:46:34.569Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"651c716f-9499-43eb-8c31-4fefb080a77c"},"reviewer":{"model":"gpt-6-luna","runId":"b316e19f-241f-4603-8827-ad6161054bd1"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T07:16:33.158Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Lopez-Paz, David","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Lopez-Paz, David","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Lopez-Paz, David","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.09385","locator":"head/meta[name=author|citation_author]"},"assertionId":"25e08ba21e09f42bd6021b23fe31a00d5839f535f287c82b89618556819b09d8:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T07:48:06.527Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"25e08ba21e09f42bd6021b23fe31a00d5839f535f287c82b89618556819b09d8","sourceUrl":"https://arxiv.org/abs/2611.09385","contentSha256":"1646d121ac870d9530823883dab1078670dde94b4ccd14c935787958fba689dc","textHash":"51daf788cef70087ac8749ec1152c0d3700f0166e89b9256d1bfb1c8260bd86c","observedAt":"2026-11-09T07:48:06.527Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.09385","snapshotId":"25e08ba21e09f42bd6021b23fe31a00d5839f535f287c82b89618556819b09d8","contentSha256":"1646d121ac870d9530823883dab1078670dde94b4ccd14c935787958fba689dc","textHash":"51daf788cef70087ac8749ec1152c0d3700f0166e89b9256d1bfb1c8260bd86c","observedAt":"2026-11-09T07:48:06.527Z","basis":"publisher-page-metadata","sourceLinks":39,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/fc11f22d32dcce8f55e8f23940bbb56b7deac1d6e48a69c2036d2d2746ae9ddd/source"}}}],"audits":[{"publicationId":"563c22ec-b54f-4c9c-88d1-6236e93a9a5d","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The arXiv page lists David Lopez-Paz as the sole author. Attributing the paper's \"we argue\" thesis to him is accurate, and the reading presents it as his argument rather than as established fact.","excerpt":"Authors:David Lopez-Paz"},{"dimension":"summary","status":"uncertain","explanation":"The reading leaves out the abstract's opening premise: maximum likelihood is the dominant training principle for large language models. Without it, a general reader cannot see why the argument matters for AI. It also drops the philosophical grounding (Nozick, Wigner, Poincaré, Cassirer). Several central terms are unexplained: out-of-distribution generalization, invariant learning, inference time and continual learning. They need tooltips. Paraphrasing 'environment' as 'context' blurs the source's term. Smallest repair: add the sentence about maximum likelihood being the dominant LLM training principle, and keep 'environment'.","excerpt":"Maximum likelihood is the dominant training principle for large language models, yet likelihood is neither necessary nor sufficient for truth."},{"dimension":"date","status":"pass","explanation":"originalPublished is 2026-11-06, which matches the v1 submission date on arXiv. The feed date of 2026-11-09 is later and correctly not used.","excerpt":"[Submitted on 6 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim matches the abstract verbatim. The limitations correctly note that only the abstract was supplied, with no specified transformations and no reported results. The question follows from those gaps and does not assume benefits.","excerpt":"sketch how invariance could be tested at inference time with language models, and discuss implications for continual learning."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page, which is the source itself.","excerpt":null}],"createdAt":"2026-11-09T07:16:33.158Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}