{"id":"e3b6ff165011e132e5667903878e59681a12ccca80931a5ba7b210b86039244c","title":"arXiv cs.AI: Grading Executable Legal Rules Against Independent Records","argument":"In an arXiv paper, Jinhyung Bae argues that legal programs can appear more accurate when judged against an answer written by someone who read the same law, rather than against records of what happened. The paper introduces LexTemporis, which grades programs for Korean SME status against company disclosures and the versions of rules in force at the relevant times. Bae reports that a transitional provision outside the main statutory text raises agreement with those disclosures from 83–86% to 89–90%. The disclosures also favor Bae’s reading of a contested provision in 130 of 189 firm-years where interpretations differ. Four LLMs wrote programs using different selections of law; a pre-registered comparison found no condition best across all four. In exploratory analyses, the apparent benefit of supplying the right provisions was smaller when programs were graded against records rather than Bae’s reading, for three models. The paper cautions that grading against a grader’s own reading can overstate how well legal programs work. Its evidence centers on Korean SME disclosures; the abstract also says an appendix adds comparison cases from US income tax and German hospital minimum volumes.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv page and abstract, not the paper's full methods or results; the reported comparisons cannot be assessed in greater detail here. The abstract says comparison cases from US income tax and German hospital minimum volumes are in an appendix but does not report their findings.","speaker":{"name":"Bae, Jinhyung","roleAtSource":"Article author"},"source":{"title":"Grading Executable Legal Rules Against Independent Records: Transitional Provisions and Korean SME Status","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.24055","publishedAt":"2026-11-18","dateBasis":"Date basis not provided."},"evidence":[{"text":"The paper argues that grading legal programs against an answer based on the same law can reward agreement with the grader’s interpretation rather than correctness against what happened.","excerpt":"a program can score well by sharing the grader's reading rather than by getting the law right","url":"https://arxiv.org/abs/2611.24055","relationship":"Source-stated"},{"text":"LexTemporis grades programs for Korean SME status against company disclosures and the versions of the governing rules.","excerpt":"10,901 firm-years of SME status disclosed by Korean listed companies, with every version of the governing rules","url":"https://arxiv.org/abs/2611.24055","relationship":"Source-stated"},{"text":"The paper reports that a transitional provision raises agreement with disclosures from 83–86% to 89–90%.","excerpt":"one transitional provision raises agreement with the disclosures from 83-86% to 89-90%","url":"https://arxiv.org/abs/2611.24055","relationship":"Source-stated"},{"text":"Disclosures favor the author's reading of a contested provision in 130 of 189 firm-years where readings diverge.","excerpt":"favouring it in 130 of 189 firm-years where readings diverge","url":"https://arxiv.org/abs/2611.24055","relationship":"Source-stated"},{"text":"A pre-registered comparison found no condition better across all four LLMs that wrote the legal rules.","excerpt":"A pre-registered comparison finds no condition better across all four models.","url":"https://arxiv.org/abs/2611.24055","relationship":"Source-stated"},{"text":"In exploratory analyses, the apparent advantage of supplying the right provisions shrinks for three models when grading uses records instead of the author's reading.","excerpt":"the advantage shrinks for three models","url":"https://arxiv.org/abs/2611.24055","relationship":"Source-stated"},{"text":"The paper concludes that grading legal programs against a grader's own reading can overstate their performance.","excerpt":"Grading legal programs against the grader's own reading can overstate how well they work.","url":"https://arxiv.org/abs/2611.24055","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.24055","checkedAt":"2026-11-19T06:34:09.776Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What findings does the appendix report from the US income tax and German hospital minimum-volume comparison cases?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Grading Executable Legal Rules Against Independent Records","summary":"In an arXiv paper, Jinhyung Bae argues that legal programs can appear more accurate when judged against an answer written by someone who read the same law, rather than against records of what happened. The paper introduces LexTemporis, which grades programs for Korean SME status against company disclosures and the versions of rules in force at the relevant times. Bae reports that a transitional provision outside the main statutory text raises agreement with those disclosures from 83–86% to 89–90%. The disclosures also favor Bae’s reading of a contested provision in 130 of 189 firm-years where interpretations differ. Four LLMs wrote programs using different selections of law; a pre-registered comparison found no condition best across all four. In exploratory analyses, the apparent benefit of supplying the right provisions was smaller when programs were graded against records rather than Bae’s reading, for three models. The paper cautions that grading against a grader’s own reading can overstate how well legal programs work. Its evidence centers on Korean SME disclosures; the abstract also says an appendix adds comparison cases from US income tax and German hospital minimum volumes.","question":"What findings does the appendix report from the US income tax and German hospital minimum-volume comparison cases?","claims":[{"text":"The paper argues that grading legal programs against an answer based on the same law can reward agreement with the grader’s interpretation rather than correctness against what happened.","excerpt":"a program can score well by sharing the grader's reading rather than by getting the law right","support":"source-stated"},{"text":"LexTemporis grades programs for Korean SME status against company disclosures and the versions of the governing rules.","excerpt":"10,901 firm-years of SME status disclosed by Korean listed companies, with every version of the governing rules","support":"source-stated"},{"text":"The paper reports that a transitional provision raises agreement with disclosures from 83–86% to 89–90%.","excerpt":"one transitional provision raises agreement with the disclosures from 83-86% to 89-90%","support":"source-stated"},{"text":"Disclosures favor the author's reading of a contested provision in 130 of 189 firm-years where readings diverge.","excerpt":"favouring it in 130 of 189 firm-years where readings diverge","support":"source-stated"},{"text":"A pre-registered comparison found no condition better across all four LLMs that wrote the legal rules.","excerpt":"A pre-registered comparison finds no condition better across all four models.","support":"source-stated"},{"text":"In exploratory analyses, the apparent advantage of supplying the right provisions shrinks for three models when grading uses records instead of the author's reading.","excerpt":"the advantage shrinks for three models","support":"source-stated"},{"text":"The paper concludes that grading legal programs against a grader's own reading can overstate their performance.","excerpt":"Grading legal programs against the grader's own reading can overstate how well they work.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv page and abstract, not the paper's full methods or results; the reported comparisons cannot be assessed in greater detail here.","The abstract says comparison cases from US income tax and German hospital minimum volumes are in an appendix but does not report their findings."],"mediaId":"c4bb2d7b56bfe52bf59a481f35acc3070cff905db254eaf26cc4219b36c4e00c","correctionReason":null,"id":"e3b6ff165011e132e5667903878e59681a12ccca80931a5ba7b210b86039244c","publicationId":"e46c1277-8d1c-4ed3-88b2-6f65fb592c52","version":1,"sourceUrl":"https://arxiv.org/abs/2611.24055","sourceTitle":"Grading Executable Legal Rules Against Independent Records: Transitional Provisions and Korean SME Status","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-18","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-19T05:04:09.191Z","createdAt":"2026-11-19T06:02:06.984Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"c4bb2d7b56bfe52bf59a481f35acc3070cff905db254eaf26cc4219b36c4e00c","kind":"article","url":"https://arxiv.org/abs/2611.24055","sourceUrl":"https://arxiv.org/abs/2611.24055","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-19T06:01:13.565Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.24055","checkedAt":"2026-11-19T06:34:09.776Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"c4bb2d7b56bfe52bf59a481f35acc3070cff905db254eaf26cc4219b36c4e00c","confidence":0.73,"provider":"typesafe","model":"jev-1.13.0","inputHash":"aee434b323aa1b4aa66003790fdbf71f2ad829c40210c951b647705caed8839a","decidedAt":"2026-11-19T06:01:14.324Z"},"provenance":{"textHash":"345e1dea2f4936967bfdef16e3fe3f3f8f759776082d76ae2b7df55fde86295f","observationId":"88d0cb66fc77b07909576aa8a22869761528bbbc525f1e06051bd550eb887d45","retrievedAt":"2026-11-19T06:01:13.468Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"19f8f3ad-c325-4e9a-8d9a-a8d70e848b62"},"reviewer":{"model":"gpt-6-luna","runId":"9dd70821-5ee9-493a-8eb1-ea403b767fcd"}},"audit":{"status":"passed","reviewedAt":"2026-11-19T06:02:06.984Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Bae, Jinhyung","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Bae, Jinhyung","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Bae, Jinhyung","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.24055","locator":"head/meta[name=author|citation_author]"},"assertionId":"075944d13213d39c4989f1db2115795d8c959df00f9af6ec11bbd15f36418275:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-19T06:34:09.776Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"075944d13213d39c4989f1db2115795d8c959df00f9af6ec11bbd15f36418275","sourceUrl":"https://arxiv.org/abs/2611.24055","contentSha256":"b7ffdbb3579a9c51a807136f66c4b5513f76e5e09434d875e401c6a93a560c53","textHash":"345e1dea2f4936967bfdef16e3fe3f3f8f759776082d76ae2b7df55fde86295f","observedAt":"2026-11-19T06:34:09.776Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.24055","snapshotId":"075944d13213d39c4989f1db2115795d8c959df00f9af6ec11bbd15f36418275","contentSha256":"b7ffdbb3579a9c51a807136f66c4b5513f76e5e09434d875e401c6a93a560c53","textHash":"345e1dea2f4936967bfdef16e3fe3f3f8f759776082d76ae2b7df55fde86295f","observedAt":"2026-11-19T06:34:09.776Z","basis":"publisher-page-metadata","sourceLinks":40,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/e3b6ff165011e132e5667903878e59681a12ccca80931a5ba7b210b86039244c/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-grading-executable-legal-rules-against-independent-e3b6ff16","formats":{"html":"/readings/arxiv-cs-ai-grading-executable-legal-rules-against-independent-e3b6ff16","markdown":"/readings/arxiv-cs-ai-grading-executable-legal-rules-against-independent-e3b6ff16.md","json":"/readings/arxiv-cs-ai-grading-executable-legal-rules-against-independent-e3b6ff16.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"e3b6ff165011e132e5667903878e59681a12ccca80931a5ba7b210b86039244c","revision":"e46c1277-8d1c-4ed3-88b2-6f65fb592c52","revisionKind":"publication-id","title":"arXiv cs.AI: Grading Executable Legal Rules Against Independent Records","url":"https://escapemeridian.com/readings/arxiv-cs-ai-grading-executable-legal-rules-against-independent-e3b6ff16"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.24055","revision":"345e1dea2f4936967bfdef16e3fe3f3f8f759776082d76ae2b7df55fde86295f","revisionKind":"sha256-source-text","title":"Grading Executable Legal Rules Against Independent Records: Transitional Provisions and Korean SME Status","url":"https://arxiv.org/abs/2611.24055"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"e3b6ff165011e132e5667903878e59681a12ccca80931a5ba7b210b86039244c","title":"arXiv cs.AI: Grading Executable Legal Rules Against Independent Records","argument":"In an arXiv paper, Jinhyung Bae argues that legal programs can appear more accurate when judged against an answer written by someone who read the same law, rather than against records of what happened. The paper introduces LexTemporis, which grades programs for Korean SME status against company disclosures and the versions of rules in force at the relevant times. Bae reports that a transitional provision outside the main statutory text raises agreement with those disclosures from 83–86% to 89–90%. The disclosures also favor Bae’s reading of a contested provision in 130 of 189 firm-years where interpretations differ. Four LLMs wrote programs using different selections of law; a pre-registered comparison found no condition best across all four. In exploratory analyses, the apparent benefit of supplying the right provisions was smaller when programs were graded against records rather than Bae’s reading, for three models. The paper cautions that grading against a grader’s own reading can overstate how well legal programs work. Its evidence centers on Korean SME disclosures; the abstract also says an appendix adds comparison cases from US income tax and German hospital minimum volumes.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv page and abstract, not the paper's full methods or results; the reported comparisons cannot be assessed in greater detail here. The abstract says comparison cases from US income tax and German hospital minimum volumes are in an appendix but does not report their findings.","speaker":{"name":"Bae, Jinhyung","roleAtSource":"Article author"},"source":{"title":"Grading Executable Legal Rules Against Independent Records: Transitional Provisions and Korean SME Status","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.24055","publishedAt":"2026-11-18","dateBasis":"Date basis not provided."},"evidence":[{"text":"The paper argues that grading legal programs against an answer based on the same law can reward agreement with the grader’s interpretation rather than correctness against what happened.","excerpt":"a program can score well by sharing the grader's reading rather than by getting the law right","url":"https://arxiv.org/abs/2611.24055","relationship":"Source-stated"},{"text":"LexTemporis grades programs for Korean SME status against company disclosures and the versions of the governing rules.","excerpt":"10,901 firm-years of SME status disclosed by Korean listed companies, with every version of the governing rules","url":"https://arxiv.org/abs/2611.24055","relationship":"Source-stated"},{"text":"The paper reports that a transitional provision raises agreement with disclosures from 83–86% to 89–90%.","excerpt":"one transitional provision raises agreement with the disclosures from 83-86% to 89-90%","url":"https://arxiv.org/abs/2611.24055","relationship":"Source-stated"},{"text":"Disclosures favor the author's reading of a contested provision in 130 of 189 firm-years where readings diverge.","excerpt":"favouring it in 130 of 189 firm-years where readings diverge","url":"https://arxiv.org/abs/2611.24055","relationship":"Source-stated"},{"text":"A pre-registered comparison found no condition better across all four LLMs that wrote the legal rules.","excerpt":"A pre-registered comparison finds no condition better across all four models.","url":"https://arxiv.org/abs/2611.24055","relationship":"Source-stated"},{"text":"In exploratory analyses, the apparent advantage of supplying the right provisions shrinks for three models when grading uses records instead of the author's reading.","excerpt":"the advantage shrinks for three models","url":"https://arxiv.org/abs/2611.24055","relationship":"Source-stated"},{"text":"The paper concludes that grading legal programs against a grader's own reading can overstate their performance.","excerpt":"Grading legal programs against the grader's own reading can overstate how well they work.","url":"https://arxiv.org/abs/2611.24055","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.24055","checkedAt":"2026-11-19T06:34:09.776Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What findings does the appendix report from the US income tax and German hospital minimum-volume comparison cases?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Grading Executable Legal Rules Against Independent Records","summary":"In an arXiv paper, Jinhyung Bae argues that legal programs can appear more accurate when judged against an answer written by someone who read the same law, rather than against records of what happened. The paper introduces LexTemporis, which grades programs for Korean SME status against company disclosures and the versions of rules in force at the relevant times. Bae reports that a transitional provision outside the main statutory text raises agreement with those disclosures from 83–86% to 89–90%. The disclosures also favor Bae’s reading of a contested provision in 130 of 189 firm-years where interpretations differ. Four LLMs wrote programs using different selections of law; a pre-registered comparison found no condition best across all four. In exploratory analyses, the apparent benefit of supplying the right provisions was smaller when programs were graded against records rather than Bae’s reading, for three models. The paper cautions that grading against a grader’s own reading can overstate how well legal programs work. Its evidence centers on Korean SME disclosures; the abstract also says an appendix adds comparison cases from US income tax and German hospital minimum volumes.","question":"What findings does the appendix report from the US income tax and German hospital minimum-volume comparison cases?","claims":[{"text":"The paper argues that grading legal programs against an answer based on the same law can reward agreement with the grader’s interpretation rather than correctness against what happened.","excerpt":"a program can score well by sharing the grader's reading rather than by getting the law right","support":"source-stated"},{"text":"LexTemporis grades programs for Korean SME status against company disclosures and the versions of the governing rules.","excerpt":"10,901 firm-years of SME status disclosed by Korean listed companies, with every version of the governing rules","support":"source-stated"},{"text":"The paper reports that a transitional provision raises agreement with disclosures from 83–86% to 89–90%.","excerpt":"one transitional provision raises agreement with the disclosures from 83-86% to 89-90%","support":"source-stated"},{"text":"Disclosures favor the author's reading of a contested provision in 130 of 189 firm-years where readings diverge.","excerpt":"favouring it in 130 of 189 firm-years where readings diverge","support":"source-stated"},{"text":"A pre-registered comparison found no condition better across all four LLMs that wrote the legal rules.","excerpt":"A pre-registered comparison finds no condition better across all four models.","support":"source-stated"},{"text":"In exploratory analyses, the apparent advantage of supplying the right provisions shrinks for three models when grading uses records instead of the author's reading.","excerpt":"the advantage shrinks for three models","support":"source-stated"},{"text":"The paper concludes that grading legal programs against a grader's own reading can overstate their performance.","excerpt":"Grading legal programs against the grader's own reading can overstate how well they work.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv page and abstract, not the paper's full methods or results; the reported comparisons cannot be assessed in greater detail here.","The abstract says comparison cases from US income tax and German hospital minimum volumes are in an appendix but does not report their findings."],"mediaId":"c4bb2d7b56bfe52bf59a481f35acc3070cff905db254eaf26cc4219b36c4e00c","correctionReason":null,"id":"e3b6ff165011e132e5667903878e59681a12ccca80931a5ba7b210b86039244c","publicationId":"e46c1277-8d1c-4ed3-88b2-6f65fb592c52","version":1,"sourceUrl":"https://arxiv.org/abs/2611.24055","sourceTitle":"Grading Executable Legal Rules Against Independent Records: Transitional Provisions and Korean SME Status","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-18","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-19T05:04:09.191Z","createdAt":"2026-11-19T06:02:06.984Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"c4bb2d7b56bfe52bf59a481f35acc3070cff905db254eaf26cc4219b36c4e00c","kind":"article","url":"https://arxiv.org/abs/2611.24055","sourceUrl":"https://arxiv.org/abs/2611.24055","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-19T06:01:13.565Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.24055","checkedAt":"2026-11-19T06:34:09.776Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"c4bb2d7b56bfe52bf59a481f35acc3070cff905db254eaf26cc4219b36c4e00c","confidence":0.73,"provider":"typesafe","model":"jev-1.13.0","inputHash":"aee434b323aa1b4aa66003790fdbf71f2ad829c40210c951b647705caed8839a","decidedAt":"2026-11-19T06:01:14.324Z"},"provenance":{"textHash":"345e1dea2f4936967bfdef16e3fe3f3f8f759776082d76ae2b7df55fde86295f","observationId":"88d0cb66fc77b07909576aa8a22869761528bbbc525f1e06051bd550eb887d45","retrievedAt":"2026-11-19T06:01:13.468Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"19f8f3ad-c325-4e9a-8d9a-a8d70e848b62"},"reviewer":{"model":"gpt-6-luna","runId":"9dd70821-5ee9-493a-8eb1-ea403b767fcd"}},"audit":{"status":"passed","reviewedAt":"2026-11-19T06:02:06.984Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Bae, Jinhyung","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Bae, Jinhyung","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Bae, Jinhyung","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.24055","locator":"head/meta[name=author|citation_author]"},"assertionId":"075944d13213d39c4989f1db2115795d8c959df00f9af6ec11bbd15f36418275:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-19T06:34:09.776Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"075944d13213d39c4989f1db2115795d8c959df00f9af6ec11bbd15f36418275","sourceUrl":"https://arxiv.org/abs/2611.24055","contentSha256":"b7ffdbb3579a9c51a807136f66c4b5513f76e5e09434d875e401c6a93a560c53","textHash":"345e1dea2f4936967bfdef16e3fe3f3f8f759776082d76ae2b7df55fde86295f","observedAt":"2026-11-19T06:34:09.776Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.24055","snapshotId":"075944d13213d39c4989f1db2115795d8c959df00f9af6ec11bbd15f36418275","contentSha256":"b7ffdbb3579a9c51a807136f66c4b5513f76e5e09434d875e401c6a93a560c53","textHash":"345e1dea2f4936967bfdef16e3fe3f3f8f759776082d76ae2b7df55fde86295f","observedAt":"2026-11-19T06:34:09.776Z","basis":"publisher-page-metadata","sourceLinks":40,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/e3b6ff165011e132e5667903878e59681a12ccca80931a5ba7b210b86039244c/source"}}}],"audits":[{"publicationId":"e46c1277-8d1c-4ed3-88b2-6f65fb592c52","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading attributes the paper and its arguments to Jinhyung Bae on arXiv, consistent with the author line. Findings are framed as what the paper reports, argues or cautions. LexTemporis is correctly described as the paper's grading approach. The cs.AI label matches the publisher field, and the page shows the paper cross-listed under cs.AI.","excerpt":"Authors:Jinhyung Bae"},{"dimension":"summary","status":"pass","explanation":"The reading leads with the author's thesis: legal programs graded against the grader's own reading can look better than they are. It then explains the record-based alternative and keeps the key figures, the null pre-registered result and the exploratory status. The scope caveat is preserved. Minor gaps: SME, LLM and firm-years are not expanded inline, and the 'partly by construction' nuance is omitted. Neither prevents understanding, assuming term tooltips cover SME and LLM. The question asks about the appendix findings, a genuine unknown.","excerpt":"Grading legal programs against the grader's own reading can overstate how well they work."},{"dimension":"date","status":"pass","explanation":"originalPublished 2026-11-18 matches the v1 submission date shown on the arXiv page. It is not the later feed date of 2026-11-19.","excerpt":"[Submitted on 18 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim matches the abstract: the grader-reading problem, the 10,901 firm-years, the 83–86% to 89–90% change, the 130 of 189 split, the null pre-registered result, and the shrinking advantage for three models. Describing the rule versions as 'in force at the relevant times' is a fair gloss of 'every version of the governing rules'. No unsupported benefits, costs or forecasts are added, and the limitations accurately note that the appendix findings are absent from the abstract.","excerpt":"In exploratory analyses, supplying the right provisions looks better graded against the author's reading than against the records: the advantage shrinks for three models"},{"dimension":"media","status":"pass","explanation":"The selected media ID matches the only verified candidate, which is the direct arXiv abstract page for the source. That is the most direct and relevant access point.","excerpt":null}],"createdAt":"2026-11-19T06:02:06.984Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}