{"id":"1bcf9c614007560c5c5b4294dbdf479e84f934063c2930206439d9da5268db41","title":"Epoch AI compares models on math and software capabilities","argument":"Epoch AI’s data insight was published on September 16, 2026. It compares four recent models using the Epoch Capabilities Index (ECI), a measure of model capabilities based on benchmarks, and domain-specific versions focused on math and software capabilities. Epoch AI says these versions keep the benchmark difficulty parameters from the general ECI fit and estimate each model’s capability using only benchmarks from the selected domain, so their scores can be compared with general ECI scores. The retrieved text describes the comparison method and links to data, but does not include the chart or model scores. What do the domain-specific scores show about how each model performs relative to its general ECI score?","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 24, 2026; originally published September 16, 2026. The retrieved text provides the comparison methodology and links to data, but does not include the chart or model scores, so it does not support conclusions about which models lead in each domain. The source title makes a benchmark comparison claim not detailed in the retrieved text.","speaker":{"name":"Epoch AI","roleAtSource":"Publisher"},"source":{"title":"GPT-6 Astra leads on math benchmarks, but not on software engineering","publisher":"Epoch AI","format":"Article","url":"https://epoch.ai/data-insights/astra-eci-breakdown","publishedAt":"2026-09-16T00:00:00.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"Epoch AI says it compares four recent models using the general Epoch Capabilities Index and domain-specific variants for math and software capabilities.","excerpt":"We compare four recent models (GPT-6 Astra, Claude Fable 5.1, GPT-5.6 Sol and Kimi K3) using the Epoch Capabilities Index (ECI), as well as domain-specific ECI variants meant to measure math and software capabilities.","url":"https://epoch.ai/data-insights/astra-eci-breakdown","relationship":"Source-stated"},{"text":"Epoch AI says the domain-specific scores retain difficulty parameters from the general index and estimate capability using benchmarks from one domain, allowing comparison with general ECI scores.","excerpt":"Domain-specific ECIs retain the benchmark difficulty parameters from the general ECI fit and re-estimate each model’s capability from only a subset of those benchmarks from a specific domain, making the resulting scores comparable to general ECI scores.","url":"https://epoch.ai/data-insights/astra-eci-breakdown","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://epoch.ai/data-insights/astra-eci-breakdown","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What do the domain-specific scores show about how each model performs relative to its general ECI score?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Epoch AI compares models on math and software capabilities","summary":"Epoch AI’s data insight was published on September 16, 2026. It compares four recent models using the Epoch Capabilities Index (ECI), a measure of model capabilities based on benchmarks, and domain-specific versions focused on math and software capabilities. Epoch AI says these versions keep the benchmark difficulty parameters from the general ECI fit and estimate each model’s capability using only benchmarks from the selected domain, so their scores can be compared with general ECI scores. The retrieved text describes the comparison method and links to data, but does not include the chart or model scores. What do the domain-specific scores show about how each model performs relative to its general ECI score?","question":"What do the domain-specific scores show about how each model performs relative to its general ECI score?","claims":[{"text":"Epoch AI says it compares four recent models using the general Epoch Capabilities Index and domain-specific variants for math and software capabilities.","excerpt":"We compare four recent models (GPT-6 Astra, Claude Fable 5.1, GPT-5.6 Sol and Kimi K3) using the Epoch Capabilities Index (ECI), as well as domain-specific ECI variants meant to measure math and software capabilities.","support":"source-stated"},{"text":"Epoch AI says the domain-specific scores retain difficulty parameters from the general index and estimate capability using benchmarks from one domain, allowing comparison with general ECI scores.","excerpt":"Domain-specific ECIs retain the benchmark difficulty parameters from the general ECI fit and re-estimate each model’s capability from only a subset of those benchmarks from a specific domain, making the resulting scores comparable to general ECI scores.","support":"source-stated"}],"limitations":["Text as retrieved on October 24, 2026; originally published September 16, 2026.","The retrieved text provides the comparison methodology and links to data, but does not include the chart or model scores, so it does not support conclusions about which models lead in each domain. The source title makes a benchmark comparison claim not detailed in the retrieved text."],"mediaId":null,"correctionReason":null,"id":"1bcf9c614007560c5c5b4294dbdf479e84f934063c2930206439d9da5268db41","publicationId":"e6d9f3e3-2d74-5004-9066-8a04cef7c107","version":1,"sourceUrl":"https://epoch.ai/data-insights/astra-eci-breakdown","sourceTitle":"GPT-6 Astra leads on math benchmarks, but not on software engineering","publisher":"Epoch AI","publishedAt":"2026-09-16T00:00:00.000Z","originalPublished":{"value":"2026-09-16T00:00:00.000Z","precision":"instant","basis":"backfill:feed_published"},"firstObservedAt":"2026-10-18T02:49:42.047Z","createdAt":"2026-10-29T16:58:17.729Z","historical":true,"entityIds":["epoch-ai"],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://epoch.ai/data-insights/astra-eci-breakdown","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"46ab1a865572c9396efee8427778b9b93c8ffe83e09a5bd93e71db82eaf7bdb0","rubricVersion":"unrecorded","provider":"unrecorded","model":"anthropic/claude-opus-5.5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-10-24T03:29:55.824Z"},"provenance":{"textHash":"e65714031b0e334add2e5fa6ccbe05a1712f79c4fcfac3ccf00a44d976544812","observationId":"e17e5ca562d7225262bfb7fa1890f6cc8d1fa1192c4812e2d8f4dca080695e9e","retrievedAt":"2026-10-24T03:31:35.151Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"77ee6135-8a86-fe6c-a403-e717bc676da3"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"869d4458-b601-7ce4-646f-3cb0a48e3217"}},"audit":{"status":"passed","reviewedAt":"2026-10-29T16:57:46.994Z","model":"anthropic/claude-opus-5.5"}},"canonicalUrl":"https://escapemeridian.com/readings/epoch-ai-compares-models-on-math-and-software-capabilities-1bcf9c61","formats":{"html":"/readings/epoch-ai-compares-models-on-math-and-software-capabilities-1bcf9c61","markdown":"/readings/epoch-ai-compares-models-on-math-and-software-capabilities-1bcf9c61.md","json":"/readings/epoch-ai-compares-models-on-math-and-software-capabilities-1bcf9c61.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"}],"entities":[{"id":"epoch-ai","name":"Epoch AI","kind":"organization","context":"Epoch AI studies trends in AI capability, training resources and the infrastructure behind them.","referenceUrls":["https://epoch.ai/","https://epoch.ai/data"],"path":"/entities/epoch-ai","json":"/entities/epoch-ai.json","markdown":"/entities/epoch-ai.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"1bcf9c614007560c5c5b4294dbdf479e84f934063c2930206439d9da5268db41","revision":"e6d9f3e3-2d74-5004-9066-8a04cef7c107","revisionKind":"publication-id","title":"Epoch AI compares models on math and software capabilities","url":"https://escapemeridian.com/readings/epoch-ai-compares-models-on-math-and-software-capabilities-1bcf9c61"},"source":{"type":"source","id":"https://epoch.ai/data-insights/astra-eci-breakdown","revision":"e65714031b0e334add2e5fa6ccbe05a1712f79c4fcfac3ccf00a44d976544812","revisionKind":"sha256-source-text","title":"GPT-6 Astra leads on math benchmarks, but not on software engineering","url":"https://epoch.ai/data-insights/astra-eci-breakdown"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"1bcf9c614007560c5c5b4294dbdf479e84f934063c2930206439d9da5268db41","title":"Epoch AI compares models on math and software capabilities","argument":"Epoch AI’s data insight was published on September 16, 2026. It compares four recent models using the Epoch Capabilities Index (ECI), a measure of model capabilities based on benchmarks, and domain-specific versions focused on math and software capabilities. Epoch AI says these versions keep the benchmark difficulty parameters from the general ECI fit and estimate each model’s capability using only benchmarks from the selected domain, so their scores can be compared with general ECI scores. The retrieved text describes the comparison method and links to data, but does not include the chart or model scores. What do the domain-specific scores show about how each model performs relative to its general ECI score?","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 24, 2026; originally published September 16, 2026. The retrieved text provides the comparison methodology and links to data, but does not include the chart or model scores, so it does not support conclusions about which models lead in each domain. The source title makes a benchmark comparison claim not detailed in the retrieved text.","speaker":{"name":"Epoch AI","roleAtSource":"Publisher"},"source":{"title":"GPT-6 Astra leads on math benchmarks, but not on software engineering","publisher":"Epoch AI","format":"Article","url":"https://epoch.ai/data-insights/astra-eci-breakdown","publishedAt":"2026-09-16T00:00:00.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"Epoch AI says it compares four recent models using the general Epoch Capabilities Index and domain-specific variants for math and software capabilities.","excerpt":"We compare four recent models (GPT-6 Astra, Claude Fable 5.1, GPT-5.6 Sol and Kimi K3) using the Epoch Capabilities Index (ECI), as well as domain-specific ECI variants meant to measure math and software capabilities.","url":"https://epoch.ai/data-insights/astra-eci-breakdown","relationship":"Source-stated"},{"text":"Epoch AI says the domain-specific scores retain difficulty parameters from the general index and estimate capability using benchmarks from one domain, allowing comparison with general ECI scores.","excerpt":"Domain-specific ECIs retain the benchmark difficulty parameters from the general ECI fit and re-estimate each model’s capability from only a subset of those benchmarks from a specific domain, making the resulting scores comparable to general ECI scores.","url":"https://epoch.ai/data-insights/astra-eci-breakdown","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://epoch.ai/data-insights/astra-eci-breakdown","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What do the domain-specific scores show about how each model performs relative to its general ECI score?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Epoch AI compares models on math and software capabilities","summary":"Epoch AI’s data insight was published on September 16, 2026. It compares four recent models using the Epoch Capabilities Index (ECI), a measure of model capabilities based on benchmarks, and domain-specific versions focused on math and software capabilities. Epoch AI says these versions keep the benchmark difficulty parameters from the general ECI fit and estimate each model’s capability using only benchmarks from the selected domain, so their scores can be compared with general ECI scores. The retrieved text describes the comparison method and links to data, but does not include the chart or model scores. What do the domain-specific scores show about how each model performs relative to its general ECI score?","question":"What do the domain-specific scores show about how each model performs relative to its general ECI score?","claims":[{"text":"Epoch AI says it compares four recent models using the general Epoch Capabilities Index and domain-specific variants for math and software capabilities.","excerpt":"We compare four recent models (GPT-6 Astra, Claude Fable 5.1, GPT-5.6 Sol and Kimi K3) using the Epoch Capabilities Index (ECI), as well as domain-specific ECI variants meant to measure math and software capabilities.","support":"source-stated"},{"text":"Epoch AI says the domain-specific scores retain difficulty parameters from the general index and estimate capability using benchmarks from one domain, allowing comparison with general ECI scores.","excerpt":"Domain-specific ECIs retain the benchmark difficulty parameters from the general ECI fit and re-estimate each model’s capability from only a subset of those benchmarks from a specific domain, making the resulting scores comparable to general ECI scores.","support":"source-stated"}],"limitations":["Text as retrieved on October 24, 2026; originally published September 16, 2026.","The retrieved text provides the comparison methodology and links to data, but does not include the chart or model scores, so it does not support conclusions about which models lead in each domain. The source title makes a benchmark comparison claim not detailed in the retrieved text."],"mediaId":null,"correctionReason":null,"id":"1bcf9c614007560c5c5b4294dbdf479e84f934063c2930206439d9da5268db41","publicationId":"e6d9f3e3-2d74-5004-9066-8a04cef7c107","version":1,"sourceUrl":"https://epoch.ai/data-insights/astra-eci-breakdown","sourceTitle":"GPT-6 Astra leads on math benchmarks, but not on software engineering","publisher":"Epoch AI","publishedAt":"2026-09-16T00:00:00.000Z","originalPublished":{"value":"2026-09-16T00:00:00.000Z","precision":"instant","basis":"backfill:feed_published"},"firstObservedAt":"2026-10-18T02:49:42.047Z","createdAt":"2026-10-29T16:58:17.729Z","historical":true,"entityIds":["epoch-ai"],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://epoch.ai/data-insights/astra-eci-breakdown","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"46ab1a865572c9396efee8427778b9b93c8ffe83e09a5bd93e71db82eaf7bdb0","rubricVersion":"unrecorded","provider":"unrecorded","model":"anthropic/claude-opus-5.5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-10-24T03:29:55.824Z"},"provenance":{"textHash":"e65714031b0e334add2e5fa6ccbe05a1712f79c4fcfac3ccf00a44d976544812","observationId":"e17e5ca562d7225262bfb7fa1890f6cc8d1fa1192c4812e2d8f4dca080695e9e","retrievedAt":"2026-10-24T03:31:35.151Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"77ee6135-8a86-fe6c-a403-e717bc676da3"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"869d4458-b601-7ce4-646f-3cb0a48e3217"}},"audit":{"status":"passed","reviewedAt":"2026-10-29T16:57:46.994Z","model":"anthropic/claude-opus-5.5"}}}],"audits":[{"publicationId":"e6d9f3e3-2d74-5004-9066-8a04cef7c107","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading correctly attributes the data insight and its methodology to Epoch AI, the publisher. It presents the comparison as Epoch AI's stated work.","excerpt":"We compare four recent models (GPT-6 Astra, Claude Fable 5.1, GPT-5.6 Sol and Kimi K3) using the Epoch Capabilities Index (ECI)"},{"dimension":"summary","status":"pass","explanation":"The title and summary match the retrieved text. They explain ECI as a benchmark-based capability measure and describe the math and software variants. The summary notes that the chart and scores are absent from the retrieved text, and the limitations flag the title's unsupported leadership claim. The phrase about difficulty parameters from the general fit is somewhat technical, but the comparability point is still clear. The question follows from the evidence.","excerpt":"Domain-specific ECIs retain the benchmark difficulty parameters from the general ECI fit and re-estimate each model’s capability"},{"dimension":"date","status":"pass","explanation":"The stated September 16, 2026 date matches the UTC day of evidence.originalPublished. It is consistent with the data files, which were updated Sep. 15, 2026. The related insights dated May and Sep. 1, 2026 are not used. Nothing in the reading is presented as occurring later. This is a publisher page, so no archive disclosure is needed.","excerpt":"CSV, Updated Sep. 15, 2026"},{"dimension":"support","status":"pass","explanation":"Both claims are source-stated and backed by verbatim excerpts. The reading avoids claiming results or model rankings that the retrieved text does not contain.","excerpt":"making the resulting scores comparable to general ECI scores"},{"dimension":"media","status":"pass","explanation":"No media was selected and no verified media candidates were supplied, so leaving media empty is appropriate.","excerpt":null}],"createdAt":"2026-10-29T16:57:46.994Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}