{"id":"ddf310b983df49caf148247e60a492f59ab679eea73218f74d1b56fc8e4f9720","title":"METR reports time-horizon trends across AI benchmarks","argument":"Published July 14, 2025, METR compares how long AI agents can complete tasks across different benchmark domains. METR defines a 50% time horizon as the length of tasks, measured by how long human professionals take, that an agent completes autonomously with a 50% probability. Its estimates put software, math-contest and scientific-question-answering benchmarks in a similar range, with reported doubling times of 2–6 months. METR says agentic computer-use benchmarks have much shorter horizons, while self-driving has improved more slowly. It argues that the software results are not an outlier, but stresses that many estimates are noisy and some extend beyond the task lengths represented in their benchmarks. The post concludes that the evidence points to exponential or slightly super-exponential growth in the domains examined, while emphasizing that the benchmarks cover a limited range of domains and AI-strong tasks. METR says the evidence does not establish how these trends translate to real-world work, or whether domains with shorter horizons will catch up or stagnate. It identifies research on other domains and harder-to-automate skills as important for understanding potential bottlenecks to AI R&D automation and dangerous capabilities.","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 23, 2026; originally published July 14, 2025. METR says its evidence comes from benchmarks in a limited range of domains, especially those where AIs are relatively good, and that estimates are noisy. METR says it has few domains with short time horizons and does not know whether such domains will see catch-up growth or stagnation. METR says many time-horizon estimates are extrapolations beyond the task lengths in the benchmarks; such estimates may not correspond to actual task-length ranges tested.","speaker":{"name":"METR","roleAtSource":"Publisher"},"source":{"title":"How Does Time Horizon Vary Across Domains?","publisher":"METR","format":"Article","url":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","publishedAt":"2025-07-14T07:00:00.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"METR defines a 50% time horizon by task length, measured using human professionals’ completion time, and an agent’s probability of autonomous completion.","excerpt":"METR defined an AI model’s 50% time horizon as the length of tasks (measured by how long they take human professionals) that it can complete autonomously with 50% probability.","url":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","relationship":"Source-stated"},{"text":"METR reports that software, math-contest and scientific-question-answering benchmarks have similar time horizons and doubling times.","excerpt":"Coding, math contest, and QA benchmarks all show 30-200 minute+ horizons doubling every ~2-6 months","url":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","relationship":"Source-stated"},{"text":"METR says agentic computer-use horizons are much shorter than coding or math horizons, and self-driving has improved more slowly.","excerpt":"Agentic GUI tasks (OSWorld) are still ~100 × shorter than coding or math; Tesla self-driving has improved much slower than other domains.","url":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","relationship":"Source-stated"},{"text":"METR says the examined domains show exponential or super-exponential growth trends, while noting that its estimates are noisy and cover a limited range of domains.","excerpt":"We find exponential or super-exponential growth trends everywhere we look, although there is a large spread in both time horizons and growth rates.","url":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","relationship":"Source-stated"},{"text":"METR says future work on other domains with shorter horizons may help identify bottlenecks to dangerous capabilities and AI R&D automation.","excerpt":"Future work on other domains with shorter horizons may provide direct evidence about the bottlenecks to dangerous capabilities and AI R&D automation.","url":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Will time-horizon trends in domains with short horizons, or in economically important work not represented by these benchmarks, resemble the trends METR reports?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"METR reports time-horizon trends across AI benchmarks","summary":"Published July 14, 2025, METR compares how long AI agents can complete tasks across different benchmark domains. METR defines a 50% time horizon as the length of tasks, measured by how long human professionals take, that an agent completes autonomously with a 50% probability. Its estimates put software, math-contest and scientific-question-answering benchmarks in a similar range, with reported doubling times of 2–6 months. METR says agentic computer-use benchmarks have much shorter horizons, while self-driving has improved more slowly. It argues that the software results are not an outlier, but stresses that many estimates are noisy and some extend beyond the task lengths represented in their benchmarks. The post concludes that the evidence points to exponential or slightly super-exponential growth in the domains examined, while emphasizing that the benchmarks cover a limited range of domains and AI-strong tasks. METR says the evidence does not establish how these trends translate to real-world work, or whether domains with shorter horizons will catch up or stagnate. It identifies research on other domains and harder-to-automate skills as important for understanding potential bottlenecks to AI R&D automation and dangerous capabilities.","question":"Will time-horizon trends in domains with short horizons, or in economically important work not represented by these benchmarks, resemble the trends METR reports?","claims":[{"text":"METR defines a 50% time horizon by task length, measured using human professionals’ completion time, and an agent’s probability of autonomous completion.","excerpt":"METR defined an AI model’s 50% time horizon as the length of tasks (measured by how long they take human professionals) that it can complete autonomously with 50% probability.","support":"source-stated"},{"text":"METR reports that software, math-contest and scientific-question-answering benchmarks have similar time horizons and doubling times.","excerpt":"Coding, math contest, and QA benchmarks all show 30-200 minute+ horizons doubling every ~2-6 months","support":"source-stated"},{"text":"METR says agentic computer-use horizons are much shorter than coding or math horizons, and self-driving has improved more slowly.","excerpt":"Agentic GUI tasks (OSWorld) are still ~100 × shorter than coding or math; Tesla self-driving has improved much slower than other domains.","support":"source-stated"},{"text":"METR says the examined domains show exponential or super-exponential growth trends, while noting that its estimates are noisy and cover a limited range of domains.","excerpt":"We find exponential or super-exponential growth trends everywhere we look, although there is a large spread in both time horizons and growth rates.","support":"source-stated"},{"text":"METR says future work on other domains with shorter horizons may help identify bottlenecks to dangerous capabilities and AI R&D automation.","excerpt":"Future work on other domains with shorter horizons may provide direct evidence about the bottlenecks to dangerous capabilities and AI R&D automation.","support":"source-stated"}],"limitations":["Text as retrieved on October 23, 2026; originally published July 14, 2025.","METR says its evidence comes from benchmarks in a limited range of domains, especially those where AIs are relatively good, and that estimates are noisy.","METR says it has few domains with short time horizons and does not know whether such domains will see catch-up growth or stagnation.","METR says many time-horizon estimates are extrapolations beyond the task lengths in the benchmarks; such estimates may not correspond to actual task-length ranges tested."],"mediaId":null,"correctionReason":null,"id":"ddf310b983df49caf148247e60a492f59ab679eea73218f74d1b56fc8e4f9720","publicationId":"fe5f97e7-8a29-d093-b1e0-11e3c8a5f572","version":1,"sourceUrl":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","sourceTitle":"How Does Time Horizon Vary Across Domains?","publisher":"METR","publishedAt":"2025-07-14T07:00:00.000Z","originalPublished":{"value":"2025-07-14T07:00:00.000Z","precision":"instant","basis":"backfill:feed_published"},"firstObservedAt":"2026-10-18T03:27:31.440Z","createdAt":"2026-11-13T04:28:23.239Z","historical":true,"entityIds":["metr"],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"9f41e6ad35373a14974d69be2c6eba87f79d7786fb738c1e44b1826353116af7","rubricVersion":"unrecorded","provider":"vercel","model":"typesafe-ai/jev","reasonCodes":["bridge_admitted_by_model"],"confidence":0.86,"decidedAt":"2026-10-23T23:23:49.682Z"},"provenance":{"textHash":"0c284fde06c17e634605af031b640bdba6ff30969b4a0664f40928d00f37215b","observationId":"5977fab96c52ff51167dad747e76084bfd6799f6f0bdb3d7c380416bc6f3d884","retrievedAt":"2026-10-23T23:25:38.190Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"40f42800-3b94-9db3-63da-f7aea8e4ea6f"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"bcbd989c-0e01-a58f-af6f-f90900e4c53e"}},"audit":{"status":"passed","reviewedAt":"2026-11-13T04:23:40.226Z","model":"anthropic/claude-opus-5.5"}},"canonicalUrl":"https://escapemeridian.com/readings/metr-reports-time-horizon-trends-across-ai-benchmarks-ddf310b9","formats":{"html":"/readings/metr-reports-time-horizon-trends-across-ai-benchmarks-ddf310b9","markdown":"/readings/metr-reports-time-horizon-trends-across-ai-benchmarks-ddf310b9.md","json":"/readings/metr-reports-time-horizon-trends-across-ai-benchmarks-ddf310b9.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-time-horizon","name":"Time horizon","explanation":"METR's measure of AI agents' ability: the length of task, timed by how long skilled people take, that an agent completes at a set success rate.","referenceUrl":"https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/"},{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"},{"id":"term-ai-agent","name":"AI agent","explanation":"An AI system that chooses and carries out actions toward a goal, often using software tools.","referenceUrl":"https://www.ibm.com/think/topics/ai-agents"},{"id":"term-agentic","name":"Agentic AI","explanation":"AI systems that plan and carry out a series of steps toward a goal, often by using other software, rather than giving one answer.","referenceUrl":"https://developers.google.com/machine-learning/glossary#agentic"}],"entities":[{"id":"metr","name":"METR","kind":"organization","context":"METR studies what AI systems can do and how reliably they complete tasks, including work with human developers.","referenceUrls":["https://metr.org/"],"path":"/entities/metr","json":"/entities/metr.json","markdown":"/entities/metr.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"ddf310b983df49caf148247e60a492f59ab679eea73218f74d1b56fc8e4f9720","revision":"fe5f97e7-8a29-d093-b1e0-11e3c8a5f572","revisionKind":"publication-id","title":"METR reports time-horizon trends across AI benchmarks","url":"https://escapemeridian.com/readings/metr-reports-time-horizon-trends-across-ai-benchmarks-ddf310b9"},"source":{"type":"source","id":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","revision":"0c284fde06c17e634605af031b640bdba6ff30969b4a0664f40928d00f37215b","revisionKind":"sha256-source-text","title":"How Does Time Horizon Vary Across Domains?","url":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"ddf310b983df49caf148247e60a492f59ab679eea73218f74d1b56fc8e4f9720","title":"METR reports time-horizon trends across AI benchmarks","argument":"Published July 14, 2025, METR compares how long AI agents can complete tasks across different benchmark domains. METR defines a 50% time horizon as the length of tasks, measured by how long human professionals take, that an agent completes autonomously with a 50% probability. Its estimates put software, math-contest and scientific-question-answering benchmarks in a similar range, with reported doubling times of 2–6 months. METR says agentic computer-use benchmarks have much shorter horizons, while self-driving has improved more slowly. It argues that the software results are not an outlier, but stresses that many estimates are noisy and some extend beyond the task lengths represented in their benchmarks. The post concludes that the evidence points to exponential or slightly super-exponential growth in the domains examined, while emphasizing that the benchmarks cover a limited range of domains and AI-strong tasks. METR says the evidence does not establish how these trends translate to real-world work, or whether domains with shorter horizons will catch up or stagnate. It identifies research on other domains and harder-to-automate skills as important for understanding potential bottlenecks to AI R&D automation and dangerous capabilities.","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 23, 2026; originally published July 14, 2025. METR says its evidence comes from benchmarks in a limited range of domains, especially those where AIs are relatively good, and that estimates are noisy. METR says it has few domains with short time horizons and does not know whether such domains will see catch-up growth or stagnation. METR says many time-horizon estimates are extrapolations beyond the task lengths in the benchmarks; such estimates may not correspond to actual task-length ranges tested.","speaker":{"name":"METR","roleAtSource":"Publisher"},"source":{"title":"How Does Time Horizon Vary Across Domains?","publisher":"METR","format":"Article","url":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","publishedAt":"2025-07-14T07:00:00.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"METR defines a 50% time horizon by task length, measured using human professionals’ completion time, and an agent’s probability of autonomous completion.","excerpt":"METR defined an AI model’s 50% time horizon as the length of tasks (measured by how long they take human professionals) that it can complete autonomously with 50% probability.","url":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","relationship":"Source-stated"},{"text":"METR reports that software, math-contest and scientific-question-answering benchmarks have similar time horizons and doubling times.","excerpt":"Coding, math contest, and QA benchmarks all show 30-200 minute+ horizons doubling every ~2-6 months","url":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","relationship":"Source-stated"},{"text":"METR says agentic computer-use horizons are much shorter than coding or math horizons, and self-driving has improved more slowly.","excerpt":"Agentic GUI tasks (OSWorld) are still ~100 × shorter than coding or math; Tesla self-driving has improved much slower than other domains.","url":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","relationship":"Source-stated"},{"text":"METR says the examined domains show exponential or super-exponential growth trends, while noting that its estimates are noisy and cover a limited range of domains.","excerpt":"We find exponential or super-exponential growth trends everywhere we look, although there is a large spread in both time horizons and growth rates.","url":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","relationship":"Source-stated"},{"text":"METR says future work on other domains with shorter horizons may help identify bottlenecks to dangerous capabilities and AI R&D automation.","excerpt":"Future work on other domains with shorter horizons may provide direct evidence about the bottlenecks to dangerous capabilities and AI R&D automation.","url":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Will time-horizon trends in domains with short horizons, or in economically important work not represented by these benchmarks, resemble the trends METR reports?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"METR reports time-horizon trends across AI benchmarks","summary":"Published July 14, 2025, METR compares how long AI agents can complete tasks across different benchmark domains. METR defines a 50% time horizon as the length of tasks, measured by how long human professionals take, that an agent completes autonomously with a 50% probability. Its estimates put software, math-contest and scientific-question-answering benchmarks in a similar range, with reported doubling times of 2–6 months. METR says agentic computer-use benchmarks have much shorter horizons, while self-driving has improved more slowly. It argues that the software results are not an outlier, but stresses that many estimates are noisy and some extend beyond the task lengths represented in their benchmarks. The post concludes that the evidence points to exponential or slightly super-exponential growth in the domains examined, while emphasizing that the benchmarks cover a limited range of domains and AI-strong tasks. METR says the evidence does not establish how these trends translate to real-world work, or whether domains with shorter horizons will catch up or stagnate. It identifies research on other domains and harder-to-automate skills as important for understanding potential bottlenecks to AI R&D automation and dangerous capabilities.","question":"Will time-horizon trends in domains with short horizons, or in economically important work not represented by these benchmarks, resemble the trends METR reports?","claims":[{"text":"METR defines a 50% time horizon by task length, measured using human professionals’ completion time, and an agent’s probability of autonomous completion.","excerpt":"METR defined an AI model’s 50% time horizon as the length of tasks (measured by how long they take human professionals) that it can complete autonomously with 50% probability.","support":"source-stated"},{"text":"METR reports that software, math-contest and scientific-question-answering benchmarks have similar time horizons and doubling times.","excerpt":"Coding, math contest, and QA benchmarks all show 30-200 minute+ horizons doubling every ~2-6 months","support":"source-stated"},{"text":"METR says agentic computer-use horizons are much shorter than coding or math horizons, and self-driving has improved more slowly.","excerpt":"Agentic GUI tasks (OSWorld) are still ~100 × shorter than coding or math; Tesla self-driving has improved much slower than other domains.","support":"source-stated"},{"text":"METR says the examined domains show exponential or super-exponential growth trends, while noting that its estimates are noisy and cover a limited range of domains.","excerpt":"We find exponential or super-exponential growth trends everywhere we look, although there is a large spread in both time horizons and growth rates.","support":"source-stated"},{"text":"METR says future work on other domains with shorter horizons may help identify bottlenecks to dangerous capabilities and AI R&D automation.","excerpt":"Future work on other domains with shorter horizons may provide direct evidence about the bottlenecks to dangerous capabilities and AI R&D automation.","support":"source-stated"}],"limitations":["Text as retrieved on October 23, 2026; originally published July 14, 2025.","METR says its evidence comes from benchmarks in a limited range of domains, especially those where AIs are relatively good, and that estimates are noisy.","METR says it has few domains with short time horizons and does not know whether such domains will see catch-up growth or stagnation.","METR says many time-horizon estimates are extrapolations beyond the task lengths in the benchmarks; such estimates may not correspond to actual task-length ranges tested."],"mediaId":null,"correctionReason":null,"id":"ddf310b983df49caf148247e60a492f59ab679eea73218f74d1b56fc8e4f9720","publicationId":"fe5f97e7-8a29-d093-b1e0-11e3c8a5f572","version":1,"sourceUrl":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","sourceTitle":"How Does Time Horizon Vary Across Domains?","publisher":"METR","publishedAt":"2025-07-14T07:00:00.000Z","originalPublished":{"value":"2025-07-14T07:00:00.000Z","precision":"instant","basis":"backfill:feed_published"},"firstObservedAt":"2026-10-18T03:27:31.440Z","createdAt":"2026-11-13T04:28:23.239Z","historical":true,"entityIds":["metr"],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://metr.org/blog/2025-07-14-how-does-time-horizon-vary-across-domains/","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"9f41e6ad35373a14974d69be2c6eba87f79d7786fb738c1e44b1826353116af7","rubricVersion":"unrecorded","provider":"vercel","model":"typesafe-ai/jev","reasonCodes":["bridge_admitted_by_model"],"confidence":0.86,"decidedAt":"2026-10-23T23:23:49.682Z"},"provenance":{"textHash":"0c284fde06c17e634605af031b640bdba6ff30969b4a0664f40928d00f37215b","observationId":"5977fab96c52ff51167dad747e76084bfd6799f6f0bdb3d7c380416bc6f3d884","retrievedAt":"2026-10-23T23:25:38.190Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"40f42800-3b94-9db3-63da-f7aea8e4ea6f"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"bcbd989c-0e01-a58f-af6f-f90900e4c53e"}},"audit":{"status":"passed","reviewedAt":"2026-11-13T04:23:40.226Z","model":"anthropic/claude-opus-5.5"}}}],"audits":[{"publicationId":"fe5f97e7-8a29-d093-b1e0-11e3c8a5f572","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"This is a single METR blog post with its own analysis. The reading attributes its definitions, estimates and conclusions to METR throughout and does not present them as established fact.","excerpt":"We find exponential or super-exponential growth trends everywhere we look"},{"dimension":"summary","status":"pass","explanation":"The reading leads with the actor and the development, and defines the 50% time horizon in plain language. It covers the domain cluster, shorter computer-use horizons, slower self-driving progress, noise and extrapolation caveats, and the limited-domain gap. Time horizon, benchmark and agent terms are defined beside the reading. The question follows from the source's stated unknowns. Omitting the video and five-year speculation does not distort the source.","excerpt":"we don’t know whether such domains will see catch-up growth or stagnation"},{"dimension":"date","status":"pass","explanation":"The reading gives July 14, 2025, which matches the UTC day of originalPublished and the URL path. There is no hindsight framing, and forecasts are not presented as outcomes. The evidence is a publisher page, not an archive copy, so no archive disclosure is needed.","excerpt":null},{"dimension":"support","status":"pass","explanation":"Each claim matches a verbatim source passage. The 2–6 month doubling times, much shorter GUI horizons, slower self-driving progress, the exponential or slightly super-exponential trend, noisy estimates, extrapolations, the limited domains and the bottleneck framing are all source-stated. The reading invents no benefits or costs.","excerpt":"Many of the time horizons are also extrapolations beyond the actual range of task lengths found in benchmarks"},{"dimension":"media","status":"pass","explanation":"No media was selected and no verified candidates were supplied, so there is no identity or relevance problem.","excerpt":null}],"createdAt":"2026-11-13T04:23:40.226Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}