{"id":"6d451408ed0fe5aff5079b3420922e1cab4fb8c402da26e28767b6e80ea8fe80","title":"Epoch AI reports progress on AI furniture-assembly reasoning","argument":"On September 23, 2026, Epoch AI described the Furniture Assembly Benchmark (FAB), which tests whether models can spot assembly mistakes in photos using instructions and image-inspection tools. Epoch AI reports that GPT-6 Astra scored 80%, compared with 28% for Claude Opus 4.5 in November 2025. The benchmark also measures how long models take: Epoch AI says Astra had a median time of three minutes per photo, which it considers too slow for practical real-time feedback.\n\nEpoch AI presents photo-based assembly checking as a possible proxy for tasks such as car and appliance repair, while describing reliable real-time guidance as a possibility rather than a demonstrated use. The results cover 60 photos from three furniture builds, and Epoch AI says it has not measured human performance on the benchmark. It also reports no clear relationship between furniture complexity and model accuracy. These limits leave open how well the results extend to other physical tasks or to real-world repair. The benchmark measures performance on its test images; it does not establish that models can provide reliable guidance in practical settings.","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 23, 2026; originally published September 23, 2026. The benchmark covers 60 photos from three furniture builds; Epoch AI says it has not measured human performance, and the results' relevance to other physical tasks remains unclear. Epoch AI presents assembly checking as a possible proxy for other tasks, not as a demonstrated real-world repair capability.","speaker":{"name":"Epoch AI","roleAtSource":"Publisher"},"source":{"title":"AI has improved significantly at reasoning about IKEA furniture assembly","publisher":"Epoch AI","format":"Article","url":"https://epoch.ai/publications/furniture-assembly","publishedAt":"2026-09-23T00:00:00.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"Epoch AI says the Furniture Assembly Benchmark uses 60 images from three IKEA furniture builds to test whether models identify assembly mistakes and describe them.","excerpt":"The benchmark consists of 60 images spanning three different IKEA furniture builds.","url":"https://epoch.ai/publications/furniture-assembly","relationship":"Source-stated"},{"text":"Epoch AI reports GPT-6 Astra scored 80% on FAB, while Claude Opus 4.5 scored 28% in November 2025.","excerpt":"The best score in November 2025 was 28%, set by Anthropic’s Claude Opus 4.5. Just ten months later, OpenAI’s GPT-6 Astra now tops the leaderboard at 80%.","url":"https://epoch.ai/publications/furniture-assembly","relationship":"Source-stated"},{"text":"Epoch AI reports Astra's median completion time was three minutes per photo and says this is still too slow for practical real-time feedback.","excerpt":"At a median of three minutes per task, it is still a little too slow for practical real-time feedback, but it is not far off.","url":"https://epoch.ai/publications/furniture-assembly","relationship":"Source-stated"},{"text":"Epoch AI says it has not yet measured human performance on FAB and that the results' relevance to other physical tasks remains unclear.","excerpt":"We tested models on only 60 photos from three furniture builds, so it remains unclear how well these results extend to other physical tasks.","url":"https://epoch.ai/publications/furniture-assembly","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://epoch.ai/publications/furniture-assembly","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well would models perform on different furniture, with human comparisons, or in real repair settings?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Epoch AI reports progress on AI furniture-assembly reasoning","summary":"On September 23, 2026, Epoch AI described the Furniture Assembly Benchmark (FAB), which tests whether models can spot assembly mistakes in photos using instructions and image-inspection tools. Epoch AI reports that GPT-6 Astra scored 80%, compared with 28% for Claude Opus 4.5 in November 2025. The benchmark also measures how long models take: Epoch AI says Astra had a median time of three minutes per photo, which it considers too slow for practical real-time feedback.\n\nEpoch AI presents photo-based assembly checking as a possible proxy for tasks such as car and appliance repair, while describing reliable real-time guidance as a possibility rather than a demonstrated use. The results cover 60 photos from three furniture builds, and Epoch AI says it has not measured human performance on the benchmark. It also reports no clear relationship between furniture complexity and model accuracy. These limits leave open how well the results extend to other physical tasks or to real-world repair. The benchmark measures performance on its test images; it does not establish that models can provide reliable guidance in practical settings.","question":"How well would models perform on different furniture, with human comparisons, or in real repair settings?","claims":[{"text":"Epoch AI says the Furniture Assembly Benchmark uses 60 images from three IKEA furniture builds to test whether models identify assembly mistakes and describe them.","excerpt":"The benchmark consists of 60 images spanning three different IKEA furniture builds.","support":"source-stated"},{"text":"Epoch AI reports GPT-6 Astra scored 80% on FAB, while Claude Opus 4.5 scored 28% in November 2025.","excerpt":"The best score in November 2025 was 28%, set by Anthropic’s Claude Opus 4.5. Just ten months later, OpenAI’s GPT-6 Astra now tops the leaderboard at 80%.","support":"source-stated"},{"text":"Epoch AI reports Astra's median completion time was three minutes per photo and says this is still too slow for practical real-time feedback.","excerpt":"At a median of three minutes per task, it is still a little too slow for practical real-time feedback, but it is not far off.","support":"source-stated"},{"text":"Epoch AI says it has not yet measured human performance on FAB and that the results' relevance to other physical tasks remains unclear.","excerpt":"We tested models on only 60 photos from three furniture builds, so it remains unclear how well these results extend to other physical tasks.","support":"source-stated"}],"limitations":["Text as retrieved on October 23, 2026; originally published September 23, 2026.","The benchmark covers 60 photos from three furniture builds; Epoch AI says it has not measured human performance, and the results' relevance to other physical tasks remains unclear.","Epoch AI presents assembly checking as a possible proxy for other tasks, not as a demonstrated real-world repair capability."],"mediaId":null,"correctionReason":null,"id":"6d451408ed0fe5aff5079b3420922e1cab4fb8c402da26e28767b6e80ea8fe80","publicationId":"3e5830b7-f78f-9b7f-d1d3-9e8ca42d6d5b","version":1,"sourceUrl":"https://epoch.ai/publications/furniture-assembly","sourceTitle":"AI has improved significantly at reasoning about IKEA furniture assembly","publisher":"Epoch AI","publishedAt":"2026-09-23T00:00:00.000Z","originalPublished":{"value":"2026-09-23T00:00:00.000Z","precision":"instant","basis":"backfill:feed_published"},"firstObservedAt":"2026-10-18T02:43:54.812Z","createdAt":"2026-10-29T15:50:30.157Z","historical":true,"entityIds":["epoch-ai"],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://epoch.ai/publications/furniture-assembly","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"56b22dabffbae5ab0eda5d872599603d49ff8cad8b06d09fb86e0e2547993892","rubricVersion":"unrecorded","provider":"anthropic","model":"claude-opus-5-5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-10-29T15:32:07.611Z"},"provenance":{"textHash":"876a2951cabd7b19b68aa5c48941beb1b95fcbf03ef77392a025ece47aa47ab1","observationId":"e34cf06fac550ad50c9eadb84ed9a19ceab0a737f3b611ab09ee93190c60c404","retrievedAt":"2026-10-23T20:45:52.646Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"c24db156-51f6-3d56-1a7a-371e86964fdb"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"9de70eb8-63cd-80ea-534d-e8c6aacf6533"}},"audit":{"status":"passed","reviewedAt":"2026-10-29T15:50:14.765Z","model":"anthropic/claude-opus-5.5"}},"canonicalUrl":"https://escapemeridian.com/readings/epoch-ai-reports-progress-on-ai-furniture-assembly-reasoning-6d451408","formats":{"html":"/readings/epoch-ai-reports-progress-on-ai-furniture-assembly-reasoning-6d451408","markdown":"/readings/epoch-ai-reports-progress-on-ai-furniture-assembly-reasoning-6d451408.md","json":"/readings/epoch-ai-reports-progress-on-ai-furniture-assembly-reasoning-6d451408.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"}],"entities":[{"id":"epoch-ai","name":"Epoch AI","kind":"organization","context":"Epoch AI studies trends in AI capability, training resources and the infrastructure behind them.","referenceUrls":["https://epoch.ai/","https://epoch.ai/data"],"path":"/entities/epoch-ai","json":"/entities/epoch-ai.json","markdown":"/entities/epoch-ai.md"},{"id":"claude","name":"Claude","kind":"model","context":"Claude is Anthropic’s family of AI models and assistants for tasks such as writing, analysis and coding.","referenceUrls":["https://claude.com/product/overview","https://www.anthropic.com/news","https://www.anthropic.com/research/team/economics"],"path":"/entities/claude","json":"/entities/claude.json","markdown":"/entities/claude.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"6d451408ed0fe5aff5079b3420922e1cab4fb8c402da26e28767b6e80ea8fe80","revision":"3e5830b7-f78f-9b7f-d1d3-9e8ca42d6d5b","revisionKind":"publication-id","title":"Epoch AI reports progress on AI furniture-assembly reasoning","url":"https://escapemeridian.com/readings/epoch-ai-reports-progress-on-ai-furniture-assembly-reasoning-6d451408"},"source":{"type":"source","id":"https://epoch.ai/publications/furniture-assembly","revision":"876a2951cabd7b19b68aa5c48941beb1b95fcbf03ef77392a025ece47aa47ab1","revisionKind":"sha256-source-text","title":"AI has improved significantly at reasoning about IKEA furniture assembly","url":"https://epoch.ai/publications/furniture-assembly"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"6d451408ed0fe5aff5079b3420922e1cab4fb8c402da26e28767b6e80ea8fe80","title":"Epoch AI reports progress on AI furniture-assembly reasoning","argument":"On September 23, 2026, Epoch AI described the Furniture Assembly Benchmark (FAB), which tests whether models can spot assembly mistakes in photos using instructions and image-inspection tools. Epoch AI reports that GPT-6 Astra scored 80%, compared with 28% for Claude Opus 4.5 in November 2025. The benchmark also measures how long models take: Epoch AI says Astra had a median time of three minutes per photo, which it considers too slow for practical real-time feedback.\n\nEpoch AI presents photo-based assembly checking as a possible proxy for tasks such as car and appliance repair, while describing reliable real-time guidance as a possibility rather than a demonstrated use. The results cover 60 photos from three furniture builds, and Epoch AI says it has not measured human performance on the benchmark. It also reports no clear relationship between furniture complexity and model accuracy. These limits leave open how well the results extend to other physical tasks or to real-world repair. The benchmark measures performance on its test images; it does not establish that models can provide reliable guidance in practical settings.","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 23, 2026; originally published September 23, 2026. The benchmark covers 60 photos from three furniture builds; Epoch AI says it has not measured human performance, and the results' relevance to other physical tasks remains unclear. Epoch AI presents assembly checking as a possible proxy for other tasks, not as a demonstrated real-world repair capability.","speaker":{"name":"Epoch AI","roleAtSource":"Publisher"},"source":{"title":"AI has improved significantly at reasoning about IKEA furniture assembly","publisher":"Epoch AI","format":"Article","url":"https://epoch.ai/publications/furniture-assembly","publishedAt":"2026-09-23T00:00:00.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"Epoch AI says the Furniture Assembly Benchmark uses 60 images from three IKEA furniture builds to test whether models identify assembly mistakes and describe them.","excerpt":"The benchmark consists of 60 images spanning three different IKEA furniture builds.","url":"https://epoch.ai/publications/furniture-assembly","relationship":"Source-stated"},{"text":"Epoch AI reports GPT-6 Astra scored 80% on FAB, while Claude Opus 4.5 scored 28% in November 2025.","excerpt":"The best score in November 2025 was 28%, set by Anthropic’s Claude Opus 4.5. Just ten months later, OpenAI’s GPT-6 Astra now tops the leaderboard at 80%.","url":"https://epoch.ai/publications/furniture-assembly","relationship":"Source-stated"},{"text":"Epoch AI reports Astra's median completion time was three minutes per photo and says this is still too slow for practical real-time feedback.","excerpt":"At a median of three minutes per task, it is still a little too slow for practical real-time feedback, but it is not far off.","url":"https://epoch.ai/publications/furniture-assembly","relationship":"Source-stated"},{"text":"Epoch AI says it has not yet measured human performance on FAB and that the results' relevance to other physical tasks remains unclear.","excerpt":"We tested models on only 60 photos from three furniture builds, so it remains unclear how well these results extend to other physical tasks.","url":"https://epoch.ai/publications/furniture-assembly","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://epoch.ai/publications/furniture-assembly","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well would models perform on different furniture, with human comparisons, or in real repair settings?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Epoch AI reports progress on AI furniture-assembly reasoning","summary":"On September 23, 2026, Epoch AI described the Furniture Assembly Benchmark (FAB), which tests whether models can spot assembly mistakes in photos using instructions and image-inspection tools. Epoch AI reports that GPT-6 Astra scored 80%, compared with 28% for Claude Opus 4.5 in November 2025. The benchmark also measures how long models take: Epoch AI says Astra had a median time of three minutes per photo, which it considers too slow for practical real-time feedback.\n\nEpoch AI presents photo-based assembly checking as a possible proxy for tasks such as car and appliance repair, while describing reliable real-time guidance as a possibility rather than a demonstrated use. The results cover 60 photos from three furniture builds, and Epoch AI says it has not measured human performance on the benchmark. It also reports no clear relationship between furniture complexity and model accuracy. These limits leave open how well the results extend to other physical tasks or to real-world repair. The benchmark measures performance on its test images; it does not establish that models can provide reliable guidance in practical settings.","question":"How well would models perform on different furniture, with human comparisons, or in real repair settings?","claims":[{"text":"Epoch AI says the Furniture Assembly Benchmark uses 60 images from three IKEA furniture builds to test whether models identify assembly mistakes and describe them.","excerpt":"The benchmark consists of 60 images spanning three different IKEA furniture builds.","support":"source-stated"},{"text":"Epoch AI reports GPT-6 Astra scored 80% on FAB, while Claude Opus 4.5 scored 28% in November 2025.","excerpt":"The best score in November 2025 was 28%, set by Anthropic’s Claude Opus 4.5. Just ten months later, OpenAI’s GPT-6 Astra now tops the leaderboard at 80%.","support":"source-stated"},{"text":"Epoch AI reports Astra's median completion time was three minutes per photo and says this is still too slow for practical real-time feedback.","excerpt":"At a median of three minutes per task, it is still a little too slow for practical real-time feedback, but it is not far off.","support":"source-stated"},{"text":"Epoch AI says it has not yet measured human performance on FAB and that the results' relevance to other physical tasks remains unclear.","excerpt":"We tested models on only 60 photos from three furniture builds, so it remains unclear how well these results extend to other physical tasks.","support":"source-stated"}],"limitations":["Text as retrieved on October 23, 2026; originally published September 23, 2026.","The benchmark covers 60 photos from three furniture builds; Epoch AI says it has not measured human performance, and the results' relevance to other physical tasks remains unclear.","Epoch AI presents assembly checking as a possible proxy for other tasks, not as a demonstrated real-world repair capability."],"mediaId":null,"correctionReason":null,"id":"6d451408ed0fe5aff5079b3420922e1cab4fb8c402da26e28767b6e80ea8fe80","publicationId":"3e5830b7-f78f-9b7f-d1d3-9e8ca42d6d5b","version":1,"sourceUrl":"https://epoch.ai/publications/furniture-assembly","sourceTitle":"AI has improved significantly at reasoning about IKEA furniture assembly","publisher":"Epoch AI","publishedAt":"2026-09-23T00:00:00.000Z","originalPublished":{"value":"2026-09-23T00:00:00.000Z","precision":"instant","basis":"backfill:feed_published"},"firstObservedAt":"2026-10-18T02:43:54.812Z","createdAt":"2026-10-29T15:50:30.157Z","historical":true,"entityIds":["epoch-ai"],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://epoch.ai/publications/furniture-assembly","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"56b22dabffbae5ab0eda5d872599603d49ff8cad8b06d09fb86e0e2547993892","rubricVersion":"unrecorded","provider":"anthropic","model":"claude-opus-5-5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-10-29T15:32:07.611Z"},"provenance":{"textHash":"876a2951cabd7b19b68aa5c48941beb1b95fcbf03ef77392a025ece47aa47ab1","observationId":"e34cf06fac550ad50c9eadb84ed9a19ceab0a737f3b611ab09ee93190c60c404","retrievedAt":"2026-10-23T20:45:52.646Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"c24db156-51f6-3d56-1a7a-371e86964fdb"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"9de70eb8-63cd-80ea-534d-e8c6aacf6533"}},"audit":{"status":"passed","reviewedAt":"2026-10-29T15:50:14.765Z","model":"anthropic/claude-opus-5.5"}}}],"audits":[{"publicationId":"3e5830b7-f78f-9b7f-d1d3-9e8ca42d6d5b","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The benchmark, scores, timings, proxy argument and limitations are all attributed to Epoch AI, the publisher and author of the piece. Model makers are named as the source names them.","excerpt":"We created the Furniture Assembly Benchmark (FAB) to help fill this gap."},{"dimension":"summary","status":"pass","explanation":"The summary is understandable without specialist background. It explains what FAB tests, reports the score jump, and states the proxy argument and the limits. It says Epoch considers three minutes too slow; the source says 'a little too slow' and 'not far off'. That is a slight softening of tone, not a misstatement. The title and question follow from the evidence.","excerpt":"At a median of three minutes per task, it is still a little too slow for practical real-time feedback, but it is not far off."},{"dimension":"date","status":"pass","explanation":"September 23, 2026 matches the UTC calendar day of evidence.originalPublished. The source's own reference to September 2026 is consistent with that date. Nothing is presented as happening after publication. The evidence is a publisher page, so no archive disclosure is required.","excerpt":"Ten months later, in September 2026, Astra scored 80%."},{"dimension":"support","status":"pass","explanation":"Each claim is source-stated: the 60 images, the 80% versus 28% scores, the median of three minutes, the unmeasured human performance, the unclear complexity relationship and the uncertain extension to other tasks. Real-time guidance is correctly framed as Epoch's stated possibility, not a demonstrated benefit.","excerpt":"Although we have not yet measured human performance on the benchmark, we expect many of these mistakes to be challenging to find for those unfamiliar with the build."},{"dimension":"media","status":"pass","explanation":"No media was selected and no verified media candidates were supplied, so there is no identity or relevance issue.","excerpt":null}],"createdAt":"2026-10-29T15:50:14.765Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}