{"id":"7a0924b305e68c1af5692d8a84870a416adbbdd954dd81ea5d4343b8ffe38c3a","title":"Sayash Kapoor and Arvind Narayanan argue AI agents struggle with open-ended research","argument":"The essay was published on August 5, 2026. Sayash Kapoor and Arvind Narayanan report that frontier AI agents failed to produce papers accepted by the original authors in two shadow evaluations, where agents attempted to answer research questions from unpublished AI papers. Their analysis found problems with judgment, use of available resources, response to feedback, backtracking, and following instructions. The authors distinguish these open-ended tasks, where success may not be immediately verifiable, from narrow tasks with clear measures of success.\n\nThe authors say the results are tentative and the evaluation has important limits: it covers only two papers, and expert reviewers knew the papers were AI-generated. They argue that the findings raise a larger question about whether progress on verifiable tasks can drive broad recursive self-improvement, or whether open-ended research and other bottlenecks will constrain the pace of AI progress. Their conclusion is that identifying which bottlenecks are difficult to overcome could substantially affect estimates of that pace. They plan further shadow evaluations; whether open-ended research is on the critical path to recursive self-improvement remains unresolved.","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 23, 2026; originally published August 5, 2026.","speaker":{"name":"Arvind Narayanan and Sayash Kapoor","roleAtSource":"Publisher"},"source":{"title":"AI agents can't yet do open-ended AI research","publisher":"Arvind Narayanan and Sayash Kapoor","format":"Article","url":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","publishedAt":"2026-08-05T13:49:19.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"Sayash Kapoor and Arvind Narayanan report that authors rejected both papers produced by agents in their shadow evaluations.","excerpt":"The authors unambiguously rejected both agent papers.","url":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","relationship":"Source-stated"},{"text":"The evaluations involved two papers, and the authors identify the small sample as a limitation.","excerpt":"Because we are conducting in-depth evaluations of each paper, the sample size is small (in our study, we used just two papers).","url":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","relationship":"Source-stated"},{"text":"The authors say their results are tentative and intend to continue shadow evaluations.","excerpt":"Still, these findings are tentative, and we are working to address the limitations, such as by increasing the sample size, testing with new models, and through potential scaffold improvements.","url":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","relationship":"Source-stated"},{"text":"The authors argue that whether further bottlenecks emerge and how tractable they are matters for understanding the pace of AI progress.","excerpt":"Whether we encounter further bottlenecks, and how tractable they turn out to be, will be consequential for understanding the pace of progress.","url":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Will further shadow evaluations show that poor performance on open-ended AI research is a bottleneck on the critical path to recursive self-improvement?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Sayash Kapoor and Arvind Narayanan argue AI agents struggle with open-ended research","summary":"The essay was published on August 5, 2026. Sayash Kapoor and Arvind Narayanan report that frontier AI agents failed to produce papers accepted by the original authors in two shadow evaluations, where agents attempted to answer research questions from unpublished AI papers. Their analysis found problems with judgment, use of available resources, response to feedback, backtracking, and following instructions. The authors distinguish these open-ended tasks, where success may not be immediately verifiable, from narrow tasks with clear measures of success.\n\nThe authors say the results are tentative and the evaluation has important limits: it covers only two papers, and expert reviewers knew the papers were AI-generated. They argue that the findings raise a larger question about whether progress on verifiable tasks can drive broad recursive self-improvement, or whether open-ended research and other bottlenecks will constrain the pace of AI progress. Their conclusion is that identifying which bottlenecks are difficult to overcome could substantially affect estimates of that pace. They plan further shadow evaluations; whether open-ended research is on the critical path to recursive self-improvement remains unresolved.","question":"Will further shadow evaluations show that poor performance on open-ended AI research is a bottleneck on the critical path to recursive self-improvement?","claims":[{"text":"Sayash Kapoor and Arvind Narayanan report that authors rejected both papers produced by agents in their shadow evaluations.","excerpt":"The authors unambiguously rejected both agent papers.","support":"source-stated"},{"text":"The evaluations involved two papers, and the authors identify the small sample as a limitation.","excerpt":"Because we are conducting in-depth evaluations of each paper, the sample size is small (in our study, we used just two papers).","support":"source-stated"},{"text":"The authors say their results are tentative and intend to continue shadow evaluations.","excerpt":"Still, these findings are tentative, and we are working to address the limitations, such as by increasing the sample size, testing with new models, and through potential scaffold improvements.","support":"source-stated"},{"text":"The authors argue that whether further bottlenecks emerge and how tractable they are matters for understanding the pace of AI progress.","excerpt":"Whether we encounter further bottlenecks, and how tractable they turn out to be, will be consequential for understanding the pace of progress.","support":"source-stated"}],"limitations":["Text as retrieved on October 23, 2026; originally published August 5, 2026."],"mediaId":null,"correctionReason":null,"id":"7a0924b305e68c1af5692d8a84870a416adbbdd954dd81ea5d4343b8ffe38c3a","publicationId":"b22eb2b3-af24-aac4-99fc-a6d494c79b2e","version":1,"sourceUrl":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","sourceTitle":"AI agents can't yet do open-ended AI research","publisher":"Arvind Narayanan and Sayash Kapoor","publishedAt":"2026-08-05T13:49:19.000Z","originalPublished":{"value":"2026-08-05T13:49:19.000Z","precision":"instant","basis":"backfill:feed_published"},"firstObservedAt":"2026-10-23T20:55:41.490Z","createdAt":"2026-11-06T06:33:24.661Z","historical":true,"entityIds":[],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"0afb271e6cf6c0eec639399eda4b256e8b830a3e764b26839b49e9ba084ddb43","rubricVersion":"unrecorded","provider":"vercel","model":"typesafe-ai/jev","reasonCodes":["bridge_admitted_by_model"],"confidence":0.65,"decidedAt":"2026-10-23T20:55:41.210Z"},"provenance":{"textHash":"f5656aa798e0ac05d1793e9efd24070c525d045b1a6ae211c248d371c0294fdd","observationId":"a2bee9e0eec4dbff5928f2c91dc2aab201ba2d5cc5ae2bf99205fbfd17781158","retrievedAt":"2026-10-23T20:57:35.496Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"72c963e5-cc18-0498-820d-3cd87d9fd564"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"0c39b3f0-c95f-7a9a-33a4-499fdb0ad198"}},"audit":{"status":"passed","reviewedAt":"2026-11-06T06:28:36.664Z","model":"anthropic/claude-opus-5.5"}},"canonicalUrl":"https://escapemeridian.com/readings/sayash-kapoor-and-arvind-narayanan-argue-ai-agents-struggle-7a0924b3","formats":{"html":"/readings/sayash-kapoor-and-arvind-narayanan-argue-ai-agents-struggle-7a0924b3","markdown":"/readings/sayash-kapoor-and-arvind-narayanan-argue-ai-agents-struggle-7a0924b3.md","json":"/readings/sayash-kapoor-and-arvind-narayanan-argue-ai-agents-struggle-7a0924b3.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-ai-agent","name":"AI agent","explanation":"An AI system that chooses and carries out actions toward a goal, often using software tools.","referenceUrl":"https://www.ibm.com/think/topics/ai-agents"},{"id":"term-frontier-model","name":"Frontier model","explanation":"One of the most capable AI models available at a given time; the set shifts as models improve.","referenceUrl":"https://www.gov.uk/government/publications/frontier-ai-capabilities-and-risks-discussion-paper"},{"id":"term-recursive-self-improvement","name":"Recursive self-improvement","explanation":"An AI system improving its own capabilities, such as its code, training methods or reasoning, then using the gains to improve further. Each cycle could hypothetically produce a more capable system.","referenceUrl":"https://hai.stanford.edu/what-is-recursive-self-improvement"}],"entities":[]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"7a0924b305e68c1af5692d8a84870a416adbbdd954dd81ea5d4343b8ffe38c3a","revision":"b22eb2b3-af24-aac4-99fc-a6d494c79b2e","revisionKind":"publication-id","title":"Sayash Kapoor and Arvind Narayanan argue AI agents struggle with open-ended research","url":"https://escapemeridian.com/readings/sayash-kapoor-and-arvind-narayanan-argue-ai-agents-struggle-7a0924b3"},"source":{"type":"source","id":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","revision":"f5656aa798e0ac05d1793e9efd24070c525d045b1a6ae211c248d371c0294fdd","revisionKind":"sha256-source-text","title":"AI agents can't yet do open-ended AI research","url":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"7a0924b305e68c1af5692d8a84870a416adbbdd954dd81ea5d4343b8ffe38c3a","title":"Sayash Kapoor and Arvind Narayanan argue AI agents struggle with open-ended research","argument":"The essay was published on August 5, 2026. Sayash Kapoor and Arvind Narayanan report that frontier AI agents failed to produce papers accepted by the original authors in two shadow evaluations, where agents attempted to answer research questions from unpublished AI papers. Their analysis found problems with judgment, use of available resources, response to feedback, backtracking, and following instructions. The authors distinguish these open-ended tasks, where success may not be immediately verifiable, from narrow tasks with clear measures of success.\n\nThe authors say the results are tentative and the evaluation has important limits: it covers only two papers, and expert reviewers knew the papers were AI-generated. They argue that the findings raise a larger question about whether progress on verifiable tasks can drive broad recursive self-improvement, or whether open-ended research and other bottlenecks will constrain the pace of AI progress. Their conclusion is that identifying which bottlenecks are difficult to overcome could substantially affect estimates of that pace. They plan further shadow evaluations; whether open-ended research is on the critical path to recursive self-improvement remains unresolved.","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 23, 2026; originally published August 5, 2026.","speaker":{"name":"Arvind Narayanan and Sayash Kapoor","roleAtSource":"Publisher"},"source":{"title":"AI agents can't yet do open-ended AI research","publisher":"Arvind Narayanan and Sayash Kapoor","format":"Article","url":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","publishedAt":"2026-08-05T13:49:19.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"Sayash Kapoor and Arvind Narayanan report that authors rejected both papers produced by agents in their shadow evaluations.","excerpt":"The authors unambiguously rejected both agent papers.","url":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","relationship":"Source-stated"},{"text":"The evaluations involved two papers, and the authors identify the small sample as a limitation.","excerpt":"Because we are conducting in-depth evaluations of each paper, the sample size is small (in our study, we used just two papers).","url":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","relationship":"Source-stated"},{"text":"The authors say their results are tentative and intend to continue shadow evaluations.","excerpt":"Still, these findings are tentative, and we are working to address the limitations, such as by increasing the sample size, testing with new models, and through potential scaffold improvements.","url":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","relationship":"Source-stated"},{"text":"The authors argue that whether further bottlenecks emerge and how tractable they are matters for understanding the pace of AI progress.","excerpt":"Whether we encounter further bottlenecks, and how tractable they turn out to be, will be consequential for understanding the pace of progress.","url":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Will further shadow evaluations show that poor performance on open-ended AI research is a bottleneck on the critical path to recursive self-improvement?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Sayash Kapoor and Arvind Narayanan argue AI agents struggle with open-ended research","summary":"The essay was published on August 5, 2026. Sayash Kapoor and Arvind Narayanan report that frontier AI agents failed to produce papers accepted by the original authors in two shadow evaluations, where agents attempted to answer research questions from unpublished AI papers. Their analysis found problems with judgment, use of available resources, response to feedback, backtracking, and following instructions. The authors distinguish these open-ended tasks, where success may not be immediately verifiable, from narrow tasks with clear measures of success.\n\nThe authors say the results are tentative and the evaluation has important limits: it covers only two papers, and expert reviewers knew the papers were AI-generated. They argue that the findings raise a larger question about whether progress on verifiable tasks can drive broad recursive self-improvement, or whether open-ended research and other bottlenecks will constrain the pace of AI progress. Their conclusion is that identifying which bottlenecks are difficult to overcome could substantially affect estimates of that pace. They plan further shadow evaluations; whether open-ended research is on the critical path to recursive self-improvement remains unresolved.","question":"Will further shadow evaluations show that poor performance on open-ended AI research is a bottleneck on the critical path to recursive self-improvement?","claims":[{"text":"Sayash Kapoor and Arvind Narayanan report that authors rejected both papers produced by agents in their shadow evaluations.","excerpt":"The authors unambiguously rejected both agent papers.","support":"source-stated"},{"text":"The evaluations involved two papers, and the authors identify the small sample as a limitation.","excerpt":"Because we are conducting in-depth evaluations of each paper, the sample size is small (in our study, we used just two papers).","support":"source-stated"},{"text":"The authors say their results are tentative and intend to continue shadow evaluations.","excerpt":"Still, these findings are tentative, and we are working to address the limitations, such as by increasing the sample size, testing with new models, and through potential scaffold improvements.","support":"source-stated"},{"text":"The authors argue that whether further bottlenecks emerge and how tractable they are matters for understanding the pace of AI progress.","excerpt":"Whether we encounter further bottlenecks, and how tractable they turn out to be, will be consequential for understanding the pace of progress.","support":"source-stated"}],"limitations":["Text as retrieved on October 23, 2026; originally published August 5, 2026."],"mediaId":null,"correctionReason":null,"id":"7a0924b305e68c1af5692d8a84870a416adbbdd954dd81ea5d4343b8ffe38c3a","publicationId":"b22eb2b3-af24-aac4-99fc-a6d494c79b2e","version":1,"sourceUrl":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","sourceTitle":"AI agents can't yet do open-ended AI research","publisher":"Arvind Narayanan and Sayash Kapoor","publishedAt":"2026-08-05T13:49:19.000Z","originalPublished":{"value":"2026-08-05T13:49:19.000Z","precision":"instant","basis":"backfill:feed_published"},"firstObservedAt":"2026-10-23T20:55:41.490Z","createdAt":"2026-11-06T06:33:24.661Z","historical":true,"entityIds":[],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.normaltech.ai/p/ai-agents-cant-yet-do-open-ended","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"0afb271e6cf6c0eec639399eda4b256e8b830a3e764b26839b49e9ba084ddb43","rubricVersion":"unrecorded","provider":"vercel","model":"typesafe-ai/jev","reasonCodes":["bridge_admitted_by_model"],"confidence":0.65,"decidedAt":"2026-10-23T20:55:41.210Z"},"provenance":{"textHash":"f5656aa798e0ac05d1793e9efd24070c525d045b1a6ae211c248d371c0294fdd","observationId":"a2bee9e0eec4dbff5928f2c91dc2aab201ba2d5cc5ae2bf99205fbfd17781158","retrievedAt":"2026-10-23T20:57:35.496Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"72c963e5-cc18-0498-820d-3cd87d9fd564"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"0c39b3f0-c95f-7a9a-33a4-499fdb0ad198"}},"audit":{"status":"passed","reviewedAt":"2026-11-06T06:28:36.664Z","model":"anthropic/claude-opus-5.5"}}}],"audits":[{"publicationId":"b22eb2b3-af24-aac4-99fc-a6d494c79b2e","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The publisher page is a single essay bylined Sayash Kapoor and Arvind Narayanan. The reading attributes the findings and arguments to them. The underlying paper has a longer author list, but the essay voice is theirs, so the attribution is accurate.","excerpt":"Sayash Kapoor and Arvind Narayanan\nAug 05, 2026"},{"dimension":"summary","status":"pass","explanation":"The reading leads with the actors and the finding that both agent papers were rejected. It explains shadow evaluations inline and lists the five failure areas. It keeps the verifiable versus open-ended distinction, the stated limits, and the bottleneck argument. Recursive self-improvement, AI agent and frontier AI are defined beside the reading. The question follows from the source's stated open issue.","excerpt":"though it remains to be seen if it is on the critical path to RSI"},{"dimension":"date","status":"pass","explanation":"originalPublished is 2026-08-05T13:49:19Z, which matches the dateline Aug 05, 2026, and the reading states August 5, 2026. modifiedAt equals the publication time. The reading uses no hindsight framing, and planned evaluations are reported as plans rather than outcomes. This is a publisher page, so no archive disclosure is needed.","excerpt":"Aug 05, 2026"},{"dimension":"support","status":"pass","explanation":"The source text supports every claim: both papers rejected, two-paper sample, tentative results, plans for further shadow evaluations, and the importance of bottlenecks. The reading adds no unsupported benefits or costs.","excerpt":"We plan to continue shadow evaluations on a regular basis to help answer this question."},{"dimension":"media","status":"pass","explanation":"The reading selects no media, and no verified media candidates were supplied, so selecting none is appropriate.","excerpt":null}],"createdAt":"2026-11-06T06:28:36.664Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}