{"id":"89e736b2071989a001b434d099ee4d40a600bfd6d24591d73aa79464cb312e1e","title":"The Pragmatic Engineer: Harjot Gill on software factories and code reviews","argument":"Gergely Orosz of The Pragmatic Engineer describes a conversation with Harjot Gill, CodeRabbit’s founder and CEO, about building software with AI agents. Gill says he shipped over 5,000 pull requests in a month, often using agents for maintenance work such as fixing flaky tests and improving CI. Orosz presents CodeRabbit’s heavy AI spending as potentially justified when it helps the company create products it can sell, but says this is not a typical case for companies whose existing customers may not pay more for new development.\n\nGill argues that agents need ways to verify their own work. The methods he describes include formal models, simulations, emulated APIs and staged production rollouts. He expects engineers to spend less time reviewing individual agent-written pull requests and more time reviewing plans and releases. At CodeRabbit, Orosz says, engineers review releases made up of multiple pull requests.\n\nThe account describes a shift in human judgment, not its disappearance: review moves toward planning and releases, while the team monitors rollouts and holds people accountable when releases cause outages. Orosz links CodeRabbit’s high AI spending to its business and product development, rather than presenting it as a general template. He also notes Gill’s report of disturbed sleep from waking at night to nudge agents.","topicIds":["work-and-agency"],"domain":"work","claimType":"attributed reading","limits":"The account reports Gill’s and Orosz’s descriptions; it does not provide independent measurement of the reliability or quality of the software shipped. The source gives examples of verification methods but no comparative results showing how well they prevent production failures. The page summarizes a podcast conversation and links to its transcript; this reading relies on the supplied page text.","speaker":{"name":"Gergely Orosz","roleAtSource":"Article author"},"source":{"title":"Software factories and code reviews with Harjot Gill","publisher":"The Pragmatic Engineer","format":"Article","url":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","publishedAt":"2026-11-18T18:08:52+00:00","dateBasis":"Date stated by the publisher."},"evidence":[{"text":"Orosz reports that Gill shipped more than 5,000 pull requests in a month, using agents for maintenance work as well as product development.","excerpt":"Janitorial work formed a large part of his 5,000 PRs last month, pushed with agents.","url":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","relationship":"Source-stated"},{"text":"Orosz frames CodeRabbit’s AI spending as potentially justified when it helps the company build new products it can commercialize, while cautioning that CodeRabbit is not typical.","excerpt":"massive AI spend can be justified by launching new, AI-related products faster","url":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","relationship":"Source-stated"},{"text":"Gill says agents need ways to verify their own work, and the account describes methods from formal models and simulations to staged rollouts.","excerpt":"Harjot believes agents need to be “hill climbing”; they need to have ways to verify their own work","url":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","relationship":"Source-stated"},{"text":"Gill expects human review to shift from individual agent-generated pull requests toward planning and final releases; Orosz says CodeRabbit engineers review releases comprising multiple PRs.","excerpt":"Inside of CodeRabbit, engineers are reviewing releases (multiple PRs), not individual PRs.","url":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","relationship":"Source-stated"},{"text":"Orosz says Gill reports disturbed sleep from waking at night to nudge agents.","excerpt":"Harjot also reports disturbed sleep, like waking up at night to nudge his agents.","url":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","relationship":"Source-stated"}],"sourceMedia":{"status":"found","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","checkedAt":"2026-11-18T18:16:32.639Z","items":[{"type":"video","url":"https://www.youtube.com/watch?v=4Cjb7691GJ8","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","attribution":"The Pragmatic Engineer","basis":"publisher-embed","availability":"verified","verifiedAt":"2026-11-18T18:16:32.981Z"},{"type":"image","url":"https://substackcdn.com/image/fetch/$s_!jCup!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff3b0c36f-48f4-4d26-a750-244e2f6e2e66_1600x140.png","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","attribution":"The Pragmatic Engineer","basis":"publisher-embed","availability":"verified","verifiedAt":"2026-11-18T18:16:32.981Z"}],"note":"Media declared by the original publisher; availability checked separately from the editorial reading."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What evidence from CodeRabbit’s experience would show whether its verification methods keep agent-built software reliable as its output grows?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"The Pragmatic Engineer: Harjot Gill on software factories and code reviews","summary":"Gergely Orosz of The Pragmatic Engineer describes a conversation with Harjot Gill, CodeRabbit’s founder and CEO, about building software with AI agents. Gill says he shipped over 5,000 pull requests in a month, often using agents for maintenance work such as fixing flaky tests and improving CI. Orosz presents CodeRabbit’s heavy AI spending as potentially justified when it helps the company create products it can sell, but says this is not a typical case for companies whose existing customers may not pay more for new development.\n\nGill argues that agents need ways to verify their own work. The methods he describes include formal models, simulations, emulated APIs and staged production rollouts. He expects engineers to spend less time reviewing individual agent-written pull requests and more time reviewing plans and releases. At CodeRabbit, Orosz says, engineers review releases made up of multiple pull requests.\n\nThe account describes a shift in human judgment, not its disappearance: review moves toward planning and releases, while the team monitors rollouts and holds people accountable when releases cause outages. Orosz links CodeRabbit’s high AI spending to its business and product development, rather than presenting it as a general template. He also notes Gill’s report of disturbed sleep from waking at night to nudge agents.","question":"What evidence from CodeRabbit’s experience would show whether its verification methods keep agent-built software reliable as its output grows?","claims":[{"text":"Orosz reports that Gill shipped more than 5,000 pull requests in a month, using agents for maintenance work as well as product development.","excerpt":"Janitorial work formed a large part of his 5,000 PRs last month, pushed with agents.","support":"source-stated"},{"text":"Orosz frames CodeRabbit’s AI spending as potentially justified when it helps the company build new products it can commercialize, while cautioning that CodeRabbit is not typical.","excerpt":"massive AI spend can be justified by launching new, AI-related products faster","support":"source-stated"},{"text":"Gill says agents need ways to verify their own work, and the account describes methods from formal models and simulations to staged rollouts.","excerpt":"Harjot believes agents need to be “hill climbing”; they need to have ways to verify their own work","support":"source-stated"},{"text":"Gill expects human review to shift from individual agent-generated pull requests toward planning and final releases; Orosz says CodeRabbit engineers review releases comprising multiple PRs.","excerpt":"Inside of CodeRabbit, engineers are reviewing releases (multiple PRs), not individual PRs.","support":"source-stated"},{"text":"Orosz says Gill reports disturbed sleep from waking at night to nudge agents.","excerpt":"Harjot also reports disturbed sleep, like waking up at night to nudge his agents.","support":"source-stated"}],"limitations":["The account reports Gill’s and Orosz’s descriptions; it does not provide independent measurement of the reliability or quality of the software shipped.","The source gives examples of verification methods but no comparative results showing how well they prevent production failures.","The page summarizes a podcast conversation and links to its transcript; this reading relies on the supplied page text."],"mediaId":"8f48c3599f5e6e237507cb0c8a4920ec06568645733c9f60be3a8485626fd169","correctionReason":null,"id":"89e736b2071989a001b434d099ee4d40a600bfd6d24591d73aa79464cb312e1e","publicationId":"ae379562-4a0b-45fc-87c3-9fb320fad3d5","version":1,"sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","sourceTitle":"Software factories and code reviews with Harjot Gill","publisher":"The Pragmatic Engineer","publishedAt":"2026-11-18T18:08:52+00:00","originalPublished":{"value":"2026-11-18T18:08:52+00:00","precision":"instant","basis":"publisher_page"},"firstObservedAt":"2026-11-18T18:13:20.855Z","createdAt":"2026-11-18T18:17:32.041Z","historical":false,"entityIds":["pragmatic-engineer"],"topicIds":["work-and-agency"],"media":[{"id":"8f48c3599f5e6e237507cb0c8a4920ec06568645733c9f60be3a8485626fd169","kind":"article","url":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-18T18:16:32.981Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."},{"id":"f12c765378d41e9d7469e71ddbc86311290e2d0db3e580abacb1b9c7bb71285b","kind":"video","url":"https://www.youtube.com/watch?v=4Cjb7691GJ8","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","label":"Watch source","provenance":"publisher_page","verification":{"status":"verified","checkedAt":"2026-11-18T18:16:32.981Z","method":"publisher_association_and_head","contentType":"text/html","cacheUntil":1795025792981},"recommendationReason":"Observed on the acquired publisher source; availability checked."},{"id":"3ba7b22f1e745f3b3157f6e0d8b4ae5faac98eefc67962c6248df1e18f96491f","kind":"image","url":"https://substackcdn.com/image/fetch/$s_!jCup!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff3b0c36f-48f4-4d26-a750-244e2f6e2e66_1600x140.png","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","label":"View source image","provenance":"publisher_page","verification":{"status":"verified","checkedAt":"2026-11-18T18:16:32.981Z","method":"publisher_association_and_head","contentType":"image/jpeg","cacheUntil":1795026092981},"recommendationReason":"Observed on the acquired publisher source; availability checked."}],"sourceMedia":{"status":"found","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","checkedAt":"2026-11-18T18:16:32.639Z","items":[{"type":"video","url":"https://www.youtube.com/watch?v=4Cjb7691GJ8","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","attribution":"The Pragmatic Engineer","basis":"publisher-embed","availability":"verified","verifiedAt":"2026-11-18T18:16:32.981Z"},{"type":"image","url":"https://substackcdn.com/image/fetch/$s_!jCup!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff3b0c36f-48f4-4d26-a750-244e2f6e2e66_1600x140.png","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","attribution":"The Pragmatic Engineer","basis":"publisher-embed","availability":"verified","verifiedAt":"2026-11-18T18:16:32.981Z"}],"note":"Media declared by the original publisher; availability checked separately from the editorial reading."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v9","mediaId":"8f48c3599f5e6e237507cb0c8a4920ec06568645733c9f60be3a8485626fd169","confidence":0.8899999999999999,"provider":"typesafe","model":"jev-1.13.0","inputHash":"ce9a32956a6340a5e7285a3dfc239f57b5248d952afa0ebce2cf6709826f155a","decidedAt":"2026-11-18T18:16:34.851Z"},"provenance":{"textHash":"7951cbb9db08de87d25a6894bd333078395e209ed9df0fa7b41974d0744695fb","observationId":"30da4b3a89438222f31487a7db5c96281a83bfd010e3a42299d9b01866c37016","retrievedAt":"2026-11-18T18:16:32.639Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"fdbc3437-9982-4db3-8204-7ab08d7be0fb"},"reviewer":{"model":"gpt-6-luna","runId":"32a7591d-a2d9-4ea4-8552-9e101a7dcc4b"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-18T18:17:32.041Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Gergely Orosz","url":"https://substack.com/@pragmaticengineer","kind":"Person"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Gergely Orosz","url":"https://substack.com/@pragmaticengineer","kind":"Person","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gergely Orosz","status":"stated","provenance":{"basis":"article-jsonld","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","locator":"document/html[1]/body[2]/div[1]/div[4]/div[1]/script[0]@29318.author"},"assertionId":"9d67cdca4a454d493acdbc686ff802074a2bc177bd0047be42e2f24d3556e994:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T18:16:32.639Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9d67cdca4a454d493acdbc686ff802074a2bc177bd0047be42e2f24d3556e994","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","contentSha256":"24ba3077b49016c261814ddc7aaa47b2d3a1948622e5149a541a6f982884bca8","textHash":"7951cbb9db08de87d25a6894bd333078395e209ed9df0fa7b41974d0744695fb","observedAt":"2026-11-18T18:16:32.639Z"}},{"actor":{"name":"Gergely Orosz","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gergely Orosz","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","locator":"head/meta[name=author|citation_author]"},"assertionId":"9d67cdca4a454d493acdbc686ff802074a2bc177bd0047be42e2f24d3556e994:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T18:16:32.639Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9d67cdca4a454d493acdbc686ff802074a2bc177bd0047be42e2f24d3556e994","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","contentSha256":"24ba3077b49016c261814ddc7aaa47b2d3a1948622e5149a541a6f982884bca8","textHash":"7951cbb9db08de87d25a6894bd333078395e209ed9df0fa7b41974d0744695fb","observedAt":"2026-11-18T18:16:32.639Z"}},{"actor":{"name":"The Pragmatic Engineer","url":"https://newsletter.pragmaticengineer.com/","kind":"unknown","actorId":null},"role":"publisher","scope":{"kind":"publication","locator":null},"literalCredit":"The Pragmatic Engineer","status":"stated","provenance":{"basis":"article-publisher","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","locator":"document/html[1]/body[2]/div[1]/div[4]/div[1]/script[0]@29318.publisher"},"assertionId":"9d67cdca4a454d493acdbc686ff802074a2bc177bd0047be42e2f24d3556e994:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T18:16:32.639Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9d67cdca4a454d493acdbc686ff802074a2bc177bd0047be42e2f24d3556e994","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","contentSha256":"24ba3077b49016c261814ddc7aaa47b2d3a1948622e5149a541a6f982884bca8","textHash":"7951cbb9db08de87d25a6894bd333078395e209ed9df0fa7b41974d0744695fb","observedAt":"2026-11-18T18:16:32.639Z"}}],"participationCoverage":{"total":3,"returned":3,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":{"name":"The Pragmatic Engineer","url":"https://newsletter.pragmaticengineer.com/"},"sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","snapshotId":"9d67cdca4a454d493acdbc686ff802074a2bc177bd0047be42e2f24d3556e994","contentSha256":"24ba3077b49016c261814ddc7aaa47b2d3a1948622e5149a541a6f982884bca8","textHash":"7951cbb9db08de87d25a6894bd333078395e209ed9df0fa7b41974d0744695fb","observedAt":"2026-11-18T18:16:32.639Z","basis":"publisher-page-metadata","sourceLinks":129,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/89e736b2071989a001b434d099ee4d40a600bfd6d24591d73aa79464cb312e1e/source"}},"canonicalUrl":"https://escapemeridian.com/readings/the-pragmatic-engineer-harjot-gill-on-software-factories-and-89e736b2","formats":{"html":"/readings/the-pragmatic-engineer-harjot-gill-on-software-factories-and-89e736b2","markdown":"/readings/the-pragmatic-engineer-harjot-gill-on-software-factories-and-89e736b2.md","json":"/readings/the-pragmatic-engineer-harjot-gill-on-software-factories-and-89e736b2.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-ai-agent","name":"AI agent","explanation":"An AI system that chooses and carries out actions toward a goal, often using software tools.","referenceUrl":"https://www.ibm.com/think/topics/ai-agents"},{"id":"term-api","name":"API","explanation":"An application programming interface: a defined way for software to request data or actions from another system.","referenceUrl":"https://developer.mozilla.org/en-US/docs/Glossary/API"}],"entities":[{"id":"pragmatic-engineer","name":"The Pragmatic Engineer","kind":"organization","context":"The Pragmatic Engineer is Gergely Orosz's newsletter on software engineering practice, careers and the tech job market.","referenceUrls":["https://newsletter.pragmaticengineer.com/","https://newsletter.pragmaticengineer.com/feed"],"path":"/entities/pragmatic-engineer","json":"/entities/pragmatic-engineer.json","markdown":"/entities/pragmatic-engineer.md"},{"id":"time","name":"TIME","kind":"organization","context":"TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.","referenceUrls":["https://time.com/"],"path":"/entities/time","json":"/entities/time.json","markdown":"/entities/time.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"89e736b2071989a001b434d099ee4d40a600bfd6d24591d73aa79464cb312e1e","revision":"ae379562-4a0b-45fc-87c3-9fb320fad3d5","revisionKind":"publication-id","title":"The Pragmatic Engineer: Harjot Gill on software factories and code reviews","url":"https://escapemeridian.com/readings/the-pragmatic-engineer-harjot-gill-on-software-factories-and-89e736b2"},"source":{"type":"source","id":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","revision":"7951cbb9db08de87d25a6894bd333078395e209ed9df0fa7b41974d0744695fb","revisionKind":"sha256-source-text","title":"Software factories and code reviews with Harjot Gill","url":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews"},"status":"partial","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"89e736b2071989a001b434d099ee4d40a600bfd6d24591d73aa79464cb312e1e","title":"The Pragmatic Engineer: Harjot Gill on software factories and code reviews","argument":"Gergely Orosz of The Pragmatic Engineer describes a conversation with Harjot Gill, CodeRabbit’s founder and CEO, about building software with AI agents. Gill says he shipped over 5,000 pull requests in a month, often using agents for maintenance work such as fixing flaky tests and improving CI. Orosz presents CodeRabbit’s heavy AI spending as potentially justified when it helps the company create products it can sell, but says this is not a typical case for companies whose existing customers may not pay more for new development.\n\nGill argues that agents need ways to verify their own work. The methods he describes include formal models, simulations, emulated APIs and staged production rollouts. He expects engineers to spend less time reviewing individual agent-written pull requests and more time reviewing plans and releases. At CodeRabbit, Orosz says, engineers review releases made up of multiple pull requests.\n\nThe account describes a shift in human judgment, not its disappearance: review moves toward planning and releases, while the team monitors rollouts and holds people accountable when releases cause outages. Orosz links CodeRabbit’s high AI spending to its business and product development, rather than presenting it as a general template. He also notes Gill’s report of disturbed sleep from waking at night to nudge agents.","topicIds":["work-and-agency"],"domain":"work","claimType":"attributed reading","limits":"The account reports Gill’s and Orosz’s descriptions; it does not provide independent measurement of the reliability or quality of the software shipped. The source gives examples of verification methods but no comparative results showing how well they prevent production failures. The page summarizes a podcast conversation and links to its transcript; this reading relies on the supplied page text.","speaker":{"name":"Gergely Orosz","roleAtSource":"Article author"},"source":{"title":"Software factories and code reviews with Harjot Gill","publisher":"The Pragmatic Engineer","format":"Article","url":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","publishedAt":"2026-11-18T18:08:52+00:00","dateBasis":"Date stated by the publisher."},"evidence":[{"text":"Orosz reports that Gill shipped more than 5,000 pull requests in a month, using agents for maintenance work as well as product development.","excerpt":"Janitorial work formed a large part of his 5,000 PRs last month, pushed with agents.","url":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","relationship":"Source-stated"},{"text":"Orosz frames CodeRabbit’s AI spending as potentially justified when it helps the company build new products it can commercialize, while cautioning that CodeRabbit is not typical.","excerpt":"massive AI spend can be justified by launching new, AI-related products faster","url":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","relationship":"Source-stated"},{"text":"Gill says agents need ways to verify their own work, and the account describes methods from formal models and simulations to staged rollouts.","excerpt":"Harjot believes agents need to be “hill climbing”; they need to have ways to verify their own work","url":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","relationship":"Source-stated"},{"text":"Gill expects human review to shift from individual agent-generated pull requests toward planning and final releases; Orosz says CodeRabbit engineers review releases comprising multiple PRs.","excerpt":"Inside of CodeRabbit, engineers are reviewing releases (multiple PRs), not individual PRs.","url":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","relationship":"Source-stated"},{"text":"Orosz says Gill reports disturbed sleep from waking at night to nudge agents.","excerpt":"Harjot also reports disturbed sleep, like waking up at night to nudge his agents.","url":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","relationship":"Source-stated"}],"sourceMedia":{"status":"found","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","checkedAt":"2026-11-18T18:16:32.639Z","items":[{"type":"video","url":"https://www.youtube.com/watch?v=4Cjb7691GJ8","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","attribution":"The Pragmatic Engineer","basis":"publisher-embed","availability":"verified","verifiedAt":"2026-11-18T18:16:32.981Z"},{"type":"image","url":"https://substackcdn.com/image/fetch/$s_!jCup!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff3b0c36f-48f4-4d26-a750-244e2f6e2e66_1600x140.png","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","attribution":"The Pragmatic Engineer","basis":"publisher-embed","availability":"verified","verifiedAt":"2026-11-18T18:16:32.981Z"}],"note":"Media declared by the original publisher; availability checked separately from the editorial reading."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What evidence from CodeRabbit’s experience would show whether its verification methods keep agent-built software reliable as its output grows?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"The Pragmatic Engineer: Harjot Gill on software factories and code reviews","summary":"Gergely Orosz of The Pragmatic Engineer describes a conversation with Harjot Gill, CodeRabbit’s founder and CEO, about building software with AI agents. Gill says he shipped over 5,000 pull requests in a month, often using agents for maintenance work such as fixing flaky tests and improving CI. Orosz presents CodeRabbit’s heavy AI spending as potentially justified when it helps the company create products it can sell, but says this is not a typical case for companies whose existing customers may not pay more for new development.\n\nGill argues that agents need ways to verify their own work. The methods he describes include formal models, simulations, emulated APIs and staged production rollouts. He expects engineers to spend less time reviewing individual agent-written pull requests and more time reviewing plans and releases. At CodeRabbit, Orosz says, engineers review releases made up of multiple pull requests.\n\nThe account describes a shift in human judgment, not its disappearance: review moves toward planning and releases, while the team monitors rollouts and holds people accountable when releases cause outages. Orosz links CodeRabbit’s high AI spending to its business and product development, rather than presenting it as a general template. He also notes Gill’s report of disturbed sleep from waking at night to nudge agents.","question":"What evidence from CodeRabbit’s experience would show whether its verification methods keep agent-built software reliable as its output grows?","claims":[{"text":"Orosz reports that Gill shipped more than 5,000 pull requests in a month, using agents for maintenance work as well as product development.","excerpt":"Janitorial work formed a large part of his 5,000 PRs last month, pushed with agents.","support":"source-stated"},{"text":"Orosz frames CodeRabbit’s AI spending as potentially justified when it helps the company build new products it can commercialize, while cautioning that CodeRabbit is not typical.","excerpt":"massive AI spend can be justified by launching new, AI-related products faster","support":"source-stated"},{"text":"Gill says agents need ways to verify their own work, and the account describes methods from formal models and simulations to staged rollouts.","excerpt":"Harjot believes agents need to be “hill climbing”; they need to have ways to verify their own work","support":"source-stated"},{"text":"Gill expects human review to shift from individual agent-generated pull requests toward planning and final releases; Orosz says CodeRabbit engineers review releases comprising multiple PRs.","excerpt":"Inside of CodeRabbit, engineers are reviewing releases (multiple PRs), not individual PRs.","support":"source-stated"},{"text":"Orosz says Gill reports disturbed sleep from waking at night to nudge agents.","excerpt":"Harjot also reports disturbed sleep, like waking up at night to nudge his agents.","support":"source-stated"}],"limitations":["The account reports Gill’s and Orosz’s descriptions; it does not provide independent measurement of the reliability or quality of the software shipped.","The source gives examples of verification methods but no comparative results showing how well they prevent production failures.","The page summarizes a podcast conversation and links to its transcript; this reading relies on the supplied page text."],"mediaId":"8f48c3599f5e6e237507cb0c8a4920ec06568645733c9f60be3a8485626fd169","correctionReason":null,"id":"89e736b2071989a001b434d099ee4d40a600bfd6d24591d73aa79464cb312e1e","publicationId":"ae379562-4a0b-45fc-87c3-9fb320fad3d5","version":1,"sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","sourceTitle":"Software factories and code reviews with Harjot Gill","publisher":"The Pragmatic Engineer","publishedAt":"2026-11-18T18:08:52+00:00","originalPublished":{"value":"2026-11-18T18:08:52+00:00","precision":"instant","basis":"publisher_page"},"firstObservedAt":"2026-11-18T18:13:20.855Z","createdAt":"2026-11-18T18:17:32.041Z","historical":false,"entityIds":["pragmatic-engineer"],"topicIds":["work-and-agency"],"media":[{"id":"8f48c3599f5e6e237507cb0c8a4920ec06568645733c9f60be3a8485626fd169","kind":"article","url":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-18T18:16:32.981Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."},{"id":"f12c765378d41e9d7469e71ddbc86311290e2d0db3e580abacb1b9c7bb71285b","kind":"video","url":"https://www.youtube.com/watch?v=4Cjb7691GJ8","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","label":"Watch source","provenance":"publisher_page","verification":{"status":"verified","checkedAt":"2026-11-18T18:16:32.981Z","method":"publisher_association_and_head","contentType":"text/html","cacheUntil":1795025792981},"recommendationReason":"Observed on the acquired publisher source; availability checked."},{"id":"3ba7b22f1e745f3b3157f6e0d8b4ae5faac98eefc67962c6248df1e18f96491f","kind":"image","url":"https://substackcdn.com/image/fetch/$s_!jCup!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff3b0c36f-48f4-4d26-a750-244e2f6e2e66_1600x140.png","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","label":"View source image","provenance":"publisher_page","verification":{"status":"verified","checkedAt":"2026-11-18T18:16:32.981Z","method":"publisher_association_and_head","contentType":"image/jpeg","cacheUntil":1795026092981},"recommendationReason":"Observed on the acquired publisher source; availability checked."}],"sourceMedia":{"status":"found","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","checkedAt":"2026-11-18T18:16:32.639Z","items":[{"type":"video","url":"https://www.youtube.com/watch?v=4Cjb7691GJ8","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","attribution":"The Pragmatic Engineer","basis":"publisher-embed","availability":"verified","verifiedAt":"2026-11-18T18:16:32.981Z"},{"type":"image","url":"https://substackcdn.com/image/fetch/$s_!jCup!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff3b0c36f-48f4-4d26-a750-244e2f6e2e66_1600x140.png","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","attribution":"The Pragmatic Engineer","basis":"publisher-embed","availability":"verified","verifiedAt":"2026-11-18T18:16:32.981Z"}],"note":"Media declared by the original publisher; availability checked separately from the editorial reading."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v9","mediaId":"8f48c3599f5e6e237507cb0c8a4920ec06568645733c9f60be3a8485626fd169","confidence":0.8899999999999999,"provider":"typesafe","model":"jev-1.13.0","inputHash":"ce9a32956a6340a5e7285a3dfc239f57b5248d952afa0ebce2cf6709826f155a","decidedAt":"2026-11-18T18:16:34.851Z"},"provenance":{"textHash":"7951cbb9db08de87d25a6894bd333078395e209ed9df0fa7b41974d0744695fb","observationId":"30da4b3a89438222f31487a7db5c96281a83bfd010e3a42299d9b01866c37016","retrievedAt":"2026-11-18T18:16:32.639Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"fdbc3437-9982-4db3-8204-7ab08d7be0fb"},"reviewer":{"model":"gpt-6-luna","runId":"32a7591d-a2d9-4ea4-8552-9e101a7dcc4b"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-18T18:17:32.041Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Gergely Orosz","url":"https://substack.com/@pragmaticengineer","kind":"Person"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Gergely Orosz","url":"https://substack.com/@pragmaticengineer","kind":"Person","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gergely Orosz","status":"stated","provenance":{"basis":"article-jsonld","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","locator":"document/html[1]/body[2]/div[1]/div[4]/div[1]/script[0]@29318.author"},"assertionId":"9d67cdca4a454d493acdbc686ff802074a2bc177bd0047be42e2f24d3556e994:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T18:16:32.639Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9d67cdca4a454d493acdbc686ff802074a2bc177bd0047be42e2f24d3556e994","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","contentSha256":"24ba3077b49016c261814ddc7aaa47b2d3a1948622e5149a541a6f982884bca8","textHash":"7951cbb9db08de87d25a6894bd333078395e209ed9df0fa7b41974d0744695fb","observedAt":"2026-11-18T18:16:32.639Z"}},{"actor":{"name":"Gergely Orosz","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gergely Orosz","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","locator":"head/meta[name=author|citation_author]"},"assertionId":"9d67cdca4a454d493acdbc686ff802074a2bc177bd0047be42e2f24d3556e994:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T18:16:32.639Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9d67cdca4a454d493acdbc686ff802074a2bc177bd0047be42e2f24d3556e994","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","contentSha256":"24ba3077b49016c261814ddc7aaa47b2d3a1948622e5149a541a6f982884bca8","textHash":"7951cbb9db08de87d25a6894bd333078395e209ed9df0fa7b41974d0744695fb","observedAt":"2026-11-18T18:16:32.639Z"}},{"actor":{"name":"The Pragmatic Engineer","url":"https://newsletter.pragmaticengineer.com/","kind":"unknown","actorId":null},"role":"publisher","scope":{"kind":"publication","locator":null},"literalCredit":"The Pragmatic Engineer","status":"stated","provenance":{"basis":"article-publisher","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","locator":"document/html[1]/body[2]/div[1]/div[4]/div[1]/script[0]@29318.publisher"},"assertionId":"9d67cdca4a454d493acdbc686ff802074a2bc177bd0047be42e2f24d3556e994:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T18:16:32.639Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"9d67cdca4a454d493acdbc686ff802074a2bc177bd0047be42e2f24d3556e994","sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","contentSha256":"24ba3077b49016c261814ddc7aaa47b2d3a1948622e5149a541a6f982884bca8","textHash":"7951cbb9db08de87d25a6894bd333078395e209ed9df0fa7b41974d0744695fb","observedAt":"2026-11-18T18:16:32.639Z"}}],"participationCoverage":{"total":3,"returned":3,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":{"name":"The Pragmatic Engineer","url":"https://newsletter.pragmaticengineer.com/"},"sourceUrl":"https://newsletter.pragmaticengineer.com/p/software-factories-and-code-reviews","snapshotId":"9d67cdca4a454d493acdbc686ff802074a2bc177bd0047be42e2f24d3556e994","contentSha256":"24ba3077b49016c261814ddc7aaa47b2d3a1948622e5149a541a6f982884bca8","textHash":"7951cbb9db08de87d25a6894bd333078395e209ed9df0fa7b41974d0744695fb","observedAt":"2026-11-18T18:16:32.639Z","basis":"publisher-page-metadata","sourceLinks":129,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/89e736b2071989a001b434d099ee4d40a600bfd6d24591d73aa79464cb312e1e/source"}}}],"audits":[{"publicationId":"ae379562-4a0b-45fc-87c3-9fb320fad3d5","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft attributes the framing and observations to Gergely Orosz and the claims about PR counts, verification and review to Harjot Gill, CodeRabbit's founder and CEO. This matches the source.","excerpt":"Harjot Gill is founder and CEO of CodeRabbit, an AI code review business"},{"dimension":"summary","status":"uncertain","explanation":"The draft blunts Gill's central thesis. The source says he believes human code review is dead and that 'we will stop reviewing code generated by agents.' The draft says engineers will 'spend less time reviewing individual' PRs. Smallest repair: state that Gill argues human review of agent code is dead and will stop, with review moving to plans and releases. The draft also omits the $250,000-a-month personal AI spend that frames the episode. Central terms such as pull request, CI and staged rollout are not explained and need term tooltips.","excerpt":"Harjot thinks that we will stop reviewing code generated by agents."},{"dimension":"date","status":"pass","explanation":"The originalPublished date, 2026-11-18, matches the page's 'Nov 18, 2026' date and the feed entry.","excerpt":"Gergely Orosz\nNov 18, 2026"},{"dimension":"support","status":"uncertain","explanation":"The claims and excerpts are source-grounded. One synthesis line says 'the team monitors rollouts.' The source says an agent often observes the rollout, checks logs and continues it, so this shifts the role from the agent to humans. Smallest repair: say an agent often monitors rollouts. The accountability point, the strike system tied to outages, is supported. The question and limitations are appropriately non-leading.","excerpt":"He said they often have an agent observe the performance characteristics of the rollout, check the logs, and continue the wider rollout when things are stable."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified original article page, which matches the source and gives direct access to the episode and transcript. The verified YouTube video would also have been relevant.","excerpt":null}],"createdAt":"2026-11-18T18:17:32.041Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}