{"id":"53679e0d36f06821dbdf2d136016fb058eef76169bad5ae8624a52c324a654c4","title":"Harvard Business School Working Knowledge: AI suggestions helped service agents","argument":"Ben Rand’s Working Knowledge article describes a study by Shunyuan Zhang and Das Narayandas of AI suggestions shown to customer-service agents during online chats with customers of an unnamed meal delivery company. The researchers report that agents using suggestions responded faster and received higher customer-sentiment scores than agents without them; the reported improvements were larger for less-experienced agents. The article argues that AI can support human service rather than simply replace it, especially by helping newer agents handle conversations. It also describes limits: results varied with customer intent, improvements were less substantial for repeat complaints, and customers sometimes seemed confused when transferred from a chatbot to an agent who responded very quickly. The researchers suggest that managers consider who benefits from assistance, including newer service employees and companies seeking to retain customers who ask to cancel subscriptions. These findings come from one company, and the article does not establish that the measured sentiment changes led to higher revenue, better employee retention, or results in other settings. How would the reported effects change across other companies, customer intents, and ways of transferring conversations from chatbots to human agents?","topicIds":["work-and-agency"],"domain":"work","claimType":"attributed reading","limits":"The study concerns one unnamed meal delivery company; the article does not establish whether the findings generalize to other companies or service settings. Customer sentiment was evaluated by the AI tool based on emotional tone at the beginning and end of the interaction; the article does not establish that sentiment changes produced higher revenue or profitability. The article presents employee retention and freemium customer conversion as possible benefits, not outcomes demonstrated by the reported study. The source does not establish effects on employee retention or later subscription conversion.","speaker":{"name":"Ben Rand","roleAtSource":"Article author"},"source":{"title":"When AI Chatbots Help People Act More Human | Working Knowledge","publisher":"Harvard Business School","format":"Article","url":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","publishedAt":"2025-05-27T08:00:00-05:00","dateBasis":"Date stated by the publisher."},"evidence":[{"text":"The study analyzed online chats at an unnamed meal delivery company, comparing agents who received AI response suggestions with agents who did not.","excerpt":"Some agents received real-time response suggestions from the AI tool, while others did not.","url":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","relationship":"Source-stated"},{"text":"The article reports faster responses and higher customer-sentiment scores for agents using AI suggestions, with larger reported improvements for less-experienced agents.","excerpt":"AI helped human agents respond to chats some 20 percent faster—improving performance even more for less experienced agents.","url":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","relationship":"Source-stated"},{"text":"The article says results varied by customer intent; improvements were less substantial for repeat complaints, while cancellation inquiries showed improved sentiment.","excerpt":"The study found that AI improved sentiment when customers asked to cancel their subscriptions. The researchers think this could be because AI recommended alternative subscription options.","url":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","relationship":"Source-stated"},{"text":"The authors say very rapid transfers from chatbots to human agents sometimes left customers confused about whether they were still interacting with a chatbot.","excerpt":"the transfer happened so quickly that customers thought they were still communicating with a chatbot.","url":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","relationship":"Source-stated"},{"text":"The researchers suggest AI assistance may help newer service employees and may be useful to firms seeking to retain customers who ask to cancel subscriptions.","excerpt":"The research suggests that AI is effective for:\nTraining new employees in service roles","url":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","relationship":"Source-stated"}],"sourceMedia":{"status":"found","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","checkedAt":"2026-11-05T20:53:16.563Z","items":[{"type":"image","url":"https://cloudinary.hbs.edu/hbsit/image/fetch/q_auto,c_fill,w_600,ar_1:1/f_webp/https%3A%2F%2Fwww.hbs.edu%2Fctfassets%2Fpublic%2Fimages%2F2fmjqIVrmo8fWgcSupmDlt%2FBen%2520Rand%2520R3_01.jpg","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","attribution":"Harvard Business School","basis":"publisher-embed","availability":"verified","label":"Illustrated portrait of Ben Rand, a writer at Harvard Business School's Working Knowledge online publication","verifiedAt":"2026-11-05T20:53:17.103Z"}],"note":"Media declared by the original publisher; availability checked separately from the editorial reading."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How would the reported effects change across other companies, customer intents, and ways of transferring conversations from chatbots to human agents?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Harvard Business School Working Knowledge: AI suggestions helped service agents","summary":"Ben Rand’s Working Knowledge article describes a study by Shunyuan Zhang and Das Narayandas of AI suggestions shown to customer-service agents during online chats with customers of an unnamed meal delivery company. The researchers report that agents using suggestions responded faster and received higher customer-sentiment scores than agents without them; the reported improvements were larger for less-experienced agents. The article argues that AI can support human service rather than simply replace it, especially by helping newer agents handle conversations. It also describes limits: results varied with customer intent, improvements were less substantial for repeat complaints, and customers sometimes seemed confused when transferred from a chatbot to an agent who responded very quickly. The researchers suggest that managers consider who benefits from assistance, including newer service employees and companies seeking to retain customers who ask to cancel subscriptions. These findings come from one company, and the article does not establish that the measured sentiment changes led to higher revenue, better employee retention, or results in other settings. How would the reported effects change across other companies, customer intents, and ways of transferring conversations from chatbots to human agents?","question":"How would the reported effects change across other companies, customer intents, and ways of transferring conversations from chatbots to human agents?","claims":[{"text":"The study analyzed online chats at an unnamed meal delivery company, comparing agents who received AI response suggestions with agents who did not.","excerpt":"Some agents received real-time response suggestions from the AI tool, while others did not.","support":"source-stated"},{"text":"The article reports faster responses and higher customer-sentiment scores for agents using AI suggestions, with larger reported improvements for less-experienced agents.","excerpt":"AI helped human agents respond to chats some 20 percent faster—improving performance even more for less experienced agents.","support":"source-stated"},{"text":"The article says results varied by customer intent; improvements were less substantial for repeat complaints, while cancellation inquiries showed improved sentiment.","excerpt":"The study found that AI improved sentiment when customers asked to cancel their subscriptions. The researchers think this could be because AI recommended alternative subscription options.","support":"source-stated"},{"text":"The authors say very rapid transfers from chatbots to human agents sometimes left customers confused about whether they were still interacting with a chatbot.","excerpt":"the transfer happened so quickly that customers thought they were still communicating with a chatbot.","support":"source-stated"},{"text":"The researchers suggest AI assistance may help newer service employees and may be useful to firms seeking to retain customers who ask to cancel subscriptions.","excerpt":"The research suggests that AI is effective for:\nTraining new employees in service roles","support":"source-stated"}],"limitations":["The study concerns one unnamed meal delivery company; the article does not establish whether the findings generalize to other companies or service settings.","Customer sentiment was evaluated by the AI tool based on emotional tone at the beginning and end of the interaction; the article does not establish that sentiment changes produced higher revenue or profitability.","The article presents employee retention and freemium customer conversion as possible benefits, not outcomes demonstrated by the reported study. The source does not establish effects on employee retention or later subscription conversion."],"mediaId":"1fbf94c90b1867acd601ff3424772c4f216935bb585c3d8143d8d23ccda34b0f","correctionReason":null,"id":"53679e0d36f06821dbdf2d136016fb058eef76169bad5ae8624a52c324a654c4","publicationId":"7151804c-aab6-415a-82dd-fce49bea11d7","version":1,"sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","sourceTitle":"When AI Chatbots Help People Act More Human | Working Knowledge","publisher":"Harvard Business School Working Knowledge","publishedAt":"2025-05-27T08:00:00-05:00","originalPublished":{"value":"2025-05-27T08:00:00-05:00","precision":"instant","basis":"publisher_page"},"firstObservedAt":"2026-11-05T15:42:07.080Z","createdAt":"2026-11-05T20:54:15.869Z","historical":true,"entityIds":["harvard-business-school-working-knowledge"],"topicIds":["work-and-agency"],"media":[{"id":"1fbf94c90b1867acd601ff3424772c4f216935bb585c3d8143d8d23ccda34b0f","kind":"article","url":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-05T20:53:17.103Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."},{"id":"84f939d735d1d770a3aa39ab5beabb0f9d2faed36a0644b5fe7de7e8cd67db99","kind":"image","url":"https://cloudinary.hbs.edu/hbsit/image/fetch/q_auto,c_fill,w_600,ar_1:1/f_webp/https%3A%2F%2Fwww.hbs.edu%2Fctfassets%2Fpublic%2Fimages%2F2fmjqIVrmo8fWgcSupmDlt%2FBen%2520Rand%2520R3_01.jpg","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","label":"Illustrated portrait of Ben Rand, a writer at Harvard Business School's Working Knowledge online pub","provenance":"publisher_page","verification":{"status":"verified","checkedAt":"2026-11-05T20:53:17.103Z","method":"publisher_association_and_head","contentType":"image/webp","cacheUntil":1793911997103},"recommendationReason":"Observed on the acquired publisher source; availability checked."}],"sourceMedia":{"status":"found","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","checkedAt":"2026-11-05T20:53:16.563Z","items":[{"type":"image","url":"https://cloudinary.hbs.edu/hbsit/image/fetch/q_auto,c_fill,w_600,ar_1:1/f_webp/https%3A%2F%2Fwww.hbs.edu%2Fctfassets%2Fpublic%2Fimages%2F2fmjqIVrmo8fWgcSupmDlt%2FBen%2520Rand%2520R3_01.jpg","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","attribution":"Harvard Business School","basis":"publisher-embed","availability":"verified","label":"Illustrated portrait of Ben Rand, a writer at Harvard Business School's Working Knowledge online publication","verifiedAt":"2026-11-05T20:53:17.103Z"}],"note":"Media declared by the original publisher; availability checked separately from the editorial reading."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v5","mediaId":"1fbf94c90b1867acd601ff3424772c4f216935bb585c3d8143d8d23ccda34b0f","confidence":1,"provider":"typesafe","model":"jev-1.13.0","inputHash":"f2f31df391290dddca1dd6dbc06bb0be08e0d211e1b18d3b88d9621909f3388a","decidedAt":"2026-11-05T20:53:18.887Z"},"provenance":{"textHash":"901b8aee25c81ccdeceec4da045ce0caf6d09fa230ec376c14c697348ea16a1e","observationId":"827bab4bbd10a5af19ff72d149d0c6d8a7060ad50df5133ec87eea26dfe932e0","retrievedAt":"2026-11-05T20:53:16.563Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"64ac0fe1-6beb-489f-8ebb-246804d75838"},"reviewer":{"model":"gpt-6-luna","runId":"070b01df-038b-4f7f-88fc-28a8c91a44fe"}},"audit":{"status":"passed","reviewedAt":"2026-11-05T20:54:15.869Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Ben Rand","url":null,"kind":"Person"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Ben Rand","url":null,"kind":"Person","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ben Rand","status":"stated","provenance":{"basis":"article-jsonld","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","locator":"document/html[1]/head[0]/script[23]@2705.author"},"assertionId":"1e207e6bd8cee5a5aeb5b695b6eef9d1f0d13f34b57cb2ba5e164574254b521d:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-05T20:53:16.563Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1e207e6bd8cee5a5aeb5b695b6eef9d1f0d13f34b57cb2ba5e164574254b521d","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","contentSha256":"59cce413b714d81174f63287601088b25bd015e769fc7ca0d92664dcea1b122e","textHash":"901b8aee25c81ccdeceec4da045ce0caf6d09fa230ec376c14c697348ea16a1e","observedAt":"2026-11-05T20:53:16.563Z"}},{"actor":{"name":"Harvard Business School","url":null,"kind":"unknown","actorId":null},"role":"publisher","scope":{"kind":"publication","locator":null},"literalCredit":"Harvard Business School","status":"stated","provenance":{"basis":"article-publisher","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","locator":"document/html[1]/head[0]/script[23]@2705.publisher"},"assertionId":"1e207e6bd8cee5a5aeb5b695b6eef9d1f0d13f34b57cb2ba5e164574254b521d:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-05T20:53:16.563Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1e207e6bd8cee5a5aeb5b695b6eef9d1f0d13f34b57cb2ba5e164574254b521d","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","contentSha256":"59cce413b714d81174f63287601088b25bd015e769fc7ca0d92664dcea1b122e","textHash":"901b8aee25c81ccdeceec4da045ce0caf6d09fa230ec376c14c697348ea16a1e","observedAt":"2026-11-05T20:53:16.563Z"}}],"participationCoverage":{"total":2,"returned":2,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":{"name":"Harvard Business School","url":null},"sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","snapshotId":"1e207e6bd8cee5a5aeb5b695b6eef9d1f0d13f34b57cb2ba5e164574254b521d","contentSha256":"59cce413b714d81174f63287601088b25bd015e769fc7ca0d92664dcea1b122e","textHash":"901b8aee25c81ccdeceec4da045ce0caf6d09fa230ec376c14c697348ea16a1e","observedAt":"2026-11-05T20:53:16.563Z","basis":"publisher-page-metadata","sourceLinks":9,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/53679e0d36f06821dbdf2d136016fb058eef76169bad5ae8624a52c324a654c4/source"}},"canonicalUrl":"https://escapemeridian.com/readings/harvard-business-school-working-knowledge-ai-suggestions-helped-53679e0d","formats":{"html":"/readings/harvard-business-school-working-knowledge-ai-suggestions-helped-53679e0d","markdown":"/readings/harvard-business-school-working-knowledge-ai-suggestions-helped-53679e0d.md","json":"/readings/harvard-business-school-working-knowledge-ai-suggestions-helped-53679e0d.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[],"entities":[{"id":"harvard-business-school-working-knowledge","name":"Harvard Business School Working Knowledge","kind":"organization","context":"Harvard Business School Working Knowledge publishes articles explaining business research on management, technology and workplace behavior.","referenceUrls":["https://www.library.hbs.edu/"],"path":"/entities/harvard-business-school-working-knowledge","json":"/entities/harvard-business-school-working-knowledge.json","markdown":"/entities/harvard-business-school-working-knowledge.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"53679e0d36f06821dbdf2d136016fb058eef76169bad5ae8624a52c324a654c4","revision":"7151804c-aab6-415a-82dd-fce49bea11d7","revisionKind":"publication-id","title":"Harvard Business School Working Knowledge: AI suggestions helped service agents","url":"https://escapemeridian.com/readings/harvard-business-school-working-knowledge-ai-suggestions-helped-53679e0d"},"source":{"type":"source","id":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","revision":"901b8aee25c81ccdeceec4da045ce0caf6d09fa230ec376c14c697348ea16a1e","revisionKind":"sha256-source-text","title":"When AI Chatbots Help People Act More Human | Working Knowledge","url":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"53679e0d36f06821dbdf2d136016fb058eef76169bad5ae8624a52c324a654c4","title":"Harvard Business School Working Knowledge: AI suggestions helped service agents","argument":"Ben Rand’s Working Knowledge article describes a study by Shunyuan Zhang and Das Narayandas of AI suggestions shown to customer-service agents during online chats with customers of an unnamed meal delivery company. The researchers report that agents using suggestions responded faster and received higher customer-sentiment scores than agents without them; the reported improvements were larger for less-experienced agents. The article argues that AI can support human service rather than simply replace it, especially by helping newer agents handle conversations. It also describes limits: results varied with customer intent, improvements were less substantial for repeat complaints, and customers sometimes seemed confused when transferred from a chatbot to an agent who responded very quickly. The researchers suggest that managers consider who benefits from assistance, including newer service employees and companies seeking to retain customers who ask to cancel subscriptions. These findings come from one company, and the article does not establish that the measured sentiment changes led to higher revenue, better employee retention, or results in other settings. How would the reported effects change across other companies, customer intents, and ways of transferring conversations from chatbots to human agents?","topicIds":["work-and-agency"],"domain":"work","claimType":"attributed reading","limits":"The study concerns one unnamed meal delivery company; the article does not establish whether the findings generalize to other companies or service settings. Customer sentiment was evaluated by the AI tool based on emotional tone at the beginning and end of the interaction; the article does not establish that sentiment changes produced higher revenue or profitability. The article presents employee retention and freemium customer conversion as possible benefits, not outcomes demonstrated by the reported study. The source does not establish effects on employee retention or later subscription conversion.","speaker":{"name":"Ben Rand","roleAtSource":"Article author"},"source":{"title":"When AI Chatbots Help People Act More Human | Working Knowledge","publisher":"Harvard Business School","format":"Article","url":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","publishedAt":"2025-05-27T08:00:00-05:00","dateBasis":"Date stated by the publisher."},"evidence":[{"text":"The study analyzed online chats at an unnamed meal delivery company, comparing agents who received AI response suggestions with agents who did not.","excerpt":"Some agents received real-time response suggestions from the AI tool, while others did not.","url":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","relationship":"Source-stated"},{"text":"The article reports faster responses and higher customer-sentiment scores for agents using AI suggestions, with larger reported improvements for less-experienced agents.","excerpt":"AI helped human agents respond to chats some 20 percent faster—improving performance even more for less experienced agents.","url":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","relationship":"Source-stated"},{"text":"The article says results varied by customer intent; improvements were less substantial for repeat complaints, while cancellation inquiries showed improved sentiment.","excerpt":"The study found that AI improved sentiment when customers asked to cancel their subscriptions. The researchers think this could be because AI recommended alternative subscription options.","url":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","relationship":"Source-stated"},{"text":"The authors say very rapid transfers from chatbots to human agents sometimes left customers confused about whether they were still interacting with a chatbot.","excerpt":"the transfer happened so quickly that customers thought they were still communicating with a chatbot.","url":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","relationship":"Source-stated"},{"text":"The researchers suggest AI assistance may help newer service employees and may be useful to firms seeking to retain customers who ask to cancel subscriptions.","excerpt":"The research suggests that AI is effective for:\nTraining new employees in service roles","url":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","relationship":"Source-stated"}],"sourceMedia":{"status":"found","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","checkedAt":"2026-11-05T20:53:16.563Z","items":[{"type":"image","url":"https://cloudinary.hbs.edu/hbsit/image/fetch/q_auto,c_fill,w_600,ar_1:1/f_webp/https%3A%2F%2Fwww.hbs.edu%2Fctfassets%2Fpublic%2Fimages%2F2fmjqIVrmo8fWgcSupmDlt%2FBen%2520Rand%2520R3_01.jpg","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","attribution":"Harvard Business School","basis":"publisher-embed","availability":"verified","label":"Illustrated portrait of Ben Rand, a writer at Harvard Business School's Working Knowledge online publication","verifiedAt":"2026-11-05T20:53:17.103Z"}],"note":"Media declared by the original publisher; availability checked separately from the editorial reading."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How would the reported effects change across other companies, customer intents, and ways of transferring conversations from chatbots to human agents?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Harvard Business School Working Knowledge: AI suggestions helped service agents","summary":"Ben Rand’s Working Knowledge article describes a study by Shunyuan Zhang and Das Narayandas of AI suggestions shown to customer-service agents during online chats with customers of an unnamed meal delivery company. The researchers report that agents using suggestions responded faster and received higher customer-sentiment scores than agents without them; the reported improvements were larger for less-experienced agents. The article argues that AI can support human service rather than simply replace it, especially by helping newer agents handle conversations. It also describes limits: results varied with customer intent, improvements were less substantial for repeat complaints, and customers sometimes seemed confused when transferred from a chatbot to an agent who responded very quickly. The researchers suggest that managers consider who benefits from assistance, including newer service employees and companies seeking to retain customers who ask to cancel subscriptions. These findings come from one company, and the article does not establish that the measured sentiment changes led to higher revenue, better employee retention, or results in other settings. How would the reported effects change across other companies, customer intents, and ways of transferring conversations from chatbots to human agents?","question":"How would the reported effects change across other companies, customer intents, and ways of transferring conversations from chatbots to human agents?","claims":[{"text":"The study analyzed online chats at an unnamed meal delivery company, comparing agents who received AI response suggestions with agents who did not.","excerpt":"Some agents received real-time response suggestions from the AI tool, while others did not.","support":"source-stated"},{"text":"The article reports faster responses and higher customer-sentiment scores for agents using AI suggestions, with larger reported improvements for less-experienced agents.","excerpt":"AI helped human agents respond to chats some 20 percent faster—improving performance even more for less experienced agents.","support":"source-stated"},{"text":"The article says results varied by customer intent; improvements were less substantial for repeat complaints, while cancellation inquiries showed improved sentiment.","excerpt":"The study found that AI improved sentiment when customers asked to cancel their subscriptions. The researchers think this could be because AI recommended alternative subscription options.","support":"source-stated"},{"text":"The authors say very rapid transfers from chatbots to human agents sometimes left customers confused about whether they were still interacting with a chatbot.","excerpt":"the transfer happened so quickly that customers thought they were still communicating with a chatbot.","support":"source-stated"},{"text":"The researchers suggest AI assistance may help newer service employees and may be useful to firms seeking to retain customers who ask to cancel subscriptions.","excerpt":"The research suggests that AI is effective for:\nTraining new employees in service roles","support":"source-stated"}],"limitations":["The study concerns one unnamed meal delivery company; the article does not establish whether the findings generalize to other companies or service settings.","Customer sentiment was evaluated by the AI tool based on emotional tone at the beginning and end of the interaction; the article does not establish that sentiment changes produced higher revenue or profitability.","The article presents employee retention and freemium customer conversion as possible benefits, not outcomes demonstrated by the reported study. The source does not establish effects on employee retention or later subscription conversion."],"mediaId":"1fbf94c90b1867acd601ff3424772c4f216935bb585c3d8143d8d23ccda34b0f","correctionReason":null,"id":"53679e0d36f06821dbdf2d136016fb058eef76169bad5ae8624a52c324a654c4","publicationId":"7151804c-aab6-415a-82dd-fce49bea11d7","version":1,"sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","sourceTitle":"When AI Chatbots Help People Act More Human | Working Knowledge","publisher":"Harvard Business School Working Knowledge","publishedAt":"2025-05-27T08:00:00-05:00","originalPublished":{"value":"2025-05-27T08:00:00-05:00","precision":"instant","basis":"publisher_page"},"firstObservedAt":"2026-11-05T15:42:07.080Z","createdAt":"2026-11-05T20:54:15.869Z","historical":true,"entityIds":["harvard-business-school-working-knowledge"],"topicIds":["work-and-agency"],"media":[{"id":"1fbf94c90b1867acd601ff3424772c4f216935bb585c3d8143d8d23ccda34b0f","kind":"article","url":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-05T20:53:17.103Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."},{"id":"84f939d735d1d770a3aa39ab5beabb0f9d2faed36a0644b5fe7de7e8cd67db99","kind":"image","url":"https://cloudinary.hbs.edu/hbsit/image/fetch/q_auto,c_fill,w_600,ar_1:1/f_webp/https%3A%2F%2Fwww.hbs.edu%2Fctfassets%2Fpublic%2Fimages%2F2fmjqIVrmo8fWgcSupmDlt%2FBen%2520Rand%2520R3_01.jpg","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","label":"Illustrated portrait of Ben Rand, a writer at Harvard Business School's Working Knowledge online pub","provenance":"publisher_page","verification":{"status":"verified","checkedAt":"2026-11-05T20:53:17.103Z","method":"publisher_association_and_head","contentType":"image/webp","cacheUntil":1793911997103},"recommendationReason":"Observed on the acquired publisher source; availability checked."}],"sourceMedia":{"status":"found","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","checkedAt":"2026-11-05T20:53:16.563Z","items":[{"type":"image","url":"https://cloudinary.hbs.edu/hbsit/image/fetch/q_auto,c_fill,w_600,ar_1:1/f_webp/https%3A%2F%2Fwww.hbs.edu%2Fctfassets%2Fpublic%2Fimages%2F2fmjqIVrmo8fWgcSupmDlt%2FBen%2520Rand%2520R3_01.jpg","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","attribution":"Harvard Business School","basis":"publisher-embed","availability":"verified","label":"Illustrated portrait of Ben Rand, a writer at Harvard Business School's Working Knowledge online publication","verifiedAt":"2026-11-05T20:53:17.103Z"}],"note":"Media declared by the original publisher; availability checked separately from the editorial reading."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v5","mediaId":"1fbf94c90b1867acd601ff3424772c4f216935bb585c3d8143d8d23ccda34b0f","confidence":1,"provider":"typesafe","model":"jev-1.13.0","inputHash":"f2f31df391290dddca1dd6dbc06bb0be08e0d211e1b18d3b88d9621909f3388a","decidedAt":"2026-11-05T20:53:18.887Z"},"provenance":{"textHash":"901b8aee25c81ccdeceec4da045ce0caf6d09fa230ec376c14c697348ea16a1e","observationId":"827bab4bbd10a5af19ff72d149d0c6d8a7060ad50df5133ec87eea26dfe932e0","retrievedAt":"2026-11-05T20:53:16.563Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"64ac0fe1-6beb-489f-8ebb-246804d75838"},"reviewer":{"model":"gpt-6-luna","runId":"070b01df-038b-4f7f-88fc-28a8c91a44fe"}},"audit":{"status":"passed","reviewedAt":"2026-11-05T20:54:15.869Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Ben Rand","url":null,"kind":"Person"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Ben Rand","url":null,"kind":"Person","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ben Rand","status":"stated","provenance":{"basis":"article-jsonld","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","locator":"document/html[1]/head[0]/script[23]@2705.author"},"assertionId":"1e207e6bd8cee5a5aeb5b695b6eef9d1f0d13f34b57cb2ba5e164574254b521d:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-05T20:53:16.563Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1e207e6bd8cee5a5aeb5b695b6eef9d1f0d13f34b57cb2ba5e164574254b521d","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","contentSha256":"59cce413b714d81174f63287601088b25bd015e769fc7ca0d92664dcea1b122e","textHash":"901b8aee25c81ccdeceec4da045ce0caf6d09fa230ec376c14c697348ea16a1e","observedAt":"2026-11-05T20:53:16.563Z"}},{"actor":{"name":"Harvard Business School","url":null,"kind":"unknown","actorId":null},"role":"publisher","scope":{"kind":"publication","locator":null},"literalCredit":"Harvard Business School","status":"stated","provenance":{"basis":"article-publisher","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","locator":"document/html[1]/head[0]/script[23]@2705.publisher"},"assertionId":"1e207e6bd8cee5a5aeb5b695b6eef9d1f0d13f34b57cb2ba5e164574254b521d:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-05T20:53:16.563Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1e207e6bd8cee5a5aeb5b695b6eef9d1f0d13f34b57cb2ba5e164574254b521d","sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","contentSha256":"59cce413b714d81174f63287601088b25bd015e769fc7ca0d92664dcea1b122e","textHash":"901b8aee25c81ccdeceec4da045ce0caf6d09fa230ec376c14c697348ea16a1e","observedAt":"2026-11-05T20:53:16.563Z"}}],"participationCoverage":{"total":2,"returned":2,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":{"name":"Harvard Business School","url":null},"sourceUrl":"https://www.library.hbs.edu/working-knowledge/when-ai-chatbots-help-people-be-more-human","snapshotId":"1e207e6bd8cee5a5aeb5b695b6eef9d1f0d13f34b57cb2ba5e164574254b521d","contentSha256":"59cce413b714d81174f63287601088b25bd015e769fc7ca0d92664dcea1b122e","textHash":"901b8aee25c81ccdeceec4da045ce0caf6d09fa230ec376c14c697348ea16a1e","observedAt":"2026-11-05T20:53:16.563Z","basis":"publisher-page-metadata","sourceLinks":9,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/53679e0d36f06821dbdf2d136016fb058eef76169bad5ae8624a52c324a654c4/source"}}}],"audits":[{"publicationId":"7151804c-aab6-415a-82dd-fce49bea11d7","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading correctly attributes the article to Ben Rand at HBS Working Knowledge and the study to Shunyuan Zhang and Das Narayandas. It keeps findings framed as the researchers' reports and the article's claims rather than established fact.","excerpt":"Featuring Shunyuan Zhang and Das Narayandas. By Ben Rand on May 27, 2025"},{"dimension":"summary","status":"pass","explanation":"The summary is understandable to a non-specialist. It explains the setup (agents with and without AI response suggestions), the reported gains, the larger effects for newer agents, the limits by customer intent, and the transfer-confusion finding. The complement-not-replacement framing matches the article. The question follows from the stated boundaries.","excerpt":"AI currently works best as a complement to human intelligence, rather than a replacement"},{"dimension":"date","status":"pass","explanation":"The originalPublished value of 2025-05-27 matches the article byline date. The forthcoming paper's earlier submission is not presented as this source's date.","excerpt":"By Ben Rand on May 27, 2025"},{"dimension":"support","status":"pass","explanation":"Each claim is grounded in the article. The limitations accurately note the single company, the AI-scored sentiment, and that the revenue, retention and freemium-conversion benefits are presented as potential rather than demonstrated. No unsupported benefits or costs are added.","excerpt":"uniquely human service strengths with the potential to positively impact revenue and profitability by making for happier customers"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the original Working Knowledge article. It is the most relevant choice, ahead of the author portrait.","excerpt":null}],"createdAt":"2026-11-05T20:54:15.869Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}