{"id":"6a9adadeb1a1c2f833f71dac6f725ce08615ac4edf5fa6c7090dc2a43d4a8c5b","title":"MIT Technology Review’s The Download on scraped personal data and chatbot health advice","argument":"MIT Technology Review’s The Download, published July 21, 2025, reports two research findings about AI and personal risk. Researchers found thousands of images, including faces and identity documents, in a small sample of DataComp CommonPool, an open-source AI training set for image generation. Because they checked only a small fraction of the data, they estimate the full set may contain hundreds of millions of images with personally identifiable information. The newsletter’s warning is stark: material put online can be scraped and used in training data.\n\nThe edition also reports research finding that AI companies have mostly stopped including medical disclaimers when chatbots answer health questions. It says many leading models now ask follow-up questions and attempt diagnoses. The researchers argue that disclaimers remind people not to treat chatbot responses as medical advice; without them, users may be more likely to trust unsafe advice. The evidence here is the newsletter’s account of the two studies, not their full methods or results. How often the scraped images identify real people, and how much removing disclaimers changes users’ trust or medical decisions, remain unknown from this account.","topicIds":["work-and-business--jobs-and-occupations","job-displacement-and-creation"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on November 2, 2026; originally published July 21, 2025. The newsletter summarizes the research and links to full stories; their methods and underlying evidence are not included in the retrieved text. The source gives an estimate based on an audit of a small subset; it does not establish the actual number of images containing personally identifiable information. The account reports the researchers’ claim about users’ trust, but gives no measure of how disclaimer changes affect trust or medical decisions.","speaker":{"name":"MIT Technology Review","roleAtSource":"Publisher"},"source":{"title":"The Download: how your data is being used to train AI, and why chatbots aren’t doctors","publisher":"MIT Technology Review","format":"Article","url":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","publishedAt":"2025-07-21T12:10:00Z","dateBasis":"Date from the publisher’s own records, through its API."},"evidence":[{"text":"Researchers found thousands of images, including identifiable faces, in a small subset of DataComp CommonPool, and estimate the full dataset may contain hundreds of millions of images with personally identifiable information.","excerpt":"Thousands of images—including identifiable faces—were found in a small subset of DataComp CommonPool, a major AI training set for image generation scraped from the web.","url":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","relationship":"Source-stated"},{"text":"The newsletter says researchers estimate that the full dataset contains hundreds of millions of images with personally identifiable information, including faces and identity documents.","excerpt":"Because the researchers audited just 0.1% of CommonPool’s data, they estimate that the real number of images containing personally identifiable information, including faces and identity documents, is in the hundreds of millions.","url":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","relationship":"Source-stated"},{"text":"The newsletter reports research finding that AI companies have mostly abandoned medical disclaimers in chatbot responses to health questions.","excerpt":"AI companies have now mostly abandoned the once-standard practice of including medical disclaimers and warnings in response to health questions, new research has found.","url":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","relationship":"Source-stated"},{"text":"The newsletter reports that many leading AI models answer health questions, ask follow-ups, and attempt diagnoses.","excerpt":"In fact, many leading AI models will now not only answer health questions but even ask follow-ups and attempt a diagnosis.","url":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","relationship":"Source-stated"},{"text":"The researchers say medical disclaimers remind users not to rely uncritically on chatbot answers, and that their absence means users are more likely to trust unsafe medical advice.","excerpt":"Such disclaimers serve an important reminder to people asking AI about everything from eating disorders to cancer diagnoses, the authors say, and their absence means that users of AI are more likely to trust unsafe medical advice.","url":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How often do the identified images expose real people, and how much does removing chatbot medical disclaimers affect users’ trust or decisions?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"MIT Technology Review’s The Download on scraped personal data and chatbot health advice","summary":"MIT Technology Review’s The Download, published July 21, 2025, reports two research findings about AI and personal risk. Researchers found thousands of images, including faces and identity documents, in a small sample of DataComp CommonPool, an open-source AI training set for image generation. Because they checked only a small fraction of the data, they estimate the full set may contain hundreds of millions of images with personally identifiable information. The newsletter’s warning is stark: material put online can be scraped and used in training data.\n\nThe edition also reports research finding that AI companies have mostly stopped including medical disclaimers when chatbots answer health questions. It says many leading models now ask follow-up questions and attempt diagnoses. The researchers argue that disclaimers remind people not to treat chatbot responses as medical advice; without them, users may be more likely to trust unsafe advice. The evidence here is the newsletter’s account of the two studies, not their full methods or results. How often the scraped images identify real people, and how much removing disclaimers changes users’ trust or medical decisions, remain unknown from this account.","question":"How often do the identified images expose real people, and how much does removing chatbot medical disclaimers affect users’ trust or decisions?","claims":[{"text":"Researchers found thousands of images, including identifiable faces, in a small subset of DataComp CommonPool, and estimate the full dataset may contain hundreds of millions of images with personally identifiable information.","excerpt":"Thousands of images—including identifiable faces—were found in a small subset of DataComp CommonPool, a major AI training set for image generation scraped from the web.","support":"source-stated"},{"text":"The newsletter says researchers estimate that the full dataset contains hundreds of millions of images with personally identifiable information, including faces and identity documents.","excerpt":"Because the researchers audited just 0.1% of CommonPool’s data, they estimate that the real number of images containing personally identifiable information, including faces and identity documents, is in the hundreds of millions.","support":"source-stated"},{"text":"The newsletter reports research finding that AI companies have mostly abandoned medical disclaimers in chatbot responses to health questions.","excerpt":"AI companies have now mostly abandoned the once-standard practice of including medical disclaimers and warnings in response to health questions, new research has found.","support":"source-stated"},{"text":"The newsletter reports that many leading AI models answer health questions, ask follow-ups, and attempt diagnoses.","excerpt":"In fact, many leading AI models will now not only answer health questions but even ask follow-ups and attempt a diagnosis.","support":"source-stated"},{"text":"The researchers say medical disclaimers remind users not to rely uncritically on chatbot answers, and that their absence means users are more likely to trust unsafe medical advice.","excerpt":"Such disclaimers serve an important reminder to people asking AI about everything from eating disorders to cancer diagnoses, the authors say, and their absence means that users of AI are more likely to trust unsafe medical advice.","support":"source-stated"}],"limitations":["Text as retrieved on November 2, 2026; originally published July 21, 2025.","The newsletter summarizes the research and links to full stories; their methods and underlying evidence are not included in the retrieved text.","The source gives an estimate based on an audit of a small subset; it does not establish the actual number of images containing personally identifiable information.","The account reports the researchers’ claim about users’ trust, but gives no measure of how disclaimer changes affect trust or medical decisions."],"mediaId":null,"correctionReason":null,"id":"6a9adadeb1a1c2f833f71dac6f725ce08615ac4edf5fa6c7090dc2a43d4a8c5b","publicationId":"532e8120-faa9-93e0-58da-40445bacc1fa","version":1,"sourceUrl":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","sourceTitle":"The Download: how your data is being used to train AI, and why chatbots aren’t doctors","publisher":"MIT Technology Review","publishedAt":"2025-07-21T12:10:00Z","originalPublished":{"value":"2025-07-21T12:10:00Z","precision":"instant","basis":"backfill:api_published"},"firstObservedAt":"2026-11-02T21:47:52.320Z","createdAt":"2026-11-13T02:33:24.730Z","historical":true,"entityIds":[],"topicIds":["work-and-business--jobs-and-occupations","job-displacement-and-creation"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"624d3e366c9349dc1d9a0c8e5327d2b21f8a3aabdec2702d12fb560e692d600c","rubricVersion":"unrecorded","provider":"anthropic","model":"claude-opus-5-5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-11-02T21:47:47.905Z"},"provenance":{"textHash":"c9a3e8e0a3192c28ed491a68e6352c30ccf3fc75225ad62f38a11ddd31a2554b","observationId":"d62967f5da1ddfb8aa91523f6d12c30d620b684b5a97ef1fb09cd92f79323b41","retrievedAt":"2026-11-02T21:49:19.986Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"31a05667-6fbb-5476-1286-cdc5ec03840f"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"37a908a6-8405-1c30-078e-4fdd464dd677"}},"audit":{"status":"passed","reviewedAt":"2026-11-13T02:28:48.170Z","model":"anthropic/claude-opus-5.5"}},"canonicalUrl":"https://escapemeridian.com/readings/mit-technology-review-s-the-download-on-scraped-personal-data-6a9adade","formats":{"html":"/readings/mit-technology-review-s-the-download-on-scraped-personal-data-6a9adade","markdown":"/readings/mit-technology-review-s-the-download-on-scraped-personal-data-6a9adade.md","json":"/readings/mit-technology-review-s-the-download-on-scraped-personal-data-6a9adade.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[],"entities":[]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"6a9adadeb1a1c2f833f71dac6f725ce08615ac4edf5fa6c7090dc2a43d4a8c5b","revision":"532e8120-faa9-93e0-58da-40445bacc1fa","revisionKind":"publication-id","title":"MIT Technology Review’s The Download on scraped personal data and chatbot health advice","url":"https://escapemeridian.com/readings/mit-technology-review-s-the-download-on-scraped-personal-data-6a9adade"},"source":{"type":"source","id":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","revision":"c9a3e8e0a3192c28ed491a68e6352c30ccf3fc75225ad62f38a11ddd31a2554b","revisionKind":"sha256-source-text","title":"The Download: how your data is being used to train AI, and why chatbots aren’t doctors","url":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"6a9adadeb1a1c2f833f71dac6f725ce08615ac4edf5fa6c7090dc2a43d4a8c5b","title":"MIT Technology Review’s The Download on scraped personal data and chatbot health advice","argument":"MIT Technology Review’s The Download, published July 21, 2025, reports two research findings about AI and personal risk. Researchers found thousands of images, including faces and identity documents, in a small sample of DataComp CommonPool, an open-source AI training set for image generation. Because they checked only a small fraction of the data, they estimate the full set may contain hundreds of millions of images with personally identifiable information. The newsletter’s warning is stark: material put online can be scraped and used in training data.\n\nThe edition also reports research finding that AI companies have mostly stopped including medical disclaimers when chatbots answer health questions. It says many leading models now ask follow-up questions and attempt diagnoses. The researchers argue that disclaimers remind people not to treat chatbot responses as medical advice; without them, users may be more likely to trust unsafe advice. The evidence here is the newsletter’s account of the two studies, not their full methods or results. How often the scraped images identify real people, and how much removing disclaimers changes users’ trust or medical decisions, remain unknown from this account.","topicIds":["work-and-business--jobs-and-occupations","job-displacement-and-creation"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on November 2, 2026; originally published July 21, 2025. The newsletter summarizes the research and links to full stories; their methods and underlying evidence are not included in the retrieved text. The source gives an estimate based on an audit of a small subset; it does not establish the actual number of images containing personally identifiable information. The account reports the researchers’ claim about users’ trust, but gives no measure of how disclaimer changes affect trust or medical decisions.","speaker":{"name":"MIT Technology Review","roleAtSource":"Publisher"},"source":{"title":"The Download: how your data is being used to train AI, and why chatbots aren’t doctors","publisher":"MIT Technology Review","format":"Article","url":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","publishedAt":"2025-07-21T12:10:00Z","dateBasis":"Date from the publisher’s own records, through its API."},"evidence":[{"text":"Researchers found thousands of images, including identifiable faces, in a small subset of DataComp CommonPool, and estimate the full dataset may contain hundreds of millions of images with personally identifiable information.","excerpt":"Thousands of images—including identifiable faces—were found in a small subset of DataComp CommonPool, a major AI training set for image generation scraped from the web.","url":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","relationship":"Source-stated"},{"text":"The newsletter says researchers estimate that the full dataset contains hundreds of millions of images with personally identifiable information, including faces and identity documents.","excerpt":"Because the researchers audited just 0.1% of CommonPool’s data, they estimate that the real number of images containing personally identifiable information, including faces and identity documents, is in the hundreds of millions.","url":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","relationship":"Source-stated"},{"text":"The newsletter reports research finding that AI companies have mostly abandoned medical disclaimers in chatbot responses to health questions.","excerpt":"AI companies have now mostly abandoned the once-standard practice of including medical disclaimers and warnings in response to health questions, new research has found.","url":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","relationship":"Source-stated"},{"text":"The newsletter reports that many leading AI models answer health questions, ask follow-ups, and attempt diagnoses.","excerpt":"In fact, many leading AI models will now not only answer health questions but even ask follow-ups and attempt a diagnosis.","url":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","relationship":"Source-stated"},{"text":"The researchers say medical disclaimers remind users not to rely uncritically on chatbot answers, and that their absence means users are more likely to trust unsafe medical advice.","excerpt":"Such disclaimers serve an important reminder to people asking AI about everything from eating disorders to cancer diagnoses, the authors say, and their absence means that users of AI are more likely to trust unsafe medical advice.","url":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How often do the identified images expose real people, and how much does removing chatbot medical disclaimers affect users’ trust or decisions?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"MIT Technology Review’s The Download on scraped personal data and chatbot health advice","summary":"MIT Technology Review’s The Download, published July 21, 2025, reports two research findings about AI and personal risk. Researchers found thousands of images, including faces and identity documents, in a small sample of DataComp CommonPool, an open-source AI training set for image generation. Because they checked only a small fraction of the data, they estimate the full set may contain hundreds of millions of images with personally identifiable information. The newsletter’s warning is stark: material put online can be scraped and used in training data.\n\nThe edition also reports research finding that AI companies have mostly stopped including medical disclaimers when chatbots answer health questions. It says many leading models now ask follow-up questions and attempt diagnoses. The researchers argue that disclaimers remind people not to treat chatbot responses as medical advice; without them, users may be more likely to trust unsafe advice. The evidence here is the newsletter’s account of the two studies, not their full methods or results. How often the scraped images identify real people, and how much removing disclaimers changes users’ trust or medical decisions, remain unknown from this account.","question":"How often do the identified images expose real people, and how much does removing chatbot medical disclaimers affect users’ trust or decisions?","claims":[{"text":"Researchers found thousands of images, including identifiable faces, in a small subset of DataComp CommonPool, and estimate the full dataset may contain hundreds of millions of images with personally identifiable information.","excerpt":"Thousands of images—including identifiable faces—were found in a small subset of DataComp CommonPool, a major AI training set for image generation scraped from the web.","support":"source-stated"},{"text":"The newsletter says researchers estimate that the full dataset contains hundreds of millions of images with personally identifiable information, including faces and identity documents.","excerpt":"Because the researchers audited just 0.1% of CommonPool’s data, they estimate that the real number of images containing personally identifiable information, including faces and identity documents, is in the hundreds of millions.","support":"source-stated"},{"text":"The newsletter reports research finding that AI companies have mostly abandoned medical disclaimers in chatbot responses to health questions.","excerpt":"AI companies have now mostly abandoned the once-standard practice of including medical disclaimers and warnings in response to health questions, new research has found.","support":"source-stated"},{"text":"The newsletter reports that many leading AI models answer health questions, ask follow-ups, and attempt diagnoses.","excerpt":"In fact, many leading AI models will now not only answer health questions but even ask follow-ups and attempt a diagnosis.","support":"source-stated"},{"text":"The researchers say medical disclaimers remind users not to rely uncritically on chatbot answers, and that their absence means users are more likely to trust unsafe medical advice.","excerpt":"Such disclaimers serve an important reminder to people asking AI about everything from eating disorders to cancer diagnoses, the authors say, and their absence means that users of AI are more likely to trust unsafe medical advice.","support":"source-stated"}],"limitations":["Text as retrieved on November 2, 2026; originally published July 21, 2025.","The newsletter summarizes the research and links to full stories; their methods and underlying evidence are not included in the retrieved text.","The source gives an estimate based on an audit of a small subset; it does not establish the actual number of images containing personally identifiable information.","The account reports the researchers’ claim about users’ trust, but gives no measure of how disclaimer changes affect trust or medical decisions."],"mediaId":null,"correctionReason":null,"id":"6a9adadeb1a1c2f833f71dac6f725ce08615ac4edf5fa6c7090dc2a43d4a8c5b","publicationId":"532e8120-faa9-93e0-58da-40445bacc1fa","version":1,"sourceUrl":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","sourceTitle":"The Download: how your data is being used to train AI, and why chatbots aren’t doctors","publisher":"MIT Technology Review","publishedAt":"2025-07-21T12:10:00Z","originalPublished":{"value":"2025-07-21T12:10:00Z","precision":"instant","basis":"backfill:api_published"},"firstObservedAt":"2026-11-02T21:47:52.320Z","createdAt":"2026-11-13T02:33:24.730Z","historical":true,"entityIds":[],"topicIds":["work-and-business--jobs-and-occupations","job-displacement-and-creation"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.technologyreview.com/2025/07/21/1120525/the-download-how-your-data-is-being-used-to-train-ai-and-why-chatbots-arent-doctors/","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"624d3e366c9349dc1d9a0c8e5327d2b21f8a3aabdec2702d12fb560e692d600c","rubricVersion":"unrecorded","provider":"anthropic","model":"claude-opus-5-5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-11-02T21:47:47.905Z"},"provenance":{"textHash":"c9a3e8e0a3192c28ed491a68e6352c30ccf3fc75225ad62f38a11ddd31a2554b","observationId":"d62967f5da1ddfb8aa91523f6d12c30d620b684b5a97ef1fb09cd92f79323b41","retrievedAt":"2026-11-02T21:49:19.986Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"31a05667-6fbb-5476-1286-cdc5ec03840f"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"37a908a6-8405-1c30-078e-4fdd464dd677"}},"audit":{"status":"passed","reviewedAt":"2026-11-13T02:28:48.170Z","model":"anthropic/claude-opus-5.5"}}}],"audits":[{"publicationId":"532e8120-faa9-93e0-58da-40445bacc1fa","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading attributes the content to MIT Technology Review's The Download. This newsletter issue comments on several items in its own words, so it counts as one piece. The study findings are attributed to researchers and the newsletter rather than presented as established fact.","excerpt":"This is today's edition of The Download, our weekday newsletter that provides a daily dose of what's going on in the world of technology."},{"dimension":"summary","status":"pass","explanation":"The reading clearly explains both items, with DataComp CommonPool described as an open-source image-generation training set, and a lay reader can follow it. It renders the newsletter's line as material that can be scraped and drops 'probably has been', which slightly softens its force without changing its meaning. The question follows from gaps the source leaves open.","excerpt":"The bottom line? Anything you put online can be and probably has been scraped."},{"dimension":"date","status":"pass","explanation":"July 21, 2025 matches the UTC calendar day of originalPublished. The page's dateModified falls before publication, so there is no later edit. The Deep Dive listings may be later additions, but the reading neither uses nor relies on them. The evidence is a publisher page, so no archive disclosure is needed, and there is no hindsight framing.","excerpt":null},{"dimension":"support","status":"pass","explanation":"Each claim matches its excerpt. Describing the disclaimers as reminders not to rely on chatbots as doctors is a mild paraphrase consistent with the headline and the authors' stated reminder. The stated unknowns and limitations stay within the evidence and invent no stakeholder impacts.","excerpt":"Such disclaimers serve an important reminder to people asking AI about everything from eating disorders to cancer diagnoses, the authors say"},{"dimension":"media","status":"pass","explanation":"No media was selected, and no verified candidates were supplied.","excerpt":null}],"createdAt":"2026-11-13T02:28:48.170Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}