{"id":"78837683568f91dd6b0f4e8362d19c43ec626119980c6af6a3f4c52884d467ea","title":"MIT Technology Review reports OpenAI’s GPT-4o combines voice, video, and text","argument":"MIT Technology Review published this report on May 13, 2024. It describes OpenAI’s GPT-4o as bringing live voice conversation, phone video, and text together in one model, rather than splitting those interactions across separate models. At OpenAI’s demonstration, users could interrupt the assistant, ask it to change its speaking style, or show it an algebra problem and request guidance instead of an answer. OpenAI CTO Mira Murati described the change as a move toward more natural collaboration; the report says the demonstration suggested a conversational assistant able to handle more complex prompts than Siri or Alexa. The demonstration also had glitches: the voice sometimes interrupted awkwardly, and the model appeared to comment on a presenter’s outfit without being asked. The report says features such as reasoning through image and video, previously behind a paywall, were opening to a wider public. OpenAI said paid subscribers would have higher capacity limits, but the report notes that the number of free interactions before charges was not yet clear. The report’s evidence is a live demonstration and company statements; it does not establish how the model performs outside that setting.","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"The report’s evidence for the described interaction and capabilities is a live demonstration; it does not establish performance outside that setting. Text as retrieved on November 3, 2026; originally published May 13, 2024.","speaker":{"name":"MIT Technology Review","roleAtSource":"Publisher"},"source":{"title":"OpenAI’s new GPT-4o lets people interact using voice or video in the same model","publisher":"MIT Technology Review","format":"Article","url":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","publishedAt":"2024-05-13T19:27:57Z","dateBasis":"Date from the publisher’s own records, through its API."},"evidence":[{"text":"MIT Technology Review reports that OpenAI introduced GPT-4o for real-time interaction through voice, video, and text.","excerpt":"OpenAI just debuted GPT-4o, a new kind of AI model that you can communicate with in real time via live voice conversation, video streams from your phone, and text.","url":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","relationship":"Source-stated"},{"text":"The report says GPT-4o combines capabilities that GPT-4 kept in separate models, which Murati said would make responses faster and transitions smoother.","excerpt":"GPT-4o has now merged those capabilities into a single model, which Murati called an “omnimodel.” That means faster responses and smoother transitions between tasks, she said.","url":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","relationship":"Source-stated"},{"text":"At the demonstration, users could interrupt GPT-4o during a response, and it would stop, listen, and adjust.","excerpt":"You could interrupt the model during its responses, and it would stop, listen, and adjust course.","url":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","relationship":"Source-stated"},{"text":"The report notes glitches during the live demonstration, including awkward interruptions and an unsolicited comment about a presenter’s outfit.","excerpt":"GPT-4o’s voice might jump in awkwardly during the conversation. It appeared to comment on one of the presenters’ outfits even though it wasn’t asked to.","url":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","relationship":"Source-stated"},{"text":"The report says it was unclear how many interactions free users would get before being charged.","excerpt":"though it’s not yet clear how many interactions you’ll be able to have with the model before being charged.","url":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How many interactions will free users be able to have with GPT-4o before being charged?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"MIT Technology Review reports OpenAI’s GPT-4o combines voice, video, and text","summary":"MIT Technology Review published this report on May 13, 2024. It describes OpenAI’s GPT-4o as bringing live voice conversation, phone video, and text together in one model, rather than splitting those interactions across separate models. At OpenAI’s demonstration, users could interrupt the assistant, ask it to change its speaking style, or show it an algebra problem and request guidance instead of an answer. OpenAI CTO Mira Murati described the change as a move toward more natural collaboration; the report says the demonstration suggested a conversational assistant able to handle more complex prompts than Siri or Alexa. The demonstration also had glitches: the voice sometimes interrupted awkwardly, and the model appeared to comment on a presenter’s outfit without being asked. The report says features such as reasoning through image and video, previously behind a paywall, were opening to a wider public. OpenAI said paid subscribers would have higher capacity limits, but the report notes that the number of free interactions before charges was not yet clear. The report’s evidence is a live demonstration and company statements; it does not establish how the model performs outside that setting.","question":"How many interactions will free users be able to have with GPT-4o before being charged?","claims":[{"text":"MIT Technology Review reports that OpenAI introduced GPT-4o for real-time interaction through voice, video, and text.","excerpt":"OpenAI just debuted GPT-4o, a new kind of AI model that you can communicate with in real time via live voice conversation, video streams from your phone, and text.","support":"source-stated"},{"text":"The report says GPT-4o combines capabilities that GPT-4 kept in separate models, which Murati said would make responses faster and transitions smoother.","excerpt":"GPT-4o has now merged those capabilities into a single model, which Murati called an “omnimodel.” That means faster responses and smoother transitions between tasks, she said.","support":"source-stated"},{"text":"At the demonstration, users could interrupt GPT-4o during a response, and it would stop, listen, and adjust.","excerpt":"You could interrupt the model during its responses, and it would stop, listen, and adjust course.","support":"source-stated"},{"text":"The report notes glitches during the live demonstration, including awkward interruptions and an unsolicited comment about a presenter’s outfit.","excerpt":"GPT-4o’s voice might jump in awkwardly during the conversation. It appeared to comment on one of the presenters’ outfits even though it wasn’t asked to.","support":"source-stated"},{"text":"The report says it was unclear how many interactions free users would get before being charged.","excerpt":"though it’s not yet clear how many interactions you’ll be able to have with the model before being charged.","support":"source-stated"}],"limitations":["The report’s evidence for the described interaction and capabilities is a live demonstration; it does not establish performance outside that setting.","Text as retrieved on November 3, 2026; originally published May 13, 2024."],"mediaId":null,"correctionReason":null,"id":"78837683568f91dd6b0f4e8362d19c43ec626119980c6af6a3f4c52884d467ea","publicationId":"1558ac55-e529-7132-6aa5-e70733afbcb5","version":1,"sourceUrl":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","sourceTitle":"OpenAI’s new GPT-4o lets people interact using voice or video in the same model","publisher":"MIT Technology Review","publishedAt":"2024-05-13T19:27:57Z","originalPublished":{"value":"2024-05-13T19:27:57Z","precision":"instant","basis":"backfill:api_published"},"firstObservedAt":"2026-11-03T18:02:07.249Z","createdAt":"2026-11-18T17:53:10.250Z","historical":true,"entityIds":[],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"0cd2785a4412a868c45ea702b0866e63685f32519a5a37c457c088f075cd1ff8","rubricVersion":"unrecorded","provider":"anthropic","model":"claude-opus-5-5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-11-03T18:02:04.034Z"},"provenance":{"textHash":"c5076149e6f87864c9ffda17007e09ff903253881e278546facc939125d4eeee","observationId":"632820afe19178e9133715030dd85a98be48ff719ed8bb2e66fc31358c6b0f67","retrievedAt":"2026-11-03T18:03:20.769Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"ff6ce058-04ec-6147-1b9d-224d59b17018"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"5630a103-bce5-4b0b-29db-e8ff6531f7c4"}},"audit":{"status":"passed","reviewedAt":"2026-11-18T17:48:24.766Z","model":"anthropic/claude-opus-5.5"}},"canonicalUrl":"https://escapemeridian.com/readings/mit-technology-review-reports-openai-s-gpt-4o-combines-voice-78837683","formats":{"html":"/readings/mit-technology-review-reports-openai-s-gpt-4o-combines-voice-78837683","markdown":"/readings/mit-technology-review-reports-openai-s-gpt-4o-combines-voice-78837683.md","json":"/readings/mit-technology-review-reports-openai-s-gpt-4o-combines-voice-78837683.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[],"entities":[{"id":"openai","name":"OpenAI","kind":"organization","context":"OpenAI develops AI models and products and publishes research, release announcements and evaluations.","referenceUrls":["https://openai.com/news/"],"path":"/entities/openai","json":"/entities/openai.json","markdown":"/entities/openai.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"78837683568f91dd6b0f4e8362d19c43ec626119980c6af6a3f4c52884d467ea","revision":"1558ac55-e529-7132-6aa5-e70733afbcb5","revisionKind":"publication-id","title":"MIT Technology Review reports OpenAI’s GPT-4o combines voice, video, and text","url":"https://escapemeridian.com/readings/mit-technology-review-reports-openai-s-gpt-4o-combines-voice-78837683"},"source":{"type":"source","id":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","revision":"c5076149e6f87864c9ffda17007e09ff903253881e278546facc939125d4eeee","revisionKind":"sha256-source-text","title":"OpenAI’s new GPT-4o lets people interact using voice or video in the same model","url":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"78837683568f91dd6b0f4e8362d19c43ec626119980c6af6a3f4c52884d467ea","title":"MIT Technology Review reports OpenAI’s GPT-4o combines voice, video, and text","argument":"MIT Technology Review published this report on May 13, 2024. It describes OpenAI’s GPT-4o as bringing live voice conversation, phone video, and text together in one model, rather than splitting those interactions across separate models. At OpenAI’s demonstration, users could interrupt the assistant, ask it to change its speaking style, or show it an algebra problem and request guidance instead of an answer. OpenAI CTO Mira Murati described the change as a move toward more natural collaboration; the report says the demonstration suggested a conversational assistant able to handle more complex prompts than Siri or Alexa. The demonstration also had glitches: the voice sometimes interrupted awkwardly, and the model appeared to comment on a presenter’s outfit without being asked. The report says features such as reasoning through image and video, previously behind a paywall, were opening to a wider public. OpenAI said paid subscribers would have higher capacity limits, but the report notes that the number of free interactions before charges was not yet clear. The report’s evidence is a live demonstration and company statements; it does not establish how the model performs outside that setting.","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"The report’s evidence for the described interaction and capabilities is a live demonstration; it does not establish performance outside that setting. Text as retrieved on November 3, 2026; originally published May 13, 2024.","speaker":{"name":"MIT Technology Review","roleAtSource":"Publisher"},"source":{"title":"OpenAI’s new GPT-4o lets people interact using voice or video in the same model","publisher":"MIT Technology Review","format":"Article","url":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","publishedAt":"2024-05-13T19:27:57Z","dateBasis":"Date from the publisher’s own records, through its API."},"evidence":[{"text":"MIT Technology Review reports that OpenAI introduced GPT-4o for real-time interaction through voice, video, and text.","excerpt":"OpenAI just debuted GPT-4o, a new kind of AI model that you can communicate with in real time via live voice conversation, video streams from your phone, and text.","url":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","relationship":"Source-stated"},{"text":"The report says GPT-4o combines capabilities that GPT-4 kept in separate models, which Murati said would make responses faster and transitions smoother.","excerpt":"GPT-4o has now merged those capabilities into a single model, which Murati called an “omnimodel.” That means faster responses and smoother transitions between tasks, she said.","url":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","relationship":"Source-stated"},{"text":"At the demonstration, users could interrupt GPT-4o during a response, and it would stop, listen, and adjust.","excerpt":"You could interrupt the model during its responses, and it would stop, listen, and adjust course.","url":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","relationship":"Source-stated"},{"text":"The report notes glitches during the live demonstration, including awkward interruptions and an unsolicited comment about a presenter’s outfit.","excerpt":"GPT-4o’s voice might jump in awkwardly during the conversation. It appeared to comment on one of the presenters’ outfits even though it wasn’t asked to.","url":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","relationship":"Source-stated"},{"text":"The report says it was unclear how many interactions free users would get before being charged.","excerpt":"though it’s not yet clear how many interactions you’ll be able to have with the model before being charged.","url":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How many interactions will free users be able to have with GPT-4o before being charged?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"MIT Technology Review reports OpenAI’s GPT-4o combines voice, video, and text","summary":"MIT Technology Review published this report on May 13, 2024. It describes OpenAI’s GPT-4o as bringing live voice conversation, phone video, and text together in one model, rather than splitting those interactions across separate models. At OpenAI’s demonstration, users could interrupt the assistant, ask it to change its speaking style, or show it an algebra problem and request guidance instead of an answer. OpenAI CTO Mira Murati described the change as a move toward more natural collaboration; the report says the demonstration suggested a conversational assistant able to handle more complex prompts than Siri or Alexa. The demonstration also had glitches: the voice sometimes interrupted awkwardly, and the model appeared to comment on a presenter’s outfit without being asked. The report says features such as reasoning through image and video, previously behind a paywall, were opening to a wider public. OpenAI said paid subscribers would have higher capacity limits, but the report notes that the number of free interactions before charges was not yet clear. The report’s evidence is a live demonstration and company statements; it does not establish how the model performs outside that setting.","question":"How many interactions will free users be able to have with GPT-4o before being charged?","claims":[{"text":"MIT Technology Review reports that OpenAI introduced GPT-4o for real-time interaction through voice, video, and text.","excerpt":"OpenAI just debuted GPT-4o, a new kind of AI model that you can communicate with in real time via live voice conversation, video streams from your phone, and text.","support":"source-stated"},{"text":"The report says GPT-4o combines capabilities that GPT-4 kept in separate models, which Murati said would make responses faster and transitions smoother.","excerpt":"GPT-4o has now merged those capabilities into a single model, which Murati called an “omnimodel.” That means faster responses and smoother transitions between tasks, she said.","support":"source-stated"},{"text":"At the demonstration, users could interrupt GPT-4o during a response, and it would stop, listen, and adjust.","excerpt":"You could interrupt the model during its responses, and it would stop, listen, and adjust course.","support":"source-stated"},{"text":"The report notes glitches during the live demonstration, including awkward interruptions and an unsolicited comment about a presenter’s outfit.","excerpt":"GPT-4o’s voice might jump in awkwardly during the conversation. It appeared to comment on one of the presenters’ outfits even though it wasn’t asked to.","support":"source-stated"},{"text":"The report says it was unclear how many interactions free users would get before being charged.","excerpt":"though it’s not yet clear how many interactions you’ll be able to have with the model before being charged.","support":"source-stated"}],"limitations":["The report’s evidence for the described interaction and capabilities is a live demonstration; it does not establish performance outside that setting.","Text as retrieved on November 3, 2026; originally published May 13, 2024."],"mediaId":null,"correctionReason":null,"id":"78837683568f91dd6b0f4e8362d19c43ec626119980c6af6a3f4c52884d467ea","publicationId":"1558ac55-e529-7132-6aa5-e70733afbcb5","version":1,"sourceUrl":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","sourceTitle":"OpenAI’s new GPT-4o lets people interact using voice or video in the same model","publisher":"MIT Technology Review","publishedAt":"2024-05-13T19:27:57Z","originalPublished":{"value":"2024-05-13T19:27:57Z","precision":"instant","basis":"backfill:api_published"},"firstObservedAt":"2026-11-03T18:02:07.249Z","createdAt":"2026-11-18T17:53:10.250Z","historical":true,"entityIds":[],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.technologyreview.com/2024/05/13/1092358/openais-new-gpt-4o-model-lets-people-interact-using-voice-or-video-in-the-same-model/","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"0cd2785a4412a868c45ea702b0866e63685f32519a5a37c457c088f075cd1ff8","rubricVersion":"unrecorded","provider":"anthropic","model":"claude-opus-5-5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-11-03T18:02:04.034Z"},"provenance":{"textHash":"c5076149e6f87864c9ffda17007e09ff903253881e278546facc939125d4eeee","observationId":"632820afe19178e9133715030dd85a98be48ff719ed8bb2e66fc31358c6b0f67","retrievedAt":"2026-11-03T18:03:20.769Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"ff6ce058-04ec-6147-1b9d-224d59b17018"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"5630a103-bce5-4b0b-29db-e8ff6531f7c4"}},"audit":{"status":"passed","reviewedAt":"2026-11-18T17:48:24.766Z","model":"anthropic/claude-opus-5.5"}}}],"audits":[{"publicationId":"1558ac55-e529-7132-6aa5-e70733afbcb5","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading consistently attributes the report to MIT Technology Review and the statements to OpenAI and CTO Mira Murati. The evidence is a single news article, not a listing.","excerpt":"OpenAI CTO Mira Murati led the live demonstration of the new release"},{"dimension":"summary","status":"pass","explanation":"The reading clearly states the actor (OpenAI), the development (one model combining voice, video and text), the demo highlights, the glitches and the access changes in plain language. The Siri/Alexa comparison is fairly paraphrased as the demonstration's suggestion. The question reflects an open issue the source raises. The reading needs no further context to be understood.","excerpt":"The result, the company’s demonstration suggests, is a conversational assistant much in the vein of Siri or Alexa but capable of fielding much more complex prompts."},{"dimension":"date","status":"pass","explanation":"May 13, 2024 matches the UTC day of originalPublished. The page was modified on 2024-05-14. The correction note concerns only the Memory feature, which the reading does not use. All the cited passages are plainly body text of the original article. The later sidebar items (e.g., on AlphaGo's ten-year anniversary) are neither used nor relied on. No hindsight framing appears.","excerpt":"Correction: This story has been updated to reflect that the Memory feature, which stores past conversations, is not new to GPT-4o but has existed in previous models."},{"dimension":"support","status":"pass","explanation":"Each claim is directly supported by its quoted excerpt. The summary's statements about the paywall shift, the capacity limits and the unclear free-tier limits match the source. The limitation that the evidence comes from a live demo is a fair caveat and not an unsupported inference.","excerpt":"Previously, many of OpenAI’s most powerful features, like reasoning through image and video, were behind a paywall."},{"dimension":"media","status":"pass","explanation":"No media was selected and no verified candidate media were supplied, so there is no identity or relevance issue.","excerpt":null}],"createdAt":"2026-11-18T17:48:24.766Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}