AI Mockery Last week, OpenAI published the GPT-4o “scorecard,” a report that details “key areas of risk” for the company’s latest large language model, and how they hope to mitigate them. In one terrifying instance, OpenAI found that the model’s Advanced Voice Mode — which allows users to speak with ChatGPT — unexpectedly imitated users’ voices without their permission, Ars Technica reports. “Voice generation can also occur in non-adversarial situations, such as our use of that ability to generate voices for ChatGPT’s advanced voice mode,” OpenAI wrote in its documentation. “During testing, we also observed rare instances where the model would unintentionally generate an output emulating the user’s voice.” An appended clip demonstrates the phenomenon, with ChatGPT suddenly switching to an almost uncanny rendition of the user’s voice after shouting “No!” for no discernible reason. It’s a wild breach of consent that feels like it was yanked straight out of a sci-fi horror movie. “OpenAI just leaked the plot of Black Mirror’s next season,” BuzzFeed data scientist Max Woolf tweeted. Voice Clone In its “system card,” OpenAI describes its AI model’s capability of creating “audio with a human-sounding synthetic voice.” That ability could “facilitate harms such as an increase in fraud due to impersonation and may be harnessed to spread false information,” the company noted. OpenAI’s GPT-4o not only has the unsettling ability to imitate voices, but “nonverbal vocalizations” like sound effects and music as well. By picking up noise in the user’s inputs, ChatGPT may decide that the user’s voice is…ChatGPT Went Rogue, Spoke In People's Voices Without Their Permission

AI Mockery Last week, OpenAI published the GPT-4o “scorecard,” a report that details “key areas of risk” for the company’s latest large language model, and how they hope to mitigate them. In one terrifying instance, OpenAI found that the model’s Advanced Voice Mode — which allows users to speak with ChatGPT — unexpectedly imitated users’ voices without their permission, Ars Technica reports. “Voice generation can also occur in non-adversarial situations, such as our use of that ability to generate voices for ChatGPT’s advanced voice mode,” OpenAI wrote in its documentation. “During testing, we also observed rare instances where the model would unintentionally generate an output emulating the user’s voice.” An appended clip demonstrates the phenomenon, with ChatGPT suddenly switching to an almost uncanny rendition of the user’s voice after shouting “No!” for no discernible reason. It’s a wild breach of consent that feels like it was yanked straight out of a sci-fi horror movie. “OpenAI just leaked the plot of Black Mirror’s next season,” BuzzFeed data scientist Max Woolf tweeted. Voice Clone In its “system card,” OpenAI describes its AI model’s capability of creating “audio with a human-sounding synthetic voice.” That ability could “facilitate harms such as an increase in fraud due to impersonation and may be harnessed to spread false information,” the company noted. OpenAI’s GPT-4o not only has the unsettling ability to imitate voices, but “nonverbal vocalizations” like sound effects and music as well. By picking up noise in the user’s inputs, ChatGPT may decide that the user’s voice is…ChatGPT Went Rogue, Spoke In People's Voices Without Their Permission