Study finds surprisingly harmful fabrications in OpenAI’s speech-to-text algorithm
By now, the tendency for chatbots powered by artificial intelligence to occasionally make stuff up, or “hallucinate,” has been well documented. Chatbots have generatedhas found that AI models are not only seeing things, but hearing things: OpenAI’s Whisper, an AI model trained to transcribe audio input, made up sentences in about 1.4% of the transcriptions of audio recordings tested. Disconcertingly, a large portion of the fabricated sentences contained offensive or potentially harmful text.
Generative chatbots rely on large language models , which take text prompts and produce outputs by predicting likely words based on patterns learned after training on billions of pages of text from books and webpages. The transcription systems combine those language models with audio models that learn representations of speech patterns.
About 40% of the fabricated segments were harmful or concerning in some way. About half of the concerning fabrications alluded to violence, sexual innuendo, or demographic stereotypes. For instance, audio about fire department rescues of cats included concocted additions about a “blood-soaked stroller” and “fondling.” Innocuous audio about an umbrella included fabrications about a “terror knife” and killing people.
United Kingdom Latest News, United Kingdom Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Grappling With AI and Health MisinformationAlthough artificial intelligence can improve diagnosis, its tendency to 'hallucinate' must be recognized and addressed.
Read more »
New study calls into question prior study results that found tumor transmission slowing in Tasmanian devilsA trio of biologists and veterinarians with CRG Barcelona, the University of Cambridge and The Barcelona Institute of Science and Technology, respectively, has found evidence contradicting results found by a prior team of researchers who claimed that they had found that tumor transmission in Tasmanian devils was slowing.
Read more »
Ad transparency tools are 'major disappointment' ahead of election, new study showsA new study concludes that ad transparency tools from major platforms like Google, Meta and X are insufficient for users and researchers.
Read more »
A new Olympic study challenges a flawed misconception about trans women in sportsKatelyn Burns is a freelance journalist based in New England. She was the first openly transgender Capitol Hill reporter in U.S. history.
Read more »
Simulated microgravity affects sleep and physiological rhythms, study findsSimulated effects of microgravity significantly affect rhythmicity and sleep in humans, a new study from the University of Surrey finds. Such disturbances could negatively affect the physiology and performance of astronauts in space.
Read more »
Semaglutide, gastric bypass delay weight loss plateau, study findsChloe Nordquist is a national journalist for the E.W. Scripps Company. She has a passion for telling community stories and giving a voice to the voiceless. Chloe has had the opportunity to report across the world, as far as Milan and Berlin. Previously she worked at news stations in California’s Central Valley and Southwest Florida.
Read more »