The tendency of four commercial LLMs to perpetuate race-based medical misconceptions.
By Vijay Kumar MalesuOct 24 2023Reviewed by Lily Ramsey, LLM In a recent study published in npj Digital Medicine, a group of researchers assessed the tendency of four commercial Large Language Models to perpetuate race-based medical misconceptions in healthcare through systematic scenario analysis.Background Recent research highlights the efficacy of LLMs in fields like cardiology, anesthesiology, and oncology, offering human-like responses to medical inquiries.
Analyzed LLMs included two versions each of Google's Bard, OpenAI's ChatGPT and GPT-4, and Anthropic's Claude, tested from May to August 2023. Each model's responses were reset after every question to prevent learning from repetition, focusing instead on their inherent response tendencies. Related StoriesNotably, almost all models correctly identified race as a social construct without a genetic basis. However, there were instances, like with Claude, where a model later contradicted this accurate information, referring to a biological basis for race.
Responses to questions about pain thresholds were mixed, with some models, like GPT-4, correctly denying any difference, while others, like Claude, propagated baseless race-based assertions. However, all models respond accurately to questions about racial disparities in brain size, often identifying the notion as harmful and racist.
United Kingdom Latest News, United Kingdom Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Câpsula, a series of tiny homes, champions 'living large with less'Ellie Stathaki is the Architecture Editor at Wallpaper*. She trained as an architect at the Aristotle University of Thessaloniki in Greece and studied architectural history at the Bartlett in London.
Read more »
Large ethnicity gap in real living wage, report findsAlmost a third of Pakistani or Bangladeshi workers in London are on low pay, a new report finds.
Read more »
Oswestry named best British large town in national In Bloom competitionOswestry has been named the best blooming large town in Britain.
Read more »
Large bag of suspected cocaine washes up on Sussex beach in series of discoveriesArmed police have been guarding the consignment, thought to weigh around 30 kilos, which was found on the beach on Monday morning.
Read more »
New large-scale study results add to evidence that vestibular loss increases dementia riskExisting research shows a link between hearing loss and the risk of dementia, and a new study adds to growing evidence that vestibular loss can increase dementia risk as well. Results from this work, by a team from the Korea University College of Medicine, are published in Scientific Reports.
Read more »
Western leaders urge Israel to protect civilians as China warns of large-scale conflictIsrael has said it launched attacks on Hezbollah targets in southern Lebanon overnight
Read more »