Researchers assessed ChatGPT's ability to address the 50 most common misconceptions about vaccine safety.
By Vijay Kumar MalesuSep 6 2023Reviewed by Sophia Coveney In a recent study published in Human Vaccines & Immunotherapeutics, a group of researchers assessed Chat Generative Pre-trained Transformer 's ability to address the 50 most common misconceptions about vaccine safety and evaluate its alignment with established scientific evidence.
Despite its utility, there are concerns about its misuse, especially academically, prompting regulatory measures. Its wide accessibility also raises concerns about potential misuse in educational contexts. Three experts from WHO-CC-VSS, namely Siddhartha Sankar Datta, IR-C, and FM-T, took the responsibility of independently assessing the AI's responses. Their evaluations considered the accuracy and specificity of the answers in comparison to the latest scientific findings and recommendations provided by the WHO and other leading international bodies.
When measuring precision, most questions were answered accurately, with the majority of answers rated as either 'excellent' or 'good', receiving an average score of 9 out of 10. In terms of accuracy, the experts found that on average, 85.5% of the answers were spot-on, while 14.5% were deemed 'accurate but with gaps'.
To visually represent their findings, the team charted out results of evaluations on three parameters: veracity , precision , and an overall quality score from 1 to 10 .
United Kingdom Latest News, United Kingdom Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Taxpayers should foot the bill if EU demands efficient removal of pharmaceuticals from wastewaters, say researchersThe public sector should pay if EU demands efficient removal of pharmaceuticals from wastewaters, according to researchers at the Center for Antibiotic Research, CARe, at the University of Gothenburg. Their argumentation analysis, published in the journal Public Health Ethics, raises important questions of responsibility.
Read more »
Researchers receive $2.5 million award to develop a tailored treatment for glioblastomaA multidisciplinary team of investigators from the UCLA Jonsson Comprehensive Cancer Center was awarded a $2.5 million Translational Team Science Award from the Department of Defense to develop a tailored treatment for glioblastoma, a deadly brain tumor with limited treatment options.
Read more »
Researchers design machine learning models to better predict adolescent suicide and self-harm riskArtificial intelligence can help to identify risk factors for suicide and self-harm, according to new research from UNSW Sydney.
Read more »
Cancer cases in younger people rising globally, researchers sayThe study estimated a 79 rise of cases in those aged under 50 between 1990 and 2019.
Read more »
Cancer cases in younger people rising globally, researchers sayThe study estimated a 79 rise of cases in those aged under 50 between 1990 and 2019.
Read more »