A research team funded by the National Institutes of Health (NIH) has developed a versatile machine learning model that could one day greatly expand what medical scans can tell us about disease.
National Institutes of Health Mar 4 2026 A research team funded by the National Institutes of Health has developed a versatile machine learning model that could one day greatly expand what medical scans can tell us about disease.
Scientists used their tool, named Merlin, to assess 3D abdominal computed tomography scans, accomplishing tasks as simple as identifying anatomical features to as complex as predicting disease onset years in advance. Despite being developed as a general-purpose CT model, Merlin surpassed a gauntlet of similar automated tools in tasks they were specifically built to handle. The team trained their model on a unique set of patient CT scans linked to radiology reports and medical diagnosis codes collected from the Stanford University School of Medicine. The researchers note that it is the largest collection of abdominal CT data to date. Rich datasets like this are necessary to push the limits of what artificial intelligence models can accomplish in medicine. This work exemplifies how meticulously crafted training data can enable remarkable insights that significantly streamline workflows and assist in clinical decision-making." Bruce Tromberg, Ph.D., Director of NIH's National Institute of Biomedical Imaging and Bioengineering CT is a common form of medical imaging, often performed in the early stage of medical evaluations. To obtain a diagnosis, a radiologist must interpret the results and, oftentimes, additional tests and clinical assessments are needed too. At baseline, this process is lengthy and only becomes more cumbersome when accounting for the growing shortage of physicians in the United States. "With Merlin, you could potentially go beyond traditional radiology and jump straight from imaging to a possible diagnosis. And that's just one potential use," said co-first author Louis Blankemeier, Ph.D., who conducted this work while a graduate student at Stanford University. Merlin represents a new class of models, commonly referred to as foundation models, that are trained using large-scale, unlabeled datasets, which span many kinds of information. In the new work, the researchers tested Merlin across six broad categories of activities, spanning more than 750 individual tasks that entailed diagnostics, prognostics, and quality assessment. To prepare Merlin for the wide breadth of tasks, the researchers initially trained it on their clinical data trove which connected more than 15,000 3D abdominal CT scans paired with their radiology reports and nearly one million diagnostic codes. Using this information as study material, Merlin learned about relationships between visual and written data. Related StoriesThe researchers then quizzed Merlin on more than 50,000 previously unseen abdominal CT scans - coming from one of four different hospitals - to learn how closely their model could match the human-produced conclusions associated with each scan. "Merlin tackled some tasks, such as predicting diagnosis codes, head-on, while other more complicated tasks, such as drafting radiology reports from scratch or identifying and outlining organs in a 3D space, called for additional training," said co-first author Ashwin Kumar, a graduate student at Stanford University. The team also deployed state-of-the-art models, specializing in each task type, to serve as points of comparison. On average across 692 different diagnostic codes, Merlin successfully predicted which of two scans was more likely to be associated with a particular code over 81% of the time, outperforming several variants of two other models. For a subset of 102 codes, Merlin's performance rose to 90%. In another category, the team pushed Merlin to predict the onset of chronic diseases, such as diabetes, osteoporosis, and heart disease, in healthy patients based solely on CT scans. The study authors found that, when comparing scans from different subjects, Merlin could identify patients who were at higher risk of developing a particular disease in the next five years 75% of the time, versus 68% for the other model. These findings hint that the model can detect key features in scans that may be lost to human eyes, suggesting that the tool could help identify new biomarkers for disease, Blankemeier explained. The researchers ramped up the difficulty further by challenging Merlin to interpret CT scans of the chest, a body part completely absent from its CT study material. Merlin's unique ability to identify generalizable features of disease allowed it to perform as well as or better than models trained exclusively on chest scans. Despite being a jack-of-all-trades, Merlin exceeded or matched the specialist models across all tasks. The authors attribute Merlin's magic touch to its architecture and training data, which allowed it to process complex 3D scans and build associations between visual and written information. The researchers have high hopes that their approach could soon leverage prior precedent to obtain regulatory approval for simpler tasks but also plan to refine Merlin to better handle more complicated challenges, such as report writing. While the tool is powerful out of the box, they encourage users to fine-tune the model with their own data to address their specific needs. "Our model and the data will provide the community a robust backbone to build upon," said senior author Akshay Chaudhari, Ph.D., a professor of radiology and biomedical data science at Stanford University. "From here, the sky's the limit." This research was supported by NIBIB through grants R01EB002524 and P41EB027060, by the Medical Imaging and Data Resource Center under contract 75N92020C00021, by the National Health, Lung, and Blood Institute through grants R01HL167974 and R01HL169345, and by the National Institute of Arthritis and Musculoskeletal and Skin Diseases through grants R01AR077604 and R01AR079431.Journal reference:Blankemeier, L., et al. . Merlin: a computed tomography vision–language foundation model and dataset. Nature. DOI: 10.1038/s41586-026-10181-8. https://www.nature.com/articles/s41586-026-10181-8
Artificial Intelligence Bioengineering Computed Tomography Diagnostic Imaging Language Machine Learning Medical Imaging Medical Research Medicine Ph Radiology Research Tomography
United States Latest News, United States Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
COVID-19 ARDS survivors face lasting disability and high late mortality, researchers reportIn this single-center ambispective cohort of 283 Polish patients with COVID-19–related ARDS requiring invasive mechanical ventilation, cumulative mortality reached 44.5% at four years after ICU admission. Among survivors, substantial proportions reported persistent functional limitations, insomnia, fatigue, and reduced quality-adjusted life years.
Read more »
Trump's Neck Rash Sparks Health Concerns Amidst Scrutiny of His Health and AgeFormer President Donald Trump's appearance at a Medal of Honor ceremony, marked by a visible red rash on his neck, has ignited widespread speculation about his health. Coupled with his age and previous health issues, this has intensified the public's attention and raised questions regarding his fitness.
Read more »
MPs Warn of 'National Scandal' as Women's Health is Failing: Calls for Urgent ReformsA cross-party report reveals that women and girls are being failed by the NHS and government, facing long waiting times, dismissed concerns, and inadequate information. The report calls for systemic change, highlighting the need for prioritized menstrual and gynaecological healthcare and the improvement of health education. It warns that a planned renewal of the Women's Health Strategy for England is 'inadequate' if it fails to address critical issues.
Read more »
Lawmakers, health groups resist their states’ rural health fund plansIn the final days of 2025, governors around the country trumpeted the hundreds of millions of federal dollars they won from a new, $50 billion rural health fund.
Read more »
Cardiologist says popular food can cause high blood pressureThe health expert explained that eating the popular sweet regularly could impact heart health
Read more »
Researchers identify TRIM13 protein as key driver of immune suppression in sepsisDendritic cells (DCs) are increasingly recognized as important contributors to sepsis-associated immune dysfunction.
Read more »