Chest X-rays contain information that can be harvested with AI

Study finds chest X-rays contain ‘hidden’ information that can be harvested with artificial intelligence to predict long-term mortality

BOSTON – The most frequently performed imaging exam in medicine “the chest X-ray” holds ‘hidden’ prognostic information that can be harvested with artificial intelligence (AI), according to a study by scientists at Massachusetts General Hospital (MGH). The findings of this study, to be published in the July 19, 2019 issue of JAMA Network Open, could help to identify patients most likely to benefit from screening and preventive medicine for heart disease, lung cancer and other conditions.

AI technology automates many aspects of our daily lives, such as your smartphone’s speech-recognition function, photo tagging on social media, and self-driving cars. AI is also responsible for major advances in medicine; for example, several groups have applied AI to automate diagnosis of chest X-rays for detection of pneumonia and tuberculosis.

If this technology can make diagnoses, asked radiologist Michael Lu, MD, MPH, could it also identify people at high risk for future heart attack, lung cancer, or death? Lu, who is director of research for the MGH Division of Cardiovascular Imaging and assistant professor of Radiology at Harvard Medical School, and his colleagues developed a convolutional neural network, a state-of-the-art AI tool for analyzing visual information, called CXR-risk. CXR-risk was trained by having the network analyze more than 85,000 chest X-rays from 42,000 subjects who took part in an earlier clinical trial. Each image was paired with a key piece of data: Did the person die over a 12-year period? The goal was for CXR-risk to learn the features or combinations of features on a chest X-ray image that best predict health and mortality.

Next, Lu and colleagues tested CXR-risk using chest X-rays for 16,000 patients from two earlier clinical trials. They found that 53% of people the neural network identified as “very high risk” died over 12 years, compared to fewer than 4% of those that CXR-risk labeled as “very low risk.” The study found that CXR-risk provided information that predicts long-term mortality, independent of radiologists’ readings of the x-rays and other factors, such as age and smoking status.

Lu believes this new tool will be even more accurate when combined with other risk factors, such as genetics and smoking status. Early identification of at-risk patients could get more into preventive and treatment programs. “This is a new way to extract prognostic information from everyday diagnostic tests,” says Lu. “It’s information that’s already there that we’re not using, that could improve people’s health.”

###

Co-authors of the JAMA Network Open paper are Michael T. Lu, MD, MPH, director of research for the MGH Division of Cardiovascular Imaging and assistant professor of Radiology at Harvard Medical School; Alexander Ivanov, BS, clinical research coordinator of MGH’s Cardiac MR PET CT Program; Thomas Mayrhofer, PhD, a lecturer at HMS and a professor of Economics at Stralsund University of Applied Sciences in Germany; Ahmed Hosny, MS, of the department of Radiation Oncology, Dana-Farber Cancer Institute; Hugo J.W. L. Aerts, PhD, director, Computational Imaging and Bioinformatics Laboratory (CIBL) and associate professor at Harvard University; Udo Hoffmann, MD, MPH, director of the Cardiac MR PET CT Program, MGH and a professor of Radiology at HMS.

About the Massachusetts General Hospital

Massachusetts General Hospital, founded in 1811, is the original and largest teaching hospital of Harvard Medical School. The MGH Research Institute conducts the largest hospital-based research program in the nation, with an annual research budget of more than $925 million and comprises more than 8,500 researchers working across more than 30 institutes, centers and departments. In August 2018 the MGH was once again named to the Honor Roll in the U.S. News & World Report list of “America’s Best Hospitals.”