AI That Explains Itself: New Benchmark Reveals Which Neural Networks Truly See Pneumonia

Pneumonia remains one of the world’s deadliest infections, and chest X-rays are usually the first line of defense. But as radiology departments drown in images, hospitals are increasingly turning to deep learning to help flag suspicious scans. A new benchmarking study published in Applied Intelligence by researchers at Universidad Pablo de Olavide in Seville has now delivered a finding that could reshape how clinicians choose their AI: the best-performing neural networks are also the ones that explain themselves most faithfully, and that coupling survives even when the models are confronted with patients they were never trained on.

The research team, led by Francisco Gómez-Vela together with Aurelio López-Fernandez, Federico Divina and Miguel García-Torres, put six convolutional neural network architectures through an identical gauntlet: VGG16, ResNet50, DenseNet121, MobileNetV2, EfficientNetB0 and ConvNeXt-Tiny. Each was trained on the same pediatric chest X-ray dataset of 5,863 radiographs from Guangzhou Women and Children’s Medical Center, using the same optimizer, learning rate, batch size and early-stopping rules. That standardization matters, because most previous studies compared models trained under different conditions, making it impossible to tell whether performance differences came from the architecture or the training recipe.

The results upended some expectations. MobileNetV2, a lightweight network designed for smartphones rather than supercomputers, achieved the highest area under the ROC curve at 0.99, while DenseNet121, famous for its densely connected layers that recycle features across the network, matched it statistically across every metric. More surprising still, the venerable VGG16, a 2014 design with roughly 138 million parameters and no residual connections at all, took third place, beating both ResNet50 and the transformer-inspired ConvNeXt-Tiny. The researchers attribute this to the frozen-backbone transfer learning protocol: when the task does not demand deep domain-specific adaptation, architectural sophistication does not necessarily buy better predictions.

But raw accuracy was only half the story. The team went beyond the usual practice of eyeballing a few heatmaps and instead quantified explanation quality using five metrics: Deletion and Insertion AUC, which test whether the regions a model highlights actually drive its predictions; Sparsity and Entropy, which measure how focused those highlights are; and Stability SSIM, which checks whether explanations stay consistent when the input is perturbed. DenseNet121 came out on top across the board, producing attribution maps that were causally meaningful, compactly localized on lung tissue, and stable under noise.

The contrast cases were instructive. ResNet50 produced attribution maps that spread relevance almost uniformly across the image, so its explanations were numerically stable but essentially uninformative. EfficientNetB0 fared even worse: it collapsed deterministically to predicting a single class across all cross-validation folds, yielding a Matthews correlation coefficient of zero, and its gradient-based saliency maps came out entirely black. Perfect stability, the authors caution, can signal degenerate behavior rather than genuine robustness, a warning for anyone who equates consistent explanations with trustworthy ones.

To formalize the trade-off, the researchers introduced a Performance-Interpretability Index that multiplies a model’s AUC by the average of its Deletion and Insertion AUC scores. The multiplicative form deliberately penalizes models that classify well but explain poorly. Under this composite criterion, DenseNet121 ranked first, MobileNetV2 second, and VGG16 third, while ConvNeXt-Tiny and EfficientNetB0 sank to the bottom despite their modern pedigrees. The index offers hospitals a practical shortcut: instead of weighing accuracy against explainability as competing goals, they can select architectures that maximize both simultaneously.

The study’s most stringent test came from an unusual experimental design. The models were trained exclusively on pediatric X-rays, in which pneumonia typically appears as lobar consolidations or perihilar infiltrates, and then validated without any retraining on an independent adult dataset of over 15,000 images, where viral pneumonia manifests as bilateral ground-glass opacities in the lung periphery. This deliberate distributional shift simulates the demographic mismatch AI systems face in real deployment. DenseNet121 led the transfer with an external AUC of 0.83 and a recall of 0.98, while MobileNetV2 posted the best accuracy and F1-score with an AUC of 0.81. Crucially, the performance-interpretability ranking was preserved across populations.

The external validation also exposed a false friend. ResNet50, which had scored a respectable 0.96 internally, fell to an AUC of 0.43 on adult data, below random chance. The authors argue this is exactly the kind of hidden failure that explainability metrics can predict: ResNet50’s diffuse, unfocused attribution maps had already revealed that it was leaning on dataset-specific cues rather than transferable pathological features. High test performance without stable, localized explanations, they conclude, is a false positive of reliability.

The clinical implications are concrete. In triage settings where sensitivity is paramount, a model like DenseNet121, which rarely misses a true case, is the natural choice. In resource-constrained or point-of-care environments, MobileNetV2 offers nearly the same diagnostic power at a fraction of the computational cost, making it suitable for portable and real-time systems. VGG16’s strong internal showing but weaker cross-population generalization suggests its sheer parameter count encourages overfitting to the training distribution rather than learning transferable representations, a caution against equating model size with robustness.

The authors are careful to note the limits of their framework. All the explainability metrics are model-centric proxies that measure faithfulness to the network’s own reasoning, not to radiologist-annotated ground truth, and the study is a methodological benchmark rather than a clinical validation. Future work will extend the comparison to Vision Transformers, pursue prospective validation with radiologist annotations, and test how the lightweight architectures fare on edge devices. All code and data are publicly available, making this one of the first end-to-end reproducible pipelines that treats interpretability not as an afterthought but as a core criterion for deciding which AI deserves a place in the clinic.

Subject of Research: Benchmarking deep learning architectures and explainable AI for pneumonia detection in chest X-rays

Article Title: Performance-interpretability trade-offs and generalization in deep learning for pneumonia detection: A benchmarking study

Article References: Gómez-Vela, F., López-Fernandez, A., Divina, F., & García-Torres, M. (2026). Performance-interpretability trade-offs and generalization in deep learning for pneumonia detection: A benchmarking study. Applied Intelligence, 56(14), Article 414. https://doi.org/10.1007/s10489-026-07398-5

Image Credits: AI Generated

DOI: 10.1007/s10489-026-07398-5

Keywords: deep learning, pneumonia detection, chest X-ray, explainable AI, convolutional neural networks, model interpretability, benchmarking, generalization, medical imaging, DenseNet121, MobileNetV2, clinical AI