Two-phase swarm algorithm trims medical feature sets without losing accuracy

Medical machine learning often drowns in its own data. Clinical datasets routinely carry redundant, irrelevant, or tightly correlated variables, and every unnecessary feature inflates the cost of diagnosis, erodes interpretability, and invites overfitting. A new open-access study in Discover Artificial Intelligence by Chaimae Lazrak, Anas Bouayad, and Adnane Talha of Sidi Mohammed Ben Abdellah University in Fez, Morocco, tackles this problem with a carefully engineered twist on an established tool: a sequential hybrid metaheuristic that hands an evolved population of feature subsets from one optimization algorithm to another for refinement. The framework, published on 10 October 2026, is notable less for a dramatic accuracy breakthrough than for its statistical honesty about what such hybrids can and cannot deliver.

The core idea is a two-phase relay built on Talbi’s High-level Relay Hybridization taxonomy. In the first phase, one of three exploration-oriented metaheuristics searches the binary feature space: Particle Swarm Optimization (PSO), which mimics flocking behavior; Harris Hawks Optimization (HHO), which models cooperative hunting with an escaping-energy parameter that shifts the search from exploration to exploitation; or Brain Storm Optimization (BSO), which clusters candidate solutions the way human brainstormers group ideas. In the second phase, the Binary Al-Biruni Earth Radius algorithm (bABER) takes over. Inspired by the medieval scholar’s geometric method for estimating the Earth’s radius, bABER generates adaptive step sizes and splits its population into exploration and exploitation groups whose proportions shift linearly from 70 percent to 30 percent over its run, with a mutation operator rescuing any individual that stagnates for three consecutive iterations.

The link between the phases is a direct population-transfer strategy. Rather than reinitializing randomly or passing only summary information, the framework moves the entire evolved population from phase one into bABER, preserving individual-level structure and the search history embedded in it. Because the transfer copies every solution, it cannot by itself reduce population diversity; the real risk is stagnation during refinement, which bABER’s shifting exploration share and mutation mechanism are designed to counter. The transition point was set quantitatively rather than by eye: the base algorithms realize roughly 98 to 99 percent of their total fitness gain by iteration 60, so a 60/40 split of the 100-iteration budget leaves exploration essentially complete before refinement begins.

Every candidate subset is scored by a fitness function that weights classification accuracy at 0.99 and penalizes subset size with the remaining weight, evaluated by 5-fold cross-validation on the training partition with a fixed Random Forest classifier. The authors are unusually transparent about what that weighting actually buys. They derive an exchange rate showing how many features must be removed to offset a single cross-validation error: about 1.5 features per error on the Diabetes dataset, where the compactness term exerts genuine pressure, but over 16 on Parkinson’s, where it functions only as a tie-breaker among equally accurate subsets. Since all seven algorithms share the same objective, differences in subset size must come from search dynamics, not from the penalty itself.

Evaluation covered six benchmark medical datasets, from Parkinson’s disease voice measurements and PIMA diabetes records to breast cancer, cervical cancer, heart disease, and a 2,149-case Alzheimer’s dataset. The protocol is deliberately leakage-aware: 15 independent runs per algorithm per dataset, each with its own stratified 70/30 split, z-score scaling fitted only on training data, and no selection among runs using test performance. That yields 630 optimization runs in total, with all metrics reported as means and standard deviations. The authors even flag an implementation inconsistency they discovered: in PSO-bABER the phase-two schedule continues on the global iteration counter rather than resetting, an offset they report as observed rather than quietly re-running.

The statistical verdict is refreshingly sober. A Friedman test finds no significant difference in accuracy among the seven methods, and equivalence testing with a one-percentage-point margin confirms that each hybrid matches its base algorithm. The single nominally significant accuracy result, BSO-bABER over BSO at p = 0.031, carries a negligible effect size and does not survive Holm correction for multiple comparisons. What the statistics do support is an effect on compactness: the Friedman test on the number of selected features is significant at p = 0.015, and HHO-bABER selects fewer features than HHO on five of six datasets, with a mean reduction of about two features and the largest effect size in the study outside execution-time comparisons.

The clinical significance of that compactness effect should not be understated. HHO-bABER selects between roughly one and seven fewer features than HHO depending on the dataset, at unchanged accuracy, which translates directly into fewer measurements to acquire per patient when features are laboratory assays or biomedical voice recordings. On the imbalanced cervical cancer dataset, where a majority-class classifier would already score 93.4 percent accuracy, the hybrid variants also produce far more consistent subset sizes across runs than standalone bABER, whose aggressive reduction yields subsets varying by more than 100 percent of their mean. Reproducibility of the selected feature set matters for clinical trust, and the hybrids deliver it where the standalone algorithm does not.

There is a price. All three hybrids are significantly slower than their base algorithms on every dataset, with large effect sizes, because the refinement stage adds fitness evaluations dominated by cross-validated Random Forest training. HHO-bABER is the most expensive at roughly 881 seconds on average. Yet relative to standalone bABER, the PSO- and BSO-based hybrids are about 22 percent faster, and execution time scales mainly with the number of instances rather than features: an elevenfold increase in sample size across the benchmarks multiplied runtime by only about 1.3. A sensitivity analysis of the transition ratio found accuracy varies by at most about one percentage point across 40/60, 60/40, and 70/30 configurations, so the authors present their default as a reasonable choice within a broad plateau rather than an optimum.

The study is equally candid about its limits. The datasets span only 8 to 35 features, and the authors show that their scalarized fitness function would collapse to accuracy alone on high-dimensional gene-expression data, where the compactness penalty could never offset a single cross-validation error; a Pareto formulation or a filter stage would be needed there. Population states were not logged per iteration, so diversity preservation across the transfer could not be measured directly, and subset stability indices could not be computed retrospectively. All conclusions are conditional on a single fixed Random Forest, and validation on prospectively collected institutional clinical data remains necessary before any clinical claim.

What emerges is a template for how hybrid optimization studies should be reported. The framework itself is algorithm-agnostic: because the transfer operates on binary solution vectors rather than algorithm-specific internal states, any population-based explorer, from Grey Wolf to Whale Optimization, could be slotted into phase one without modification. The complete code, including split seeds and analysis scripts, is publicly available on GitHub and archived on Zenodo. In a field crowded with inflated claims of accuracy gains from algorithm stacking, this team’s conclusion that sequential hybridization is best understood as a way of obtaining more compact feature subsets at preserved accuracy, paid for in runtime, is exactly the kind of precise, falsifiable finding that makes medical machine learning incrementally more trustworthy.

Subject of Research: Sequential hybrid metaheuristic feature selection for medical machine learning using population transfer

Article Title: A sequential hybrid framework for medical feature selection using population transfer

Article References: Lazrak, C., Bouayad, A., & Talha, A. (2026). A sequential hybrid framework for medical feature selection using population transfer. Discover Artificial Intelligence, 6(1), Article 1429. https://doi.org/10.1007/s44163-026-02217-9

Image Credits: AI Generated

DOI: 10.1007/s44163-026-02217-9

Keywords: feature selection, metaheuristics, particle swarm optimization, Harris Hawks optimization, brain storm optimization, Al-Biruni Earth Radius algorithm, medical machine learning, Random Forest, hybridization, data leakage, statistical validation, clinical diagnostics