Puma-Inspired Algorithm Sharpens Feature Selection for Machine Learning

Researchers at Yazd University in Iran have turned a big-cat-inspired optimization algorithm into a tool for one of machine learning’s most stubborn problems: deciding which features in a dataset actually matter. In a study published in Cluster Computing, Sayed Zabihullah Musawi, Mohammad Farshi, and Sepehr Ebrahimi Mood present a binary version of the Puma Optimization Algorithm, or POA, and show that it can strip away redundant data columns while preserving, and often improving, classification accuracy. Their best-performing variant reached a classification accuracy of 91.53 percent, outperforming both classical feature selection techniques and a roster of recently proposed metaheuristic rivals.

Feature selection sits at the heart of practical machine learning. Modern datasets can carry hundreds or thousands of candidate variables, ranging from sensor readings and network traffic statistics to gene expression levels. Many of those variables are irrelevant or redundant, and including them inflates computation time, increases memory demands, and can actively degrade model performance by encouraging overfitting. The goal of feature selection is to find the smallest subset of features that still allows a classifier to make accurate predictions. Mathematically, this is a combinatorial optimization problem: with n candidate features, there are 2^n possible subsets, a search space so vast that exhaustive evaluation becomes impossible even for moderately sized datasets.

This is where metaheuristics come in. These are stochastic search strategies, often inspired by natural processes, that explore large search spaces without guaranteeing a perfect solution but usually finding very good ones in reasonable time. The Puma Optimization Algorithm, first proposed in 2024, mimics the cooperative hunting strategies and social behavior of pumas, balancing exploration of new territory with exploitation of promising regions. It was originally designed for continuous optimization problems, where solutions are expressed as real-valued vectors. Feature selection, however, is inherently binary: each feature is either selected or not selected, represented as a one or a zero in a solution vector.

Bridging that gap is the central technical contribution of the new study. The researchers adapted POA to binary search spaces by integrating ten different transfer functions, mathematical mappings that convert the continuous positions generated by the puma-inspired update rules into probabilities of selecting or discarding each feature. Transfer functions come in several families, including sigmoid-based, hyperbolic tangent-based, and newer V-shaped and U-shaped forms, each with different characteristics regarding how aggressively they push probabilities toward zero or one. The choice of transfer function can dramatically affect how thoroughly the algorithm explores the binary space and how quickly it converges, which is why the authors systematically evaluated all ten rather than picking one arbitrarily.

The evaluation unfolded in three stages. First, the team identified which transfer function suited the binary POA best, with the Threshold Cut-off variant, abbreviated BPOATC, emerging as the strongest performer at 91.53 percent classification accuracy. Second, they benchmarked the algorithm against conventional feature selection methods, the classical filter and wrapper techniques that have long served as baseline tools in the field. Third, they compared it against leading metaheuristic competitors, including the Binary Slime Mould Algorithm, Binary Harris Hawks Optimization, Binary Flood Algorithm, Binary Chinese Pangolin Optimizer, and Binary Rüppell’s Fox Optimizer. Each of these rivals draws on a different natural metaphor, from the foraging networks of slime moulds to the cooperative ambush tactics of hawks, and each has been shown effective on feature selection in recent literature, making the comparison a demanding test.

Performance was measured across four criteria: classification accuracy, fitness value, the number of selected features, and computational time. The fitness function used in wrapper-style feature selection typically balances two competing objectives, rewarding high accuracy while penalizing large feature subsets, so a good algorithm must find solutions that are simultaneously accurate and compact. K-Nearest Neighbour served as the primary classifier during the search, with Support Vector Machine, Gaussian Naïve Bayes, and Logistic Regression used in further analysis to verify that the selected feature subsets generalize across different learning algorithms rather than being tuned to a single classifier’s quirks.

The results were consistent. BPOATC demonstrated superior performance compared with both traditional feature selection techniques and the state-of-the-art metaheuristics it was tested against. To guard against the possibility that observed differences were due to random variation, the authors applied the Friedman test, a non-parametric statistical procedure commonly used to rank multiple algorithms across multiple datasets and problem instances. The test outcomes confirmed the statistical superiority of the new algorithm, meaning its advantage over the competitors was unlikely to be a fluke of particular runs or datasets.

Perhaps the most practically significant part of the study is its validation on three real-world Intrusion Detection System datasets: NSL-KDD, UNSW-NB15, and UAV-IDS-2020. Intrusion detection is a domain where feature selection has immediate security value. Network traffic and drone telemetry data contain enormous numbers of features, and detection systems must classify traffic as benign or malicious in near real time. Fewer features mean faster inference, lower memory footprints on edge devices, and reduced exposure to noisy or manipulated inputs. The binary puma algorithm attained leading performance on UNSW-NB15 and UAV-IDS-2020 and near-optimal results on NSL-KDD, demonstrating that its advantages hold up on high-dimensional, security-critical data rather than only on curated benchmark repositories.

The work fits into a broader and rapidly accelerating trend. The past few years have seen a wave of nature-inspired optimizers adapted for feature selection, including algorithms modeled on dung beetles, gray wolves, plant rhizomes, fairy-wrens, chimps, and pangolins, alongside hybrid and multi-objective approaches that treat the accuracy-versus-subset-size trade-off more explicitly. Researchers have also applied these methods to demanding domains such as cancer gene expression data, microarray analysis, diabetes prediction, botnet detection, and wireless sensor networks. The proliferation reflects a genuine need: as datasets grow in dimensionality across science, medicine, and cybersecurity, the ability to automatically distill the informative signal from a sea of variables becomes a bottleneck for the entire machine learning pipeline.

For practitioners, the study offers a concrete new option in the feature selection toolbox, one whose puma-inspired dynamics appear to strike an effective balance between exploring the binary search space and exploiting the best solutions found so far. The datasets used in the evaluation are publicly available, and the authors report no competing interests and no external funding for the research. As machine learning systems are deployed in increasingly resource-constrained and security-sensitive settings, from drones detecting attacks to models screening medical data, algorithms that can automatically identify the few features that truly matter are likely to grow only more valuable. The binary puma, at least on the evidence of this study, is a formidable hunter in that search space.

Subject of Research: A binary puma-inspired metaheuristic algorithm for feature selection in high-dimensional machine learning classification and intrusion detection

Article Title: A novel binary puma optimization algorithm for feature selection problem

Article References: Musawi, S. Z., Farshi, M., & Ebrahimi Mood, S. (2026). A novel binary puma optimization algorithm for feature selection problem. Cluster Computing, 29(13), Article 755. https://doi.org/10.1007/s10586-026-06610-y

Image Credits: AI Generated

DOI: 10.1007/s10586-026-06610-y

Keywords: feature selection, Puma Optimization Algorithm, metaheuristics, machine learning, binary optimization, transfer functions, intrusion detection, classification accuracy, K-Nearest Neighbour, Friedman test, NSL-KDD, UNSW-NB15