A new computational method promises to sharpen one of the most fiddly tasks in modern microbiology: telling apart the many kinds of proteins that power CRISPR immune systems in bacteria and archaea. In a study published in BMC Bioinformatics, researchers at Northwest A&F University in Yangling, China, describe PrePssmCas, a machine learning classifier that fuses two very different ways of reading a protein sequence and, in doing so, outperforms seven existing tools for classifying CRISPR-Cas systems. On an independent validation set, the method reached an accuracy of 97.98 percent and a Matthews correlation coefficient of 0.962, improving on the previous best method, CRISPRCasStack, by 3.91 percentage points in accuracy and 9.60 percentage points in MCC.
The stakes are higher than they might first appear. CRISPR and the Cas proteins that accompany it form the adaptive immune systems of prokaryotes, the vast group of single-celled organisms that dominate life on Earth. These systems store fragments of invading viruses and plasmids in the famous clustered regularly interspaced short palindromic repeats, then use them as molecular wanted posters to recognize and destroy foreign genetic material. Because different classes of Cas proteins perform different jobs within these systems, identifying which Cas proteins are present in a genome offers a route to classifying the whole system. The trouble is that direct experimental identification of CRISPR-Cas systems remains difficult, so computational classification carries much of the load, and its accuracy matters.
The core insight behind PrePssmCas is that no single numerical representation of a protein captures everything a classifier needs to know. The team therefore extracted two complementary families of features from Cas protein sequences. The first came from pre-trained protein language models, the deep neural networks that have transformed computational biology in recent years by learning statistical patterns from millions of sequences. The second came from position-specific scoring matrices, or PSSMs, a much older technique that encodes the evolutionary conservation of each position in a sequence by comparing it against related proteins in a database.
The language model side of the comparison was ambitious. The researchers systematically evaluated five pre-trained models: Prot_BERT, ALBERT, ProtXLNet, ProtT5 and ESM1b. Each of these models reads a protein sequence like a sentence and produces a high-dimensional vector, known as an embedding, for every amino acid in it. These embeddings encode information about structure, function and evolutionary context that the models absorbed during training on vast protein databases. On the PSSM side, the team compared six different variants, methods that compress the raw scoring matrix into fixed-dimensional descriptors that a classifier can consume. The raw PSSM itself has dimensions that scale with protein length, which makes it unwieldy for machine learning, so the compression step is where much of the engineering happens.
After systematic comparison, a clear winner emerged: embeddings from ESM1b, the protein language model developed by Meta’s fundamental AI research group, combined with a PSSM variant called RPM-PSSM gave the most comprehensive representation of Cas proteins. The researchers also incorporated an attention-based aggregation strategy, a mechanism that lets the model learn which parts of a sequence deserve the most weight when building its final representation. Attention has become a cornerstone of modern deep learning, and its use here reflects a broader trend of importing techniques from natural language processing into protein analysis.
Fusing the two feature families produced a large pool of candidate descriptors, and not all of them carried useful signal. To distill the mixture, the team applied random forest-based feature selection, a technique that uses an ensemble of decision trees to score each feature by how much it contributes to accurate classification. The result was a compact 143-dimensional feature vector, comprising 87 features drawn from the pre-trained language model embeddings and 56 features from the RPM-PSSM representation. That reduction, from potentially thousands of dimensions down to 143, is what allows the final classifier to generalize rather than memorize, focusing on the descriptors that genuinely distinguish one type of Cas protein from another.
The performance gains were substantial. On the independent validation set, the selected features achieved 97.98 percent accuracy and an MCC of 0.962. The Matthews correlation coefficient is widely regarded as a more honest metric than raw accuracy because it accounts for all four cells of the confusion matrix and remains informative even when classes are imbalanced, as they typically are in biological datasets. An MCC above 0.95 indicates near-perfect agreement between predictions and ground truth. Crucially, the improvements were measured against CRISPRCasStack, itself a recent and strong baseline, meaning the gains are not merely the result of comparing against weak predecessors.
The benchmarking went further. PrePssmCas was evaluated against seven existing methods: HMMCAS, CASPredict, CRISPRone, CRISPRCasFinder, CRISPRCasTyper, CRISPRloci and CRISPRCasStack. These tools represent a range of strategies, from hidden Markov models that capture profile signatures of protein families to more recent machine learning pipelines. On the independent validation set, PrePssmCas outperformed all of them, a result the authors attribute to the complementary nature of the fused features. Language model embeddings excel at capturing deep semantic patterns learned across the protein universe, while PSSM-derived features anchor the predictions in the specific evolutionary history of each sequence, and the combination appears to cover blind spots that neither approach addresses alone.
The work also contributes to a lively debate in computational biology about whether large pre-trained language models have made classical sequence analysis techniques obsolete. The answer from this study is a qualified no. Although the ESM1b embeddings contributed the larger share of the final feature vector, more than half of the selected dimensions came from the language model, the 56 RPM-PSSM features that survived selection clearly added discriminative power that the embeddings alone did not provide. Evolutionary profiles, computed by aligning a query sequence against a database of homologs with tools like BLAST, encode information about which positions tolerate mutation, and that information is not always fully captured by a language model trained on sequences without explicit alignment data. The fusion framework suggests that the most powerful classifiers of the near future will be hybrids rather than replacements.
The authors are candid about the limits of their achievement. They note that the generalization of PrePssmCas to large-scale datasets and to remotely homologous sequences, proteins whose similarity to known Cas proteins is so distant that standard detection methods struggle, remains to be established. This is a familiar caveat in protein classification, where models trained on curated datasets can falter when confronted with the messy diversity of real genomic data, particularly the rapidly evolving catalog of CRISPR-Cas variants being discovered through metagenomics. Still, the researchers frame their contribution as both a practical tool for classifying CRISPR-Cas systems and a promising feature-fusion framework that could support future Cas protein discovery, potentially helping biologists spot novel defense systems hiding in the growing torrent of microbial genome sequences. The study, led by Ningyi Zhang with corresponding author Qianqian Shi, was conducted without dedicated funding and relied on the High-Performance Computing Center of Northwest A&F University, the publicly available ESM1b model and BLAST software, and the Gold Standard dataset for Cas protein analysis maintained by the research community.
Subject of Research: Machine learning classification of CRISPR-Cas proteins using fused pre-trained language model and PSSM features
Article Title: PrePssmCas: fusing pre-trained features and PSSM features for Cas protein classification
Article References: Zhang, N., Zhao, Y., Luo, C., Peng, Z., & Shi, Q. (2026). PrePssmCas: fusing pre-trained features and PSSM features for Cas protein classification. BMC Bioinformatics. https://doi.org/10.1186/s12859-026-06569-y
Image Credits: AI Generated
DOI: 10.1186/s12859-026-06569-y
Keywords: CRISPR-Cas, Cas proteins, protein classification, machine learning, ESM1b, protein language models, PSSM, feature fusion, bioinformatics, BMC Bioinformatics, random forest, deep learning
Cite Scienmag News
APA
MLA
Chicago
Juliet Wilcox. (September 26, 2026). AI Tool Fuses Language Models and Evolutionary Profiles to Classify CRISPR Cas Proteins. Scienmag. https://scienmag.com/ai-tool-fuses-language-models-and-evolutionary-profiles-to-classify-crispr-cas-proteins/
Juliet Wilcox. “AI Tool Fuses Language Models and Evolutionary Profiles to Classify CRISPR Cas Proteins.” Scienmag, 26 September 2026, https://scienmag.com/ai-tool-fuses-language-models-and-evolutionary-profiles-to-classify-crispr-cas-proteins/. Accessed 26 September 2026.
Juliet Wilcox. “AI Tool Fuses Language Models and Evolutionary Profiles to Classify CRISPR Cas Proteins.” Scienmag. September 26, 2026. https://scienmag.com/ai-tool-fuses-language-models-and-evolutionary-profiles-to-classify-crispr-cas-proteins/
Copy citation
Download RIS
Tags: accuracy improvement in CRISPR protein identificationbacterial immune system genomicsbioinformaticsbioinformatics in microbiologyBMC BioinformaticsCas proteinscomputational methods for protein classificationCRISPR protein classificationCRISPR-Cas system detection toolsCRISPR-Cas system diversityCRISPR/Casdeep learningdevelopment of bioinformatics classifiersESM1bevolutionary profile-based protein analysisfeature fusionMachine learningmachine learning in microbiologyprokaryotic immune system researchprotein classificationprotein language modelsprotein sequence reading techniquesPSSMRandom Forest
