Computational study finds strong benchmark performance from attention-enhanced CNN–Transformer music-genre classifier

A computational study reports that CCTAF-MSR, an attention-enhanced CNN–Transformer model developed for audio-only music-genre recognition, achieved 86.40% precision, 88.99% recall and an 87.67% F1-score in comparisons on the GTZAN benchmark. The results were measured in model-training and testing experiments using log-mel spectrograms, rather than in a user study or a real-world deployment.

The model was designed to address limitations attributed to existing genre-recognition methods: mixed audio and MIDI classification tasks, inadequate modeling of spatiotemporal features, and incomplete reporting of experimental conditions. The authors restricted the task to recorded audio and provided fixed dataset partitions, standardized spectrogram preprocessing, optimizer settings, early stopping and measures intended to prevent data leakage.

CCTAF-MSR uses a single-pipeline architecture that begins with log-mel spectrograms measuring 128 mel-frequency bands across 1,024 time frames. A four-layer convolutional backbone extracts local spatial-spectral patterns. The Convolutional Block Attention Module then applies channel and spatial attention, while two stacked multi-head self-attention layers in a Transformer encoder model longer-range temporal dependencies. Global average pooling, fully connected layers and a softmax output produce genre probabilities.

The broader feature analysis considers rhythm, timbre and melody. The study describes Mallat discrete wavelet transform filtering for beat-related temporal variation, the Discrete Harmonic Transform for timbral characteristics, and normalized pitch-range statistics for melody. These methods are presented as complementary ways of representing musical information used in the recognition and ablation experiments.

GTZAN contains 1,000 audio segments of 30 seconds each, evenly distributed across blues, classical, country, disco, hip hop, jazz, metal, pop, reggae and rock. The researchers used a fixed stratified division of 70% for training, 15% for validation and 15% for testing. The test set was not used for training or hyperparameter optimization. The reported confusion matrix showed class-specific accuracies of 98% for reggae, 96% for metal, 94% for pop, 88% for rock and 86% for country; some country examples were classified as pop, reggae or rock.

The second evaluation dataset, ASAP, contains audio recordings of Western classical piano performances with an average sample duration of about 20 seconds. Only audio was used, while MIDI data and performance annotations were excluded. The dataset was divided into 80% training, 10% validation and 10% test subsets. With training and testing conducted separately for GTZAN and ASAP, CCTAF-MSR was reported on ASAP to have 85.30% precision, 88.92% F1-score and an AUC of 89.40%. These results concern performance within the two datasets, not a test of recognition on unseen audio from a different corpus.

Controlled ablations covered six GTZAN genres—blues, classical, country, disco, hip-hop and jazz—and compared harmonic mapping matrices with and without ground-truth pitch labels. Without the labels, matrices D1 and D2 produced better reported results for rock and dance music than for jazz, blues and classical music, while D4, D5 and D6 showed lower recognition for rock and disco but higher recognition for blues and classical; recognition of pop and jazz changed little. The authors said this pattern did not support a strong relationship between matrix order and overall accuracy, and that genre-specific scores were more sensitive to the order.

When ground-truth pitch-label matrices were used, jazz and pop reached reported scores of 0.965 and 0.949, respectively, exceeding their results with estimated pitch-label matrices. A separate feature ablation found that relying only on discrete wavelet transform, discrete harmonic transform or pitch statistics produced biased weight updates and degraded performance. The reported contribution order was discrete wavelet transform, followed by discrete harmonic transform and then pitch statistics; removing high-ambiguity samples also discarded important information and aggravated overfitting, according to the study.

The authors describe CCTAF-MSR as a lightweight framework that offers a favorable trade-off between recognition performance and computational efficiency, but the reported evidence comes from controlled benchmark experiments. The study does not establish performance on live music, diverse recording conditions or unseen corpora, and the separate GTZAN and ASAP experiments do not demonstrate deployment readiness. The authors identify inference-speed optimization for edge devices and extension to fine-grained genre recognition as future work.

Subject of Research: Evaluation of an attention-enhanced CNN–Transformer model for audio-based music-genre recognition on GTZAN and ASAP datasets

Article Title: Research on the application of a CNN–transformer model fused with convolutional attention mechanisms in music-genre recognition

Article References: Liu, Y. (2026). Research on the application of a CNN–transformer model fused with convolutional attention mechanisms in music-genre recognition. Discover Artificial Intelligence, 6(1), Article 1444. https://doi.org/10.1007/s44163-026-02079-1

Image Credits: AI Generated

DOI: 10.1007/s44163-026-02079-1

Keywords: music-genre recognition, CNN-Transformer, convolutional attention, log-mel spectrograms, GTZAN, ASAP dataset, music information retrieval, classification metrics, ablation study, Research, application, transformer