Deep Learning Meets Multi-Objective Optimization to Grade Vocational Teaching Quality

Vocational education sits at the intersection of economic competitiveness and individual opportunity, yet the way institutions judge the quality of their teaching has barely changed in decades. Student questionnaires, manual classroom observations and a handful of performance metrics still dominate, offering at best a fragmented snapshot of what happens between instructor and learner. A new study published in Discover Artificial Intelligence by Kuiliang Fu of Nanjing City Vocational College proposes a far more ambitious approach: a hybrid artificial intelligence framework that combines deep convolutional networks with a multi-objective evolutionary optimizer to evaluate and improve teaching quality across several competing criteria at once.

The core problem Fu set out to solve is one that has long frustrated educational researchers. Teaching quality is not a single number. It is a tangle of partially conflicting goals: keeping students engaged, raising academic achievement, maximizing instructional effectiveness and using institutional resources efficiently. Improving one of these dimensions can easily come at the expense of another. Traditional evaluation pipelines, which typically collapse everything into one weighted score, hide these trade-offs. Machine learning models described in earlier literature, including deep neural networks, convolutional classifiers and genetic-algorithm-based optimizers, generally optimized a single objective or relied on static indicator sets, leaving the multi-dimensional nature of the problem unaddressed.

The proposed system, called MODE–DCN, attacks the problem in two complementary stages. The first stage is a Deep Convolutional Network, a class of neural network best known for image recognition but here applied to tabular educational data. The network consists of two one-dimensional convolutional layers with 64 and 128 filters and a kernel size of three, followed by max-pooling and two fully connected layers ending in a Softmax output. The convolutional filters slide across the reduced feature sequence, learning nonlinear interactions between educational indicators that simpler models such as support vector machines, random forests or gradient-boosted tree ensembles cannot capture, because those models process features independently at each split rather than jointly.

Before any learning begins, the raw data passes through a carefully layered preprocessing pipeline. The study used a publicly available Teaching Quality Evaluation Dataset from Kaggle containing 1,000 evaluation instances, each describing a specific teacher, course and semester, with ten input attributes and a four-class target variable labeled Excellent, Good, Average or Poor. Records were checked for missing values and duplicates, categorical variables were encoded numerically, and the features were normalized with Min–Max scaling and standardized with Z-scores. Principal component analysis then compressed the feature space from eleven dimensions down to eight, and recursive feature elimination pruned the set further to the six most informative attributes. The authors stress that these two techniques complement rather than duplicate each other: PCA removes linear redundancy based on variance, while RFE performs supervised selection of task-relevant features, leaving the convolutional network free to learn nonlinear structure.

The second stage is where the framework earns its name. A Multi-Objective Decision Evolution algorithm, inspired by Differential Evolution, searches for the best configuration of the network’s hyperparameters, including the number of filters, kernel size, dropout rate and learning rate, together with a mask selecting which features to use. The optimizer works with a population of candidate solutions, each encoded as a decision vector. In each generation it applies mutation, in which a scaled difference between two randomly chosen individuals is added to a third, and crossover, which mixes parental and mutant vectors into trial solutions. Crucially, the algorithm does not rank candidates by a single scalar score. Instead it uses fast non-dominated sorting to arrange solutions into Pareto fronts and crowding distance to preserve diversity, so that the search converges toward a set of optimal compromises rather than one narrow answer.

Four objective functions guide that search. The first minimizes classification error on validation data, serving as a proxy for academic performance. The second minimizes an engagement-weighted cross-entropy loss, in which each student’s prediction error is scaled by a weight derived from their normalized engagement score, so the model is penalized more heavily for failing students who are highly engaged. The third measures the standard deviation of validation accuracy across folds, capturing teaching effectiveness as prediction stability. The fourth balances model complexity, measured by the number of trainable parameters, against training time, reflecting operational efficiency. The optimizer explored filters between 16 and 128, kernel sizes from 2 to 5, dropout rates from 0.1 to 0.5 and learning rates from 0.0001 to 0.01, ultimately settling on a population size of 30, a mutation factor of 0.5 and a crossover rate of 0.9.

The results are striking. On a held-out test set of 200 instances, the MODE–DCN model achieved 98.5 percent accuracy, 96.3 percent precision, 95.8 percent recall and a 96.6 percent F1-score, while the mean squared error fell to 14.67, compared with 56.41 for a gradient descent method and 22.63 for a backpropagation neural network with a random matrix model. The confusion matrix showed near-perfect separation across the four quality classes, with only a handful of errors, such as four Excellent cases misclassified as Good. Receiver operating characteristic analysis produced area-under-curve values above 0.99 for every class, and five-fold cross-validation with a paired t-test confirmed that the improvements over the strongest baseline were statistically significant at p below 0.001.

The framework also proved its mettle against re-implemented baselines under identical conditions, including the same data split, preprocessing pipeline and evaluation metrics. Models such as LSTM combined with CNN, KNN and a multi-source data CNN reached accuracies between 89.4 and 94.2 percent, all well short of the hybrid model. An ablation study reinforced the point: removing the MODE optimization stage caused the largest performance degradation, demonstrating that the evolutionary search over hyperparameters and features, rather than the network architecture alone, drives much of the gain. When the model was re-implemented on three external datasets, accuracy dropped to a range of 90.8 to 93.1 percent, a candid acknowledgment by the author that generalization across different educational domains remains a challenge requiring domain-specific calibration.

Interpretability, often the Achilles heel of deep learning in high-stakes settings, receives explicit attention. The study employs SHAP, or SHapley Additive exPlanations, as a post-training analysis tool to quantify how much each feature contributes to individual predictions. The beeswarm analysis identified teacher evaluation scores, student averages and technology integration scores as the three most influential drivers of the model’s judgments, giving administrators a transparent rationale rather than an opaque verdict. The Pareto-optimal solutions are further aggregated into a Teaching Quality Index, computed as a weighted sum of the objective functions with equal weights by default, and presented through an institutional decision dashboard that ranks instructor performance and surfaces engagement metrics. Because this index is applied after optimization, institutions can adjust the weights to reflect their own policy priorities without invalidating the underlying Pareto set.

The implications reach beyond vocational colleges. As education systems worldwide digitize their records, the combination of deep feature learning and Pareto-based optimization offers a template for any assessment problem where multiple legitimate goals pull in different directions, from curriculum design to faculty development. Fu notes that practical deployment will demand adequate hardware, staff training and ongoing model maintenance, and that future work should incorporate live classroom data from multiple institutions to validate and refine the model over time. For now, the study stands as a persuasive demonstration that the messy, contested question of what makes teaching good can be rendered measurable, optimizable and, perhaps most importantly, explainable.

Subject of Research: Deep learning and multi-objective optimization for assessing vocational education teaching quality

Article Title: Vocational education teaching quality assessment based on deep learning and multi-objective optimization decision algorithms

Article References: Fu, K. (2026). Vocational education teaching quality assessment based on deep learning and multi-objective optimization decision algorithms. Discover Artificial Intelligence, 6(1), Article 1342. https://doi.org/10.1007/s44163-026-02336-3

Image Credits: AI Generated

DOI: 10.1007/s44163-026-02336-3

Keywords: deep learning, multi-objective optimization, vocational education, teaching quality assessment, convolutional neural networks, Pareto optimization, feature selection, PCA, recursive feature elimination, SHAP interpretability, educational data mining, Differential Evolution