KG-LSTM model diagnoses English learning behavior patterns with 92% accuracy in junior high school study

A model that combines an English-learning knowledge map with long short-term memory networks achieved an accuracy of 0.92 and a macro F1-score of 0.91 in a study of junior high school students’ online learning behavior. The research, published in Discover Artificial Intelligence, evaluated the model on three categories of observable learning difficulty: Lexical Retrieval Deficit, Syntactic Parsing Deficit and Discourse Coherence Deficit.

Using logs from the Lingual AB online English platform, the study examined sequences of student responses to vocabulary, grammar, reading and listening activities. The researchers reported recognition errors below 8% for each of the three categories, with 40 of 720 Lexical Retrieval Deficit cases, 60 of 840 Syntactic Parsing Deficit cases and 55 of 840 Discourse Coherence Deficit cases misclassified. The model’s F1-score across five-fold cross-validation was 0.91 ± 0.015, with a 95% confidence interval from 0.895 to 0.925.

The study involved 200 selected participants aged 12 to 15 whose platform records were collected from September 2023 through January 2024. The raw dataset contained 185,000 interaction records with 12 fields each, including timestamps, response time, correctness, help clicks, prompt views, answer revisions, retry counts and session identifiers. After cleaning and preprocessing, the dataset contained 188 users, approximately 172,000 logs and 9,380 samples. Each sample consisted of 20 consecutive interactions from one student.

Ground-truth labels were not generated automatically. Three senior English as a Second Language instructors, each with more than eight years of teaching experience, independently reviewed the final 20 interaction logs for each user against a rubric covering error frequency, response latency and help-seeking behavior. Lexical Retrieval Deficit required a vocabulary error rate above 40% and average response latency above 15 seconds; Syntactic Parsing Deficit required a grammatical error rate above 35% and clause-segmentation accuracy below 60%; and Discourse Coherence Deficit required a cross-sentence referential error rate above 30%. Fleiss’ Kappa was 0.83, and cases with disagreement, approximately 8%, were resolved through moderated consensus. The protocol received institutional review-board approval, and written informed consent was obtained from participants and their legal guardians.

The knowledge map contained 847 entities and 3,412 relationships, representing knowledge points, topic items and student nodes. Its relations included knowledge-point prerequisites, topic tests, student mastery and links between broader and narrower knowledge points. Entities and relations were represented with TransE embeddings, while two stacked LSTM layers with 128-dimensional hidden states processed normalized behavioral sequences. The fusion mechanism used cross-attention and a gate derived from each LSTM state to modulate the relevant knowledge embedding, rather than merely concatenating the two information sources.

Comparisons favored the combined model. Support Vector Machine and Random Forest baselines achieved accuracies of 0.78 and 0.82, respectively; GRU and single LSTM models reached 0.85 and 0.87; and the knowledge-graph-enhanced MLP reached 0.88. A Transformer baseline achieved 0.90, compared with 0.92 for the full KG-LSTM. Paired tests of five-fold F1 scores against the Transformer reported t(4) = 3.82, p = 0.019 and Cohen’s d = 1.52. Ablation results were lower when major components were removed: accuracy fell to 0.87 without the knowledge map, 0.86 without the LSTM and 0.84 without the fusion layer, while removal of attention produced an accuracy of 0.89.

The model also generated diagnostic paths linking behavioral evidence to specific knowledge nodes. In a worked example, the system recorded four weeks of vocabulary accuracy below 60%, an average grammar-filling response time of 18.6 seconds and seven to nine long sentences encountered in each reading passage. The knowledge map connected these recorded observations into a path from low vocabulary mastery through slower syntactic parsing to increased reading-processing load. After edge weights were combined, the syntactic-parsing path scored 0.84, compared with 0.76 for the lexical-retrieval alternative, so the system identified grammar difficulty as the main obstacle and reading comprehension as a secondary risk.

These findings apply to behavioral indicators observed in an online learning environment, not to clinically diagnosed specific learning disorders such as dyslexia. The authors describe persistent errors, prolonged response times and unusual help-seeking behavior as early-warning signals and quantitative references, not substitutes for formal clinical assessment. The practical application scenarios in online and classroom settings were presented as potential uses rather than interventions validated in the study.

Several limitations constrain the results. The model was tested on data from one platform and one age group, and the study did not empirically validate classroom deployment or teaching interventions. Platform-specific logging standards, privacy protection, and inference speed at high concurrency remain deployment challenges; the paper reports that latency could exceed 300 milliseconds with more than 500 concurrent users and that direct transfer to other schools or age groups could reduce accuracy by 3% to 6%. The framework also assumes that the knowledge graph and relevant entity attributes are complete. Future work is proposed to address cross-platform validation, incomplete graphs, richer relation types, larger samples and alternative sequence-model architectures.

Subject of Research: A KG-LSTM model for classifying behavioral English-learning difficulty patterns from online platform logs

Article Title: Intelligent diagnosis method of English learning disabilities based on knowledge mapand long-term and short-term memory network

Article References: Lin, C. (2026). Intelligent diagnosis method of English learning disabilities based on knowledge mapand long-term and short-term memory network. Discover Artificial Intelligence, 6(1), Article 1281. https://doi.org/10.1007/s44163-026-02095-1

Image Credits: AI Generated

DOI: 10.1007/s44163-026-02095-1

Keywords: English learning difficulty, knowledge graph, LSTM, behavioral data, online learning, diagnostic model, junior high school, interpretable AI, cross-validation, Intelligent, diagnosis, method