• HOME
  • NEWS
  • EXPLORE
    • CAREER
      • Companies
      • Jobs
    • EVENTS
    • iGEM
      • News
      • Team
    • PHOTOS
    • VIDEO
    • WIKI
  • BLOG
  • COMMUNITY
    • FACEBOOK
    • INSTAGRAM
    • TWITTER
Wednesday, November 18, 2026
BIOENGINEER.ORG
No Result
View All Result
  • Login
  • HOME
  • NEWS
  • EXPLORE
    • CAREER
      • Companies
      • Jobs
        • Lecturer
        • PhD Studentship
        • Postdoc
        • Research Assistant
    • EVENTS
    • iGEM
      • News
      • Team
    • PHOTOS
    • VIDEO
    • WIKI
  • BLOG
  • COMMUNITY
    • FACEBOOK
    • INSTAGRAM
    • TWITTER
  • HOME
  • NEWS
  • EXPLORE
    • CAREER
      • Companies
      • Jobs
        • Lecturer
        • PhD Studentship
        • Postdoc
        • Research Assistant
    • EVENTS
    • iGEM
      • News
      • Team
    • PHOTOS
    • VIDEO
    • WIKI
  • BLOG
  • COMMUNITY
    • FACEBOOK
    • INSTAGRAM
    • TWITTER
No Result
View All Result
Bioengineer.org
No Result
View All Result
Home NEWS Science News Health

AI Models Differ When Classifying Cognitive Levels of Dental Exam Questions

by
November 12, 2026
in Health
Reading Time: 3 mins read
0
AI Models Differ When Classifying Cognitive Levels of Dental Exam Questions

AI Models Differ When Classifying Cognitive Levels of Dental Exam Questions

Share on FacebookShare on TwitterShare on LinkedinShare on RedditShare on Telegram

Large language models can classify the cognitive demand of dental specialty examination questions under certain educational frameworks but struggle under others, according to a study evaluating four publicly accessible artificial intelligence models. Researchers found that while systems such as Gemini and DeepSeek demonstrated substantial classification fidelity when evaluating multiple-choice questions under Revised Bloom’s Taxonomy and the SOLO Taxonomy, performance across all evaluated models remained weak when categorizing items according to Miller’s Pyramid. The findings demonstrate that educational taxonomies should not be treated as interchangeable frameworks in automated evaluation. Furthermore, the investigators reported that an artificial intelligence model’s classification fidelity across cognitive frameworks represents an independent capability that cannot be inferred from its answer accuracy alone.

Large language models are finding increasing applications within dental education, yet prior investigations have focused predominantly on whether these systems can correctly answer examination questions. Whether computational models can reliably identify the specific cognitive demand of assessment items has remained unclear.

The research team evaluated a dataset comprising two hundred endodontic multiple-choice questions taken from the Turkish Dentistry Specialty Examination, known as DUS, spanning the years 2012 through 2025. Each examination item was classified independently by four widely accessible models: ChatGPT, Gemini, Kimi, and DeepSeek. To establish an authoritative benchmark for comparison, the researchers developed a three-layer expert consensus reference standard. This rigorous evaluation framework incorporated formal calibration training, a procedural audit, and structured joint deliberation to establish consensus classifications across all three educational taxonomies for the evaluated questions.

To evaluate classification performance and agreement with the expert consensus standard, the investigators employed multiple statistical metrics. Agreement between model classifications and the expert standard was quantified using weighted Cohen’s kappa coefficients, designated as κw, with bootstrap 95 percent confidence intervals. Overall classification performance was measured using accuracy and macro-averaged F1 scores. To assess differences in item-level classification accuracy among the four models, the authors conducted Cochran’s Q tests accompanied by Kendall’s W, followed by pairwise McNemar tests adjusted with Holm–Bonferroni corrections to maintain statistical rigor across multiple comparisons.

The statistical analysis revealed significant inter-model differences in classification accuracy across all three educational taxonomies, with all omnibus comparisons reaching statistical significance at p < 0.001. Under Revised Bloom’s Taxonomy, Gemini and DeepSeek achieved substantial agreement with the expert consensus reference standard, recording weighted kappa values of 0.676 and 0.667, respectively. Under the SOLO Taxonomy, Gemini was the only model to achieve substantial agreement, registering a weighted kappa of 0.622, whereas DeepSeek, Kimi, and ChatGPT demonstrated moderate agreement.

In sharp contrast to the results on the first two taxonomies, classification performance on Miller’s Pyramid remained consistently weak across all evaluated systems, with agreement failing to exceed the fair threshold for any model. In this framework, ChatGPT recorded the highest performance with a weighted kappa of 0.372. This outcome produced a notable reversal in relative model rankings, as ChatGPT ranked lowest among the four models on Revised Bloom’s Taxonomy and the SOLO Taxonomy but highest on Miller’s Pyramid.

Beyond comparing model performance, the researchers identified a significant longitudinal trend within the examination dataset itself. Analysis revealed that the cognitive demand of the endodontic questions increased over time, as Revised Bloom levels assigned by the expert consensus reference standard showed a statistically significant positive correlation across examination years from 2012 to 2025, with a Spearman rank correlation coefficient of ρ = 0.301 (p < 0.001).

In their conclusions, the authors highlighted that artificial intelligence models exhibit meaningful classification fidelity for Revised Bloom’s Taxonomy and the SOLO Taxonomy, particularly when using Gemini or DeepSeek, but remain limited when applied to Miller’s Pyramid.

Subject of Research: Large language model classification fidelity across educational taxonomies in dental examination questions

Article Title: Classification fidelity of large language models on endodontic items from the Turkish dental specialty examination

Article References: Şen, B. H., Yekeler, A., Arpaçay, D. K., Ocak, J., & Akkoçan, O. (2026). Classification fidelity of large language models on endodontic items from the Turkish dental specialty examination. BMC Medical Education. https://doi.org/10.1186/s12909-026-10746-1

Image Credits: AI Generated

DOI: 10.1186/s12909-026-10746-1

Keywords: dental education, large language models, educational taxonomies, Revised Bloom's Taxonomy, SOLO Taxonomy, Miller's Pyramid, ChatGPT, Gemini, Classification, fidelity, large, language

News Source: Courtney Benton. (November 12, 2026). AI Models Differ When Classifying Cognitive Levels of Dental Exam Questions. Scienmag.

Tags: ChatGPTclassificationdental educationeducational taxonomiesfidelityGeminilanguagelargeLarge Language ModelsMiller's PyramidRevised Bloom's TaxonomySOLO Taxonomy
Share12Tweet7Share2ShareShareShare1

Related Posts

List Experiments in Nigeria Reveal Non-Medical Drug Use Among Agricultural Workers

List Experiments in Nigeria Reveal Non-Medical Drug Use Among Agricultural Workers

November 18, 2026
Chitosan-Based Nanoparticles Boost Anti-Diabetic Efficacy of Desert Snail Extract

Chitosan-Based Nanoparticles Boost Anti-Diabetic Efficacy of Desert Snail Extract

November 18, 2026

Health Students Share Similar Teamwork Attitudes After Community Interprofessional Training

November 18, 2026

Ethiopian Study Validates ReConnect Scale for Assessing Mental Health Personal Recovery

November 18, 2026

POPULAR NEWS

  • Copper Nanoparticles Enhance Corrosion Resistance in Direct-to-Metal Coatings

    Copper Nanoparticles Enhance Corrosion Resistance in Direct-to-Metal Coatings

    29 shares
    Share 12 Tweet 7
  • Electroacupuncture Modulates Hippocampal RNA Fusion Transcripts in Traumatic Brain Injury Rats

    29 shares
    Share 12 Tweet 7
  • Combined Malnutrition and Poor Quality of Life Elevate Digestive Cancer Mortality

    29 shares
    Share 12 Tweet 7
  • Meta-Learning Accelerates Microwave Hyperthermia Antenna Optimization in Proof-of-Concept Study

    29 shares
    Share 12 Tweet 7

About

We bring you the latest biotechnology news from best research centers and universities around the world. Check our website.

Follow us

Recent News

List Experiments in Nigeria Reveal Non-Medical Drug Use Among Agricultural Workers

Chitosan-Based Nanoparticles Boost Anti-Diabetic Efficacy of Desert Snail Extract

Health Students Share Similar Teamwork Attitudes After Community Interprofessional Training

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 88 other subscribers
  • Contact Us

Bioengineer.org © Copyright 2023 All Rights Reserved.

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • Homepages
    • Home Page 1
    • Home Page 2
  • News
  • National
  • Business
  • Health
  • Lifestyle
  • Science

Bioengineer.org © Copyright 2023 All Rights Reserved.