Prépublication · 2026
Auditing black-box clinical prediction models with a large language model through queries alone: a blinded test with planted flaws
Zhiyu Liu, Xinyu Yang — Monde
Source : arXiv
Résumé
Large language models (LLMs) are used to explain clinical prediction models, on the promise that they can say what a model computes, find its faults and even reveal new knowledge in it. We tested the three promises where the answers could be checked. From the International Stroke Trial we trained four kinds of model (logistic regression, explainable boosting machine, gradient-boosted trees, neural network) for two outcomes on patients randomised earlier, planted one flaw in each of 24 copies (an under-predicted subgroup, a reversed risk factor or an implausible step) and mixed them with the 8…