Prépublication · 2026
Better Answers, Weaker Evidence Control: Evidence Bypass in On-Policy Distillation
Ruoran Xu, Yilun Zhao et al. — Monde
Source : arXiv
Résumé
On-policy distillation (OPD) can improve answer accuracy while weakening responsiveness to supporting evidence. We investigate this separation in scientific-document question answering through matched document interventions that change the supported answer while preserving the question and unrelated context. We identify evidence bypass: a student retains an originally correct answer after the document changes to support a different one. On QASPER with a Qwen3-4B student, standard OPD raises original-document accuracy by 3.4 percentage points, lowers counterfactual accuracy by 5.3 points, and i…