Nouveau Recherche PDF, HTML, DOCX et bien d'autres formats.

Prépublication · 2026

What Does a Bias Head Measure? Non-Identifiability in Head-Level Bias Attribution

S. M Seefat Alam — Monde

Source : arXiv

Résumé

Methods that localise social bias in large language models to individual attention heads and remove it by ablation are validated by their effect on a fairness metric, never by evidence that the statistic selecting the heads measures bias. We audit this on Qwen-2.5-7B-Instruct and Llama-3.1-8B-Instruct. The head map correlates at $ρ= -0.950$ and $-0.768$ with a label-blind response-length map, apparently identifying a surface confound. An intervention that breaks the length-label coupling rejects this reading: with the prompt held fixed, response length explains 1% of the statistic's variance.…

Actions

Citation