Prépublication · 2026
Search-by-Answer Bias in Retrieval Models
Adiel Avigad, Shauli Ravfogel et al. — Monde
Source : arXiv
Résumé
Dense retrievers are meant to select passages that match a query's semantic specification. We show they suffer from search-by-answer bias: they favor passages that mention answer objects the model knows (scores as likely), over passages that support valid alternative answers. We test this with controlled factual contrasts from LAMA/TREx. For each retriever, we measure how strongly the model scores the canonical object over an alternative object using a token-prediction head, and ask whether this score predicts passage rankings. Across eight retrievers, including DPR, Spider variants, Contrieve…