Nouveau Recherche PDF, HTML, DOCX et bien d'autres formats.

Prépublication · 2026

Search-by-Answer Bias in Retrieval Models

Adiel Avigad, Shauli Ravfogel et al. — Monde

Source : arXiv

Résumé

Dense retrievers are meant to select passages that match a query's semantic specification. We show they suffer from search-by-answer bias: they favor passages that mention answer objects the model knows (scores as likely), over passages that support valid alternative answers. We test this with controlled factual contrasts from LAMA/TREx. For each retriever, we measure how strongly the model scores the canonical object over an alternative object using a token-prediction head, and ask whether this score predicts passage rankings. Across eight retrievers, including DPR, Spider variants, Contrieve…

Actions

Citation