Prépublication · 2026
MM-SystemOneBias: Evaluating Bias in Multimodal Jev-Style System One Decision Models
Jinzhe Li, Qi Wang et al. — Monde
Source : arXiv
Résumé
When multimodal decision models determine actions, moderation outcomes, or quality judgments, their reliability depends on preserving semantic decisions across presentation changes, ignoring irrelevant additions, and distinguishing information consistent with task evidence from information that conflicts with it. Existing evaluations study decision-interface biases and multimodal model behavior in separate settings, leaving no common protocol to compare multimodal decision models with their backbones on practical tasks. We introduce \textbf{MM-SystemOneBias}, which evaluates 13 models on 5,323…