Nouveau Recherche PDF, HTML, DOCX et bien d'autres formats.

Prépublication · 2026

Represented but misread: Post-training changes how language models read out what they represent

Jochen Laubrock — Monde

Source : arXiv

Résumé

Does post-training change what a language model represents, or how this representation is read out into an answer? We compared linear probes with the models' own answers, analyzed with signal detection theory, in six open-weight base models and their post-trained versions. For judgments of whether German texts were written by a human or an AI, probes and word n-gram classifiers separated the classes well, but the answers did not and often ordered the texts inversely. Post-training lowered the sensitivity of the answers on average ($Δd' = -0.34$ across model families; -0.29 across three prompts…

Actions

Citation