Nouveau Recherche PDF, HTML, DOCX et bien d'autres formats.

Prépublication · 2026

Ambient LLMs: Data-Efficient Supervised Fine-tuning via Temperature Matching

Giannis Daras, Marios Papachristou et al. — Monde

Source : arXiv

Résumé

Collecting large-scale, diverse, and high-quality post-training datasets for autoregressive language models is challenging. Consequently, Supervised Fine-Tuning (SFT) is typically applied to datasets significantly smaller than those used for pre-training, which leads to overfitting and the catastrophic forgetting of the tails of the data distribution. To prevent this collapse, we introduce Ambient SFT, a principled framework for leveraging imperfect predictions to augment the fine-tuning set. In our method, a "frozen" version of the pre-trained model serves as a noisy teacher that the fine-tun…

Actions

Citation