Prépublication · 2026
AutoScaffold: AI-Guided Scaffolding for Reinforcement Learning of Language Models
Zijian Zhang, Rizhen Hu et al. — Monde
Source : arXiv
Résumé
Reinforcement learning with verifiable rewards (RLVR) produces rich training experience, yet outcome rewards reduce each attempt to a single number and leave most of this information unused. Training-time scaffolds, such as strategies or hints added to the prompt during training, offer a natural way to turn this information into guidance, but their design and adaptation are largely left to humans and tailored to specific domains. We introduce AutoScaffold, a unified AI-for-AI framework that turns a student's training experience into adaptive scaffolds, with minimal domain-specific information…