Nouveau Recherche PDF, HTML, DOCX et bien d'autres formats.

Prépublication · 2026

Risk-certified prompt optimization for LLM-as-a-judge guardrails

Hussein Jawad, Alexandre Landeau et al. — Monde

Source : arXiv

Résumé

LLM-as-a-judge guardrails are often controlled primarily through system prompts, yet standard prompt optimization methods target average performance rather than explicit safety constraints. This paper studies system-prompt selection as a constrained optimization problem: maximize benign pass rate while keeping the missed-attack rate below a user-specified level α with finite-sample statistical control. The framework combines LLM-based judging, automatic prompt generation, and distribution-free risk certification. This work instantiates it in two procedures: CPS and CRISP. CPS generates a fixed…

Actions

Citation