←

Self-OPD: On-Policy Distillation for Flow Matching Models without Teacher

Research official 2 src. ~1 min

Removes the task-specific teacher from on-policy distillation of flow matching models by turning the student's own self-exploration into step-wise supervision: each deterministic next-state prediction branches into K stochastic SDE candidates scored against a self-reference baseline, with a pull-push objective attracting high-advantage branches and repelling low-advantage ones. Reports wins over prior RL and OPD methods on single and mixed reward benchmarks without any teacher.

Why it matters

66 upvotes; teacher-free self-distillation cuts the cost of aligning flow matching models

Importance: 3/5

notable paper, 66 HF upvotes

Sources

official arXiv 2608.26872