Hugging Face Daily Papers·· 3 天前AI 评分43
Length Self-Distillation 用在线蒸馏缓解 Length-Scaling Tax
Mitigating the Length-Scaling Tax with Online Distillation
AI 导读
Length Self-Distillation(LSD)在 RL 后训练中用在线策略蒸馏缓解 Length-Scaling Tax,减少已解决问题的冗长回答。LSD 以在线策略的指数移动平均作为教师,无需外部模型;单轮推理中 LST 从 19.0% 降至 -3.7%,多轮智能体任务中从 31.4% 降至 13.7%。
来源:Hugging Face Daily Papers · arxiv.org