后见自蒸馏中提示词有多重要？通用反馈句即可匹配自写批评的效果
How Much Does the Hint Matter? A generic feedback line matches self-written critiques in hindsight self-distillation (ACM ICAIF '26) [R]
作者在 GPT-OSS-20B 上研究多步金融推理的后见自蒸馏：学生模型找出自己第一个错误步骤并写出批评，冻结副本在反向 KL 下蒸馏回学生。把批评替换成一句固定的通用反馈，也能达到约 3 个点的完整增益；用大 6 倍模型生成的批评并未实质提升表现，Fin-SD 比使用完整参考解的 OPSD 少用 9.5% token。
We study hindsight self-distillation for multi-step financial reasoning on GPT-OSS-20B. The student finds its own first wrong step and writes a critique. A frozen copy, conditioned on the prefix plus the critique, is distilled back into the student under reverse KL. Notably, replacing the critique with a fixed generic feedback line matches the full gain of about 3 points, and critiques from a 6x larger model do not materially improve performance, suggesting that the positional information provided by hindsight distillation significantly decreases the privileged information needed for effective training. Fin-SD matches OPSD from full reference solutions with 9.5% fewer tokens.
Paper: https://arxiv.org/abs/2610.36082 | Code: https://github.com/johnnyhyu/fin-sd
We'd love to find the limits of this approach. Let us know your thoughts!
来源：r/MachineLearning · reddit.com