Check out our new paper. We let language models retry failed attempts during RLVR, dynamically expanding the group size. The result: better first-attempt accuracy than GRPO across Qwen3 0.6Bโ4B on 8 math & science benchmarks. https://t.co/F9TsZcL9OC
๐จNew paper led by my amazing master's student @NghiMDao! ๐จ
Introducing Retry-Aware Policy Optimization (ReAPO). Conditioning retries on failures improves RLVR exploration: ReAPO improves accuracy and training efficiency relative to GRPO.
1/12