参考文章:
joschu.net/blog/kl-approx.html
rlhfbook.com/c/06-policy-gradients#group-relative-policy-optimization-grpo
cameronrwolfe.substack.com/p/grpo
abderrahmanskiredj.github.io/the-illustrated-grpo
github.com/verl-project/verl/pull/2953
RLVR 算法对比(一) - Hakurei Reimu的文章 - 知乎 https://zhuanlan.zhihu.com/p/1981431634575238748