RL Algorithms for RLAIF (Advanced PPO)