Where is the SRPO implement code？

[1018weijia]

Thank you for your excellent work in open source, I want to learn more details about SRPO, but after jumping from the usage instructions in the document, I only saw the implementation of GRPO. Where is the code implementation of SRPO?

[SII-limingliu]

Hi @1018weijia,

Thank you for your interest in SRPO!

In siiRL, SRPO is implemented as the embodied SRPO workflow combined. Rather than being a separate standalone implementation, SRPO's components are integrated into the existing framework.

Here are the key code locations:

• Training Entry: siirl/client/main_dag.py
• DAG Workflow: siirl/client/config/workflow_embodied_srpo.yaml
• Embodied Rollout (VLA-Env interaction): siirl/workers/rollout/embodied_rollout.py
• Environment Adapter: siirl/workers/environment/embodied.py
• V-JEPA Embedding: siirl/utils/embodied/video_emb.py
• VJEPA Reward Computation: siirl/utils/reward_score/embodied.py
• Advantage: siirl/workers/dag_worker/core_algos.py
• VLA Actor: siirl/workers/actor/embodied_actor.py
• Example Scripts: examples/embodied_srpo_trainer/run_openvla_oft_*.sh

We've also added a comprehensive code walkthrough document that explains the SRPO implementation in detail:

📄 SRPO Code Explained

This document covers:

• The complete training pipeline
• Embodied rollout: VLA-Environment interaction loop
• V-JEPA based reward computation
• advantage calculation
• PPO policy update

Feel free to reach out if you have any further questions!

[SMM-challenge]

Thanks for your reply and can you update the QR code for the Weixin group?It seems to be invalid.

[wangzhixin-ai]

wechat QR have been updated, welcome to join the wechat group.

Thanks for your reply and can you update the QR code for the Weixin group?It seems to be invalid.