Skip to content

[Robot] Yam rollout station for EgoVerse checkpoints - #747

Draft
aidang3019 wants to merge 1 commit into
mainfrom
aidan/yam-rollout-egoverse-20261029
Draft

aidang3019 wants to merge 1 commit into
mainfrom
aidan/yam-rollout-egoverse-20261029

Conversation

@aidang3019

@aidang3019 aidang3019 commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Port the rl2 Yam rollout runtime from EgoVerse-graph (#319 eee60539: dashboard, gripper-force and IK controls, cameras, episode/video capture) into egomimic/robot/yam_station, leaving the Eva rollout untouched. Inference loads a self-contained ModelWrapper checkpoint (kind: egoverse): proprio normalized as in training, model frame set by base_T_model (default: front-camera frame, the Eva convention), 14/20-wide euler/6D from the checkpoint, sampling steps and actions-before-replanning as dashboard controls. The model browser swaps bare .ckpt files.

Not ported: Quest teleop (collect_demo, teleop, quest_mapper, streaming IK), replay policies, benchmark_ik. The shared HDF5 writer lives in episode_writer.py.

Profile: hydra_configs/robot/yam_rl2_egoverse_rollout.yaml. Checked on CPU only (ruff gate, rollout --check-model via the test in #755); not run on the arms.

aidang3019 commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor Author

Port the rl2 Yam rollout runtime from EgoVerse-graph (#319 eee6053:
dashboard, gripper-force and IK controls, cameras, episode/video capture)
into egomimic/robot/yam_station, leaving the Eva rollout untouched.
Inference loads a self-contained ModelWrapper checkpoint (kind: egoverse):
proprio normalized as in training, model frame set by base_T_model
(default: front-camera frame, the Eva convention), 14/20-wide euler/6D
from the checkpoint, sampling steps and actions-before-replanning as
dashboard controls. The model browser swaps bare .ckpt files.

Not ported: Quest teleop (collect_demo, teleop, quest_mapper, streaming IK),
replay policies, benchmark_ik. The shared HDF5 writer lives in
episode_writer.py.

Profile: hydra_configs/robot/yam_rl2_egoverse_rollout.yaml.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@aidang3019
aidang3019 force-pushed the aidan/yam-rollout-egoverse-20261029 branch from 57b4f08 to 5c7bd6e Compare November 4, 2026 06:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant