Skip to content

Serve the RoboLab leaderboard pi05 through the env-server (droid_jointpos) - #486

Merged
vertix merged 1 commit into
Positronic-Robotics:mainfrom
vertix:robolab-pi
Jul 20, 2026
Merged

Serve the RoboLab leaderboard pi05 through the env-server (droid_jointpos)#486
vertix merged 1 commit into
Positronic-Robotics:mainfrom
vertix:robolab-pi

Conversation

@vertix

@vertix vertix commented Jul 19, 2026

Copy link
Copy Markdown
Contributor

Summary

First policy served against the merged RoboLab env (#469): openpi's DROID jointpos model — the same recipe RoboLab's leaderboard runs for its pi0-family entries.

Differential eval

Same checkpoint, same serving process (our server hosts openpi's serve_policy.py on :8001 and speaks the positronic wire on :8000). Two harnesses, 10 episodes per task per arm, on one L40S (2026-07-19):

  • ourspositronic eval run → env-server proxy → RoboLab env
  • theirs — RoboLab's own policies/pi0_family/run.py --policy pi05 --remote-port 8001, no positronic code in the loop
Task ours theirs
BananaInBowlTask 10/10 10/10
RubiksCubeAndBananaTask 5/10 6/10
BlockStackingOrderAgnosticTask 6/10 7/10

Per-task rates match within n=10 noise (RoboLab has no seed hook, so both arms draw fresh randomized scenes). BananaInBowl our-arm was also 9/10 on 2026-07-07 with the pre-rebase tree.

The eval ran with the pre-#488 tree, where an interim hold_last guard produced the same full-chunk cadence the sentinel now provides universally; the wire test above proves the cadence is unchanged on the rebased tree.

Test plan

  • pytest suite green locally (605 passed / 7 skipped); test_remote_env pins the full-stack cadence.
  • Differential eval above; episodes on the eval box under ~/eval_out/2026-07-19/, RoboLab-side logs under output/differential_2026-07-19/.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 8049ca9e9b

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread positronic/vendors/openpi/server.py
@vertix
vertix merged commit cd9a155 into Positronic-Robotics:main Jul 20, 2026
19 checks passed
@vertix
vertix deleted the robolab-pi branch July 20, 2026 14:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant