feat: inspect real scene edits and paired official LIBERO-Plus outcomes - #49
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add two source-checked Physical AI labs: captured CC0 terrain with actual Blender edits, mesh-derived surface Gaussians and a separate collision proxy; and an official LIBERO-Plus SmolVLA subset with paired native camera/light conditions. The latter records baseline success at77 actions, camera step limit at220 and lighting success at87; it is not a full benchmark score.
An actual OpenEnv0.4.2 environment independently reopens native Blender output: incorrect recipe reward0, correct recipe reward1, and completion-claim fields rejected. Cosmos has a pinned recorder and access preflight, but its NVIDIA dependency returns403; no Cosmos inference results are claimed. Homepages connect all45 cross-project agent trials. Version0.11.0 adds immutable, hash-checked native/evidence release downloads.
Validation: 193 tests (3 optional Rerun checks delegated to the dedicated CI job), 193 stdlib-only checks (9 optional-dependency skips), real GPU rendering/readback and policy recordings, source-media frame counts, independent installed-wheel checks, and desktop/390/320 browser tests including actual25,000-splat rendering, exact video seeks, share-state restore and missing-evidence retry. Updated page manifest refresh handles both hash-only and hash-plus-byte entries while preserving original source records. All184 files of the immutable HF dataset were anonymously verified.
Data and limitations: https://huggingface.co/datasets/glayguo/noteflow-research-pilots/tree/v2026-09-14.