Skip to content

Robot Reel — Physical AI. In motion. On record. Three real demos: SmolVLA robot actions, an MCP Blender director, and Newton physics exported to OpenUSD.

Give Physical AI a replay button.

Real policy rollouts. Films you can inspect. 3D scenes you can edit.
Watch the behavior, step through the evidence, and take the scene with you.

CI status Latest release Code license: Apache-2.0 Live demos: 13 replays Python 3.12+ GitHub stars

◉ Explore the Stress Lab   ·   ✦ Enter the Butterfly Lab   ·   ◐ Try the before / after   ·   Download the demos ↓   ·   中文

No account or install to watch. Preview panels show independent recorded runs.

Quick start

New here? Take the three-step tour: compare a real paired outcome, inspect its native Rerun workspace, then verify the full experiment locally. The demo gallery filters policy runs, comparison experiments and 3D creation; previews play on request.

Python 3.12+ and the standard library are enough to check a real recording:

git clone https://github.com/noteflowai/robot-reel.git
cd robot-reel

# Check every trial in the paired policy experiment.
python3 -m robot_reel.cli stress docs/stress

# Check the recorded policy episode and its evidence.
python3 -m robot_reel.cli vla docs/vla

# Turn the included braking comparison into a checked storyboard.
python3 -m robot_reel.cli direct docs/compare/braking \
  --plan examples/contact-storyboard.json --output artifacts/director

Open in Colab Or use the verified installation packages or non-root Docker image. Recording new runs needs the full runtime; the browser demos need nothing.

New / Same sheet. Three ways to fall.

Cloth Lab. Release three independent Newton cloth simulations on NVIDIA L40S, changing only the bending coefficient. Orbit the deforming meshes, overlay them on the same clock, and compare measured vertex motion. Every one of the 42,471 vertex samples is retained in the source data and checked through OpenUSD and Blender.

Three actual Newton CUDA cloth recordings with identical grids and clamps, but different bending coefficients. Each preview frame identifies its source sample and simulation time.

Release the sheets ↗ · Offline experiment · Editable OpenUSD · Method, limits & reproduction

The coefficients are solver settings, not calibrated fabric properties. Colors identify cases; the page reports geometric diagnostics and preserves original float32 positions and velocities. No collisions or self-contact are modeled. The browser needs no GPU. Robot Reel 0.7.0+ includes the cloth CLI and complete offline export in its installation package. Recording new runs uses the optional Newton runtime.

Same task. Change the view.

The Stress Lab. SmolVLA runs the same task under reference lighting, reduced light and a shifted camera. Explore 30 real closed-loop trials across ten paired initial states. Select any outcome in the matrix, compare both policy cameras, and jump to the largest measured trajectory difference. Recorded with NVIDIA L40S / CUDA inference, with hardware and timing in every trace.

Three real SmolVLA rollouts from the same initial state under reference lighting, reduced light and a shifted camera. Each view retains its source sample and actual outcome.

Compare the policy runs ↗ · Complete offline lab ↓ · MCAP telemetry ↓ · Open it in Foxglove · Reproduce & inspect

Share a moment for review. Export a selected pair as JSON or readable Markdown with your own note. Reopen the JSON to restore the exact source samples, or verify its recorded facts against the full local collection. Held final observations and the complete experiment's counts stay explicit. Review workflow and CLI.

The 0.7.0 offline lab includes these review tools. Download the ZIP and the sample review JSON, then follow the quick start guide. No installation is needed to replay; the matching release wheel enables independent CLI checks.

One task × three native scene conditions × ten paired seeds. Fixed budget: 160 actions / 8 simulation seconds per trial. Every trial is retained; execution errors stay in the attempt ledger. Inspect applied controls, measured state, separate inference/simulation timings and per-condition confidence intervals. This is a controlled diagnostic, not an official LIBERO benchmark score. Preview plays on simulation time; shorter runs explicitly hold their final sample.

Same seed. Different endings.

Native Rerun inspection. Open three paired Stress Lab trials with six embedded camera videos, measured 3D end-effector paths, applied controls and policy-timing curves on one clock. The portable recording keeps the original JSON and has been read back against every source sample.

Actual Rerun workspace with three policy camera views, measured 3D paths and applied-control curves from paired seed 09.

Open the Rerun workspace ↗ · Portable recording ↓ · Rebuild & verify

Selected seed 09: reference succeeds; dim lighting and the shifted camera reach the step limit. 405 observations · 41 policy calls · 6 embedded videos. The full experiment still contains 30 trials. Desktop browser recommended; the downloaded file opens locally in Rerun 0.37.2.

0.05° apart. Worlds apart.

The Butterfly Lab. Twelve isolated Newton worlds begin at nearly identical angles. Their recorded paths become a luminous 3D time sculpture. Drag to orbit, switch to a motion overlay, and find the moment a tiny release difference becomes a 6.26 m gap.

Twelve measured Newton pendulum trajectories unfold into a colored time sculpture. Depth represents simulation time; adjacent releases differ by 0.05 degrees.

Explore the Butterfly Lab ↗ · OpenUSD scene ↓ · Offline experiment ↓ · Reproduce & inspect

601 samples × 12 worlds. All 14,424 body poses checked in native Blender. Adjacent release offsets are 0.05°; the sweep spans 0.55°. The largest recorded gap is world 04 versus 01 (+0.15°), at 12.5 s. Sculpture depth represents time, not physical travel. Preview plays at 3.33×; the interactive replay defaults to 1×.

One recording. Two looks.

Drag between the original MuJoCo simulation and its Blender replay. Jump to the recorded contact, step both views together, then take the editable scene into your own project.

Animated divider between the original MuJoCo footage and its Blender replay, with the same recorded source frame and simulator time.

Drag to compare ↗ · How the samples match · Download the Blender scene

Choose your front-row seat

01 / Words → robot actions

SmolVLA's scene and wrist cameras after the recorded bowl-to-plate task.

A language instruction becomes an actual SmolVLA rollout in LIBERO. Inspect both camera views, measured state and each applied control.

76 actions · one completed simulation task

Play the task ↗ · Reproduce it · Episode + evidence ↓

02 / Brief → Blender film

A Blender camera shows two recorded braking trials at the contact sequence.

Connect an MCP agent to plan camera cuts, captions and slow motion. Build an editable film whose frames map back to the original recording.

4 camera views · all 180 source samples retained

Explore the film ↗ · Connect an agent · Blender project ↓

03 / Physics → editable 3D

Recorded Newton double-pendulum poses and their motion trail in the browser's 3D replay.

Record Newton physics on CPU. Explore measured poses in a browser, then open the animated OpenUSD scene in Blender to light, edit and render.

181 source samples · 362 checked body transforms

Inspect the physics ↗ · Build the scene · OpenUSD ↓

04 / A tiny robot. A learned policy.

Microduck's official ONNX walking policy recorded in MuJoCo, with measured joint telemetry.

Watch Pollen Robotics' Microduck walk with its official ONNX policy. Follow joint targets, measured responses and base motion, or compare two speed commands.

50 Hz policy · 14 joint targets and responses

Meet Microduck ↗ · Compare speeds · Record your own

More scenes: Early vs. late braking · SO-100 arm studio · Editable braking scene

Keep the run behind the film

Watch Inspect Reuse
Browser replays, synchronized views, shot navigation and frame links. Applied actions, measured poses, recorded outcomes and source revisions. Offline episodes, MP4s, JSON traces, editable Blender projects and OpenUSD scenes.

The evidence travels with the demo. Validators check file hashes, timestamps, frame mappings and outcome consistency. Native Blender checks cover all 420 vehicle samples in the directed film and all 362 body transforms in the Newton import. Director check · Newton check.

The browser plays recorded simulations. The VLA example is one seeded rollout, with inference waiting time omitted; new director briefs use your connected agent and a new render. Microduck uses the XML PD-actuator fallback. Scope, provenance and asset terms.

How it differs

Robot Reel is not a simulator, a training framework or a benchmark. It sits after them: it records a run from those tools, verifies the trace, and turns it into something people can watch, inspect and reuse.

Focus Where Robot Reel fits
LeRobot Datasets, policies and training for real and simulated robots Runs a LeRobot policy (SmolVLA), then keeps every applied action, both cameras and the hardware/timing record as a replay
MuJoCo Playground, Isaac Lab GPU-scale environments and RL training Takes a single rollout from a simulator and makes it inspectable, comparable and editable
Genesis, Newton Physics engines Records Newton on CPU and exports the measured motion as an animated OpenUSD scene with a native Blender check
Rerun, Foxglove General telemetry viewers Publishes self-contained HTML replays, MCAP telemetry and a verified native Rerun workspace with embedded videos

What is unique here is the chain: hash-verified traces, paired comparisons on one clock, an MCP agent that directs a Blender film from the recording, and 3D scenes whose keyframes map back to the original samples.

Build your own scene

Choose the workflow you want to build:

I want to… Start here
Run paired VLA stress trials on GPU CUDA setup, fixed experiment and evidence checks
Inspect paired trials in Rerun Portable video, 3D paths and native readback
Run SmolVLA locally Isolated CPU environment + pinned models
Let an agent direct a film MCP setup + Blender build/render
Export real physics to a DCC Newton → OpenUSD → Blender
Explore a physics parameter sweep Butterfly Lab → twelve isolated worlds
Record Microduck, braking or the arm Recording packs + runtime setup
Compare two captured runs Comparison contract + CLI

Make the next scene

Contributions with a working replay and inspectable source data are welcome: new simulation adapters, measured policy comparisons, accessible viewers and editable 3D exports. Contributing · Development and checks · Issues.

Built with LeRobot, MuJoCo, Newton, Blender, OpenUSD, Strands Robots, and Pollen Robotics.

Recorder code: Apache-2.0. VLA images retain their upstream attribution and asset terms; Microduck media retains its noncommercial/share-alike terms. The cover's source mapping and media notice accompany the preview. Independent project; no upstream endorsement is implied.

About

Physical AI replay lab: GPU VLA stress tests, paired failure inspection, Blender films, MCP agents and editable OpenUSD scenes.

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages