Skip to content

feat: Newton 后端原生渲染器(离线 record + 交互式 interactive)(roadmap #1513) - #1524

Merged
TATP-233 merged 3 commits into
mainfrom
dev/issue-1513-newton-native-renderer
Sep 6, 2026
Merged

TATP-233 merged 3 commits into
mainfrom
dev/issue-1513-newton-native-renderer

Conversation

@TATP-233

@TATP-233 TATP-233 commented Sep 6, 2026

Copy link
Copy Markdown
Collaborator

Roadmap

Roadmap issue:#1513。Declared base:main。

包含的 child issue

交付内容

  • NewtonBackend 接入上游 newton.viewer.ViewerGL:离线 record(ViewerGL(headless=True) + get_frame() 写 mp4)与交互式 interactive 窗口;auto 按有无显示解析;未装渲染依赖时 record 回退 MuJoCo 快照路径、interactive fail-closed。(unisim PR feat: add development toolchain (Makefile) and upgrade dependencies #35)
  • UniLab:G1 PPO/SAC newton owner 移除 record override 继承 base 的 auto;新 newton-render extra(pyglet>=2.1.6,<3 + imgui-bundle>=1.92.0);双语 7-newton.md / installation 页 / 支持矩阵证据更新;contract 测试新增 play_render_mode == "auto" 断言。

冲突处理

与 main 的 #1522(mujoco 3.11 联合 extra,移除 uv conflicts)与 #1516(newton DP 验证,SAC owner 新增 inference_request_timeout_sec: 180)取并集:newton 与 mujoco/mjwarp 同线可同环境安装的措辞 + newton-render extra 说明;SAC owner 保留 180 s 超时、移除 play_render_mode: record(继承 auto)。

Validation

  • 最终 head(merge commit)本地 make test-all 通过(全量 + benchmark smoke,1 个 platform-optional mlx skip)。
  • 近风险:owner contract / support matrix / config compose / doc checks 217 passed(-m slow);Sphinx 构建干净。
  • 真机(RTX 4090 + X display :0,editable unisim#35 + newton-render extra):
    • uv run eval --algo sac --task g1_walk_flat --sim newton --load-run 2026-09-06_01-21-36_newton --render-mode record(PYOPENGL_PLATFORM=egl):via newton-viewer-gl,800 帧 1280x720 mp4,16 world 渲染与步态正常(抽帧人工确认)。
    • --render-mode interactive:ViewerGL 窗口持续渲染无报错(交互语义为运行至关窗)。

Dependency

运行时需要 unilabsim/unisim PR #35 的 NewtonBackend native playback 能力。对未含该能力的旧版 unisim-core:interactive/auto 保持 fail-closed,record 走 MuJoCo 快照路径,行为不回归。

TATP-233 and others added 3 commits September 6, 2026 03:01
…ender

feat(issue-1514): wire Newton native ViewerGL playback (auto mode, docs, render extra)
@TATP-233
TATP-233 merged commit 15a18c6 into main Sep 6, 2026
8 checks passed
@TATP-233
TATP-233 deleted the dev/issue-1513-newton-native-renderer branch September 6, 2026 07:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant