You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+20-3Lines changed: 20 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -55,6 +55,7 @@
55
55
56
56
57
57
## News
58
+
-**[2026/09/15]** Stable checkpoints released.
58
59
-**[2026/06/19]** Paper released on arXiv. See [World Engine: Towards the Era of Post-Training for Autonomous Driving](https://arxiv.org/abs/2606.19836).
59
60
-**[2026/04/09]** Official dataset released. See [OpenDriveLab/WorldEngine](https://huggingface.co/datasets/OpenDriveLab/WorldEngine) or [OpenDriveLab/WorldEngine (ModelScope)](https://www.modelscope.cn/datasets/OpenDriveLab/WorldEngine)
60
61
-**[2026/04/10]** Official code repository established.
@@ -65,16 +66,17 @@
65
66
We compare different post-training paradigms on the nuPlan dataset, evaluating on both open-loop and closed-loop metrics across common and rare driving scenarios.
66
67
67
68
> **Metric notes:**
68
-
> **Early stage**. Stable ckpts and corresponding results coming soon.
69
69
> -**Open-loop PDMS** is aligned with [NAVSIM v1.1](https://github.com/autonomousvision/navsim) PDM Score. *Common* denotes the standard `navtest` split; *Rare* denotes the `navtest_failures` subset — failure-prone rare-case scenarios extracted from `navtest`.
70
-
> -**Closed-loop Success Rate** is defined as the fraction of simulated driving episodes completed without collision or off-road failure.
70
+
> -**Closed-loop Success Rate (SR)** is computed as NC × DAC (no-at-fault-collision score × drivable-area compliance score), reported as a percentage.
71
71
> -**Closed-loop Ego Progress (EP)** measures the route progress made by the ego vehicle during **SimEngine closed-loop testing**, reflecting whether the agent makes meaningful forward progress rather than merely avoiding collision or off-road failure.
72
72
> -**Closed-loop PDMS*** is the PDM Score obtained via **SimEngine closed-loop testing**, where the planner interacts with reactive agents in simulation under real-time rendering.
73
73
>
74
74
> **Training notes:**
75
75
> -**Rare logs** are failure-prone scenarios automatically extracted from `navtrain` by the pre-trained agent itself (see [Rare Case Extraction](docs/algengine_usage.md#rare-case-extraction)).
76
76
> -**Common logs** are the standard cases in `navtrain`.
| Base model | 85.64 | 47.14 | 73.66 | 46.71 | 60.98 |
@@ -90,6 +92,21 @@ We compare different post-training paradigms on the nuPlan dataset, evaluating o
90
92
- Post-training on **common logs** provides limited long-tail benefit and degrades rare closed-loop performance, reducing SR from **73.66%** to **69.63%** and PDMS$^\ast$ from **60.98** to **60.21**, confirming the importance of long-tail event discovery.
91
93
- The full WorldEngine pipeline achieves the best overall rare closed-loop performance, with the highest SR (**88.89%**) and PDMS$^\ast$ (**70.12**). It improves rare closed-loop SR by **+15.23** percentage points and PDMS$^\ast$ by **+9.14** over the base model, while maintaining strong common open-loop performance.
92
94
95
+
#### HydraMDP
96
+
97
+
The base model and WorldEngine rows match **Table S1** of the paper. Additional ablations follow the selected HydraMDP experiment records: pure IL fine-tuning for the supervised row, and reward shaping enabled, RL fine-tuning enabled, PG = 0.01, entropy = 0 for the RL rows. Closed-loop values use the **reactive** evaluation results.
|**Post-training with WorldEngine**|**93.89**|**72.28**|**81.63**|**67.95**|**74.49**|
107
+
108
+
WorldEngine improves HydraMDP's rare closed-loop SR by **+6.48** percentage points, EP by **+4.97**, and PDMS$^\ast$ by **+5.80**, matching the gains reported in Table S1.
109
+
93
110
### Qualitative Results — Closed-Loop Simulation on nuPlan
94
111
95
112
Each pair shows the **Base model** vs **WorldEngine post-trained model** on the same rare-case scenario. Left: front-camera rendering; Right: BEV trajectory visualization.
@@ -138,8 +155,8 @@ WorldEngine consists of two tightly coupled subsystems:
138
155
-[x] Hugging Face / ModelScope dataset
139
156
-[x] Open-source release (code, data, early pre-trained models)
0 commit comments