Skip to content

docs(rpent): rename replay figures to Flash Mode - #63

Open
Elessar123 wants to merge 1 commit into
RLinf:mainfrom
Elessar123:docs/flash-mode-figures
Open

Elessar123 wants to merge 1 commit into
RLinf:mainfrom
Elessar123:docs/flash-mode-figures

Conversation

@Elessar123

Copy link
Copy Markdown
Contributor

Redraw the LIBERO-PRO and Object comparisons using the Flash Mode name and publish them under rpent/flash/. Remove the previous figure paths as part of the naming migration.

Include CSV inputs and a standalone matplotlib script so the figures can be regenerated. The comparison is unchanged: Flash Mode 581/800, Codex without reasoning 500/800, and Codex with high reasoning 628/800. The Object-only comparison remains 179/200 versus 186/200, with mean times of 40.9 s and 283.6 s.

Both Codex series were recovered from the original logs; Flash success counts were checked against the published figure, and source execution times were matched to its bars. Two originally zero timing bars are retained. Timing methodology and data provenance are documented in the adjacent README.

Validation: regenerated both PNGs using python rpent/flash/plot.py, visually checked both figures, and verified success totals. No new benchmark evaluation was run.

Coordinate this migration with the RPent --planner flash change and the Flash memory dataset PR, so documentation uses the new asset paths.

Signed-off-by: Elessar123 <571360229@qq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant