Repository navigation
Link the M4Bench paper on arXiv and publish Croissant 1.0.1 - #66
Merged
Merged
Conversation
The Hugging Face dataset has served this version since 23 October 2026. Its five record sets now read the run-index CSV files from metadata/run-indexes/ on the dataset instead of from inside the evidence archives, and the dataset card lists that folder. The archives and their SHA-256 checksums are unchanged. make_croissant.py regenerates the hosted Croissant file byte for byte. The file is marked linguist-generated so the token-limit hook skips it and GitHub collapses its diff.
The paper is arXiv:2610.37459. The README's M4Bench section and the dataset card link it, and CITATION.cff gives its DOI and URL, so GitHub's "Cite this repository" points to the paper. The evidence bullet in the README is shorter to keep the file within its size budget.
Codex Review SummaryThis comment shows the latest Codex review activity on this pull request.
ℹ️ About Codex in GitHubYour team has set up Codex to review pull requests in this repo. Reviews are triggered when you
Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Links the published paper (arXiv:2610.37459) and brings
mainup to the Croissant file the Hugging Face dataset has served since 23 October.8fd20cbCroissant 1.0.1, exactly as hosted (JSON, script, dataset card).5b8c5b3arXiv links.README.mdis over the 5,000-token budget, so the evidence bullet was shortened to keep the file from growing (net −5 bytes).Evidence
mainholds Croissant 1.0.0; Hugging Face serves 1.0.1.After:
make_croissant.py <evidence package dir>regenerates the JSON, andcmpagainsthuggingface.co/datasets/hannesill/m4bench-evidence/raw/main/m4bench_evidence.croissant.jsonreports no difference. The dataset card in8fd20cbis also byte-identical to the hosted card.cffconvert --validate: "Citation metadata are valid according to schema version 1.2.0."https://doi.org/10.48550/arXiv.2610.37459redirects toarxiv.org/abs/2610.37459; the arXiv record's title and eight authors matchCITATION.cff.Merge Danger
Door: two-way
Docs and release metadata only. The tag
m4bench-neurips2026-camera-readyand its GitHub release do not move; the tag keeps Croissant 1.0.0, which matched the dataset on release day.Blast Radius: none
No benchmark code changes. After merge, the dataset card on
maincarries the arXiv link that the hosted card lacks until it is uploaded again.