Skip to content

Repository navigation

Publish FastLanes retry archive metadata #175

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
Anionix wants to merge 1 commit into from
Closed

Publish FastLanes retry archive metadata #175

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions docs/research-log.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,8 @@ The claims runner keeps the corrected TsFile time-series workload as `ADAPTED` a

The 2026-07-17 retry added the exact 13-column mixed-schema case and corrected fatal classification for worker failures and crashes. The lock-pinned Python package could not build under macOS arm64 Clang 21 because `src/table/stats.cpp` promotes a `std::string` null-argument warning to an error. The official C++ `quick_fuzz_test` built after downgrading the two observed warning classes, but all ten pinned cases exited `SIGTRAP`; this is experimental evidence, not an upstream bug claim.

The Linux x86_64 retry on [workflow run 29520329351](https://github.com/Anionix/data-format-lab/actions/runs/29520329351) built the pinned Python extension successfully with Python 3.12.13, Clang 21.1.8, CMake 4.1.2, and Ninja 1.13.2. The 1,000,000-row numeric control and all five string-boundary cases exited `SIGSEGV`; the 13-column mixed case raised `UNREACHABLE` at `src/wizard/wizard.cpp:1252`. The raw archive is preserved in the [v0.1.0 Release](https://github.com/Anionix/data-format-lab/releases/download/v0.1.0/data-format-lab-fastlanes-linux-x86_64-29520329351.tar.zst) with a [checksum sidecar](https://github.com/Anionix/data-format-lab/releases/download/v0.1.0/data-format-lab-fastlanes-linux-x86_64-29520329351.tar.zst.sha256). This remains `FAILED`/`PARTIAL` evidence and is excluded from rankings.

The 2026-07-17 Nimble retry pinned core `9da673...`, Velox `e06dd...`, and OpenZL `6b48...`. The dependency provenance was not fully lock-pure: protobuf library `35.1` came from Nix, `protoc 33.4` and fmt `12.1.0` came from Homebrew, and CMake reported the compiler/library mismatch. A dependency-resolving CMake path reached the bundled xsimd project but stopped at its pre-3.5 minimum-version declaration under CMake 4.1.2. The earlier protobuf/fmt target failure and this newer configure failure are both `UNSUPPORTED` build evidence; the 1,024-column projection comparison was not run.

The 2026-07-17 AnyBlox retry found official bundler and `anyblox2csv` targets at the pinned commits, but the artifact still required an undated nightly Rust toolchain. This host had Homebrew Rust 1.93.1 and no `rustup`; stable compilation failed with `E0554/E0599`. The input bundle and compiler were not checksum-complete, so no round trip or performance result was promoted.
Expand Down
28 changes: 27 additions & 1 deletion research/formats/fastlanes.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,14 +34,40 @@
"environment": {
"os": "Linux x86_64",
"runner": "ubuntu-24.04",
"kernel": "6.17.0-1020-azure",
"architecture": "x86_64",
"host_python": "3.12.3",
"python": "3.12.13",
"clang": "21.1.8",
"cmake": "4.1.2",
"ninja": "1.13.2",
"scikit_build_core": "0.11.6",
"pybind11": "2.12.1",
"setuptools_scm": "8.3.1",
"build_type": "Release",
"parallelism": 4,
"timeout_seconds": 120,
"package": "pyfastlanes==0.1.3.post9",
"runtime": "0.1.4"
},
"result": "numeric and all five string cases exited SIGSEGV; the mixed 13-column case raised RuntimeError UNREACHABLE; malformed comma input raised RuntimeError. The workflow preserved per-case inputs, artifacts, logs, and SHA-256 hashes."
"build_command": "nix develop --command python -m venv native/fastlanes/.venv; nix develop --command native/fastlanes/.venv/bin/python -m pip install scikit-build-core==0.11.6 cmake==4.4.0 ninja==1.13.0 pybind11==2.12.1 setuptools-scm==8.3.1; CMAKE_BUILD_PARALLEL_LEVEL=4 nix develop --command native/fastlanes/.venv/bin/python -m pip install --no-build-isolation -e native/fastlanes",

@chatgpt-codex-connector chatgpt-codex-connector Bot Jul 16, 2026

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Record the build tools actually used

For anyone reproducing this retry, this command installs CMake 4.4.0 and Ninja 1.13.0 into the build virtualenv, while the adjacent environment record and new research-log claim identify CMake 4.1.2 and Ninja 1.13.2. The workflow obtained the latter versions by probing nix develop --command cmake/ninja, not the executables selected by the virtualenv's scikit-build-core invocation, so the published evidence is internally inconsistent about a potentially outcome-affecting part of the toolchain; record the effective build executables and distinguish them from the Nix-host versions.

Useful? React with 👍 / 👎.

"result": {
"build": "succeeded",
"numeric": "CRASHED SIGSEGV (-11)",
"string_boundaries": "1,023, 1,024, 1,025, 2,048, and 2,049 all CRASHED SIGSEGV (-11)",
"mixed": "HARNESS_FAILED RuntimeError: UNREACHABLE at src/wizard/wizard.cpp:1252",
"comma_malformed": "HARNESS_FAILED RuntimeError: invalid character in signed integer; child process returned 0 because the worker captured the exception"
},
"workflow_artifact": {
"run_id": "29520329351",
"artifact_name": "data-format-lab-fastlanes-linux-x86_64-29520329351",
"results_path": "runs/fastlanes-linux-29520329351/results.json",
"archive_path": "outputs/release/data-format-lab-fastlanes-linux-x86_64-29520329351.tar.zst",
"archive_sha256": "b9270a10d9cc0f5d81a81e67b8e22af591a06018e767720b9d9c6e4c3689227a",
"release_tag": "v0.1.0",
"release_asset_url": "https://github.com/Anionix/data-format-lab/releases/download/v0.1.0/data-format-lab-fastlanes-linux-x86_64-29520329351.tar.zst",
"release_checksum_url": "https://github.com/Anionix/data-format-lab/releases/download/v0.1.0/data-format-lab-fastlanes-linux-x86_64-29520329351.tar.zst.sha256"
}
},
{
"entrypoint": "official pyfastlanes editable build with scikit-build-core",
Expand Down
13 changes: 13 additions & 0 deletions tests/test_research.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,19 @@ def test_negative_research_records_are_pinned_and_unranked() -> None:
assert "/nix/store/" not in nimble_json
assert "/opt/homebrew/" not in nimble_json

fastlanes_attempt = next(
attempt
for attempt in records["fastlanes"]["attempts"]
if attempt.get("workflow_run")
== "https://github.com/Anionix/data-format-lab/actions/runs/29520329351"
)
assert fastlanes_attempt["environment"]["architecture"] == "x86_64"
assert fastlanes_attempt["result"]["mixed"].startswith("HARNESS_FAILED")
assert fastlanes_attempt["workflow_artifact"]["release_tag"] == "v0.1.0"
assert fastlanes_attempt["workflow_artifact"]["release_asset_url"].endswith(
".tar.zst"
)


def test_relative_root_does_not_match_url_punctuation(
monkeypatch: pytest.MonkeyPatch,
Expand Down
Loading