Skip to content

feat: add Rust bundle inspection with Python and C++ bindings - #27

Open
malwan-nv wants to merge 24 commits into
leapp-compiled-runtimefrom
malwan-nv/leapp-compiled-runtime
Open

malwan-nv wants to merge 24 commits into
leapp-compiled-runtimefrom
malwan-nv/leapp-compiled-runtime

Conversation

@malwan-nv

Copy link
Copy Markdown
Collaborator

Adds packages/leapp-runtime-rust as a public API for loading and inspecting exported LEAPP bundles from Rust, Python, and C++.
The Rust loader validates graph connections, artifact paths, optional SHA-256 hashes, and safetensors initial state. Python exposes detached inspection values and structured errors.

frlai and others added 6 commits October 13, 2026 17:18
Signed-off-by: Frank Lai <frlai@nvidia.com>
Signed-off-by: Frank Lai <frlai@nvidia.com>
Signed-off-by: Marc Alwan <malwan@nvidia.com>
Signed-off-by: Marc Alwan <malwan@nvidia.com>
Signed-off-by: Marc Alwan <malwan@nvidia.com>
Signed-off-by: Marc Alwan <malwan@nvidia.com>
@malwan-nv
malwan-nv force-pushed the malwan-nv/leapp-compiled-runtime branch from 7325dc2 to 2b281a0 Compare October 14, 2026 17:26
@malwan-nv malwan-nv self-assigned this Oct 14, 2026
@malwan-nv
malwan-nv requested a review from frlai October 14, 2026 17:27
Comment thread packages/leapp-runtime-rust/src/load.rs Outdated
Comment thread packages/leapp-runtime-rust/src/load.rs Outdated
frlai added 3 commits October 16, 2026 15:23
replace the hand-maintained in-place allowlist with cached ATen schema discovery
preserve eager receiver identity while recording deterministic functional graph operations
support metadata-mutating views such as squeeze_, unsqueeze_, and transpose_
cover masked_fill_, index_copy_, cumsum_, and other schema-compatible methods
reject nondeterministic or incompatible methods before mutation
consolidate overlapping traced-tensor regression coverage while retaining distinct semantics
Signed-off-by: Frank Lai <frlai@nvidia.com>
@frlai

frlai commented Oct 17, 2026

Copy link
Copy Markdown
Collaborator

another thing. the runtime needs a reset call. reset needs to clear all the buffers and load in the initial values.

frlai and others added 8 commits October 17, 2026 12:51
* docs: clarify whole-pipeline export and optional stage boundaries

Signed-off-by: Frank Lai <frlai@nvidia.com>

* docs: streamline pipeline pitch and single-model quick start

Signed-off-by: Frank Lai <frlai@nvidia.com>

* docs: correct capture scope and getting started references

Signed-off-by: Frank Lai <frlai@nvidia.com>

* docs: focus README on general pipeline export workflow

Signed-off-by: Frank Lai <frlai@nvidia.com>

* docs: clarify stateful cached validation and sequential replay

Signed-off-by: Frank Lai <frlai@nvidia.com>

* docs: remove em dashes from README

Signed-off-by: Frank Lai <frlai@nvidia.com>

* docs: describe capture flexibility as a capability

Signed-off-by: Frank Lai <frlai@nvidia.com>

* docs: remove redundant supported computation overview

Signed-off-by: Frank Lai <frlai@nvidia.com>

* docs: restore concise YAML artifact summary

Signed-off-by: Frank Lai <frlai@nvidia.com>

---------

Signed-off-by: Frank Lai <frlai@nvidia.com>
# Conflicts:
#	README.md
#	docs/source/conf.py
Signed-off-by: Marc Alwan <malwan@nvidia.com>
Signed-off-by: Marc Alwan <malwan@nvidia.com>
Signed-off-by: Marc Alwan <malwan@nvidia.com>
Signed-off-by: Marc Alwan <malwan@nvidia.com>
Signed-off-by: Marc Alwan <malwan@nvidia.com>
@malwan-nv
malwan-nv added this pull request to stack #35 October 19, 2026 21:43
frlai and others added 6 commits October 19, 2026 15:56
Signed-off-by: Frank Lai <frlai@nvidia.com>
Signed-off-by: Frank Lai NV <frlai@nvidia.com>
Signed-off-by: Frank Lai NV <frlai@nvidia.com>
* feat: lower NumPy calls through ATen and support reverse slices

Signed-off-by: Frank Lai <frlai@nvidia.com>

* docs: remove NumPy ATen experiment report

Signed-off-by: Frank Lai <frlai@nvidia.com>

* test: consolidate NumPy tracing coverage

Signed-off-by: Frank Lai <frlai@nvidia.com>

* docs: explain NumPy ATen capture and supported limits

Signed-off-by: Frank Lai <frlai@nvidia.com>

* docs: describe NumPy capture without historical comparisons

Signed-off-by: Frank Lai <frlai@nvidia.com>

* fix: defer recoverable NumPy capture errors until output validation

Signed-off-by: Frank Lai <frlai@nvidia.com>

* perf: validate NumPy numerics at exported node outputs

Signed-off-by: Frank Lai <frlai@nvidia.com>

* test: fold NumPy comparison probe into replay coverage

Signed-off-by: Frank Lai <frlai@nvidia.com>

* docs: simplify NumPy capture explanation

Signed-off-by: Frank Lai <frlai@nvidia.com>

* test: use portable cosine dtypes and remove duplicate NumPy checks

Signed-off-by: Frank Lai <frlai@nvidia.com>

---------

Signed-off-by: Frank Lai <frlai@nvidia.com>
Move the bundle regression target under tests/unit_tests and remove the redundant C++ fixture-loading check. Keep the inspection-only build instructions aligned with the test layout.

Signed-off-by: Marc Alwan <malwan@nvidia.com>
Export Session, construction options, result/error types, and backend-independent DLPack ownership. Compile the common binding wrapper against the real core API. Execution returns Unsupported in this contract revision and is supplied by the runtime integration.

Signed-off-by: Marc Alwan <malwan@nvidia.com>
@malwan-nv
malwan-nv marked this pull request as ready for review October 21, 2026 22:29
Bring the latest develop fixes and formatting requirements through the PR stack while preserving published commit history.

Apply required Ruff formatting without changing Python syntax trees.

Signed-off-by: Marc Alwan <malwan@nvidia.com>
@malwan-nv
malwan-nv removed this pull request from stack #35 October 21, 2026 23:09
@malwan-nv
malwan-nv changed the base branch from leapp-compiled-runtime to develop October 21, 2026 23:09
@malwan-nv
malwan-nv added this pull request to stack #43 October 21, 2026 23:09
@karsten-nvidia
karsten-nvidia requested a review from frlai October 26, 2026 17:49
@malwan-nv
malwan-nv removed this pull request from stack #43 October 26, 2026 18:43
@malwan-nv
malwan-nv changed the base branch from develop to leapp-compiled-runtime October 26, 2026 18:44
@malwan-nv
malwan-nv added this pull request to stack #47 October 26, 2026 18:44

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants