fix: strip orphaned nvidia-* CUDA packages from Linux bundle (2.5GB->under 2GiB) - #225
Merged
Conversation
Both Linux tarballs were 2.5 GB (over GitHub's 2 GiB asset limit) even with CPU torch. Root cause: 'uv pip install <project>' pulls the default Linux torch, which is the CUDA build, dragging in nvidia-* runtime packages (cuDNN/cuBLAS/NCCL/...) and triton (~2.5 GB). The CPU torch swap uses --force-reinstall --no-deps, so torch becomes CPU but those CUDA packages stay installed and orphaned, bloating the tarball. Uninstall the nvidia-* packages and triton after the swap. CPU torch does not use them and the NVIDIA variant re-downloads CUDA at first run.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
Both Linux tarballs were 2.5 GB, failing the upload with GitHub's 2 GiB asset limit — even though torch was correctly
2.6.0+cpu.Root cause
uv pip install <project>pulls the default Linux torch, which is the CUDA build, dragging innvidia-*runtime packages (cuDNN, cuBLAS, NCCL, …) andtriton— ~2.5 GB. The CPU torch swap uses--force-reinstall --no-deps, so torch becomes CPU but those CUDA packages stay installed and orphaned, still bloating the bundle.(Windows never hits this because its default torch wheel is already CPU-only — no nvidia-* deps to begin with.)
Fix
After the CPU torch swap, uninstall the orphaned
nvidia-*packages andtriton. CPU torch doesn't use them, and the NVIDIA variant re-downloads CUDA at first run. Expected size: well under 2 GiB.Status
Windows binaries already published to alpha.17. The Linux build now passes apt (skip-when-present) and builds both variants — this removes the last blocker (size) on the Linux upload.
🤖 Generated with Claude Code