Skip to content

Resolve GGUF artifact links#138

Open
hannibal-lee wants to merge 3 commits into
Andyyyy64:mainfrom
hannibal-lee:fix/resolve-gguf-artifact-links
Open

Resolve GGUF artifact links#138
hannibal-lee wants to merge 3 commits into
Andyyyy64:mainfrom
hannibal-lee:fix/resolve-gguf-artifact-links

Conversation

@hannibal-lee

Copy link
Copy Markdown
Contributor

What

  • Resolve ranked GGUF recommendations to their actual downloadable artifact repo/file.
  • Add artifact metadata to ranking results and JSON output.
  • Update Rich/Markdown output so model links can point to the real GGUF repo while preserving the recommended base model ID.

Why

Fixes #137.

Some recommendations are scored as an official base model plus a GGUF quantization, but the actual GGUF files may live in a third-party repo. The output previously linked only to the base model repo, so
users could click a Q3_K_M recommendation and land on a repo that does not contain that GGUF artifact.

Testing

  • Tests pass (pytest)
  • New tests added (if applicable)
  • Tested on real hardware (if hardware-related)

Manual verification:

  • Ran git diff --check.
  • Ran python -m compileall src/whichllm tests/test_artifacts.py tests/test_markdown_output.py tests/test_cli.py.
  • Could not run full pytest locally because uv run pytest failed while building pyarrow==23.0.1, and the local Python environments do not have pytest installed.

Notes

This keeps ranking based on the recommended/base model, but exposes the resolved GGUF artifact repo and filename for output/download surfaces.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Clicking a result's link opens a different model's page than the one shown in the results.

1 participant