Repository navigation
Conversation
…site - detect mode: --format html writes a self-contained report (heatmap, per-token strip, alternative bars; no scripts), --format markdown a PR-ready summary, and the terminal output is a heatmap with aligned alternative bars - new report module with tests; CI smoke-tests html and markdown output - --help examples; emoji removed from visualizer headers - README: hero, real terminal capture, sample table, the confidently-wrong example, formats; long reference in <details> - docs/: GitHub Pages site with the bundled samples, a threshold slider that runs the same detection rules in the browser, and the honest failure case - .github/social-preview.png
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Makes the detector's output something you want to look at, and gives the repo a front page built from real runs.
Before / after: terminal (same command, same sample)
llm-token-visualizer --logprobs-file examples/logprobs/cuyp.json --threshold 0.6Before / after: README top
What changed
--format htmlin detect mode: a self-contained page (no scripts, no external assets, light and dark) with the answer as a confidence heatmap, a per-token probability strip, and bars for the alternatives at each flagged span. Hover or focus any word for its probability and alternatives.--format markdownin detect mode: numbered spans plus a table of alternatives, for PRs, issues and$GITHUB_STEP_SUMMARY.NO_COLORhonored.--helpgains examples; emoji removed from the visualizer headers.reportmodule with 7 tests; CI now smoke-tests the HTML and Markdown output too. JSON output and all existing public APIs are unchanged.cargo run --example detect), the confidently-wrong moonwalk example as an image, formats; long reference moved into<details>.detect.rs; I checked it against the CLI's JSON output for all 4 samples at 5 thresholds (20/20 identical)..github/social-preview.png(1280x640) to upload in Settings.Every image comes from running the CLI on the bundled Llama 3.1 8B responses today.