Skip to content

Automated leaderboard check#195

Merged
maxjeblick merged 1 commit intomainfrom
check-leaderboard-workflow
Mar 12, 2026
Merged

Automated leaderboard check#195
maxjeblick merged 1 commit intomainfrom
check-leaderboard-workflow

Conversation

@maxjeblick
Copy link
Collaborator

PR description

Automated leaderboard check, triggered every day. Avoids issues such as #193.

Workflow was tested using

          SPACE_API="https://huggingface.co/api/spaces/nvidia/kvpress-leaderboard-FAKE"
          SPACE_URL="https://nvidia-kvpress-leaderboard-fake.hf.space"

which tirggered #194

Checklist

Before submitting a PR, please make sure:

  • Tests are working (make test)

  • Code is formatted correctly (make style, on errors try fix with make format)

  • Copyright header is included

  • All commits are signed-off using git commit -s

  • (new press) mypress_press.py is in the presses directory

  • (new press) MyPress is in __init__.py

  • (new press) README.md is updated with a 1 liner about the new press in the Available presses section

  • (new press) New press is in the default_presses list in tests/default_presses.py

  • (new press) A docstring is provided that follows the same structure as the existing ones

@copy-pr-bot
Copy link

copy-pr-bot bot commented Mar 12, 2026

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

Scheduled GitHub Action that checks the kvpress-leaderboard HF Space
status daily and opens an issue when it's down. Deduplicates by
checking for existing open issues with the "leaderboard-down" label.

Signed-off-by: Max Jeblick <maximilianjeblick@gmail.com>
@maxjeblick maxjeblick force-pushed the check-leaderboard-workflow branch from a9928b1 to 353afdf Compare March 12, 2026 14:27
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds a scheduled GitHub Actions workflow to automatically check the availability of the HuggingFace KVPress leaderboard Space daily and open a GitHub issue when the Space appears unhealthy, helping proactively catch outages like #193/#194.

Changes:

  • Introduces a daily (and manual) workflow that checks HF Space runtime stage and the Space HTTP status code.
  • Prevents duplicate alerts by only opening an issue if no open issue with the leaderboard-down label exists.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review. Take the survey.

@maxjeblick
Copy link
Collaborator Author

/ok to test 353afdf

@alessiodevoto alessiodevoto force-pushed the check-leaderboard-workflow branch from 2876d3c to 353afdf Compare March 12, 2026 15:08
@alessiodevoto alessiodevoto self-requested a review March 12, 2026 15:32
@maxjeblick maxjeblick merged commit 6f0a9da into main Mar 12, 2026
4 checks passed
@maxjeblick maxjeblick deleted the check-leaderboard-workflow branch March 12, 2026 16:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants