Skip to content

ci(ai-evals): Stop keeping eval outputs as artifacts - #375

Merged
jaydgoss merged 1 commit into
mainfrom
jaygoss/no-eval-artifacts
Oct 20, 2026
Merged

jaydgoss merged 1 commit into
mainfrom
jaygoss/no-eval-artifacts

Conversation

@jaydgoss

@jaydgoss jaydgoss commented Oct 20, 2026 •

Copy link
Copy Markdown
Member

The AI Evals workflow kept each run's outputs as a GitHub Actions artifact. This repo is public, so anyone could download them. We want nothing from a run surfaced publicly, so this drops the artifact. The results still go to evals.sentry.dev, and the job log shows only pytest's progress and failures.

Testing: workflow-only change; the run-evals action already treats an empty artifact-name as no artifact.

🤖 Generated with Claude Code

This repo is public, so the run-evals artifact (transcripts, products reports and the
agent's workspace diff) was readable by anyone. The results still go to evals.sentry.dev.
@jaydgoss
jaydgoss requested a review from a team October 20, 2026 17:29
@jaydgoss
jaydgoss merged commit bd3d654 into main Oct 20, 2026
15 checks passed
@jaydgoss
jaydgoss deleted the jaygoss/no-eval-artifacts branch October 20, 2026 17:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants