Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 6 additions & 2 deletions .github/workflows/canary.yml
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,10 @@ on:
# Off the hour, so it is not competing with every other cron job for
# runner availability.
- cron: "23 6 * * *"
# Mondays: the same jobs, WITH the paid secrets (proxy, Scraping Browser,
# captcha key). On the daily run above those secrets read as empty, so
# it takes the free no-secret route and bills nothing.
- cron: "23 6 * * 1"
workflow_dispatch:

# Read-only token: nothing here writes to the repository.
Expand All @@ -40,7 +44,7 @@ jobs:
# `secrets` is not available in a job-level `if`, so presence is tested
# through job env and read in each step's `if`.
env:
HAS_PROXY: ${{ secrets.SCREENER_PROXY != '' }}
HAS_PROXY: ${{ (github.event_name != 'schedule' || github.event.schedule == '23 6 * * 1') && secrets.SCREENER_PROXY != '' }}
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1

Expand All @@ -67,7 +71,7 @@ jobs:
# failing the job, not the shell's errexit.
continue-on-error: true
env:
SCREENER_PROXY: ${{ secrets.SCREENER_PROXY }}
SCREENER_PROXY: ${{ (github.event_name != 'schedule' || github.event.schedule == '23 6 * * 1') && secrets.SCREENER_PROXY || '' }}
run: |
set +e
python3 playwright_scraper.py \
Expand Down
6 changes: 6 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,12 @@ notes with a warning saying so.

## [Unreleased]

### Changed

- CI only: the canary's optional paid secret `SCREENER_PROXY` now reaches it only on a new weekly
run (Mondays 06:23 UTC) and on a manual dispatch. The daily run keeps its
schedule and takes the free route without them, so it bills nothing.

## [0.3.0] — 2026-10-16

> **Output file modes change.** JSON, CSV and `.meta.json` files used to be
Expand Down
Loading