Skip to content

feat(ingestion): add guarded catalog refresh workflow - #35

Merged
apantaz merged 1 commit into
masterfrom
feat/guarded-catalog-refresh
Sep 1, 2026
Merged

apantaz merged 1 commit into
masterfrom
feat/guarded-catalog-refresh

Conversation

@apantaz

@apantaz apantaz commented Sep 1, 2026

Copy link
Copy Markdown
Owner

Summary

  • add a guarded end-to-end catalog refresh command
  • select only the latest complete TMDB discovery snapshot for publication
  • support routine incremental enrichment and clean metadata backfills
  • make TMDB watch-provider enrichment explicitly opt-in
  • enrich lifecycle-only new and upcoming titles with missing TMDB metadata
  • prefer fresh discovery ratings, vote counts, and popularity
  • add minute-by-minute enrichment progress logging
  • add a complete routine-refresh and clean-rebuild runbook

Safety

  • incomplete or sampled discovery runs cannot become live
  • failed dbt candidates preserve the previous serving database
  • Streaming API requests remain bounded by run and monthly limits
  • completed enrichment batches remain resumable

Validation

  • 117 Python tests passed
  • dbt compile and parse passed
  • dbt documentation generation passed
  • Ruff, formatting, secret detection, and pre-push coverage passed

@apantaz
apantaz merged commit 8c398d5 into master Sep 1, 2026
2 checks passed
@apantaz
apantaz deleted the feat/guarded-catalog-refresh branch September 1, 2026 20:02
@apantaz apantaz mentioned this pull request Sep 1, 2026
3 of 4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant