Skip to content

Implement Durham City OnBase scraper#176

Closed
ThatXliner wants to merge 1 commit into
mainfrom
codex/durham-city-onbase
Closed

Implement Durham City OnBase scraper#176
ThatXliner wants to merge 1 commit into
mainfrom
codex/durham-city-onbase

Conversation

@ThatXliner

Copy link
Copy Markdown
Collaborator

Closes #166.

What changed

  • Adds a current-cycle Durham City Council scraper using official OnBase Agenda Online endpoints.
  • Persists meetings, work sessions, agenda/minutes items, attachments, action text, and votes.
  • Adds provider-neutral local meeting/item storage, migration, readers, and tRPC routes.
  • Adds deterministic fixtures, caching, request pacing, retries, and documentation.

Validation

  • 16 scraper tests, 5 API tests, and 7 environment tests.
  • Scraper, API, DB, and environment typechecks.
  • API lint and diff checks.
  • Live check: 25 meetings; meeting 748 parsed 23 items, 22 with action/vote text.

Notes

A real migration/scrape was not run without a disposable Postgres target. Provider-neutral local-government schema files overlap with #167 and #170.

@vercel

vercel Bot commented Jul 22, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
billion-nextjs Ready Ready Preview, Comment Jul 22, 2026 3:36pm

@ThatXliner

Copy link
Copy Markdown
Collaborator Author

Superseded by consolidated PR #181, which combines the North Carolina and Texas current-cycle scrapers and resolves the shared local-government schema/API overlap.

@ThatXliner ThatXliner closed this Jul 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Data Source] Build Durham City Council OnBase agenda and legislation scraper

1 participant