Live civic-data source contract drift

[github-actions]

The daily live-source check found an upstream contract change.

Workflow: https://github.com/cityscroll/crol-list/actions/runs/30541381888

ok checkbook-contracts: Contracts
ok checkbook-nycha-contracts: Contracts_NYCHA
ok abo-local-development-corporations: d84c-dk28 · 240d old
ok citywide-payroll: k397-673e · 104d old
ok active-civil-service-list: vx8i-nprf · 0d old
ok zap-projects: hgx4-8ukb · 64d old
ok mappluto: 57d old
ok nyc-geosearch: availability and schema
ok dob-now-job-filings: w9ak-ipjd · 0d old
ok nyc-agencies: t3jq-9nkf · 0d old
ok dcas-exam-notices: manual source reachable
ok nyc-rules-rss: 1d old
ok nyc-council-legistar: manual source reachable
error fetch failed
error nycida-build-nyc-projects: landing page HTTP 403
error checkbook-spending: missing XML fields spending_id, vendor_name, check_date
error fetch failed
error fetch failed
error fetch failed
error fetch failed
error fetch failed
error fetch failed
error fetch failed
error dcas-annual-exam-outcomes: landing page HTTP 403
error fetch failed

[github-actions]

The daily live-source check found an upstream contract change.

Workflow: https://github.com/cityscroll/crol-list/actions/runs/30594440749

ok checkbook-contracts: Contracts
ok checkbook-nycha-contracts: Contracts_NYCHA
ok citywide-payroll: k397-673e · 105d old
ok active-civil-service-list: vx8i-nprf · 0d old
ok zap-projects: hgx4-8ukb · 65d old
ok zap-bbl: 2iga-a6mk · 65d old
ok mappluto: 58d old
ok nyc-geosearch: availability and schema
ok dob-now-job-filings: w9ak-ipjd · 0d old
ok expense-budget: mwzb-yiwb · 22d old
ok dcas-exam-notices: manual source reachable
ok nyc-rules-rss: 2d old
ok doing-business-entities: 72mk-a8z7 · 251d old
ok ulurp-recommendations: 4j6i-9rmr · 1857d old
error fetch failed
error nycida-build-nyc-projects: landing page HTTP 403
error checkbook-spending: missing XML fields spending_id, vendor_name, check_date
error fetch failed
error fetch failed
error fetch failed
error fetch failed
error fetch failed
error fetch failed
error zap-api-outcomes: machine endpoint HTTP 404
error fetch failed
error fetch failed
error dcas-annual-exam-outcomes: landing page HTTP 403
error fetch failed
error fetch failed
error nyc-council-legistar: machine endpoint HTTP 404
error passport-public-contracts: landing page HTTP 403
error passport-public-rfx: landing page HTTP 403
error fetch failed
error capital-projects: source is stale (421 days; limit 120)
error fetch failed
error fetch failed

[github-actions]

The daily live-source check found an upstream contract change.

Workflow: https://github.com/cityscroll/crol-list/actions/runs/30595385181

ok city-record: dg92-zbpx · 0d old
ok nycida-build-nyc-projects: known bot-blocked landing; no machine probe (product-side challenge handling)
ok checkbook-contracts: Contracts
ok checkbook-spending: Spending (contract_id probe)
ok ocp-recent-contract-awards: qyyg-4tf5 · 0d old
ok checkbook-nycha-contracts: Contracts_NYCHA
ok abo-local-authorities: 8w5p-k45m · 241d old
ok abo-local-development-corporations: d84c-dk28 · 241d old
ok abo-state-authorities: ehig-g5x3 · 241d old
ok citywide-payroll: k397-673e · 105d old
ok active-civil-service-list: vx8i-nprf · 0d old
ok annual-examination-schedule: 4ptz-hmtc · 8d old
ok civil-service-list-certification: a9md-ynri · 1d old
ok zap-projects: hgx4-8ukb · 65d old
ok zap-bbl: 2iga-a6mk · 65d old
ok zap-api-outcomes: JSON machine endpoint reachable · landing reachable
ok mappluto: 58d old
ok nyc-geosearch: availability and schema
ok dob-now-job-filings: w9ak-ipjd · 0d old
ok legacy-dob-job-filings: ic3t-wcy2 · 0d old
ok nyc-agencies: t3jq-9nkf · 0d old
ok expense-budget: mwzb-yiwb · 22d old
ok dcas-exam-notices: landing reachable
ok dcas-annual-exam-outcomes: known bot-blocked landing; no machine probe (product-side challenge handling)
ok mocs-ll63-plans: disabled field case confirmed
ok ocp-current-solicitations: 3khw-qi8f · 0d old
ok nyc-rules-rss: 2d old
ok nyc-council-legistar: authenticated machine endpoint reachable · landing reachable
ok bid-tabulations-historical: 9k82-ys7w · 1048d old
ok capital-projects: n7gv-k5yt · reachable (pointer; freshness not gated; 421d since rowsUpdatedAt)
ok city-council-meetings-open-data: m48u-yjt8 · 212d old
ok doing-business-entities: 72mk-a8z7 · 251d old
ok ulurp-recommendations: 4j6i-9rmr · 1857d old
ok ulurp-recommendation-pdfs: gt5i-dmde · 3138d old
error passport-public-contracts: machine endpoint HTTP 403
error passport-public-rfx: machine endpoint HTTP 403

[jimdc]

Resolution

The daily live source-contract monitor mixed real catches with false alarms on its first runs. That is fixed in #207.

What was real this morning

• Checkbook Spending field mismatch — the product now joins payments by contract_id after the Contracts domain (PIN is rejected on Spending). The monitor was still asserting obsolete XML field names. Re-trued to the live Spending shape.
• NYCIDA / bot-blocked publisher pages — CI runners cannot open some city landings; that is not the same as the source vanishing. The product Worker already treats Cloudflare challenge HTML as a feed failure with notice-derived fallback.

What was monitor noise (fixed)

• Anonymous fetch failed lines (now every failure names source id + URL class)
• Legistar / ZAP machine endpoints pointed at non-probeable URLs (now a cheap Legistar Bodies auth probe and a real ZAP sample project)
• PASSPort / DCAS / NYCIDA landing (and PASSPort dataJs) HTTP 403 from GitHub runners — reclassified as known bot-blocked CI egress; product materialization is the contract
• Capital Projects pointer-class freshness gate (existence/schema only; no ingest staleness fail)
• MOCS LL63 landing URL moved by the publisher (updated to the current path)

Current state

Live workflow on the fix branch: green (run https://github.com/cityscroll/crol-list/actions/runs/30595762549).

Closing this issue. Future alerts should mean genuine upstream drift again (vanished dataset, schema loss on fields the product uses, broken machine endpoint, or ingest-class freshness).