Production patterns for building OSINT tools on Cloudflare's edge β D1 Β· KV Β· R2 Β· Cron Β· AT Protocol
A battle-tested collection of Cloudflare Workers patterns extracted from real OSINT tools in production. Built by VPDLNY running 65+ workers across 38 custom domains.
Use these as starters, templates, or reference implementations for your own intelligence tools.
| Pattern | Description | Storage |
|---|---|---|
news-aggregator |
NewsAPI + KV caching with TTL | KV |
d1-heatmap-api |
REST API over D1 for map data | D1 |
bsky-poster |
AT Protocol post with image embed | KV |
campaign-drip |
Scheduled thread posting engine | D1 |
cron-digest |
Daily digest via Telegram/email | KV |
btc-gating |
Bitcoin payment verification gateway | KV |
leaflet-worker |
Full Leaflet.js app served from Worker | Static |
r2-cdn |
R2-backed image CDN with custom domain | R2 |
Every OSINT tool follows this pattern:
1. CF Worker β handles all HTTP (no server, no cold start)
2. D1 β primary structured data (SQLite at edge)
3. KV β cache, rate limits, short-lived flags
4. R2 β images, PDFs, blobs
5. Cron β scheduled refreshes (max 5/account on free)
6. CF Access β Zero Trust auth for admin endpoints
# Clone the toolkit
git clone https://github.com/indicaindependent/cf-osint-toolkit
cd cf-osint-toolkit
# Pick a pattern
cd patterns/news-aggregator
# Configure
cp wrangler.toml.example wrangler.toml
# Deploy
npm install -g wrangler
wrangler login
wrangler deploy- πΊοΈ FaceHeatMap β FR surveillance tracker
- β‘ StraitTracker β Hormuz intel
- π WarHeatMap β Global conflict map
- π EdgeIntel β OSINT news aggregator
MIT β Build freely. Credit appreciated.
Extracted from 65+ production workers | Indica Independent