Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 19 additions & 0 deletions GETTING_STARTED.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,24 @@
# Getting Started with InsightWeaver

> **Superseded 2026-08-31 (backlog task 012).** The briefing product this
> document describes -- `brief`, beats, questions, predictions, frames,
> synthesis and rendering -- has been **deleted**. Roughly 8,900 lines of source
> and most of the test suite went with it, in a single commit, because the
> operator's call was that git history is the rollback path and dead code in the
> tree reads as current. `insightweaver` now exposes one command, `sources`.
>
> What survives is ingestion: `src/sources/`, `src/rss/`, `src/processors/`, the
> feed config, and five modules ported for tiers not yet built
> (`src/matching/entity_matcher.py`, `src/matching/coverage_probe.py`,
> `src/llm/claude_client.py`, `src/utils/cadence.py`,
> `src/processors/deduplicator.py`).
>
> **Everything below this banner describes the deleted product and has not been
> rewritten.** Rewriting it needs the new pipeline to exist first, which task 012
> explicitly puts out of scope. Read it as history until it is replaced.

---

This guide walks you through downloading, installing, and running InsightWeaver on your computer.

---
Expand Down
43 changes: 14 additions & 29 deletions Makefile
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
.PHONY: help install install-dev test lint format fmt typecheck check pre-commit clean clean-all coverage run-brief run-forecast db-migrate db-migrate-down db-reset update-deps
.PHONY: help install install-dev test lint format fmt typecheck check pre-commit clean clean-all coverage db-drop-briefing update-deps

# Tool resolution (added 2026-08-24).
# Before this, every recipe called bare `pytest` / `ruff` / `mypy`, which only
Expand Down Expand Up @@ -43,14 +43,9 @@ help:
@echo " make pre-commit Run all pre-commit hooks"
@echo " make check Run all checks (lint + typecheck + test)"
@echo ""
@echo "Application:"
@echo " make run-brief Run intelligence brief"
@echo " make run-forecast Run forecast generation"
@echo ""
@echo "Database:"
@echo " make db-migrate Run database migrations"
@echo " make db-migrate-down Rollback database migrations"
@echo " make db-reset Reset database (WARNING: deletes all data)"
@echo " make db-drop-briefing Drop the deleted briefing product's tables"
@echo " (DESTRUCTIVE; captures to a dump first)"
@echo ""
@echo "Cleanup:"
@echo " make clean Remove build artifacts and cache"
Expand Down Expand Up @@ -96,12 +91,11 @@ pre-commit:
check: lint typecheck test
@echo "All checks passed."

run-brief:
insightweaver brief

run-forecast:
insightweaver forecast

# run-brief / run-forecast / db-migrate / db-migrate-down / db-reset were
# removed on 2026-08-31 (backlog task 012): every command and migration they
# invoked was deleted with the briefing product. db-reset in particular ran
# `rm -f data/insightweaver.db` behind a y/N prompt, which is not a guard worth
# keeping pointed at a 55,249-row corpus.
clean:
find . -type d -name "__pycache__" -exec rm -rf {} + 2>/dev/null || true
find . -type d -name "*.egg-info" -exec rm -rf {} + 2>/dev/null || true
Expand All @@ -119,18 +113,9 @@ clean-all: clean
rm -rf venv/
rm -rf .venv/

db-migrate:
python -m src.database.migrations.add_forecast_tables

db-migrate-down:
python -m src.database.migrations.add_forecast_tables down

db-reset:
@echo "WARNING: This will delete all data!"
@read -p "Are you sure? [y/N] " confirm; \
if [ "$$confirm" = "y" ] || [ "$$confirm" = "Y" ]; then \
rm -f data/insightweaver.db; \
python -m src.database.migrations.add_forecast_tables; \
else \
echo "Cancelled"; \
fi
# Deliberately does NOT pass --confirm. The migration refuses without it, so
# running this target prints what it would destroy and stops; the operator types
# the real command themselves. A Makefile target that drops tables on `make` is
# the accident this arrangement exists to prevent.
db-drop-briefing:
$(PYTHON) -m src.database.migrations.drop_briefing_tables
19 changes: 19 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,24 @@
# InsightWeaver

> **Superseded 2026-08-31 (backlog task 012).** The briefing product this
> document describes -- `brief`, beats, questions, predictions, frames,
> synthesis and rendering -- has been **deleted**. Roughly 8,900 lines of source
> and most of the test suite went with it, in a single commit, because the
> operator's call was that git history is the rollback path and dead code in the
> tree reads as current. `insightweaver` now exposes one command, `sources`.
>
> What survives is ingestion: `src/sources/`, `src/rss/`, `src/processors/`, the
> feed config, and five modules ported for tiers not yet built
> (`src/matching/entity_matcher.py`, `src/matching/coverage_probe.py`,
> `src/llm/claude_client.py`, `src/utils/cadence.py`,
> `src/processors/deduplicator.py`).
>
> **Everything below this banner describes the deleted product and has not been
> rewritten.** Rewriting it needs the new pipeline to exist first, which task 012
> explicitly puts out of scope. Read it as history until it is replaced.

---

**A tool for building warranted, inspectable understanding from RSS feeds.**

---
Expand Down
88 changes: 0 additions & 88 deletions config/beats/us-public-sector-compliance.json

This file was deleted.

74 changes: 74 additions & 0 deletions config/probes/known-events.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,74 @@
{
"_provenance": "Authored by hand for the us-public-sector-compliance beat and recovered from commit 673a8dd when backlog task 012 deleted that beat. Beats no longer exist; these are kept because they are real, verified past events in the operator's domain and task 018's staleness check needs exactly this shape. The loader for the old beat format is gone -- task 018 reads this file directly. Recovered 2026-08-31.",
"probes": [
{
"date": "2026-08-25",
"what": "OPM issued corrections to its final rules on reduction-in-force, suitability and probationary appeals",
"terms": [
"OPM"
],
"any_of": [
[
"reduction in force",
"suitability",
"probationary"
],
[
"final rule",
"correction"
]
]
},
{
"date": "2026-08-24",
"what": "Supreme Court let the executive order restricting mail-in voting take effect",
"terms": [
"Supreme Court",
"mail-in voting"
],
"any_of": [
[
"allow*",
"restriction*",
"sides with",
"stay"
]
]
},
{
"date": "2026-08-24",
"what": "FedRAMP director reinstated",
"terms": [
"FedRAMP"
],
"any_of": [
[
"director",
"administrator"
],
[
"reinstat*",
"return*",
"restored"
]
]
},
{
"date": "2021-11-03",
"what": "CISA issued Binding Operational Directive 22-01, creating the Known Exploited Vulnerabilities catalog and its remediation deadlines",
"terms": [
"CISA"
],
"any_of": [
[
"binding operational directive",
"BOD 22-01"
],
[
"known exploited",
"catalog"
]
]
}
]
}
12 changes: 8 additions & 4 deletions pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -173,14 +173,18 @@ module = [
]
ignore_errors = true

# Updated 2026-08-31 (backlog task 012). `src.context.*`, `src.pipeline.*` and
# `src.prompts.*` were deleted; `src.forecast.*` had not existed for some time.
# `src.matching.*` and `src.llm.*` are the new homes of the five modules ported
# out of `src.context`, and they inherit the suppression those files already had
# rather than gaining a new one -- the annotations here are SQLAlchemy Column
# descriptors mypy reads as their column type, which predates this task.
[[tool.mypy.overrides]]
module = [
"src.processors.*",
"src.rss.*",
"src.context.*",
"src.forecast.*",
"src.pipeline.*",
"src.prompts.*",
"src.matching.*",
"src.llm.*",
"src.feed_manager",
]
ignore_errors = true
Expand Down
Loading
Loading