Skip to content

Strengthen intelligence data model and RAG ingestion - #23

Merged
anpa1200 merged 1 commit into
mainfrom
agent/strengthen-intelligence-data-model
Jul 27, 2026
Merged

Strengthen intelligence data model and RAG ingestion#23
anpa1200 merged 1 commit into
mainfrom
agent/strengthen-intelligence-data-model

Conversation

@anpa1200

Copy link
Copy Markdown
Owner

What changed

  • adds canonical intelligence tags and provenance-backed cross-entity relationships
  • promotes report-derived IOCs into the normalized IOC store
  • links asset assessments to assets, CVE candidates, tags, and scanner evidence
  • queues source-scoped RAG reconciliation immediately after ingestion
  • adds an idempotent historical tag/link backfill
  • extends startup and self-test integrity validation

Why

IOC, CVE, report, and scan ingestion previously used partially independent structures. Report IOCs could remain embedded in JSON, canonical tags were not first-class relationships, and RAG updates depended on the periodic reconciliation interval.

Validation

  • full backend suite: 754 passed, 10 skipped
  • focused ingestion/RAG suite: 77 passed
  • final integrity/RAG suites: 29 passed and 24 passed
  • live backfill: 0 untagged IOC/CVE/report records and 0 structural tag errors
  • live RAG reconciliation: 122,262 documents seen and 118,502 updated

@anpa1200
anpa1200 merged commit 0911301 into main Jul 27, 2026
25 checks passed
@anpa1200
anpa1200 deleted the agent/strengthen-intelligence-data-model branch July 27, 2026 03:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants