docs: fix drift in Background Processing - #273
Draft
jack-arturo wants to merge 1 commit into
Draft
Conversation
- /health exposes only enrichment.* metrics; drop fabricated embedding.* and consolidation.* rows and point consolidation timings at GET /consolidate/status - only /enrichment/reprocess requires the admin token; /enrichment/status, /consolidate and /consolidate/status are covered by the API token guard - /enrichment/status returns no pending-ID samples - relationship-count LRU cache is consolidation.py L201, not L152 - repin automem/runtime_wiring.py permalinks to 8ff266e Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01EXhZREMSHTSqk3bhiNaX4k
Deploying automem-website with
|
| Latest commit: |
8e1319a
|
| Status: | ✅ Deploy successful! |
| Preview URL: | https://152bd7f1.automem-website.pages.dev |
| Branch Preview URL: | https://docs-audit-architecture-back.automem-website.pages.dev |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Docs-accuracy audit of
/docs/architecture/background-processing(never previously reviewed). 4 proven discrepancies fixed./healthexposes real-time statistics for all background systems", with rows forembedding.queue_depth,consolidation.last_runs,consolidation.next_runshealth_datacontains onlystatus,falkordb,qdrant,memory_count,vector_count,sync_status,vector_dimensions,enrichment,timestamp,graph. There is noembeddingorconsolidationkey at all.enrichment.statusrow, and pointed consolidation timings atGET /consolidate/statusautomem@8ff266e:automem/api/health.py#L86enrichment.pending= "Memories not yet enriched in graph"pendingislen(state.enrichment_pending)— the dedup set of enqueued jobs the worker has not yet claimed; it is discarded the moment a job goes inflightautomem@8ff266e:automem/api/health.py#L31/enrichment/status,/enrichment/reprocess,/consolidate,/consolidate/status;/enrichment/statusdescribed as returning "sample pending IDs"enrichment_reprocess()callsrequire_admin_token()./enrichment/status,/consolidateand/consolidate/statushave no admin gate./enrichment/statusreturnsstatus,queue_size,pending,inflight,max_attempts,stats,classification— no ID samples./enrichment/reprocessneedsX-Admin-Token, and corrected the/enrichment/statusdescriptionautomem@8ff266e:automem/api/enrichment.py#L38,automem@8ff266e:automem/api/enrichment.py#L25consolidation.py#L152@lru_cache(maxsize=10000)is atconsolidation.py#L201; L152 is an unrelated decay parameter assignment#L201and repinned to the audited SHAautomem@8ff266e:consolidation.py#L201Also repinned the two
automem/runtime_wiring.pypermalinks fromebcf5f16to8ff266e(that file changed since the old pin). The other seven source-note links point at files that are byte-identical betweenebcf5f16and8ff266e, so they were left alone.Verified correct and untouched: the eight-step
init_*startup sequence (runtime_wiring.py#L84-L92), every default in the Enrichment / Embedding / Consolidation configuration tables (automem/config.py,app.py#L217-L218), the enrichment retry model (flatENRICHMENT_FAILURE_BACKOFF_SECONDSsleep, give up afterENRICHMENT_MAX_ATTEMPTS), and the/admin/reembedreference.Verified against: automem@8ff266e62e65cb2e81719a765b05f64a2361a127
Questions
Unverified
Follow-ups
SyncWorker<br/>sync/runtime_bindings.py. The scheduling closure does live there, but the actual polling loop isautomem/sync/runtime_worker.py. Cosmetic, not fixed./healthpublishesenrichment.queue_depthfromenrichment_queue.qsize(), which excludes inflight jobs — the same "queue depth" wording appears on/docs/operations/healthwith an explicitly wrong definition ("pending + inflight"). Being handled on that page.Generated by Claude Code