Skip to content

feat(server): EPIC-1 server pipeline — search API, backends, ingestion, dashboard, eval - #2

Merged
evidence-codes merged 16 commits into
epic-0/mono-repo-bootstrapfrom
epic-1/server-foundation
May 29, 2026
Merged

feat(server): EPIC-1 server pipeline — search API, backends, ingestion, dashboard, eval#2
evidence-codes merged 16 commits into
epic-0/mono-repo-bootstrapfrom
epic-1/server-foundation

Conversation

@evidence-codes

Copy link
Copy Markdown
Owner

EPIC-1 — Server Pipeline (Phase 1)

Builds out the Phase 1 server pipeline on top of the EPIC-0 mono-repo bootstrap. Foundation built directly; the five backend/feature slices were built by a parallel agent fleet (isolated worktrees) and integrated + verified here.

Stacked on epic-0/mono-repo-bootstrap (PR #1). Review/merge that first; this PR's base auto-retargets to main once #1 merges.

What's included

  • Decision — ADR-0002: server does not persist fallback query vectors (D-7 / OQ-7).
  • Contracts — Phase 1 OpenAPI: /search, /admin/catalog, /admin/index/status, /health.
  • Foundation — FastAPI app + Pydantic schemas + protocol seams; pluggable backends via zetix_api.factory (env-selected).
  • Embedding (fleet B)OpenCLIPEmbeddingService (ViT-B/32), ZETIX_EMBEDDER=openclip.
  • Vector store (fleet C)ChromaVectorStore, ZETIX_VECTOR_STORE=chroma; verified end-to-end.
  • Ingestion + storage + DB (fleet A) — CSV/JSON/Shopify adapters, Local/S3 ObjectStorage, SQLAlchemy models (no PII).
  • Admin dashboard (fleet D) — standalone FastAPI+Jinja2 (upload, index status, search-logs stub).
  • Eval harness (fleet E) — Top-1/3/5 + per-category via make eval.

Verification

  • ruff check server models → clean.
  • Server suite: 23 passed, 1 skipped (OpenCLIP test skips — torch not installed in CI/dev here).
  • chromadb installed → ChromaDB backend verified live (/admin/catalog/search returns the match).
  • make eval runs the real pipeline (synthetic set; Top-3 100% by construction with the stub embedder).

Status / honesty

EPIC-1 is 🟡 in progress, not complete. Dev-complete (🟢): search/ranking/admin (FR-06/34/35), both backends, ingestion, dashboard, eval harness. Still 🔴: TLS 1.3 (1.C.5), a real 10k labelled eval set (1.E.1), and the M1 acceptance bar — Top-3 > 80% on a real catalog (1.E.4) — which needs ZETIX_EMBEDDER=openclip + real data. OpenCLIP is code-complete + lint-clean but not runtime-verified here (no torch).

Per the working agreement, these are 🟢 (dev-complete) pending owner verification → ✅.

🤖 Generated with Claude Code

evidence-codes and others added 13 commits May 29, 2026 20:24
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
…ex status)

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
…ion)

Reference impls (in-memory store, stub embedder) behind protocols; pluggable backends via zetix_api.factory; /search and /admin endpoints with tests.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Lazy-imported torch/open_clip/PIL; 512-dim L2-normalised. Test skips without torch.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
…hroma)

Per-store cosine collections, JSON payloads, distance→score; idempotent clear(). Verified end-to-end.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
…schema

CSV/JSON/Shopify -> Product; Local/S3 ObjectStorage; SQLAlchemy models (no PII).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
…earch-logs stub)

Standalone FastAPI+Jinja2 app calling the API; search-logs is a stub pending a logs endpoint.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Runs through /admin/catalog->/search via 'make eval'. Synthetic set is high by construction; real M1 needs OpenCLIP + a 10k catalog.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@gitguardian

gitguardian Bot commented May 29, 2026

Copy link
Copy Markdown

⚠️ GitGuardian has uncovered 3 secrets following the scan of your pull request.

Please consider investigating the findings and remediating the incidents. Failure to do so may lead to compromising the associated services or software components.

🔎 Detected hardcoded secrets in your pull request
GitGuardian id GitGuardian status Secret Commit Filename
33479418 Triggered Generic Password 1a65999 server/docker-compose.yml View secret
33479514 Triggered Generic Password b4f4cb5 server/docker-compose.yml View secret
33479514 Triggered Generic Password b4f4cb5 server/docker-compose.yml View secret
🛠 Guidelines to remediate hardcoded secrets
  1. Understand the implications of revoking this secret by investigating where it is used in your code.
  2. Replace and store your secrets safely. Learn here the best practices.
  3. Revoke and rotate these secrets.
  4. If possible, rewrite git history. Rewriting git history is not a trivial act. You might completely break other contributing developers' workflow and you risk accidentally deleting legitimate data.

To avoid such incidents in the future consider


🦉 GitGuardian detects secrets in your source code to help developers and security teams secure the modern development process. You are seeing this because you or someone else with access to this repository has authorized GitGuardian to scan your pull request.

evidence-codes and others added 3 commits May 29, 2026 21:01
Use env-var substitution with dev defaults; drop the inline postgresql:// URI.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Fixes ModuleNotFoundError: fastapi in the eval job.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@evidence-codes
evidence-codes merged commit c002aa4 into epic-0/mono-repo-bootstrap May 29, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant