Repository navigation

Dev/leasing controller - #9

Merged

edlwang merged 96 commits into

mainfrom

dev/leasing-controller

Jun 23, 2026

Merged

Dev/leasing controller#9
edlwang merged 96 commits into
mainfrom
dev/leasing-controller

Commits on Jun 16, 2026
- Add backend-agnostic lease ledger (leasing/controller redesign)
  
  Erotemic
  and
  claude
  committed
  b1ebf17
- Add serving catalog parser to the leasing model
  
  Erotemic
  and
  claude
  committed
  1274470
- Add backend protocol + controller (reconcile loop)
  
  Erotemic
  and
  claude
  committed
  b512c62
- Add leasing CLI verbs + endpoint env-file (dry-run backend)
  
  Erotemic
  and
  claude
  committed
  0100a52
- Add single-host GPU placement planner (Compose backend, slice 1)
  
  Erotemic
  and
  claude
  committed
  3f136a3
- Add Compose backend (converge-style) + controller converge path
  
  Erotemic
  and
  claude
  committed
  301d4de
- Add Compose LiteLLM front door, real descriptor base_url, converge lock
  
  Erotemic
  and
  claude
  committed
  aca9256
- Consolidate GPU placement primitives into hardware.py
  
  Erotemic
  and
  claude
  committed
  9c8e05a
- Consolidate HTTP readiness probes into infer_stack.probe
  
  Erotemic
  and
  claude
  committed
  7e55df7
Commits on Jun 17, 2026
- Add Ollama pull/warmup readiness to the Compose backend
  
  Erotemic
  and
  claude
  committed
  77db567
- Fix Compose GPU capabilities shape; add yardrat test plan
  
  Erotemic
  and
  claude
  committed
  0f7c665
- Guard rendered compose with docker compose config validation
  
  Erotemic
  and
  claude
  committed
  630c5df
- Fix test isolation: force INFER_STACK_* in subprocess run_cli helpers
  
  Erotemic
  and
  claude
  committed
  29234e5
- Make Compose observe() tolerant of a stale/invalid compose file
  
  Erotemic
  and
  claude
  committed
  9416bf9
- Fix corrupted catalog heredoc in the leasing test plan
  
  Erotemic
  and
  claude
  committed
  27f08ad
- Manage the LiteLLM key in-backend; ship it in the env-file; drop bad vLLM flag
  
  Erotemic
  and
  claude
  committed
  5565624
- Make `config paths`/`status` relevant to the leasing model
  
  Erotemic
  and
  claude
  committed
  a1456b6
- Test plan: add Content-Type to chat curls (F10, doc-only)
  
  Erotemic
  and
  claude
  committed
  2955c74
- Make day-2 compose wrappers leasing-aware (logs/ps/restart/pull/start/stop)
  
  Erotemic
  and
  claude
  committed
  ad1c96e
- Add dev/e2e_tests: executable leasing e2e harness with report
  
  Erotemic
  and
  claude
  committed
  a29eb51
- Fix e2e harness: exit (not return) in GPU-tier skip path
  
  Erotemic
  and
  claude
  committed
  cb7a255
- Add --include-display-gpus (close F5), both-GPU e2e tier, and demo walkthrough
  
  Erotemic
  and
  claude
  committed
  de2d4f7
- Fix LiteLLM not reloading on config change (coalescing readiness bug)
  
  Erotemic
  and
  claude
  committed
  6efad9b
- e2e harness: write report+rsync on Ctrl-C, exclude heavy caches from rsync
  
  Erotemic
  and
  claude
  committed
  19e461a
- Track LiteLLM keep-alive follow-up (#1 static table chosen, #2 DB retry later)
  
  Erotemic
  and
  claude
  committed
  56d24b3
- e2e: print rsync at start + reset GPU state between tiers; record design notes
  
  Erotemic
  and
  claude
  committed
  b030487
- Record resolved keep-warm eviction policy + approve compat-key group ids
  
  Erotemic
  and
  claude
  committed
  b41405f
- e2e: speed up GPU tiers (enforce-eager, SmolLM2, trim intentional waits)
  
  Erotemic
  and
  claude
  committed
  2abdd3d
- Fix converge crash when releasing the last model (empty desired set)
  
  Erotemic
  and
  claude
  committed
  f47fb5b
- e2e: wipe ledger between tiers, add progress heartbeat + cleanup.sh
  
  Erotemic
  and
  claude
  committed
  118187c
Commits on Jun 18, 2026
- e2e: rename endpoints qwen-*->smol-*, isolate config dir, fix status test, add wall time
  
  Erotemic
  and
  claude
  committed
  22e703e
- e2e: robustly clean up the progress heartbeat (no stragglers after a run)
  Erotemic
  committed
  ab73b77
- docs: switch leasing demo to SmolLM2; add CLI-redesign proposal
  
  Erotemic
  and
  claude
  committed
  253a361
- cli phase 1: `catalog` editor submodal + `help tree`
  
  Erotemic
  and
  claude
  committed
  70af3cf
- cli phase 2: `config` submodal + durable settings (backend, data_dir)
  
  Erotemic
  and
  claude
  committed
  562dd13
- cli phase 3: `secret` submodal (get/set/list); keep `secrets` alias
  
  Erotemic
  and
  claude
  committed
  b3433b2
- cli phase 4: `stack` submodal for day-2 ops; logs/ps kept top-level
  
  Erotemic
  and
  claude
  committed
  348c9aa
- cli phase 5: group the pre-leasing profile world under `infer-stack legacy`
  
  Erotemic
  and
  claude
  committed
  d27d139
- cli phase 6: docs for the reorg (demo on new CLI, README banner, changelog)
  
  Erotemic
  and
  claude
  committed
  c7f24f8
- cli: render `help tree` with rich (pretty + alignment-proof)
  
  Erotemic
  and
  claude
  committed
  6e8d419
- cli: interactive `config init` (rich prompts + confirm) with --yes
  
  Erotemic
  and
  claude
  committed
  3d30ce2
- cli: syntax-highlight catalog/config YAML output (rich)
  
  Erotemic
  and
  claude
  committed
  8f70e61
- cli: add `python -m infer_stack` entry + lazy heavy imports for snappy startup
  
  Erotemic
  and
  claude
  committed
  5a82963
- leasing: managed Open WebUI (default on), `infer-stack test`, `env` rename, LiteLLM warmup tuning
  
  Erotemic
  and
  claude
  committed
  e2e8a29
- leasing: fold `secret` into `env` (one verb for the managed env-file)
  
  Erotemic
  and
  claude
  committed
  fc3e79d
- cli: make `infer-stack status` leasing-aware (no stale "run setup" nag)
  
  Erotemic
  and
  claude
  committed
  f24f1e6
- cli: rich-format `infer-stack status` on a terminal
  
  Erotemic
  and
  claude
  committed
  b77a608
- catalog: default endpoint NAME to the model (Open WebUI shows the model)
  
  Erotemic
  and
  claude
  committed
  b31d17e
- leasing: release --all, rich leases, compose diff-approval, loguru narration
  
  Erotemic
  and
  claude
  committed
  a631cba
- leasing: force-evict released (idle) models — `evict` + `release --evict`
  
  Erotemic
  and
  claude
  committed
  70d9cc3
- catalog: auto-increment default endpoint names (-N) + multi-rm; model-centric demo
  
  Erotemic
  and
  claude
  committed
  61df5fd
- docs(leasing-demo): show explicit endpoint-name setup alongside model-centric
  
  Erotemic
  and
  claude
  committed
  5798e68
- leasing: add `infer-stack wait` (block until ready) for serve --no-wait fan-out
  
  Erotemic
  and
  claude
  committed
  2340fe3
Commits on Jun 19, 2026
- leasing: render/apply split, fail-fast placement, legible naming + status
  
  Erotemic
  and
  claude
  committed
  fe90d2e
- leasing: gate every converge behind the compose-diff prompt
  
  Erotemic
  and
  claude
  committed
  952c298
- leasing: model-vs-endpoint hint in the unknown-endpoint error
  
  Erotemic
  and
  claude
  committed
  9802179
- leasing: use every GPU by default; skipping the display GPU is opt-in
  
  Erotemic
  and
  claude
  committed
  b034131
- cli: config init mode message + --fresh; `<section> show` lists all
  
  Erotemic
  and
  claude
  committed
  e58b846
- config init: prompt for every known setting (incl. skip_display_gpus, ui)
  
  Erotemic
  and
  claude
  committed
  631d8d9
- leasing: keep the front door up at zero models (release/evict ≠ full teardown)
  
  Erotemic
  and
  claude
  committed
  d5e39d7
- leasing: optional single-port HTTP reverse proxy (front door)
  
  Erotemic
  and
  claude
  committed
  98b520f
- leasing: optional Textual TUI to monitor + control the stack
  
  Erotemic
  and
  claude
  committed
  ddc243a
- tui: multi-pane dashboard — catalog, leases/groups, live switchable logs
  
  Erotemic
  and
  claude
  committed
  e888eff
- tui: calmer, roomier layout — soft borders, padding, resizable panes
  
  Erotemic
  and
  claude
  committed
  4d90c54
- catalog: seed from server introspection (suggestion pool)
  
  Erotemic
  and
  claude
  committed
  4ef5147
- TUI tweaks
  Erotemic
  committed
  2313adc
- catalog: bring current-gen families into the suggestion pool
  
  Erotemic
  and
  claude
  committed
  a4f35be
- tui tweaks
  Erotemic
  committed
  889f10e
- tui work
  Erotemic
  committed
  1c9979a
- tui work
  Erotemic
  committed
  059c2cd
- tui: make lease↔deployment relationship legible; compact buttons
  
  Erotemic
  and
  claude
  committed
  08353d3
- leasing: rename session_id -> lease_id (hard, breaking)
  
  Erotemic
  and
  claude
  committed
  0ab64db
- journal: lease↔deployment legibility + session→lease rename
  
  Erotemic
  and
  claude
  committed
  4930d02
- leasing: rename 'group' concept -> 'deployment' (hard, breaking)
  
  Erotemic
  and
  claude
  committed
  2c2d815
- cleanup: remove dead placeholder tuning.py (no importers)
  
  Erotemic
  and
  claude
  committed
  508f442
- cli: remove pre-leasing profile world; make status holistic
  
  Erotemic
  and
  claude
  committed
  1677e99
- cli: remove resolver/validator/cli-compose/cli-probes; carve context
  
  Erotemic
  and
  claude
  committed
  05f4ff1
- backends: drop superseded compose_renderer (keep kubeai concept)
  
  Erotemic
  and
  claude
  committed
  ad54818
- tui: advanced endpoint params + edit/remove for endpoints & models
  
  Erotemic
  and
  claude
  committed
  6be217a
- tui: top-level Dashboard/Settings tabs + editable settings
  
  Erotemic
  and
  claude
  committed
  1f5c329
- tui: docker Control tab (compose up/down + compose-file path)
  
  Erotemic
  and
  claude
  committed
  002f16e
- tui: model cache/quant columns (cheap existence check)
  
  Erotemic
  and
  claude
  committed
  257da4c
- tui: drag bars between endpoints|models and leases|deployments
  
  Erotemic
  and
  claude
  committed
  b4947e5
- tui: labeled engine-adaptive endpoint wizard + layout fixes
  
  Erotemic
  and
  claude
  committed
  7c5a1e6
- tui: make leases + deployments panes collapsible
  
  Erotemic
  and
  claude
  committed
  e599e1f
- config: drop dead catalog chain; delete old top-level catalog.py
  
  Erotemic
  and
  claude
  committed
  75c54c1
- tui: fix endpoint action buttons overflowing the narrow sidebar
  
  Erotemic
  and
  claude
  committed
  383ed20
- tui: richer API tab (URLs, list-models, curl) + clipboard copy
  
  Erotemic
  and
  claude
  committed
  92e8880
- tui: fix API-tab MarkupError on URL render (use plain text)
  
  Erotemic
  and
  claude
  committed
  a48c1d5
- suggest: never size gpu_memory_utilization below the pool default
  
  Erotemic
  and
  claude
  committed
  ae0af53
- tui: fix System pane never polling + robust clipboard copy
  
  Erotemic
  and
  claude
  committed
  80b4641
- leasing: make LiteLLM optional + let Open WebUI manage Ollama's own models
  
  Erotemic
  and
  claude
  committed
  363d5bd
- docs: add a Sphinx user manual; move the current guides into it
  
  Erotemic
  and
  claude
  committed
  679f75e
Commits on Jun 20, 2026
- e2e+fix: cover optional-litellm / direct-ollama-webui / GPU pinning on yardrat
  
  Erotemic
  and
  claude
  committed
  45611d6
- e2e: fix dead --include-display-gpus flag + bad status assertion in new tiers
  
  Erotemic
  and
  claude
  committed
  0344636
Commits on Jun 23, 2026
- Fix TUI resize bug and collapse serve and acquire + other stuff
  edlwang
  committed
  8150e33

Commits

Commits on Jun 16, 2026

Commits on Jun 17, 2026

Commits on Jun 18, 2026

Commits on Jun 19, 2026

Commits on Jun 20, 2026

Commits on Jun 23, 2026