Skip to content

feat: pull pinned models by digest on Ollaya 0.13.0 and make it the default runtime - #184

Merged
maks3201 merged 2 commits into
mainfrom
feat/ollaya-013-digest-pull
Oct 13, 2026
Merged

maks3201 merged 2 commits into
mainfrom
feat/ollaya-013-digest-pull

Conversation

@maks3201

Copy link
Copy Markdown
Owner

Ollaya 0.13.0 (ollaya-dev/ollaya#64) can pull a model by manifest digest. Facts are in docs/spikes/011-ollaya-0.13.md.

  • 0.13.0 and its -cuda image are in the version to digest table; 0.13.0 is the default runtime for new revisions. Existing revisions keep the runtime recorded in status, so an operator upgrade does not roll them.
  • On 0.13.0 and later the prefetch Job pulls <model>@sha256:<digest>, so a lost store is rebuilt to the recorded revision after the tag moved upstream (before: permanent UpstreamTagMoved). If the registry or mirror has no by-digest manifest route, it falls back once to the tag pull with the old checks.
  • DIGEST_MISMATCH from the runtime is a permanent DigestMismatch; an unknown digest is ModelNotFound. A custom spec.image without an explicit runtimeVersion keeps the tag pull.
  • The readiness gate accepts an /api/ps name with a @sha256: suffix.
  • Docs: README runtime row, ARCHITECTURE security section, GPU CI notes, ModelMismatch runbook. GPU behaviour is verified on 0.12.1-cuda, not yet on 0.13.0-cuda.

Tests: engine unit tests for the digest path, fallback, classification and version gate; controller envtest suite passes. E2E infra for 0.13.0 (mirror by-digest route, preloaded image) is a separate PR.

…efault runtime

On Ollaya 0.13.0 and later the prefetch Job pulls <model>@sha256:<digest>,
so a lost store is rebuilt to the recorded revision even after its tag
moved upstream. A registry or mirror without by-digest manifests falls back
to the tag pull. A digest mismatch is a permanent DigestMismatch. A custom
image without an explicit runtimeVersion keeps the tag pull. Older runtimes
keep the seeded tag pull. Existing revisions keep their recorded runtime.
@codecov

codecov Bot commented Oct 13, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@maks3201
maks3201 enabled auto-merge (squash) October 13, 2026 22:52
@sonarqubecloud

Copy link
Copy Markdown

@maks3201
maks3201 merged commit 4aea440 into main Oct 13, 2026
29 checks passed
@maks3201
maks3201 deleted the feat/ollaya-013-digest-pull branch October 13, 2026 23:06
maks3201 pushed a commit that referenced this pull request Oct 18, 2026
🤖 I have created a release *beep* *boop*
---


##
[0.6.0](v0.5.1...v0.6.0)
(2026-10-18)


### Features

* pull pinned models by digest on Ollaya 0.13.0 and make it the default
runtime
([#184](#184))
([4aea440](4aea440))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant