Skip to content

Add cached_explicit_singularity resolver for biocontainers CVMFS cache - #464

Merged
natefoo merged 1 commit into
mainfrom
cached_explit_singularity_resolver
Jun 11, 2026
Merged

Add cached_explicit_singularity resolver for biocontainers CVMFS cache#464
natefoo merged 1 commit into
mainfrom
cached_explit_singularity_resolver

Conversation

@mvdbeek

@mvdbeek mvdbeek commented Jun 11, 2026

Copy link
Copy Markdown
Member

Summary

  • Adds cached_explicit_singularity resolver ([26.1] Add namespace stripping to CachedExplicitSingularityContainerResolver galaxy#22878) before explicit_singularity in all eligible container resolver configs
  • Uses cache_directory: /cvmfs/singularity.galaxyproject.org/all, namespace: biocontainers, and cache_directory_cacher_type: dir_mtime
  • Strips docker://quay.io/biocontainers/ prefix from explicit container specs and looks up flat filenames in the CVMFS cache before falling back to pulling

Eligible destinations (have singularity.galaxyproject.org accessible)

  • cyclone / jetstream2 — native CVMFS (via global config)
  • tacc_hpc (stampede3, stampede3_skx, frontera) — cvmfsexec singularity.galaxyproject.org
  • bridges2, expanse, anvil — cvmfsexec mountrepo singularity.galaxyproject.org
  • stampede3_nvdimm (VGP) — cvmfsexec singularity.galaxyproject.org

Not updated

  • rockfish_devgalaxy — no CVMFS singularity mount
  • frontera_rtxsingularity_volumes: null, no cached resolvers by design

Uses galaxyproject/galaxy#22878 to resolve explicit docker://quay.io/biocontainers/
container specs against /cvmfs/singularity.galaxyproject.org/all before falling
back to pulling. Applied to all destinations that mount singularity.galaxyproject.org
(cyclone, jetstream2, tacc_hpc, bridges2, expanse, anvil, stampede3_nvdimm).
@natefoo
natefoo merged commit 8b5bca4 into main Jun 11, 2026
@itisAliRH
itisAliRH deleted the cached_explit_singularity_resolver branch June 14, 2026 15:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants