Skip to content

Cache cleanup strategy#2

Open
tropicrainforest wants to merge 6 commits intomainfrom
cache-cleanup
Open

Cache cleanup strategy#2
tropicrainforest wants to merge 6 commits intomainfrom
cache-cleanup

Conversation

@tropicrainforest
Copy link
Contributor

This PR implements a cache cleanup strategy that removes caches either manually or automatically based on two policies: TTL and a size cap. By default, the TTL is 7 days and the size cap is 10 GB. Both limits can be increased via environment variables.

Copy link

@antarcticrainforest antarcticrainforest left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think that this repo is the right place for this sort of thing!

@tropicrainforest
Copy link
Contributor Author

@antarcticrainforest now auto cache cleanup logic has been eliminated from prims and we only kept the manual cleanup here as an util to be used standalone by its own or other apps that are using prism. It seems to be ready to go to main

@tropicrainforest
Copy link
Contributor Author

when it's merged and pypi and conda packages are released, we will implement the auto cache cleanup in the opened PR in data-loader of freva-nextgen

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants