Merged
Conversation
- Added `download_state.py` for managing download state persistence with JSON storage. - Introduced `DownloadStateStore` class for tracking download progress and status. - Enhanced `download_burst_on_demand` function in `downloader.py` to support resumable downloads with state management. - Implemented exponential backoff and retry logic for transient failures in download processes. - Updated `pull_down` function in `s5cmd_utils.py` to include retry and worker count options. - Modified `CopernicusDataSearcher` to utilize download state and support resumable downloads. - Added tests for download state functionality and updated existing tests to cover new features.
Add a high-level download mode selector across the CLI and product download API. - route fast mode through s5cmd transfers - route safe mode through native resumable downloads - keep legacy resume and robust knobs as deprecated compat paths - update CLI tests and user-facing docs to prefer mode
Add the native product download implementation and related resume/state test coverage without including unrelated repo changes. - add native resumable downloader support - keep download state and package exports aligned - add targeted tests for native download and resume paths
Add the search and burst-mode test updates related to WKT, coverage, and pagination behavior.
Update visualization helpers and interactive tooling alongside their targeted test coverage.
Refresh the insar workflow support code, associated tests, and the search/download notebook example.
Update the project and Sphinx documentation, including setup, getting started, installation, and contributor guidance.
Handle non-polygon AOIs in footprint plotting and ensure credential reset prompts happen only once across retries.
Document the new download modes, native resumable support, AOI plotting support, and follow-up regression fixes.
…s and fixes fix(cli): improve download mode resolution and deprecate conflicting resume_mode options test(cli): add tests for download mode resolution compatibility with resume_mode docs(readme): remove outdated guidelines and pagination examples
…configurable options fix(dependencies): add requests library for improved functionality test(download): add unit tests for download_product retry behavior
- Updated the default state file path to store it in a dedicated '.phidown' directory, enhancing organization of download metadata. - Modified the `default_state_file` function to create the '.phidown' directory if it doesn't exist. - Enhanced user feedback during download attempts in `CopernicusDataSearcher` by adding verbose output for each attempt and clearer error messages. - Updated tests to reflect changes in the state file path and ensure the '.phidown' directory is created.
…nload state tests
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.