Skip to content

fix: add retry logic and checkpoint support for filter command#1

Open
mosumosu-JAPAN wants to merge 1 commit into
coolwoods19:mainfrom
mosumosu-JAPAN:main
Open

fix: add retry logic and checkpoint support for filter command#1
mosumosu-JAPAN wants to merge 1 commit into
coolwoods19:mainfrom
mosumosu-JAPAN:main

Conversation

@mosumosu-JAPAN
Copy link
Copy Markdown

fix: retry logic and checkpoint support for filter command

@mosumosu-JAPAN
Copy link
Copy Markdown
Author

What this fixes

Two bugs that cause kompile filter to crash on large datasets:

  1. Retry logic: Haiku occasionally returns a list instead of a dict,
    or invalid JSON. Added up to 3 retries before discarding the source.

  2. Checkpoint support: Filter now saves progress after each source,
    So a crashed run resumes from where it left off instead of restarting
    from the beginning.

Tested on around 1500~ Claude conversations.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants