Skip to content

Add perpetual deep_searcher scheduler#53

Draft
latekvo wants to merge 32 commits intomainfrom
@latekvo/implement-deepsearcher-worker
Draft

Add perpetual deep_searcher scheduler#53
latekvo wants to merge 32 commits intomainfrom
@latekvo/implement-deepsearcher-worker

Conversation

@latekvo
Copy link
Owner

@latekvo latekvo commented Jul 12, 2024

No description provided.

@latekvo
Copy link
Owner Author

latekvo commented Jul 15, 2024

Important before merging:

  • remove deep_searcher from the workers list - create a dedicated schedulers -s flag for it and webui
  • add simple tasks to summarizer
  • move all workload only to the workers while lifting it out of the schedulers class (deep_searcher)

It's all important, without these changes:

  • each new scheduler has to have a useless llm config created for it
  • schedulers are indistinguishable from core chain workers
  • schedulers have to be added to the -w possible options

@latekvo latekvo mentioned this pull request Jul 15, 2024
@latekvo latekvo changed the title Add perpetual deepsearcher scheduler Add perpetual deep_searcher scheduler Jul 15, 2024
@latekvo
Copy link
Owner Author

latekvo commented Jul 15, 2024

As of 55229b7 everything works as intended, but the criteria I pointed out earlier are still not met.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant