Skip to content

Refactor ConfigGenerator #39

Description

@vijusudhi

Currently, ConfigGenerator does the minimal setting with one IC config, (LoRA + FFT) finetuning and corrseponding evaluations.

TODOs:

  • Extend this to different possible configurations
    For example:
    • IC experiments can be conducted on different prompt templates, consider using Dspy?
    • Zero-shot, few-shot
    • Fine tuning experiments can be extended to different PEFT techniques
    • For PEFT fine tuning, different hyperparams can be tried
  • How to extend the Train and Eval Configurations?
    Maybe use Hydra and hierarchical configurations for this?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2UtilsRelates to - ConfigGenerator, ConfigExectuor - Model filtration

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions