Skip to content

Investigate ways to improve embedding generation speed #20

Description

Theres evidence to believe we might be under utilizing the CPU on our EC2s as well as being bottlenecked by disk I/O and network I/O.

So, it might be worth looking into how we can speed that up similar to what we did with bf. Basically, spinning up a single GPU instance, and running various changes and seeing how it affects throughput.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions