Skip to content

Inacceptable performance on excellent_acticles full #39

Description

@rti

Terms

Behavior

When booting up with the full excellent articles dataset, the application takes ages to start up. After the embeddings have been generated with GPU acceleration (NVIDIA RTX 3090 takes ~10minutes to embed excellent articles full) the application hangs, 1 CPU core on 100%, GPU idle. Is it the storage of the embedding cache as json?

Operating System

runpod host with rtx 3090

Activity

  1. added
    bugSomething isn't working
    on Feb 19, 2024
  2. linked a pull request that will close this issuewip: postgres vecto.rs db, s/haystack/langchain #41on Feb 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions