Skip to content

Support for local/in-process embedding libraries #25

Description

@titusz

For offline or cost-free embeddings, local libraries like FastEmbed
or sentence-transformers are useful. These run in-process without HTTP.

Possible API

client = Client()
response = client.embed(
    model="fastembed/BAAI/bge-small-en-v1.5",
    inputs=["Hello world"]
)

This would need a different provider type (no HTTP client) and could be an optional
dependency to keep the core package light.

Happy to discuss if this fits the project scope. It's a different paradigm from
API-based providers but would be quite handy for local development and testing.

Thanks for building catsu!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions