Skip to content

Is it possible to serve EmbeddingGemma in /embeddings using mlx-serve? #79

Description

@ajram23

Looks like it still needs

Parse and honor:

  • use_bidirectional_attention: true
  • tokenizer add_bos_token / add_eos_token or tokenizer post-processor

Load/apply EmbeddingGemma projection:

  • dense.0
  • dense.1
  • then existing mean-pool + L2-normalize

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions