Skip to content

Create LLM-based reranker #55

@AsphodelRem

Description

@AsphodelRem

Add an LLM reranker that scores (query, document) pairs using next-token logits.

Example:

Prompt template:

"""
Query: {query}
Document: {document}

Relevant:
"""

Compute relevance score from logits:
score = log P(" yes")

or

score = log P("yes") - log P("no")

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions