Add an LLM reranker that scores (query, document) pairs using next-token logits.
Example:
Prompt template:
"""
Query: {query}
Document: {document}
Relevant:
"""
Compute relevance score from logits:
score = log P(" yes")
or
score = log P("yes") - log P("no")
Add an LLM reranker that scores (query, document) pairs using next-token logits.
Example:
Prompt template:
"""
Query: {query}
Document: {document}
Relevant:
"""
Compute relevance score from logits:
score = log P(" yes")
or
score = log P("yes") - log P("no")