Skip to content

Verify & document subscription-routed LLM for agentic search (sampling / Agent SDK) #72

Description

@thorwhalen

Summary

ir's agentic LLM can run on a Claude subscription instead of a metered key, with zero ir code changes — every seam already injects a plain callable. This issue tracks documentation + the one real unknown.

See the design note: misc/docs/ir_10 -- LLM Routing ....

Facts (SSOT)

  • Injectable seams: make_llm_formulator(rewriter=) (formulate.py:66), make_llm_selector(chooser=) (select.py:433), make_llm_synthesizer/with_synopsis(synthesize=) (synopsis.py:97/220), eval_gen (eval_gen.py:264/386). Default backend is aix (not oa — README drift fixed in docs: LLM routing on a Claude subscription (ir_10) + fix oa→aix drift #71).
  • Routing targets: connector→Claude.ai via MCP sampling/createMessage (transport exists; client support unverified); Claude Code→host via claude_agent_sdk / coact (exists today); Desktop→sampling (same caveat).

Actions

Note

No ir code change is required for any of this; ir stays backend-agnostic. Closing condition: docs merged + the client-support question answered (then connectors can adopt or defer accordingly).

https://claude.ai/code/session_0154TnwYASjN1u1Hw97JQ2vd

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions