Skip to content

Phase 2: Productionize linear_logp backend support and telemetry #20

Description

@inaniloquentee

Background

Split from #6 Phase 2: Productionize linear_logp.

This issue covers the production-readiness surface for the existing linear_logp integration: keep the hidden-state-to-selected-logprob path working, make supported configurations explicit, and report backend decisions with useful telemetry.

Scope

  • Keep the existing hidden-state -> selected-logprob integration.
  • Preserve the saved backward state required by the full-gradient path.
  • Document the linear_logp support matrix:
    • dtype
    • hardware/backend
    • TP support
    • CP behavior
    • entropy support / fallback
    • full-gradient support
    • backend implementation name
  • Emit structured runtime metadata for linear_logp decisions:
    • requested backend
    • actual backend
    • contract/backend ID when available
    • fallback status
    • fallback reason
    • operator-level timing
    • operator-level memory information when available

Acceptance Criteria

  • Supported linear_logp configurations are discoverable from docs or runtime logs.
  • Operator-level timing and memory claims remain separate from full-step performance claims.
  • Existing native behavior is unchanged when the RL-Kernel fast path is disabled.
  • The full-gradient path remains covered by tests or an explicit validation path.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    phase-2Phase 2 workstreamrl-kernelRL-Kernel integrationtelemetryStructured telemetry and observability

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions