Skip to content

TestRemotePeft::test_adapter_applied_remotely fails on both paths — architecture mismatch on the adapted model #282

Description

@JadenFiotto-Kaufman

The per-request PEFT adapter test fails identically on the trusted and untrusted paths, so unlike #281 this is not sandbox-specific.

Symptom

tests/test_nnsight_remote.py::TestRemotePeft::test_adapter_applied_remotely

RemoteError: The model architecture on this server doesn't match the one your code was
traced against: it has no module at 'Module:model.base_model.model'.

TestRemotePeft::test_env_reports_adapter passes — the adapter id does ride on the request env. It is applying it, or the module tree it produces, that does not line up.

The client builds a meta model with peft grafted (so it can name base_model.model.*); the server is expected to apply the adapter before the run so those paths resolve. The mismatch says the server's live tree has no base_model.model, i.e. the adapted architecture is not what the client assumed.

Notes

  • Client and server ran the same image here, so this is not the usual version-skew cause the message suggests. peft==0.19.1, transformers==5.16.1, nnsight 3bed88cc.
  • Reproduces on both key types (trusted and untrusted), 1 failure in each run.
  • The error message itself is behaving correctly — it is the architecture-mismatch classification doing its job, which is how the cause was this easy to read.

Observed on the Test deployment. ndif 0.8 @ be38d78.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions