The per-request PEFT adapter test fails identically on the trusted and untrusted paths, so unlike #281 this is not sandbox-specific.
Symptom
tests/test_nnsight_remote.py::TestRemotePeft::test_adapter_applied_remotely
RemoteError: The model architecture on this server doesn't match the one your code was
traced against: it has no module at 'Module:model.base_model.model'.
TestRemotePeft::test_env_reports_adapter passes — the adapter id does ride on the request env. It is applying it, or the module tree it produces, that does not line up.
The client builds a meta model with peft grafted (so it can name base_model.model.*); the server is expected to apply the adapter before the run so those paths resolve. The mismatch says the server's live tree has no base_model.model, i.e. the adapted architecture is not what the client assumed.
Notes
- Client and server ran the same image here, so this is not the usual version-skew cause the message suggests.
peft==0.19.1, transformers==5.16.1, nnsight 3bed88cc.
- Reproduces on both key types (trusted and untrusted), 1 failure in each run.
- The error message itself is behaving correctly — it is the architecture-mismatch classification doing its job, which is how the cause was this easy to read.
Observed on the Test deployment. ndif 0.8 @ be38d78.
The per-request PEFT adapter test fails identically on the trusted and untrusted paths, so unlike #281 this is not sandbox-specific.
Symptom
TestRemotePeft::test_env_reports_adapterpasses — the adapter id does ride on the request env. It is applying it, or the module tree it produces, that does not line up.The client builds a meta model with peft grafted (so it can name
base_model.model.*); the server is expected to apply the adapter before the run so those paths resolve. The mismatch says the server's live tree has nobase_model.model, i.e. the adapted architecture is not what the client assumed.Notes
peft==0.19.1,transformers==5.16.1, nnsight3bed88cc.Observed on the Test deployment. ndif 0.8 @ be38d78.