Skip to content

Run inference on newer hardware (RTX 5080) #19

Description

@MrPio

I am unable to setup the environment as explained in the README.md as it installs a version of PyTorch that is incompatible with my CUDA.

NVIDIA GeForce RTX 5080 with CUDA capability sm_120 is not compatible with the current PyTorch installation.
The current PyTorch install supports CUDA capabilities sm_37 sm_50 sm_60 sm_70 sm_75 sm_80 sm_86.

However, I was able to solve with two minor changes:

  • patch_t=128 instead of 160, otherwise, the positional embeddings have shape (1, 10, 128) instead of (1, 8, 128) as in the checkpoint.
  • in SRDTrans/MainFrame.py, SqueezeLayer::forward, I changed before_down = self.conv_net(x) to before_down = self.conv_net(x.float())

Now the inference works fine on Python 3.12.3, torch (2.9.0+cu128).

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions