how to increase fps

[MrRss]

Hi all,

I trained the model from scratch with one of my dataset. When I perform the inference, the actual call takes around 23ms. Why is it so slow? BisNet runs with 9ms. GPU is a Titan RTX.

Code snippet:

model.eval()
with torch.no_grad():
        t = time.time()
        pr_mask = model.forward(x_tensor)
        print(time.time() - t)
x_tensor.shape is torch.Size([1, 3, 2080, 2464])

Thank you in advance.