How can i convert model to the tensorrt engine?? Is any guide to convert this model to onnx or trt?

[hamitbugrabayram]

To reduce inference time, I try to convert the model to the TensorRT engine. How should I convert the model to ONNX? Do you have any guidelines about conversion?

[windks]

+1

[fushh]

Unfortunately, I am not familiar with onnx or tensorrt. I am sorry that I can not provide any help or guidelines.

[hamitbugrabayram]

thanks

[DSPresearchlrj]

LLMdet is a excellent work. I believe that converting it to ONNX or TensorRT is a challenge, but it is necessary applying the project to engineering. Could we reopen this issue? Perhaps some experts can solve it.

[SangbumChoi]

Well this information itself might help, you can convert this into ONNX and tensorRT without custom cuda kernel. (Sorry that I cannot share the detail)