Adding inference with JIT Scripted Torch model#26

Open

rickybalin wants to merge 10 commits intocoreyjadams:v2.1from

rickybalin:v2.1_jit

Commits on Mar 7, 2024

Initial commit for adding jJIT tracing to CT for inference
rickybalin
committed
Attempt at tracing or scripting the model, but errors with both
rickybalin
committed

Commits on Mar 8, 2024

Commits on Mar 11, 2024

Cleaned up changes to perform inference with torch.jit.script model and added config option
rickybalin
committed
Removed limit on number of iterations
rickybalin
committed

Commits on Mar 12, 2024

Commits on Mar 19, 2024

With DDP, now broadcasting state first and restoring model weights from all ranks, and avoiding DDP wrapper during inference
rickybalin
committed