Hi, Congrats on the amazing work. Any plans to upstream the torch pipelining modifications to PyTorch? I think both dynamic batch sizes and reduced memory bubbles would be great to have in the official PyTorch API.
Hi,
Congrats on the amazing work. Any plans to upstream the torch pipelining modifications to PyTorch?
I think both dynamic batch sizes and reduced memory bubbles would be great to have in the official PyTorch API.