tensorparallel

Here are 3 public repositories matching this topic...

AMD Radeon 9700 AI PRO RDNA multi GPU Tools for llm/vLLM inference, tuning, overclocking, undervolting and LLM models benchmarking

linux benchmark ubuntu amd rocm radeon vllm tensorparallel rdna4 amd-radeon gfx1201

Framework, Model & Kernel Optimizations for Distributed Deep Learning - Data Hack Summit

pytorch triton codegen inductor ddp deepspeed fsdp tensorparallel pipelineparallel

Implementations of some popular approaches for efficient deep learning training and inference

profiler amp offloading multigpu quanti fsdp tensorparallel

To associate your repository with the tensorparallel topic, visit your repo's landing page and select "manage topics."