tensorparallel

Here are 2 public repositories matching this topic...

Implementations of some popular approaches for efficient deep learning training and inference

profiler amp offloading multigpu quanti fsdp tensorparallel

Framework, Model & Kernel Optimizations for Distributed Deep Learning - Data Hack Summit

pytorch triton codegen inductor ddp deepspeed fsdp tensorparallel pipelineparallel

Add a description, image, and links to the tensorparallel topic page so that developers can more easily learn about it.

To associate your repository with the tensorparallel topic, visit your repo's landing page and select "manage topics."