nvfuser

Here are 2 public repositories matching this topic...

stochasticai / x-stable-diffusion

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6

docker notebook cuda inference pytorch automl tensorrt onnx onnxruntime stable-diffusion aitemplate nvfuser

Updated Dec 4, 2023
Jupyter Notebook

elvinagam / benchmarking_gpu_inference

Star

Scripts from Neural network inference on Pytorch with tools like ONNX, TensorRT, nvFuser, TorchDynamo, Triton

amp transformers pytorch tensorrt onnx nvfuser torchdynamo

Updated Nov 15, 2022
Jupyter Notebook

Add this topic to your repo

To associate your repository with the nvfuser topic, visit your repo's landing page and select "manage topics."

Learn more