Popular repositories Loading

1. GPU-Perf-Playground GPU-Perf-Playground Public

   GPU 性能与 AI Infra 学习项目：CUDA/Triton 算子、NCU/NSYS、vLLM/SGLang/TRT-LLM/ms-swift、PyTorch/DeepSpeed/ms-swift 训练、并行架构

   Python 104 1

2. cutile-python cutile-python Public

   Forked from NVIDIA/cutile-python

   cuTile is a programming model for writing parallel kernels for NVIDIA GPUs

   Python

3. tvm tvm Public

   Forked from apache/tvm

   Open Machine Learning Compiler Framework

   Python

4. onnxruntime onnxruntime Public

   Forked from microsoft/onnxruntime

   ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

   C++

5. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

   Python

6. MinivLLM MinivLLM Public

   Forked from Wenyueh/MinivLLM

   Based on Nano-vLLM, a simple replication of vLLM with self-contained paged attention and flash attention implementation

   Python