Popular repositories Loading

1. R3pere R3pere Public

2. ai-infra-notes ai-infra-notes Public

   transformer,Pytorch,deep learning etc.

3. edge-claw edge-claw Public

   Python

4. nano-vllm-spec-decode nano-vllm-spec-decode Public

   Speculative decoding (n-gram / draft model, dynamic k) and vLLM V1-style mixed batching on nano-vllm, benchmarked against vLLM on A100

   Python

5. nano-vllm-triton-kernels nano-vllm-triton-kernels Public

   Triton kernels and a fused QK-norm + RoPE + paged-KV-write kernel for nano-vllm

   Python