run DeepSeek-R1 GGUFs on KTransformers
-
Updated
Mar 3, 2025 - Python
#
ktransformers
Here are 5 public repositories matching this topic...
Run DeepSeek-V4.1-Flash-1017 with SGLang + KTransformers (CPU/GPU hybrid): one setup script, a launcher that reads the machine, and the FP8 step 1017 needs
-
Updated
Nov 1, 2026 - Python
清华大学 KTransformers Docker Image Build Tool
docker docker-compose docker-container docker-image deepseek-coder deepseek-chat deepseek-llm deepseek deepseek-math deepseek-api deepseek-v3 deepseek-r1 deepseek-r1-zero deepseek-ai ktransformers
-
Updated
Apr 20, 2025 - Dockerfile
Dockerfiles and deployment recipes for local AI, primarily focused on hybrid GPU+CPU LLM inference
-
Updated
Oct 27, 2026
Pinned CPU, PMem, and multi-GPU inference tooling for llama.cpp and KTransformers.
-
Updated
Oct 24, 2026 - Shell
Add this topic to your repo
To associate your repository with the ktransformers topic, visit your repo's landing page and select "manage topics."