← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonxlite-dev/Awesome-LLM-Inference

Awesome-LLM-Inference

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

72.9/100
★ 5.5KForks: 435
View on GitHub →
Loading report...

Similar Projects

UltraRAG

86

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

Python★ 5.7K

InferenceX

75

Open Source Inference Research Platform Standard / 开源推理研究平台

Python★ 1.8K

llm_note

51

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

Python★ 892

unsloth

95

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

Python★ 77.2K
← Back to List