Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonxlite-dev/Awesome-LLM-Inference

Awesome-LLM-Inference

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

76.0/100
5.4KForks: 428
View on GitHub
Loading report...

Similar Projects

UltraRAG

85

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

Python5.7K

llm_note

56

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

Python889

unsloth

93

Unsloth is a local UI for training and running Gemma 4, Qwen3.6, DeepSeek, Kimi, GLM and other models.

Python68.9K

CowAgent

95

Open-source super AI assistant & Agent Harness. Plans tasks, runs tools and skills, self-evolves with memory and knowledge. Multi-model, multi-channel. Lightweight, extensible, one-line install. (formerly chatgpt-on-wechat)

Python46.1K
Back to List