Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonskyzh/tiny-llm

tiny-llm

A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen.

77.1/100
3.9KForks: 284
View on GitHubHomepage →
Loading report...

Similar Projects

UltraRAG

85

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

Python5.4K

FastDeploy

85

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

Python3.7K

parallax

67

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

Python1.1K

langchain

94

The agent engineering platform

Python128.7K
Back to List