Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonskyzh/tiny-llm

tiny-llm

A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen.

74.4/100
4.1KForks: 308
View on GitHubHomepage →
Loading report...

Similar Projects

UltraRAG

86

[GitHub Trending #2] A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

Python5.5K

FastDeploy

85

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

Python3.7K

parallax

71

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

Python1.3K

AutoGPT

96

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

Python183.7K
Back to List