Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Jupyter Notebookefeslab/Nanoflow

Nanoflow

A throughput-oriented high-performance serving framework for LLMs

53.9/100
952Forks: 48
View on GitHubHomepage →
Loading report...

Similar Projects

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python77.8K

llama-cookbook

88

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

Jupyter Notebook18.3K

AI-Engineering.academy

63

Mastering Applied AI, One Concept at a Time

Jupyter Notebook2.2K

LLMs-from-scratch

81

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Jupyter Notebook91.3K
Back to List