Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Jupyter Notebookefeslab/Nanoflow

Nanoflow

A throughput-oriented high-performance serving framework for LLMs

42.5/100
969Forks: 50
View on GitHubHomepage →
Loading report...

Similar Projects

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python87.1K

llama-cookbook

75

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

Jupyter Notebook18.5K

AI-Engineering.academy

56

Mastering Applied AI, One Concept at a Time

Jupyter Notebook2.4K

LLMs-from-scratch

79

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Jupyter Notebook99.8K
Back to List