Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Jupyter Notebookefeslab/Nanoflow

Nanoflow

A throughput-oriented high-performance serving framework for LLMs

43.1/100
948Forks: 46
View on GitHubHomepage →
Loading report...

Similar Projects

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python72.4K

llama-cookbook

88

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

Jupyter Notebook18.2K

AI-Engineering.academy

72

Mastering Applied AI, One Concept at a Time

Jupyter Notebook2.1K

llmgraph

49

Create knowledge graphs with LLMs

Jupyter Notebook503
Back to List