← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
PythonGradientHQ/parallax

parallax

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

68.3/100
★ 1.4KForks: 144
View on GitHub →
Loading report...

Similar Projects

kvpress

75

LLM KV cache compression made easy

Python★ 1.1K

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python★ 87.1K

LlamaFactory

92

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Python★ 73.5K

langextract

86

A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

Python★ 37.8K
← Back to List