Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythoncontainers/ramalama

ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

86.2/100
2.9KForks: 342
View on GitHubHomepage →
Loading report...

Similar Projects

InferenceX

70

Open Source Continuous Inference Benchmark Research Platform Kimi K2.6, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3

Python1.1K

LMCache

88

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Python8.5K

hermes-agent

90

The agent that grows with you

Python188.9K

AutoGPT

96

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

Python184.9K
Back to List