← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Rustmarcelroed/gigatoken

gigatoken

Language model tokenization at GB/s

59.7/100
★ 4.1KForks: 218
View on GitHub →
Loading report...

Similar Projects

memvid

75

Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.

Rust★ 16.6K

graphrag-rs

55

GraphRAG-rs is a high-performance, state-of-the-art Rust implementation of GraphRAG (Graph-based Retrieval Augmented Generation) that builds knowledge graphs from documents and enables natural language querying with configurable entity extraction and local LLM integration

Rust★ 529

rtk

91

CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies

Rust★ 82.4K

jan

91

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

Rust★ 44.8K
← Back to List