Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Rustmarcelroed/gigatoken

gigatoken

Language model tokenization at GB/s

66.7/100
1.2KForks: 45
View on GitHub
Loading report...

Similar Projects

memvid

88

Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.

Rust16.0K

graphrag-rs

61

GraphRAG-rs is a high-performance, state-of-the-art Rust implementation of GraphRAG (Graph-based Retrieval Augmented Generation) that builds knowledge graphs from documents and enables natural language querying with configurable entity extraction and local LLM integration

Rust522

rtk

90

CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies

Rust72.7K

CodeWhale

89

Open-source, community-driven agent harness

Rust40.0K
Back to List