← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++eastriverlee/LLM.swift

LLM.swift

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

80.9/100
★ 865Forks: 122
View on GitHub →
Loading report...

Similar Projects

runanywhere-sdks

81

Production ready toolkit to run AI locally

C++★ 10.3K

cactus

86

Low-latency AI engine for mobile devices & wearables

C++★ 5.4K

sherpa-onnx

90

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages

C++★ 13.4K

PowerInfer

61

High-speed Large Language Model Serving for Local Deployment

C++★ 9.6K
← Back to List