Faster Whisper transcription with CTranslate2
Port of OpenAI's Whisper model in C/C++
Nano vLLM
Large Language Model Text Generation Inference
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.