← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonlucidrains/rotary-embedding-torch

rotary-embedding-torch

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch

60.7/100
★ 827Forks: 68
View on GitHub →
Loading report...

Similar Projects

pytorch-lightning

87

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

Python★ 31.4K

cs249r_book

92

Machine Learning Systems: Foundations, Scaling, Agentic AI, and Physical AI (Vols I–IV) • Harvard CS249r | https://mlsysbook.ai

Python★ 28.8K

camel

90

🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org

Python★ 17.8K

litgpt

83

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Python★ 13.7K
← Back to List