← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonlucidrains/rotary-embedding-torch

rotary-embedding-torch

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch

61.2/100
★ 812Forks: 67
View on GitHub →
Loading report...

Similar Projects

pytorch-lightning

91

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

Python★ 31.1K

camel

89

🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org

Python★ 16.9K

litgpt

87

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Python★ 13.3K

AutoGPT

96

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

Python★ 184.1K
← Back to List