← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonlucidrains/rotary-embedding-torch

rotary-embedding-torch

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch

66.1/100
★ 804Forks: 66
View on GitHub →
Loading report...

Similar Projects

pytorch-lightning

91

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

Python★ 31.0K

camel

91

🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org

Python★ 16.5K

litgpt

89

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Python★ 13.3K

PaLM-rlhf-pytorch

68

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

Python★ 7.9K
← Back to List