← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonlucidrains/rotary-embedding-torch

rotary-embedding-torch

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch

77.2/100
★ 813Forks: 68
View on GitHub →
Loading report...

Similar Projects

pytorch-lightning

87

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

Python★ 31.2K

camel

89

🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org

Python★ 17.2K

litgpt

89

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Python★ 13.4K

PaLM-rlhf-pytorch

80

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

Python★ 7.9K
← Back to List