RWKV-LM
BlinkDL
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
Growth over time
4 data points · 2023-03-01 → 2026-07-01How do you feel about this project?
Ask AI about RWKV-LM
Question copied to clipboardWhat is the BlinkDL/RWKV-LM GitHub project? Description: "RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
How to clone RWKV-LM
Clone via HTTPS
Clone via SSH
Download ZIP
Download main.zipFound an issue?
Report bugs or request features on the RWKV-LM issue tracker:
Open GitHub Issues