reference
The paper 'Rwkv: reinventing rnns for the transformer era' (arXiv:2305.13048) proposes a method to reinvent recurrent neural networks for the transformer era.
Authors
Sources
- A Survey on the Theory and Mechanism of Large Language Models arxiv.org via serper
Referenced by nodes (2)
- Transformer concept
- Recurrent Neural Network concept