claim
Transformers and LSTMs both possess the ability to learn in-context, and this capability improves with the length and quantity of demonstrations.
Authors
Sources
- A Survey on the Theory and Mechanism of Large Language Models arxiv.org via serper
Referenced by nodes (2)
- Transformers concept
- In-Context Learning concept