reference
The paper 'Generalization v.s. memorization: tracing language models’ capabilities back to pretraining data' investigates the relationship between memorization and generalization in language models.
Authors
Sources
- A Survey on the Theory and Mechanism of Large Language Models arxiv.org via serper
Referenced by nodes (3)
- Language Model concept
- generalization concept
- memorization concept