Knowledge Tree
Relations (1)
related 2.00 — strongly supporting 3 facts
Large Language Models are directly linked to memorization through research evaluating the difficulty of data retention [1], the role of memorization in model learning and generalization [2], and the privacy vulnerabilities caused by the memorization of contaminated data [3].
Facts (3)
Sources
A Survey on the Theory and Mechanism of Large Language Models arxiv.org 3 facts
claimThe memorization of contaminated data, particularly sensitive information, creates significant privacy vulnerabilities in large language models.
claimMemorization in Large Language Models is deeply intertwined with the model's learning and generalization capabilities, rather than being solely a privacy risk (Wei et al., 2024).
referenceThe paper 'Entropy-memorization law: evaluating memorization difficulty of data in llms' is an arXiv preprint, identified as arXiv:2507.06056.