A fundamental problem in the Data Preparation Stage of Large Language Models is determining how to guarantee better data utilization, specifically regarding the theoretical relationship between data quality and the learning process when using rich, heterogeneous, and non-i.i.d. web-scale data.

Authors

• Person: Not available Organization: arXiv
  A Survey on the Theory and Mechanism of Large Language Models

Sources

• A Survey on the Theory and Mechanism of Large Language Models arxiv.org arXiv via serper

Referenced by nodes (1)

• Large Language Models concept