The paper 'Understanding warmup-stable-decay learning rates: A river valley loss landscape view' was presented at The Thirteenth International Conference on Learning Representations.

Authors

• Person: Not available Organization: arXiv
  A Survey on the Theory and Mechanism of Large Language Models

Sources

• A Survey on the Theory and Mechanism of Large Language Models arxiv.org arXiv via serper

Referenced by nodes (1)

• International Conference on Learning Representations entity