reference
The research paper 'Muon is scalable for LLM training' was published in the Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 17177–17197, and cited in section 7.2.2 of the survey.
Authors
Sources
- A Survey on the Theory and Mechanism of Large Language Models arxiv.org via serper