reference
The paper 'LoRA training provably converges to a low-rank global minimum or it fails loudly (But it probably won’t fail)' was published in the Proceedings of the 42nd International Conference on Machine Learning, Vol. 267, pages 30224–30247, and is cited in section 4.2.2 of 'A Survey on the Theory and Mechanism of Large Language Models'.
Authors
Sources
- A Survey on the Theory and Mechanism of Large Language Models arxiv.org via serper