reference
The paper 'Beyond zero initialization: investigating the impact of non-zero initialization on LoRA fine-tuning dynamics' was published in the Proceedings of the 42nd International Conference on Machine Learning, Vol. 267, pp. 35519–35535.
Authors
Sources
- A Survey on the Theory and Mechanism of Large Language Models arxiv.org via serper
Referenced by nodes (2)
- fine-tuning concept
- International Conference on Machine Learning entity