Ren and Sutherland (2025) introduced a framework to analyze learning dynamics during both Supervised Fine-Tuning and alignment phases, suggesting that the alignment process is governed by specific dynamic laws that persist across different algorithms.

Authors

• Person: Not available Organization: arXiv
  A Survey on the Theory and Mechanism of Large Language Models

Sources

• A Survey on the Theory and Mechanism of Large Language Models arxiv.org arXiv via serper

Referenced by nodes (1)

• supervised fine-tuning concept