The paper 'Why transformers need adam: a hessian perspective' was published in Advances in neural information processing systems 37 (pp. 131786–131823) and is cited in section 4.3.2 of 'A Survey on the Theory and Mechanism of Large Language Models'.

Authors

• Person: Not available Organization: arXiv
  A Survey on the Theory and Mechanism of Large Language Models

Sources

• A Survey on the Theory and Mechanism of Large Language Models arxiv.org arXiv via serper

Referenced by nodes (1)

• Advances in Neural Information Processing Systems entity