Scaling up large language model size and training data simultaneously tends to reduce hallucinations regarding well-documented facts because larger models have greater capacity to memorize and recall high-frequency information.

Authors

• Person: M. Brenndoerfer Organization: mbrenndoerfer.com
  Hallucination Causes: Why Language Models Fabricate Facts

Sources

• Hallucination Causes: Why Language Models Fabricate Facts mbrenndoerfer.com M. Brenndoerfer · mbrenndoerfer.com via serper

Referenced by nodes (2)

• hallucination concept
• training data concept