Large language models lack a concept of source reliability because standard pretraining objectives treat all training data sources, such as Wikipedia articles, peer-reviewed papers, and social media posts, with equal weight per token.

Authors

• Person: M. Brenndoerfer Organization: mbrenndoerfer.com
  Hallucination Causes: Why Language Models Fabricate Facts

Sources

• Hallucination Causes: Why Language Models Fabricate Facts mbrenndoerfer.com M. Brenndoerfer · mbrenndoerfer.com via serper

Referenced by nodes (2)

• Large Language Models concept
• Wikipedia entity