Deduplication processes (both exact and fuzzy) reduce the training signal for specific facts by collapsing multiple web pages that discuss the same fact into fewer training examples, thereby altering the effective frequency of entities.

Authors

• Person: M. Brenndoerfer Organization: mbrenndoerfer.com
  Hallucination Causes: Why Language Models Fabricate Facts

Sources

• Hallucination Causes: Why Language Models Fabricate Facts mbrenndoerfer.com M. Brenndoerfer · mbrenndoerfer.com via serper

Referenced by nodes (1)

• Large Language Models concept