Large language models generate the most statistically plausible answer to questions implying a factual answer exists, rather than expressing uncertainty, because their probability distribution over vocabulary always has a mode and lacks probability mass for an 'abstain' option.

Authors

• Person: M. Brenndoerfer Organization: mbrenndoerfer.com
  Hallucination Causes: Why Language Models Fabricate Facts

Sources

• Hallucination Causes: Why Language Models Fabricate Facts mbrenndoerfer.com M. Brenndoerfer · mbrenndoerfer.com via serper

Referenced by nodes (2)

• Large Language Models concept
• probability distribution concept