Supervised finetuning datasets suffer from a selection bias where annotators write detailed, authoritative responses for topics they know well and shorter, hedged responses for topics where they are less confident, which reinforces model overconfidence on well-known topics.

Authors

• Person: M. Brenndoerfer Organization: mbrenndoerfer.com
  Hallucination Causes: Why Language Models Fabricate Facts

Sources

• Hallucination Causes: Why Language Models Fabricate Facts mbrenndoerfer.com M. Brenndoerfer · mbrenndoerfer.com via serper

Referenced by nodes (1)

• supervised fine-tuning concept