The author of the Vectara hallucination-leaderboard argues that testing models by providing a list of well-known facts is a poor method for detecting hallucinations because the model's training data is unknown, the definition of 'well known' is unclear, and most hallucinations arise from rare or conflicting information rather than common knowledge.

Authors

• Person: Not available Organization: Vectara
  vectara/hallucination-leaderboard - GitHub

Sources

• vectara/hallucination-leaderboard - GitHub github.com Vectara via serper

Referenced by nodes (3)

• hallucination concept
• training data concept
• Vectara LLM Hallucination Leaderboard concept