The moderate Pearson correlation coefficient between AUROC scores derived from ROUGE and LLM-as-Judge evaluation approaches suggests that hallucination detection methods may be inadvertently optimized for ROUGE’s lexical overlap criteria rather than genuine factual correctness.

Authors

• Person: Not available Organization: arXiv
  Re-evaluating Hallucination Detection in LLMs - arXiv

Sources

• Re-evaluating Hallucination Detection in LLMs - arXiv arxiv.org arXiv via serper

Referenced by nodes (4)

• factual correctness concept
• hallucination detection concept
• ROUGE concept
• LLM-as-a-judge concept