The ROUGE evaluation metric exhibits a bias against longer responses, consistently assigning lower scores to responses exceeding token thresholds regardless of their factual accuracy.

Authors

• Person: Not available Organization: arXiv
  Re-evaluating Hallucination Detection in LLMs - arXiv

Sources

• Re-evaluating Hallucination Detection in LLMs - arXiv arxiv.org arXiv via serper

Referenced by nodes (1)

• ROUGE concept