Automated metrics like ROUGE, BLEU, and BERT-score, which are designed to compare model-generated text with expert-written examples, have significant limitations in healthcare because they focus on surface-level textual similarity rather than semantic nuances, contextual dependencies, and domain-specific knowledge.

Authors

• Person: Not available Organization: Nature
  A framework to assess clinical safety and hallucination rates of LLMs ...

Sources

• A framework to assess clinical safety and hallucination rates of LLMs ... www.nature.com Nature via serper

Referenced by nodes (3)

• ROUGE concept
• BERTScore concept
• BLEU concept