By establishing a threshold for similarity scores, developers can flag sentences with consistently low BERT scores as potential hallucinations, as these sentences demonstrate semantic inconsistency across multiple generations from the same model.

Authors

• Person: Not available Organization: Amazon Web Services
  Detect hallucinations for RAG-based systems - AWS

Sources

• Detect hallucinations for RAG-based systems - AWS aws.amazon.com Amazon Web Services via serper

Referenced by nodes (1)

• hallucination concept