Semantic similarity-based hallucination detection involves three steps: (1) create embeddings for the answer and the context using an LLM, (2) calculate cosine similarity scores between each sentence in the answer and the context, and (3) tune the decision threshold for a specific dataset to classify hallucinating statements.

Authors

• Person: Not available Organization: Amazon Web Services
  Detect hallucinations for RAG-based systems - AWS

Sources

• Detect hallucinations for RAG-based systems - AWS aws.amazon.com Amazon Web Services via serper

Referenced by nodes (2)

• embeddings concept
• cosine similarity concept