The Amazon Bedrock Agents hallucination detection workflow proceeds as follows: (1) Relevant answer chunks are retrieved from the knowledge base. (2) A knowledge base response is generated from the retrieved chunks. (3) The user query and knowledge base response are passed to a Lambda function. (4) The Lambda function calculates a hallucination score. (5) If the score is lower than a custom threshold, an SNS notification is sent to a customer service queue for human intervention. (6) If the score is higher than the threshold, the system returns the knowledge base response to the user.

Authors

• Person: Not available Organization: Amazon Web Services
  Reducing hallucinations in large language models with custom ...

Sources

• Reducing hallucinations in large language models with custom ... aws.amazon.com Amazon Web Services via serper

Referenced by nodes (1)

• Amazon Bedrock Agents concept