The Amazon Bedrock Knowledge Bases RAG evaluation workflow consists of six steps: preparing a prompt dataset (optionally with ground truth), converting the dataset to JSONL format, storing the file in an Amazon S3 bucket, running the Amazon Bedrock Knowledge Bases RAG evaluation job (which integrates with Amazon Bedrock Guardrails), generating an automated report with metrics, and analyzing the report for system optimization.

Authors

• Person: Not available Organization: Amazon Web Services
  Evaluating RAG applications with Amazon Bedrock knowledge base ...

Sources

• Evaluating RAG applications with Amazon Bedrock knowledge base ... aws.amazon.com Amazon Web Services via serper

Referenced by nodes (3)

• ground truth concept
• Amazon Bedrock Knowledge Bases concept
• RAG evaluation concept