The procedure to start a knowledge base RAG evaluation job using the Amazon Bedrock console is: (1) Navigate to the Amazon Bedrock console, select 'Evaluations' under 'Inference and Assessment', and choose 'Knowledge Bases'. (2) Select 'Create'. (3) Provide an Evaluation name, Description, and select an Evaluator model to act as a judge. (4) Choose the knowledge base and the evaluation type (either 'Retrieval only' or 'Retrieval and response generation'). (5) Select a model for generating responses. (6) Optionally configure inference parameters such as temperature, top-P, prompt templates, guardrails, search strategy, and chunk counts. (7) Provide the S3 URI for evaluation data and results. (8) Select or create an IAM role with permissions for Amazon Bedrock, S3 buckets, the knowledge base, and the models. (9) Select 'Create' to initiate the job.

Authors

• Person: Not available Organization: Amazon Web Services
  Evaluating RAG applications with Amazon Bedrock knowledge base ...

Sources

• Evaluating RAG applications with Amazon Bedrock knowledge base ... aws.amazon.com Amazon Web Services via serper

Referenced by nodes (2)

• RAG concept
• Amazon Bedrock entity