Model distillation can be used to create smaller, faster generator models that maintain the quality of larger models for specific RAG use cases requiring high performance and lower latency.

Authors

• Person: Not available Organization: Amazon Web Services
  Evaluating RAG applications with Amazon Bedrock knowledge base ...

Sources

• Evaluating RAG applications with Amazon Bedrock knowledge base ... aws.amazon.com Amazon Web Services via serper

Referenced by nodes (2)

• RAG concept
• latency concept