The Similarity Score calculation process involves three steps: (1) Embedding Generation: Encoding the original medical question, the correct option, and the model's generated output using UMLSBERT for each method (Base, System Prompt, CoT, MedRAG, Internet Search). (2) Cosine Similarity Calculation: Calculating the cosine similarity for model outputs against the correct option (Answer Similarity) and the original question (Question Similarity). (3) Combined Similarity Score: Computing the average of the Answer Similarity and the Question Similarity.

Authors

• Person: Not available Organization: medRxiv
  Medical Hallucination in Foundation Models and Their Impact on ...

Sources

• Medical Hallucination in Foundation Models and Their Impact on ... www.medrxiv.org medRxiv via serper

Referenced by nodes (3)

• MedRAG concept
• BASE concept
• CoT concept