Knowledge Tree
Relations (1)
related 2.00 — strongly supporting 3 facts
The clinical safety evaluation framework is designed to assess the impact of LLM hallucinations on patient safety [1], serving as a metric to quantify these errors [2]. Furthermore, the framework uses the frequency of hallucinations as a key criterion to determine whether a model's performance is suitable for clinical deployment [3].
Facts (3)
Sources
A framework to assess clinical safety and hallucination rates of LLMs ... nature.com 3 facts
claimThe researchers determined that the changes tested in Experiment 5 were not suitable for clinical safety evaluation because the resulting increase in hallucinations and omissions was too large to be considered useful.
claimThe authors propose a multi-component framework that combines the assessment of hallucinations and omissions with an evaluation of their impact on clinical safety to serve as a governance and clinical safety assessment template for organizations.
claimThe framework developed by the researchers quantifies the clinical impact and implications of LLM omissions and hallucinations, which is a necessary step to meaningfully address clinical safety.