Knowledge Tree
New England Journal of Medicine
Also known as: NEJM, The New England Journal of Medicine
Facts (10)
Sources
Medical Hallucination in Foundation Models and Their ... medrxiv.org Mar 3, 2025 6 facts
claimThe NEJM case reports used in the study required a substantial time commitment from annotators due to the reports' depth, clinical intricacy, and frequent presentation of unusual or diagnostically challenging conditions.
procedureThe researchers evaluated LLM hallucinations in the clinical domain using a structured annotation process based on the hallucination typology proposed by Hegselmann et al. (2024b) and the risk level framework from Asgari et al. (2024), utilizing New England Journal of Medicine (NEJM) Case Reports for inferences.
referenceThe dataset used to evaluate LLM hallucinations consists of 'Case Records of the Massachusetts General Hospital' published in The New England Journal of Medicine (NEJM), as referenced in Brinkmann et al. (2024).
procedureThe data collection process for the NEJM Medical Case Records Dataset involved two steps: (1) extracting URLs of all individual case record PDFs from the New England Journal of Medicine website by analyzing the website structure, and (2) using Selenium WebDriver with a Chrome browser to access each URL and download the files into a structured directory.
claimThe research methodology described in the paper enabled the efficient, ethical, and high-quality extraction of New England Journal of Medicine (NEJM) medical case records into a multi-modal dataset comprising text, images, and tables.
claimThe dataset of NEJM case records used for evaluating LLM hallucinations includes clinical cases published between November 2000 and November 2018, specifically excluding cases related to the COVID-19 pandemic.
Medical Hallucination in Foundation Models and Their Impact on ... medrxiv.org Nov 2, 2025 3 facts
measurementThe researchers curated a dataset of 20 case reports from the New England Journal of Medicine, selected to highlight challenges such as complex differential diagnosis and detailed lab results.
procedureAnnotators evaluating NEJM case reports were authorized and encouraged to use external medical resources, specifically UpToDate and PubMed, to inform their evaluations.
referenceThe researchers used case records from the Massachusetts General Hospital, published in The New England Journal of Medicine (NEJM), to evaluate LLM hallucinations.
Survey and analysis of hallucinations in large language models frontiersin.org Sep 29, 2025 1 fact
referenceLee et al. (2023) analyzed the benefits, limits, and risks of using GPT-4 as an AI chatbot for medical applications in the New England Journal of Medicine.