The clinical evaluation procedure for LLMs involves the following steps: (1) configuring the model to conduct multi-turn clinical interviews with a simulated patient agent conditioned on an electronic medical record; (2) using a unified system prompt to instruct the model to act as a physician performing history-taking; (3) allowing the model to either continue asking questions or terminate the consultation by outputting the token “End Inquiry”; (4) capping the session at a maximum of 12 turns to avoid unbounded interactions.

Authors

• Person: Not available Organization: arXiv
  A Comprehensive Benchmark and Evaluation Framework for Multi ...

Sources

• A Comprehensive Benchmark and Evaluation Framework for Multi ... arxiv.org arXiv via serper

Referenced by nodes (1)

• Patient Agent concept