The final case score S_c for a case c and conversation C generated by doctor agents is calculated as S_c = (sum of (w_r * I_r)) / (sum of w_r), where R is the set of all rubrics for case c, w_r is the importance score assigned to rubric r, and I_r is the binary indicator returned from the model-based judge representing the LLM-as-judge process for rubric r.

Authors

• Person: Not available Organization: arXiv
  A Comprehensive Benchmark and Evaluation Framework for Multi ...

Sources

• A Comprehensive Benchmark and Evaluation Framework for Multi ... arxiv.org arXiv via serper

Referenced by nodes (1)

• LLM-as-a-judge concept