Datadog's hallucination detection procedure involves: (1) breaking down a problem into multiple smaller steps of guided summarization by creating a rubric, (2) using the LLM to fill out the rubric, and (3) using deterministic code to parse the LLM output and score the rubric.

Authors

• Person: Aritra Biswas, Noé Vernier Organization: Datadog
  Detecting hallucinations with LLM-as-a-judge: Prompt ... - Datadog

Sources

• Detecting hallucinations with LLM-as-a-judge: Prompt ... - Datadog www.datadoghq.com Aritra Biswas, Noé Vernier · Datadog via serper

Referenced by nodes (2)

• hallucination detection concept
• Datadog entity