Datadog's two-step prompting approach for non-reasoning models involves: (1) prompting an LLM to fill out a rubric without output format restrictions, including instructions for self-criticism and multiple interpretations; (2) making a second LLM call using structured output to convert the initial output into the desired format.

Authors

• Person: Aritra Biswas, Noé Vernier Organization: Datadog
  Detecting hallucinations with LLM-as-a-judge: Prompt ... - Datadog

Sources

• Detecting hallucinations with LLM-as-a-judge: Prompt ... - Datadog www.datadoghq.com Aritra Biswas, Noé Vernier · Datadog via serper

Referenced by nodes (1)

• Datadog entity