procedure
The Prompt Sensitivity (PS) measurement protocol involves evaluating each model on multiple variants of prompts systematically varied along three axes: Format (e.g., declarative vs. interrogative vs. instruction-style), Structure (e.g., straight forward query vs. Chain-of-Thought, zero-shot vs. few-shot, inclusion of context), and Specificity (vague vs. explicitly detailed).
Authors
Sources
- Survey and analysis of hallucinations in large language models www.frontiersin.org via serper
Referenced by nodes (3)
- chain-of-thought concept
- Prompt Sensitivity concept
- structure concept