Tao et al. (2025) proposed the Self-Critique method to detect contamination after Reinforcement Learning from Human Feedback (RLHF), which probes for policy collapse by comparing the token-level entropy sequences of an initial response and a second, alternative critique response.

Authors

• Person: Not available Organization: arXiv
  A Survey on the Theory and Mechanism of Large Language Models

Sources

• A Survey on the Theory and Mechanism of Large Language Models arxiv.org arXiv via serper

Referenced by nodes (2)

• Reinforcement learning from human feedback (RLHF) concept
• RLHF concept