Decoder-only models, such as GPT, OPT, and LLaMA, utilize unidirectional attention and auto-regressive token prediction to excel in text generation tasks like chatbots, text summarization, and code generation.

Authors

• Person: Not available Organization: Frontiers
  Practices, opportunities and challenges in the fusion of knowledge ...

Sources

• Practices, opportunities and challenges in the fusion of knowledge ... www.frontiersin.org Frontiers via serper

Referenced by nodes (3)

• LLaMA concept
• text generation concept
• GPT concept