LUKE (Language Understanding with Knowledge-based Embeddings) is an extension of BERT that uses an entity-aware self-attention mechanism to treat words and entities as independent tokens, outputting contextualized representations.

Authors

• Person: Not available Organization: arXiv
  Combining Knowledge Graphs and Large Language Models - arXiv

Sources

• Combining Knowledge Graphs and Large Language Models - arXiv arxiv.org arXiv via serper

Referenced by nodes (1)

• BERT concept