KnowBERT includes a Knowledge Attention and Recontextualization (KAR) component within the BERT architecture that computes a knowledge-enhanced representation using entity links from a Knowledge Graph and passes it to the next transformer block.

Authors

• Person: Not available Organization: arXiv
  Combining Knowledge Graphs and Large Language Models - arXiv

Sources

• Combining Knowledge Graphs and Large Language Models - arXiv arxiv.org arXiv via serper

Referenced by nodes (2)

• Knowledge Graph concept
• BERT concept