procedure
The first round of experiments in the KG-IRAG study tests four LLMs on three QA datasets (weatherQA-Irish, weatherQA-Sydney, and trafficQA-TFNSW) using three data formats: raw data (table) format, text data (transferred into text descriptions), and triplet format (KG structure). To minimize irrelevant information, input prompts are restricted to questions and the least amount of necessary data, with final answers compared against correct answers using exact match (EM) values.
Authors
Sources
- KG-IRAG: A Knowledge Graph-Based Iterative Retrieval-Augmented ... arxiv.org via serper
Referenced by nodes (2)
- KG-IRAG concept
- Exact Match concept