Back to articles

Large Language Model = Knowledge Graph Store? Yes, by Fine-Tuning LLM With KG

Learn how to get GPT to ask complex questions in any languageI know, how dare I, but I disagree with ChatGPT. I asked if a GPT can be used as a Knowledge Graph store, and this is part of its answer:… While GPT can be used to generate text related to a particular topic, it is not designed to be a knowledge graph store. …This article shows how a knowledge graph can fine-tune an LLM, enabling users to ask complex questions in their language. To illustrate this, we use two RDF knowledge graphs to fine-tune OpenAI’s GPT LLM. One is of a process plant, the core of a Digital-Twin. The other is a genealogical model of the Kennedys family.Fine-Tuning an LLM With a Knowledge GraphAlthough prompting works well, it is limited by the scale of any serialized knowledge graph that can be included within a prompt.Prompts are limited to about 1,500 words. Although this limit is increasing, it has a long way to go to absorb a serialized graph.An LLM is not going to be tuned to your domain’s information.
#chatgpt
#gpt
#llm
#openai
#overfitting
15 May 2023
vote
comment0