MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Models
Abstract
LLMs usually exhibit limitations in their ability to incorporate new knowledge, the generation of hallucinations, and the transparency of their decision-making process. In this paper, we explore how to prompt LLMs with knowledge graphs (KG), working as a remedy to engage LLMs with up-to-date knowledge and elicit the reasoning pathways from LLMs. Specifically, we build a prompting pipeline that endows LLMs with the capability of comprehending KG inputs and inferring with a combined implicit knowledge and the retrieved external knowledge. In addition, we investigate eliciting the mind map on which LLMs perform the reasoning and generate the answers. It is identified that the produced mind map exhibits the reasoning pathways of LLMs grounded on the ontology of knowledge, hence bringing the prospects of probing and gauging LLM inference in production. The experiments on three question & answering datasets also show that MindMap prompting leads to a striking empirical gain. For instance, prompting a GPT-3.5 with MindMap yields an overwhelming performance over GPT-4 consistently. We also demonstrate that with structured facts retrieved from KG, MindMap can outperform a series of prompting-with-document-retrieval methods, benefiting from more accurate, concise, and comprehensive knowledge from KGs. To reproduce our results and extend the framework further, we make our codebase available at https://github.com/wyl.willing/MindMap.
Community
a einstein
mindmap
root((Preanesthetic Visit and Assessment))
PreoperativeAssessment
HistoryTaking
Cardiovascular
IschemicHeartDisease
Angina
MyocardialInfarction
Hypertension
HeartFailure
Dysrhythmia
PeripheralVascularDisease
DeepVeinThrombosis
PulmonaryEmbolism
Respiratory
COPD
Asthma
RespiratoryInfections
Gastrointestinal
PepticUlcerDisease
GastroesophagealReflux
LiverDisease
Genitourinary
UTI
RenalDysfunction
Neurological
Epilepsy
CVA
TIA
PsychiatricDisorders
EndocrineMetabolic
Diabetes
ThyroidDysfunction
Locomotor
Osteoarthritis
InflammatoryArthropathy
Other
HIV
Hepatitis
Tuberculosis
Malignancy
Allergy
PreviousSurgery
FamilyHistory
Examination
General
SurgeryRelated
Systemic
Specific
Investigations
RoutineInvestigations
FBC
UreaElectrolytes
ECG
ClottingScreen
ChestXRay
Urinalysis
HCG
BloodGlucose
ArterialBloodGases
LiverFunctionTests
PreoperativeManagement
Cardiovascular
Dysrhythmias
Anemia
Respiratory
COPD
Asthma
Gastrointestinal
NilByMouth
LiverDisease
Genitourinary
ChronicRenalFailure
Malnutrition
Obesity
DiabetesMellitus
Neurological
StrokeHistory
RiskFactorsForThrombosis
Musculoskeletal
AirwayAssessment
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper