Awesome
Multi-perspective Improvement of Knowledge Graph Completion with Large Language Models
This is the code and data of paper Multi-perspective Improvement of Knowledge Graph Completion with Large Language Models, LREC-COLING 2024.
The entire project consists of three steps: (1) Generating data, (2) Processing data and (3) Runing KGC models.
Generating data
You can directly download the data we generated from Goolge Drive. Put the data in current directory, e.g., MPIKGC/LP_fb_wn_chatglm2/
.
If you want to generate data with LLMs by yourself, you can run the following command to query LLMs for data:
First, cd generating_MPIKG/
, then
For FB15k237:
python querying_llm_fb15k237.py --max_length 256 --temperature 0.2 --cuda 0 --batchsize 1 --LLMfold './../LP_fb_wn_llama2/' --LLMname ChatGLM2
For WN18RR:
python querying_llm_wn18rr.py --max_length 256 --temperature 0.2 --cuda 0 --batchsize 1 --LLMfold './../LP_fb_wn_llama2/' --LLMname ChatGLM2
For FB13 and WN11:
python querying_llm_TC_FB13_WN11.py --max_length 256 --temperature 0.2 --cuda 0 --batchsize 1 --LLMfold './../TC_fb_wn_llama2/' --LLMname ChatGLM2 --fb_or_wn FB13
After getting extracted keywords, you can genearate the top K matching entities for Structure Extraction, and change the default parameters in codes to obtain the desired data:
python textmatch4structure.py
Finally, generating data in corresponding path, e.g., LP_fb_wn_chatglm2/FB15k237/
:
cotdes.txt
for MPIKGC-E
rel2des.txt
for MPIKGC-R Global
rel2sentence.txt
for MPIKGC-R Local
rel2reverse.txt
for MPIKGC-R Reverse
struc/*
for MPIKGC-S
Processing data
Merge the enhanced data with original KG to generate new KG with regular form:
cd processing_MPIKG
python merge.py
Download KGC models from their repository: CSprom-KG,
LMKE,
SimKGC,
KG-BERT. Put these project in current directory, e.g., MPIKGC/CSprom-KG/
.
For diffrent KGC models, you need to slightly modify the form of data by runing:
python data4kgc_models.py
This code will transfer the form of data to adapt to different KGC model requirements, and copy the data to corresponding model project folder.
Note that KG-BERT need same form as LMKE, You can directly copy it over.
Runing KGC models
Configure according to the environment and process requirements of each model. Hyperparameters for KGC models can be found in Appendices of our paper.