Awesome

Awesome-Graph-LLM

A collection of AWESOME things about Graph-Related Large Language Models (LLMs).

Large Language Models (LLMs) have shown remarkable progress in natural language processing tasks. However, their integration with graph structures, which are prevalent in real-world applications, remains relatively unexplored. This repository aims to bridge that gap by providing a curated list of research papers that explore the intersection of graph-based techniques with LLMs.

Awesome-Graph-LLM

Datasets, Benchmarks & Surveys

(NAACL'21) Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training [paper][code]
(NeurIPS'23) Can Language Models Solve Graph Problems in Natural Language? [paper][code]
(IEEE Intelligent Systems 2023) Integrating Graphs with Large Language Models: Methods and Prospects [paper]
(ICLR'24) Talk like a Graph: Encoding Graphs for Large Language Models [paper]
(KDD'24) LLM4DyG: Can Large Language Models Solve Problems on Dynamic Graphs? [paper][code]
(NeurIPS'24) TEG-DB: A Comprehensive Dataset and Benchmark of Textual-Edge Graphs [pdf][code][datasets]
(arXiv 2023.05) GPT4Graph: Can Large Language Models Understand Graph Structured Data? An Empirical Evaluation and Benchmarking [paper][code]
(arXiv 2023.08) Graph Meets LLMs: Towards Large Graph Models [paper]
(arXiv 2023.10) Towards Graph Foundation Models: A Survey and Beyond [paper]
(arXiv 2023.11) Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Survey [paper]
(arXiv 2023.11) A Survey of Graph Meets Large Language Model: Progress and Future Directions [paper][code]
(arXiv 2023.12) Large Language Models on Graphs: A Comprehensive Survey [paper][code]
(arXiv 2024.02) Towards Versatile Graph Learning Approach: from the Perspective of Large Language Models [paper]
(arXiv 2024.04) Graph Machine Learning in the Era of Large Language Models (LLMs) [paper]
(arXiv 2024.05) A Survey of Large Language Models for Graphs [paper][code]
(NeurIPS'24 D&B) GLBench: A Comprehensive Benchmark for Graph with Large Language Models [paper][code]
(arXiv 2024.07) Learning on Graphs with Large Language Models(LLMs): A Deep Dive into Model Robustness [paper][code]
(Complex Networks 2024) LLMs hallucinate graphs too: a structural perspective [paper]
(arXiv 2024.10) Can Graph Descriptive Order Affect Solving Graph Problems with LLMs? [paper]
(arXiv 2024.10) How Do Large Language Models Understand Graph Patterns? A Benchmark for Graph Pattern Comprehension [paper]
(arXiv 2024.10) GRS-QA - Graph Reasoning-Structured Question Answering Dataset [paper]
(NeurIPS'24 D&B) Can Large Language Models Analyze Graphs like Professionals? A Benchmark, Datasets and Models [paper] [code]

Prompting

(EMNLP'23) StructGPT: A General Framework for Large Language Model to Reason over Structured Data [paper][code]
(AAAI'24) Graph of Thoughts: Solving Elaborate Problems with Large Language Models [paper][code]
(arXiv 2023.05) PiVe: Prompting with Iterative Verification Improving Graph-based Generative Capability of LLMs [paper][code]
(arXiv 2023.08) Boosting Logical Reasoning in Large Language Models through a New Framework: The Graph of Thought [paper]
(arxiv 2023.10) Thought Propagation: An Analogical Approach to Complex Reasoning with Large Language Models [paper]
(arxiv 2024.01) Topologies of Reasoning: Demystifying Chains, Trees, and Graphs of Thoughts [paper]
(ACL'24) Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphs [paper][code]

General Graph Model

(ICLR'24) One for All: Towards Training One Graph Model for All Classification Tasks [paper][code]
(WWW'24) GraphTranslator: Aligning Graph Model to Large Language Model for Open-ended Tasks [paper][code]
(arXiv 2023.08) Natural Language is All a Graph Needs [paper][code]
(arXiv 2023.10) GraphGPT: Graph Instruction Tuning for Large Language Models [paper][code][blog in Chinese]
(arXiv 2023.10) Graph Agent: Explicit Reasoning Agent for Graphs [paper]
(arXiv 2024.02) Let Your Graph Do the Talking: Encoding Structured Data for LLMs [paper]
(NeurIPS'24) G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answering [paper][code][blog]
(arXiv 2024.02) InstructGraph: Boosting Large Language Models via Graph-centric Instruction Tuning and Preference Alignment [paper][code]
(arXiv 2024.02) LLaGA: Large Language and Graph Assistant [paper][code]
(arXiv 2024.02) HiGPT: Heterogeneous Graph Language Model [paper][code]
(arXiv 2024.02) UniGraph: Learning a Cross-Domain Graph Foundation Model From Natural Language [paper]
(arXiv 2024.06) UniGLM: Training One Unified Language Model for Text-Attributed Graphs [paper][code]
(arXiv 2024.07) GOFA: A Generative One-For-All Model for Joint Graph Language Modeling [paper][code]
(arXiv 2024.08) AnyGraph: Graph Foundation Model in the Wild [paper][code]
(arXiv 2024.10) NT-LLM: A Novel Node Tokenizer for Integrating Graph Structure into Large Language Models [paper]

Large Multimodal Models (LMMs)

(NeurIPS'23) GraphAdapter: Tuning Vision-Language Models With Dual Knowledge Graph [paper][code]
(arXiv 2023.10) Multimodal Graph Learning for Generative Tasks [paper][code]
(arXiv 2024.02) Rendering Graphs for Graph Reasoning in Multimodal Large Language Models [paper]
(ACL 2024) Graph Language Models [paper][code]
(NeurIPS'24) GITA: Graph to Visual and Textual Integration for Vision-Language Graph Reasoning [paper][code][project]

Applications

Basic Graph Reasoning

(KDD'24) GraphWiz: An Instruction-Following Language Model for Graph Problems [paper][code][project]
(arXiv 2023.04) Graph-ToolFormer: To Empower LLMs with Graph Reasoning Ability via Prompt Augmented by ChatGPT [paper][code]
(arXiv 2023.10) GraphText: Graph Reasoning in Text Space [paper]
(arXiv 2023.10) GraphLLM: Boosting Graph Reasoning Ability of Large Language Model [paper][code]
(arXiv 2024.10) GUNDAM: Aligning Large Language Models with Graph Understanding [paper]
(arXiv 2024.10) Are Large-Language Models Graph Algorithmic Reasoners? [paper][code]
(arXiv 2024.10) GCoder: Improving Large Language Model for Generalized Graph Problem Solving [paper] [code]
(arXiv 2024.10) GraphTeam: Facilitating Large Language Model-based Graph Analysis via Multi-Agent Collaboration [paper] [code]

Node Classification

(ICLR'24) Explanations as Features: LLM-Based Features for Text-Attributed Graphs [paper][code]
(ICLR'24) Label-free Node Classification on Graphs with Large Language Models (LLMS) [paper]
(WWW'24) Can GNN be Good Adapter for LLMs? [paper][code]
(CIKM'24) Distilling Large Language Models for Text-Attributed Graph Learning [paper]
(arXiv 2023.07) Exploring the Potential of Large Language Models (LLMs) in Learning on Graphs [paper][code]
(arXiv 2023.09) Can LLMs Effectively Leverage Structural Information for Graph Learning: When and Why [paper][code]
(arXiv 2023.10) Empower Text-Attributed Graphs Learning with Large Language Models (LLMs) [paper]
(arXiv 2023.10) Disentangled Representation Learning with Large Language Models for Text-Attributed Graphs [paper]
(arXiv 2023.11) Large Language Models as Topological Structure Enhancers for Text-Attributed Graphs [paper]
(arXiv 2024.01) Efficient Tuning and Inference for Large Language Models on Textual Graphs [paper][code]
(arXiv 2024.02) Similarity-based Neighbor Selection for Graph LLMs [paper] [code]
(arXiv 2024.02) Distilling Large Language Models for Text-Attributed Graph Learning [paper]
(arXiv 2024.02) GraphEdit: Large Language Models for Graph Structure Learning [paper][code]
(arXiv 2024.05) LOGIN: A Large Language Model Consulted Graph Neural Network Training Framework [paper][code]
(arXiv 2024.06) GAugLLM: Improving Graph Contrastive Learning for Text-Attributed Graphs with Large Language Models [paper][code]
(arXiv 2024.07) Enhancing Data-Limited Graph Neural Networks by Actively Distilling Knowledge from Large Language Models [paper]
(arXiv 2024.07) All Against Some: Efficient Integration of Large Language Models for Message Passing in Graph Neural Networks [paper]
(arXiv 2024.10) Let's Ask GNN: Empowering Large Language Model for Graph In-Context Learning [paper]
(arXiv 2024.10) Large Language Model-based Augmentation for Imbalanced Node Classification on Text-Attributed Graphs [paper]
(arXiv 2024.10) Enhance Graph Alignment for Large Language Models [paper]

Graph Classification/Regression

(arXiv 2023.06) GIMLET: A Unified Graph-Text Model for Instruction-Based Molecule Zero-Shot Learning [paper][code]
(arXiv 2023.07) Can Large Language Models Empower Molecular Property Prediction? [paper][code]

Knowledge Graph

(AAAI'22) Enhanced Story Comprehension for Large Language Models through Dynamic Document-Based Knowledge Graphs [paper]
(EMNLP'22) Language Models of Code are Few-Shot Commonsense Learners [paper][code]
(SIGIR'23) Schema-aware Reference as Prompt Improves Data-Efficient Knowledge Graph Construction [paper][code]
(TKDE‘23) AutoAlign: Fully Automatic and Effective Knowledge Graph Alignment enabled by Large Language Models [paper][code]
(AAAI'24) Graph Neural Prompting with Large Language Models [paper][code]
(NAACL'24) zrLLM: Zero-Shot Relational Learning on Temporal Knowledge Graphs with Large Language Models [paper]
(ICLR'24) Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph [paper][code]
(arXiv 2023.04) CodeKGC: Code Language Model for Generative Knowledge Graph Construction [paper][code]
(arXiv 2023.05) Knowledge Graph Completion Models are Few-shot Learners: An Empirical Study of Relation Labeling in E-commerce with LLMs [paper]
(arXiv 2023.08) MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Models [paper][code]
(arXiv 2023.10) Faithful Path Language Modelling for Explainable Recommendation over Knowledge Graph [paper]
(arXiv 2023.10) Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning [paper][code]
(arXiv 2023.11) Zero-Shot Relational Learning on Temporal Knowledge Graphs with Large Language Models [paper]
(arXiv 2023.12) KGLens: A Parameterized Knowledge Graph Solution to Assess What an LLM Does and Doesn’t Know [paper]
(arXiv 2024.02) Large Language Model Meets Graph Neural Network in Knowledge Distillation [paper]
(arXiv 2024.02) Large Language Models Can Learn Temporal Reasoning [paper][code]
(arXiv 2024.02) Knowledge Graph Large Language Model (KG-LLM) for Link Prediction [paper]
(arXiv 2024.03) Call Me When Necessary: LLMs can Efficiently and Faithfully Reason over Structured Environments [paper]
(arXiv 2024.04) Evaluating the Factuality of Large Language Models using Large-Scale Knowledge Graphs [paper][code]
(arXiv 2024.04) Extract, Define, Canonicalize: An LLM-based Framework for Knowledge Graph Construction [paper][code]
(arXiv 2024.05) FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answering [paper]
(arXiv 2024.06) Explore then Determine: A GNN-LLM Synergy Framework for Reasoning over Knowledge Graph [paper]
(ACL 2024) Graph Language Models [paper][code]
(EMNLP 2024) LLM-Based Multi-Hop Question Answering with Knowledge Graph Integration in Evolving Environments [paper]

Molecular Graph

(arXiv 2024.06) MolecularGPT: Open Large Language Model (LLM) for Few-Shot Molecular Property Prediction [paper][code]
(arXiv 2024.06) HIGHT: Hierarchical Graph Tokenization for Graph-Language Alignment [paper][project]
(arXiv 2024.06) MolX: Enhancing Large Language Models for Molecular Learning with A Multi-Modal Extension [paper]
(arXiv 2024.06) LLM and GNN are Complementary: Distilling LLM for Multimodal Graph Learning [paper]
(arXiv 2024.10) G2T-LLM: Graph-to-Tree Text Encoding for Molecule Generation with Fine-Tuned Large Language Models [paper]

Graph Robustness

(arXiv 2024.05) Intruding with Words: Towards Understanding Graph Injection Attacks at the Text Level [paper]
(arXiv 2024.08) Can Large Language Models Improve the Adversarial Robustness of Graph Neural Networks? [paper]

Others

(WSDM'24) LLMRec: Large Language Models with Graph Augmentation for Recommendation [paper][code][blog in Chinese].
(arXiv 2023.03) Ask and You Shall Receive (a Graph Drawing): Testing ChatGPT’s Potential to Apply Graph Layout Algorithms [paper]
(arXiv 2023.05) Graph Meets LLM: A Novel Approach to Collaborative Filtering for Robust Conversational Understanding [paper]
(arXiv 2023.05) ChatGPT Informed Graph Neural Network for Stock Movement Prediction [paper][code]
(arXiv 2023.10) Graph Neural Architecture Search with GPT-4 [paper]
(arXiv 2023.11) Biomedical knowledge graph-enhanced prompt generation for large language models [paper][code]
(arXiv 2023.11) Graph-Guided Reasoning for Multi-Hop Question Answering in Large Language Models [paper]
(NeurIPS'24) Microstructures and Accuracy of Graph Recall by Large Language Models [paper][code]
(arXiv 2024.02) Causal Graph Discovery with Retrieval-Augmented Generation based Large Language Models [paper]
(arXiv 2024.02) Graph-enhanced Large Language Models in Asynchronous Plan Reasoning [paper][code]
(arXiv 2024.02) Efficient Causal Graph Discovery Using Large Language Models [paper]
(arXiv 2024.03) Exploring the Potential of Large Language Models in Graph Generation [paper]
(arXiv 2024.05) Don't Forget to Connect! Improving RAG with Graph-based Reranking [paper]
(NeurIPS'24) Can Graph Learning Improve Planning in LLM-based Agents? [paper][code]
(arXiv 2024.06) GNN-RAG: Graph Neural Retrieval for Large Language Modeling Reasoning [paper][code]
(arXiv 2024.07) LLMExplainer: Large Language Model based Bayesian Inference for Graph Explanation Generation [paper]
(arXiv 2024.08) CodexGraph: Bridging Large Language Models and Code Repositories via Code Graph Databases [paper][code][project]
(arXiv 2024.10) Graph Linearization Methods for Reasoning on Graphs with Large Language Models [paper]
(arXiv 2024.10) GraphRouter: A Graph-based Router for LLM Selections [paper][code]
(arXiv 2024.10) Graph of Records: Boosting Retrieval Augmented Generation for Long-context Summarization with Graphs [paper] [code]
(arXiv 2024.10) G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks [paper] [code]

Resources & Tools

GraphGPT: Extrapolating knowledge graphs from unstructured text using GPT-3
GraphML: Graph markup language. An XML-based file format for graphs.
GML: Graph modelling language. Read graphs in GML format.

Contributing

👍 Contributions to this repository are welcome!

If you have come across relevant resources, feel free to open an issue or submit a pull request.

- (*conference|journal*) paper_name [[pdf](link)][[code](link)]