Meta-Inductive Node Classification across Graphs.
Zhihao Wen,Yuan Fang,Zemin Liu +2 more
TL;DR: This paper proposes a novel meta-inductive framework called MI-GNN to customize the inductive model to each graph under a meta-learning paradigm, and employs a dual adaptation mechanism at both the graph and task levels.
read more
Abstract:Â Semi-supervised node classification on graphs is an important research problem, with many real-world applications in information retrieval such as content classification on a social network and query intent classification on an e-commerce query graph. While traditional approaches are largely transductive, recent graph neural networks (GNNs) integrate node features with network structures, thus enabling inductive node classification models that can be applied to new nodes or even new graphs in the same feature space. However, inter-graph differences still exist across graphs within the same domain. Thus, training just one global model (e.g., a state-of-the-art GNN) to handle all new graphs, whilst ignoring the inter-graph differences, can lead to suboptimal performance.
In this paper, we study the problem of inductive node classification across graphs. Unlike existing one-model-fits-all approaches, we propose a novel meta-inductive framework called MI-GNN to customize the inductive model to each graph under a meta-learning paradigm. That is, MI-GNN does not directly learn an inductive model; it learns the general knowledge of how to train a model for semi-supervised node classification on new graphs. To cope with the differences across graphs, MI-GNN employs a dual adaptation mechanism at both the graph and task levels. More specifically, we learn a graph prior to adapt for the graph-level differences, and a task prior to adapt for the task-level differences conditioned on a graph. Extensive experiments on five real-world graph collections demonstrate the effectiveness of our proposed model.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Figures

Table 2: Statistics of graph datasets. 
Figure 1: Illustrative comparison of transductive, inductive and our meta-inductive approaches for semi-supervised node classification on subgraphs of an image-sharing network. (Colored images: labeled nodes; black &white images: unlabeled nodes.) 
Table 1: List of major notations. 
Table 4: Accuracy of MI-GNN and baselines using alternative GNN architectures, in percent, with 95% confidence intervals. 
Table 3: Performance of MI-GNN and baselines, in percent, with 95% confidence intervals. 
Figure 2: Overall framework of MI-GNN, illustrating the pipeline on a training graph đşđ and a testing graph đş đ .
Citations
GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networks
Zemin Liu,Xingtong Yu,Yuan Fang,Xinming Zhang +3 more
- 16 Feb 2023
TL;DR: GraphPrompt as discussed by the authors unifies pre-training and downstream tasks into a common task template, and employs a learnable prompt to assist a downstream task in locating the most relevant knowledge from the pre-trained model in a task-specific manner.
TREND: TempoRal Event and Node Dynamics for Graph Representation Learning
Yuan Fang
- 27 Mar 2022
TL;DR: TREND is a novel framework for temporal graph representation learning, driven by TempoRal Event and Node Dynamics and built upon a Hawkes process-based graph neural network (GNN).
Task-Adaptive Few-shot Node Classification
Song Wang,Kaize Ding,Chuxu Zhang,Chen Chen,Jundong Li +4 more
- 23 Jun 2022
TL;DR: A task-adaptive node classification framework under the few-shot learning setting that can conduct adaptations to different meta-tasks and advance the model generalization performance on meta-test tasks.
Meta-Knowledge Transfer for Inductive Knowledge Graph Embedding
06 Jul 2022
TL;DR: In this article , the authors propose a model MorsE, which does not learn embeddings for entities but learns transferable meta-knowledge that can be used to produce entity embedding.
Augmenting Low-Resource Text Classification with Graph-Grounded Pre-training and Prompting
TL;DR: This article proposed a graph-grounded pre-training and prompting (G2P2) model to address low-resource text classification in a two-pronged approach, where three graph interaction-based contrastive strategies were proposed to jointly pre-train a graphtext model.
References
â˘Proceedings Article
Distributed Representations of Words and Phrases and their Compositionality
Tomas Mikolov,Ilya Sutskever,Kai Chen,Greg S. Corrado,Jeffrey Dean +4 more
- 05 Dec 2013
TL;DR: This paper presents a simple method for finding phrases in text, and shows that learning good vector representations for millions of phrases is possible and describes a simple alternative to the hierarchical softmax called negative sampling.
â˘Posted Content
Semi-Supervised Classification with Graph Convolutional Networks
Thomas Kipf,Max Welling +1 more
TL;DR: A scalable approach for semi-supervised learning on graph-structured data that is based on an efficient variant of convolutional neural networks which operate directly on graphs which outperforms related methods by a significant margin.
22.7K
Graph Attention Networks
Petar VeliÄkoviÄ,Guillem Cucurull,Arantxa Casanova,Adriana Romero,Pietro Liò,Yoshua Bengio +5 more
- 15 Feb 2018
TL;DR: Graph Attention Networks (GATs) as mentioned in this paper leverage masked self-attentional layers to address the shortcomings of prior methods based on graph convolutions or their approximations.
â˘Posted Content
Inductive Representation Learning on Large Graphs
TL;DR: GraphSAGE is presented, a general, inductive framework that leverages node feature information (e.g., text attributes) to efficiently generate node embeddings for previously unseen data and outperforms strong baselines on three inductive node-classification benchmarks.
11.9K
DeepWalk: online learning of social representations
Bryan Perozzi,Rami Al-Rfou,Steven Skiena +2 more
- 24 Aug 2014
TL;DR: DeepWalk as mentioned in this paper uses local information obtained from truncated random walks to learn latent representations by treating walks as the equivalent of sentences, which encode social relations in a continuous vector space, which is easily exploited by statistical models.
Related Papers (5)
Zhihao Wen,Yuan Fang,Zemin Liu +2 more
- 11 Jul 2021
Dai Quoc Nguyen,Tu Dinh Nguyen,Dinh Phung +2 more
- 26 Sep 2019