Meta-Inductive Node Classification across Graphs
Zhihao Wen,Yuan Fang,Zemin Liu +2 more
- 11 Jul 2021
- pp 1219-1228
8
TL;DR: In this paper, a meta-inductive framework called MI-GNN is proposed to customize the inductive model to each graph under a meta learning paradigm, which learns the general knowledge of how to train a model for semi-supervised node classification on new graphs.
read more
Abstract: Semi-supervised node classification on graphs is an important research problem, with many real-world applications in information retrieval such as content classification on a social network and query intent classification on an e-commerce query graph. While traditional approaches are largely transductive, recent graph neural networks (GNNs) integrate node features with network structures, thus enabling inductive node classification models that can be applied to new nodes or even new graphs in the same feature space. However, inter-graph differences still exist across graphs within the same domain. Thus, training just one global model (e.g., a state-of-the-art GNN) to handle all new graphs, whilst ignoring the inter-graph differences, can lead to suboptimal performance. In this paper, we study the problem of inductive node classification across graphs. Unlike existing one-model-fits-all approaches, we propose a novel meta-inductive framework called MI-GNN to customize the inductive model to each graph under a meta-learning paradigm. That is, MI-GNN does not directly learn an inductive model; it learns the general knowledge of how to train a model for semi-supervised node classification on new graphs. To cope with the differences across graphs, MI-GNN employs a dual adaptation mechanism at both the graph and task levels. More specifically, we learn a graph prior to adapt for the graph-level differences, and a task prior to adapt for the task-level differences conditioned on a graph. Extensive experiments on five real-world graph collections demonstrate the effectiveness of our proposed model.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networks
Zemin Liu,Xingtong Yu,Yuan Fang,Xinming Zhang +3 more
- 16 Feb 2023
TL;DR: GraphPrompt as discussed by the authors unifies pre-training and downstream tasks into a common task template, and employs a learnable prompt to assist a downstream task in locating the most relevant knowledge from the pre-trained model in a task-specific manner.
TREND: TempoRal Event and Node Dynamics for Graph Representation Learning
Yuan Fang
- 27 Mar 2022
TL;DR: TREND is a novel framework for temporal graph representation learning, driven by TempoRal Event and Node Dynamics and built upon a Hawkes process-based graph neural network (GNN).
Task-Adaptive Few-shot Node Classification
Song Wang,Kaize Ding,Chuxu Zhang,Chen Chen,Jundong Li +4 more
- 23 Jun 2022
TL;DR: A task-adaptive node classification framework under the few-shot learning setting that can conduct adaptations to different meta-tasks and advance the model generalization performance on meta-test tasks.
Group Property Inference Attacks Against Graph Neural Networks
Xiuling Wang,Wendy Hui Wang +1 more
- 02 Sep 2022
TL;DR: This work performs the first systematic study of group property inference attacks (GPIA) against GNNs, and shows that the target model trained on the graphs with or without the target property represents some dissimilarity in model parameters and/or model outputs which enables the adversary to infer the existence of the property.
33
Few-shot Node Classification on Attributed Networks with Graph Meta-learning
Yonghao Liu,Meng Li,Ximing Li,Fausto Giunchiglia,Xiaoyue Feng,Renchu Guan +5 more
- 06 Jul 2022
TL;DR: An efficient method for learning expressive node representations even on heterophilic graphs is introduced and a prototype-based approach to initialize parameters in meta-learning is proposed, which outperforms other state-of-the-art baselines by up to 13% absolute improvement in terms of related metrics.
References
•Proceedings Article
Distributed Representations of Words and Phrases and their Compositionality
Tomas Mikolov,Ilya Sutskever,Kai Chen,Greg S. Corrado,Jeffrey Dean +4 more
- 05 Dec 2013
TL;DR: This paper presents a simple method for finding phrases in text, and shows that learning good vector representations for millions of phrases is possible and describes a simple alternative to the hierarchical softmax called negative sampling.
•Posted Content
Semi-Supervised Classification with Graph Convolutional Networks
Thomas Kipf,Max Welling +1 more
TL;DR: A scalable approach for semi-supervised learning on graph-structured data that is based on an efficient variant of convolutional neural networks which operate directly on graphs which outperforms related methods by a significant margin.
22.7K
•Posted Content
Inductive Representation Learning on Large Graphs
TL;DR: GraphSAGE is presented, a general, inductive framework that leverages node feature information (e.g., text attributes) to efficiently generate node embeddings for previously unseen data and outperforms strong baselines on three inductive node-classification benchmarks.
11.9K
DeepWalk: online learning of social representations
Bryan Perozzi,Rami Al-Rfou,Steven Skiena +2 more
- 24 Aug 2014
TL;DR: DeepWalk as mentioned in this paper uses local information obtained from truncated random walks to learn latent representations by treating walks as the equivalent of sentences, which encode social relations in a continuous vector space, which is easily exploited by statistical models.
node2vec: Scalable Feature Learning for Networks
Aditya Grover,Jure Leskovec +1 more
- 13 Aug 2016
TL;DR: Node2vec as mentioned in this paper learns a mapping of nodes to a low-dimensional space of features that maximizes the likelihood of preserving network neighborhoods of nodes by using a biased random walk procedure.
Related Papers (5)
Zhihao Wen,Yuan Fang,Zemin Liu +2 more
Dai Quoc Nguyen,Tu Dinh Nguyen,Dinh Phung +2 more
- 26 Sep 2019