Task-Adaptive Few-shot Node Classification
Song Wang,Kaize Ding,Chuxu Zhang,Chen Chen,Jundong Li +4 more
- 23 Jun 2022
TL;DR: A task-adaptive node classification framework under the few-shot learning setting that can conduct adaptations to different meta-tasks and advance the model generalization performance on meta-test tasks.
read more
Abstract: Node classification is of great importance among various graph mining tasks. In practice, real-world graphs generally follow the long-tail distribution, where a large number of classes only consist of limited labeled nodes. Although Graph Neural Networks (GNNs) have achieved significant improvements in node classification, their performance decreases substantially in such a few-shot scenario. The main reason can be attributed to the vast generalization gap between meta-training and meta-test due to the task variance caused by different node/class distributions in meta-tasks (i.e., node-level and class-level variance). Therefore, to effectively alleviate the impact of task variance, we propose a task-adaptive node classification framework under the few-shot learning setting. Specifically, we first accumulate meta-knowledge across classes with abundant labeled nodes. Then we transfer such knowledge to the classes with limited labeled nodes via our proposed task-adaptive modules. In particular, to accommodate the different node/class distributions among meta-tasks, we propose three essential modules to perform node-level, class-level, and task-level adaptations in each meta-task, respectively. In this way, our framework can conduct adaptations to different meta-tasks and thus advance the model generalization performance on meta-test tasks. Extensive experiments on four prevalent node classification datasets demonstrate the superiority of our framework over the state-of-the-art baselines. Our code is provided at https://github.com/SongW-SW/TENT https://github.com/SongW-SW/TENT.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
One for All: Towards Training One Graph Model for All Classification Tasks
Hao Liu,Jiarui Feng,Ningyue Liang,Dacheng Tao,Yixin Chen,Muhan Zhang +5 more
TL;DR: OFA introduces a novel graph prompting paradigm that appends prompting substructures to the input graph, which enables it to address varied tasks without fine-tuning and performs well across different tasks, making it the first general-purpose across-domains classification model on graphs.
51
Federated Few-shot Learning
Song Wang,Xingbo Fu,Kaize Ding,Chen Chen,Haidan Chen,Jundong Li +5 more
- 04 Aug 2023
TL;DR: Federated few-shot learning is a novel problem that aims to train a machine learning model on a large dataset distributed across multiple clients, where clients have limited data samples. The problem is challenging due to global data variance and local data insufficiency. A novel framework is proposed to address these challenges.
15
A Survey of Imbalanced Learning on Graphs: Problems, Techniques, and Future Directions
TL;DR: This survey begins by providing a definitive understanding of the concept and related terminologies of imbalanced learning on graphs, and proposes two comprehensive taxonomies: the problem taxonomy, which describes the forms of imbalance the authors consider, the associated tasks, and potential solutions, and the technique taxonomy which details key strategies for addressing these imbalances and aids readers in their method selection process.
Few-shot Node Classification with Extremely Weak Supervision
Song Wang,Yushun Dong,Kaize Ding,Chen Chen,Jundong Li +4 more
- 06 Jan 2023
TL;DR: X-FNC as mentioned in this paper proposes a principled framework to accumulate meta-knowledge across different meta-training tasks with extremely weak supervision and generalize such knowledge to meta-test tasks.
Road Planning for Slums via Deep Reinforcement Learning
TL;DR: Wang et al. as mentioned in this paper proposed a generic graph model to capture the topological structure of a slum, and devised a novel graph neural network to select locations for the planned roads.
References
•Proceedings Article
Adam: A Method for Stochastic Optimization
Diederik P. Kingma,Jimmy Ba +1 more
- 01 Jan 2015
TL;DR: This work introduces Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments, and provides a regret bound on the convergence rate that is comparable to the best known results under the online convex optimization framework.
138.5K
•Posted Content
Semi-Supervised Classification with Graph Convolutional Networks
Thomas Kipf,Max Welling +1 more
TL;DR: A scalable approach for semi-supervised learning on graph-structured data that is based on an efficient variant of convolutional neural networks which operate directly on graphs which outperforms related methods by a significant margin.
22.7K
Automatic differentiation in PyTorch
Adam Paszke,Sam Gross,Soumith Chintala,Gregory Chanan,Edward Z. Yang,Zachary DeVito,Zeming Lin,Alban Desmaison,Luca Antiga,Adam Lerer +9 more
- 28 Oct 2017
TL;DR: An automatic differentiation module of PyTorch is described — a library designed to enable rapid research on machine learning models that focuses on differentiation of purely imperative programs, with a focus on extensibility and low overhead.
STRING v11: protein-protein association networks with increased coverage, supporting functional discovery in genome-wide experimental datasets.
Damian Szklarczyk,Annika L. Gable,David Lyon,Alexander Junge,Stefan Wyder,Jaime Huerta-Cepas,Milan Simonovic,Nadezhda Tsankova Doncheva,John H. Morris,Peer Bork,Lars Juhl Jensen,Christian von Mering +11 more
TL;DR: The latest version of STRING more than doubles the number of organisms it covers, and offers an option to upload entire, genome-wide datasets as input, allowing users to visualize subsets as interaction networks and to perform gene-set enrichment analysis on the entire input.
16.2K
•Posted Content
Inductive Representation Learning on Large Graphs
TL;DR: GraphSAGE is presented, a general, inductive framework that leverages node feature information (e.g., text attributes) to efficiently generate node embeddings for previously unseen data and outperforms strong baselines on three inductive node-classification benchmarks.
11.9K