SelfCF: A Simple Framework for Self-supervised Collaborative Filtering
20 Apr 2023
TL;DR: SelfCF as mentioned in this paper proposes a self-supervised collaborative filtering framework to augment the output embeddings generated by backbone networks, which can be easily applied to existing deep learning based collaborative filtering models.
read more
Abstract: Collaborative filtering (CF) is widely used to learn informative latent representations of users and items from observed interactions. Existing CF-based methods commonly adopt negative sampling to discriminate different items. Training with negative sampling on large datasets is computationally expensive. Further, negative items should be carefully sampled under the defined distribution, in order to avoid selecting an observed positive item in the training dataset. Unavoidably, some negative items sampled from the training dataset could be positive in the test set. In this paper, we propose a self-supervised collaborative filtering framework (SelfCF), that is specially designed for recommender scenario with implicit feedback. The proposed SelfCF framework simplifies the Siamese networks and can be easily applied to existing deep-learning based CF models, which we refer to as backbone networks. The main idea of SelfCF is to augment the output embeddings generated by backbone networks, because it is infeasible to augment raw input of user/item ids. We propose and study three output perturbation techniques that can be applied to different types of backbone networks including both traditional CF models and graph-based models. The framework enables learning informative representations of users and items without negative samples, and is agnostic to the encapsulated backbones. We conduct comprehensive experiments on four datasets to show that our framework may achieve even better recommendation accuracy than the encapsulated supervised counterpart with a 2$\times$--4$\times$ faster training speed. We also show that SelfCF can boost up the accuracy by up to 17.79% on average, compared with a self-supervised framework BUIR.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Self-Supervised Learning for Recommender Systems: A Survey
TL;DR: Self-supervised learning (SSL) has attracted considerable attention as a potential solution to this issue as mentioned in this paper , but they still fall short of expectation when dealing with highly sparse data.
139
XSimGCL: Towards Extremely Simple Graph Contrastive Learning for Recommendation
TL;DR: Yu et al. as discussed by the authors used contrastive learning (CL) to learn more evenly distributed user and item representations, which alleviates the prevalent popularity bias and promotes long-tail items.
81
CrossCBR
Yunshan Ma,Yin Jie He,An Zhang,Xiang Wang,Tat-Seng Chua +4 more
- 14 Aug 2022
TL;DR: In this paper , the authors propose a cooperative association between the two views' representations to obtain informative representations for users and bundles, corresponding to bundle view and item view, respectively, which can satisfy the users' various needs with one-stop convenience.
A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal Recommendation
Ashesh Ranchod
- 13 Nov 2022
TL;DR: FREEDOM as mentioned in this paper proposes a simple yet effective model, dubbed as FREEDOM, that FREEzes the item-item graph and denoises the user-item interaction graph simultaneously for multimodal recommendation.
49
A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trends
Abolfazl Younesi,Mohsen Ansari,MohammadAmin Fazli,Alireza Ejlali,Muhammad Shafique,Joerg Henkel +5 more
TL;DR: This survey paper provides a comprehensive examination and comparison of various CNN architectures, highlighting their architectural differences and emphasizing their respective advantages, disadvantages, applications, challenges, and future trends.
44
References
•Journal Article
Dropout: a simple way to prevent neural networks from overfitting
TL;DR: It is shown that dropout improves the performance of neural networks on supervised learning tasks in vision, speech recognition, document classification and computational biology, obtaining state-of-the-art results on many benchmark data sets.
Backpropagation applied to handwritten zip code recognition
Yann LeCun,Bernhard E. Boser,John S. Denker,D. Henderson,Richard Howard,W. Hubbard,Lawrence D. Jackel +6 more
TL;DR: This paper demonstrates how constraints from the task domain can be integrated into a backpropagation network through the architecture of the network, successfully applied to the recognition of handwritten zip code digits provided by the U.S. Postal Service.
12.5K
A survey on Image Data Augmentation for Deep Learning
TL;DR: This survey will present existing methods for Data Augmentation, promising developments, and meta-level decisions for implementing DataAugmentation, a data-space solution to the problem of limited data.
Neural Collaborative Filtering
Xiangnan He,Lizi Liao,Hanwang Zhang,Liqiang Nie,Xia Hu,Tat-Seng Chua +5 more
- 03 Apr 2017
TL;DR: This work strives to develop techniques based on neural networks to tackle the key problem in recommendation --- collaborative filtering --- on the basis of implicit feedback, and presents a general framework named NCF, short for Neural network-based Collaborative Filtering.
Unsupervised Feature Learning via Non-parametric Instance Discrimination
Zhirong Wu,Yuanjun Xiong,Stella X. Yu,Dahua Lin +3 more
- 18 Jun 2018
TL;DR: This work forms this intuition as a non-parametric classification problem at the instance-level, and uses noise-contrastive estimation to tackle the computational challenges imposed by the large number of instance classes.