Auto-Encoders in Deep Learning—A Review with New Perspectives
Shuangshuang Chen,Wei Guo +1 more
TL;DR: The auto-encoder is a key component of deep structure, which can be used to realize transfer learning and plays an important role in both unsupervised learning and non-linear feature extraction as mentioned in this paper .
read more
Abstract: Deep learning, which is a subfield of machine learning, has opened a new era for the development of neural networks. The auto-encoder is a key component of deep structure, which can be used to realize transfer learning and plays an important role in both unsupervised learning and non-linear feature extraction. By highlighting the contributions and challenges of recent research papers, this work aims to review state-of-the-art auto-encoder algorithms. Firstly, we introduce the basic auto-encoder as well as its basic concept and structure. Secondly, we present a comprehensive summarization of different variants of the auto-encoder. Thirdly, we analyze and study auto-encoders from three different perspectives. We also discuss the relationships between auto-encoders, shallow models and other deep learning models. The auto-encoder and its variants have successfully been applied in a wide range of fields, such as pattern recognition, computer vision, data generation, recommender systems, etc. Then, we focus on the available toolkits for auto-encoders. Finally, this paper summarizes the future trends and challenges in designing and training auto-encoders. We hope that this survey will provide a good reference when using and designing AE models.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Autoencoders and their applications in machine learning: a survey
Kamal Berahmand,Fatemeh Daneshfar,Elaheh Sadat Salehi,Yuefeng Li,Yue Xu +4 more
TL;DR: A comprehensive survey of autoencoders is presented, starting with an explanation of the principle of conventional autoencoder and their primary development process, and a taxonomy of autoencoders based on their structures and principles is provided.
116
A comprehensive review of synthetic data generation in smart farming by using variational autoencoder and generative adversarial network
Yaganteeswarudu Akkem,Saroj Biswas,Aruna Varanasi +2 more
TL;DR: This study reviews the application of Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) for generating synthetic crop data, enhancing crop recommendation models with high-quality, realistic data, and improving their performance in agriculture.
49
Deep learning in computational mechanics: a review
Leon Herrmann,Stefan Kollmannsberger +1 more
TL;DR: This review focuses on deep learning methods rather than applications for computational mechanics, thereby enabling researchers to explore this field more effectively and help researchers identify key concepts and promising methodologies within this field.
42
Machine Learning Empowering Personalized Medicine: A Comprehensive Review of Medical Image Analysis Methods
Irena Galić,Marija Habijan,Hrvoje Leventic,Kresimir Romic +3 more
TL;DR: The types of learning problems commonly employed in medical image processing are introduced and an overview of commonly used deep learning methods are presented, including convolutional neural networks (CNNs), recurrent neural Networks (RNNs), and generative adversarial networks (GANs), with a focus on the image analysis task they are solving.
29
Deep Learning for Optical Sensor Applications: A Review
18 Jul 2023
TL;DR: In this article , the authors present recent studies integrating DL algorithms with optical sensor applications and highlight several directions for DL algorithms that promise a considerable impact on use for optical sensors applications, and provide new directions for the future development of related research.
16
References
Fusing Heterogeneous Features From Stacked Sparse Autoencoder for Histopathological Image Analysis
TL;DR: This paper employs a graph-based query-specific fusion approach where multiple retrieval results are integrated and reordered based on a fused graph, capable of combining the strengths of local or holistic features adaptively for different inputs.
93
Deep embedding clustering based on contractive autoencoder
TL;DR: Li et al. as mentioned in this paper proposed a deep embedding clustering framework based on contractive autoencoder (DECCA), which simultaneously disentangled the problem of learned representation by preserving important information from the initial data while pushing the original samples and their augmentations together in one hand.
90
•Proceedings Article
Regularized estimation of image statistics by Score Matching
Diederik P. Kingma,Yann L. Cun +1 more
- 06 Dec 2010
TL;DR: A regularization term is introduced for the Score Matching loss that enables its use for a broader range of problem by suppressing instabilities that occur with finite training sample sizes and quantized input values.
Unsupervised Learning Approach to Feature Analysis for Automatic Speech Emotion Recognition
Sefik Emre Eskimez,Zhiyao Duan,Wendi Heinzelman +2 more
- 19 Apr 2018
TL;DR: This work systematically investigate four kinds of unsupervised feature learning methods for improving speaker-independent ASER and shows that all methods improve the performance regarding unweighted accuracy rating (UAR) and Fl-score over methods that use hand-crafted features or that do not perform feature learning on external datasets.
84
Augmented Variational Autoencoders for Collaborative Filtering with Auxiliary Information
Wonsung Lee,Kyungwoo Song,Il-Chul Moon +2 more
- 06 Nov 2017
TL;DR: These two augmentations are the first trial in the venue of the variational autoencoders, and they demonstrate their significant improvement on the performances in the applications of the collaborative filtering.
78