Auto-Encoders in Deep Learning—A Review with New Perspectives
Shuangshuang Chen,Wei Guo +1 more
TL;DR: The auto-encoder is a key component of deep structure, which can be used to realize transfer learning and plays an important role in both unsupervised learning and non-linear feature extraction as mentioned in this paper .
read more
Abstract: Deep learning, which is a subfield of machine learning, has opened a new era for the development of neural networks. The auto-encoder is a key component of deep structure, which can be used to realize transfer learning and plays an important role in both unsupervised learning and non-linear feature extraction. By highlighting the contributions and challenges of recent research papers, this work aims to review state-of-the-art auto-encoder algorithms. Firstly, we introduce the basic auto-encoder as well as its basic concept and structure. Secondly, we present a comprehensive summarization of different variants of the auto-encoder. Thirdly, we analyze and study auto-encoders from three different perspectives. We also discuss the relationships between auto-encoders, shallow models and other deep learning models. The auto-encoder and its variants have successfully been applied in a wide range of fields, such as pattern recognition, computer vision, data generation, recommender systems, etc. Then, we focus on the available toolkits for auto-encoders. Finally, this paper summarizes the future trends and challenges in designing and training auto-encoders. We hope that this survey will provide a good reference when using and designing AE models.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Autoencoders and their applications in machine learning: a survey
Kamal Berahmand,Fatemeh Daneshfar,Elaheh Sadat Salehi,Yuefeng Li,Yue Xu +4 more
TL;DR: A comprehensive survey of autoencoders is presented, starting with an explanation of the principle of conventional autoencoder and their primary development process, and a taxonomy of autoencoders based on their structures and principles is provided.
116
A comprehensive review of synthetic data generation in smart farming by using variational autoencoder and generative adversarial network
Yaganteeswarudu Akkem,Saroj Biswas,Aruna Varanasi +2 more
TL;DR: This study reviews the application of Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) for generating synthetic crop data, enhancing crop recommendation models with high-quality, realistic data, and improving their performance in agriculture.
49
Deep learning in computational mechanics: a review
Leon Herrmann,Stefan Kollmannsberger +1 more
TL;DR: This review focuses on deep learning methods rather than applications for computational mechanics, thereby enabling researchers to explore this field more effectively and help researchers identify key concepts and promising methodologies within this field.
42
Machine Learning Empowering Personalized Medicine: A Comprehensive Review of Medical Image Analysis Methods
Irena Galić,Marija Habijan,Hrvoje Leventic,Kresimir Romic +3 more
TL;DR: The types of learning problems commonly employed in medical image processing are introduced and an overview of commonly used deep learning methods are presented, including convolutional neural networks (CNNs), recurrent neural Networks (RNNs), and generative adversarial networks (GANs), with a focus on the image analysis task they are solving.
29
Deep Learning for Optical Sensor Applications: A Review
18 Jul 2023
TL;DR: In this article , the authors present recent studies integrating DL algorithms with optical sensor applications and highlight several directions for DL algorithms that promise a considerable impact on use for optical sensors applications, and provide new directions for the future development of related research.
16
References
Independent Component Analysis.
Seungjin Choi
- 01 Jan 2009
TL;DR: In this article, the independent component analysis (ICA) is used to find an estimate of an unmixing matrix Γ such that Γx has independent components in the IC model.
3.3K
A survey of deep neural network architectures and their applications
TL;DR: This work was supported in part by the Royal Society of the UK, the National Natural Science Foundation of China, and the Alexander von Humboldt Foundation of Germany.
3.2K
Improving the fisher kernel for large-scale image classification
Florent Perronnin,Jorge Sanchez,Thomas Mensink +2 more
- 05 Sep 2010
TL;DR: In an evaluation involving hundreds of thousands of training images, it is shown that classifiers learned on Flickr groups perform surprisingly well and that they can complement classifier learned on more carefully annotated datasets.
Updating Quasi-Newton Matrices With Limited Storage
TL;DR: An update formula which generates matrices using information from the last m iterations, where m is any number supplied by the user, and the BFGS method is considered to be the most efficient.
3K
What is the best multi-stage architecture for object recognition?
Kevin Jarrett,Koray Kavukcuoglu,Marc'Aurelio Ranzato,Yann LeCun +3 more
- 01 Sep 2009
TL;DR: It is shown that using non-linearities that include rectification and local contrast normalization is the single most important ingredient for good accuracy on object recognition benchmarks and that two stages of feature extraction yield better accuracy than one.