TL;DR: Wang et al. as mentioned in this paper proposed a Feature Decomposition and Reconstruction Learning (FDRL) method for effective facial expression recognition, which consists of two crucial networks: a Feature decomposition Network (FDN) and a Feature Reconstruction Network (FRN).
Abstract: In this paper, we propose a novel Feature Decomposition and Reconstruction Learning (FDRL) method for effective facial expression recognition. We view the expression information as the combination of the shared information (expression similarities) across different expressions and the unique information (expression-specific variations) for each expression. More specifically, FDRL mainly consists of two crucial networks: a Feature Decomposition Network (FDN) and a Feature Reconstruction Network (FRN). In particular, FDN first decomposes the basic features extracted from a backbone network into a set of facial action-aware latent features to model expression similarities. Then, FRN captures the intra-feature and inter-feature relationships for la-tent features to characterize expression-specific variations, and reconstructs the expression feature. To this end, two modules including an intra-feature relation modeling module and an inter-feature relation modeling module are developed in FRN. Experimental results on both the in-the-lab databases (including CK+, MMI, and Oulu-CASIA) and the in-the-wild databases (including RAF-DB and SFEW) show that the proposed FDRL method consistently achieves higher recognition accuracy than several state-of-the-art methods. This clearly highlights the benefit of feature decomposition and reconstruction for classifying expressions.
TL;DR: Investigating tissue expression difference between mRNAs and lncRNAs revealed the heterogeneous expression pattern of lncRNA and mRNA and gave rise to the development of a new tool to identify the potential biological functions of such RNA subgroups.
Abstract: Messenger RNA (mRNA) and long noncoding RNA (lncRNA) are two main subgroups of RNAs participating in transcription regulation. With the development of next generation sequencing, increasing lncRNAs are identified. Many hidden functions of lncRNAs are also revealed. However, the differences in lncRNAs and mRNAs are still unclear. For example, we need to determine whether lncRNAs have stronger tissue specificity than mRNAs and which tissues have more lncRNAs expressed. To investigate such tissue expression difference between mRNAs and lncRNAs, we encoded 9339 lncRNAs and 14,294 mRNAs with 71 expression features, including 69 maximum expression features for 69 types of cells, one feature for the maximum expression in all cells, and one expression specificity feature that was measured as Chao-Shen-corrected Shannon's entropy. With advanced feature selection methods, such as maximum relevance minimum redundancy, incremental feature selection methods, and random forest algorithm, 13 features presented the dissimilarity of lncRNAs and mRNAs. The 11 cell subtype features indicated which cell types of the lncRNAs and mRNAs had the largest expression difference. Such cell subtypes may be the potential cell models for lncRNA identification and function investigation. The expression specificity feature suggested that the cell types to express mRNAs and lncRNAs were different. The maximum expression feature suggested that the maximum expression levels of mRNAs and lncRNAs were different. In addition, the rule learning algorithm, repeated incremental pruning to produce error reduction algorithm, was also employed to produce effective classification rules for classifying lncRNAs and mRNAs, which gave competitive results compared with random forest and could give a clearer picture of different expression patterns between lncRNAs and mRNAs. Results not only revealed the heterogeneous expression pattern of lncRNA and mRNA, but also gave rise to the development of a new tool to identify the potential biological functions of such RNA subgroups.
TL;DR: This paper proposes and optimizes a new LGC operator based on horizontal and diagonal gradient prior principle (LGC-HD), which has a significant advantage in the recognition accuracy and run time.
TL;DR: For the recognition of facial expression images, the proposed method based on the fusion LBP expression features and convolutional neural network expression features is used to obtain the best performance of 91.28% in the comparative experiment.
Abstract: Aiming at the disadvantages of the traditional machine-based facial expression recognition method that eliminates the feature of manual selection, a feature extraction method based on deep convolutional neural network to learn expression features is proposed. Since the deep convolutional neural network can directly use the original image as the input image, the image abstract feature interpretation is obtained at the fully connected layer of the image, which avoids the inherent error of image preprocessing and artificial selection features. Then, we reconstruct the traditional local binary pattern (LBP) feature operator for facial expression image and fuse the abstract facial expression features learned by the deep convolution neural network with the modified LBP facial expression texture features in the full connection layer. A new facial expression feature can be obtained, and the classification accuracy can be improved. In general, for the recognition of facial expression images, the proposed method based on the fusion LBP expression features and convolutional neural network expression features is used to obtain the best performance of 91.28% in the comparative experiment. An efficient extension of the expression feature texture expression channel is carried out. On the other hand, convolutional neural networks have incomparable advantages over other methods in abstract information representation of two-dimensional images.
TL;DR: A method of expression-invariant face recognition that transforms input face image with an arbitrary expression into its corresponding neutral facial expression image by the distance-based matching technique.