Image Matching from Handcrafted to Deep Features: A Survey
TL;DR: This survey introduces feature detection, description, and matching techniques from handcrafted methods to trainable ones and provides an analysis of the development of these methods in theory and practice, and briefly introduces several typical image matching-based applications.
read more
Abstract: As a fundamental and critical task in various visual applications, image matching can identify then correspond the same or similar structure/content from two or more images. Over the past decades, growing amount and diversity of methods have been proposed for image matching, particularly with the development of deep learning techniques over the recent years. However, it may leave several open questions about which method would be a suitable choice for specific applications with respect to different scenarios and task requirements and how to design better image matching methods with superior performance in accuracy, robustness and efficiency. This encourages us to conduct a comprehensive and systematic review and analysis for those classical and latest techniques. Following the feature-based image matching pipeline, we first introduce feature detection, description, and matching techniques from handcrafted methods to trainable ones and provide an analysis of the development of these methods in theory and practice. Secondly, we briefly introduce several typical image matching-based applications for a comprehensive understanding of the significance of image matching. In addition, we also provide a comprehensive and objective comparison of these classical and latest techniques through extensive experiments on representative datasets. Finally, we conclude with the current status of image matching technologies and deliver insightful discussions and prospects for future works. This survey can serve as a reference for (but not limited to) researchers and engineers in image matching and related fields.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Synthetic feature pairs dataset and siamese convolutional model for image matching
Houssam Halmaoui,Abdelkrim Haqiq +1 more
TL;DR: In this article , a large synthetic dataset of feature pairs, similar and different, in order to perform description and matching of the detected features was created, thanks to a siamese convolutional model.
2
Progressive matching method of aerial-ground remote sensing image via multi-scale context feature coding
TL;DR: A progressive matching method via multi-scale context feature coding network is proposed to achieve robust matching of aerial-ground remote sensing images, which provides better technical support for urban modelling.
2
Vehicle-Borne Multi-Sensor Temporal–Spatial Pose Globalization via Cross-Domain Data Association
TL;DR: This work proposes a novel pipeline for vehicle-borne camera and LiDAR temporal and spatial pose globalization with the guidance of Global Navigation Satellite System/Inertial Measurement Unit (GNSS/IMU), where both of the assumptions on strict synchronization and exact calibration are loosened.
2
Learning-Based Dimensionality Reduction for Computing Compact and Effective Local Feature Descriptors
29 May 2023
TL;DR: In this article , a multi-layer perceptrons (MLP) was used to extract low-dimensional but high-quality descriptors for image matching, image retrieval, and visual localization.
2
A Confounder-Free Fusion Network for Aerial Image Scene Feature Representation
Wei Xiong,Zhenyu Xiong,Yaqi Cui +2 more
TL;DR: The proposed CFF-NET achieves reasonable and state-of-the-art results, including high-level tasks such as aerial image captioning, and eliminates the spurious and biased visual relationships of the image on the object level.
2
References
Distinctive Image Features from Scale-Invariant Keypoints
TL;DR: This paper presents a method for extracting distinctive invariant features from images that can be used to perform reliable matching between different views of an object or scene and can robustly identify objects among clutter and occlusion while achieving near real-time performance.
Generative Adversarial Nets
Ian Goodfellow,Jean Pouget-Abadie,Mehdi Mirza,Bing Xu,David Warde-Farley,Sherjil Ozair,Aaron Courville,Yoshua Bengio +7 more
- 08 Dec 2014
TL;DR: A new framework for estimating generative models via an adversarial process, in which two models are simultaneously train: a generative model G that captures the data distribution and a discriminative model D that estimates the probability that a sample came from the training data rather than G.
Histograms of oriented gradients for human detection
Navneet Dalal,Bill Triggs +1 more
- 20 Jun 2005
TL;DR: It is shown experimentally that grids of histograms of oriented gradient (HOG) descriptors significantly outperform existing feature sets for human detection, and the influence of each stage of the computation on performance is studied.
A Computational Approach to Edge Detection
TL;DR: There is a natural uncertainty principle between detection and localization performance, which are the two main goals, and with this principle a single operator shape is derived which is optimal at any scale.
29.9K
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography
TL;DR: New results are derived on the minimum number of landmarks needed to obtain a solution, and algorithms are presented for computing these minimum-landmark solutions in closed form that provide the basis for an automatic system that can solve the Location Determination Problem under difficult viewing.