A method for semantic-based image retrieval using hierarchical clustering tree and graph
01 Oct 2022
Vol. 20, Iss: 5, pp 1026-1026
2
TL;DR: In this article , a semantic-based image retrieval (SBIR) system is proposed based on the combination of growth partitioning tree (GP-Tree), which was built in the authors' previous work, with a self-organizing map (SOM) network and neighbor graph to improve accuracy.
read more
Abstract: Semantic extraction for images is an urgent problem and is applied in many different semantic retrieval systems. In this paper, a semantic-based image retrieval (SBIR) system is proposed based on the combination of growth partitioning tree (GP-Tree), which was built in the authors’ previous work, with a self-organizing map (SOM) network and neighbor graph (called SgGP-Tree) to improve accuracy. For each query image, a similar set of images is retrieved on the SgGP-Tree, and a set of visual words is extracted relying on the classes obtained from mask region-based convolutional neural networks (R-CNN), as the basis for querying semantic of input images on ontology by simple protocol and resource description framework query language (SPARQL) query. The experiment was performed on image datasets, such as ImageCLEF and MS-COCO, with precision values of 0.898453 and 0.875467, respectively. These results are compared with related works on the same image dataset, showing the effectiveness of the methods proposed.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Transforming image descriptions as a set of descriptors to construct classification features
Volodymyr Gorokhovatskyi,I. S. Tvoroshenko,Olena Yakovleva +2 more
TL;DR: The application of the system of orthogonal functions as an apparatus for the transformation of the description showed the possibility of a significant gain in the speed of processing while maintaining high indicators of classification accuracy and interference resistance.
4
Review on integration of ontology and deep learning in cultural heritage image retrieval
Fikri Budiman,Edi Sugiarto,Novi Hendriyanto +2 more
TL;DR: Image retrieval methods are evolving towards big data processing with cultural heritage domain as training and testing datasets. The focus is on processing big data with many classes, specifically cultural heritage images such as Indonesian Batik. Currently, research is evolving into knowledge-based image retrieval using ontologies due to semantic gap constraints.
References
Mask R-CNN
Kaiming He,Georgia Gkioxari,Piotr Dollár,Ross Girshick +3 more
- 20 Mar 2017
TL;DR: This work presents a conceptually simple, flexible, and general framework for object instance segmentation, which extends Faster R-CNN by adding a branch for predicting an object mask in parallel with the existing branch for bounding box recognition.
Deep Cauchy Hashing for Hamming Space Retrieval
Yue Cao,Mingsheng Long,Bin Liu,Jianmin Wang +3 more
- 01 Jun 2018
TL;DR: The main idea is to design a pairwise cross-entropy loss based on Cauchy distribution, which penalizes significantly on similar image pairs with Hamming distance larger than the given Hamming radius threshold.
Deep Binary Reconstruction for Cross-Modal Hashing
Di Hu,Feiping Nie,Xuelong Li +2 more
TL;DR: A novel multimodal deep binary reconstruction model is proposed, which can be trained to simultaneously model the correlation across modalities and learn the binary hashing codes, where the model can be easily optimized by a standard gradient descent optimizer.
165
Robust and Flexible Discrete Hashing for Cross-Modal Similarity Search
Di Wang,Quan Wang,Xinbo Gao +2 more
TL;DR: A novel hashing model is proposed to efficiently learn robust discrete binary codes, which is referred as Robust and Flexible Discrete Hashing (RFDH), which is directly learned based on discrete matrix decomposition so that the large quantization error caused by relaxation is avoided.
149
An effective content-based image retrieval technique for image visuals representation based on the bag-of-visual-words model
TL;DR: The qualitative and quantitative analysis performed on three image collections shows that proposed technique based on visual words fusion significantly improved the performance of the CBIR as compared to the feature fusion of both descriptors and state-of-the-art image retrieval techniques.