SAR Ship Detection Dataset (SSDD) is the first open dataset that is widely used to research state-of-the-art technology of ship detection from Synthetic Aperture Radar (SAR) imagery based on deep learning (DL). According to our investigation, up to 46.59% of the total 161 public reports confidently select SSDD to study DL-based SAR ship detection. Undoubtedly, this situation reveals the popularity and great influence of SSDD in the SAR remote sensing community. Nevertheless, the coarse annotations and ambiguous standards of use of its initial version both hinder fair methodological comparisons and effective academic exchanges. Additionally, its single-function horizontal-vertical rectangle bounding box (BBox) labels can no longer satisfy the current research needs of the rotatable bounding box (RBox) task and the pixel-level polygon segmentation task. Therefore, to address the above two dilemmas, in this review, advocated by the publisher of SSDD, we will make an official release of SSDD based on its initial version. SSDD’s official release version will cover three types: (1) a bounding box SSDD (BBox-SSDD), (2) a rotatable bounding box SSDD (RBox-SSDD), and (3) a polygon segmentation SSDD (PSeg-SSDD). We relabel ships in SSDD more carefully and finely, and then explicitly formulate some strict using standards, e.g., (1) the training-test division determination, (2) the inshore-offshore protocol, (3) the ship-size reasonable definition, (4) the determination of the densely distributed small ship samples, and (5) the determination of the densely parallel berthing at ports ship samples. These using standards are all formulated objectively based on the using differences of existing 75 (161 × 46.59%) public reports. They will be beneficial for fair method comparison and effective academic exchanges in the future. Most notably, we conduct a comprehensive data analysis on BBox-SSDD, RBox-SSDD, and PSeg-SSDD. Our analysis results can provide some valuable suggestions for possible future scholars to further elaborately design DL-based SAR ship detectors with higher accuracy and stronger robustness when using SSDD.

SAR Ship Detection Dataset (SSDD): Official Release and Comprehensive Data Analysis

Due to its great application value in the military and civilian fields, ship detection in synthetic aperture radar (SAR) images has always attracted much attention. However, ship targets in High-Resolution (HR) SAR images show the significant characteristics of multi-scale, arbitrary directions and dense arrangement, posing enormous challenges to detect ships quickly and accurately. To address these issues above, a novel YOLO-based arbitrary-oriented SAR ship detector using bi-directional feature fusion and angular classification (BiFA-YOLO) is proposed in this article. First of all, a novel bi-directional feature fusion module (Bi-DFFM) tailored to SAR ship detection is applied to the YOLO framework. This module can efficiently aggregate multi-scale features through bi-directional (top-down and bottom-up) information interaction, which is helpful for detecting multi-scale ships. Secondly, to effectively detect arbitrary-oriented and densely arranged ships in HR SAR images, we add an angular classification structure to the head network. This structure is conducive to accurately obtaining ships’ angle information without the problem of boundary discontinuity and complicated parameter regression. Meanwhile, in BiFA-YOLO, a random rotation mosaic data augmentation method is employed to suppress the impact of angle imbalance. Compared with other conventional data augmentation methods, the proposed method can better improve detection performance of arbitrary-oriented ships. Finally, we conduct extensive experiments on the SAR ship detection dataset (SSDD) and large-scene HR SAR images from GF-3 satellite to verify our method. The proposed method can reach the detection performance with precision = 94.85%, recall = 93.97%, average precision = 93.90%, and F1-score = 0.9441 on SSDD. The detection speed of our method is approximately 13.3 ms per 512 × 512 image. In addition, comparison experiments with other deep learning-based methods and verification experiments on large-scene HR SAR images demonstrate that our method shows strong robustness and adaptability.

BiFA-YOLO: A Novel YOLO-Based Method for Arbitrary-Oriented Ship Detection in High-Resolution SAR Images

After the revival of deep learning in computer vision in 2012, SAR ship detection comes into the deep learning era too. The deep learning-based computer vision algorithms can work in an end-to-end pipeline, without the need of designing features manually, and they have amazing performance. As a result, it is also used to detect ships in SAR images. The beginning of this direction is the paper we published in 2017BIGSARDATA, in which the first dataset SSDD was used and shared with peers. Since then, lots of researchers focus their attention on this field. In this paper, we analyze the past, present, and future of the deep learning-based ship detection algorithms in SAR images. In the past section, we analyze the difference between traditional CFAR (constant false alarm rate) based and deep learning-based detectors through theory and experiment. The traditional method is unsupervised while the deep learning is strongly supervised, and their performance varies several times. In the present part, we analyze the 177 published papers about SAR ship detection. We highlight the dataset, algorithm, performance, deep learning framework, country, timeline, etc. After that, we introduce the use of single-stage, two-stage, anchor-free, train from scratch, oriented bounding box, multi-scale, and real-time detectors in detail in the 177 papers. The advantages and disadvantages of speed and accuracy are also analyzed. In the future part, we list the problem and direction of this field. We can find that, in the past five years, the AP50 has boosted from 78.8% in 2017 to 97.8 % in 2022 on SSDD. Additionally, we think that researchers should design algorithms according to the specific characteristics of SAR images. What we should do next is to bridge the gap between SAR ship detection and computer vision by merging the small datasets into a large one and formulating corresponding standards and benchmarks. We expect that this survey of 177 papers can make people better understand these algorithms and stimulate more research in this field. 

/pdf/deep-learning-for-sar-ship-detection-past-present-and-future-3czwsurl.pdf

Deep Learning for SAR Ship Detection: Past, Present and Future

Due to the advantages of all-weather capability and high resolution, synthetic aperture radar (SAR) image ship detection has been widely applied in the military, civilian, and other domains. However, SAR-based ship detection suffers from limitations such as strong scattering of targets, multiple scales, and background interference, leading to low detection accuracy. To address these limitations, this paper presents a novel SAR ship detection method, NAS-YOLOX, which leverages the efficient feature fusion of the neural architecture search feature pyramid network (NAS-FPN) and the effective feature extraction of the multi-scale attention mechanism. Specifically, NAS-FPN replaces the PAFPN in the baseline YOLOX, greatly enhances the fusion performance of the model’s multi-scale feature information, and a dilated convolution feature enhancement module (DFEM) is designed and integrated into the backbone network to improve the network’s receptive field and target information extraction capabilities. Furthermore, a multi-scale channel-spatial attention (MCSA) mechanism is conceptualised to enhance focus on target regions, improve small-scale target detection, and adapt to multi-scale targets. Additionally, extensive experiments conducted on benchmark datasets, HRSID and SSDD, demonstrate that NAS-YOLOX achieves comparable or superior performance compared to other state-of-the-art ship detection models and reaches best accuracies of 91.1% and 97.2% on AP0.5, respectively. 

NAS-YOLOX: a SAR ship detection using neural architecture search and multi-scale attention

Recently, deep learning techniques have been extensively used to detect ships in synthetic aperture radar (SAR) images. The majority of modern algorithms can achieve successful ship detection outcomes when working with multiple-scale ships on a large sea surface. However, there are still issues, such as missed detection and incorrect identification when performing multi-scale ship object detection operations in SAR images of complex scenes. To solve these problems, this paper proposes a complex scenes multi-scale ship detection model, according to YOLOv7, called CSD-YOLO. First, this paper suggests an SAS-FPN module that combines atrous spatial pyramid pooling and shuffle attention, allowing the model to focus on important information and ignore irrelevant information, reduce the feature loss of small ships, and simultaneously fuse the feature maps of ship targets on various SAR image scales, thereby improving detection accuracy and the model’s capacity to detect objects at several scales. The model’s optimization is then improved with the aid of the SIoU loss function. Finally, thorough tests on the HRSID and SSDD datasets are presented to support our methodology. CSD-YOLO achieves better detection performance than the baseline YOLOv7, with a 98.01% detection accuracy, a 96.18% recall, and a mean average precision (mAP) of 98.60% on SSDD. In addition, in comparative experiments with other deep learning-based methods, in terms of overall performance, CSD-YOLO still performs better.

/pdf/multi-scale-ship-detection-algorithm-based-on-yolov7-for-1kriow4n.pdf

Multi-Scale Ship Detection Algorithm Based on YOLOv7 for Complex Scene SAR Images

With the rapid development of earth observation technology, high-resolution synthetic aperture radar (HR SAR) imaging satellites could provide more observational information for maritime surveillance. However, there are still some problems to detect ship targets in HR SAR images due to the complex surroundings, targets defocusing, and diversity of the scales. In this article, an anchor-free method is proposed for ship target detection in HR SAR images. First, fully convolutional one-stage object detection (FCOS) as the base network is applied to detect ship targets, achieving better detection performance through pixel-by-pixel prediction of the image. Second, the category-position (CP) module is proposed to optimize the position regression branch features in the FCOS network. This module can improve target positioning performance in complex scenes by generating guidance vector from the classification branch features. At the same time, target classification and boundary box regression methods are redesigned to shield the adverse effects of fuzzy areas in the network training. Finally, to evaluate the effectiveness of CP-FCOS, extensive experiments are conducted on High-Resolution SAR Images Dataset, SAR Ship Detection Dataset, IEEE 2020 Gaofen Challenge SAR dataset, and two complex large-scene HR SAR images. The experimental results show that our method can obtain encouraging detection performance compared with Faster-RCNN, RetinaNet, and FCOS. Remarkably, the proposed method was applied to SAR ship detection in the 2020 Gaofen Challenge. Our team ranked first among 292 teams in the preliminary contest and won seventh place in the final match.

An Anchor-Free Detection Method for Ship Targets in High-Resolution SAR Images

Deep learning has offered new ideas in SAR ship target recognition. Although many methods improve the recognition performance through the improvement of loss function and migration of deep networks, scattering features as the important intrinsic features of SAR targets, need to be considered in the SAR ship recognition tasks. To introduce the scattering features into the deep network and characterize the features of ship targets more comprehensively, a multiscale global scattering feature association network (MGSFA-Net) for SAR ship target recognition is proposed in this article. In the network, the SAR ship target is first separated from the background by fine target segmentation. Then, the scattering centers (SCs) of ship targets are extracted and converted to local graph structures based on the $k$-nearest neighbors algorithm. The local graph structures are associated by the scattering center feature association module and enhanced by the multiscale feature enhancement module to produce the multiscale global scattering features. Moreover, the deep features of the targets are extracted by the multikernel deep feature extraction module to characterize the high-dimensional information. Finally, the scattering features and deep features are fused by weighted integration to enrich the diversity of features. The experimental results on the FUSAR-Ship and OpenSARShip dataset show that the MGSFA-Net can significantly improve the recognition performance, even on a few-shot condition with the accuracy increasing over 2%–3%. The feature distribution and visualization show the effectiveness of the MGSFA-Net to characterize the multiscale global scattering association features.

MGSFA-Net: Multi-Scale Global Scattering Feature Association Network for SAR Ship Target Recognition

SAR ship detection and recognition are important components of the application of SAR data interpretation, allowing for the continuous, reliable, and efficient monitoring of maritime ship targets, in view of the present situation of SAR interpretation applications. On the one hand, because of the lack of high-quality datasets, most existing research on SAR ships is focused on target detection. Additionally, there have been few studies on integrated ship detection and recognition in complex SAR images. On the other hand, the development of deep learning technology promotes research on the SAR image intelligent interpretation algorithm to some extent. However, most existing algorithms only focus on target recognition performance and ignore the model’s size and computational efficiency. Aiming to solve the above problems, a lightweight model for ship detection and recognition in complex-scene SAR images is proposed in this paper. Firstly, in order to comprehensively improve the detection performance and deployment capability, this paper applies the YOLOv5-n lightweight model as the baseline algorithm. Secondly, we redesign and optimize the pyramid pooling structure to effectively enhance the target feature extraction efficiency and improve the algorithm’s operation speed. Meanwhile, to suppress the influence of complex background interference and ships’ distribution, we integrate different attention mechanism into the target feature extraction layer. In addition, to improve the detection and recognition performance of densely parallel ships, we optimize the structure of the model’s prediction layer by adding an angular classification module. Finally, we conducted extensive experiments on the newly released complex-scene SAR image ship detection and recognition dataset, named the SRSDDv1.0 dataset. The experimental results show that the minimum size of the model proposed in this paper is only 1.92 M parameters and 4.52 MB of model memory, which can achieve an excellent F1-Score performance of 61.26 and an FPS performance of 68.02 on the SRSDDv1.0 dataset.

/pdf/a-lightweight-model-for-ship-detection-and-recognition-in-2qi9dvwy.pdf

A Lightweight Model for Ship Detection and Recognition in Complex-Scene SAR Images

Ship recognition in synthetic aperture radar (SAR) is an essential challenge in SAR image interpretation. The measured SAR ship targets often contain complex backgrounds such as port facilities and neighboring ships, which are easy to interfere with the model and affect the recognition performance. To address this issue, a SAR ship recognition method with a complex background based on a dual-branch transformer fusion network is proposed in this letter. First of all, a dual-branch feature extraction and fusion architecture is designed in this letter, including significant feature extraction (SFE), global feature extraction (GFE), and dual-branch feature fusion (D-BFF). Specifically, the SFE effectively extracts the most discriminative local fine-grained features of the ship target using multilayer convolution of significant regions. The GFE captures global semantic information by residual module optimization. In addition, combined with the self-attention in the transformer block based on cross-attention and position encoding, the effective fusion of SFE and GFE is realized in D-BFF. Finally, extensive experiments are carried out based on the Gaofen-3 seven-category dataset (anyone can get the dataset after sending the application e-mail). The results reveal that the proposed method can achieve a recognition accuracy of 75.55%, which is significantly superior to other algorithms.

Ship Recognition for Complex SAR images via Dual-Branch Transformer Fusion Network

Popular Tasks used by Researchers

How can I help with your research?

Get more enhanced response by uploading the PDFs you want me to reference.

No relevant PDFs in your library

SciSpace is the AI research assistant for academics. Run systematic literature reviews on 280M+ papers, and write papers with cited sources. Trusted by 1M+ students, PhDs & researchers.

SciSpace | AI for Research

We encountered an error while loading the panel. Please try refreshing the page.

Something went wrong

Analyze PDFs

Code & Manuscripts

Funding & Grants

Literature & Patents

Medical & Clinical Data

Systematic Review

Visualize & Present

Web & Data

Build a Google Scholar-like website for your research.

Build a website

Create charts and images for your research

Create a Chart

Write a paper for submission to a journal

Draft a manuscript

Patent Search

Design eye-catching scientific posters in minutes.

Scientific Poster Generation

Systematic Literature Review

Anyone with the link can view this chat. You can switch it back to private anytime.

One task is running at the moment. Your messages will be shown right after.

Drag and drop or click here to browse

Loved by <highlight>1 million+</highlight> researchers

Extract a list of specific topics and their sources from unstructured text

Topics

Compare and analyze relevant papers that matches with your search

Papers

Get insights from PDFs and bookmarked papers from your library

My library

Recent searches

Try searching for:

Catch AI-generated content in scholarly and non-scholarly content

{ai} Detector

Ai Writer

Get PDF Summaries, highlighted text explanations 

Chat with PDF

Effortlessly create in-text citations and bibliographies in APA and 2,500 other formats

Citation generator

Get explanations, summaries, and answers on academic papers

Ease up your research workflow with {scispace}'s cohort of exciting AI tools

Elevate your academic writing skills and convey your ideas the way you want

Paraphraser

Explore our range of reading and writing tools

Your file is being prepared and should be ready in a few minutes. If it's a large file, it might take a bit longer. You can close this window, and we'll email you the file when it's done.

You have reached a maximum limit of <strong>{limit}</strong> columns in the table. Remove at least <strong>1</strong> column to add or create another one.

Zhongzhen Sun

Author Tools

Chat about Author