Automated Vehicles (AVs) are attracting attention as a safer mobility option thanks to the recent advancement of various sensing technologies that realize a much quicker Perception–Reaction Time than Human-Driven Vehicles (HVs). However, AVs are not entirely free from the risk of accidents, and we currently lack a systematic and reliable method to improve AV safety functions. The manual composition of accident scenarios does not scale. Simulation-based methods do not fully cover the peculiar AV accident patterns that can occur in the real world. Artificial Intelligence (AI) techniques are employed to identify the moments of accidents from ego-vehicle videos. However, most AI-based approaches fall short in accounting for the probable causes of the accidents. Neither of these AI-driven methods offer details for authoring accident scenarios used for AV safety testing. In this paper, we present a customized Vision Transformer (named ViT-TA) that accurately classifies the critical situations around traffic accidents and automatically points out the objects as probable causes based on an Attention map. Using 24,740 frames from Dashcam Accident Dataset (DAD) as training data, ViT-TA detected critical moments at Time-To-Collision (TTC) ≤ 1 s with 34.92 higher accuracy than the state-of-the-art approach. ViT-TA’s Attention map highlighting the critical objects helped us understand how the situations unfold to put the hypothetical ego vehicles with AV functions at risk. Based on the ViT-TA-assisted interpretation, we systematized the composition of Functional scenarios conceptualized by the PEGASUS project for describing a high-level plan to improve AVs’ capability of evading critical situations. We propose a novel framework for automatically deriving Logical and Concrete scenarios specified with 6-Layer situational variables defined by the PEGASUS project. We believe our work is vital towards systematically generating highly reliable and trustworthy safety improvement plans for AVs in a scalable manner. 

/pdf/vision-transformer-for-detecting-critical-situations-and-3d6gvwjk.pdf

Vision Transformer for Detecting Critical Situations and Extracting Functional Scenario for Automated Vehicle Safety Assessment

Safety assessment is an active research subject for autonomous vehicles (AVs) that have emerged as a new mode of mobility. In particular, scenario-based safety assessments have garnered significant attention. AVs can be tested on how they safely avoid hypothetical situations leading to accidents. However, scenarios written by humans based on their expert knowledge and experience may only partially reflect real-world situations. Instead, we are keen on a different technique of extracting statistically significant and more detailed scenarios from sensor data captured during the critical moments when AVs become vulnerable to potential accidents. Specifically, we first render the three-dimensional space around an AV with fixed-sized voxels. Then, we modeled the aggregate kinetics of the objects in each voxel detected by 3D-LiDAR sensors mounted on real test AVs. The Vision Transformer we used to model the kinetics helped us quickly pinpoint critical voxels containing objects that threatened the AV’s safety. We traced the trajectory of the critical voxels on a visual attention map to describe in detail how AVs become vulnerable to accidents according to the logical scenario format defined by the PEGASUS Project. We tested our novel method with 250 h of 3D-LiDAR recordings capturing critical moments. We devised an inference model that detected critical situations with an F1-score of 98.26%. For each type of scenario, our model consistently identified the critical objects and their tendency to influence AVs. Given the evaluation results, we can ensure that our data-driven approach yields an AV safety assessment scenario with high representativeness, coverage, expansion, and computational feasibility. 

Critical voxel learning with vision transformer and derivation of logical AV safety assessment scenarios

To suppress inertial navigation system drift and improve the seamless navigation capability of microelectromechanical system-inertial navigation systems/geomagnetic navigation systems (MEMS-INS/MNS) in geomagnetically unlocked environments, this paper proposes a hybrid seamless MEMS-INS/MNS strategy combining a strongly tracked square-root cubature Kalman filter with deep self-learning (DSL-STSRCKF). The proposed DSL-STSRCKF method consists of two innovative steps: (i) The relationship between the deep Kalman filter gain and the optimal estimation is established. In this paper, combining the two auxiliary methods of strong tracking filtering and square-root filtering based on singular value decomposition, the heading accuracy error of ST-SRCKF can reach 1.29°, which improves the heading accuracy by 90.10% and 9.20% compared to the traditional single INS and the traditional integrated navigation algorithm and greatly improves the robustness and computational efficiency. (ii) Providing deep self-learning capability for the ST-SRCKF by introducing a nonlinear autoregressive neural network (NARX) with exogenous inputs, which means that the heading accuracy can still reach 1.33° even during the MNS lockout period, and the heading accuracy can be improved by 89.80% compared with the single INS, realizing the continuous high-precision navigation estimation.

Seamless MEMS-INS/Geomagnetic Navigation System Based on Deep-Learning Strong Tracking Square-Root Cubature Kalman Filter

In this paper, a method for detecting real-time images that include counterlight produced by the sun, is proposed. It involves applying a multistep analysis of the size, location, and distribution of bright areas in the image. In general, images containing counterlight have a symmetrically high brightness value at a specific location spread over an extremely large region. In addition, the distribution and change in brightness in that specific region have a symmetrically large difference compared with other regions. Through a multistep analysis of these symmetrical features, it is determined whether counterlight is included in the image. The proposed method presents a processing time of approximately 0.7 s and a detection accuracy of 88%, suggesting that the approach can be applied to a safe driving support system for autonomous vehicles.

Detection of Road Images Containing a Counterlight Using Multilevel Analysis

Unmanned motion platforms are being used in a wide range of industries. Unmanned motion platforms must have an autonomous and intelligent navigation procedure in order to carry out their system functions. Traditional inertial navigation and radio navigation have poor accuracy and autonomy when not dependent on satellite circumstances. The accuracy of image recognition algorithms must meet strict standards. This study and exploration of the high-precision scene image recognition system is based on convolutional neural network structure optimization. To demonstrate the viability of the approach, simulation experiments are carried out on the NUC dataset using the recognition technique based on a convolutional neural network that is proposed. The fundamental network architecture of a convolutional neural network is optimized using the L2 regularization technique. The experimental findings demonstrate that the NUC dataset now has better recognition accuracy. In terms of recognition accuracy, the suggested method satisfies the predetermined requirements.

Image Processing Method of a Visual Communication System Based on Convolutional Neural Network

As automated vehicles have been considered one of the important trends in intelligent transportation systems, various research is being conducted to enhance their safety. In particular, the importance of technologies for the design of preventive automated driving systems, such as detection of surrounding objects and estimation of distance between vehicles. Object detection is mainly performed through cameras and LiDAR, but due to the cost and limits of LiDAR’s recognition distance, the need to improve Camera recognition technique, which is relatively convenient for commercialization, is increasing. This study learned convolutional neural network (CNN)-based faster regions with CNN (Faster R-CNN) and You Only Look Once (YOLO) V2 to improve the recognition techniques of vehicle-mounted monocular cameras for the design of preventive automated driving systems, recognizing surrounding vehicles in black box highway driving videos and estimating distances from surrounding vehicles through more suitable models for automated driving systems. Moreover, we learned the PASCAL visual object classes (VOC) dataset for model comparison. Faster R-CNN showed similar accuracy, with a mean average precision (mAP) of 76.4 to YOLO with a mAP of 78.6, but with a Frame Per Second (FPS) of 5, showing slower processing speed than YOLO V2 with an FPS of 40, and a Faster R-CNN, which we had difficulty detecting. As a result, YOLO V2, which shows better performance in accuracy and processing speed, was determined to be a more suitable model for automated driving systems, further progressing in estimating the distance between vehicles. For distance estimation, we conducted coordinate value conversion through camera calibration and perspective transform, set the threshold to 0.7, and performed object detection and distance estimation, showing more than 80% accuracy for near-distance vehicles. Through this study, it is believed that it will be able to help prevent accidents in automated vehicles, and it is expected that additional research will provide various accident prevention alternatives such as calculating and securing appropriate safety distances, depending on the vehicle types.

https://www.mdpi.com/2079-9292/10/14/1737/pdf

The Design of Preventive Automated Driving Systems Based on Convolutional Neural Network

Handle everyday research tasks with reliable, citation-backed results

Your personal Research Agent to handle research tasks with citation-backed results

Popular Tasks used by Researchers

How can I help with your research?

Meet SciSpace

Get more enhanced response by uploading the PDFs you want me to reference.

No relevant PDFs in your library

SciSpace is the AI research assistant for academics. Run systematic literature reviews on 280M+ papers, and write papers with cited sources. Trusted by 1M+ students, PhDs & researchers.

SciSpace | AI for Research

Analyze PDFs

Code & Manuscripts

Funding & Grants

Literature & Patents

Medical & Clinical Data

Systematic Review

Visualize & Present

Web & Data

Build a Google Scholar-like website for your research.

Build a website

Create charts and images for your research

Create a Chart

Write a paper for submission to a journal

Draft a manuscript

Patent Search

Design eye-catching scientific posters in minutes.

Scientific Poster Generation

Systematic Literature Review

One task is running at the moment. Your messages will be shown right after.

Drag and drop or click here to browse

Loved by <highlight>1 million+</highlight> researchers

Extract a list of specific topics and their sources from unstructured text

Topics

Compare and analyze relevant papers that matches with your search

Papers

Get insights from PDFs and bookmarked papers from your library

My library

Recent searches

Try searching for:

Catch AI-generated content in scholarly and non-scholarly content

{ai} Detector

Ai Writer

Get PDF Summaries, highlighted text explanations 

Chat with PDF

Effortlessly create in-text citations and bibliographies in APA and 2,500 other formats

Citation generator

Get explanations, summaries, and answers on academic papers

Ease up your research workflow with {scispace}'s cohort of exciting AI tools

Elevate your academic writing skills and convey your ideas the way you want

Paraphraser

Explore our range of reading and writing tools

Your file is being prepared and should be ready in a few minutes. If it's a large file, it might take a bit longer. You can close this window, and we'll email you the file when it's done.

You have reached a maximum limit of <strong>{limit}</strong> columns in the table. Remove at least <strong>1</strong> column to add or create another one.

Wooseop Lee

Author Tools

Chat about Author

Papers

The Design of Preventive Automated Driving Systems Based on Convolutional Neural Network