A spatial–spectral classification framework for multispectral LiDAR

TL;DR: In this article , the spatial and spectral information of multispectral LiDAR point clouds is used to improve the accuracy of point cloud point cloud classification, which could benefit more precise neighborhood selection, more effective features, and satisfactory refinement of classification result.

Abstract: Precise classification of Light Detection and Ranging (LiDAR) point cloud is a fundamental process in various applications, such as land cover mapping, forestry management, and autonomous driving. Due to the lack of spectral information, the existing research on single wavelength LiDAR classification is limited. Spectral information from images could address this limitation, but data fusion suffers from varying illumination conditions and the registration problem. A novel multispectral LiDAR successfully obtains spatial and spectral information as a brand-new data type, namely, multispectral point cloud, thereby improving classification performance. However, spatial and spectral information of multispectral LiDAR has been processed separately in previous studies, thereby possibly limiting the classification performance of multispectral LiDAR. To explore the potential of this new data type, the current spatial–spectral classification framework for multispectral LiDAR that includes four steps: (1) neighborhood selection, (2) feature extraction and selection, (3) classification, and (4) label smoothing. Three novel highlights were proposed in this spatial – spectral classification framework. (1) We improved the popular eigen entropy-based neighborhood selection by spectral angle match to extract a more precise neighborhood. (2) We evaluated the importance of geometric and spectral features to compare their contributions and selected the most important features to reduce feature redundancy. (3) We conducted spatial label smoothing by a conditional random field, accounting for the spatial and spectral information of the neighborhood points. The proposed method demonstrated by a multispectral LiDAR with three channels: 466 nm (blue), 527 nm (green), and 628 nm (red). Experimental results demonstrate the effectiveness of the proposed spatial – spectral classification framework. Moreover, this research takes advantages of the complementation of spatial and spectral information, which could benefit more precise neighborhood selection, more effective features, and satisfactory refinement of classification result. Finally, this study could serve as an inspiration for future efficient spatial–spectral process for multispectral point cloud.