Paper
20 October 2022 TbNet: three-branch network to guide deep completion
Hongkai Geng, Chi-Te Chin, Ching-Hsiang Cheng, Jiawei Xu
Author Affiliations +
Proceedings Volume 12451, 5th International Conference on Computer Information Science and Application Technology (CISAT 2022); 124513R (2022) https://doi.org/10.1117/12.2656872
Event: 5th International Conference on Computer Information Science and Application Technology (CISAT 2022), 2022, Chongqing, China
Abstract
The depth maps obtained from current LiDAR scans are relatively sparse, while dense depth maps are needed. In this paper we propose a fusion-based RGB image and semantic image to jointly guide the deep completion. The RGB images, semantic images, and sparse depth images are fused after feature extraction, respectively. Specifically, we first perform depth estimation on the RGB image to generate the color depth. Then the color depth is fused with the semantic image to estimate the semantic depth. Finally, the color depth and semantic depth together lead to the complementation of the sparse depth map. To generate more accurate dense depth maps. In this paper, the fusion module (AFF) is added in some branches to fuse the color depth and semantic depth sparse depth maps. Under the test of public dataset KITTI, the experimental results show that the depth map predicted by the proposed depth completion model in this paper is more accurate compared with the backbone of the depth completion method guided by RGB only.
© (2022) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Hongkai Geng, Chi-Te Chin, Ching-Hsiang Cheng, and Jiawei Xu "TbNet: three-branch network to guide deep completion", Proc. SPIE 12451, 5th International Conference on Computer Information Science and Application Technology (CISAT 2022), 124513R (20 October 2022); https://doi.org/10.1117/12.2656872
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
RGB color model

Image fusion

Seaborgium

Computer programming

LIDAR

Cameras

Data centers

RELATED CONTENT


Back to Top