TbNet: three-branch network to guide deep completion

Hongkai Geng; Chi-Te Chin; Ching-Hsiang Cheng; Jiawei Xu

doi:10.1117/12.2656872

20 October 2022 TbNet: three-branch network to guide deep completion

Hongkai Geng, Chi-Te Chin, Ching-Hsiang Cheng, Jiawei Xu

Proceedings Volume 12451, 5th International Conference on Computer Information Science and Application Technology (CISAT 2022); 124513R (2022) https://doi.org/10.1117/12.2656872
Event: 5th International Conference on Computer Information Science and Application Technology (CISAT 2022), 2022, Chongqing, China

Abstract

The depth maps obtained from current LiDAR scans are relatively sparse, while dense depth maps are needed. In this paper we propose a fusion-based RGB image and semantic image to jointly guide the deep completion. The RGB images, semantic images, and sparse depth images are fused after feature extraction, respectively. Specifically, we first perform depth estimation on the RGB image to generate the color depth. Then the color depth is fused with the semantic image to estimate the semantic depth. Finally, the color depth and semantic depth together lead to the complementation of the sparse depth map. To generate more accurate dense depth maps. In this paper, the fusion module (AFF) is added in some branches to fuse the color depth and semantic depth sparse depth maps. Under the test of public dataset KITTI, the experimental results show that the depth map predicted by the proposed depth completion model in this paper is more accurate compared with the backbone of the depth completion method guided by RGB only.

Citation Download Citation

Hongkai Geng, Chi-Te Chin, Ching-Hsiang Cheng, and Jiawei Xu "TbNet: three-branch network to guide deep completion", Proc. SPIE 12451, 5th International Conference on Computer Information Science and Application Technology (CISAT 2022), 124513R (20 October 2022); https://doi.org/10.1117/12.2656872

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available