Siamese network object tracking based on fusion of visible and event cameras

Qiang Hu; Liwei Meng; Yian Liu; Shaogang Hu; Guanchao Qiao

doi:10.1117/12.2681645

1 June 2023 Siamese network object tracking based on fusion of visible and event cameras

Qiang Hu, Liwei Meng, Yian Liu, Shaogang Hu, Guanchao Qiao

Proceedings Volume 12718, International Conference on Cyber Security, Artificial Intelligence, and Digital Economy (CSAIDE 2023); 127181R (2023) https://doi.org/10.1117/12.2681645
Event: International Conference on Cyber Security, Artificial Intelligence, and Digital Economy (CSAIDE 2023), 2023, Nanjing, China

Abstract

Object tracking is widely used in daily life. The existing visible camera-based tracking methods are difficult to track objects accurately in the face of degraded scenes such as fast movement, high contrast, and low illumination, which will cause the loss of tracking performance. An event camera is a biologically driven sensor with higher dynamic range, smaller time delay, and higher light sensitivity than traditional visible cameras. We propose a siamese network object tracking method that fuses visible and event cameras to realize more reliable tracking. We design a feature fusion method combining visible and event camera features based on attention mechanism. It realizes the cooperation of both sensors and improves the accuracy of tracking. Experiments on the VisEvent dataset reveal that our network outperforms single-modality trackers by 5.8% and outperforms other fusion-based methods by 2.1%.

Citation Download Citation

Qiang Hu, Liwei Meng, Yian Liu, Shaogang Hu, and Guanchao Qiao "Siamese network object tracking based on fusion of visible and event cameras", Proc. SPIE 12718, International Conference on Cyber Security, Artificial Intelligence, and Digital Economy (CSAIDE 2023), 127181R (1 June 2023); https://doi.org/10.1117/12.2681645

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available