Bimodal vision system combining standard camera and dynamic vision sensor for detecting and tracking fast UAVs

Antoine Zundel; Cédric Demonceaux; Nicolas Hueber; Damien Spittler; Guillaume Strub; Sébastien Changey

doi:10.1117/12.3031854

15 November 2024 Bimodal vision system combining standard camera and dynamic vision sensor for detecting and tracking fast UAVs

Antoine Zundel, Cédric Demonceaux, Nicolas Hueber, Damien Spittler, Guillaume Strub, Sébastien Changey

Author Affiliations +

Proceedings Volume 13204, Emerging Imaging and Sensing Technologies for Security and Defence IX; 1320402 (2024) https://doi.org/10.1117/12.3031854
Event: Security + Defence, 2024, Edinburgh, United Kingdom

Abstract

This work focuses on a bimodal vision system which was previously demonstrated as a relevant sensing candidate for detecting and tracking fast objects by combining the unique event-based sensor features i.e. high temporal resolution, reduced bandwidth needs, low energy consumption, and passive detection capabilities with the high-spatial resolution of a RGB camera. In this study, we aim to propose a model based on the principle of attentional vision for real-time detection and tracking of UAVs, taking into account computing and on-board resource constraints. A laboratory demonstrator have been proposed to evaluate the operational limits in terms of computation time, system performances (including target detection) versus speed. Our first indoor and outdoor tests revealed the interest and potential of our system to quickly detect objects flying at hundreds of kilometers an hour.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Antoine Zundel, Cédric Demonceaux, Nicolas Hueber, Damien Spittler, Guillaume Strub, and Sébastien Changey "Bimodal vision system combining standard camera and dynamic vision sensor for detecting and tracking fast UAVs", Proc. SPIE 13204, Emerging Imaging and Sensing Technologies for Security and Defence IX, 1320402 (15 November 2024); https://doi.org/10.1117/12.3031854

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available