Enhancing the capability of registration networks in multimodal remote sensing image registration using synthetic data

Liyu Tian; Jin Luo; Meng Yu

doi:10.1117/12.3038564

23 August 2024 Enhancing the capability of registration networks in multimodal remote sensing image registration using synthetic data

Liyu Tian, Jin Luo, Meng Yu

Author Affiliations +

Proceedings Volume 13250, Fourth International Conference on Image Processing and Intelligent Control (IPIC 2024); 1325008 (2024) https://doi.org/10.1117/12.3038564
Event: 4th International Conference on Image Processing and Intelligent Control (IPIC 2024), 2024, Kuala Lumpur, Malaysia

Abstract

The accurate alignment of multimodal remote sensing images is of paramount importance for a wide range of applications, including environmental monitoring, change detection, and resource management. These tasks require robust registration techniques capable of handling the inherent variations in image appearance due to different sensor modalities. In this study, we introduce a novel approach that leverages synthetic data to improve the performance of image registration networks for multimodal remote sensing imagery. Our method involves the generation of synthetic image pairs through color-space transformations applied to synthetic data, which are then utilized to fine-tune a neural network specifically designed for image registration tasks. By training on these synthetic pairs, the network learns to cope with the complex variations between different sensor modalities. The fine-tuned network demonstrates state-of-theart (SOTA) performance when applied to real-world remote sensing images, showcasing the effectiveness of synthetic data in enhancing the network’s ability to generalize across diverse imaging conditions. This advancement represents a significant step forward in the field of remote sensing image analysis, offering a robust solution for the precise registration of multimodal datasets.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Liyu Tian, Jin Luo, and Meng Yu "Enhancing the capability of registration networks in multimodal remote sensing image registration using synthetic data", Proc. SPIE 13250, Fourth International Conference on Image Processing and Intelligent Control (IPIC 2024), 1325008 (23 August 2024); https://doi.org/10.1117/12.3038564

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image registration

Remote sensing

Deformation

Education and training

Image enhancement

Neural networks

Image processing

Show All Keywords

Keywords/Phrases

Search In:

Publication Years