|
In recent years, the field of thermal to visible image transformation has made great progress with Generative Adversarial Network(GAN). Since GANs own the ability to fit the signal frequency, these methods are limited to using more GANs or designing sub-tasks to improve the quality of the generated image. Due to the large difference in the information frequency of individual objects in the image, GANs pay less attention to low-frequency information, which leads to edge distortion of dynamic objects such as people and vehicles in the generated image. Edge distortion has become an important issue for practical applications We propose a new structure and two new loss functions to complete the task of thermal to visible image transformation. Our network takes one thermal image as input and generates a visible RGB image as output. First, we down-sample inputs for three times to get multi-scale inputs. Then we build outputs in multi-scale form small size to large size and fuse the multi-scale outputs. In train stage, our two new losses better direct the network to converge. In order to prove the effectiveness of the proposed thermal to visible image transformation algorithm, we use the KASIT-MPD dataset, which includes real paired thermal and visible images.
|
