The images captured by a single sensor are often limited. How to use multi-sensor images has important value. For example, the imaging conditions of visible camera are relatively harsh, while the infrared camera can operate in all-day and all-weather and has longer visual distance. For better visual presentation and subsequent perception tasks, we focused on the infrared and visible image fusion based on auto-encoder. Specifically, we proposed a fusion strategy based on regional attention and a multi-scale convolution layer. The fusion strategy based on regional attention divides a image into several regions and adopts different fusion strategy for different regions. Multi-scale convolution layer is to capture the features of different receptive fields and improve the semantic representation ability of the encoder. From detailed experimental results, we can see that the optimized fusion algorithm is more robust, reduces the sensitivity to the classifier, and keeps more textures of background.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Infrared-visible image fusion based on regional attention auto-encoder


    Contributors:
    Shao, Xiaopeng (editor) / Wang, Peng (author) / Huang, Sheng (author) / Liu, Huimin (author) / Tian, Peng (author)

    Conference:

    Third International Computing Imaging Conference (CITA 2023) ; 2023 ; Sydney, Australia


    Published in:

    Proc. SPIE ; 12921


    Publication date :

    2023-11-06





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Infrared long-wave multispectral image reconstruction based on auto-encoder network

    Tian, Yuan / Qin, Hanlin / Ma, Lin et al. | British Library Conference Proceedings | 2019


    BLURRED IMAGE REGION DETECTION BASED ON STACKED AUTO-ENCODER

    Zhou, Yuan / Yang, Jianxing / Chen, Yang et al. | British Library Conference Proceedings | 2018


    A GAN-based visible and infrared image fusion algorithm

    Zhang, Hongzhi / Shen, Yifan / Ou, Yangyan et al. | British Library Conference Proceedings | 2021



    Deep Supervised Auto-encoder Hashing for Image Retrieval

    Tang, Sanli / Chi, Haoyuan / Yang, Jie et al. | British Library Conference Proceedings | 2018