最全图像融合论文及代码整理
News
[2022-07-29] 我们的综述论文《基于深度学习的图像融合方法综述》被《中国图象图形学报》正式接收！[论文下载]
Github项目地址：https://github.com/Linfeng-Tang/Image-Fusion （欢迎大家Start、 Fork、 Fellow 一键三连哦~）
图像融合(Image Fusion)
多模图像融合(Multi-Modal Image Fusion)
红外和可见光图像融合(Infrared and visible image fusion) 医学图像融合(Medical image fusion) 数字摄影图像融合(Digital Photography Image Fusion)
多曝光图像融合(Multi-exposure image fusion) 多聚焦图像融合(Multi-focus image fusion) 遥感影像融合(Remote Sensing Image Fusion)
通用图像融合框架(General Image Fusion Framerwork) 综述(Survey) 数据集(Dataset) 评估指标(Evaluation Metric)
通用评估指标(General evaluation metric) 遥感影像融合评估指标 Citation 图像融合系列博客还有：
图像融合综述论文整理参见：图像融合综述论文整理 图像融合评估指标参见：红外和可见光图像融合评估指标 图像融合常用数据集整理参见：图像融合常用数据集整理 通用图像融合框架论文及代码整理参见：通用图像融合框架论文及代码整理 基于深度学习的红外和可见光图像融合论文及代码整理参见:基于深度学习的红外和可见光图像融合论文及代码整理 更加详细的红外和可见光图像融合代码参见：红外和可见光图像融合论文及代码整理 基于深度学习的多曝光图像融合论文及代码整理参见：基于深度学习的多曝光图像融合论文及代码整理 基于深度学习的多聚焦图像融合论文及代码整理参见：基于深度学习的多聚焦图像融合(Multi-focus Image Fusion)论文及代码整理 基于深度学习的全色图像锐化论文及代码整理参见：基于深度学习的全色图像锐化(Pansharpening)论文及代码整理 基于深度学习的医学图像融合论文及代码整理参见：基于深度学习的医学图像融合(Medical image fusion)论文及代码整理 彩色图像融合程序参见：彩色图像融合 SeAFusion:首个结合高级视觉任务的图像融合框架参见：SeAFusion:首个结合高级视觉任务的图像融合框架 DIVFusion:首个耦合互促低光增强&图像融合的框架参见：DIVFusion:首个耦合互促低光增强&图像融合的框架 多模图像融合(Multi-Modal Image Fusion)
红外和可见光图像融合(Infrared and visible image fusion)
方法 标题 论文 代码 发表期刊或会议 基础框架 监督范式 发表年份 DenseFuse DenseFuse: A Fusion Approach to Infrared and Visible Images Paper Code TIP AE 自监督 2019 FusionGAN FusionGAN: A generative adversarial network for infrared and visible image fusion Paper Code InfFus GAN 无监督 2019 DDcGAN Learning a Generative Model for Fusing Infrared and Visible Images via Conditional Generative Adversarial Network with Dual Discriminators Paper Code IJCAI GAN 无监督 2019 NestFuse NestFuse: An Infrared and Visible Image Fusion Architecture Based on Nest Connection and Spatial/Channel Attention Models Paper Code TIM AE 自监督 2020 DDcGAN DDcGAN: A dual-discriminator conditional generative adversarial network for multi-resolution image fusion Paper Code TIP GAN 无监督 2020 RFN-Nest RFN-Nest: An end-to-end residual fusion network for infrared and visible images Paper Code InfFus AE 自监督 2021 CSF Classification Saliency-Based Rule for Visible and Infrared Image Fusion Paper Code TCI AE 自监督 2021 DRF DRF: Disentangled Representation for Visible and Infrared Image Fusion Paper Code TIM AE 自监督 2021 SEDRFuse SEDRFuse: A Symmetric Encoder–Decoder With Residual Block Network for Infrared and Visible Image Fusion Paper Code TIM AE 自监督 2021 MFEIF Learning a Deep Multi-Scale Feature Ensemble and an Edge-Attention Guidance for Image Fusion Paper Code TCSVT AE 自监督 2021 Meta-Learning Different Input Resolutions and Arbitrary Output Resolution: A Meta Learning-Based Deep Framework for Infrared and Visible Image Fusion Paper TIP CNN 无监督 2021 RXDNFuse RXDNFuse: A aggregated residual dense network for infrared and visible image fusion Paper InfFus CNN 无监督 2021 STDFusionNet STDFusionNet: An Infrared and Visible Image Fusion Network Based on Salient Target Detection Paper Code TIM CNN 无监督 2021 D2LE A Bilevel Integrated Model With Data-Driven Layer Ensemble for Multi-Modality Image Fusion Paper TIP CNN 无监督 2021 HAF Searching a Hierarchically Aggregated Fusion Architecture for Fast Multi-Modality Image Fusion Paper Code ACM MM CNN 无监督 2021 SDDGAN Semantic-supervised Infrared and Visible Image Fusion via a Dual-discriminator Generative Adversarial Network Paper Code TMM GAN 无监督 2021 Detail-GAN Infrared and visible image fusion via detail preserving adversarial learning Paper Code InfFus GAN 无监督 2021 Perception-GAN Image fusion based on generative adversarial network consistent with perception Paper Code InfFus GAN 无监督 2021 GAN-FM GAN-FM: Infrared and Visible Image Fusion Using GAN With Full-Scale Skip Connection and Dual Markovian Discriminators Paper Code TCI GAN 无监督 2021 AttentionFGAN AttentionFGAN: Infrared and Visible Image Fusion Using Attention-Based Generative Adversarial Networks Paper TMM GAN 无监督 2021 GANMcC GANMcC: A Generative Adversarial Network With Multiclassification Constraints for Infrared and Visible Image Fusion Paper Code TIM GAN 无监督 2021 MgAN-Fuse Multigrained Attention Network for Infrared and Visible Image Fusion Paper TIM GAN 无监督 2021 TC-GAN Infrared and Visible Image Fusion via Texture Conditional Generative Adversarial Network Paper TCSVT GAN 无监督 2021 TarDAL Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection Paper Code CVPR GAN 无监督 2022 RFNet RFNet: Unsupervised Network for Mutually Reinforcing Multi-modal Image Registration and Fusion Paper Code CVPR CNN 无监督 2022 SeAFusion Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network Paper Code InfFus CNN 无监督 2022 PIAFusion PIAFusion: A progressive infrared and visible image fusion network based on illumination aware Paper Code InfFus CNN 无监督 2022 UMF-CMGR Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registration Paper Code IJCAI CNN 无监督 2022 DetFusion DetFusion: A Detection-driven Infrared and Visible Image Fusion Network Paper Code ACM MM CNN 无监督 2022 DIVFusion DIVFusion: Darkness-free infrared and visible image fusion Paper Code InfFus CNN 无监督 2023
医学图像融合(Medical image fusion)
方法 标题 论文 代码 发表期刊或会议 基础框架 监督范式 年份 CNN A medical image fusion method based on convolutional neural networks Paper ICIF CNN 无监督 2017 Zero-LMF Zero-Learning Fast Medical Image Fusion Paper Code ICIF CNN 无监督 2019 DDcGAN Learning a Generative Model for Fusing Infrared and Visible Images via Conditional Generative Adversarial Network with Dual Discriminators Paper Code IJCAI GAN 无监督 2019 GFPPC-GAN Green Fluorescent Protein and Phase-Contrast Image Fusion via Generative Adversarial Networks Paper CMMM GAN 无监督 2019 CCN-CP Multi-modality medical image fusion using convolutional neural network and contrast pyramid Paper Sensors CNN 无监督 2020 DDcGAN DDcGAN: A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion Paper Code TIP GAN 无监督 2020 MGMDcGAN Medical Image Fusion Using Multi-Generator Multi-Discriminator Conditional Generative Adversarial Network Paper Code Access GAN 无监督 2020 D2LE A Bilevel Integrated Model With Data-Driven Layer Ensemble for Multi-Modality Image Fusion Paper TIP CNN 无监督 2021 HAF Searching a Hierarchically Aggregated Fusion Architecture for Fast Multi-Modality Image Fusion Paper Code ACM MM CNN 无监督 2021 EMFusion EMFusion: An unsupervised enhanced medical image fusion network Paper Code InfFus CNN 无监督 2021 DPCN-Fusion Green Fluorescent Protein and Phase Contrast Image Fusion Via Detail Preserving Cross Network Paper Code TCI CNN 无监督 2021 MSPRN A multiscale residual pyramid attention network for medical image fusion Paper Code BSPC CNN 无监督 2021 DCGAN Medical image fusion method based on dense block and deep convolutional generative adversarial network Paper NCA GAN 无监督 2021
数字摄影图像融合(Digital Photography Image Fusion)
多曝光图像融合(Multi-exposure image fusion)
方法 标题 论文 代码 发表期刊或会议 基础框架 监督范式 年份 DeepFuse DeepFuse: A Deep Unsupervised Approach for Exposure Fusion with Extreme Exposure Image Pairs Paper Code ICCV CNN 无监督 2017 CNN Multi-exposure fusion with CNN features Paper Code ICIP CNN 无监督 2018 MEF-Net Deep guided learning for fast multi-exposure image fusion Paper Code TIP CNN 无监督 2020 ICEN Multi-exposure high dynamic range imaging with informative content enhanced network Paper NC CNN 无监督 2020 MEF-GAN MEF-GAN: Multi-Exposure Image Fusion via Generative Adversarial Networks Paper Code TIP GAN 无监督 2020 CF-Net Deep coupled feedback network for joint exposure fusion and image super-resolutions Paper Code TIP CNN 无监督 2021 UMEF Deep unsupervised learning based on color un-referenced loss functions for multi-exposure image fusion Paper Code InFus CNN 无监督 2021 PA-AGN Two exposure fusion using prior-aware generative adversarial network Paper TMM GAN 无监督 2021 AGAL Attention-guided Global-local Adversarial Learning for Detail-preserving Multi-exposure Image Fusion Paper Code TCSVT GAN 无监督 2022 GANFuse GANFuse: a novel multi-exposure image fusion method based on generative adversarial networks Paper NCAA GAN 无监督 2021 DRLF Automatic Intermediate Generation With Deep Reinforcement Learning for Robust Two-Exposure Image Fusion Paper TNNLS CNN 无监督 2021 Trans-MEF TransMEF: A Transformer-Based Multi-Exposure Image Fusion Framework using Self-Supervised Multi-Task Learning Paper Code AAAI AE 自监督 2022 DPE-MEF Multi-exposure image fusion via deep perceptual enhancement Paper Code InFus CNN 无监督 2022
多聚焦图像融合(Multi-focus image fusion)
方法 标题 论文 代码 发表期刊或会议 基础框架 监督范式 年份 CNN Multi-focus image fusion with a deep convolutional neural network Paper Code InFus CNN 有监督 2017 ECNN Ensemble of CNN for multi-focus image fusion Paper Code InFus CNN 有监督 2019 MLFCNN Multilevel features convolutional neural network for multifocus image fusion Paper TCI CNN 有监督 2019 DRPL DRPL: Deep Regression Pair Learning for Multi-Focus Image Fusion Paper Code TIP CNN 有监督 2020 MMF-Net An α-Matte Boundary Defocus Model-Based Cascaded Network for Multi-Focus Image Fusion Paper Code TCI CNN 有监督 2020 MFF-SSIM Towards Reducing Severe Defocus Spread Effects for Multi-Focus Image Fusion via an Optimization Based Strategy Paper Code Sensors CNN 无监督 2020 MFNet Structural Similarity Loss for Learning to Fuse Multi-Focus Images Paper TIP CNN 有监督 2021 GEU-Net Global-Feature Encoding U-Net (GEU-Net) for Multi-Focus Image Fusion [GEU-Net Paper Code TCI CNN 自监督 2021 DTMNet DTMNet: A Discrete Tchebichef Moments-Based Deep Neural Network for Multi-Focus Image Fusion Paper TMM CNN 无监督 2021 SMFuse SMFuse: Multi-Focus Image Fusion Via Self-Supervised Mask-Optimization Paper Code NCA CNN 无监督 2021 ACGAN A generative adversarial network with adaptive constraints for multi-focus image fusion Paper Code ICCV GAN 有监督 2021 FuseGAN Learning to fuse multi-focus image via conditional generative adversarial network Paper TIP GAN 有监督 2020 D2FMIF Depth-Distilled Multi-focus Image Fusion Paper TMM CNN 有监督 2019 SESF-Fuse SESF-Fuse: an unsupervised deep model for multi-focus image fusion Paper Code NCAA CNN 有监督 2020 MFF-GAN MFF-GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion Paper Code InFus GAN 无监督 2021 MFIF-GAN MFIF-GAN: A new generative adversarial network for multi-focus image fusion Paper Code SPIC GAN 有监督 2021
遥感影像融合(Remote Sensing Image Fusion)
全色图像锐化(Pansharpening)
方法 标题 论文 代码 发表期刊或会议 基础框架 监督范式 年份 PNN Pansharpening by Convolutional Neural Networks Paper Code RS CNN 有监督 2016 PanNet PanNet: A deep network architecture for pan-sharpening Paper Code PanNet CNN 有监督 2017 TFNet Remote sensing image fusion based on two-stream fusion network Paper Code TFNet CNN 有监督 2020 BKL Unsupervised Blur Kernel Learning for Pansharpening Paper IGARSS CNN 无监督 2020 Pan-GAN Pan-GAN: An unsupervised pan-sharpening method for remote sensing image fusion Paper Code InFus GAN 无监督 2020 UCNN Pansharpening via Unsupervised Convolutional Neural Networks Paper JSTARS CNN 无监督 2020 UPSNet UPSNet: Unsupervised Pan-Sharpening Network With Registration Learning Between Panchromatic and Multi-Spectral Images Paper ACCESS CNN 无监督 2020 GPPNN Deep Gradient Projection Networks for Pan-sharpening Paper Code CVPR CNN 有监督 2021 GTP-PNet GTP-PNet: A residual learning network based on gradient transformation prior for pansharpening Paper Code ISPRS CNN 有监督 2021 HMCNN Pan-Sharpening Via High-Pass Modification Convolutional Neural Network Paper Code ICIP CNN 有监督 2021 SDPNet SDPNet: A Deep Network for Pan-Sharpening With Enhanced Information Representation Paper Code TGRS CNN 有监督 2021 SIPSA-Net SIPSA-Net: Shift-Invariant Pan Sharpening with Moving Object Alignment for Satellite Imagery Paper Code CVPR CNN 有监督 2021 SRPPNN Super-resolution-guided progressive pansharpening based on a deep convolutional neural network Paper Code TGRS CNN 有监督 2021 PSGAN PSGAN: A generative adversarial network for remote sensing image pan-sharpening Paper Code TGRS GAN 有监督 2021 MDCNN MDCNN: multispectral pansharpening based on a multiscale dilated convolutional neural network Paper JRS CNN 有监督 2021 LDP-Net LDP-Net: An Unsupervised Pansharpening Network Based on Learnable Degradation Processes Paper Code Arxiv CNN 无监督 2021 DIGAN Pansharpening approach via two-stream detail injection based on relativistic generative adversarial networks Paper ESA GAN 有监督 2022 DPFN A Dual-Path Fusion Network for Pan-Sharpening Paper Code TGRS CNN 有监督 2022 MSGAN An Unsupervised Multi-scale Generative Adversarial Network for Remote Sensing Image Pan-Sharpening Paper ICMM GAN 无监督 2022 UCGAN Unsupervised Cycle-Consistent Generative Adversarial Networks for Pan Sharpening Paper Code TGRS GAN 无监督 2022 P2Sharpen P2Sharpen: A progressive pansharpening network with deep spectral transformation Paper Code INFFus CNN 有监督 2023
通用图像融合框架(General Image Fusion Framerwork)
方法 标题 论文 代码 发表期刊或会议 基础框架 监督范式 年份 IFCNN IFCNN: A general image fusion framework based on convolutional neural network Paper Code InFus CNN 有监督 2020 FusionDN FusionDN: A Unified Densely Connected Network for Image Fusion Paper Code AAAI CNN 无监督 2020 PMGI Rethinking the Image Fusion: A Fast Unified Image Fusion Network based on Proportional Maintenance of Gradient and Intensity Paper Code AAAI CNN 无监督 2020 CU-Net Deep Convolutional Neural Network for Multi-Modal Image Restoration and Fusion Paper Code TPAMI CNN 有监督 2021 SDNet SDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion Paper Code IJCV CNN 无监督 2021 DIF-Net Unsupervised Deep Image Fusion With Structure Tensor Representations Paper Code TIP CNN 无监督 2021 IFSepR IFSepR: A general framework for image fusion based on separate representation learning Paper TMM AE 自监督 2021 MTOE Multiple Task-Oriented Encoders for Unified Image Fusion Paper ICME CNN 无监督 2021 U2Fusion U2Fusion: A Unified Unsupervised Image Fusion Network Paper Code TPAMI CNN 无监督 2022 SwinFusion SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer Paper Code JAS Transformer 无监督 2022 DeFusion Fusion from Decomposition: A Self-Supervised Decomposition Approach for Image Fusion Paper Code ECCV CNN 无监督 2022 UIFGAN UIFGAN: An unsupervised continual-learning generative adversarial network for unified image fusion Paper Code InFus GAN 无监督 2023
综述(Survey)
标题 论文 代码 发表期刊或会议 年份 A review of remote sensing image fusion methods Paper InFus 2016 Pixel-level image fusion: A survey of the state of the art Paper InFus 2017 Deep learning for pixel-level image fusion: Recent advances and future prospects Paper InFus 2018 Infrared and visible image fusion methods and applications: A survey Paper InFus 2019 Multi-focu image fusion: A Survey of the state of the art Paper InFus 2020 Image fusion meets deep learning: A survey and perspective Paper InFus 2021 Deep Learning-based Multi-focus Image Fusion: A Survey and A Comparative Study Paper Code TPAMI 2021 Benchmarking and comparing multi-exposure image fusion algorithms Paper Code InFus 2021 Current advances and future perspectives of image fusion: A comprehensive review Paper InFus Code InFus 2023
数据集(Dataset)
融合场景 数据集 下载链接 红外和可见光图像融合 TNO https://figshare.com/articles/dataset/TNO_Image_Fusion_Dataset/1008029 INO https://www.ino.ca/en/technologies/video-analytics-dataset/videos/ RoadScene https://github.com/hanna-xu/RoadScene MSRS https://github.com/Linfeng-Tang/MSRS LLVIP https://bupt-ai-cz.github.io/LLVIP / M3FD https://github.com/JinyuanLiu-CV/TarDAL 医学图像融合 Harvard http://www.med.harvard.edu/AANLIB/home.html 多曝光图像融合 MEF https://github.com/csjcai/SICE MEFB https://github.com/xingchenzhang/MEFB 多聚焦图像融合 Lytro https://mansournejati.ece.iut.ac.ir/content/lytro-multi-focus-dataset MFI-WHU https://github.com/HaoZhang1018/MFI-WHU MFFW https://www.semanticscholar.org/paper/MFFW%3A-A-new-dataset-for-multi-focus-image-fusion-Xu-Wei/4c0658f338849284ee4251a69b3c323908e62b45 全色图像锐化 GaoFen https://directory.eoportal.org/web/eoportal/satellite-missions/g WorldView https://worldview.earthdata.nasa.gov/ GeoEye https://earth.esa.int/eogateway/missions/geoeye-1 QuickBird https://www.satimagingcorp.com/satellite-sensors/quickbird/
评估指标(Evaluation Metric)
通用评估指标(General evaluation metric)
通用评估指标位于：https://github.com/Linfeng-Tang/Image-Fusion/tree/main/General%20Evaluation%20Metric or https://github.com/Linfeng-Tang/Evaluation-for-Image-Fusion
遥感影像融合评估指标(Evaluation metric for pansharpening)
如有疑问可联系：2458707789@qq.com ; 备注 姓名+学校