🤖 This repository was organized and maintained with assistance from ChatGPT. Thanks to ChatGPT for helping with literature collection, verification, and README organization.
Here, RGB-T also includes RGB-Thermal, Visible-Thermal, Visible-Infrared, and RGB-IR when the work belongs to the three tasks collected in this repository. Click a venue to open the paper; click a Stars badge to open the official code repository.
🔥 Salient Object Detection · 🧩 Semantic Segmentation · 👥 Crowd Counting · 📚 Datasets · 📏 Evaluation · 🔗 Resources
| Year | Venue | Method | Title |
|---|---|---|---|
| 2026 | CVPR | UMFNet  |
Uncertainty-Aware Modality Fusion for Unaligned RGB-T Salient Object Detection |
| 2026 | AAAI | TPS-SCL  |
Breaking Alignment Barriers: TPS-Driven Semantic Correlation Learning for Alignment-Free RGB-T Salient Object Detection |
| 2026 | TMM | SAMSOD | SAMSOD: Rethinking SAM Optimization for RGB-T Salient Object Detection |
| 2026 | TCSVT | RSONet | RSONet: Region-Guided Selective Optimization Network for RGB-T Salient Object Detection |
| 2026 | TCSVT | GaCNet | Empirical Study on Fusion Strategy in RGB-T Salient Object Detection |
| 2025 | TPAMI | ConTriNet  |
Divide-and-Conquer: Confluent Triple-Flow Network for RGB-T Salient Object Detection |
| 2025 | AAAI | PCNet  |
Alignment-Free RGB-T Salient Object Detection: A Large-Scale Dataset and Progressive Correlation Network |
| 2025 | CVPR | 🔥 Samba  |
Samba: A Unified Mamba-Based Framework for General Salient Object Detection |
| 2025 | TIP | TwinsTNet  |
TwinsTNet: Broad-View Twins Transformer Network for Bi-Modal Salient Object Detection |
| 2025 | TCSVT | UniSOD  |
Unified-Modal Salient Object Detection via Adaptive Prompt Learning |
| 2025 | TETCI | — | Collaborating Constrained and Unconstrained Encodings for Cross-Modal Salient Object Detection |
| 2025 | TIM | TCINet  |
Three-Decoder Cross-Modal Interaction Network for Unregistered RGB-T Salient Object Detection |
| 2025 | TIM | DFINet | Cognition-Inspired Dynamic Feature Integration Network for RGB-D and RGB-T Salient Object Detection |
| 2025 | TGRS | AlignSal  |
Efficient Fourier Filtering Network With Contrastive Learning for AAV-Based Unaligned Bimodal Salient Object Detection |
| 2025 | TCSVT | HyPSAM  |
HyPSAM: Hybrid Prompt-Driven Segment Anything Model for RGB-Thermal Salient Object Detection |
| 2025 | Information Fusion | — | Weakly Supervised RGBT Salient Object Detection via SAM-Guided Label Optimization and Progressive Cross-Modal Cross-Scale Fusion |
| 2025 | Neurocomputing | GOSNet | GOSNet: RGB-T Salient Object Detection Network Based on Global Omnidirectional Scanning |
| 2025 | KBS | TFL | Trigonometric Feature Learning for RGBD and RGBT Image Salient Object Detection |
| 2024 | TMM | UniTR  |
UniTR: A Unified TRansformer-Based Framework for Co-Object and Multi-Modal Saliency Detection |
| 2024 | TMM | MFFNet | MFFNet: Multi-Modal Feature Fusion Network for V-D-T Salient Object Detection |
| 2024 | TIP | QSFNet  |
Quality-Aware Selective Fusion Network for V-D-T Salient Object Detection |
| 2024 | TCSVT | AFB | Learning Adaptive Fusion Bank for Multi-Modal Salient Object Detection |
| 2024 | TMM | SGACNet | Alignment-Free RGBT Salient Object Detection: Semantics-Guided Asymmetric Correlation Network and a Unified Benchmark |
| 2024 | TIM | — | RGB-T Saliency Detection Based on Multiscale Modal Reasoning Interaction |
| 2024 | TCE | — | Transformer-Based Cross-Modal Integration Network for RGB-T Salient Object Detection |
| 2024 | PR | TMNet | Triple-Modal Interaction Encoder and Multi-Scale Fusion Decoder Network for V-D-T Salient Object Detection |
| 2024 | PR | — | Frequency-Aware Feature Aggregation Network With Dual-Task Consistency for RGB-T Salient Object Detection |
| 2024 | NN | UTDNet | UTDNet: A Unified Triplet Decoder Network for Multimodal Salient Object Detection |
| 2024 | NN | MSEDNet  |
MSEDNet: Multi-Scale Fusion and Edge-Supervised Network for RGB-T Salient Object Detection |
| 2024 | NN | — | Salient Object Detection in Low-Light RGB-T Scene via Spatial-Frequency Cues Mining |
| 2023 | TIP | 🔥 LSNet  |
LSNet: Lightweight Spatial Boosting Network for Detecting Salient Objects in RGB-Thermal Images |
| 2023 | TIP | 🔥 CAVER  |
CAVER: Cross-Modal View-Mixed Transformer for Bi-Modal Salient Object Detection |
| 2023 | TIP | PRLNet  |
Position-Aware Relation Learning for RGB-Thermal Salient Object Detection |
| 2023 | TIP | WaveNet  |
WaveNet: Wavelet Network With Knowledge Distillation for RGB-T Salient Object Detection |
| 2023 | TGRS | MROS  |
Modality Registration and Object Search Framework for UAV-Based Unregistered RGB-T Image Salient Object Detection |
| 2023 | TCSVT | CMDBIF-Net | Cross-Modality Double Bidirectional Interaction and Fusion Network for RGB-T Salient Object Detection |
| 2023 | TCSVT | MGAINet  |
Multiple Graph Affinity Interactive Network and a Variable Illumination Dataset for RGBT Image Salient Object Detection |
| 2023 | ACM MM | SPNet  |
Saliency Prototype for RGB-D and RGB-T Salient Object Detection |
| 2023 | ICME | RGBTScribble  |
Scribble-Supervised RGB-T Salient Object Detection |
| 2023 | RAL | 🔥 EAEFNet  |
Explicit Attention-Enhanced Fusion for RGB-Thermal Perception Tasks |
| 2023 | Neurocomputing | FANet  |
Feature Aggregation With Transformer for RGB-T Salient Object Detection |
| 2023 | KBS | TIDNet  |
Three-Stream Interaction Decoder Network for RGB-Thermal Salient Object Detection |
| 2022 | TIP | DCNet  |
Weakly Alignment-Free RGBT Salient Object Detection With Deep Correlation Network |
| 2022 | TMM | TNet | Does Thermal Really Always Matter for RGB-T Salient Object Detection |
| 2022 | TCSVT | CGMDRNet | CGMDRNet: Cross-Guided Modality Difference Reduction Network for RGB-T Salient Object Detection |
| 2022 | TCSVT | CCFENet | Cross-Collaborative Fusion-Encoder Network for Robust RGB-Thermal Salient Object Detection |
| 2022 | PR | C³A | Cross-Modal Co-Feedback Cellular Automata for RGB-T Saliency Detection |
| 2022 | TIM | OSRNet  |
Real-Time One-Stream Semantic-Guided Refinement Network for RGB-Thermal Salient Object Detection |
| 2022 | Neurocomputing | MIA-DPD  |
Multi-Modal Interactive Attention and Dual Progressive Decoding Network for RGB-D/T Salient Object Detection |
| 2022 | KBS | ACMANet  |
Asymmetric Cross-Modal Activation Network for RGB-T Salient Object Detection |
| 2021 | TIP | MIDD  |
Multi-Interactive Dual-Decoder for RGB-Thermal Salient Object Detection |
| 2021 | TCSVT | ECFFNet | ECFFNet: Effective and Consistent Feature Fusion Network for RGB-T Salient Object Detection |
| 2021 | TCSVT | UIFNet | Unified Information Fusion Network for Multi-Modal RGB-D and RGB-T Salient Object Detection |
| 2021 | TCSVT | CGFNet  |
CGFNet: Cross-Guided Fusion Network for RGB-T Salient Object Detection |
| 2021 | TCSVT | CSRNet  |
Efficient Context-Guided Stacked Refinement Network for RGB-T Salient Object Detection |
| 2021 | TCSVT | 🔥 SwinNet  |
Swin Transformer Drives Edge-Aware RGB-D and RGB-T Salient Object Detection |
| 2021 | TCSVT | — | Multi-Graph Fusion and Learning for RGBT Image Saliency Detection |
| 2021 | TETCI | APNet  |
APNet: Adversarial Learning Assistance and Perceived Importance Fusion Network for All-Day RGB-T Salient Object Detection |
| 2020 | TIP | — | RGB-T Salient Object Detection via Fusing Multi-Level CNN Features |
| 2020 | TCSVT | — | Revisiting Feature Fusion for RGB-T Salient Object Detection |
| 2019 | TMM | CGL | RGB-T Image Saliency Detection via Collaborative Graph Learning |
| 2019 | TCSVT | VT821 | RGBT Salient Object Detection: Benchmark and a Novel Cooperative Ranking Approach |
| Year | Venue | Method | Title |
|---|---|---|---|
| 2026 | TIP | SPCL  |
Decouple-Then-Synergize: A Self-Paced Collaborative Learning Network for RGB-T Snowy Urban Scene Parsing |
| 2026 | TCSVT | TUNI  |
TUNI: Unifying Pre-Training and Fine-Tuning With Modality-Aware Mutual Learning and Rectification for RGB-T Semantic Segmentation |
| 2026 | TITS | USformer | USformer: A U-Shaped Structure Transformer for RGB-Thermal Semantic Segmentation and Traffic Scene Understanding |
| 2026 | PR | IQSeg  |
Implicit Alignment and Query Refinement for RGB-T Semantic Segmentation |
| 2026 | PR | P³D | P³D: Plug-and-Play Prompt-Driven Framework for RGB-Thermal Semantic Segmentation |
| 2025 | ICCV | AMDANet | AMDANet: Attention-Driven Multi-Perspective Discrepancy Alignment for RGB-Infrared Image Fusion and Segmentation |
| 2025 | TIP | MiLNet  |
MiLNet: Multiplex Interactive Learning Network for RGB-T Semantic Segmentation |
| 2025 | IROS | CM-SSM  |
Cross-Modal State Space Modeling for Real-Time RGB-Thermal Wild Scene Semantic Segmentation |
| 2025 | TNNLS | DML | Deformation-Resilient Multigranularity Learning for Unaligned RGB-T Semantic Segmentation |
| 2025 | TETCI | CIGF-Net | CIGF-Net: Cross-Modality Interaction and Global-Feature Fusion for RGB-T Semantic Segmentation |
| 2025 | TIM | — | Low-Light Enhancement and Global-Local Feature Interaction for RGB-T Semantic Segmentation |
| 2025 | TITS | AGFNet | AGFNet: Adaptive Gated Fusion Network for RGB-T Semantic Segmentation |
| 2025 | TITS | — | Transferring Prior Thermal Knowledge for Snowy Urban Scene Semantic Segmentation |
| 2025 | TITS | RADNet | Real-Time Multispectral Semantic Segmentation Network Utilizing Feature Frequency Decomposition and Spatial Division Distillation for Autonomous Driving |
| 2025 | TII | CLMFNet | CLMFNet: Cross-Level Multimodal Fusion Network for RGB-T Semantic Segmentation of Distribution Network Lines |
| 2025 | TCSVT | C⁴Net | C⁴Net: Excavating Cross-Modal Context- and Content-Complementarity for RGB-T Semantic Segmentation |
| 2025 | Information Fusion | FGD | Towards Efficient RGB-T Semantic Segmentation via Feature Generative Distillation Strategy |
| 2025 | Information Fusion | PEAFusion | PEAFusion: Parameter-Efficient Adaptation for RGB-Thermal Fusion-Based Semantic Segmentation |
| 2025 | PR | SCRNet | Resolving Semantic Conflicts in RGB-T Semantic Segmentation |
| 2025 | TITS | CFDHI-Net  |
Correlation-Driven Feature Decoupling and Hierarchical Integration Network for RGB-Thermal Semantic Segmentation |
| 2025 | TITS | HMFENet  |
Hierarchical Matching Guided Feature Enhancement Network for Few-Shot RGB-Thermal Urban Scene Segmentation |
| 2025 | CVIU | ERTFNet | ERTFNet: Enhanced RGB-T Fusion Network for Semantic Segmentation by Integrating Thermal Edge Features |
| 2024 | ECCV | OpenRSS  |
Open-Vocabulary RGB-Thermal Semantic Segmentation |
| 2024 | TIP | RegSeg | RegSeg: An End-to-End Network for Multimodal RGB-Thermal Registration and Semantic Segmentation |
| 2024 | TNNLS | MDRNet+  |
Mitigating Modality Discrepancies for RGB-T Semantic Segmentation |
| 2024 | TITS | — | A RGB-Thermal Image Segmentation Method Based on Parameter Sharing and Attention Fusion for Safe Autonomous Driving |
| 2024 | TMM | CAINet  |
Context-Aware Interaction Network for RGB-T Semantic Segmentation |
| 2024 | TCSVT | MDNet  |
Mamba-Effective Diffusion-Distillation Network for RGB-Thermal Urban Dense Prediction |
| 2024 | AAAI | MSG | Prompting Multi-Modal Image Segmentation With Semantic Grouping |
| 2024 | PR | RCCM | Region-Adaptive and Context-Complementary Cross Modulation for RGB-T Semantic Segmentation |
| 2024 | TIV | MGSGNet-S*  |
Multilayer Guided Semantic Graph Network via Knowledge Distillation for RGB-Thermal Urban Scene Parsing |
| 2024 | TIV | MDBFNet | Multi-Branch Differential Bidirectional Fusion Network for RGB-T Semantic Segmentation |
| 2024 | RAL | TCNet | Temporal Consistency for RGB-Thermal Data-Based Semantic Scene Understanding |
| 2024 | ICRA | 🔥 CRM  |
Complementary Random Masking for RGB-Thermal Semantic Segmentation |
| 2024 | Neurocomputing | DHFNet  |
Decoupled Hierarchical Fusion Network for RGB-T Dense Prediction Tasks |
| 2024 | KBS | CLNet  |
Contrastive Learning-Based Knowledge Distillation for RGB-Thermal Urban Scene Semantic Segmentation |
| 2023 | PR | CCFFNet | Complementarity-Aware Cross-Modal Feature Fusion Network for RGB-T Semantic Segmentation |
| 2023 | TCSVT | — | Dual-Space Graph-Based Interaction Network for RGB-Thermal Semantic Segmentation in Electric Power Scene |
| 2023 | TCSVT | MMSMCNet  |
Modal Memory Sharing and Morphological Complementary Networks for RGB-T Urban Scene Semantic Segmentation |
| 2023 | TCSVT | SGFNet  |
Semantic-Guided Fusion Network for RGB-Thermal Semantic Segmentation |
| 2023 | TIV | CACFNet | CACFNet: Cross-Modal Attention Cascaded Fusion Network for RGB-T Urban Scene Parsing |
| 2023 | TSMC | DBCNet | DBCNet: Dynamic Bilateral Cross-Fusion Network for RGB-T Urban Scene Understanding in Intelligent Vehicles |
| 2023 | TIV | SASEM  |
On Exploring Shape and Semantic Enhancements for RGB-X Semantic Segmentation |
| 2023 | TITS | ECGF | Embedded Control Gate Fusion and Attention Residual Learning for RGB-Thermal Urban Scene Parsing |
| 2023 | GRSL | UTFNet  |
Uncertainty-Guided Trustworthy Fusion Network for RGB-Thermal Semantic Segmentation |
| 2023 | TIM | SFAF-MA  |
Spatial Feature Aggregation and Fusion With Modality Adaptation for RGB-Thermal Semantic Segmentation |
| 2022 | AAAI | EGFNet  |
Edge-Aware Guidance Fusion Network for RGB-Thermal Scene Parsing |
| 2022 | TITS | 🔥 CMX  |
Cross-Modal Fusion for RGB-X Semantic Segmentation With Transformers |
| 2022 | TIV | MTANet  |
Multitask-Aware Network With Hierarchical Multimodal Fusion for RGB-T Urban Scene Understanding |
| 2022 | TCSVT | LASNet  |
RGB-T Semantic Segmentation With Location, Activation, and Sharpening |
| 2022 | TCSVT | FDCNet | A Feature Divide-and-Conquer Network for RGB-T Semantic Segmentation |
| 2022 | SPL | GEBNet  |
GEBNet: Graph-Enhancement Branch Network for RGB-T Scene Parsing |
| 2022 | Neurocomputing | GCNet | Grid-Like Context-Aware Network for RGB-Thermal Semantic Segmentation |
| 2021 | CVPR | ABMDRNet | Adaptive-Weighted Bi-Directional Modality Difference Reduction Network for RGB-T Semantic Segmentation |
| 2021 | TIP | GMNet  |
Graded-Feature Multilabel-Learning Network for RGB-Thermal Urban Scene Semantic Segmentation |
| 2021 | TMM | MFFENet | Multiscale Feature Fusion and Enhancement Network for RGB-Thermal Urban Road Scene Parsing |
| 2021 | IROS | FEANet  |
Feature-Enhanced Attention Network for RGB-Thermal Real-Time Semantic Segmentation |
| 2021 | IROS | HeatNet | HeatNet: Bridging the Day-Night Domain Gap in Semantic Segmentation With Thermal Images |
| 2021 | Neurocomputing | CCAFFMNet | Dual-Spectral Semantic Segmentation Network With Channel-Coordinate Attention Feature Fusion Module |
| 2020 | TASE | FuseSeg | FuseSeg: Semantic Segmentation of Urban Scenes Based on RGB and Thermal Data Fusion |
| 2020 | ICRA | 🔥 PST900  |
PST900: RGB-Thermal Calibration, Dataset and Segmentation Network |
| 2019 | RAL | 🔥 RTFNet  |
RTFNet: RGB-Thermal Fusion Network for Semantic Segmentation of Urban Scenes |
| 2017 | IROS | 🔥 MFNet  |
Towards Real-Time Semantic Segmentation for Autonomous Vehicles With Multi-Spectral Scenes |
| Year | Venue | Method | Title |
|---|---|---|---|
| 2026 | TASE | GFAF-Net | GFAF-Net: Global–Local Feature Extraction and Adaptive Fusion Network for RGB-T Crowd Counting in Video Surveillance Systems |
| 2026 | JIOT | BigCounter | BigCounter: A Bidirectional-Guided Network With Scene-Semantics-Driven Fusion for RGB-Thermal Crowd Counting |
| 2026 | JIOT | SONet | SONet: An Efficient, Lightweight, and Accurate RGB-T Crowd Counting Network for Smart City Edge Computing |
| 2026 | PR | VMMNet | Multi-Modal Mamba Framework for RGB-T Crowd Counting With Linear Complexity |
| 2026 | PR | CSAFNet  |
Cross-Modal Spatial Alignment and Fusion Network for RGB-T Crowd Counting |
| 2025 | CVPR | Free Lunch  |
Free Lunch Enhancements for Multi-Modal Crowd Counting |
| 2025 | TMM | MISF-Net  |
MISF-Net: Modality-Invariant and -Specific Fusion Network for RGB-T Crowd Counting |
| 2025 | TCSVT | MHKDF  |
A Mutual Head Knowledge Distillation Framework for Lightweight RGB-T Crowd Counting |
| 2025 | TIM | GLFNet | GLFNet: An RGB-T Crowd Counting Network Based on Global–Local Multimodal Feature Fusion |
| 2025 | TIM | MMFFNet | MMFFNet: Multimodal Feature Fusion Network for RGB-T Crowd Counting |
| 2025 | JIOT | RGBT-Booster  |
RGBT-Booster: Detail-Boosted Fusion Network for RGB-Thermal Crowd Counting With Local Contrastive Learning |
| 2024 | ECCV | BMCC  |
Multi-Modal Crowd Counting via a Broker Modality |
| 2024 | TITS | MC³Net  |
MC³Net: Multimodality Cross-Guided Compensation Coordination Network for RGB-T Crowd Counting |
| 2023 | RAL | 🔥 EAEFNet |
Explicit Attention-Enhanced Fusion for RGB-Thermal Perception Tasks |
| 2022 | TITS | DEFNet  |
DEFNet: Dual-Branch Enhanced Feature Fusion Network for RGB-T Crowd Counting |
| 2022 | ACCV | CSCA  |
Spatio-Channel Attention Blocks for Cross-Modal Crowd Counting |
| 2022 | BMVC | MSDTrans | RGB-T Multi-Modal Crowd Counting Based on Transformer |
| 2022 | ISCAS | TAFNet | TAFNet: A Three-Stream Adaptive Fusion Network for RGB-T Crowd Counting |
| 2021 | CVPR | 🔥 IADM  |
Cross-Modal Collaborative Representation Learning and a Large-Scale RGBT Benchmark for Crowd Counting |
| Dataset | Task | Notes | Links |
|---|---|---|---|
| VT821 / VT1000 / VT5000 | Salient Object Detection | Classic RGB-T SOD benchmarks | Resources |
| UVT20K | Salient Object Detection | Large-scale unaligned RGB-T SOD benchmark | PCNet |
| VI-RGBT1500 | Salient Object Detection | Variable-illumination RGB-T SOD benchmark | Dataset / Code |
| MFNet | Semantic Segmentation | RGB-T urban scenes | Dataset |
| PST900 | Semantic Segmentation | RGB-T calibration and segmentation | Dataset / Code |
| RGBT-CC | Crowd Counting | Large-scale RGB-T crowd counting benchmark | Project |
| DroneRGBT | Crowd Counting | Drone-based RGB-T crowd counting | Dataset / Code |
| Task | Resources | Notes |
|---|---|---|
| Salient Object Detection | PySODEvalToolkit · SOD Evaluation Metrics · Saliency Evaluation Toolbox | Common SOD evaluation toolkits and metrics |
| Semantic Segmentation | RTFNet · GMNet · CMX | Reference implementations with semantic-segmentation evaluation scripts |
| Crowd Counting | DEFNet · RGBTCrowdCounting | Reference implementations and crowd-counting evaluation tools |
| Area | Resource | Focus |
|---|---|---|
| RGB-T | Awesome-RGBT | Papers and resources across RGB-T / visible-thermal perception |
| RGB-T SOD | RGBT Salient Object Detection | RGB-T salient object detection papers, datasets, and results |
| RGB-T Fusion | Awesome-RGBT-Fusion | Visible-infrared image fusion and related multimodal methods |
| Thermal Segmentation | Awesome Thermal Segmentation | Thermal and RGB-T semantic segmentation resources |
| Multimodal SOD | Awesome Salient Object Detection | Curated SOD resources with emphasis on RGB-D / multimodal SOD |
| RGB-D SOD | RGBD-SODsurvey | RGB-D SOD survey, models, datasets, benchmarks, and evaluation |
| RGB-D SOD | D3Net Benchmark | RGB-D salient object detection benchmark and evaluation resources |
| Co-SOD | CoSOD3K | Co-salient object detection benchmark, dataset, and resources |
| Video SOD | Video SOD Papers | Paper list for video salient object detection |
| General SOD | SODsurvey | Deep-learning-era salient object detection survey and benchmark resources |
PRs are welcome. Please prefer official paper/project links and official GitHub repositories.
Thanks to the authors and maintainers of the papers, codebases, datasets, and evaluation tools collected here.
⭐ Thanks to all authors for their excellent work!