Logo image
Rain-free and Residue Hand-in-Hand: A Progressive Coupled Network for Real-Time Image Deraining
期刊文章   同儕審查

Rain-free and Residue Hand-in-Hand: A Progressive Coupled Network for Real-Time Image Deraining

Kui Jiang, Zhongyuan Wang, Peng Yi, Chen Chen, Zheng Wang, Zheng Wang, Xiao Wang, Junjun JiangChia-Wen Lin
IEEE Transactions on Image Processing
2021
PMID: 34403336

摘要

Attention mechanism Computational modeling Customer relationship management Degradation Feature extraction Image deraining Image restoration Multi-scale fusion Non-local network Rain Task analysis Software Computer Graphics and Computer-Aided Design
Rainy weather is a challenge for many vision-oriented tasks (e.g., object detection and segmentation), which causes performance degradation. Image deraining is an effective solution to avoid performance drop of downstream vision tasks. However, most existing deraining methods either fail to produce satisfactory restoration results or cost too much computation. In this work, considering both effectiveness and efficiency of image deraining, we propose a progressive coupled network (PCNet) to well separate rain streaks while preserving rain-free details. To this end, we investigate the blending correlations between them and particularly devise a novel coupled representation module (CRM) to learn the joint features and the blending correlations. By cascading multiple CRMs, PCNet extracts the hierarchical features of multi-scale rain streaks, and separates the rain-free content and rain streaks progressively. To promote computation efficiency, we employ depth-wise separable convolutions and a U-shaped structure, and construct CRM in an asymmetric architecture to reduce model parameters and memory footprint. Extensive experiments are conducted to evaluate the efficacy of the proposed PCNet in two aspects: (1) image deraining on several synthetic and real-world rain datasets and (2) joint image deraining and downstream vision tasks (e.g., object detection and segmentation). Furthermore, we show that the proposed CRM can be easily adopted to similar image restoration tasks including image dehazing and low-light enhancement with competitive performance. The source code is available at https://github.com/kuijiang0802/PCNet.

相關連結

指標

1 檢視次數

詳細資料

Logo image