Logo image
PH-Mamba: Enhancing Mamba With Position Encoding and Harmonized Attention for Image Deraining and Beyond
期刊文章   同儕審查

PH-Mamba: Enhancing Mamba With Position Encoding and Harmonized Attention for Image Deraining and Beyond

Kui Jiang, Junjun Jiang, Xianming Liu, Hongxun Yao 和 Chia-Wen Lin
IEEE transactions on image processing, 卷.35, 頁碼.1727-1739
01/01/2026
PMID: 41385422
Web of Science ID: WOS:001691030300006

摘要

Adaptation models Degradation Image coding Image deraining Image reconstruction Image restoration mamba Perturbation methods position encoding Rain Transformers vector decomposition and synthesis Vectors Computer Architecture
Mamba and its variants excel at modeling long-range dependencies with linear computational complexity, making them effective for diverse vision tasks. However, Mamba's reliance on unfolding 1D sequential representations necessitates multiple directional scans to recover lost spatial dependencies. This introduces significant computational overhead, redundant token traversal, and inefficiencies that compromise accuracy in real-world applications. To this end, we propose PH-Mamba, a novel framework integrating position encoding and harmonized attention for image deraining and beyond. PH-Mamba transforms Mamba's scanning process into a position-guided, unidirectional scanning that selectively prioritizes degradation-relevant tokens. Specifically, we devise a position-guided hybrid Mamba module (PHMM) that jointly encodes perturbation features alongside their spatial coordinates and harmonized representation to model consistent degradation patterns. Within PHMM, a harmonized Transformer is developed to focus on uncertain regions while suppressing noise interference, thereby improving spatial modeling fidelity. Additionally, we employ a vector decomposition and synthesis strategy to enable the unified representation layout to global degradation by directional scanning while minimizing redundancy. By cascading multiple PHMM blocks, PH-Mamba combines global positional guidance with local differential features to strengthen contextual learning. Extensive experiments demonstrate the superiority of PH-Mamba across low-level image restoration benchmarks. For example, compared to NeRD, PH-Mamba achieves a 0.60 dB PSNR improvement while requiring 88.9% fewer parameters, 36.2% less computation, and 63.0% faster inference time.

檔案與連結 (1)

url
https://ieeexplore.ieee.org/document/11299444檢視
已出版(紀錄版本)

相關連結

指標

1 檢視次數

詳細資料

Logo image