Logo image
Text in the dark: Extremely low-light text image enhancement
期刊文章   同儕審查

Text in the dark: Extremely low-light text image enhancement

Che-Tsung Lin, Chun Chet Ng, Zhi Qin Tan, Wan Jun Nah, Xinyu Wang, Jie Long Kew, Pohao Hsu, Shang-Hong Lai, Chee Seng Chan 和 Christopher Zach
Signal processing. Image communication, 卷.130, 頁.117222
01/01/2025
Web of Science ID: WOS:001350573800001

摘要

Edge attention Extremely low-light image enhancement Scene text detection Scene text recognition Text aware augmentation
Extremely low-light text images pose significant challenges for scene text detection. Existing methods enhance these images using low-light image enhancement techniques before text detection. However, they fail to address the importance of low-level features, which are essential for optimal performance in downstream scene text tasks. Further research is also limited by the scarcity of extremely low-light text datasets. To address these limitations, we propose a novel, text-aware extremely low-light image enhancement framework. Our approach first integrates a Text-Aware Copy-Paste (Text-CP) augmentation method as a preprocessing step, followed by a dual-encoder–decoder architecture enhanced with Edge-Aware attention modules. We also introduce text detection and edge reconstruction losses to train the model to generate images with higher text visibility. Additionally, we propose a Supervised Deep Curve Estimation (Supervised-DCE) model for synthesizing extremely low-light images, allowing training on publicly available scene text datasets such as IC15. To further advance this domain, we annotated texts in the extremely low-light See In the Dark (SID) and ordinary LOw-Light (LOL) datasets. The proposed framework is rigorously tested against various traditional and deep learning-based methods on the newly labeled SID-Sony-Text, SID-Fuji-Text, LOL-Text, and synthetic extremely low-light IC15 datasets. Our extensive experiments demonstrate notable improvements in both image enhancement and scene text tasks, showcasing the model’s efficacy in text detection under extremely low-light conditions. Code and datasets will be released publicly at https://github.com/chunchet-ng/Text-in-the-Dark. •We present a new method to enhance low-light images, especially scene text regions.•We developed a novel Supervised-DCE model to synthesize extremely low-light images.•We create 3 new low-light text datasets SID-Sony-Text, SID-Fuji-Text, and LOL-Text.•Our new datasets assess enhanced low-light images with scene text extraction tasks.•Our method achieves notable gains on all datasets quantitatively and qualitatively.

相關連結

指標

1 檢視次數

詳細資料

Logo image