TY - JOUR
T1 - Image Enhancement Based on Histogram-Guided Multiple Transformation Function Estimation
AU - Park, Jaemin
AU - Vien, An Gia
AU - Pham, Thuy Thi
AU - Kim, Hanul
AU - Lee, Chul
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Although recent deep learning-based algorithms have achieved significant performance improvements in various image enhancement tasks, most approaches have been developed using image-to-image translation, which is challenging to interpret and analyze the enhancement processes. Several attempts have been made to use the image-to-transformation function approach for better interpretability; however, they often fail to generate complex color mappings, degrading image quality. In this work, we develop a novel transformation function-based algorithm that estimates multiple transformation functions with different properties by exploiting both the spatial and statistical characteristics of the input image to describe complex color mapping. First, we extract the image features that capture spatial information, considering their channel correlations. Next, we estimate multiple transformation functions utilizing a cross-attention block to capture the relevance between spatial and statistical information in the input image and its histogram, respectively. We then estimate the weight maps indicating the pixel-wise contribution of each transformation function by exploiting the spatial correlation between the input and transformed images obtained by each transformation function. Finally, we obtain an enhanced image by taking the weighted sum of the transformed images and the corresponding weight maps. Experimental results demonstrate that the proposed algorithm outperforms state-of-the-art algorithms on various image enhancement tasks.
AB - Although recent deep learning-based algorithms have achieved significant performance improvements in various image enhancement tasks, most approaches have been developed using image-to-image translation, which is challenging to interpret and analyze the enhancement processes. Several attempts have been made to use the image-to-transformation function approach for better interpretability; however, they often fail to generate complex color mappings, degrading image quality. In this work, we develop a novel transformation function-based algorithm that estimates multiple transformation functions with different properties by exploiting both the spatial and statistical characteristics of the input image to describe complex color mapping. First, we extract the image features that capture spatial information, considering their channel correlations. Next, we estimate multiple transformation functions utilizing a cross-attention block to capture the relevance between spatial and statistical information in the input image and its histogram, respectively. We then estimate the weight maps indicating the pixel-wise contribution of each transformation function by exploiting the spatial correlation between the input and transformed images obtained by each transformation function. Finally, we obtain an enhanced image by taking the weighted sum of the transformed images and the corresponding weight maps. Experimental results demonstrate that the proposed algorithm outperforms state-of-the-art algorithms on various image enhancement tasks.
KW - Image enhancement
KW - color representation
KW - cross-attention
KW - histogram
KW - multiple transformation functions
UR - http://www.scopus.com/inward/record.url?scp=85207123500&partnerID=8YFLogxK
U2 - 10.1109/TCE.2024.3476033
DO - 10.1109/TCE.2024.3476033
M3 - Article
AN - SCOPUS:85207123500
SN - 0098-3063
VL - 70
SP - 6664
EP - 6678
JO - IEEE Transactions on Consumer Electronics
JF - IEEE Transactions on Consumer Electronics
IS - 4
ER -