Image Enhancement Based on Histogram-Guided Multiple Transformation Function Estimation

Jaemin Park, An Gia Vien, Thuy Thi Pham, Hanul Kim, Chul Lee

Research output: Contribution to journalArticlepeer-review

Abstract

Although recent deep learning-based algorithms have achieved significant performance improvements in various image enhancement tasks, most approaches have been developed using image-to-image translation, which is challenging to interpret and analyze the enhancement processes. Several attempts have been made to use the image-to-transformation function approach for better interpretability; however, they often fail to generate complex color mappings, degrading image quality. In this work, we develop a novel transformation function-based algorithm that estimates multiple transformation functions with different properties by exploiting both the spatial and statistical characteristics of the input image to describe complex color mapping. First, we extract the image features that capture spatial information, considering their channel correlations. Next, we estimate multiple transformation functions utilizing a cross-attention block to capture the relevance between spatial and statistical information in the input image and its histogram, respectively. We then estimate the weight maps indicating the pixel-wise contribution of each transformation function by exploiting the spatial correlation between the input and transformed images obtained by each transformation function. Finally, we obtain an enhanced image by taking the weighted sum of the transformed images and the corresponding weight maps. Experimental results demonstrate that the proposed algorithm outperforms state-of-the-art algorithms on various image enhancement tasks.

Original languageEnglish
Pages (from-to)6664-6678
Number of pages15
JournalIEEE Transactions on Consumer Electronics
Volume70
Issue number4
DOIs
StatePublished - 2024

Keywords

  • Image enhancement
  • color representation
  • cross-attention
  • histogram
  • multiple transformation functions

Fingerprint

Dive into the research topics of 'Image Enhancement Based on Histogram-Guided Multiple Transformation Function Estimation'. Together they form a unique fingerprint.

Cite this