Underwater image enhancement using a mixed generative adversarial network

Abstract

Abstract Underwater images intuitively reflect the underwater environment information. However, underwater images have defects such as colour distortion and low contrast, which seriously affect the processing of complex underwater visual tasks. Here, a novel mixed model called mixed underwater image generative adversarial network (MUGAN) is presented, consisting of a generator and corresponding discriminator. The generator is built following the U‐shaped architecture, where a mixed block of convolution and self‐attention is developed. It effectively exploits the complementarity between the two paradigms. In addition, a dual discriminator is employed to induce the generator to produce realistic images at both the global semantic and local detail levels, which is only discriminates based on the patch‐level information. Meanwhile, a multi‐term loss function is formulated to supervise adversarial training by evaluating the perceptual quality of an image based on its global content, local texture and illumination smoothness. To validate the proposed approach, extensive experiments are conducted on the public underwater datasets. MUGAN achieves promising performance in terms of colour, contrast and naturalness, showing a significant improvement over other competitive models in visual quality and quantitative metrics.