Escolar Documentos
Profissional Documentos
Cultura Documentos
978-1-5386-0462-5/17/$31.00 2017
c IEEE. VCIP 2017, Dec. 10 - 13, 2017, St Petersburg, U.S.A.
Fig. 3. color correction: (a) the raw underwater image and its histograms
of three channels, (b) the color corrected image and its histograms of three
channels.
and Lcmin are the maximum and the minimum values used for
normalization. λ is a parameter to control the image dynamic
range, empirically set to 2. If the parameter value is too low,
will cause the result image over-enhacement. If the parameter
value is too high, will lead in under-enhancement. Finally, we
make a normalization based on [Lcmin , Lcmax ] to get the color
corrected results. The average of three channels tends to be the
same and the histogram distribution ranges of three channels
cover total x-axis.
B. Illumination Adjustment
Fig. 2. A flow chart of the proposed method.
After correcting the color, the image still exists the under-
exposed issue. But now we only need to focus on the illumi-
nation. So we convert RGB space of color corrected image
• Based on Retinex model, we propose a new illumina- to HSV space, then exploit the Value layer of HSV space to
tion adjustment method. In the process of solving the make the illumination adjustment.
optimization problem, we use a fast approximate method Based on Retinex model, we decompose the energy of Value
instead of traditional iteration solution. layer of color corrected image into two components:
Vcr = R · M, (2)
II. PROPOSED METHOD
A flowchart of the proposed method is shown in Fig.2. The where Vcr is the Value layer of color corrected image, R
method contains two steps: color correction to solve the color is the reflectance component of Vcr and M is illumination
cast and illumination adjustment to improve the lightness. component of Vcr . The underwater environment has the
different condition of illumination, since the scattering and
A. Color Correction absorbing effects make the light changeable [8]. Removing the
Since the blue color and green color travel longer in influence of changeable illumination M, we can get the stable
the water due to shorter wavelength, underwater images are reflectance of observed scene R, that is the real appearance
dominated by blue color or green color. As shown in Fig. 3(a), of the scene.
the underwater image captured in certain depth is greenish. As According to equation (2), it is an ill-posed problem to
shown in histogram distributions of three channels, the mean compute R and M under one known variable Vcr . We can
of red channel is smaller than that of green channel. According estimate illumination map firstly, then make a correction on
to the gray world assumption, for an image with a large amount illumination map. Finally, through the equation (2) and the
of color change, the average of three channels tends to be the corrected illumination map, we can easily get the enhanced
same. Meanwhile, the histogram distribution ranges of three reflectance component, namely the desired image solved the
channels don’t cover [0,255]. To address the color cast, a color under-exposure.
correction method based on gray world assumption is adopted. 1) illumination map estimation: First, we use the Value
The color correction method calculates the mean value and the layer of HSV space as the initial of illumination map, M0 ←
variance value among three channels, independently. Then we Vcr . According to the prior that the estimated illumination
exploit the feature values of each channel: mean and variance, map need to preserve the complete structure of edges and
to design a new normalization range as follows: smooth the details, we build a optimization method as follow-
ing formulation:
Lcmax = Lcmean + λLcvar 2
(1) min M0 − M2 + α W · M1 ,
Lcmin = Lcmean − λLcvar M
(3)
where c ∈ {r, g, b}, Lcmean and Lcvar are the mean and where α is used to controll the trade-off between the fidelity
variance of the captured underwater image, respectively, Lcmax term and gradient term, setting as 0.5. W is the weight matrix.
978-1-5386-0462-5/17/$31.00 2017
c IEEE. VCIP 2017, Dec. 10 - 13, 2017, St Petersburg, U.S.A.
is the difference operator at both in horizontal and vertical A. Subjective Comparison
directions. ∗1 and ∗2 are the l1 and l2 norm, respectively.
The design of W is key to distinguishing from the strong
structure edges and the textures. A major edge in a local win-
dow contributes more similar-direction gradients than textures
with complex patterns [9]. Therefore, The weight in a window
that contains meaningful edges should be smaller than that
in a window only containing textures. The weight matrix is
designed as follows:
1
Wd (x) =
, d ∈ {h, v} , (4)
y∈Ω(x) d M0 (y) + ε
978-1-5386-0462-5/17/$31.00 2017
c IEEE. VCIP 2017, Dec. 10 - 13, 2017, St Petersburg, U.S.A.
CB dataset, and Fattal dataset, our method performs the under water. The method is composed of color correction and
best among other methods. In addition, our method performs illumination adjustment. First, by adopting special normaliza-
relatively good on Chiang dataset. tion method, we can greatly correct the color cast of images.
To further validate the robustness of our method, we make Then based on Retinex model, we improve the lightness of
experiments on integrated dataset including four datasets. As image. During the procedure of illumination adjustment, we
shown in Fig. 6, the height of histogram represents the variance preserve the structure edges and smooth the textures well.
range of evaluation index, and the red line denotes the mean Experiment results demonstrate that our method is superior
value of evaluation index. From the Fig. 6, we can see that the in genuine color, natural appearance, and visibility than state-
fluctuation of our method is the smallest among other methods, of-art methods. Besides, our method is robust and effective in
and the mean value is the highest. different datasets. The calculation of complexity is also lower
than other methods.
Matlab code of this paper are available at personal website3 .
Besides, Our method doesn’t take the fuzz into consideration.
If you want to enhance the fuzzy image in further, you can
add a dehaze step.
ACKNOWLEDGMENTS
This work was supported by Science and Technol-
ogy Planning Project of Guangdong Province, China (No.
2014B090910001 and No. 2014B010117007), Shenzhen Pea-
cock Plan (20130408-183003656), and the grant of National
Science Foundation of China (No.U1611461).
R EFERENCES
[1] C. Y. Li, J. C. Guo, R. M. Cong, Y. W. Pang, and B. Wang, “Underwater
image enhancement by dehazing with minimum information loss and
histogram distribution prior,” IEEE Transactions on Image Processing,
vol. 25, no. 12, pp. 5664–5677, 2016.
[2] S. Q. Duntley, “Light in the sea*,” Journal of the Optical Society of
Fig. 6. Comparison of robustness among different methods. America, vol. 53, no. 2, pp. 214–233, 1963.
[3] R. Fattal, “Single image dehazing,” ACM Transactions on Graphics,
2) Processing Time Comparison: Due to the size of testing vol. 27, no. 3, p. 1, 2008.
[4] K. He, J. Sun, and X. Tang, “Guided Image Filtering (ECCV),” European
images are variant, we make one experiment on integrated Confenrence on Computer Vision, vol. 35, no. 7, pp. 1–14, 2010.
dataset directly. Meanwhile, we make experiments on two [5] C. Ancuti, C. O. Ancuti, T. Haber, and P. Bekaert, “Enhancing under-
different scale datasets, which include the same size of images water images and videos by fusion,” in Computer Vision and Pattern
Recognition (CVPR), 2012 IEEE Conference on. IEEE, 2012, pp. 81–
respectively. We resize all images of integrated dataset to large 88.
size (1600x1200) or small size (512x384). [6] X. Fu, P. Zhuang, Y. Huang, Y. Liao, X.-P. Zhang, and X. Ding,
From the Table 2, we can know that PT(Processing Time) of “A retinex-based enhancing approach for single underwater image,”
in Image Processing (ICIP), 2014 IEEE International Conference on.
our method is the shortest of all methods, besides SID. Fattal’s IEEE, 2014, pp. 4572–4576.
SID is based on a statistically independent assumption in a [7] E. H. Land and J. J. McCann, “Lightness and retinex theory,” JOURNAL
local patch, the calculation is simple and effective. However, OF THE OPTICAL SOCIETY OF AMERICA, pp. 1–11, 1971.
[8] K. Zhang, W. Jin, Q. Su, and X. Wang, “Multi-scale retinex enhancement
it can’t solve the color cast and under-exposed problem. The algorithm on luminance channel of color underwater image,” Infrared
visual effect of resulting image is not ideal. So our method Technology, vol. 3, pp. 1003–1006, 2011.
can get the better visual effect more fastly. [9] L. Xu, Q. Yan, Y. Xia, and J. Jia, “Structure extraction from texture via
relative total variation,” Acm Transactions on Graphics, vol. 31, no. 6,
p. 139, 2012.
TABLE II [10] N. Carlevaris-Bianco, A. Mohan, and R. M. Eustice, “Initial results in
C OMPARISON OF PT AMONG DIFFERENT METHODS
underwater single image dehazing,” MTS/IEEE Seattle, OCEANS 2010,
2010.
Method PT PT(1600x1200) PT(512x384) [11] J. Y. Chiang and Y. C. Chen, “Underwater image enhancement by
HE-Lab 0.559 1.584 0.169 wavelength compensation and dehazing,” IEEE Transactions on Image
SID 0.096 0.269 0.023 Processing A Publication of the IEEE Signal Processing Society, vol. 21,
DCP 11.997 35.313 3.540 no. 4, p. 1756, 2012.
Fu 1.508 4.509 0.393 [12] K. Panetta, C. Gao, and S. Agaian, “Human-visual-system-inspired
Ours 0.415 1.247 0.102 underwater image quality measures,” IEEE Journal of Oceanic Engi-
neering, vol. 41, no. 3, pp. 541–551, 2016.
IV. CONCLUSIONS
A new fast underwater image enhancement method is pro-
posed in this paper, which can solve the color cast and under-
exposed problems caused by the absorbing and scattering 3 https://github.com/zhangwenhao123/VCIP2017
978-1-5386-0462-5/17/$31.00 2017
c IEEE. VCIP 2017, Dec. 10 - 13, 2017, St Petersburg, U.S.A.