Escolar Documentos
Profissional Documentos
Cultura Documentos
I. INTRODUCTION
Manuscript received December 29, 2008; revised December 13, 2009. First
published January 26, 2010; current version published April 16, 2010. This work
was supported by DFG Grant SPP-1324, KU 1446/13-1. The associate editor
coordinating the review of this manuscript and approving it for publication was
Prof. Minh N. Do.
The author is with the Institue of Mathematics, University of Osnabrueck,
Osnabrueck, 49080 Germany (e-mail: wlim@mathematik.uni-osnabrueck.de).
Digital Object Identifier 10.1109/TIP.2010.2041410
to artifacts in denoising and compression. Bandelets are representation elements adapted to the function that is represented.
Asymptotically, the resulting bandelets are regular functions
with compact support, which is not the case of contourlets.
However, in order to find basis optimally adapted to an image
of size , the bandelet transform searches for the optimal
geometry. For an image of pixels, the complexity of this best
which requires extensive
bandelet basis algorithm is
computation [8].
Recently, a new representation scheme has been introduced
[9], [10]. This is so called the shearlet representation which
yields nearly optimal approximation properties [11]. Shearlets
are frame elements used in this representation scheme. This new
representation is based on a simple and rigorous mathematical
framework which not only provides a more flexible theoretical
tool for the geometric representation of multidimensional data,
but is also more natural for implementation. As a result, the
shearlet approach can be associated to a multiresolution analysis (MRA) and this leads to a unified treatment of both the
continuous and discrete world [10]. However, all known constructions of shearlets so far are band-limited functions which
have an unbounded support in space domain. In fact, in order to
capture the local features of a given image efficiently, representation elements need to be compactly supported in the space domain. Furthermore, this property often leads to more convenient
framework for practically relevant discrete implementation.
The paper is structured as follows. In Section II, we describe
some basic properties of shearlets and explain an intuitive idea
of how shearlets can provide efficient geometric representations.
We construct compactly supported shearlets generated by separable functions in Section III. In this case, the separable generating functions are constructed using a MRA and this leads to
the fast discrete shearlet transform (DST) which we describe in
Section IV. Applications of the DST in image approximations
and denoising are discussed in Sections V and VI. Concluding
remarks are drawn in Section VII.
II. SHEARLETS
A family of vectors
constitute a frame for a Hilbert
such that for
space if there exist two positive constants
each
, we have
Also, for
and
unitary operators:
1167
and
Here, we denote
the set of all
with real entries. Finally, for
and
invertible matrices
and
, we define
(1)
and
and
induced by shearlets in
9.
(2)
where
. We
assume that
for
and
and
for
where
and
(3)
(or
) is a frame for
, then we call the functions
and
in the system (or
) shearlets.
Observe that shearlets in are obtained by applying translations with the sampling constant followed by applying
and shear matrices
to the
anisotropic scaling matrices
and . Those matrices
and
fixed generating functions
lead to windows which can be elongated along arbitrary directions and the geometric structures of singularities in images
can be efficiently represented and analyzed using those window
functions. In fact, it was shown that 2-D piecewise smooth
singularities can be approximated with
functions with
nearly optimal approximation rate using shearlets. We refer to
[11] for details. Furthermore, one can show that shearlets can
completely analyze the singular structures of piecewise smooth
images [12]. Those properties of shearlets are useful especially
in image processing since singularities and irregular structures
carry essential information in an underlying image. For example, discontinuities in the intensity of an image indicate the
presence of edges. The following example shows how shearlets
and
localize the frequency domain. Let us assume that
in (1) and (2). For any
(or
), let
and
be given by
If
1168
domain and (8) is satisfied then there exists the sampling congenerate a frame
stant such that the functions
with any sampling constant
. This result can be easily
extended to obtain similar sufficient conditions for to form a
.
frame for
Corollary III.3: Let and be constants as in Proposition
and
. For
III.2. Assume that
, we define
such that
and
If
(9)
and see equation (10), shown at the bottom of the page, then
such that
is a frame for
for all
there exists
.
Proof: First, it is easy to see that
(6)
then
is a frame for
satisfying
and
This implies that
show (8). Let
and
for
(8)
for a.e
and
(4)
for
(10)
1169
there exists
such that
and generate a shearlet frame
of
for
.
Proof: Note that in this case, (4) and (5) become
(11)
Fig. 2. Essential frequency supports of shearlets
and
in the frequency
plane: Nonseparable shearlets (left) and separable shearlets (right). Both of separable and nonseparable windows can cover whole frequency plane by applying
shear and scaling matrices.
and
(12)
, where
. Equation (11) and (12)
for a.e
can be similarly estimated to obtain (6) and the upper bound
in (12). We now estimate the lower bound in (12). Define
and
Then we obtain
Fig. 3. Examples of shearlets in the space and frequency domain: Shearlets
associated with matrices A and B in (1) when j
; (top rows). The
j associated with matrices
magnitude of the Fourier transform of shearlets j
A and B in (1) when j
; (bottom rows).
=0 1
=0 1
for a.e
and
in the next sections. Fig. 3 shows compactly supported shearlets associated with matrices
and
which provide directional windows in the space and frequency domain. Note that
in this case, all of those are generated by separable functions of
. We now describe concrete examples of
the form
compactly supported shearlet frames using Corollaries III.3 and
III.4.
B. Examples of Compactly Supported Shearlets
Assume that
and
with
for even and
for
the following two scaling equations:
and
defined as follows:
1170
Let and
now define
and
(15)
and
Then
and
and
where
and
generate a frame
Define
for
and
and
where
,
.
where
. Let
. Since
for
for
and
,
we obtain shearlets
and
Also, define
(14)
and
such that
the filters
for fixed
and
and
and
1171
(19)
On the other hand, we have
(20)
Fig. 4. (a) Two computation steps to compute the shearlet coefficients: Refinement along the horizontal axis (top) and resampling associated with shear matrix
(middle) followed by the separable wavelet transform (bottom). (b) Refinement
along the horizontal to obtain the coefficients of
when
and
k = 1.
where
the Fourier coefficients of
. For
, let
j=4
and
be
and
Hence, we have
respectively, where
(21)
where
and
are 1-D convolution and upsampling by
along the horizontal axis. Thus
and
(22)
We also let
when
. The following lemma is an immediate consequence of the cascade algorithm followed from (13) and (14).
satisfy (13) and
Lemma IV.1: Assume that and
, define
and
as in (15).
(14). For each
Then we have
where
(17)
and
(18)
for
.
Proof: See Appendix B
for
. This is simply the separable wavelet transform associated with a diagonal sampling matrix whose diagand
. We also let
onal entries are
and
. Then, by (19) and (20) and (22), see
(23), shown at the bottom of the page, where ,
and
(23)
1172
for
. Similarly, the shearlet coefficients
can be explicitly computed. Also, we have approximating formula as follows:
(25)
where (see the equation shown at the bottom of the page). Using
(24) and (25), we now define the DST
which computes the shearlet coefficients of
. Define
an index set
and
where
(26)
and
is 1
coefficients
for
and
Fig. 5. (a) Directional filters with the grid refinement associated with B
1173
for k = 1.
Fig. 6. (a) Convergence rate of approximating the inverse DST for a random image whose entries are uniformly distributed and Lena: vertical axis: ` relative
error kf 0 f k =kf k and horizontal axis: the number of iterations in conjugate gradient iterations. Random image (solid line) and Lena (dashed line). (b) Tree
structure of wavelet packet basis elements when ` = 2.
B. Inverse Transform
It is well known that an inverse frame operator with reasonable frame bounds can be effectively computed by applying iterative schemes such as conjugate gradient iterations [1]. Let
be the adjoint operator of the DST . Then the pseudo inverse to
and this can be efthe frame operator is given by
ficiently computed by conjugate gradient iterations. As we can
see in Fig. 6(a), only few iterations can still provide good approximation to a given image from the shearlet coefficients.
C. Extended Discrete Shearlet Transform
In the previous section, we derived a fast algorithm to compute the shearlet frame coefficients based on a standard MRA
approach. However, it is often convenient to work with a tight
frame rather than a general frame in many applications. In particular, one can not directly compute an inverse of frame operator (if it is not tight) and needs to use an iterative scheme to approximate the inverse. In this section, we will extend the shearlet
frame which we constructed in the previous section to obtain a
tight frame composed of directional orthonormal bases. We also
show that for this extended construction, each of those directional orthonormal bases provides anisotropic window functions
1174
We first need the following facts which are immediate consequences of the basic ideas of wavelet packet bases [14].
Lemma IV.2: For
, let
. Define
for each
. Assume that
is an orthonormal
basis of
for a fixed and let
and
(27)
where
and are conjugate mirror filters. Then
and
are orthonormal bases of
and
. Furthermore,
.
Proof: For the proof, we refer to [14].
Corollary IV.3: Let be a fixed nonnegative integer. Assume
forms an orthonormal basis of
and a subthat
satisfy the MRA conditions. For
and
spaces
, let
where
and
is an orthonormal basis of
(28)
and
(right) when
. It is clear that
. Similarly, we define
and
and
where
9 (left) and 9~
Then
is an orthonormal basis of
for each
. Fig. 7
shows the frequency tilings obtained by bases
and
when
.
Next, we derive a fast algorithm to compute the extended
and
for
and
shearlet coefficients
. For
, consider binary expansion of
so that
with
. Let
be the Fourier
where
coefficients of
and
where
and
For
By Corollary IV.3, we notice that
and
and
follows:
and
For
, where the filter coefficients
(highpass
filter) and
(lowpass filter). We assume (16) for
with positive integer . Using the same arguments as in
the previous section, one can show that for
and
(see the equation shown at the
bottom of the next page), and this indicates that
1175
for
bases associated with orthogonal transforms
and associated with orthogonal transfor
. The main
forms
idea of our adaptive approximation scheme is similar to the
Matching Pursuit (MP) introduced by Mallat and Zhong [15].
The matching pursuit selects vectors one by one from a given
basis dictionary, while optimizing the signal approximation at
each step. On the other hand, our approximation scheme selects
the best basis so that it provides the best approximation with
nonzero terms among all of the bases
at each step. Let
Similarly, we have
and
where
For
, let us define
Here,
is an index set of
case, the residual is
largest coefficients
. In this
where
Since
is orthogonal to
, we have
and
and
for
. Basically, each subtransform
or
consists of the discrete shear transfom
or
and the
(horianisotropic discrete wavelet transform (ADWT)
zontal direction) or
(vertical direction). Fig. 8 summarizes our extended DST.
and
are orthogonal transFinally, It is clear that each
forms. Therefore, the extended DST consists of those
orthogonal transforms and
is the number of directions. This implies that the inverse DST is simply the adjoint of
with normalization. For
, we have
To minimize
, we must choose the best orthogonal
projection
such that
is maximum among
for
. Let
.
is already comSuppose that the th order residue
. The next iteration chooses the index
puted for
such that
(29)
where
for each
and
(30)
The orthogonality of
and
implies
(31)
1176
Fig. 9. Nonlinear approximation results on different test images: From top left, clockwise: Lena, Barbara, boat, and goldhill. Horizontal axis: The number
of nonzero coefficients in log scale. Vertical axis: PSNR.
between 0 and
yields
(32)
Similarly, summing (31) from
between 0 and
gives
(33)
3. Update: Compute
order residual
4. Stopping rule: If
In this case is the number of iterations and nonzero coefficients are added at each iteration. Therefore,
coefficients
iterations in the MP step. Also we note
are produced after
operations
that our extended DST requires
where is the size of input image. Therefore, the total computation cost of this adaptive approximation scheme is
and this could be highly expensive depending on the
and . However, our tests indicate that only a
choice of
few iterations and directions can still provide good approximations. For numerical tests, we compare the performance of
our adaptive approximation scheme using the extended DST to
other non adaptive transforms such as the discrete biorthogonal
CDF 9/7 wavelet transform (DWT) [16] and contourlet transform (CT) [5] in image compression (see Figs. 9 and 10). We
used 5 level decomposition and only two directions (vertical and
horizontal) and applied one iteration in the MP step. In this case,
the running time of our proposed scheme is competitive to the
standard DWT while it outperforms other transforms. In fact,
with these choices, our adaptive approximation MATLAB routine takes 0.65 s while the DWT MATLAB routine (available at
www-stat.stanford.edu/wavelab/) takes 0.51 s [see Fig. 11(a)].
Finally, we note that one can achieve significant improvement
over other transforms by increasing the number of iterations but
this will increase computation cost as well.
VI. IMAGE DENOISING USING DST
and go to 1.
1177
transforms, we apply hard threshold on the coefficients of various transforms. We choose the threshold
Fig. 10. Approximation results of Barbara image of size 512 512: The
image is reconstructed from 5024 most significant coefficients. (a) Original
image. (b) DWT (PSNR = 25.01). (c) CT (PSNR = 25.87). (d) DST (PSNR
= 26.73).
Fig. 11. Running time of DST and DWT for image approximations and denoising on desktop with 2.53 GHz, 1.98 GB of RAM. (a) Image approximations
and (b) denoising.
where
is a zero-mean Gaussian white noise of variance .
For our numerical tests. We compared the performance of the
extended DST to other transforms such as the Nonsubsampled
Contourlet Transform (NSCT) [17] and Translation Invariant
Wavelet Transform (TIWT) [18] in this denoising task. To highlight the performance of the extended DST relative to other
VII. CONCLUSION
We have constructed compactly supported shearlet system
which can provide efficient directional image representation.
We also have developed the two types of fast discrete implementations of shearlets called the DST and the extended DST. Especially the extended DST is simply applying shear transforms on
the discrete domain followed by the anisotropic wavelet transforms. Thus, the extended DST is implemented by applying
finitely many orthogonal transforms and the inverse transform
is straightforward.
Application of our proposed transform in image approximations and denoising were studied. In image approximations, the
results obtained with our adaptive image representation using
the extended DST are consistently superior to other transforms
such as the DWT and CT both visually and with respect to
PSNR. In denoising, we studied the performance of the extended DST coupled with a hard thresholding estimator. Our results indicate that the DST consistently outperforms other competing transforms such as the NSCT and TIWT in PSNR.
One of the main features of our DST is that it can exactly
compute the shearlet coefficients based on a MRA [see (23)]. In
fact, shear operations preserve the structure of integer lattice and
this allows them to be faithfully adapted for discrete framework
such that the DST is naturally derived from the construction of
shearlet frame. Furthermore, it can be shown that our compactly
supported shearlet frame generated by separable wavelets can
provide nearly optimal approximation for a piecewise smooth
function. In other words, one can achieve that
where is
smooth function except at points lying on
curves and
is shearlet nonlinear approximation obtained
by taking the
largest shearlet coefficients. This approximation rate is same as one obtained with curvelets or band-limited
shearelts and the proof of this claim will appear in elsewhere
1178
[21]. This indicates that our new construction scheme of shearlets provides sparse approximation as well as efficient implementation which explicitly computes the shearlet coefficients.
However, we should point out that there are basically two
issues that need to be resolved concerning our proposed construction of shearlets. First of all, our proposed DST does not
share tree structure based on filter banks like other multiscale
transforms such as DWT and CT. Therefore, computation cost
increases as we increase the number of shear operations. Secondly, the ratio of the frame bounds for our construction depends
on the choice of the sampling constant . Especially, this implies
that one needs to increase the redundancy of shearlet frame in
order to achieve more reasonable frame bounds.
Thus, for future study, we will focus on improving construction of shearlets such that the resulting construction can provide more structured discrete transform as well as less redundant shearlet frame.
for
for
is a set of measure 0. Let us estimate
gives
. Direct computation
APPENDIX I
PROOF OF PROPOSITION III.2
Without loss of generality, we may assume that
and
. Also, we let
. We first observe that
with
and
where
(34)
where
(36)
(35)
(For the proof, see [19]).
1179
Fig. 13. Comparison between the DST and NSCT for denoising Gaussian noise with
: dB.
: dB. (c) Denoised with the DST18,
31 66
PSNR = 32 17
(37)
, then we have the second
Finally, assume that
equation shown at the bottom of the page. Observe that
= 15. (a) Original Boat image. (b) Denoised with NSCT [17], PSNR =
and
for any
for all
Also,
for
, there exists
when
such that
. Therefore,
Assume that
. By (34) and (35),
we have (38), shown at the bottom of the page. If
one can also similarly estimate
to obtain
(38). By (36)(38), we have
(38)
1180
APPENDIX II
PROOF OF LEMMA IV.1
We only prove (18) and (17) is proved similarly. Taking the
Fourier transform on (13) gives
(39)
Taking an inverse Fourier transform on (39) gives
[6] I. W. Selesnick, R. G. Baraniuk, and N. Kingsbury, The dual-tree complex wavelet transformA coherent framework for multiscale signal
and image processing, IEEE Signal Process. Mag., vol. 22, no. 6, pp.
123151, Nov. 2005.
[7] E. Candes and D. Donoho, New tight frames of curvelets and optimal
representations of objects with piecewise C singularities, Commun.
Pure Appl. Math., vol. 57, no. 2, pp. 219266, Feb. 2004.
[8] G. Peyre and S. Mallat, Discrete bandelets with geometric orthogonal
filters, presented at the Int. Conf. Image Processing, Sep. 2005.
[9] K. Guo, D. Labate, W. Lim, G. Weiss, and E. Wilson, Wavelets
with composite dilations and their MRA properties, Appl. Comput.
Harmon. Anal., vol. 20, pp. 231249, 2006.
[10] D. Labate, W. Lim, G. Kutyniok, and G. Weiss, Sparse multidimensional representation using shearlets, wavelets XI (San Diego, CA,
2005), 254262, Proc. SPIE, 5914.
[11] K. Guo and D. Labate, Optimally sparse multidimensional representation using shearlets, SIAM J Math. Anal., vol. 39, pp. 298318, 2007.
[12] K. Guo, D. Labate, and W. Lim, Edge analysis and identification using
the continuous shearlet transform, Appl. Comput. Harmon. Anal.
[13] G. Kutyniok and D. Labate, The construction of regular and irregular
shearlet frames, J. Wavelet Theory Appl., vol. 1, pp. 110, 2007.
[14] R. R. Coifman, Y. Meyer, and M. V. Wickerhauser, Wavelet analysis
and signal processing, Wavelets Appl., pp. 153178, 1992.
[15] S. Mallat and S. Zhang, Matching pursuits with time-frequency dictionaries, IEEE Trans. Signal Process., no. 12, pp. 33973415, Dec.
1993.
[16] A. Cohen, I. Daubechies, and J. Feauveau, Biorthogonal bases of compactly supported wavelets, Commun. Pure Appl. Math., vol. 45, pp.
485560, 1992.
[17] A. Cunha, J. Zhou, and M. Do, The nonsubsampled contourlet transform: Theory, design, and applications, IEEE Trans. Image Process.,
vol. 15, no. 10, pp. 30893101, Oct. 2006.
[18] R. Coifman and D. Donoho, Translation invariant de-noising, in
Wavelets and Statistics, A. Antoniadis and G. Oppenheim, Eds. New
York: Springer-Verlag, 1995, pp. 125150.
[19] D. Yang and X. Zhou, Irregular wavelet frames on L ( ), Sci.
China Ser. A Math., pp. 277287, 2005.
[20] P. Kittipoom, G. Kutyniok, and W. Lim, Construction of Compactly
Supported Shearlets, to be published.
[21] G. Kutyniok and W. Lim, Compactly Supported Shearlets are Optimally Sparse, to be published.
Wang-Q Lim was born in Seoul, Korea, in 1973. He
received the Ph.D. degree in mathematics from the
Washington University, St. Louis, MO, in 2006.
His research interests include wavelets, geometrical representation, and sparse recovery.