Você está na página 1de 5

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. 12, NO.

6, JUNE 2015 1223

Automatic Change Analysis in Satellite Images Using


Binary Descriptors and LloydMax Quantization
Anamaria Radoi, Student Member, IEEE, and Mihai Datcu, Fellow, IEEE

AbstractIn this letter, we present a novel technique for un- use change vector analysis to represent the change in the
supervised change analysis that leads to a method of ranking the n-dimensional spectral space and to show that each class of
changes that occur between two satellite images acquired at dif- change has a distinct spectral signature [1].
ferent moments of time. The proposed change analysis is based on In [2], two techniques based on the Bayes theory are pro-
binary descriptors and uses the Hamming distance as a similarity
metric. In order to render a completely unsupervised solution, the posed for the analysis of the difference image. The first ap-
obtained distances are further classified using vector quantization proach assumes that the pixels in the difference image are
methods (i.e., Lloyds algorithm for optimal quantization). The ul- independent of one another and computes the optimal threshold
timate goal in the change analysis chain is to build change intensity by minimizing the error probability, which, in Bayesian terms,
maps that provide an overview of the severeness of changes in the translates into maximizing the posterior conditional probabil-
area under analysis. In addition, the proposed analysis technique ity. The second technique uses Besags iterated conditional
can be easily adapted for change detection by selecting only two
modes for solving a Markov Random Field (MRF)-based
levels for quantization. This discriminative method (i.e., between
changed/unchanged zones) is compared with other previously de- model, which considers that a pixel belonging to a certain
veloped techniques that use principal component analysis or Bayes class (change/no change) is likely to be surrounded by pixels
theory as starting points for their analysis. The experiments are belonging to the same class. Although the spatial contextual
carried on Landsat images at a 30-m spatial resolution, covering hypothesis is likely to be true in most cases, the problem of
an area of approximately 59 51 km2 over the surroundings convergence becomes problematic when changes appear in too
of Bucharest, Romania, and containing multispectral information. many scattered places. However, the exploitation of contextual
Index TermsBinary descriptors, change analysis, Hamming information with MRF models is not well suited for online
distance, LloydMax quantization, multitemporal satellite images. applications due to their high computational complexity. Both
techniques are based on the estimation of statistical parameters
I. I NTRODUCTION using the expectationmaximization (EM) algorithm.
Other approaches consist of linear transformations [3]. For
T HE past few years have witnessed an increased interest
toward unsupervised change detection techniques. Unlike
supervised methods, the latter techniques directly compare two
example, principal component analysis (PCA) is applied in [4]
over nonoverlapping blocks of the difference image in order
to extract the main directions of change. In the same letter,
multitemporal images, without having any other type of infor- the challenging problem of searching the threshold between
mation regarding the contained classes or a priori distribution change and no change is solved by introducing a K-means step
of the change/unchanged states. Under these assumptions, a (K = 2).
challenging step is to find the optimal threshold to discriminate In this letter, we propose a multilevel change detection
between change and no change. method to assess the degree of change suffered by an area
The majority of the change detection methods are developed between two moments of time. The system provides a fast
based on the analysis of the difference image. Other techniques and unsupervised diagnosis of change that does not require the
availability of any type of a priori information or any learning
phase. To this end, we start our analysis from two images
acquired at different moments of time over the same area. For
Manuscript received August 5, 2014; revised November 29, 2014; accepted each pixel inside each image, we build a binary descriptor rep-
December 24, 2014. This work was supported in part by the Romanian Min-
istry of European Funds under the Financial Agreement POSDRU/159/1.5/S/ resenting the gradients in the neighborhood around that pixel.
134398. Next, the similarity for each pixel is measured by applying the
A. Radoi is with the Department of Applied Electronics and Information En- Hamming distance over the two temporal binary descriptors
gineering, Faculty of Electronics, Telecommunications and Information Tech-
nology, University Politehnica of Bucharest, 060032 Bucharest, Romania, and
computed at the same location. Finally, LloydMaxs algorithm
also with the Research Center for Spatial Information, CEOSpaceTech, 011061 is used to form the change map representing the intensity
Bucharest, Romania (e-mail: rdi.anamaria@gmail.com). of change for each location. Furthermore, the method can be
M. Datcu is with the Remote Sensing Technology Institute, German extended to multispectral images by a simple concatenation of
Aerospace Center (DLR), 82234 Oberpfaffenhofen, Germany, and also with the
Research Center for Spatial Information, Department of Applied Electronics the extracted binary descriptors for all channels.
and Information Engineering, Faculty of Electronics, Telecommunications The rest of this letter is organized as follows. Sections II
and Information Technology, University Politehnica of Bucharest (UPB), and III present the proposed method for unsupervised change
060032 Bucharest, Romania (e-mail: mihai.datcu@dlr.de). detection. The results obtained for synthetic and real data are
Color versions of one or more of the figures in this paper are available online
at http://ieeexplore.ieee.org. reported in Section IV, while the conclusions are summarized
Digital Object Identifier 10.1109/LGRS.2015.2389144 in the last section.
1545-598X 2015 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
1224 IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. 12, NO. 6, JUNE 2015

Fig. 1. Block diagram of the proposed change analysis method.

II. P ROPOSED C HANGE A NALYSIS M ETHOD


The main objective of this letter is to build a simple and
Fig. 2. Change detection performance comparison between the proposed
effective unsupervised method for change analysis. In order algorithm and the algorithms proposed in [2] and [4], for different levels of
to solve this problem, we propose binary descriptors that are noise.
computed in each point of the image. The construction of these
descriptors implies simple bit strings, which can be easily com-
pared by computing the Hamming distance. This operation can
be performed in a fast manner using a XOR and a counter, with
instructions that are done extremely fast on modern CPUs. The
last step toward an automatic assignment of change level is the
separation of the values yielded by the Hamming distance into
categories of variation. This is achieved by applying Lloyds
algorithm for quantization. The procedure is summarized
in Fig. 1.
Let us denote by I(t1 ) and I(t2 ) two gray-level images of size
Nx Ny , acquired at two different times, t1 and t2 .
Fig. 3. Change detection performance for binary descriptors and LloydMaxs
two-level quantization under no noise conditions, different patch sizes, and
A. Fast Way Toward Constructing Binary Descriptors various smoothing filters.

The idea behind binary descriptors is that of finding a simple ages (e.g., two coregistered satellite images), we construct two
and fast way to compare feature points while requiring a n-bit descriptors, one for each image.
small amount of memory. In order to construct local binary There are many options for placing the test locations, i.e., the
descriptors at pixel level, we start from the binary test used pairs (O, Pi ), in a patch around a pixel. Among all choices, the
also to build Binary Robust Independent Elementary Features following is convenient because it has a physical interpretation
(BRIEF) in [5]. However, BRIEF is designed especially for (i.e., it represents the signs of the gradients in all directions
object retrieval in a test image, and finding points of interest around each pixel):
(e.g., Features from Accelerated Segment Test (FAST) corner
O = (Ox , Oy )T
detection [6]) in the test image figures strongly in the success
of this technique. Pi = (Pxi , Pyi )T
In our setup, the binary descriptors are calculated separately
where O = (Ox , Oy )T is the pixel around which the patch
in each image for each pixel, as detailed hereinafter.
is considered, Ox S/2 Pxi Ox + S/2, and Oy
1) Binary Descriptor: In the following, let us consider S
S/2 Pyi Oy + S/2.
S square neighborhoods around each test pixel. For simplicity,
The number of binary tests, and thus the length of the
let us consider S to be odd. For one pixel, a binary test t
descriptor for each point, is equal to n = S 2 . As a remark, we
applied on a test pixel P and its neighbor O, at time t, is de-
could have taken n = S 2 1 by excluding the test between
fined as
point O and itself, but taking this test into consideration will
 not influence the future results (i.e., the Hamming distances),
1, if I (t) (O) < I (t) (P)
t (O, P) = (1) as t (O, O) = 0.
0, otherwise 2) Preprocessing Step: The binary tests take the information
at pixel level and are therefore very noisy. Prefiltering the
where I (t) (O) and I (t) (P) are the pixel intensities at points images yields an increase in the stability of the change detection
O = (Ox , Oy )T and P = (Px , Py )T , respectively, at time t. algorithm. Moreover, in areas where there is no change, the
In order to assess the differences in all points for precise elements of both descriptors at the same point are likely to
change detection, we perform binary tests considering S S repeat more often if the images are smoothed before performing
patches around each pixel, in both images. More precisely, con- the binary tests. This phase is the most time-consuming part of
sidering a pixel O = (Ox , Oy )T , with S/2 < Ox < Nx the proposed method, depending on the type of filters chosen
S/2, S/2 < Oy < Ny S/2 but placed in different im- for smoothing. Using a simple box filter, which is less time
RADOI AND DATCU: AUTOMATIC CHANGE ANALYSIS IN SATELLITE IMAGES 1225

Fig. 4. Binary change detection of synthetic changes on Landsat 7 images (near-infrared band). The second and third rows show the outputs of the proposed
method with two levels of quantization and also the results obtained by applying the methods described in [2] and [4] in two cases: no noise and 20-dB additive
white Gaussian noise. (a) Original image. (b) Synthetic change (no noise). (c) Synthetic change (SNR = 20 dB). (d) Ground truth. (e) Proposed method (no noise).
(f) PCA K-means (no noise). (g) EM-based (no noise). (h) MRF-based (no noise). (i) Proposed method (SNR = 20 dB). (j) PCA K-means (SNR = 20 dB).
(k) EM-based (SNR = 20 dB). (l) MRF-based (SNR = 20 dB).

consuming, serves our purposes well and can be regarded as a LloydMaxs algorithm for quantization [7], [8], which is
good compromise if compared to Gaussian-like low-pass filters. briefly reviewed hereinafter.
In the experimental part of this letter, we show the results for LloydMaxs algorithm answers to the following problem
both filters. of quantization: For a signal x with a probability density
function pX , find a quantizer with M representative levels that
B. Hamming Distance as a Similarity Metric minimizes the mean squared error
 
In information theory, the Hamming distance between two MSE = E (X X)  2 (3)
binary vectors of equal length is the number of positions at
which the corresponding symbols are different. For two binary
descriptors B1 and B2 , of length n, the Hamming distance is where X is the quantized version of the random variable X.
equal to The solution to this problem is obtained by successively
n applying the following formulas until convergence:
H(B1 , B2 ) = B1 (i) B2 (i) (2)
i=1 1
tq = 2 [
xq1 + x
q ], q = 1, 2, . . . , M 1 (4a)
tq+1
xpX (x) dx
where is the modulo 2 addition between two binary values,
xq = qtq+1
t
, q = 0, 1, 2, . . . , M 1 (4b)
while B1 (i) and B2 (i) are the ith elements of the descriptors. pX (x) dx
tq

In our case, the Hamming distance comes as a natural choice


because it measures the number of times when the binary tests where {tq }q=1,...,M 1 are the M 1 decision thresholds
differ for each patch representing the same geographical area, and { xq }q=0,...,M 1 are the M representative levels between
at different moments of time. In fact, the distance measure two successive decision thresholds. For an unknown dis-
assesses the changes in gradient, in time, along all directions tribution pX , x q in (4b) can be approximated with x q =
around the analyzed point (or pixel). This is the rationale upon 1/Tq  xTq x, where Tq = {x|tq x < tq+1 } and  
which the proposed change analysis algorithm is based. represents the number of elements in a set.
Additionally, for a fixed length n of the descriptors, the As already mentioned, the similarity between the two images
Hamming distance is a metric for the space {0, 1}n . Aside from is measured using the Hamming distances. In order to build
its simplicity, the metric property of the Hamming distance the change maps, these distances are quantized with M levels
gives it added values if compared to other similarity measures. (M 2). In particular, if M = 2, the distinction is made be-
tween insignificant versus medium or important changes, while
if M = 3, we divide the changes into three groups that take
III. C HANGE I NTENSITY M APS
into account the distribution of changes inside the images. The
In order to assess the level of change in the bitempo- number of change levels is established by the user, depending
ral images, change intensity maps (CIMs) are built using on the application.
1226 IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. 12, NO. 6, JUNE 2015

Fig. 5. Multilevel change detection on real data. The Landsat 7 images correspond to the periods (a) and (k) before and (b) and (l) after the construction of the
Palace of Parliament and Morii Lake in Bucharest, Romania. The visible changes are manually labeled in (f) and (p) (i.e., ground truth). (c), (d), and (e) and (m), (n),
and (o) show the outcome of the change detection algorithm presented in [2] and [4], while (g), (h), (i), and (j) and (q), (r), (s), and (t) show the CIMs as presented
in this letter. The red and yellow pixels correspond to more important changes, whereas the shades of blue correspond to less important changes or no changes. For
the binary change detection case, red represents majormedium changes, while no change is marked with blue. (a) June 1984. (b) July 1992. (c) PCA K-means.
(d) EM-based. (e) MRF-based. (f) Ground truth. (g) CIM (M = 2). (h) CIM (M = 4). (i) CIM (M = 8). (j) CIM (M = 16). (k) June 1984. (l) July 1992.
(m) PCA K-means. (n) EM-based. (o) MRF-based. (p) Ground truth. (q) CIM (M = 2). (r) CIM (M = 4). (s) CIM (M = 8). (t) CIM (M = 16).

The choice for the LloydMax quantization is argued by the Fig. 2. In almost all noise scenarios, the proposed method
fast and simple manner to find optimal thresholds (in the sense outperforms the others, while a better performance is obtained
of minimizing the expected quantization error) based on the when the images are smoothed. Smoothing can be skipped
distribution of the distances on the area of analysis. when dealing with a low level of noise, but it is mandatory when
working with noisy data, and this happens in most of the real
IV. E XPERIMENTS cases. If the level of noise is very high, we observe a slightly
better performance of the other methods that report a high
For the experimental part, we used the Landsat data set number of true negatives (i.e., correct no change detection)
available online at [9]. Two experiments are conducted, namely, under the assumption that the number of changed pixels in the
binary change detection on synthetic images and multilevel image is smaller than the number of unchanged pixels. Fig. 3
change detection on real data sets. shows the change detection performance when different low-
pass filters are considered for prefiltering and various patch
A. Detection of Synthetic Changes sizes are used for building the binary descriptors. The best
performance is achieved for a box 3 3 smoothing filter and
In what follows, we consider two gray-level images of a patch size of 9 9 pixels. These settings are used for change
200 200 pixels, namely, an original image and a synthetically detection in Fig. 4.
generated one. The former is obtained by inserting land-cover
changes in the original image, in random places, and also by
B. CIMs
slightly modifying the illumination level. In order to assess the
effectiveness of the method with respect to noise, we addition- The goal of this experiment is to build CIMs that show the
ally add white Gaussian noise, with different signal-to-noise degree of modification on a scale that uses M (M > 2) levels
ratios (SNRs). The performance of the proposed algorithm with of quantization. Two cases are shown in Fig. 5, namely, the
M = 2 levels of quantization is compared against that of the construction of the Palace of Parliament (173 119 pixels)
methods proposed in [2] and [4]. The results are reported in and Morii Lake (191 191 pixels) in Bucharest, Romania,
RADOI AND DATCU: AUTOMATIC CHANGE ANALYSIS IN SATELLITE IMAGES 1227

TABLE I
C OMPARISONS OF B INARY C HANGE D ETECTION M ETHODS

TABLE II in parallel, and this will further decrease the computation time.
AVERAGE RUNNING T IME C OMPARISON ( IN S ECONDS )
All the experiments were carried out on a 2.3-GHz 5-core Intel
HP EliteBook computer running a Windows 7 operating
system.

V. C ONCLUSION
This letter proposes a novel method for unsupervised mul-
tilevel change detection in satellite images. The technique is
between 1984 and 1992. All the experiments are carried on
based upon the optimal quantization of the Hamming distances
multispectral Landsat 7 images, for which only the first three
between binary descriptors built at pixel level, rendering a
bands are shown.
suitable method for building CIMs that assess the level of
The aim of the proposed multilevel approach for change
change in an area. In terms of binary change detection, the
detection is to discover all changes and to determine the optimal
experiments show that the proposed algorithm performs well,
threshold values to be applied on the similarity measures.
even under noisy conditions and variations of illumination.
Assigning levels of change to each pixel, the method is able
There are several advantages of using this technique for
to provide more information for a user regarding the areas that
change analysis. First, from a methodological viewpoint, the
were affected by major, medium, or minor changes. As shown
method is local (i.e., it takes into account the changes that
in Fig. 5, as the number of quantization levels increases, the
occur in the area around each pixel). In the same time, it has
areas of major changes are better distinguished (see the red-
the capability of reporting these local changes to the changes
colored zones), while the other changed areas confirm the fact
that happen in the whole area of analysis. Second, from the
that transformations occurred, but they are not as important
implementation viewpoint, the method implies simple binary
(see the yellow-colored zones).
descriptors that are fast to compute and to compare with modern
In a particular binary change detection scenario (i.e., M = 2
CPUs. These facilities are beneficial in terms of online change
quantization levels), the major and major-to-medium changes
analysis and unsupervised observation of the Earths surface.
interfere, resulting in a higher number of changes detected by
the proposed method. In order to evaluate the binary change
detection methods, the following measures are computed: true R EFERENCES
positives (TP), true positive rate (PT P = T P/N1 100), true [1] F. Bovolo and L. Bruzzone, A theoretical framework for unsuper-
vised change detection based on change vector analysis in the polar do-
negatives (TN), true negative rate (PT N = T N/N0 100), main, IEEE Trans. Geosci. Remote Sens., vol. 45, no. 1, pp. 218236,
correct classification rate or overall accuracy (PCC = (T P + Jan. 2007.
T N )/(N0 + N1 ) 100), false alarms (FP), false alarm rate [2] L. Bruzzone and D. Prieto, Automatic analysis of the difference image
(PF P = F P/N1 100), missed alarms (FN), missed alarm for unsupervised change detection, IEEE Trans. Geosci. Remote Sens.,
vol. 38, no. 3, pp. 11711182, May 2000.
rate (PF N = F N/N0 100), and error rate (PE = (F P + [3] J. Thau, Change detection, in Springer Handbook of Geographic
F N )/(N0 + N1 ) 100). The results for the binary change Information. New York, NY, USA: Springer-Verlag, 2012, pp. 7594.
detection are shown in Fig. 5 and in Table I. [4] T. Celik, Unsupervised change detection in satellite images using PCA
and k-means clustering, IEEE Geosci. Remote Sens. Lett., vol. 6, no. 4,
pp. 772776, Oct. 2009.
[5] M. Calonder et al., Brief: Computing a local binary descriptor very fast,
C. Average Running Time IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 7, pp. 12811298,
Jul. 2012.
Furthermore, the method proposed in this letter is efficient [6] E. Rosten and T. Drummond, Machine learning for high-speed corner
in terms of execution time if compared to EM, MRF, and detection, in Proc. Eur. Conf. Comput. Vis., 2006, vol. 1, pp. 430443.
PCA K-means-based methods. The average running times are [7] S. Lloyd, Least squares quantization in PCM, IEEE Trans. Inf. Theory,
vol. 28, no. 2, pp. 129137, Mar. 1982.
shown in Table II for gray-level images of approximately 200 [8] J. Max, Quantizing for minimum distortion, IRE Trans. Inf. Theory,
200 pixels. The method can be designed to make use of parallel vol. 6, no. 1, pp. 712, Mar. 1960.
architecture for computing the binary descriptors of the images [9] [Online]. Available: http://earthexplorer.usgs.gov

Você também pode gostar