Você está na página 1de 13

Recent Progress of Hyperspectral Imaging on

Quality and Safety Inspection of Fruits and


Vegetables: A Review
Yuan-Yuan Pu, Yao-Ze Feng, and Da-Wen Sun

Abstract: Objective quality assessment and efficacious safety surveillance for agricultural and food products are insep-
arable from innovative techniques. Hyperspectral imaging (HSI), a rapid, nondestructive, and chemical-free method, is
now emerging as a powerful analytical tool for product inspection by simultaneously offering spatial information and
spectral signals from one object. This paper focuses on recent advances and applications of HSI in detecting, classifying,
and visualizing quality and safety attributes of fruits and vegetables. First, the basic principles and major instrumental
components of HSI are presented. Commonly used methods for image processing, spectral pretreatment, and modeling
are summarized. More importantly, morphological calibrations that are essential for nonflat objects as well as feature
wavebands extraction for model simplification are provided. Second, in spite of the physical and visual attributes (size,
shape, weight, color, and surface defects), applications from the last decade are reviewed specifically categorized into
textural characteristics inspection, biochemical components detection, and safety features assessment. Finally, technical
challenges and future trends of HSI are discussed.
Keywords: classification, fruits and vegetables, hyperspectral imaging, quality assessment, safety inspection

Introduction to the whole batch (Wang and others 2012b), and ingestion
Fruits and vegetables are marketable products aimed at increas- of chemical/pathogen-contaminated fruits might incur health
ing economic value of industries as well as satisfying customer problems to consumers. Therefore, applying a rapid, accurate, and
demands, therefore besides techniques such as drying (Sun and noninvasive technique in food analytical procedure for quality
Woods 1997; Sun and Byrne 1998; Delgado and Sun 2002a, evaluation and safety inspection has become an urgent need.
2002b), refrigeration (Sun and others 1996; Sun 1997; McDonald Traditionally, food quality sorting systems based on external
and Sun 2001; Kiani and Sun 2011) and edible coating (Xu and features rely heavily on manual handling, which is laborious,
others 2001) to preserve their qualities, effective quality assessment time-consuming, and nonobjective. Meanwhile, internal quality
methods are also important. Comprehensive quality assessment in measurement depends mainly upon sample destruction and
food products integrates determination of appearance evaluation reagent-costly chemical analysis. To speed up grading and clas-
and intrinsic characteristics. External defects in fruits and vegeta- sifying efficiency and to reduce artificial error and lower analysis
bles, such as bruises, chilling injury, wind scars, and cuticle cracks cost, extensive efforts have been made recently to find solutions
can drastically lower the quality level, causing great economic loss for rapid, accurate, and nondestructive determination of food
(Ariana and others 2006, Lü and Tang 2012). Internal features products. Computer vision technology, which integrates image
such as soluble solids content (SSC), acidity, and water content acquiring, processing, and analyzing (Brosnan and Sun 2002,
have a high connection with product aroma and taste (Rajkumar Cubero and others 2010), shows great potential in automatic
and others 2012), implicating a predominant role in quality inspection of agricultural and food products by simply providing a
assessment. Safety problems of fruits and vegetables caused by gray-value or a spell out RGB image of the tested sample. How-
chemical/microbial contamination or fruit fly/insect infestation ever, the quality features captured by a computer vision system
might be severe. A small portion of products with infection mainly highlight visual properties that are closely correlated to
by bacteria/fungi may cause widespread transmissible diseases its shape, size, color, and texture features (Wang and Sun 2002,
Sun 2004, Jackman and others 2008, 2009, Valous and others
2009). Though some internal qualities, such as the antioxidant
MS 20141178 Submitted 7/8/2014, Accepted 13/10/2014. Authors are with Food activity and total phenol content, can be predicted by computer
Refrigeration and Computerized Food Technology (FRCRT), School of Biosystems vision (Pace and others 2013), their successful predictions rely
Engineering, Univ. College Dublin, Natl. Univ. of Ireland, Agriculture and Food on the color changes of samples. With respect to qualitative and
Science Centre, Belfield, Dublin 4, Ireland. Direct inquiries to author Sun (E-mail: quantitative determination of internal attributes which might
dawen.sun@ucd.ie).
have little relationship with appearance features, spectroscopic


C 2015 Institute of Food Technologists®

176 Comprehensive Reviews in Food Science and Food Safety r Vol. 14, 2015 doi: 10.1111/1541-4337.12123
Progress of hyperspectral imaging . . .

methods involving reflectance, transmittance, fluorescence, and acousto-optic tunable filter. The light source, serving as an optical
Raman scattering measurements have been employed to provide probe for effectively detecting physical structure and chemical
direct insights into food quality and safety concerns. In terms components of targets, is of great importance in HSI systems.
of the spectral range, spectroscopy in visible and near-infrared A halogen lamp is widely used in hyperspectral reflectance
(Vis-NIR) regions received a great deal of attention because most and transmittance imaging systems by providing illumination
of the agro-food products contain functional groups like C–H, of the target area with a broad spectral range in the Vis/NIR
N–H, and O–H, which are closely associated with the overtone region (Nanyam and others 2012). For fluorescence and Raman
and combination vibrations in Vis-NIR spectral region (Magwaza imaging, light units with higher intensity than a halogen lamp, for
and others 2011, Yu and others 2014). However, the weakness of example, ultraviolet-A (Vargas and others 2005), laser beam (Noh
single-spot detecting property in the above-mentioned methods and Lu 2007), and light-emitting diode (Yang and others 2012)
limits their applications to homogeneous samples. Nevertheless, are applied to provide adequate exciting energy. Particularly,
such disadvantage could be overcome by introducing hyper- to provide a uniform illumination environment, especially for
spectral imaging (HSI), where imaging and spectral scanning are those samples with a round shape, an indirect light source can be
combined to provide spectral information in spatial details about employed for spherical objects by placing light source around the
samples so that the variations within samples can be specified. edge of a hemispherical diffuser (Baranowski and others 2013).
The term of HSI was initially coined in remote sensing and
this emerging technique is currently applied as a powerful nonde- Data acquisition and analysis
structive method for plant inspection (Rumpf and others 2010), There are 3 kinds of ways for obtaining a hyperspectral data-
clinical examination (Randeberg and others 2010), and forensic cube, namely, point scan, line scan, and area scan. The acquisition
detection (Edelman and others 2012). Particularly, great attention time of point-scanning is quite long (Qin and others 2011), thus
is being paid to the field of agricultural and food science (Wu and making it unacceptable for real-time detection. Although the area-
Sun 2013), for example, fish and other seafood, meat and meat scanning mode enables whole images to be captured at discrete
products (ElMasry and others 2011a, 2011b, 2012, Kamruzzaman wavebands, it is not capable of detecting a moving target on a
and others 2011, 2012, Barbin and others 2012), grains, dairy production line (ElMasry and Sun 2010). Currently, line-scanning,
products, and horticultural products. With considerable achieve- also known as push-broom, is the most widely used acquisition
ments being accomplished in addressing quality and safety issues method in research and applications due to its fast detection speed
of fruits and vegetables using HSI (Karimi and others 2012, Cen and availability of 2-dimensional array detector.
and others 2013, Wei and others 2013, Yu and others 2014), this To extract useful spatial information from the hyperspectral
paper reviews recent applications of this advanced technology in data-cube, a series of image processing methods and algorithms
nondestructive assessments of textural characteristics, biochemical involving image calibration, image enhancement, and segmenta-
information, and safety features of fruits and vegetables. The ob- tion are necessary. To effectively minimize noise and background
jectives of this review are (1) to present fundamental principles of caused by random interference of instrument and detecting en-
HSI and key steps for data analysis; (2) to summarize state-of-the- vironment, spectral preprocessing, such as smoothing, derivatives,
art applications in fruits and vegetables from the aspects of quality detrending, multiplicative scatter correction (MSC), and standard
and safety concern; (3) and to discuss current issues encountered normal variate (SNV) are selected to improve raw data quality for
in HSI and to provide prospective trends in future research. subsequent analysis. Chemometrics is an integral part of data anal-
ysis in HSI, which connects chemical measurements with spectral
HSI Technology information. Commonly used methods for classification or regres-
Fundamental principles sion includes principal component analysis (PCA), partial least
HSI concerns 2 aspects of imaging and spectroscopy, thus square (PLS), artificial neural network (ANN), support vector
generating a series of high-resolution images at a consecutive machine (SVM), cluster analysis (CA), and discriminant analysis
wavelength range. Imaging technology enable sample to be dis- (DA). Currently, commercial software package, such as Matlab,
played on a 2-D image plane. Spectroscopy studies the relationship Unscramble, and Environment for Visualizing Images are available
of light (electromagnetic wave) and matter, the responses of matter to manipulate the modeling procedure. More details about the
to light provides 1-D spectrum at each pixel, which may imply theories can be found elsewhere (Adams 2004).
physical or chemical message of the targeted area. According to
the specific light-output captured by HSI, HSI can be performed Morphological calibrations
in reflectance, transmittance, fluorescence, and scattering mode. Generally, the collected hyperspectral images are first calibrated
using white and dark references to account for the uneven inten-
System components sity of light source, the spectral response of the device, and the dark
A typical HSI system generally consists of 4 parts: (1) an imaging current occurring in imaging detector. It is noteworthy that the
unit, (2) an illuminating source, (3) a sample stage, (4) and a general image calibration procedure does not take into account
computer with corresponding control software. The imaging the morphology of nonflat samples, for example, round-shaped
unit, being a core section in constructing spectral and spatial apples and mandarins, cylinder-shaped cucumbers, and bananas.
information of targeted samples, is made up of a standard zoom The curving surface generally results in variations of distance from
lens, a highly sensitive and specific spectrograph in conjunction the detector to the sample surface, which raises great differences
with a charge-coupled-device or complementary metal-oxide- in optical pathlength. Therefore, additional pretreatments for cor-
semiconductor camera. The function of a spectrograph is to rection of light distance difference should be conducted on the
disperse the captured light into a certain continuous spectral calibrated images.
range. To achieve this purpose, most of the spectrographs in HSI A solution for such interfaces on round-shaped samples can be
systems include optical devices, such as prism, diffraction grating, corrected by mathematically adjusting measured optical parame-
and electronically controlled liquid crystal tunable filters or ters after assuming these samples as spherical objects with a radius


C 2015 Institute of Food Technologists® Vol. 14, 2015 r Comprehensive Reviews in Food Science and Food Safety 177
Progress of hyperspectral imaging . . .

of r (Peng and Lu 2006). As shown in Figure 1, the real scat- significant ones. Some feature waveband extraction approaches
tering distance (s) is longer than the measured distance (x) due available in the literature are based on the principal components
to the curving shape, and the actual scattering intensity (Ir ) at a generated in PCA (Wang and others 2012b), β-coefficients in PLS
specific site of the sample can be determined based on the mea- model (Rajkumar and others 2012), the fitness function in genetic
sured scattering intensity (Im ) as well as the spatial information algorithms (Gómez-Sanchis and others 2008b), and the weight of
of the site (determined by the spherical radius r as well as hor- each input (wavelength) in backpropagation neural network (El-
izontal distance x). An alternative for shape correction of round Masry and others 2009). Other means for feature waveband se-
objects is to consider the fruit surface as a Lambertian ellipsoid lection are minimum redundancy maximum relevance (MRMR)
(Gómez-Sanchis and others 2008a). In this case, shape-corrected algorithm (Gómez-Sanchis and others 2012), stepwise regression
reflectance images could be obtained by introducing a geometric (ElMasry and others 2008), receiver operating characteristic curve
correction factor (εg ) to the calibrated images. The value of εg (Lorente and others 2011, 2013), branch and bound algorithm
can be calculated based on a digital elevation model, in which a (Ariana and Lu 2010), and more.
3-D model is constructed from a 2-D reflectance image. In hy-
perspectral transmittance imaging, the light intensity penetrating HSI Applications in Quality Assessment
through the matter is deeply influenced by its size. Taking pickling Being a noncontact and fast-detecting approach, HSI has found
cucumbers an example, Lu and Ariana (2013) defined a diame- increasing utilization in agricultural and food products. This sec-
ter correction factor f for each tested cucumber to minimize the tion focuses on the overview of recent applications of HSI in
size effect on detecting fruit fly infestation, with calculation of f is textural, biochemical changes, and safety features of fruits and veg-
shown in Eq. (1): etables, which might have a direct connection to maturity stage,
 1.3 eating quality, and shelf life.
Ds
f = , (1)
Dm Textural characteristics inspection
Bruise, chilling injury, and decay lesion are tissue defects prob-
where Ds is the estimated diameter of the cucumber sample from ably associated with cell wall collapse, complicated enzymatic and
transmittance image; Dm is the mean estimated diameter of all metabolic activities (Van Zeebroeck and others 2007). Such tex-
samples. tural changes restricting product’s marketing potential need to be
inspected and graded.
Feature wavebands extraction Bruise. Bruise on fruit surface is one of the most significant ex-
Raw hyperspectral data-cube contains dozens to hundreds of ternal defects and has received much attention in research. Chem-
wavebands, which pose great storage and processing pressure to a ical changes in a bruised area lead to changes of their reflectance
computer. More importantly, among the wide-scale wavebands, properties. Therefore, by comparing spectra from different spa-
only a few are highly related to certain quality attributes (Liu tial locations on the same object, a bruised region can be easily
and others 2013). Therefore, selection of optimal wavebands that detected. Table 1 summarizes the image processing and classifi-
preserve the most relevant information is an essential step for data- cation methods for bruise detection using reflectance HSI. Re-
reduction as well as model optimization to improve analysis speed. search by Ariana and others (2006) showed that the bruised tissue
The simplest method for wavelength selection is to pick the of pickling cucumber is lighter than the normal skin in the re-
wavebands at peaks or valleys of the spectral curve according to flectance image. Based on this fact, a simple band ratio algorithm
the maximum or minimum intensity difference (Liu and others is sufficient to identify bruise portions, achieving the best clas-
2007). However, the selected wavebands might not be the most sification performance of 82% to 93%. Xing and others (2005)
investigated bruise detection on “Golden Delicious” apples by
hyperspectral reflectance imaging. An algorithm based on mo-
ment thresholding was established for image processing and a
classification accuracy of 86% was attained. Despite such satis-
factory results, these studies only detected bruise on the cheek
of apples. However, the precision of classification models may be
degraded by the presence of stem-end or calyx because these 2
positions also have a lighter reflection property than the sound
regions (Wang and others 2011). Based on the changes of contour
features, stem-end/calyx was significantly distinguished from apple
cheeks (Xing and others 2007a). The color of apple skin is another
factor that can affect the detection of bruise. To address this issue,
Kleynen and others (2005) developed a multispectral imaging de-
vice with 4 bandpass filters for defect sorting on a bi-color variety
of “Jonagold” apple. By removing the stem-ends/calyxes on im-
ages using a correlation matching algorithm, defect identification
based on a Bayesian classifier was implemented, where a clas-
sification rate of more than 90% for recent bruises and serious
defects was achieved. ElMasry and others (2008) examined early
bruises on “McIntosh” apples using line-scanned hyperspectral
reflectance imaging in conjunction with PLS-DA analysis. Three
Figure 1–Image correction of morphological effect on scattering distance optimal wavebands in the NIR domain were triumphantly imple-
and intensity by Peng and Lu (2006). mented to identify bruise, even though the color of a bruised area

178 Comprehensive Reviews in Food Science and Food Safety r Vol. 14, 2015 
C 2015 Institute of Food Technologists®

Table 1–Recent applications of reflectance HSI in bruise detection of fruits and vegetables.

Species Cultivar Range (nm) Image processing Classification Accuracy Reference


Apple
Red Delicious, Golden 430 to 900 Musking, thresholding ASD, PCA, SSD / (Mehl and others 2004)
Delicious, Gala, Fuji
Golden Delicious 400 to 1000 PCA A classification algorithm 86% to 93% (Xing and others 2005)

C 2015 Institute of Food Technologists®


based on moment
thresholding
Progress of hyperspectral imaging . . .

Jonagold 400 to 1000 PCA A classification algorithm 77.5% to 100% (Xing and others 2005)
based on shape
deformation
Golden Delicious 400 to 1000 PCA PCA, PLS-DA 86.36% to 93.55%, (Xing and others 2007b)
48.39% to 98.11%
/ 500 to 900 PCA ASD 88.57% (Zhao and others 2008)
McIntosh 400 to 1000 Binary mask, PCA PLS, SD / (ElMasry and others 2008)
Champion, Gloster, 400 to 1000 PCA, MNF SIMCA, LDA, SVM 63% to 97% (Baranowski and others 2012)
Golden Delicious, 1000 to 2500
Idared, Topaz
Champion, Gloster, 400 to 1000 Binary mask, thresholding LLR in second derivative 83.3% to 97.9% (Baranowski and others 2013)
Golden Delicious, 1000 to 2500 data
Idared, Topaz
Kiwi fruit Zhonghua 600 to 900 PCA RBF-SVM 87.5% (Lü and others 2011)
Zhonghua 600 to 1000 PCA Parallelepiped 85.5% (Lü and Tang 2012)
Classification
Pear / / PCA MDC, SAM 93.8%, 95% (Zhao and others 2010)
/ 949 to 1666 Band ratio k-NN, SVM / (Dang and others 2012)
Shingo 950 to 1605 Band ratio A classification algorithm 92% (Lee and others 2014)
based on F-values of
ANOVA
White mushroom Agaricus bisporus 400 to 1000 Masking, PCA PCA >79% (Gowen and others 2008a)
Pickling cucumber Journey 950 to 1350 PCA, Band ratio, band ROC curve 65.5% to 94.6%, 81.8% (Ariana and others 2006)
difference to 92.7%, 83.6% to
92.7%
Strawberry Akihime 650 to 1000 / LDA, ND, ANN / (Nagata and others 2006)
/ 960 to 1700 Multiband segmentation Uni-band Gaussian 85.3%, 97.67% (Nanyam and others 2012)
classifier, Multi-band
decision-fusion
classifier
Mango Manila 650 to 1100 / k-NN, NBC, ELM, DT, LDA 67.46% to 98.13% (Vélez Rivera and others 2014)
ASD, asymmetric second difference; PCA, principal component analysis; SSD, symmetric second difference; PLS, partial least square; DA, discriminant analysis; SD, stepwise discrimination; MNF, minimum noise fraction; SIMCA, soft independent modeling of class analogy; LDA, linear
discriminant analysis; SVM, support vector machines; LLR, linear logistic regression; RBF, radical basis function; MDC, Mahalanobis distance classification; SAM, spectral angle mapper; ND, normalized difference; ANN, artificial neural network; k-NN, k-nearest neighbor; ANOVA, analysis
of variance; ROC, receiver operating characteristic; NBC, Naı̈ve Bayes; ELM, extreme learning machine; DT, decision tree.

Vol. 14, 2015 r Comprehensive Reviews in Food Science and Food Safety 179
Progress of hyperspectral imaging . . .

(Leiva-Valenzuela and others 2013)


is similar to the color of the apple surface. For products, such as
kiwi fruit with flocky peels, detecting the defective areas would
be more difficult. Lü and others (2012) proposed Vis/NIR HSI

(Rajkumar and others 2012)


(Mendoza and others 2011)

(Servakaranpalayam 2006)
(Tallada and others 2006)

UVE, uninformative variable elimination algorithm; SAP, supervised affinity propagation algorithm; NSAP, new semisupervised affinity propagation algorithm; LDF, Lorentzian distribution function; MLR, multilinear regression; PRESS, predicted residual error sum of squares.
(Wang and others 2012a)
technique to detect hidden bruise on kiwi fruit. A total detection

Reference

(Zhu and others 2013)


error rate of 14.5% was obtained by parallelepiped classification on

(Lu and Peng 2006)


(Noh and Lu 2007)
the top 4 principal component images, yet a better detection result
(12.5% of total error rate) was achieved by radical basis function-
SVM classifier on 5 optimal wavelength images extracted by PCA.
Chilling injury. Chilling injury is another defect commonly oc-
curring on many horticultural products during long-time cold
storage. Cheng and others (2004) integrated PCA and Fisher’s
Linear Discriminant (FLD) for feature extraction of chilling in-
jury cucumbers in hyperspectral data analysis. The results eluci-

Rp = 0.66 to 0.76
R = 0.77 to 0.95
Rp = 0.79 to 0.83

Rp 2 = 0.58 to 0.77

Rp = 0.83 to 0.87

Rp = 0.68 to 0.88
dated that the combined method provided superior classification

Accuracy
performance than using PCA or Fisher’s Linear Discriminant in-

Rp = 0.86

Rp = 0.79
Rp 2 = 0.91
dividually. In the meanwhile, studies by Liu and others (2006)
showed that chilling spot on cucumbers held a weaker reflectance,
and the dual-band ratio algorithm and PCA method maximized
the difference between normal and chilling tissues. As described
in the literature, chilling injury results from cell wall breakage and
membrane degradation (Fukushima and others 1977), thus the

PCA, PLS, MLR


Modeling
firmness of the chilled region is changed. Based on the firmness

PCA-ANN
changes, ElMasry and others (2009) developed a dependable model

ANN
(with 98.4% accuracy) using backpropagation ANN method for

MLR

MLR
PLS
PLS
PLS

PLS
chilling injury identification on “Red Delicious” apples, and this
model can be further applied to forecast apple firmness.
Firmness. Firmness is a primary textural attribute concerning

11 (“Coral Star” cultivar)


the freshness and maturity of fruits, it is also a general quality

10 (“Red Haven” cultivar),


No. of wavebands
parameter showing the mechanical properties, especially for those
with a juicy character, such as berries, plums, and tomatoes. Select-
ing approaches for feature wavebands corresponding to firmness
attributes are showed in Table 2. Among numerous fruits, apple
fruits have received great attention in firmness detection using
34, 35

4, 6, 8
HSI. Since fluorescence and reflectance are 2 distinct detecting
28

forms reflecting different interaction behaviors between light and


/
/

/
3
8
matter, a new device with collective fluorescence and reflectance
modes in one HSI system in the spectral range of 500 to 1040
nm was proposed (Noh and others 2007). Results showed that the Simple correction analysis,
Wavelength selection

performance of apple firmness prediction in the reflectance mode first derivative, based
Based on PLS analysis

(Rc = 0.77) was better than that in fluorescence mode (Rc =


on PLS analysis

0.67), while integration of the 2 modes led to a noticeable im-


Based on LDF

provement of firmness prediction (Rc = 0.81). Similar to mode


UVE, SAP

Stepwise

combination, the notion of model fusion in hyperspectral scat-


Table 2–Waveband selection for firmness detection using HSI.

NSAP

tering imaging was proposed aiming at improving the prediction


accuracy (Wang and others 2012a). In this study, 2 wavelength
/
/

selection algorithms, uninformative variable elimination (UVE)


and supervised affinity propagation (SAP), were first employed to
500 to 1040

500 to 1000
500 to 1000
400 to 1000
500 to 1000

500 to 1000
650 to 1000
400 to 1000
Range (nm)

430 to 980

extract important wavebands. Subsequently, corresponding PLS


models based on the selected wavebands were developed, namely,
UVE-PLS model and SAP-PLS model. With the aid of a BP
neural network for data fusion, the above 2 models were joined
to form a final fusion model. Results showed that the prediction
performance of fusion model (Rp = 0.828) was improved com-
Fluorescence

pared with the results from either UVE-PLS model (Rp = 0.805)
Reflectance
Reflectance
Reflectance
Reflectance
Scattering
Scattering
Scattering
Scattering
Mode

or the SAP-PLS model (Rp = 0.814). Considering the merits


of waveband extraction in data-cube processing, Huang and Lu
(2010a) utilized a hierarchical evolutionary algorithm along with
PLS method to select 17 wavebands for apple firmness prediction,
accomplishing a much higher accuracy (Rp = 0.857, RMSEP =
Strawberry

6.2 N) compared with the result (Rp = 0.848, RMSEP = 6.4 N)


Blueberry
Species

Banana
Mango
Peach
Apple

by simply using PLS. An alternative of wavelength selection for


predicting apple firmness was a modified Lorentzian distribution

180 Comprehensive Reviews in Food Science and Food Safety r Vol. 14, 2015 
C 2015 Institute of Food Technologists®
Progress of hyperspectral imaging . . .

function (Peng and Lu 2006), where high correction coefficients slices (with 3 mm thickness) during 4 and 15 °C storage tempera-
of 0.898 and 0.897 for “Red Delicious” and “Golden Delicious” tures by HSI, MC prediction performances between PCR model
apples were achieved, respectively. at full wavelength range and PCR and MLR models at selected
Others. Besides the textural disorder of bruise and chilling in- wavebands were compared, and results showed that the best pre-
jury in fruits, other textural properties, such as hardness, juici- diction accuracy was achieved by PCR models with 20 feature
ness, and chewiness are highly related to its sensory quality. Apple wavelengths.
mealiness is a kind of tissue disorder characterized as a lack of Soluble solids content. SSC, also named total soluble solids
juiciness and tissue looseness. Huang and Lu (2010b) used 2 pa- (TSS) content, is a collective index for sweetness measurement.
rameters, hardness and juiciness, as index for mealiness detection In the preharvest period, SSC profoundly dominates the optimal
in “Golden Delicious” apples using a HSI system performing from harvest time for various fruits and vegetables, whereas changes of
600 to 1000 nm. Mean reflectance derived from the targeted apple SSC during the shelf-life period after harvesting would lead to
was calculated to characterize the hyperspectral scattering profiles. quality fluctuation of fruits and vegetables. For SSC prediction
PLS models for hardness and juiciness prediction yield low per- using HSI, some feature wavelengths were extracted via various
formance, with correlation coefficients Rp ࣘ 0.76 for hardness wavelength selection methods. For example, a novel semisuper-
and Rp ࣘ 0.54 for juiciness. While PLS-DA classification models vised affinity propagation (NSAP) method was employed to pre-
for “mealy” and “nonmealy” apples achieved accuracy between dict SSC of “Golden Delicious” apples (Zhu and others 2013).
74.6% and 86.7%. With the locally linear embedding algorithm Compared with traditional affinity propagation method or genetic
for feature extraction (Huang and others 2012), PLS-DA gave an algorithm, the NSAP algorithm not only reduced data redundancy
overall classification performance of 80.4%, whereas higher accu- but also improved the correlation coefficients from 0.876 to 0.890.
racy (82.5%) was obtained by SVM classification model. Gowen In studying SSC in strawberries, ElMasry and others (2007) se-
and others (2008b) employed a push-broom HSI (400 to 1000 nm) lected 6 optimal wavelengths from the Vis-NIR region based on
to investigate the textural quality (hardness and chewiness) changes β-coefficient of PLS analysis, obtaining the same correlation coef-
of white mushroom slices during storage. Principal component re- ficients of calibration (Rc = 0.80) from both PLS model and mul-
gression (PCR) models performing on 20 wavebands selected by tiple linear regression (MLR) model. Similar prediction accuracy
an exhaustive stepwise regression method showed better predic- of SSC (Rc = 0.78 to 0.82) was acquired in a study of blueberries
tion results for hardness (Rp 2 = 0.77) and chewiness (Rp 2 = 0.72), (Leiva-Valenzuela and others 2013), while the research revealed a
indicating that HSI is promising in contactless determination of very low correlation (R = −0.02 to −0.04) between skin color
texture profiles. and SSC, indicating that skin color could not be used to esti-
mate SSC of blueberries. To elucidate the relationship of TSS and
Biochemical component detection maturity, Rajkumar and others (2012) defined 6 maturity stages
Chemical constituents, such as water content, protein, titratable of banana fruits according to the quality parameters of firmness,
acidity, total solids, and sugar content, play a key role in determin- SSC, and moisture. A quadratic polynomial with high correlation
ing the nutritional values and marketability of fruit and vegetables. (R2 > 0.90) was presented to illuminate the connection of TSS
Therefore, noncontact techniques offering full internal chemical and ripeness at 20 and 25 °C storage temperatures, namely, the
information are in an urgent need. Table 3 summarizes recent ap- TSS could serve as an effective candidate for evaluating the banana
plications of HSI on determination of some chemical constitutes ripeness.
of fruits and vegetables. It turns out that SSC, acidity, and water Acidity. Acidity content can be characterized by titratable acid
content are the top 3 parameters among the considerable internal or pH value. It is a sensory parameter affecting fruit eating quality,
attributes. especially for apples, grapes, and berries. Li and He (2006) em-
Moisture content. The moisture content (MC) of food prod- ployed a reflectance Vis/NIR HSI to measure the acidity content
ucts has a critical impact on quality and safety features. Generally, of 4 different species of Chinese Bayberries. After spectral prepro-
the MC of fruits and vegetables varies with their ripening pro- cessing using smoothing and MSC, the spectral data were analyzed
cesses. Strawberry samples in a deep maturity stage were found to using PLS method. Interestingly, the pretreatment procedure had
have higher MC and lower relative reflectance in 400 to 1000 nm an impact on the prediction performance, PLS models with MSC
spectral domain (ElMasry and others 2007). Investigations on the operation for noise removal performed better than models without
relationship of MC and maturity in banana fruit using hyperspec- MSC treatment. In the acidity study of strawberries using a simi-
tral reflectance imaging reached a consistent result (Rajkumar and lar hyperspectral system (ElMasry and others 2007), it was found
others 2012), in which MC of banana pulp increased with in- that the spectral pretreatments of mean-centering and automatic
creasing maturity and the reflectance response giving maximum baseline correction enhanced PLS calibration model when com-
differentiation in ripeness stage was shown in 800 to 960 nm in- pared with others pretreatments, such as Savitzky-Golay smooth-
tervals. Significantly, the correlation of MC and maturity stage of ing, MSC, and first and second derivatives. On the other hand,
bananas was depicted as a linear relationship at different storage Baiano and others (2012) carried out acidity determination in 7
temperatures. For the dried fruits or vegetables, MC value is an cultivars of table grapes using NIR HSI with PLS models per-
important parameter affecting the shelf life during storage. Huang forming on the mean-centering correction spectra and achieved
and others (2014) utilized HSI to predict MC of vegetable soy- the coefficients of determination for predicting titratable acid and
beans during drying process, with an active contour model, in pH of red grapes of 0.80 and 0.90, and 0.95 and 0.82 for white
which an energy function for a closed curve was initially defined grapes, respectively.
and then employed for searching the sample boundaries, the soy- Phenolics. The skin of grape fruits contains some functional
beans images were segmented from the background and MC was constitutes, such as phenolic substances that are beneficial to
predicted at a high accuracy level (Rp = 0.971 and RMSEP = human body, thus research on this aspect received great inter-
4.7%) using PLS regression model. On the other hand, Gowen ests. Nogales-Bueno and others (2014) utilized NIR HSI (900
and others (2008b) monitored the moisture loss of mushroom to 1700 nm) for nondestructive determination of total phenolic


C 2015 Institute of Food Technologists® Vol. 14, 2015 r Comprehensive Reviews in Food Science and Food Safety 181
Table 3–Applications of HSI in quantitative analysis of biochemical qualities since 2005.

Component Species Range (nm) Data analysis Accuracy Reference


Moisture content Mango 400 to 1000 PCA, PLS, ANN Rp = 0.81 (Servakaranpalayam 2006)
Strawberry 400 to 1000 PLS, MLR Rp = 0.87 to 0.90 (ElMasry and others 2007)
Mushroom 400 to 1000 MLR, PCR Rp 2 = 0.75 (Gowen and others 2008b)
Progress of hyperspectral imaging . . .

Banana 400 to 1000 PLS, MLR Rp 2 = 0.87 (Rajkumar and others 2012)
Vegetable soybean 400 to 1000 PLS Rp = 0.90 to 0.97 (Huang and others 2014)
Soluble solid content (Total soluble solid) Mango 400 to 1000 PCA, PLS, ANN Rp = 0.78 (Servakaranpalayam 2006)
Apple 500 to 1040 PCA, ANN Rp = 0.63 to 0.70 (Noh and Lu 2007)
Strawberry 400 to 1000 PLS, MLR Rp = 0.80 (ElMasry and others 2007)
Apple 500 to 1000 PLS Rp = 0.66 to 0.88 (Mendoza and others 2011)
Table grape 400 to 1000 PLS R = 0.93 to 0.94 (Baiano and others 2012)
Banana 400 to 1000 PLS, MLR Rp 2 = 0.85 (Rajkumar and others 2012)
Apple 500 to 1000 NSAP + PLS Rp = 0.88 to 0.89 (Zhu and others 2013)
Blueberry 500 to 1000 PLS Rp = 0.79 (Leiva-Valenzuela and others 2013)
Bell peper 550 to 850 PLS R2 = 0.87 to 0.95 (Schmilovitch and others 2014)
Grape 950 to 1650 MPLS Rp = 0.97 to 0.99 (Nogales-Bueno and others 2014)
Acidity (Titratable acid/pH) Chinese Bayberry 320 to 1075 PLS Rp = 0.96 (Li and He 2006)

182 Comprehensive Reviews in Food Science and Food Safety r Vol. 14, 2015
Apple 500 to 1040 PCA, ANN Rp = 0.43 to 0.57 (Noh and Lu 2007)
Strawberry 400 to 1000 PLS, MLR Rp = 0.87 to 0.92 (ElMasry and others 2007)
Table grape 400 to 1000 PLS R = 0.80 to 0.95 (Baiano and others 2012)
Grape 950 to 1650 MPLS Rp = 0.92 to 0.98 (Nogales-Bueno and others 2014)
Starch Apple 1000 to 1700 PLS-DA 80.81% (Menesatti and others 2008)
Potato 400 to 1000 PLS-DA / (Trong and others 2011)
Total phenols Grape skin 950 to 1650 MPLS Rp = 0.77 to 0.89 (Nogales-Bueno and others 2014)
Anthocyanins Grape skin 400 to 1000 PCA, AB-NN R2 = 0.65 (Fernandes and others 2011)
Grape skin 900 to 1700 PCA, MPLS R = 0.86 (Hernández-Hierro and others 2013)
Lycopene Tomato 200 to 2500 (cm−1 ) SID / (Qin and others 2011)
Total glucosinolates Broccoli 950 to 1650 PCA, PLS / (Hernández-Hierro and others 2014)
Polyphenol oxidase activity Mushroom 445 to 945 PCR, MLR, PLS RPD = 0.81 to 2.01 (Gaston and others 2010a)
2


Ascorbic acid, Total chlorophyll, Carotenoid Bell pepper 550 to 850 PLS R = 0. 72 to 0.58, R2 = 0.44 (Schmilovitch and others 2014)
to 0.95, R2 = 0.87 to 0.97
PCR, principle component regression; MPLS, modified PLS; AB-NN, adaptive boosting neural network; SID, spectral information divergence algorithm.

C 2015 Institute of Food Technologists®


Progress of hyperspectral imaging . . .

concentration of grape skins, outliers were removed from sample different fungi. Similarly, Li and others (2012) made an endeavor
set by a Student’s t-test with criterion of T ࣙ 2.5. Quantitative to differentiate cankerous tissues from normal tissues and 9 types of
analysis of total phenols was performed by modified partial least peel diseases on “Navel” oranges using line-scan hyperspectral re-
squares (MPLS) regression, achieving prediction accuracy of R2 = flectance imaging (400 to 1000 nm). The combination algorithms
0.89 and SEP (standard error of prediction) = 1.23 mg/g. of PCA and two-band ratio (I687/630 ) achieved higher detection
Anthocyanin is a kind of phenolics relating to the pigmentation rate for training (99.5%) and testing (98.2%) set compared with a
of red grape, and it plays an important role in color changing single two-band ratio method (with 84.5% and 82.9% accuracy for
of grapes and red wine (Hernández-Hierro and others 2013). training and testing, respectively). In a similar spectral region, Qin
Estimation of the anthocyanin concentration in intact grape and others (2009) implemented a spectral information divergence
(Cabernet Sauvignon variety) skins by Vis/NIR HSI was carried (SID) algorithm for the mean spectra of selected regions of interest
out by Fernandes and others (2011), who showed that PLS models (ROIs) to recognize canker spots from normal and 5 other peel
were far more insufficient in anthocyanin prediction (R2 = 0.25), diseases, accomplishing a discrimination rate of 95.3% with zero
however, a novel neural network method, called AdaBoost that is false-negative error. Based on previous studies, the authors estab-
designed by integrating several individual neural network outputs lished a small-scale hyperspectral reflectance imaging for real-time
for prediction, outperformed the PLS method, giving a higher detection of grapefruit canker (Qin and others 2012), but the cur-
precision (R2 = 0.65) for anthocyanin prediction. rent system only provided a small proportion of observation from
Other functional attributes. Regarding the detection of the whole fruit. Further research targeting at obtaining full surface
internal chemical constitutes responsible for maturity stage of information is needed.
fruits, HSI shows great potential in quantitative measurement and Fruit fly/insect infestation. Noninvasive measurement of fruit
visualization of starch index in apples (Menesatti and others 2008) flies or insects is a complicated job due to the fact that larvae
and lycopene content in tomatoes (Qin and others 2011). By generally hide themselves deep inside the fruits and vegetables and
tracking and analyzing the spectral changes of starch in potatoes they cannot be easily detected from outside. Inspection of internal
during boiling process, the optimal cooking time of potatoes can insect infestation in tart cherry was performed by Xing and others
be predicted (Trong and others 2011). In spite of these common (2008) using Vis-NIR HSI in reflectance and transmittance mode,
quality attributes being detected, activity of polyphenol oxidase respectively. With a 150-W halogen light as illumination for both
corresponding to mushroom browning was predicted using modes, identification performance in hyperspectral transmittance
Vis/NIR HSI (Gaston and others 2010a). With the use of MSC images (580 to 980 nm) was found worse than that in reflectance
pretreatment, spectral variations due to the morphological feature images (590 to 1550 nm) because the transmitting light intensity
of mushroom cap was corrected, obtaining R2 of 0.75 and 0.78 was affected not only by the infestation level but also by the sizes of
for training and testing sets in PCR models for enzyme activity the cherries. Moreover, 3 (780, 850, and 1070 nm) or 4 (780, 850,
prediction. Another preprocessing approach for lessening light 1315 and 1430 nm) optimal wavebands selected by genetic algo-
scattering effect, that is SNV, was applied before PLS modeling in rithm were found to be located in the NIR region in reflectance
order to effectively quantify total glucosinolates in florets of freeze- mode, showing that the reflectance response for detecting cherry
dried broccoli (Hernández-Hierro and others 2014). Schmilovitch insect infestation in NIR spectral range is more important than
and others (2014) presented 4 spectral pretreatments (first deriva- that in visible spectral range. Similar work was done by Lu and
tive of raw reflectance R, log(1/R), first and second derivative Ariana (2013) using hyperspectral reflectance (450 to 740 nm) and
of log(1/R)) in PLS models for detecting some internal quality transmittance (740 to 1000 nm) imaging for distinguishing fruit
parameters of bell pepper, the best results for total chlorophyll and fly infestation in pickling cucumbers. The detection accuracy in
carotenoid content were achieved by log(1/R) pretreatment cou- transmittance mode (88% to 93%) was higher than the outcomes
pled with PLS regression, with R2 of 0.95 and 0.97, respectively. in reflectance mode. Interestingly, integrating the data from re-
flectance and transmittance imaging failed to improve the detec-
Safety features assessment tion rate as achieved in transmittance imaging. Nevertheless, all
Fruits and vegetables bearing disease or microbial/chemical con- the detection performance in HSI was better than manual inspec-
tamination should be diverted due to food safety concerns. A tion (with 75% of accuracy). Making good use of the advantages
comprehensive summarization of HSI in addressing food safety of hyperspectral transmittance imaging in diagnosing inner foreign
problems was provided in a previous review (Feng and Sun 2012). matters, research on the discrimination between insect-damaged
Specifically, this part deals with safety concerns in fruits and and undamaged vegetable soybeans was investigated (Huang and
vegetables. others 2013) on the assumption that transmittance properties had
Disease caused by fungi/bacteria. Orange, lemon, mandarin, been changed after moth attack. In the study, 4 statistical fea-
and grapefruit are citrus fruits easily infested by fungi, such as ture images, minimum, maximum, mean, and standard deviation
Penicillium digitatum and Penicillium italicum (Gómez-Sanchis and of normal and damaged soybeans, were compared in the spectral
others 2013) or the bacterial pathogen Xanthomonas axonopodis scope of 400 to 1000 nm. Calibration model based on support
pv. citri (Cernadas and Benedetti 2009), causing fruit rottenness vector data description (SVDD) produced 100% classification re-
or citrus canker. Gómez-Sanchis and others (2012) utilized hy- sults, and an overall accuracy of 95.6% was also achieved for the
perspectral reflectance imaging to identify rottenness symptoms validation set which was a superior result compared with previous
of tangerines induced by inoculating Penicillium sp. Working in studies. Moreover, HSI was also employed to identify the locations
collaboration with MRMR algorithm for band selection, it was of mangoes infested by fruit fly (Haff and others 2013).
found that performance of multilayer perceptron (MLP) classi- Fecal contamination. When using feces, which may contain
fier (with 98.30% classification accuracy) was better than classi- pathogenic Escherichia coli (E. coli) strains, as the manure source,
fication and regression tree (CART) method. The greatest con- the surface of fruits and vegetables might be easily contaminated.
tribution of this study was to distinguish citrus rottenness from Comparisons of the capability of hyperspectral reflectance and
other peel defects, particularly to identify the diseases caused by 2 fluorescence imaging for detecting different feces concentrations


C 2015 Institute of Food Technologists® Vol. 14, 2015 r Comprehensive Reviews in Food Science and Food Safety 183
Table 4–Applications of HSI in safety inspection of fruits and vegetables since 2005.

Features Species Range (nm) Mode Data analysis Accuracy Reference


Fly infestation (insect Tart berry 580 to 980 590 to 1550 Reflectance, GA, PLS-DA 81.3% to 95.76% (Xing and others 2008)
damage) transmittance
Progress of hyperspectral imaging . . .

Jujube 400 to 720 Reflectance SDA 94% to 97% (Wang and others 2011)
Pickling cucumber 450 to 740 740 to 1000 Reflectance, PLS-DA 82% to 93% (Lu and Ariana 2013)
transmittance
Vegetable soybean 400 to 1000 Transmittance SVDD + LOOCV 87.5% to 97.3% (Huang and others 2013)
Mango 400 to 1000 / A multialgorithms scheme 79.7% to 98% (Haff and others 2013)
E.coli contamination Packaged spinach 400 to 1000 Reflectance PCA, ANN Rp 2 = 0.97 (Siripatrawan and others 2011)
Feces contamination Apple 430 to 900 Reflectance, fluorescence A multialgorithms scheme 58.3% to 100% (Lefcout and others 2006)
443 to 729 Fluorescence A multialgorithms scheme / (Lefcout and Kim 2006)
447 to 951 Reflectance BRA, SDA, PCA / (Liu and others 2007)
481 to 780 Fluorescence Algorithms based on BRA and >99% (Yang and others 2012)
BDA
Cantaloupes 425 to 774 Fluorescence BRA, PCA 79% to 96% (Vargas and others 2005)
Romaine lettuce,Baby 420 to 700 Fluorescence PCA / (Kang and others 2011)
spinach

184 Comprehensive Reviews in Food Science and Food Safety r Vol. 14, 2015
Dichlorvos residue Orange 400 to 1000 Reflectance PLS Rp = 0.83 (Li and others 2010)
Deterioration Spinach leaf 400 to 1000 Reflectance SAM, PLS-DA, CovSel 75% to 100% (Diezma and others 2013)
Shelf-life Spinach leaf 400 to 1000 Reflectance PCA / (Lara and others 2013)
Rottenness caused by Mandarins 460 to 1020 Reflectance GA, LDA, CART >91% (Gómez-Sanchis and others 2008b)
Penicillium sp.
400 to 720 650 to 1100 Reflectance ANN (MLP), CART Around 98% (Gómez-Sanchis and others 2012)
460 to 720 730 to 1020 Reflectance CART, ANN 93.06%, 98.3% (Gómez-Sanchis and others 2013)
Citrus canker Grapefruit 450 to 930 Reflectance SID 95.2% to 96.2% (Qin and others 2009)
Orange 400 to 1000 Reflectance PCA 92.5% (Zhang and others 2011)
550 to 900 Reflectance BRA + PCA 82.9% to 99.5% (Li and others 2012)
Sour skin caused by Onion 950 to 1650 Reflectance PCA, SVM+ 10-fold CV, 87.14%, 80% (Wang and others 2012b)
Burkholderia sp. LDA+ 10-fold CV
Brown blotch caused by Mushroom 400 to 1000 Reflectance PLS-DA (Gaston and others 2010b)


>95%
Pseudomonas sp.
GA, genetic algorithm; SVDD, support vector data description algorithm; SDA, second difference algorithm; CovSel, covariance selection method; CART, classification and regression trees; CV, cross validation.

C 2015 Institute of Food Technologists®


Progress of hyperspectral imaging . . .

(1:2, 1:20, and 1:200 dilution levels) on apples was given by and Ariana 2013], reflectance and fluorescence [Lefcout and
Lefcout and others (2006), and the results indicated that detec- others 2006]) in one HSI system had achieved success in assessing
tion accuracy was increased with decreasing feces dilution in both safety and quality attributes of fruits and vegetables. Thus, future
systems, yet the performance in fluorescence mode is preferable HSI systems performing in a multimode manner would have a
to that in reflectance mode by showing better behavior in feces good potential by offering more comprehensive information on
examination at the same concentration level. Based on the flu- the same object.
orescence intensity at 4 selected wavebands, 3 simple algorithms
intended to enhance the contrast of feces against uncontaminated Conclusion
region on apple fluorescence images were proposed, and detec- Getting full benefits of spectroscopy and computer vision,
tion accuracy of over 99% was achieved (Yang and others 2012). chemometrics-assisted HSI is a potential measurement tool for
However, after the enhancement of image contrast, some surface qualitative and quantitative determination of many agro-food
defects might also be highlighted on images, making it difficult to products. This review stressed the recent progress of HSI in as-
tell the differences between feces spots and surface defects (Vargas sessing textural quality attributes (bruise, chilling injury, firmness),
and others 2005). Another factor affecting feces detection lies in biochemical components (MC, soluble solid content, acidity, and
the object itself where fluorescence interferences from the sam- others), and safety attributes (fruit fly infestation, bacterial diseases,
ples themselves may arise. In this respect, Kang and others (2011) feces contamination) of fruits and vegetables. The striking advan-
investigated the potential of hyperspectral fluorescence imaging tage of this technique is its chemical-free and nondestructive de-
in discriminating bovine fecal contamination on Romaine lettuce tecting nature together with the abundant information provided,
and baby spinach. Under the ultraviolet-A (320 to 400 nm) exci- which enables multiple quality features to be examined. With
tation, the chlorophyll-a emission peak of feces was found to be continued technical innovations in manufacturing and comput-
inclined to shorter wavelength compared to that in green surface. ing, HSI performing in a low-cost and high-speed way for online
Others. Other inspections of potential hazards on fruits and and real-time detection of various products is foreseen.
vegetables are listed in Table 4. For example, HSI has been used to
detect sour skin disease of onion, caused by bacteria Burkholderia Acknowledgments
cepacia (Wang and others 2012b), to identify E. coli contamination Financial support from Univ. College Dublin (UCD)
on spinach leaf (Siripatrawan and others 2011), and to assess the and the Chinese Scholarship Council (CSC) is gratefully
brown blotch disease on mushroom caps by the occurrence of acknowledged.
Pseudomonas tolaasii (Gaston and others 2010b).

Technical Challenges and Future Directions


Though HSI in association with powerful chemometrics releases References
us from the laborious measurement and burdensome computation Adams MJ. 2004. Chemometrics in analytical spectroscopy. Cambridge, UK:
Royal Society of Chemistry.
during food quality assessment, there are still some obstacles to be
Ariana DP, Lu R. 2010. Hyperspectral waveband selection for internal defect
surmounted in applying HSI into real-time applications. First of detection of pickling cucumbers and whole pickles. Comput Electron Agric
all, the equipment is still too expensive, especially for those with 74:137–44.
high spatial and spectral resolutions. Second, when the prebuilt Ariana DP, Lu R, Guyer DE. 2006. Near-infrared hyperspectral reflectance
model is applied to another HSI system, model transformation imaging for detection of bruises on pickling cucumbers. Comput Electron
Agric 53:60–70.
should be carefully conducted. Third, the characteristics of sam-
Baiano A, Terracone C, Peri G, Romaniello R. 2012. Application of
ples may also pose some problems for quality classification and hyperspectral imaging for prediction of physico-chemical and sensory
prediction. On the one hand, spectral variations due to morpho- characteristics of table grapes. Comput Electron Agric 87:142–51.
logical changes of most fruits and vegetables (for example, round Baranowski P, Mazurek W, Wozniak J, Majewska U. 2012. Detection of
or cylinder-shaped objects) diminish the power of models; on the early bruises in apples using hyperspectral data and thermal imaging. J Food
other hand, the interferences that samples possess (for example, the Eng 110:345–55.
stem and calyx to bruise detection, the fluorescence compound to Baranowski P, Mazurek W, Pastuszka-Woźniak J. 2013. Supervised
classification of bruised apples with respect to the time after bruising on the
feces identification) might deteriorate the classification accuracy. basis of hyperspectral imaging data. Postharvest Biol Technol 86:249–58.
In future research, spectral and image processing techniques in Barbin DF, ElMasry G, Sun D-W, Allen P. 2012. Predicting quality and
dealing with morphological influence are required. From the as- sensory attributes of pork using near-infrared hyperspectral imaging. Anal
pect of data analysis, extraction of ROIs (feature wavebands or Chim Acta 719:30–42.
areas) for modeling is generally conducted by manual observation Brosnan T, Sun D-W. 2002. Inspection and grading of agricultural and food
products by computer vision systems – a review. Comput Electron Agric
and operation, which accounts for the majority of analyzing time. 36:193–213.
Automatic recognition of representative ROIs based on computer Cen H, Lu R, Ariana DP, Mendoza F. 2013. Hyperspectral imaging-based
software to improve analytical efficiency is another challenge. With classification and wavebands selection for internal defect detection of
technological advances in both hardware and software, HSI systems pickling cucumbers. Food Bioproc Technol 7:1689–1700.
with low-cost and fast-detecting properties are anticipated. Cur- Cernadas RA, Benedetti CE. 2009. Role of auxin and gibberellin in citrus
canker development and in the transcriptional control of cell-wall
rently, multispectral imaging based on critical wavebands derived remodeling genes modulated by Xanthomonas axonopodis pv. citri. Plant
from HSI receives great attention. It is expected that multispectral Sci 177:190–5.
imaging system would be of broad use in widespread industrial ap- Cheng X, Chen YR, Tao Y, Wang CY, Kim MS, Lefcourt AM. 2004. A
plications due to its relative low instrument cost and high analytical novel integrated PCA and FLD method on hyperspectral image feature
speed. Additionally, HSI can be performed in different modes, and extraction for cucumber chilling damage inspection. Trans ASAE
47:1313–20.
each mode has its own superiority on providing specific sample
Cubero S, Aleixos N, Moltó E, Gómez-Sanchis J, Blasco J. 2010. Advances
information. Previous studies on integrating 2 different modes (for in machine vision applications for automatic inspection and quality
example, reflectance and transmittance [Xing and others 2008; Lu evaluation of fruits and vegetables. Food Bioproc Technol 4:487–504.


C 2015 Institute of Food Technologists® Vol. 14, 2015 r Comprehensive Reviews in Food Science and Food Safety 185
Progress of hyperspectral imaging . . .

Dang H-Q, Kim I, Cho B-K, Kim MS. 2012. Detection of bruise damage of Gowen AA, O’Donnell C, Taghizadeh M, Gaston E, O’gorman A, Cullen P,
pear using hyperspectral imagery. 12th International Conference on Frias J, Esquerre C, Downey G. 2008b. Hyperspectral imaging for the
Control, Automation and Systems 17–21. investigation of quality deterioration in sliced mushrooms (Agaricus
Delgado AE, Sun D-W. 2002a. Desorption isotherms for cooked and cured bisporus) during storage. Sens Instr Food Qual Safety 2:133–43.
beef and pork. J Food Eng 51:163–70. Haff RP, Saranwong S, Thanapase W, Janhiran A, Kasemsumran S, Kawano
Delgado AE, Sun D-W. 2002b. Desorption isotherms and glass transition S. 2013. Automatic image analysis and spot classification for detection of
temperature for chicken meat. J Food Eng 55:1–8. fruit fly infestation in hyperspectral images of mangoes. Postharvest Biol
Technol 86:23–28.
Diezma B, Lleo L, Roger JM, Herrero-Langreo A, Lunadei L, Ruiz-Altisent
M. 2013. Examination of the quality of spinach leaves using hyperspectral Hernández-Hierro JM, Nogales-Bueno J, Rodrı́guez-Pulido FJ, Heredia FJ.
imaging. Postharvest Biol Technol 85:8–17. 2013. Feasibility study on the use of near-infrared hyperspectral imaging for
the screening of anthocyanins in intact grapes during ripening. J Agric Food
Edelman GJ, Gaston E, van Leeuwen TG, Cullen PJ, Aalders MCG. 2012. Chem 61:9804–09.
Hyperspectral imaging for non-contact analysis of forensic traces. Forensic
Sci Intl 223:28–39. Hernández-Hierro JM, Esquerre C, Valverde J, Villacreces S, Reilly K,
Gaffney M, González-Miret ML, Heredia FJ, O’Donnell CP, Downey G.
ElMasry G and Sun D-W. 2010. Principles of hyperspectral imaging 2014. Preliminary study on the use of near infrared hyperspectral imaging
technology. In: Sun D-W, editor. Hyperspectral imaging for food quality for quantitation and localisation of total glucosinolates in freeze-dried
analysis and control. Chap. 1. San Diego: Academic Press. p 3–43. broccoli. J Food Eng 126:107–12.
ElMasry G, Wang N, ElSayed A, Ngadi M. 2007. Hyperspectral imaging for Huang M, Lu R. 2010a. Optimal wavelength selection for hyperspectral
nondestructive determination of some quality attributes for strawberry. J scattering prediction of apple firmness and soluble solids content. Trans
Food Eng 81:98–107. ASABE 53:1175–82.
ElMasry G, Wang N, Vigneault C, Qiao J, ElSayed A. 2008. Early detection Huang M, Lu R. 2010b. Apple mealiness detection using hyperspectral
of apple bruises on different background colors using hyperspectral imaging. scattering technique. Postharvest Biol Technol 58:168–75.
LWT-Food Sci Technol 41:337–45.
Huang M, Zhu Q, Wang B, Lu R. 2012. Analysis of hyperspectral scattering
ElMasry G, Wang N, Vigneault C. 2009. Detecting chilling injury in Red images using locally linear embedding algorithm for apple mealiness
Delicious apple using hyperspectral imaging and neural networks. classification. Comput Electron Agric 89:175–81.
Postharvest Biol Technol 52:1–8.
Huang M, Wan X, Zhang M, Zhu Q. 2013. Detection of insect-damaged
ElMasry G, Iqbal A, Sun D-W, Allen P, Ward P. 2011a. Quality classification vegetable soybeans using hyperspectral transmittance image. J Food Eng
of cooked, sliced turkey hams using NIR hyperspectral imaging system. J 116:45–9.
Food Eng 103:333–44.
Huang M, Wang Q, Zhang M, Zhu Q. 2014. Prediction of color and
ElMasry G, Sun D-W, Allen P. 2011b. Non-destructive determination of moisture content for vegetable soybean during drying using hyperspectral
water-holding capacity in fresh beef by using NIR hyperspectral imaging. imaging technology. J Food Eng 128:24–30.
Food Res Int 44:2624–33.
Jackman P, Sun D-W, Du C-J, Allen P, Downey G. 2008. Prediction of beef
ElMasry G, Sun D-W, Allen P. 2012. Near-infrared hyperspectral imaging eating quality from colour, marbling and wavelet texture features. Meat Sci
for predicting colour, pH and tenderness of fresh beef. J Food Eng 80:1273–81.
110:127–40.
Jackman P, Sun D-W, Du C-J, Allen P. 2009. Prediction of beef eating
Feng Y-Z, Sun D-W. 2012. Application of hyperspectral imaging in food qualities from colour, marbling and wavelet surface texture features using
safety inspection and control: a review. Crit Rev Food Sci Nutr homogenous carcass treatment. Pattern Recognit 42:751–63.
52:1039–58. Kang S, Lee K, Son J, Kim MS. 2011. Detection of fecal contamination on
Fernandes AM, Oliveira P, Moura JP, Oliveira AA, Falco V, Correia MJ, leafy greens by hyperspectral imaging. Procedia Food Sci 1:953–9.
Melo-Pinto P. 2011. Determination of anthocyanin concentration in whole Kamruzzaman M, ElMasry G, Sun D-W, Allen P. 2011. Application of NIR
grape skins using hyperspectral imaging and adaptive boosting neural hyperspectral imaging for discrimination of lamb muscles. J Food Eng
networks. J Food Eng 105:216–26. 104:332–40.
Fukushima T, Yamazaki M, Tsugiyama T. 1977. Chilling-injury in Kamruzzaman M, ElMasry G, Sun D-W, Allen P. 2012. Prediction of some
cucumber fruits. I. Effects of storage temperature on symptoms and quality attributes of lamb meat using near-infrared hyperspectral imaging
physiological changes. Scientia Horticulturae 6:185–97. and multivariate analysis. Anal Chim Acta 714:57–67.
Gaston E, Frias JM, Cullen PJ, O’Donnell CP, Gowen AA. 2010a. Karimi Y, Maftoonazad N, Ramaswamy HS, Prasher SO, Marcotte M. 2012.
Prediction of polyphenol oxidase activity using visible near-infrared Application of hyperspectral technique for color classification avocados
hyperspectral imaging on mushroom (Agaricus bisporus) caps. J Agric Food subjected to different treatments. Food Bioproc Technol 5:252–64.
Chem 58:6226–33. Kiani H, Sun D-W. 2011. Water crystallization and its importance to
Gaston E, Frias JM, Cullen PJ, O’Donnell CP, Gowenb AA. 2010b. freezing of foods: A review. Trends Food Sci Tech 22:407–26.
Visible-near infrared hyperspectral imaging for the identification and Kleynen O, Leemans V, Destain MF. 2005. Development of a multi-spectral
discrimination of brown blotch disease on mushroom (Agaricus bisporus) vision system for the detection of defects on apples. J Food Eng 69:41–9.
caps. J Near Infrared Spec 18:341–53.
Lara MA, Lleo L, Diezma-Iglesias B, Roger JM, Ruiz-Altisent M. 2013.
Gómez-Sanchis J, Moltó E, Camps-Valls G, Gómez-Chova L, Aleixos N, Monitoring spinach shelf-life with hyperspectral image through packaging
Blasco J. 2008a. Automatic correction of the effects of the light source on films. J Food Eng 119:353–61.
spherical objects. An application to the analysis of hyperspectral images of
citrus fruits. J Food Eng 85:191–200. Lee W-H, Kim MS, Lee H, Delwiche SR, Bae H, Kim D-Y, Cho B-K.
2014. Hyperspectral near-infrared imaging for the detection of physical
Gómez-Sanchis J, Gómez-Chova L, Aleixos N, Camps-Valls G, damages of pear. J Food Eng 130:1–7.
Montesinos-Herrero C, Moltó E, Blasco J. 2008b. Hyperspectral system for
early detection of rottenness caused by Penicillium digitatum in mandarins. J Lefcout AM, Kim MS. 2006. Technique for normalizing intensity histograms
Food Eng 89:80–6. of images when the approximate size of the target is known: Detection of
feces on apples using fluorescence imaging. Comput Electron Agric
Gómez-Sanchis J, Martı́n-Guerrero JD, Soria-Olivas E, Martı́nez-Sober M, 50:135–47.
Magdalena-Benedito R, Blasco J. 2012. Detecting rottenness caused by
Penicillium genus fungi in citrus fruits using machine learning techniques. Lefcout AM, Kim MS, Chen Y R, Kang S. 2006. Systematic approach for
Expert Syst Appl 39:780–85. using hyperspectral imaging data to develop multispectral imagining
systems: detection of feces on apples. Comput Electron Agric 54:22–35.
Gómez-Sanchis J, Blasco J, Soria-Olivas E, Lorente D, Escandell-Montero P,
Martı́nez-Martı́nez JM, Martı́nez-Sober M, Aleixos N. 2013. Hyperspectral Leiva-Valenzuela GA, Lu R, Miguel Aguilera J. 2013. Prediction of firmness
LCTF-based system for classification of decay in mandarins caused by and soluble solids content of blueberries using hyperspectral reflectance
Penicillium digitatum and Penicillium italicum using the most relevant imaging. J Food Eng 115:91–8.
bands and non-linear classifiers. Postharvest Biol Technol 82:76–86. Li X, He Y. 2006. Non-destructive measurement of acidity of Chinese
Gowen AA, O’Donnell CP, Taghizadeh M, Cullen PJ, Frias JM, Downey G. bayberry using Vis/NIRS techniques. Eur Food Res Technol 223:731–6.
2008a. Hyperspectral imaging combined with principal component analysis Li J, Xue L, Liu M, Wang X, Luo C. 2010. Hyperspectral imaging
for bruise damage detection on white mushrooms (Agaricus bisporus). J technology for determination of dichlorvos residue on the surface of navel
Chemometr 22:259–67. orange. Chinese Optics Lett 8:1050–2.

186 Comprehensive Reviews in Food Science and Food Safety r Vol. 14, 2015 
C 2015 Institute of Food Technologists®
Progress of hyperspectral imaging . . .

Li J, Rao X, Ying Y. 2012. Development of algorithms for detecting citrus Qin J, Burks TF, Ritenour MA, Bonn WG. 2009. Detection of citrus canker
canker based on hyperspectral reflectance imaging. J Sci Food Agric using hyperspectral reflectance imaging with spectral information
92:125–34. divergence. J Food Eng 93:183–91.
Liu D, Sun D-W, Zeng X-A. 2013. Recent advances in wavelength selection Qin J, Chao K, Kim MS. 2011. Investigation of Raman chemical imaging for
techniques for hyperspectral image processing in the food industry. Food detection of lycopene changes in tomatoes during postharvest ripening. J
and Bioprocess Tech. 7: 307–323. Food Eng 107:277–88.
Liu Y, Chen YR, Wang CY, Chan DE, Kim MS. 2006. Development of Qin J, Burks TF, Zhao X, Niphadkar N, Ritenour MA. 2012. Development
hyperspectral imaging technique for the detection of chilling injury in of a two-band spectral imaging system for real-time citrus canker detection.
cucumbers; spectral and image analysis. Appl Eng Agric 22:101–11. J Food Eng 108:87–93.
Liu Y, Chen YR, Kim MS, Chan DE, Lefcourt AM. 2007. Development of Rajkumar P, Wang N, Eimasry G, Raghavan GSV, Gariepy Y. 2012. Studies
simple algorithms for the detection of fecal contaminants on apples from on banana fruit quality and maturity stages using hyperspectral imaging. J
visible/near infrared hyperspectral reflectance imaging. J Food Eng Food Eng 108:194–200.
81:412–8. Randeberg LL, Larsen ELP, Svaasand LO. 2010. Characterization of vascular
Liu D, Sun D-W, Zeng X-A. 2013. Recent advances in wavelength selection structures and skin bruises using hyperspectral imaging, image analysis and
techniques for hyperspectral image processing in the food industry. Food diffusion theory. J Biophoton 3:53–65.
Bioproc Technol 7:307–23. Rumpf T, Mahlein AK, Steiner U, Oerke EC, Dehne HW, Plümer L. 2010.
Lorente D, Aleixos N, Gómez-Sanchis J, Cubero S, Blasco J. 2011. Selection Early detection and classification of plant diseases with support vector
of optimal wavelength features for decay detection in citrus fruit using the machines based on hyperspectral reflectance. Comput Electron Agric
ROC curve and neural networks. Food Bioproc Technol 6:530–41. 74:91–9.
Lorente D, Blasco J, Serrano AJ, Soria-Olivas E, Aleixos N, Gómez-Sanchis Schmilovitch Ze, Ignat T, Alchanatis V, Gatker J, Ostrovsky V, Felföldi J.
J. 2013. Comparison of ROC feature selection method for the detection of 2014. Hyperspectral imaging of intact bell peppers. Biosyst Eng 117:83–93.
decay in citrus fruit using hyperspectral images. Food Bioproc Technol Servakaranpalayam SS. 2006. Potential applications of hyperspectral imaging
6:3613–19. for the determination of total soluble solids, water content and firmness in
Lu R, Ariana DP. 2013. Detection of fruit fly infestation in pickling mango. Canada: M.Sc. McGill University.
cucumbers using a hyperspectral reflectance/transmittance imaging system. Siripatrawan U, Makino Y, Kawagoe Y, Oshita S. 2011. Rapid detection of
Postharvest Biol Technol 81:44–50. Escherichia coli contamination in packaged fresh spinach using
Lu R, Peng Y. 2006. Hyperspectral scattering for assessing peach fruit hyperspectral imaging. Talanta 85:276–81.
firmness. Biosyst Eng 93:161–71. Sun D-W. 1997. Thermodynamic design data and optimum design maps for
Lü Q, Tang M. 2012. Detection of hidden bruise on kiwi fruit using absorption refrigeration systems. Appl Therm Eng 17:211–21.
hyperspectral imaging and parallelepiped classification. Procedia Environ Sci Sun D-W. 2004. Computer vision – An objective, rapid and non-contact
12, Part B:1172–9. quality evaluation tool for the food industry. J Food Eng 61:1–2.
Lü Q, Tang MJ, Cai J-R, Zhao J-W, Vittayapadung S. 2011. Vis/NIR Sun D-W, Byrne C. 1998. Selection of EMC/ERH isotherm equations for
hyperspectral imaging for detection of hidden bruises on kiwifruits. Czech J rapeseed. J Agr Eng Res 69:307–15.
Food Sci 29:595–602.
Sun D-W, Eames IW, Aphornratana S. 1996. Evaluation of a novel
Magwaza LS, Opara UL, Nieuwoudt H, Cronje PJR, Saeys W, Nicolaı̈ B. combined ejector-absorption refrigeration cycle—1: Computer simulation.
2011. NIR spectroscopy applications for internal and external quality Int J Refrig 19:172–80.
analysis of citrus fruit—A review. Food Bioproc Technol 5:425–44.
Sun D-W, Woods JL. 1997. Simulation of the heat and moisture transfer
McDonald K, Sun D-W. 2001. The formation of pores and their effects in a process during drying in deep grain beds. Drying Technol
cooked beef product on the efficiency of vacuum cooling. J Food Eng 15:2479–508.
47:175–83.
Tallada JG, Nagata M, Kobayashi T. 2006. Non-destructive estimation of
Mehl PM, Chen YR, Kim MS, Chan DE. 2004. Development of firmness of strawberries (Fragaria x ananassa Duch.) using NIR
hyperspectral imaging technique for the detection of apple surface defects hyperspectral imaging. Environ Control Biol 44:245–55.
and contaminations. J Food Eng 61:67–81.
Trong NND, Tsuta M, Nicolai BM, De Baerdemaeker J, Saeys W. 2011.
Mendoza F, Lu R, Ariana D, Cen H, Bailey B. 2011. Integrated spectral and Prediction of optimal cooking time for boiled potatoes by hyperspectral
image analysis of hyperspectral scattering data for prediction of apple fruit imaging. J Food Eng 105:617–24.
firmness and soluble solids content. Postharvest Biol Technol 62:149–
60. Valous NA, Mendoza F, Sun D-W, Allen P. 2009. Colour calibration of a
laboratory computer vision system for quality evaluation of pre-sliced hams.
Menesatti P, Zanella A, D’Andrea S, Costa C, Paglia G, Pallottino F. 2008. Meat Sci 81:132–41.
Supervised multivariate analysis of hyper-spectral NIR images to evaluate
the starch index of apples. Food Bioproc Technol 2:308–14. Van Zeebroeck M, Van linden V, Ramon H, De Baerdemaeker J, Nicolaı̈
BM, Tijskens E. 2007. Impact damage of apples during transport and
Nagata M, Tallada JG, Kobayashi T. 2006. Bruise detection using NIR handling. Postharvest Biol Technol 45:157–67.
hyperspectral imaging for strawberry (Fragaria x ananassa Duch.). Environ
Control Biol 44:133–42. Vargas AM, Kim MS, Tao Y, Lefcourt AM, Chen YR, Luo YG, Song YS,
Buchanan R. 2005. Detection of fecal contamination on cantaloupes using
Nanyam Y, Choudhary R, Gupta L, Paliwal J. 2012. A decision-fusion hyperspectral fluorescence imagery. J Food Sci 70:E471–6.
strategy for fruit quality inspection using hyperspectral imaging. Biosyst Eng
111:118–25. Vélez Rivera N, Gómez-Sanchis J, Chanona-Pérez J, Carrasco JJ, Millán-
Giraldo M, Lorente D, Cubero S, Blasco J. 2014. Early detection of
Nogales-Bueno J, Hernández-Hierro JM, Rodrı́guez-Pulido FJ, Heredia FJ. mechanical damage in mango using NIR hyperspectral images and machine
2014. Determination of technological maturity of grapes and total phenolic learning. Biosyst Eng 122:91–8.
compounds of grape skins in red and white cultivars during ripening by
near infrared hyperspectral image: a preliminary approach. Food Chem Wang HH, Sun D-W. 2002. Melting characteristics of cheese: Analysis of
152:586–91. effect of cheese dimensions using computer vision techniques. J Food Eng
52:279–84.
Noh HK, Lu R. 2007. Hyperspectral laser-induced fluorescence imaging for
assessing apple fruit quality. Postharvest Biol Technol 43:193–201. Wang J, Nakano K, Ohashi S, Kubota Y, Takizawa K, Sasaki Y. 2011.
Detection of external insect infestations in jujube fruit using hyperspectral
Noh HK, Peng Y, Lu R. 2007. Integration of hyperspectral reflectance and reflectance imaging. Biosyst Eng 108:345–51.
fluorescence imaging for assessing apple maturity. Trans ASABE 50:963–71.
Wang S, Huang M, Zhu Q. 2012a. Model fusion for prediction of apple
Pace B, Cefola M, Renna F, Renna M, Serio F, Attolico G. 2013. Multiple firmness using hyperspectral scattering image. Comput Electron Agric
regression models and Computer Vision Systems to predict antioxidant 80:1–7.
activity and total phenols in pigmented carrots. J Food Eng 117:74–81.
Wang W, Li C, Tollner EW, Gitaitis RD, Rains GC. 2012b. Shortwave
Peng Y, Lu R. 2006. Improving apple fruit firmness predictions by effective infrared hyperspectral imaging for detecting sour skin (Burkholderia
correction of multispectral scattering images. Postharvest Biol Technol cepacia)-infected onions. J Food Eng 109:38–48.
41:266–74.


C 2015 Institute of Food Technologists® Vol. 14, 2015 r Comprehensive Reviews in Food Science and Food Safety 187
Progress of hyperspectral imaging . . .

Wei X, Liu F, Qiu Z, Shao Y, He Y. 2013. Ripeness classification of Yang C-C, Kim MS, Kang S, Cho B-K, Chao K, Lefcourt AM, Chan DE.
astringent persimmon using hyperspectral imaging technique. Food Bioproc 2012. Red to far-red multispectral fluorescence image fusion for detection
Technol 7:1371–80. of fecal contamination on apples. J Food Eng 108:312–19.
Wu D, Sun D-W. 2013. Advanced applications of hyperspectral imaging Yu K, Zhao Y, Li X, Shao Y, Zhu F, He Y. 2014. Identification of crack
technology for food quality and safety analysis and assessment: A review – features in fresh jujube using Vis/NIR hyperspectral imaging combined
Part II: Applications. Innov Food Sci Emerg Technol 19:15–28. with image processing. Comput Electron Agric 103:1–10.
Xing J, De Baerdemaeker J. 2005. Bruise detection on ‘Jonagold’ apples Yu K-Q, Zhao Y-R, Liu Z-Y, Li X-L, Liu F, He Y. 2014. Application of
using hyperspectral imaging. Postharvest Biol Technol 37:152– visible and near-infrared hyperspectral imaging for detection of defective
62. features in loquat. Food Bioproc Technol 7:3077–87.
Xing J, Bravo C, Jancsók PT, Ramon H, De Baerdemaeker J. 2005. Zhang L, Liu M, Li J, Xue L. 2011. Detecting navel orange canker with
Detecting bruises on ‘Golden Delicious’ apples using hyperspectral imaging hyperspectral imaging. Fourth International Conference on Intelligent
with multiple wavebands. Biosyst Eng 90:27–36. Computation Technology and Automation, 106–9.
Xing J, Jancsók P, De Baerdemaeker J. 2007a. Stem-end/calyx identification Zhao Q, Liu J, Chen J, Saritporn V. 2008. Detecting subtle bruises on fruits
on apples using contour analysis in multispectral images. Biosyst Eng with hyperspectral imaging [J]. Trans Chinese Soc Agric Machin
96:231–7. 39(1):106:9.
Xing J, Saeys W, De Baerdemaeker J. 2007b. Combination of chemometric Zhao J, Ouyang Q, Chen Q, Wang J. 2010. Detection of bruise on pear by
tools and image processing for bruise detection on apples. Comput Electron hyperspectral imaging sensor with different classification algorithms. Sensor
Agric 56:1–13. Lett 8:570–6.
Xing J, Guyer D, Ariana D, Lu R. 2008. Determining optimal wavebands Zhu Q, Huang M, Zhao X, Wang S. 2013. Wavelength selection of
using genetic algorithm for detection of internal insect infestation in tart hyperspectral scattering image using new semi-supervised affinity
cherry. Sens Instr Food Qual Safety 2:161–7. propagation for prediction of firmness and soluble solid content in apples.
Xu SY, Chen XF, Sun D-W. 2001. Preservation of kiwifruit coated with an Food Anal Methods 6:334–42.
edible film at ambient temperature. J Food Eng 50:211–16.

188 Comprehensive Reviews in Food Science and Food Safety r Vol. 14, 2015 
C 2015 Institute of Food Technologists®

Você também pode gostar