Você está na página 1de 15

I.J.

Intelligent Systems and Applications, 2014, 06, 79-93


Published Online May 2014 in MECS (http://www.mecs -press.org/)
DOI: 10.5815/ijisa.2014.06.09

A Review on Gravitational Search Algorithm and


its Applications to Data Clustering &
Classification
Yugal kumar
Dept. of Information Technology, Birla Institute of Technology, Mesra, Ranchi, Jhrakhand, India
Email: yugalkumar.14@gmail.co m

G. Sahoo
Department of Information Technology, Birla Institute of Technology, Mesra, Ranchi, Jhrakhand, India
Email: gsahoo@bitmesra.ac.in

Abstract− Natural phenomenon‘s and swarms behavior are the terms of accuracy, convergence computational time etc.
warm area of research among the researchers. A large number Kirkpatrick et al. [12] proposed simu lated annealing
of algorithms have been developed on the account of natural algorith m based on the annealing process of metals and
phenomenon‘s and swarms behavior. These algorithms have applied SA to solve many comb inatorial optimizat ion
been implemented on the various computational problems for
the sake of solutions and provided significant results than problems but SA suffered fro m convergence problem and
conventional methods but there is no such algorithm which can trapped in local minima [13, 14]. In 1995, Kennady et al.
be applied for all of the computational problems. In 2009, a [15] developed an algorithm based on the swarm
new algorithm was developed on the behalf of theory of gravity behavior of birds & fish schooling and named it Particle
and was named gravitational search algorithm (GSA) for Swarm Optimizat ion (PSO). Th is algorithm was applied
continuous optimization problems. In short span of time, GSA to solve many optimizations such as function
algorithm gain popularity among researchers and has been optimization [16] but this algorith m suffered with partial
applied to large number of problems such as clustering, optimism and not works with scattering problems. In case
classification, parameter identification etc. This paper presents of complex and complicated problems PSO algorith m
the compendious survey on the GSA algorithm and its
applications as well as enlightens the applicability of GSA in suffered with optimal solution [17]. In 1975, John
data clustering & classification. Holland [18] developed an algorith m based on the natural
process of evaluation and called it genetic algorith m.
Index Terms− Classification, Clustering, Gravitational Search Many optimization problems solved by with the help of
Algorithm, Optimization, Nature Inspired Algorithm genetic algorithm but it‘s suffered fro m parameter tuning
problem due to complicated crossover & mutation
operator and convergence speed [19]. ACO was
I. INT RODUCT ION developed by the Dorigo [20] in 1992 based on the
behaviors of real wo rld ants. This algorith m applied to
Nature has always been a continuous source of solve many optimization problems such as TSP [21],
inspiration for researchers and scientists. A large number
Graph Co loring [22], Network Routing [23] etc. ACO
of algorith ms have been developed based on the natural algorith m is sometimes suffered fro m selection bias [24]
process of evolution, laws, swarms behavior etc. Nature and convergence [25, 26] problem. Dev is Karbooga et al.
inspired algorithms are the latest state of art algorith ms &
[27] in 2006 proposed ABC algorith m based on the
works well with optimization problems as well as other behavior of hooney Bees i.e. capabilities of Bees to find
problems than the classical methods because classical the food source for numerical optimization problems.
methods are inflexible in nature. It has been proved by
Later on ABC algorithm has widely used to solve other
many researchers that nature inspired algorith ms are problem such as mult i-d imensional nu meric problems
convenient to solve complex co mputational problems [28], real-parameter optimization [29, 30], constrained
such as to optimize objective functions [1, 2], pattern
numerical optimizat ion problems [31] etc. Derv is
recognition [3, 4], control functions [5, 6], image Karaboga & Bey za Gorkemli et al. [8] provided
processing [7, 8], filter modeling [9, 10], clustering [3], comprehensive description about the ABC algorith m and
classification [11] etc. In last one and half decade s everal
its application in various fields as well as hybridization of
nature inspired algorithms have been developed such as ABC & its variants. There are some drawbacks of ABC
Particle swarm optimization (PSO), Genetic A lgorith m algorith m such as it requires large nu mber o f objective
(GA), Simu lated Annealing (SA), Ant colony
function evaluations [32], handling co mplex mu lt imodal
optimization (ACO), Art ificial Bee colony (A BC) functions, functions with narrow curve valley,
optimization, Big Bang Big Crunch (BB-BC) etc. These convergence slow down due to stochastic nature [30] and
algorith ms show better results than classical methods in
weak exp loitation feature [33]. Os man K. Erol et al. [34]

Copyright © 2014 MECS I.J. Intelligent Systems and Applications, 2014, 06, 79-93
80 A Review on Gravitational Search Algorithm and its Applications to Data Clustering & Classification

in 2006 proposed a new algorith m Big Bang Big Crunch gravitational force between two particles is directly
(BB-BC) based on the big bang theory (Theory of proportional to the product of their masses and inversely
Evolution of Universe) for optimization problems. BB- proportional to the square of the distance between them
BC algorith m is used to solve large numbers of [39]. In proposed algorithm part icles considered as
optimization problems such as mu lti modal optimizat ion objects and their performance has evaluated with their
problem [35], mu lti-objective optimizat ion problem [36], masses. In GSA, each particle has associated with four
clustering [37] etc. A brief description about the nature specifications: particle position, its inertial mass, active
inspired algorith ms has been given above that are used to gravitational mass and passive gravitational mass. The
solve the optimization problems but till date there does position of particles provides the solution of problem
not exists any algorithm that can solve the entire while fitness function is used to calculate the
optimization problems exactly. gravitational and inertial masses. Every population based
The gravitational search algorithm is the latest nature algorith m has two capabilities: exp loration and
inspired algorithm proposed by E. Rashedi [38] to solve exploitation. This algorithm uses explorat ion capability at
the optimization problems based on the Law of gravity. the beginning to avoid local optimu m problem and after
Many researchers has applied the gravitational search that explo itation. A t ime function named as Kbest
algorith m on large nu mbers of problems because it particle/agent is used to attract other particles. The
requires only two parameters and having ability to find performance of GSA is improved by controlling
near global optimu m solution and provides better results exploration & exp loitation. The value of Kbest function
as compare to other nature inspired algorith ms. Figure 1 decreases with time linearly and at last only one agent
depicts the applications of the gravitational search will be there with heavy mass that represents final
algorith m in various domains. The objective of this paper solution. Step by step procedure of Gravitational Search
is to provide comp rehensive survey for the researchers Algorithm is given below:
which are doing research in the field of optimizing • Identification of search space.
problems (gravitational search algorith m), swarm • Generate Initial population.
intelligence and nature inspired algorith ms. The first • Evaluate fitness function for each particle in
objective of this paper is to find out the number of population.
algorith ms that are derived fro m the original GSA to • Update the gravitational constant value.
solve the optimization problems as well as to find out the
application of gravitational search algorithm in various G (t) = G (G0 , t), () * +
()
domains such as pattern recognition, power system, data
() ()
mining, classificat ion & clustering and how many
algorith ms are proposed by using gravitational search
algorith m p lus other nature inspired techniques such as  Calculate the total fo rce in different d irection (M)
GA , PSO, SA etc. (Hybrid GSA). The second objective and Acceleration (a) by following equations:
of this paper is to find out the significance of
( ) ( ) ( )
Gravitational algorith m in clustering and classificat ion () Where ( )
∑ ( ) ( ) ( )
problems. In present time, large number of algorith ms
based on the behavior of swarms & natural processes are ( )
used to solve these problems and this paper also provides Acceleration () , where ()
( )
the comparisons of GSA with swarm based algorith ms ∑ ()
for clustering and classification problems.
The rest of paper is organized as follows. Section II  Update the particle velocity and position. Velocity
gives the detail about GSA. Section III describes variants and position of part icle is calculated by following
and modificat ions in GSA. The hybridizat ion of GSA equations:
with other techniques is discussed in section IV. Sect ion
Velocity ( ) () ( )
V and VI focus the application o f GSA algorith m in
clustering and classification. These sections are followed Position ( ) () ( )
by conclusion of paper.
 Stopping criteria (repeat until stopping criteria met).

II. GRAVIT AT IONAL SEARCH A LGORIT HM The performance of the GSA is evaluated with PSO,
RGA and CFO including twenty three benchmark
The gravitational search algorithm is the latest nature functions such as uni-modal test function, mult imodal
inspired population based stochastic search algorithm test function etc. and GSA provides better result with
which is widely used to solve the optimizat ion problems. most of the functions. But the proposed GSA algorith m
E. Rashedi [38] initially proposed gravitational search solves the problems in continuous valued space. Large
algorith m to solve the optimization problem particularly number of algorith ms derived fro m gravitational search
for non linear problems. The grav itational search algorith m to solve different problems. The Figure 2
algorith m is based on Newton‘s theory. Newton‘s law of provides the percentage of algorith ms (original GSA,
gravity states that every particle attracts another particle GSA Variants & Hybrid ized GSA) that was derived fro m
by means of some gravitational force [39, 40]. The the gravitational search algorith m to solve the different

Copyright © 2014 MECS I.J. Intelligent Systems and Applications, 2014, 06, 79-93
A Review on Gravitational Search Algorith m and its Applications to Data Clustering & Classification 81

problems till date as well as to improve the statistics of original GSA.

Applications of Gravitational Search Algorithm


(GSA)

Mathematics Engineering

Optimization Problems Computer Electrical & Management


Science & Electronics Civil &
Computing Mechanical
Combinatorial Continuous Binary Operation
Parameter Slope Research
Web Identification Stability
PFSSP NP-Complete NP - Hard Services Of HTGS Problem
SCM

Parameter Selection Switched Linear System QOS


Parameter
Power Control Identification
Routing System system Of IIR & Non
Pattern DNA Distributed Linear Filters
Recognition Computing Computing & Antenna
Design
Data RPDP
Mining
EDP Fuzzy Based Servo System
OCR DNA Job Scheduling in System Parameters
Applications Design Grid Environment UAE Path Tuning
Planning OPFP

PQMP Parameters Tuning

Clustering Feature Selection Classification

Fig. 1. Applicability of Gravitational Search Algorithm in different domains

applied GSA to solve other optimization problems such


as binary optimization problems, co mbinatorial
optimization proble ms etc and generate the successor of
GSA. Es mat Rashedi [41] has developed the Binary
version of the original GSA for b inary optimizat ion
problems in wh ich updating position means to switch
between 0 and 1 rather than contiguous. Binary
problems are represented in binary space rather than real
space such as hypercube & compare the performance of
BGSA using 23 minimization & 2 maximizat ion
benchmark function with GA and Binary PSO. BGSA
provides remarkable result as compared to others
algorith ms. To exp lore the ―near g lobal optimu m‖ GSA
takes into account two parameters i.e. swarm size and
gravitational coefficient wh ich specifies the searching
Fig. 2. Statistics of Gravitational Search Algorithm ability of GSA such as premature convergence, speed,
capturing candidate solution, population explo ration etc.
To solve the mu lti objective problems Hamid Reza
Hassanzadeh et al. [42] have proposed another variant of
III. GSA VARIANT S, COMPARISONS AND GSA i.e. Mult i Ob jective GSA (M OGSA). The proposed
M ODIFICAT IONS algorith m is used pareto optimality function with
Initially, GSA was proposed to solve the continuous standard GSA to solve the mult i objective problems and
optimization problems but later on many researchers also the performance of MOGSA evaluates with SM PSO,

Copyright © 2014 MECS I.J. Intelligent Systems and Applications, 2014, 06, 79-93
82 A Review on Gravitational Search Algorith m and its Applications to Data Clustering & Classification

MOGA2 and PA ES using spacing & gravitational based GSA evaluated using six bench mark functions and
distance criteria in which MOGSA provides better result compared with o rig inal GSA . The mu lt i agent based
in terms of d istribution of solutions but it takes more t ime GSA (2.72 for 600 masses) provided better performance
as compare to another method while the another than original GSA (3.54 for 600 masses). The mult i agent
techniques require niching method must be apply for based GSA has ability to solve the optimization problems
distribution of solutions. The original GSA is not suitable with non convex objective functions and improved
for mo re co mp licated task basically it is used to solve the sensitivity feature.
non linear benchmark functions, to overcome this
problem Sarafrazi et al. [43] defined a new operator for
GSA named as ―disruption‖ to increases the explorat ion IV. GSA HYBRIDIZAT ION AND A PPLICAT IONS
and explo itation ability of gravitational search algorith m.
The hybridization of an algorith m pretends the
A threshold value parameter is used by author to
increases the performance of the original GSA as well as algorith m more powerfu l and enhances the capabilities of
an algorith m. Due to hybridization, coverage area of
to increases the global optimu m property of GSA and
algorith ms exacerbates and it can wrap mo re problems.
generates good candidate solutions, which can be
achieved by measuring the rat io of d istance between the The GSA is also hybridizes with conventional and swarm
based algorith ms to enhance its capabilit ies. To solve
mass k and nearest neighbors. The performance of
permutation flo w shop problem (PFSSP) Xiangtao Li [49]
proposed GSA compare with original GSA, PSO and
RGA with twenty three benchmark functions. The et al. has proposed ―SIGSA‖ a new hybrid algorith m
based on the GSA and SA. To design the proposed
proposed algorithm provides better results than others
algorith m for PFSSP there were two challenges, firstly
and also avoids premature convergence problem of
original GSA. M. Soleimanpour moghadam [44] et al. how to make GSA applicab le for PFSSP and second trap
in local min ima problem. First obstacle was removed by
has proposed Quantum based GSA which is a modified
using LRV rule and second was removed by using SA &
version of GSA. QGSA is based on dynamics of
Quantum. In orig inal GSA position of object and its IIS based local search. With the help of SA & IIS local
search, four variants of GSA are defined: NGSA, SGSA,
velocity cannot be found simultaneously to overcome this
IGSA and SIGSA. To evaluate the performance of
QGSA actuates the mass of object by waveform instead
of position and velocity. QGSA provides better results SIGSA with PFSSP, twenty nine problems o f t wo classes
of PFSSP are taken and compare the performance of
over original GSA. The QGSA algorith m suffers with
SIGSA with NGSA, SGSA & IGSA as well as PSOMA
―diversity loss‖ problem in collecting the masses of
objects. Radu et al. [45] has proposed a new GSA to & PSOVNS in wh ich SIGSA provides better
performance with all other methods. To avoid slow
reduced parametric sensitivity of Fuzzy based control
convergence speed of GSA Seyedali M irjalili et al. [50]
system for optimal tuning. The proposed algorithm is
constructed fro m orig inal GSA by applying three has proposed a new hybrid algorithm PSOGSA which is
based on the PSO and GSA for function optimizat ion
modifications: define constraint regarding system,
problems. The proposed algorith m is used the global best
modify deprecation equation of gravitational constant and
extended symmetrical method. The perfo rmance of i.e. ―gbest‖ concept of PSO in GSA to find out best
current position among all current positions. The
algorith m evaluates with performance index and
performance of PSOGSA evaluates with twenty three
algorith m p rovides better performance with parametric
variations of controlled process. To increase the benchmarks functions and compares with Std. PSO & Std.
GSA in which PSOGSA performs very well with most of
searching ability of GSA and high convergence rate
functions as compare to Std.PSO & Std.GSA and
Nihan Kazak et al. [46] has developed a new version of
GSA i.e. Modified GSA (M GSA). The proposed provides faster convergence speed. To improve side lobe
levels in concentric ring array A. Chatterjeeet et al. [51]
algorith m is based on the original GSA and concept of
has applied the GSA for synthesis of thinned scanned
satellite agent. The performance of M GSA evaluates with
three benchmark functions and compare with orig inal concentric ring array antenna. The performance of GSA
evaluates with fitness value & computational time and
GSA. The M GSA provides better result than GSA. To
compare with Modified PSO in wh ich GSA provides
increases diversity of mass collection and avoid local
minima Mohadeseh Soleimanpour moghadam & Hossein better results than Modified PSO. The ability to solve the
optimization problems with min imizes discrete time
Nezamabadi pour [47] have proposed Improved QGSA
objective function Radu-Emil Precup et al. [52] has
which is a new version of QGSA. In imp roved QGSA the
fitness function of QGSA has replaced by a new fitness proposed a new version of GSA for tuning the fuzzy
control systems. The new version of GSA is derived fro m
function. The perfo rmance of IQGSA evaluated with
the original GSA by modificat ion in deprecation equation
seven minimizat ion benchmark functions and compared
with original GSA & QGSA in which IQGSA has given and adding constraint regarding system in original GSA.
The proposed algorithm p rovides significant
better results than others. To improve computational cost
improvement in performance indices and covers large
of original GSA Naji et al. [48] have developed a mu lti
agent based GSA wh ich is new version of GSA. In mu lti number of control plants but the algorithm could not
promised global optimu m and minimu m sensitivity. To
agent based GSA, operations have performed in parallel
solve the partner selection problem with due date
rather than sequential. The performance of mu lti agent
constraint Jianhua Xiao et a l. [53] has proposed a new

Copyright © 2014 MECS I.J. Intelligent Systems and Applications, 2014, 06, 79-93
A Review on Gravitational Search Algorith m and its Applications to Data Clustering & Classification 83

hybrid gravitational chaotic search algorith m (GCSA) sensitivity) of fu zzy based servo control systems Radu-
based on the GSA and chaotic local search. The Emil Precup et al. [61] has proposed a novel adaptive
performance of GCSA compares with GSA, PSO, GA gravitational search algorithm based on original GSA and
and B &B in which GCSA provides better performance BGSA. The proposed algorithm is different fro m the
than others algorith ms using cost criteria and avoids earlier algorith m proposed by Radu-Emil Precup et al.
trapping in local optional solution in last iterat ions as [45] & Radu et al. [52]. In novel adaptive gravitational
well as increases convergence rate. J. P. Papa et al. [54] search algorithm two deprecation laws are defined for
have proposed a new hybrid algorithm OPF-GSA based gravitational coefficient which is derived fro m adaptive
on GSA & optimu m path forest classifier for feature PSO. The adaptive GSA provides reduced time constant
selection task and compares the performance of OPF- sensitivity with a new formu lation of Takagi-Sugeno
GSA with OPF-PSO, OPF-PCA, and OPF-LDA on the Proportional Integrated Fuzzy Controllers (T-S PI-FCs).
behalf of accuracy, nu mbers of features selected & t ime The back propagation algorithm for neural network
required in which OPF-GSA provides better performance sometime provides local minimu m convergence rather
in terms o f nu mber of features selected but requires more than global minimu m. So, to overco me local min imu m
execution time than OPF-PSO. To satisfy/overcome convergence problem of back propagation in neural
―initial/boundary conditions‖ M. Ghalambaz et al. [55] network Lucian-Ovidiu Fedorovici et al. [62] has applied
has proposed a new hybrid algorith m HNNGSA based on GSA with back propagation to train the convolution
artificial neural network and GSA fo r wessinger‘s neural network for OCR applicat ions because GSA has
equation. In proposed method, GSA is used to actuate the ability to provided near global optimu m solution and
adjustable parameter and trained the mu lti layer neural evaluated the performance of embedded GSA in
network. The performance of HNNGSA co mpares with convolution neural network with back propagation
Eu ler, improved Eu ler and Runge-Kutta in which technique to classical back propagation algorith m. The
HNNGSA provides better result than other methods. embedded GSA provides better result as compares to
Chaoshun Li et al. [56] has proposed a hybrid algorith m classical BP in terms of convergence and recognitions
IGSA based on GSA & PSO to identify the parameter for rates. To determine the behavior of GSA with nonlinear
hydraulic turbine governing system. The proposed problems S. Du man et al. [63] has applied the GSA
algorith m is differed by two ways; firstly the search algorith m to find the optimal solution for ―react ive power
technique of PSO was used with GSA to found global dispatch problem‖. The performance o f proposed
optimu m and secondly define a new objective function. algorith m evaluates with IEEE 30, 57 &118 bus power
The performance of IGSA compares with GA , PSO & system using three cases i.e. minimization of system real
GSA in which IGSA p rovides higher frequency than power, imp rovement voltage pro file & enhancement of
others Jianhua Xiao and Zhen Cheng [57] has applied the voltage stability and co mpared with BBO, PSO, DE,
gravitational search algorithm on DNA sequences CLPSO, CGA, A GA, SPSO, L-DE etc. The proposed
optimization problem to co mpute good DNA sequences algorith m prov ides robust and better quality result than
and compares the performance of GSA with Delton other methods to solve RPD problem. Serhat Du man et al.
Algorith m (GA ) for DNA design in which GSA provides [64] (2012) are also proposed a new method based on
better result than GA on the behalf of continuity, H- GSA for ―optimal Power Flow problem‖ in power system
measure and similarity criteria parameters. To solve the to find optimal solution due to the ability of GSA adjust
parameter estimation prob lem of IIR and Non linear the accuracy of search itself. The performance of
rational filters Saeid Saryazdi et al. [58] has applied the proposed GSA method evaluates with IEEE 30 Bus
GSA for filter modeling in which GSA works as heuristic power system including six d ifferent cases and compared
search algorith m and co mpares the performance of with BBO, PSO, DE, Improved GA, Gradient Descent,
proposed method with PSO & GA with unimodal EADDE and Enhanced GA using two parameters i.e.
function, mult imodal function & co mplexity of problem average fuel cost and simu lation time in which proposed
i.e. added noise in which proposed algorithm provides GSA method provides best performance using both of
better result without sucked in local optima. To imp rove parameters. To solve parameter quality p lacement
the ―fuel cost result‖ Serhat Du man et al. [59] has applied problem in power system Ahamad Asurl Ibrahim et al.
the GSA to solve the ―Econo mic Dispatch problem‖ for [65] have proposed a hybrid algorithm QBGSA based on
electrical power systems. The performance o f proposed concept of Quantum and BGSA with imp roved search
method evaluates with three test system and compares strategy & convergence speed. Performance of QBGSA
with art ificial immune system, Meta evolutionary evaluates with radial 18 bus distribution system & IEEE
programming, genetic algorith m, IPSO, AIA CO and 118 bus system using bolted three phase, double line to
HPSO among these methods, GSA provides min imu m ground & single phase to ground faults using iteration,
fuel cost. To solve parameter identificat ion problem of fitness function & standard deviation parameters and
chaotic system, Chaoshun Li et al. [60] has proposed a compares with BGSA, OBPSO & BPSO in which
new hybrid algorith m CGSA based on the chaotic local QBGSA provides better performance than others in terms
search & GSA and co mpared the perfo rmance of CGSA of fitness function & standard deviation but suffers fro m
with PSO, GSA & GA in which CGSA provides better slow convergence rate. To improve slow convergence
result than others. To min imize the objective function rate and avoid trap in local minima prob lem o f GSA
(Discrete time weighted sum of control error &Output Seyed Ali Mirjalili et al. [66] has proposed a new hybrid

Copyright © 2014 MECS I.J. Intelligent Systems and Applications, 2014, 06, 79-93
84 A Review on Gravitational Search Algorith m and its Applications to Data Clustering & Classification

algorith m PSOGSA based on the GSA & PSO in which complexity, optimality and convergence in hybrid system
PSOGSA imp lemented as new training method for Feed identification Hamed Sadeghiet et al. [68] has proposed a
forward Neural Net works. Statistics shows that the new version of GSA based on GSA & idea of sparse
PSOGSA provides better performance as compares to optimization fro m the field of sparse signal recovery to
PSO and GSA. To detect the min imu m factor o f safety & identification of switched linear system fro m input-
reliability index in determin istic and probabilistic slope output data and parameter ext raction fo r sub models. The
stability analysis Mohammad Khajehzadeh et al. [67] (in proposed algorithm provides better performance. To
press) has proposed a hybrid Modified gravitational enhance the global search strategy for path p lanning
search algorith m (M GSA) based on GSA & velocity- problem in UA V, LI Pei et al. [69] has applied the
clipping technique with time varying maximu m velocity. hybridize GSA plus PSO algorith m for this problem and
Firstly, the performance of proposed algorithm evaluates compared the performance of proposed algorithm with
with five bench mark functions i.e. unimodal, mu lt imodal original GSA & PSO in wh ich proposed algorithm
etc. and compares with orig inal GSA using accuracy, provides better performance than others. The application
stability, convergence rate & robustness parameters in of GSA in clustering and classification discuss in
which M GSA provides better performance than GSA. separate section.
After that M GSA has applied on slope stability analysis Discussion: Lot of algorithms have been developed by
to determine safety & reliab ility index factor and the researcher based on the gravitational search algorith m
compared with M VFOSM with Spencer method & non to improve the capabilities of GSA, increases the
circular slip surface, M VFOSM with Spencer method & coverage area of GSA, overcome the limitations of some
non circular slip surface by direct search, AFOSM with existed algorith ms etc. and compared the performance of
Spencer method & non circular slip surface by PSO, GSA to others techniques such as PSO, GA, DE, BBO,
AFOSM with Spencer method & non circular slip surface ABC etc. in which GSA provided better performance
by MPSO, AFOSM with M-P method & non circu lar slip than others. The Table 1 provide the year wise
surface by original GSA in which M GSA provided development in the field of gravitational search algorith m
minimu m value for minimu m factor of safety & as well as the problems addressed by the GSA & GSA
reliability index than others. To overcome co mputational based algorithms with performance matrices.

T able1. List of proposed algorithm using GSA and its variants

Ye ar Author Algorithm Problem Performance Metrics


Optimization problems 23 Non linear benchmark functions
2009 Rashedi et al (2009) GSA
in continuous space i.e. unimodal, multi model
Binary optimization 23 Minimization and 2 maximization
2010 Rashedi et al (2010) BGSA
Problems benchmark functions
Hamid Reza Hassanzadeh Multi Objective
2010 MOGSA Spacing & gravitational distance criteria
et al (2010) optimization problems
Permutation flow shop 29 Problems of two classes of PFSSP
2010 Xiangtao Li et al (2010) SIGSA
scheduling problem such as car1, car2 to car8 etc.
T o improve Side lobe in concentric
2010 A. Chatterjeeet al (2010) GSA Fitness Value & Computational T ime
ring arrays(Antenna)

T o avoid slow convergence due to 23 Non linear benchmark functions


2010 Seyedali Mirjalili et al (2010) PSOGSA
memory less feature of GSA i.e. unimodal, multi model

Jianhua Xiao and DNA sequences Continuity,


2011 GSA
Zhen Cheng (2011) optimization problem H- measure and Similarity

T o increases the exploration


2011 S. Sarafrazi et al (2011) Improved GSA 23 Non linear benchmark functions
and exploitation ability

M. Soleimanpour-moghadam Position and Velocity of


2011 QGSA Unimodal & multimodal
et al (2011) an object in GSA

GSA worked as Parameter estimation problem of IIR Unimodal function, multimodal


2011 Saeid Saryazdi (2011)
heuristic search and Nonlinear rational filters function & complexity of problem

Partner selection problem


2011 Jianhua Xiao et al (2011) GCSA Cost criteria & convergence rate
with due date constraint
GSA with
modified T uning the fuzzy
2011 Radu-Emil Precup et al (2011) Performance indices
deprecation control systems
equation

GSA with three T o improve parametric


2011 Radu-Emil Precup et al (2011) Performance indices
modifications sensitivity

Copyright © 2014 MECS I.J. Intelligent Systems and Applications, 2014, 06, 79-93
A Review on Gravitational Search Algorith m and its Applications to Data Clustering & Classification 85

Economic Dispatch
2011 Serhat Duman et al (2011) GSA T hree test system
problem
2011 J. P. Papa et al (2011) OPF-GSA Feature selection Task Number of features selected
T o solve wessinger‘s
2011 M. Ghalambaz et al (2011) HNNGSA ………………………………..
equation
T o identify the parameter for
2011 Chaoshun Li et al (2011) IGSA hydraulic Frequency
turbine governing system
Sum of intra cluster distance
2011 Abdolreza Hatamlou et al (2011) GSA Data clustering
and Standard deviation
Slow convergence problem F- measure, run time, mean
2011 Minghao Yin et al (2011) IGSAKHM
of GSA in clustering and standard deviation
Sum of intra cluster distance and
2011 Abdolreza Hatamlou et al (2011) GSA-HS Clustering
center of corresponding cluster
T o increases classification
2011 Soroor Sarafrazi et al (2011) GSA-SVM Std. Dev., Mean, Max. & Min.
accuracy in Binary Problems

Modified GSA T o increases searching 3 Benchmark functions


2012 Nihan Kazak et al (2012)
(MGSA). and convergence rate Such as unimodal, multimodal
Mohadeseh Soleimanpour
2012 Improved QGSA Diversity loss problems Unimodal & multimodal
et al (2012)
Lucian-Ovidiu Fedorovici
2012 GSA with BP OCR applications Convergence and recognitions rates
et al (2012)
multi agent Computational cost of Six bench mark functions
2012 Nanji H. R et al (2012)
based GSA original GSA such as unimodal, multimodal
Radu-Emil Precup T o minimize the
2012 Adaptive GSA Sensitivity
et al (2012) objective function
Minimization of system real power,
Reactive power
2012 S. Duman et al (2012) GSA improvement voltage profile &
dispatch problem
enhancement of voltage
Optimal Power IEEE 30 Bus power system including
2012 Serhat Duman et al (2012) GSA
Flow problem six different cases
Parameter identification problem of
2012 Chaoshun Li et al (2012) CGSA
chaotic system
Abdolreza Hatamlou Clustering problem(For improve
2012 GSA-KM Number of steps and cost
et al (2012) searching capabilities of GSA)
Identification of T-S
2012 Chaoshun Li et al (2012) GSAHCA Model accuracy
fuzzy model
Accuracy, minimum, maximum
2012 Hossein Askari et al (2012) Intelligent GSA Classification of data
and average score of recognition
Radial 69 bus distributed system and
Ahmad Asurl Ibrahim Power quality monitor placement IEEE 118 bus system with Bolted three
2012 QBGSA
et al (2012) (PQMP) problem phase, Double line to ground and Single
phase to ground

Hamed Sadeghiet GSA with sparse Identification of switch linear system Statistical Robustness under excitation,
2012
et al (2012) optimization and Parameter estimation noise and switching sequence
Mohammad Khajehzadeh Minimum factor of safety
2012 MGSA Slope Stability Analysis
et al (2012) and reliability index
prototype
Abbas Bahrololoum Average misclassification
2012 classifier Data classification
et al (2012) percentage error
based on GSA
GSA with PSO Routing (Path planning
2012 Li Pei et al (2012) Cost of threats & Evolution Curve
& DE(IGSA) for UAE)
Parameter Setting of SVM & Accuracy
2013 Soroor Sarafrazi et al (2013) GSA-SVM
Increased accuracy(Classification) (Mean & Standard Deviation)

Clustering is the process to expose previously


V. GSA IN CLUST ERING undiscovered patterns from datasets and assemble data

Copyright © 2014 MECS I.J. Intelligent Systems and Applications, 2014, 06, 79-93
86 A Review on Gravitational Search Algorith m and its Applications to Data Clustering & Classification

entities into disjoint clusters such that entities of each based on the IGSA and K-harmon ic means for clustering
cluster are similar. Clustering techniques have been problem. KHM is easily sucked in local optima but fast
emp loyed in many areas such as pattern recognition [3, 4], convergence speed as compare to GSA. On the other
informat ion retrieval [70, 71], data mining [72, 73], and hand IGSA has ability to find near global optimu m
many mo re. Large nu mber of nature inspired algorith ms solution easily but suffered with slow convergence rate.
is applied on the data clustering problem such as ABC The performance of IGSAKM H evaluates with F
[11], PSO [74], KMH [75], A CO [76], K-means [77], measure, run time, mean and standard deviation
BB-BC [34] etc. There does not exists a single algorithm parameters and co mpares with KM H and PSOKM H in
that is adequate to solve all of requisite for clustering which IGSAKMH provides better performance with F
problems due to diversity of clustering problems, measure, mean & standard deviation than others but
different data type and intention of clustering. This paper execution time of IGSAKM H algorith m longer than the
also enlightens the application of GSA for data clustering KMH. So, the application where run time is critical
problems. Abdolreza Hatamlou et al. [78] has proposed a parameter, IGSAKM H will not work efficiently. To
gravitational search algorithm for data clustering reduce convergence in local optima of K-Means
applications and compared the performance of proposed algorith m, Abdolreza Hatamlou et al. [37] has proposed a
algorith m with PSO, GA and K-means. Proposed new hybrid algorith m GSA-HS based on GSA and
algorith m provides the viable and robust result for data Heuristic search technique. In the proposed algorith m,
clustering as compares the PSO, GA and K- means using initial population is generated by the GSA after that
sum of intra cluster distance and standard deviation heuristic search technique is applied to explorat ion of
parameters. Th is algorith m provides the good searching population. The performance of GSA-HS evaluate with
ability to find global optimu m but in the last iterations two parameters i.e. su m of intra cluster distance and
the performance of algorith m suffers due to slow center of corresponding cluster including four bench
searching speed. To improve the searching ability of mark datasets and compare with K-Means & PSO in
GSA, Abdolreza Hatamlou and Salwani Abdullah et al. which GSA-HS provides better results than others. To
[79] have proposed a hybrid algorithm GSA-KM based improve the ―fu zzy space partition‖ & identification of
on the GSA & K- means for clustering problem because ‗premises parameter‖ Chaoshun Li et al. [56] has
k-means is simp le and fast algorithm. The hybrid developed a new hybrid GSA based on hyper plane
algorith m provides better performance in co mparison of clustering algorithm (GSAHCA) for identification of T-S
original GSA by two ways. First, the numbers of steps fuzzy model. The GSA is used to identify the
require for iterat ion & evaluate the objective function to consequence and premises parameters wh ich are used to
find global optimu m was reduced, its increased execution build T-S fuzzy model. The performance of GSAHCA
speed of hybrid algorith m. Second, due to the use of k- evaluates with some non linear system using real system
means with GSA, a good candidate solution is generated sampled data sets in which GSAHCA provides better
for init ial population so that near global optimu m performance. The GSA HCA also compares with FCRM
searched in more pro mising search space and provided a for identify model accuracy in wh ich GSA HCA provides
better quality solution as co mpared to original GSA. To better result than FCRM.
reduce the slow convergence speed of GSA, Minghao
Yin et al. [80] has proposed new algorith m IGSAKHM

T able 2. Comparisons of GSA and its variants to other techniques

Iris Wine Glass CMC Cancer


Me thod
Avg. Std. Avg. Std. Avg. Std. Avg. Std. Avg. Std.
KM 106.05 14.63 18061.00 793.21 235.50 12.47 5893.60 47.16 3251.21 251.14
KMH 113.41 0.09 18386.00 0.00 257.18 0.00 5852.96 25.00 3234.40 0.00
GA 125.19 14.56 16530.53 0.00 282.32 4.14 5756.59 50.37 3249.46 229.73
SA 99.95 2.02 17521.09 753.08 282.19 4.24 5893.48 50.87 3239.17 230.19
ACO 97.17 0.37 16530.53 0.00 273.46 3.58 5819.13 45.63 3046.06 90.50
HBMO 96.95 0.53 16357.28 0.00 247.71 2.44 5713.98 12.69 3112.42 103.47
PSO 97.23 0.35 16417.47 85.49 275.71 4.55 5820.96 46.95 3050.04 110.80

GSA 96.72 0.01 16376.61 31.34 225.70 3.40 5699.84 1.72 2973.58 8.17
GSA-KM 96.69 0.01 16294.31 0.04 214.22 1.14 5697.36 0.27 2965.21 0.07
GSA-KMH 96.58 0.002 16234.560 0 185.710 0.035 5685.350 0.310 2954.250 0.056
GSA-HS 96.65 0.0 16292 0.0 ---- ---- 5693.7 0.0 2964.4 0.0
PSOGSA 97.23 0.060 16331.260 0.450 205.710 2.090 5699.100 0.540 2969.410 0.063

Copyright © 2014 MECS I.J. Intelligent Systems and Applications, 2014, 06, 79-93
A Review on Gravitational Search Algorith m and its Applications to Data Clustering & Classification 87

Discussion: The study of the literature of GSA in the value of two parameters: swarm size define the
clustering, it has been observed that five GSA based number o f object and grav itational coefficient of GSA.
algorith ms have been proposed to solve the clustering The performance of IGSA classifier co mpares with IPS
problems. These algorith ms are GSA, GSA-KM, GSA- classifier ( PSO based classifier), IGA classifier (GA)
KMH, GSA-HS and PSOGSA. To evaluate the relatively and DE based classifier (Differential Equation based
performance of GSA and its variant to others techniques, classifier) with accuracy, minimu m, maximu m and
a table is constructed using common datasets & average score of recognition including five datasets from
parameters with help of literature [37,78, 79, 80] and UCI repository in which IGSA provides better
compares the GSA & its variants to other clustering performance. Abbas Bahrololoum et al. [86] has
techniques. The table 2 provides the comparisons proposed a new prototype classifier based on GSA for
between the GSA & its variants to other well known classification problem and three different fitness function
techniques that are used to solve the clustering problems. defined for this classifier to evaluate the one
The performance of these techniques evaluate with five representative for each class. Three version of GSA
different dataset using sum of intra cluster distance & classifier has been developed with the help o f three
standard deviation parameters. These para meters deduce fitness functions. The performance of newly build
the efficiency of techniques in data clustering. Minimu m classifiers co mpare with PSO and ABC including 12
value of parameters means better the efficiency of the datasets that are taken from the UCI repository and
technique. The GSA prov ides minimu m sum of intra average misclassification percentage error parameter. To
cluster distance with all five datasets as compares to KM, improve the classification accuracy for b inary problems,
KMH, GA, SA, ACO, HBM O and PSO. To analy ze Soroor Sarafrazi et al [87] has proposed a new hybrid
standard deviation parameter, GSA has minimu m value algorith m GSA-SVM based on GSA & SVM. The
for Iris and CM C datasets while second minimu m value performance of proposed algorithm evaluates with
for all other datasets. So, Table 2 states that GSA accuracy (standard deviation, mean, minimu m &
provides more accurate and significant result than other maximu m) parameter using five datasets fro m UCI
techniques except GSA variants. Table 2 also provides repository and compares with PSO-SVM & PSO-GA in
the comparisons of different GSA variants i.e. GSA, which GSA-SVM provides better performance than
GSA-KM, GSA-KMH, GSA- HS and PSOGSA. Fro m others. To overcome parameter setting problem in SVM
the table 2, it is conclude that GSA-KMH p rovides the & increase the accuracy of feature subset selection
minimu m sum of intra clusters distance and GSA -HS Soroor Sarafrazi and Hossein Nezamabadi-pour [85] has
provides almost zero value of standard deviation proposed a new hybrid algorithm GSA-SVM based on
parameter. The quality of cluster depends on the original GSA, Binary GSA & SVM for binary problems
minimu m value of objects fro m its cluster centroid. So, in which original GSA is used to setting the parameters
minimu m sum of intra cluster distance mean objects are of SVM and Binary GSA for feature subset selection.
tightly bound with cluster. Fro m the Table 2, it is observe The performance of GSA evaluates with accuracy
that GSA-KM H is the best technique among all GSA parameter (Mean & Standard Deviation) using eight well
variants and other nature inspired techniques for known binary datasets fro m UCI repository and
clustering problem. compares with PSO and GA-SVM in which GSA-SVM
predicts data more accurately than others.
Discussion: To the depth study of GSA in
VI. GSA IN CLASSIFICAT ION classification problem, it has been observed that there
exist some common data sets on which GSA & its
Classification is the process of mapping the objects
variants compare with other classification methods using
fro m input space to set of predefined classes and allocate some parameters and GSA & its variants provides better
the objects with one of class fro m set of predefined
performance than others. Such datasets are Iris, wine,
classes. There are many classification techniques that
glass & cancer and performance of classification methods
have been developed and applied on the datasets to evaluate with misclassified instance, accuracy, rank
classify the objects such as decision tree [81, 82],
parameters etc. Table 3 [66,85, 86, 87] provides the
Artificial neural network [9, 83], A BC [11], PSO [84],
comparisons of GSA & its variants (that are proposed for
Support vector machine [85] etc. Accuracy is the crucial classification problems) with other techniques using
parameter in the classification problems to test the
above discussed common datasets with two parameters:
performance of the classificat ion techniques whether the
accuracy & rank as well as some other methods also
classification techniques properly classified the instance include such as ID3, J48, SVM, IBK etc.
of a datasets or not. Due to diversity in the classification
Table 3 consists twenty two different methods that are
problems there does not exists a single technique that has
used to solve classificat ion problems such as GSA based
been applied on all of the classification problems. Th is classifiers i.e. original GSA classifier, IGSA Estimat ion
paper enlightens the application of GSA in the
& GSA Prototype, PSO, ABC, IPS, IGA , DE, Bayes
classification and provided the co mparisons of GSA to
based i.e. bayes net, ANN, Tree based i.e.ID3, J48, NB
other techniques. Hossein Askari and Seyed-Hamid tree, Function based classifiers i.e. RBF and SVM with
Zahiri [42] have proposed new algorith m based on GSA
four well defined datasets i.e. iris, cancer, wine and glass.
for classification problem and called it Intelligent GSA
Table 3 shows that for the Wine & Glass datasets GSA
i.e. IGSA classifier. In IGSA fu zzy ru le is used to modify

Copyright © 2014 MECS I.J. Intelligent Systems and Applications, 2014, 06, 79-93
88 A Review on Gravitational Search Algorith m and its Applications to Data Clustering & Classification

variants (97.64, 97.6, 88 and 79.5) provide best result ABC (88.92, 5) algorith m get fifth position wh ile mu lti
among all these techniques. For Iris and Cancer datasets boost (68.21, 20) provides worst results.
ABC (100) algorith m provides the best result with both Table 7, 8, 9 shows the sum of rank parameter and
of parameters i.e. accuracy & rank but GSA variants assign the global ranking to the techniques. Global
provide the second & third best results as shown in table ranking is derived fro m the Table 3 i.e. sum of ran k that
3. Fro m the table 3, it is concludes that the overall is associated with accuracy result of all techniques.
performance of GSA variants has better than other According to rank parameter, IGSA, IGA & GSA
methods. Table 4, 5, 6 shows the average accuracy results prototype has obtained first, second & third rank while
with relat ive ran king of all these techniques in which the nearest competitive ABC get forth rank and RBF &
IGSA (92.83, 1), IGA (91.33, 2) algorith m and GSA Multi Boost get fifteenth rank means poor ones. The
prototype (90.56, 3)obtain first, second & third position results of these parameters conclude that GSA variants
among all these techniques and the nearest competitive provide remarkable results than others.

T able 3. Comparisons of accuracy & relative ranking parameters of twenty different T echniques/classifiers

Iris Cancer Wine Glass


Classifiers
Accuracy Rank Accuracy Rank Accuracy Rank Accuracy Rank
IPS-classifier 95.3 9 95.9 9 94.9 6 70.1 6
IGA-classifier 96.7 4 97 6 96.4 4 75.2 3
DE-classifier 88.7 15 86.4 18 86.3 7 58.4 13
GSA-classifier 82.6 19 80.1 20 61.3 17 88 1
IGSA-classifier 98.1 2 96.1 8 97.6 2 79.5 2
PSO 96.14 6 95.74 10 96.22 5 60.33 9
ABC 100 1 100 1 97.19 3 58.5 12
GSA Prototype 97.54 3 99.37 3 97.64 1 67.67 7
GSA-SVM (GSA+BGSA) - - 99.54 2 - - - -
GSA-SVM - - 99.37 3 - - - -
Bayes Net 95.77 7 80.26 19 70.2 9 75.02 4
MLP ANN 93.96 11 97.07 5 66.12 12 64.61 8
RBF 91.66 14 79.33 21 60.55 18 55.56 14
K-Star 93.26 13 97.56 4 64.22 14 60.28 10
Bagging 96.58 5 95.53 13 63.76 16 50 16
Multi Boost 68.4 20 93.91 15 64.22 14 46.3 18
NB T ree 94.73 10 92.31 16 68.12 10 71.12 5
SMO (SVM) 88.66 16 95.7 11 66.51 11 51.4 15
IBK 85.33 18 95.56 12 65.1 13 58.87 11
Dagging 86 17 96.7 7 64.2 15 46.72 17
J48 95.33 8 94.42 14 64.2 15 37.38 19
ID3 93.55 12 92.24 17 72.34 8 36.56 20

T able 4. Average accuracy result with relative ranking of datasets

Classifiers
Parameter
IPS IGA DE GSA IGSA PSO ABC GSA Prototype
Average Accuracy 89.05 91.33 79.95 78 92.83 87.11 88.92 90.56
Rank 4 2 10 12 1 6 5 3

T able 5. Average accuracy result with relative ranking of datasets

Classifiers
Parameter
Bayes Net MLP ANN RBF K-Star Bagging Multi Boost
Average Accuracy 80.31 80.44 71.78 78.83 76.47 68.21
Rank 9 8 19 11 13 20

Copyright © 2014 MECS I.J. Intelligent Systems and Applications, 2014, 06, 79-93
A Review on Gravitational Search Algorith m and its Applications to Data Clustering & Classification 89

T able 6: Average accuracy result with relative ranking of datasets

Classifiers
Parameter
NB T ree SMO IBK Dagging J48 ID3
Average Accuracy 81.57 75.57 76.22 73.41 72.83 73.67
Rank 7 15 14 17 18 16

T able 7: Sum of Ranks of T echniques & Global Ranking

Classifiers
Sum of Ranks
IPS IGA DE GSA IGSA PSO ABC GSA Prototype
Sum of Ranks 29 (6) 16 (3) 52 (11) 56 (14) 12 (1) 19 (5) 17 (4) 13 (2)

T able 8: Sum of Ranks of T echniques & Global Ranking

Classifiers
Sum of Ranks
Bayes Net MLP ANN RBF K-Star Bagging Multi Boost
Sum of Ranks 38(8) 35 (7) 66 (15) 40 (9) 49 (10) 66 (15)

T able 9: Sum of Ranks of T echniques & Global Ranking

Classifiers
Sum of Ranks
NB T ree SMO IBK Dagging J48 ID3
Sum of Ranks 40 (9) 52 (11) 53 (12) 55 (13) 55 (13) 56 (14)

conclude that GSA is widely used in co mputer science &


VII. CONCLUSION computing field but a very less publications from civil &
mechanical fields.
This paper presents the review of perv ious research in
the field of gravitational search algorith m, its variants;
hybridize GSA and its applications. Table 1 provides the Year wise Growth in GSA 17
18
complete summary of GSA literature, mod ification in
16 15
GSA and applications of GSA. Fro m the table 1, it
14
conclude that GSA is four years old but this field shows
12
tremendous growth & quite popular between researchers
10
and large nu mber of p roblems solved by GSA such as
8
RPDP, ED, OPF and many more mentioned in table 1. 5
6
The figure 1 shows the percentage of hybrid algorith ms
4
and modification in GSA has been proposed by various
2 1
authors in GSA literature. The modification and
0
hybridizat ion of GSA with other techniques provided
better results in terms of computational time,
2009 2010 2011 2012
convergence etc. The figure 3 provides the year wise
Fig. 3. Year wise growth in GSA
development in the field of gravitational algorith ms and
number of publications in each year published with the
help of GSA. Fro m the figure 3, it‘s conclude that there Figure 4 exh ibits that GSA is widely use in co mputer
is only one publication on GSA in year 2009 but in last science & co mputing field but this field contains large
two years large number of papers published using GSA number of subfields to pursue further research such as
that shows the wide popularity of GSA among networks, security, ANN, pattern recognitions, clod
researchers. The figure 4 categorizes the publications computing, data mining etc. The figure 5 shows the
based on GSA in different domains. The figure 4 states applicability of GSA based publications in computer
that half of GSA publicat ions related to co mputer science science & computing field. Figure 5 art iculates that more
and computing filed that shows the GSA applicability than fifty percent publicat ions of GSA in co mputer
and significance in co mputer science & co mputing field. science & co mputing field belong to data min ing domain.
The twenty four percent of GSA publications come fro m Data mining process defined by three terms i.e.
optimization & others field and very less publication classification, clustering and feature sub selection. The
fro m civ il & mechanical field. Fro m the figure 4, it is depth study of GSA shows that large number of

Copyright © 2014 MECS I.J. Intelligent Systems and Applications, 2014, 06, 79-93
90 A Review on Gravitational Search Algorith m and its Applications to Data Clustering & Classification

algorith m proposed with the help of GSA for REFERENCES


classification & clustering problems in data min ing [1] W. Du, B. Li,‖M ulti-strategy ensemble particle swarm
domain. Table 2 & 3 provides comparisons of other optimization for dynamic optimization‖, Information
techniques to GSA & its variants for clustering & Sciences, 2008, 178, pp 3096–3109.
classification problems in data min ing respectively. Fro m [2] X. Yao, Y. Liu, G. Lin,‖Evolutionary programming made
the table 2 & 3, it is conclude that GSA provides the faster‖, IEEE Transactions on Evolutionary Computation,
better performance than others. From the section 2 & 3 1999, 3 pp 82–102.
and table 2 & 3, it is conclude that GSA has good [3] Y. Liu, Z. Yi, H. Wu, M . Ye, K. Chen, ―A tabu search
potential to solve data clustering & classificat ion approach for the minimum sum-of-squares clustering
problem‖, Information Sciences, 2008, 178, 2680–2704.
problems than other nature inspired techniques as well as
[4] X. Tan, B. Bhanu, ―Fingerprint matching by genetic
conventional methods but sometime suffers fro m large algorithms‖, Pattern Recognition, 2006, 39, 465–477.
computational time. There are several advantages of GSA [5] T.H. Kim, I. M aruta, T. Sugie,‖Robust PID controller
that proves its significance. First, it requires only two tuning based on the constrained particle swarm
parameters to adjust i.e. mass & velocity of particles and optimization‖, Automatica, 2008, 44, 1104–1110.
second is ability to find near global optimu m solution. [6] Z. Baojiang, L. Shiyong,‖Ant colony optimization
The ability to find near global optimu m solution makes algorithm and its application to neuro-fuzzy controller
the GSA differ fro m other nature inspired algorith ms. But design‖, Journal of Systems Engineering and Electronics
the GSA is also suffers fro m several problems such as 18, 603–610.
[7] O. Cordon, S. Damas, J. Santamarı,‖A fast and accurate
computational time, convergence problem if initial
approach for 3D image registration using the scatter search
population not generated well. But these problems of evolutionary algorithm, Pattern Recognition Letters, 2006,
GSA removed by the hybridization of GSA. Another 27 ,pp 1191–1200.
thing that must be point, there is no theoretical work on [8] H. Nezamabadi-pour, S. Saryazdi, E. Rashedi,‖ Edge
the computational t ime and convergence of GSA these detection using ant algorithms‖, Soft Computing, 2006, 10,
work must be perform. In this review, it is notice that pp 623- 628.
there are so me other areas that are not touch by the GSA. [9] JY Wu,‖M IMO CM AC neural network classifier for
Few of these are security application, analysis of time solving classification problems‖, Applied Soft Computing,
series data, applicability of the GSA in dynamic & 2011, 11 (2), pp 2326–2333
[10] Kalinlia A, Karabogab N, ―Artificial immune algorithm
uncertain environment, gene expressions, protein legend
for IIR filter design‖, Engineering Applications of
etc. Artificial Intelligence, 2005, 18, 919–929.
[11] D. Karaboga, C. Ozturk (2011) A novel clustering
approach: artificial bee colony (ABC) algorithm. Applied
Soft Computing 11 (1), pp 652–657.
[12] Kirkpatrick S, Gelatt CD and Vecchi P,‖Optimization by
simulated annealing‖, Science, 1983, 220, 671-680.
[13] M itra D, Romeo F and Vincentelli, A.S., ―Convergence
and Finite-Time Behavior of Simulated Annealing
Advances in Applied Probability‖, 1986.
[14] Janson S & M iddendorf M , ―A hierarchical particle swarm
optimizer for dynamic optimization problems‖, In:
Proceedings of the application of evolutionary computing,
2004, volume 3005. pp 513–524.
[15] Kennedy J & Eberhart R, ―Particle swarm optimization‖,
In: Proceeding of IEEE int‘l. Conf. on neural networks,
1995, Vol. IV, pp. 1942–1948.
[16] Silva A, Neves A, Costa E,‖Chasing the swarm: a predator
Fig. 4. Categorization of GSA publications pray approach to function optimization‖, In: Proceeding of
the international conference on soft computing M ENDEL,
2002.
[17] Y.L. Lin, W.D. Chang, J.G. Hsieh,‖A particle swarm
optimization approach to nonlinear rational filter modeling,
Expert Systems with Applications, 2008, 34, pp 1194–
1199.
[18] Holland JH, ―Adaptation in natural and artificial systems‖,
University of M ichigan Press, 1975.
[19] Boeringer D-W, Werner DH, ―Particle swarm optimization
versus genetic algorithm for phased array synthesis‖, IEEE
Trans Antennas Propag., 2004, 52(3):771–779.
[20] Dorigo M ,―Optimization, learning and natural algorithms‖,
PhD thesis, Dipartimento di Elettronica, Politecnico di
M ilano, Italy, 1992.
[21] Dorigo M and Gambardella LM , ―Ant colony for the
traveling salesman problem‖, Bio systems, 1997, 43, pp.
Fig. 5. GSA in computer science & computing field 73-81.

Copyright © 2014 MECS I.J. Intelligent Systems and Applications, 2014, 06, 79-93
A Review on Gravitational Search Algorith m and its Applications to Data Clustering & Classification 91

[22] Costa, D. and Hertz, A. (1997) Ants can color graphs. J. [40] Schutz B.,‖ Gravity from the Ground Up‖, Cambridge
Operate Res. Soc., 48, pp. 295-305. University Press, 2000.
[23] Di Caro G. and Dorigo M . (1998) Two ant colony [41] Rashedi E, Nezamabadi-pour H, Saryazdi S ,‖BGSA:
algorithms for best-effort quality of service routing. In: binary gravitational search algorithm‖, Nat Comput, 2010,
Unpublished at ANTS'98-From Ant Colonies to Artificial 9, pp 727–745.
Ants: First International Workshop on Ant Colony [42] Hamid Reza Hassanzadeh and M odjtaba Rouhani, ―A
Optimization. MULTI OBJECTIVE GRAVITATIONAL SEARCH
[24] M erkle D & M iddendorf M .M odelling,‖ ACO: Composed ALGORITHM ‖, In: Proceeding of Second International
permutation problems‖, In: Ant algorithms Proceedings of Conference on Computational Intelligence,
ANTS 2002—Third international workshop. Lecture Notes Communication Systems and Networks, 2010, pp. 7 – 12.
in Comput Sci, 2002, vol, 2463., pp. 149–62. [43] S. Sarafrazi, H. Nezamabadi-pour and S.
[25] Gutjahr WJ, ―A graph-based ant system and its Saryazdi, ‖Disruption: A new operator in gravitational
convergence Future Generat. Comput. Syst., 2000, search algorithm. Scientia Iranica D, 2011, 18 (3), pp.
16(9):873–88. 539–548.
[26] Gutjahr WJ, ―ACO algorithms with guaranteed [44] M . Soleimanpour-moghadam, H. Nezamabadi-pour, M . M .
convergence to the optimal solution‖, Information Process Farsangi ,‖A quantum behaved gravitational search
Letters, 2002, 82(3), 145–53. algorithm‖, In: proceeding of Int. Conf. Computational
[27] Karaboga D, Basturk B,‖A powerful and efficient Intelligence and Software Engineering, Wuhan, China,
algorithm for numerical function optimization:artificial 2011.
bee colony (abc) algorithm‖, J Glob Optim. 2007b, [45] Radu-Emil Precup, Radu-Codruţ David, Emil M . Petriu ,
39:459–471. Stefan Preitl and M ircea-Bogdan Rădac,‖Gravitational
[28] Karaboga D & Basturk B,‖A comparative study of Search Algorithm in Fuzzy Control Systems Tuning‖, In:
artificial bee colony algorithm‖, Applied M athematics and Proceeding of 18th IFAC World Congress, 2011, pp. no.
Computation, 2009, 214:108–32. 13624-13629, M ilano (Italy).
[29] Akay B, Karaboga D , ―A modified artificial bee colony [46] Nihan Kazak and Alpaslan Duysak,‖M odified
algorithm for real-parameter optimization‖ Inf Sci., 2010 Gravitational Search Algorithm‖, In: Proceeding of IEEE
doi:10 .1016/j.ins.2010.07.015. International Symposium on Innovations in Intelligent
[30] Basturk B, Karaboga D, ―An artificial bee colony (abc) Systems and Applications (INISTA), 2012, pp. 1- 4,
algorithm for numeric function optimization‘, In: IEEE Turkey.
swarm intelligence symposium 2006, Indianapolis, IN, [47] M ohadeseh Soleimanpour moghadam & Hossein
USA. Nezamabadi pour, ―An improved quantum behaved
[31] M ezura-M ontes E, Damian-Araoz M , Cetina-Domingez gravitational search algorithm‖, In: proceeding of 20th
O ,‖ Smart flight and dynamic tolerances in the artificial Iranian Conference on Electrical Engineering, (ICEE2012),
bee colony for constrained optimization‖, In: 2010 IEEE 2012, pp. no. 711 – 715.
congress on evolutionary computation (CEC), 2010, pp 1– [48] Nanji H. R., M ina Sohrabi and Esmat Rashedi,‖A High-
8. Speed, Performance-Optimization Algorithm Based on a
[32] Eduardo Gerhardt and Herbert M artins Gomes, ―Artificial Gravitational Approach‖, Journal of Computing in Science
Bee Colony (ABC) Algorithm for Engineering & Engineering, 2012, volume 14, Issue: 5 pp. 56 – 62.
Optimization‖, Problems In: Proceeding of 3rd [49] Xiangtao Li, Jianan Wang, Junping Zhou and M inghao
International Conference on Engineering Optimization Rio Yin,‖An Effective GSA Based M emetic Algorithm for
de Janeiro, Brazil, 2012. Permutation Flow Shop Scheduling. In: proceeding of
[33] Zhu GP & Kwong S,‖Gbest-guided artificial bee colony IEEE congress on Evolutionary Computation, 2010, pp. no.
algorithm for numerical function optimization‖, Applied 1-6.
M athematics and Computation 2010, doi: [50] Seyedali M irjalili and Siti Zaiton M ohd Hashim,‖ A new
10.1016/j.amc.2010 .08.049. hybrid PSOGSA algorithm for function optimization‖, In:
[34] Osman K. Erol and Ibrahim Eksin,‖A new optimization Proceeding of International conference on computer and
method: Big Bang–Big Crunch‖, Advances in Engineering information application (ICCIA), 2010, pp. no. 374- 377.
Software, 2006, 37, pp. 106–111. [51] Chatterjee A, M ahanti G. K. and Pathak N, (2010),‖
[35] Hesheng Tang, Jin Zhou, Songtao Xue and Liyu Xie, ‖Big COM PARATIVE PERFORM ANCE OF
Bang-Big Crunch optimization for parameter estimation in GRAVITATIONAL SEARCH ALGORITHM AND
structural systems‖, M echanical Systems and Signal MODIFIED PARTICLE SWARM OPTIMIZATION
Processing, 2010, 24, pp 2888–2897. ALGORITHM FOR SYNTHESIS OF THINNED
[36] M .H. Afshar and I. M otaei,‖CONSTRAINED BIG SCANNED CONCENTRIC RING ARRAY ANTENNA‖,
BANG-BIG CRUNCH ALGORITHM FOR OPTIM AL Progress In Electromagnetic Research B, Vol. 25, 331-348.
SOLUTION OF LARGE SCALE RESERVOIR [52] Radu-Emil Precup, Radu-Codruţ David, Emil M . Petriu ,
OPERATION PROBLEM ‖, Int. J. Optim. Civil Eng., Stefan Preitl and Adrian Sebastian Paul,‖Gravitational
2011, 2, pp 357-375. Search Algorithm-Based Tuning of Fuzzy Control Systems
[37] Hatamlou A, Abdullah S and Othman Z , ―Gravitational with a Reduced Parametric Sensitivity‖, Advances in
Search Algorithm with Heuristic Search for Clustering Intelligent and Soft Computing, 2011, Volume 96, pp.
Problems‖, In proceeding of 3rd IEEE on Data M ining and 141-150.
Optimization (DMO), 2011, pp. no. 190 – 193, 28-29 June [53] Jianhua Xiao, Fan Qi, and Yongkai Li, ―Gravitational
2011, Selangor, M alaysia. Chaotic Search Algorithm for Partners Selection with Due
[38] Rashedi E, Nezamabadi-pour H, Saryazdi S,‖ GSA: a Date Constraint in Virtual Enterprise‖, In: Proceeding of
gravitational search algorithm‖, Information Science, 2009, Fourth International Workshop on Advanced
179, 2232–2248. Computational Intelligence, 2011, pp. 138 – 142.
[39] Holliday D, Resnick R and Walker J, ―Fundamentals of [54] J. P. Papa, A. Pagnin, S. A. Schellini, A. Spadotto, R. C.
physics‖, John Wiley and Sons, 1993. Guido, M . Pont, G. Chiachia and A. X.

Copyright © 2014 MECS I.J. Intelligent Systems and Applications, 2014, 06, 79-93
92 A Review on Gravitational Search Algorith m and its Applications to Data Clustering & Classification

Falcaoi,‖FEATURE SELECTION THROUGH search algorithm for slope stability analysis‖, Engineering
GRAVITATIONAL SEARCH ALGORITHM ‖, In: Applications of Artificial Intelligence (article in press)
Proceeding of IEEE international conference Acoustics, [68] Hamed Sadeghi, Najmeh Eghbal and Reyhaneh Kardehi
Speech and Signal Processing (ICASSP), 2011, pp. 2052 M oghaddam, ―Application Gravitational Search Algorithm
– 2055. in Identification of Switched Linear Systems‖, In:
[55] M . Ghalambaz, A.R. Noghrehabadi, M .A. Behrang, E. Proceeding of IEEE Third International Conference on
Assareh, A. Ghanbarzadeh, N.Hedayat,‖A Hybrid Neural Intelligent Systems M odeling and Simulation, 2012, pp.
Network and Gravitational Search Algorithm (HNNGSA) 89 – 95.
M ethod to Solve well known Wessinger's Equation‖, [69] LI Pei & Duan HaiBin,‖Path planning of unmanned aerial
World Academy of Science, Engineering and Technology, vehicle based on improved gravitational search algorithm‖,
2011, issue 49, pp. no. 803 – 807. Science China published by Springer, 2012, Vol.55 No.10:
[56] Chaoshun Li and Jianzhong Zhou , ―Parameters 2712–2719.
identification of hydraulic turbine governing system [70] M . M ahdavi (2008) Novel meta-heuristic algorithms for
using improved gravitational search algorithm‖, Energy clustering web documents. Applied M athematics and
Conversion and M anagement, 2011, Volume 52, Issue 1, Computation, 208, 201 (1–2), pp 441–451.
pp. 374–381. [71] R. Gil-Garcia, A. Pons-Porrata,‖Dynamic hierarchical
[57] Jianhua Xiao and Zhen Cheng,‖DNA Sequences algorithms for document clustering, Pattern Recognition
Optimization Based on Gravitational Search Algorithm for Letters, 2010, 31 (6), pp 469–477.
Reliable DNA computing In: proceeding of IEEE Sixth [72] Tan P N, Steinbach M & Kumar, ―Introduction to data
International Conference on Bio-Inspired Computing: mining, Boston: Addison Wesley, 2005, pp. 487–559.
Theories and Applications, 2011, pp. 103 – 107. [73] Tjhi W C & Chen L H,‖A heuristic-based fuzzy co-
[58] Esmat Rashedi, Hossien Nezamabadi-pour and Saeid clustering algorithm for categorization of high-
Saryazdi,‖Filter modeling using gravitational search dimensional data‖, Fuzzy Sets and Systems, 2008, 159(4),
algorithm Engineering applications of Artificial pp 371–389.
Intelligence, 2011, volume 24(1), pp 117-122. [74] P. Jin, Y.L. Zhu, K.Y. Hu,‖A clustering algorithm for data
[59] [59] Serhat DUM AN, Aysen Basa ARSOY and Nuran mining based on swarm intelligence‖, in: Proceedings of
YÖRÜKEREN ,‖Solution of Economic Dispatch Problem the Sixth International Conference on M achine Learning
using Gravitational Search Algorithm‖, In: Proceeding of and Cybernetics, ICM LC, 2007.
7th international conference of electrical and electronics [75] Zhang B, Hsu M & Dayal U,‖K-harmonic means – a data
engineering, 2011, pp. 54 – 59, Turckey. clustering algorithm‖, Technical Report HPL-1999-124,
[60] Chaoshun Li, Jianzhong Zhou, Jian Xiao and Han Xiao Hewlett-Packard Laboratories.
(2012)Parameters identification of chaotic system [76] P.S. Shelokar, V.K. Jayaraman, B.D. Kulkarni, ―An ant
by chaotic gravitational search algorithm. Chaos, Solitons colony approach for clustering‖, Analytica Chimica Acta,
& Fractals, Volume 45, Issue 4, Pages 539–547, 2012. 2004, 509 (2),pp 187–195.
[61] Radu-Emil Precup, Radu-Codruţ David, Emil M . Petriu , [77] Zhou H & Liu YH,‖Accurate integration of multi-view
Stefan Preitl and M ircea-Bogdan Radac,‖Novel Adaptive range images using k-means clustering. Pattern
Gravitational Search Algorithm for Fuzzy Controlled Recognition, 2008, 41(1), pp 152–175.
Servo Systems‖, IEEE Transcation on Industrial [78] Hatamlou A, Pour HN and Abdullah S, ‖ Application of
Informatics, 2012, volume 8, no. 4, pp 791 -800. gravitational search algorithm on data clustering In:
[62] Lucian Ovidiu Fedorovici, Radu-Emil Precup, Florin published in proceeding of 6th international workshop on
Dragan, Radu-Codrut David and Constantin Rough Set and Knowledge technology (RSKT-11), 2011,
Purcaru ,‖Embedding Gravitational Search Algorithms in pp. no. 337-346.
Convolutional Neural Networks for OCR Applications In: [79] Hatamlou A, Abdullah S and Pour HN, ― A combined
Proceeding of 7th IEEE International Symposium on approach for clustering based on K-means and
Applied Computational intelligence and Informatics, 2012, gravitational search algorithms‖, Swarm and Evolutionary
pp. 125 – 130. Computation, 2012, 6, pp 47–52.
[63] S. Duman, Y. So nmez, U. Gu venc and N. Yo ru keren, [80] M inghao Yin, Yanmei Hu, Fengqin Yang, Xiangtao Li and
―Optimal reactive power dispatch using a gravitational Wenxiang Gu,‖A novel hybrid K-harmonic means and
search algorithm‖, IET Gener. Transm. Distrib., 2012, Vol. gravitational search algorithm approach for clustering‖,
6 (6), pp. 563–576. Expert Systems with Applications, 2011, 38, 9319–9324.
[64] Serhat Duman, U gur Guvenc, Yusuf Sonmez and Nuran [81] M .W. Kurzynski, ―The optimal strategy of a tree
Yorukeren,‖Optimal power flow using gravitational search classifier‖, Pattern Recognition, 1983, 16, pp 81–87.
algorithm‖, Energy Conversion and M anagement, 2012, [82] F. Seifi, M .R. Kangavari, H. Ahmadi, E. Lotfi, S.
volume 59, pp 86–95. Imaniyan, S. Lagzian, ―Optimizing twins decision tree
[65] Asrulibrahim A, M ohamed and Shareef H, ‖Application of classification using genetic algorithms‖, In: 7th IEEE
quantum-inspired binary gravitational search algorithm for International Conference on Cybernetic Intelligent
optimal power quality monitor placement. In: proceedings Systems, 2008, pp. 1–6.
of the 11th WSEAS international conference on Artificial [83] P. Knagenhjelm, P. Brauer,‖Classification of vowels in
Intelligence, Knowledge Engineering and Database,‖, continuous speech using M LP and a hybrid network‖,
2012, pp. no. 27- 32. Speech Communication,1990, 9 (1) pp 31–34.
[66] Hossein Askari and Seyed-Hamid Zahiri, ―Decision [84] Rana S, Jasola S and Kumar R A review on particle swarm
function estimation using intelligent gravitational search optimization algorithms and their applications to data
algorithm‖, Int. J. M ach. Learn. & Cyber, 2012, 3, pp. clustering Artif Intell Rev, 201,1 35, 211–222.
163–172. [85] Soroor Sarafrazi and Hossein Nezamabadi-pour, ―Facing
[67] M ohammad Khajehzadeh, M ohd RaihanTaha, Ahmed El- the classification of binary problems with a GSA-SVM
Shafie and M ahdiyehEslami, ―A modified gravitational hybrid system‖, M athematical and Computer M odeling,
2013, vol. 57, issue 1, pp. 270–278.

Copyright © 2014 MECS I.J. Intelligent Systems and Applications, 2014, 06, 79-93
A Review on Gravitational Search Algorith m and its Applications to Data Clustering & Classification 93

[86] Bahrololoum A, Pour HN, Bahrololoum H and Saeed M ,


―A prototype classifier based on gravitational search
algorithm‖, Applied Soft Computing , 2012, 12, 819–825.
[87] Soroor Sarafrazi, Hossein Nezamabadi-pour and M ojgan
Barahman,‖A GSA-SVM HYBRID SYSTEM FOR
CLASSIFICATION OF BINARY PROBLEM S‖, In:
Proceedings of the Fourth Global Conference on Power
Control and Optimization, 2011, pp. 198-203.

Author’s Profile:
Yugal Kumar received his B.Tech in
IT informat ion Technology fro m
Maharishi Dayanand Un iversity,
Rohtak, (India) in 2006 & M.Tech in
Co mputer Engineering fro m same in
2009. At present, he is pursuing Ph.D.
in Depart ment of Informat ion
Technology at Birla Institute of
Technology, mesra, Ranchi, India. His research interests
include fuzzy logic, co mputer network, Data Mining and
Swarm Intelligence.

G. Sahoo received his MSc in


Mathematics fro m Utkal Un iversity
in the year 1980 and PhD in the
Area of Co mputational Mathematics
fro m Indian Institute of Technology,
Kharagpur in the year 1987. He has
been associated with Birla Institute
of Technology, Mesra, Ranchi, India
since 1988, and currently, he is working as a Pro fessor
and Head in the Depart ment of Info rmation Technology.
His research interest includes theoretical co mputer
science, parallel and distributed computing, cloud
computing, evolutionary computing, informat ion security,
image processing and pattern recognition.

How to cite this paper: Yugal kumar, G. Sahoo,"A Review on


Gravitational Search Algorithm and its Applications to Data
Clustering & Classification", International Journal of Intelligent
Systems and Applications(IJISA), vol.6, no.6, pp.79-93, 2014.
DOI: 10.5815/ijisa.2014.06.09

Copyright © 2014 MECS I.J. Intelligent Systems and Applications, 2014, 06, 79-93

Você também pode gostar