Mathematical Theory and Modeling ISSN 2224-5804 (Paper) ISSN 2225-0522 (Online) Vol.3, No.

13, 2013

www.iiste.org

Application of Stochastic Lognormal Diffusion Model with Polynomial Exogenous Factors to Energy Consumption in Ghana
Godfred Kwame Abledu(PhD) School of Applied Science and Technology, Koforidua Polytechnic, PO Box 981, Koforidua, Ghana * E-mail of the corresponding author: godfredabledu@gmail.com Abstract. The main objective of this paper was the application of maximum likelihood ratio tests in lognormal diffusions with polynomial exogenous factors. The model described an innovation diffusion process considering at the same time disturbances coming from the environment of the system. Finally, the model was applied to energy consumption data in Ghana from 1999 to 2010. Maximum likelihood estimators (MLEs) were obtained for the drift and diffusion coefficients characterizing lognormal diffusion models involving exogenous factors affecting the drift term. The present paper provides the distribution of these MLEs, the Fisher information matrix, and the solution to some likelihood ratio tests of interest for hypotheses on the parameters weighting the relative effect of the exogenous factors. The results show that the total consumption of primary energy presents structural characteristics. The endogenous consumption pattern in Ghana, in absolute terms, also presents a clear upward trend. Key works: lognormal diffusions model, maximum likelihood estimators, endogenous actors, energy consumption . 1 Introduction The use of diffusion processes with exogenous factors and their trend is common in many fields. The reason of its application is the usual presence of deviations of the observed data with respect to the trend of some known homogenous diffusion process, in some time intervals. These factors are time dependent functions that allow, on one hand, a best fit to the data and, on the other hand, an external control to the process behaviour. The factors must be totally or partially known, that is, their functional form or some aspects about their time evolution must be available. The problem of estimating the parameters of the drift coefficient in these models has received considerable attention recently, especially in situations in which the process is observed continuously. The statistical inference is usually based on approximating maximum likelihood methodology. An extensive review of this theory an be found in Prakasa(1999), and related new work has been done by Kloeden et al. (1999), The usefulness of diffusion random fields in describing, for example, economic or environmental phenomena, has led to significant developments, particularly regarding inferential aspects. In that respect, from the contribution to theoretical foundations for diffusions given in Nualart (1983) and Ricciardi (1976), the lognormal diffusions involving exogenous factors affecting the drift term is considered. The maximum likelihood estimators (MLEs) for the drift and diffusion coefficients is obtained, which characterize these diffusions under certain conditions. Using these MLEs, techniques for estimation, prediction and conditional simulation of lognormal diffusions are developed. The study of variables that model dynamical systems has undergone a great development over the last decades, and a variety of statistical and probabilistic techniques has been worked out for this purpose. Among these, stochastic processes, and in particular diffusion processes, have been systematically employed. 2. Lognormal Diffusion Process Model (LNDP) The lognormal diffusion process with exogenous factors is defined as moments

X t : t0

T with infinitesimal

A1 x, t

xh t and A1 x, t

2 2

x , where

0 and h is continuous function in t0 , T

containing the external information sources. So it is usual to take h as a linear combination of continuous functions. A class of two-parameter random fields which are diffusions on each coordinate and satisfy a particular Markov property related to partial ordering in

R 2 are considered by Nualart(1983). Using this

theory, Skiadas(2007) introduced a 2D lognormal diffusion random field as follows.

54

Mathematical Theory and Modeling ISSN 2224-5804 (Paper) ISSN 2225-0522 (Online) Vol.3, No.13, 2013

www.iiste.org

Let

X z :z

s, t

0, ,S

0, ,T

R2

be a positive-valued Markov random field,

defined on a probability space variable with

, A, P , where X(0,0) is assumed to be constant or a lognormal random

0

E In nX 0, 0

and

Var InX 0, 0

2 0

. The distribution of the random field is

determined by the following transition probabilities:

P B, s
where

h, t
I , h, k

k | x1 , x, x2 , z
0 , x1 , x, x2

P X s

h, t

B | X s, t

x1 , X z

s, t

R 2 and B is a Borel subset. It is assumed that the transition

densities exist and are given by

g ( y,(s
1 y 2
for

h, t

k ) | x1 , x, x2 , z )
exp I 1 In 2
yx x1x2 z ;h , k 2

mz ;h ,k

2 z ;h , k

R 2 , with
s k t k

mz ;h,k
and

a
s t

, d d ,

2 z ;h ,k s

s k t

t k

, d d

a , B being continuous functions on I. Under these conditions we can assert that X z : z

a1 z x : a1 z 1 B1 z x , B1 z x 2 : B1 z x 2 2 1 B2 z x , B2 z x 2 : B2 z x 2 2
t t

I is a

lognormal diffusion random field. The one parameter drift and diffusion coefficients associated are given by:

a2 z x :
where

a2 z

a1 s, t
t

a s, r dr , B1 s, t
t

Brdt t
0

a2 s, t
for all

a
0

, t d , B1 s, t

B
0

, t dt

s, t

I, x

R .
Y z :z
parameter

The random field field with

I defined as Y z
drift and

InX z is then a Gaussian diffusion random

diffusion
s t

a and B being, respectively, the drift and diffusion coefficients, and a1 , a2 , B1 and B2 being the
one coefficients. Furthermore, if

corresponding

z, z

I, z

s, t , z

s , t , then
mY z : E Y z
2 Y
0

a
0 0

, d dr d

z : Var Y z

2 0

s 0

B
0
2 Y

, d dr d
z z

cY z, z : Cov Y z , Y z
the one-parameter case hold, that is,

It is also assumed that the conditions usually considered for estimation of the drift and diffusion coefficients in

P InX 0,0

1 and

2 Y

Bst Bst , z

s, t

I.

55

Mathematical Theory and Modeling ISSN 2224-5804 (Paper) ISSN 2225-0522 (Online) Vol.3, No.13, 2013

www.iiste.org

3. Inference in the Lognormal Diffusion Process Model (LNDP) Let

X z :z
t

I be a lognormal diffusion random field. Data X= X z1 ,..., X zn

are

assumed to be observed at known spatial locations

z1

s1 , t1 , z2
t

s2 , t2 , , zn

sn , tn

I . Let

x1 , x2 ,.. ,..., .. xn

be a sample. Let us consider the log-transformed n-dimensional random vector,

t

Y
y
Y

Y z1 , Y z2 ,..., Y zn
y1 , y2 ,..., ... yn
2 Y
t

In X z1 ,..., In n X zn
. We denote

In X , and the log-transformed sample mY z1 , mY z2 ,..., mY zn

t

In x

mY

and

zi z j

i , j 1,..., 1, n

In order to estimate the MLEs for the drift and diffusion coefficient using exogenous factors, it is supposed that the drift coefficient a of Y is a linear combination of several known functions,

h1 z ,..., hp z : z

I , with real coefficients

p

,...,

p:

a z
1

h z ,z

Defining for

z s, t

I,
s t

f0 z
the mean of Y is given by

1, f

z
0 o

h
s
0

, r d dr ,
p

1,..., p

mY s, t
Thus, denoting
0

0 1

h
0
o

, r d dr
0

f
zn
t

z
for

F= f 0 ,f1 ,...,f p , with f = f

t

z1 , f

z2 ,..., . f

0,1,..., 0,1,... , p , and

,...,

the following is obtained:

mY =
Let us write

0 0

1 1

...

p p

s1t1 s s t t BM : = B 1 2 1 2 ... s1 sn t1 tn
*

s1 s2 t1 t2 s2t2 ... s2 s n t 2 t n
Ft M 1F
1

... ... ... ...

s1 sn t1 tn s2 sn t2 tn ... sn t n
(1)

With this notation, the MLEs for the drift and diffusion coefficients are, respectively:

* 0

* 1

,...,
t

* t p

Ft M 1In x

and

B*
where
* mY

1 nx In 2
*

* mY M

* x Y In x-m

(2)

(Gutierrez, et. al., 2005) is

1 Ft M-1 E In X 1 Ft M-1 F 1 -1 Ft M E Y

The expected value of the MLE

-1 Ft M-1 F

Ft M-1F

Ft M-1F =

56

Mathematical Theory and Modeling ISSN 2224-5804 (Paper) ISSN 2225-0522 (Online) Vol.3, No.13, 2013

www.iiste.org

and then,

is unbiased. Taking into account that

1

,BM BM , it is clear that the distribution of the

(3)

estimators are given by

*

,B Ft M-1 F

and

nB*
B**

W1 n-p+1, np nn-p B
*

(4)

The last estimator is biased. Therefore, the following transformation is considered:

t n 1 In X - F * M 1 In X - F n p 1 n p 1 * * are independent and Which is unbiased estimator of B . In addition, B and

(5)

Var B

**

Var

n
*
1

n B* p 1
and

1 Var nB* V p 1

2B2 n p 1

Therefore, the covariance matrix of

B is

**

B*
p 1

B Ft M -1F 0t

0
2 B2 n p 1

(6)

with

0,...0 0 0 . The point estimation of the

function(maximum-likelihood and minimum variance

unbiased estimation) was developed in Gutierrez et. al.(2001) for h =2 . The mean and mode functions and their conditional versions can be written in the form

exp

t, s

2 k

t , s with mean, conditional mean,

mode and conditional mode as in Table 1 being the problem of building confidence bands for them solved in Gutierrez et al.( 2003). 4. Fisher Information Matrix The Fisher information is a way of measuring the amount of information that an observable random variable X carries about an unknown parameter upon which the probability of X depends. The probability function for X, which is also the likelihood function for , is a function f(X; ); it is the probability . The partial derivative with mass (or probability density) of the random variable X conditional on the value of

respect to of the natural logarithm of the likelihood function is called the score. The Fisher information matrix is determined by first calculating the following:

In L
2

In X - F

M 1F

In L
2

B 1Ft M 1F

In L
2

In L t B 2 In I X - F M 1F B n 1 t I X - F M 1F In X - F In 2 2B 2B
n 2B2 n I X-F In B3
t

In L B2

M 1F In X - F

and

57

Mathematical Theory and Modeling ISSN 2224-5804 (Paper) ISSN 2225-0522 (Online) Vol.3, No.13, 2013
2

www.iiste.org

E
2

In L
2

B 1Ft M 1F , E n 2B2 2 n p 1 2B2

In L B 2n

0 2

I L In B2

2p 2B2

Therefore, the Fisher information matrix is

B 1Ft M --1F I= 0t
5. Hypotheses Testing In order to test the hypothesis, the vector Anderson, 2003):
1 2

0
2n 2 p 2 2 B2

(7)

, 1 ,..., ,...,

t p

is split as follows (Skiadas, 2007;

where

is

p1 1 and

is

p2 1 , with p1

p2

p 1 . The hypothesis of interest is

1
1

H0 :
H1 :
where
1

1
1

is

p1 1 fixed vector. The total region and the region associated with the null hypothesis are,
,B :B ,B :
1 1

respectively,

0 :B
n 2

Rp 0
1

R p2
n

Under these hypotheses,

ax L x ; ,B max x;

B*

|M M| 2

xi 1 exp
i 1 n

ax L x max x; ,B
and the likelihood ratio statistic for testing

B*

|M M| |

xi 1 exp
i 1
n 2

n 2 n 2

H 0 is
max L max L B* B*
n 2

B* B*

For obtaining the distridution of this statistic, let us denote consider the following partitions:

A=Ft M 1F and C=Ft M 1In X and

= A= C=A A
where
*

A11 A 21 21 A 21 A 22 22

F1t M F2t

F1 | F2
* 1 * 2

F1t M 1F1 F1t M 1F2 F2t M 1F1 F2t M 1F2 C1 C2

A221 C2

A A 21 21 C1 | C2 = 11 A 21 A 2 22 2
* 2

A1 11 A1 12
A11

* 1 * 1

A1 12 2 A2 22

* 2 * 2

A11 is p1
F2
* 2w

p1 and C1 is p1 1 . Using the last two expression, the following is obtained:

A221C2 A221A21
* 1 * 1

Subtracting

in both sides of this equation, taking into account that

58

Mathematical Theory and Modeling ISSN 2224-5804 (Paper) ISSN 2225-0522 (Online) Vol.3, No.13, 2013

www.iiste.org

In x - F - F2
we obtain

* 2w

= In x - F 1
1

- F2

- F2

* 2w

= In x - F 1
In x - F 1
Since
1

-F
F 1

* 1 2w

- F2

* 2w

In x-F

F2 A221A21 2

* 1

In x - F1

* 2w

M 1F

0 , it is clear that In x - F1
* t 2w

M 1F - F2 A221A21

0 A11,2

Using the previous notation,

F1
It can be established that

F2 A221A21 M nB B* w = In x - F 1

F1 - F2 A221A21
* t 2w

A12 A221A21 - F2
* 2w

- F2
t 1

M
* 1

In x - F1
1

=nB nB B*

* 1

A11,2 1

The likelihood ratio statistics can now be written as

nB B* nB*
where

* 1

t 1

A1 11,2

* 1

n 1 2 1

nB B*

* 1

t 1

A11,2 1

* 1

is
2 n

B* (Anderson, W1 p1 , B and distributes independently of nB

is the same as

2003). This means that the distribution of random variables with distribution given by 6. Simulation Studies

U U

where U and V are independent

W1 n

p 1, 1 B and W2 p 1 , B respectively.

The stochastic differential equation dx

X t

dt

X t

dw t , where W(t )

represents the Wiener process with independent increments W(t ) - W(s) distributed according to

N 0, t

for t > 0, has a single continuous solution in the interval [t0 , T]. This corresponds to the parameter of the lognormal diffusion process, the explicit expression of which can be obtained by means of Its formula, applied to the transform

In X t

, and which has the following form

2

X t = + x0

exp

t0

W t

W t0

From this explicit solution, the simulated trajectories of the process can be obtained by discretizing the time interval [t0, T], with the initial condition W(t0) = 0. The Wiener process is obtained as the sum of the distributions N(0, h), where h = ti h ti ti 1 . From this simulated process sample, the parameters can be estimated by ML, first using the Newton . Secondly, the problems that occur in Raphson (NR) nonlinear approach to approximate the value of estimating the parameters of the lognormal diffusion process are discussed. The SA optimization to the estimation of the parameters is used in order to perform a compression of the range of values over which the conditioned log-likelihood function must be maximized to find . The parameters of the process are estimated by applying the method to the simulated data set described previously, which enable the effectiveness of the method to be tested. Table 2 shows the values used in the simulation and the results obtained by estimating the parameters, using the methods described above, implemented using the mathematical packages by considering h = 1, n = 30 and an initial value xo = 1.12149. These results clearly show that the SA algorithm was a good estimation method and that it enabled the elimination of many of the difficulties encountered with ML estimation. 59

Mathematical Theory and Modeling ISSN 2224-5804 (Paper) ISSN 2225-0522 (Online) Vol.3, No.13, 2013

www.iiste.org

7. Empirical Results The LNDP is applied to the data of total natural-petroleum products consumption in Ghana from 1999 to 2010. These data were provided by the Ministry of Economic Planning. Data of the above time series were used to estimate the parameters of the process using the methods described in Section 3. Gutierrez et al. (1999; 2005; 2006) proposed a methodology for building a theoretical model of lognormal diffusion process with exogenous factors that fit the data, that is, a method for searching for the h function. The goodness-of-fit to the data was one criterion to compare various models for petroleum consumption in Ghana. The statistical results from the models such as R2, MSE, MAPE, MAD and d values were calculated. The performance of the SGIDP for the forecasting period using the trend and conditional trend function is illustrated in Figure 1. Finally, in order to evaluate the results obtained using the SGIDP in studying the data series, the model was compared with two alternative models; the first being the stochastic logistic innovation process and the second is the stochastic lognormal innovation process (Skiadas and Giovani, 1997). A Matlab program was implemented to carry out the calculations required for this study. A Matlab program was implemented to carry out the calculations required for this study. The methodology is summarised as follows: i. Use the first 50 data set in the series of observations to estimate the parameters of the model, using expressions (5) and (6). Then, determine the corresponding confidence intervals using equations (7) and (8). ii. For the years 2000, 2001 and 2002, predict the corresponding values for electricity consumption in Morocco using the estimated trend function (ETF) and the estimated conditional trend function (ECTF), obtained by replacing the parameters with their estimators in expressions (3) and (4), and compare the results with the corresponding observed data for the same years.

The data from 1999 to 2010 are used to make forecasts of the future values of the process, with the trend and conditional trend functions given by expressions (2) and (3) and the confidence interval (given a 95%) in the expressions (6) and (7). The results are summarized in Table 3. Comparing the parameter estimation results for the demand for oil in Ghana, it can be seen that the maximum energy consumption level ( F) of the process resulting from the stochastic model is larger than that resulting from the deterministic model. The estimators of the stochastic model seem more reasonable since the forecasting values of the deterministic model underestimate the real values. The approximate distribution function and cumulative distribution function for a random point are also provided. These distribution functions are not symmetric due to the nonlinearity of the stochastic model and are in accordance with the assumption of a multiplicative noise. As it is shown, the model behaves well since in both cases the real data are included in the lower and upper limits. In the actual situation, it is suppose that they are not additional information but only values x1 ,..., xn of the endogenous variable
t

in

times

t1 ,..., tn . Suppose P X t1

x1

1 , it is known that
1,..., n are considered as
k 1 i

In

E X t

x1

h s ds
t1

H t and the values fi

In

xi , i x1

approximation to

H ti . So, with these values we fit k

X k t : t0

1 - degree polynomial P t
t

ai

t and

we can approach the lognormal diffusion process polynomial exogenous factors

X t : t0

T by the lognormal diffusion process with

T with infinitesimal moments as

k k j j 0

B1k x, t
taking, in this case,
k k j j 0

x
' j

Pjk t

and

k B2 x, t

2 2 k

k P 1 t

aj

1t , j

1,..., k and

P0k t

1 . It is assumed that

Pjk t has more than one factors, because it is possible that after a posterior study and analysis. Some

values of

Pjk may not be relevant.

60

Mathematical Theory and Modeling ISSN 2224-5804 (Paper) ISSN 2225-0522 (Online) Vol.3, No.13, 2013

www.iiste.org

Considering, for example, the function f(t) =t4, the values of the corresponding estimators are:

0.2109 , with confidence intervals (0.015215;0.098076) and (1.011172;3.812135).104. Table 4 summarises the prediction results, that is, the observed data, the values predicted by ETF and ECTF and the lower and upper limits of these functions,
7. Conclusions The main objective of this paper was the application of maximum likelihood ratio tests in lognormal diffusions model. The model described an innovation diffusion process considering at the same time disturbances coming from the environment of the system. Finally, the model was applied to energy consumption data in Ghana and showed sufficiently good results. Considering a lognormal diffusion model, in this paper we have calculated the distribution of the MLEs of the drift and diffusion coefficients, the Fisher information matrix, and solved some likelihood ratio tests for hypotheses on the parameters weighting the relative effect of exogenous factors affecting the drift. The results obtained are important for real applications; in particular, for prediction and conditional simulation. The endogenous consumption pattern in Ghana, in absolute terms, presents a clear upward trend. Between 1973 and 2010, the consumption rose from 763 to 12292 barrels (thousand metric tons of oil equivalent), while between 1990 and 2010, from 4531 to 12292 metric tons (an increase of 171.3%). With respect to the total consumption of primary energy derived from natural gas, the increase between 1990 and 2010 was even greater, at 204.46%. Finally, the separation, within total demand for petroleum products (final energy), of domestic-commercial use from industrial use (including electricity generation and cogeneration), reveals values of 18% and 82%, respectively. The energy market in Ghana has been characterized in recent decades by very important quantitative and structural changes, especially concerning natural petroleum products as a source of energy. Moreover, this has taken place in a context of an expanding phase of the economic cycle and significant social changes. The energy market in Ghana has been characterized in recent decades by very important quantitative and structural changes, especially concerning petroleum as a source of energy. Moreover, this has taken place in a context of an expanding phase of the economic cycle and significant social changes. References Anderson, T.W. (2003): An Introduction to Multivariate Statistical Analysis(3rd edition). Wiley & Sons, New Jersey. Gutirrez, R., Gutirrez-Snchez, R,. Nafidi, A and Ramos, E.(2007): Three-parameter stochastic lognormal diffusion model: statistical computation and simulating annealing application to real case. Journal of Statistical Computation and Simulation. Vol. 2, pp. 114. Gutirrez ,R., Roman P., Romero, D., and Torres, F. (2003): Application of the univariate lognormal diffusion process with exogenous factors in forecasting. Cybernetics & Systems, Vol. 34, no. 8, pp. 709 724. Gutirrez, R., Romn, P. and Torres, F., 1999, Inference and !rst -passage-time for the lognormal diffusion process with exogenous factors. Application to modelling in economics. Applied Stochastic Models in Business and Industry, Vol. 15, no. 4, pp. 325332. Gutirrez, R., Romn, P. and Torres, F., 2001, Inference on some parametric functions in the univariate lognormal diffusion process with exogenous factors. Test, Vol. 10, no. 2, pp. 357373. Gutirrez, R., Gonzlez, A. and Torres, F., 1997, Estimation in multivariate lognormal diffusion process with exogenous factors. Applied Statistics (JRSC), Vol. 46, no. 1, pp. 140146. Kloeden, P., Platen E., Schurz H. , Sorensen H. , (1999): On effects of discretization on estimators of drift parameters for diusion processes, Journal of Applied Probability.Vol. 33, pp. 10611076.

0.0209 0.020 09 , h

0.0279 and B

Prakasa B.L., (1999): Statistical Inference for Diffusion Type Processes, Arnold, London and University Press, New York,

Ricciardi, L. M. On the transformation of diffusion processes into the Wiener processes. Journal of Mathematics Analysis and Appication. Vol. 54, pp. 18599.

61

Mathematical Theory and Modeling ISSN 2224-5804 (Paper) ISSN 2225-0522 (Online) Vol.3, No.13, 2013

www.iiste.org

Skiadas, C. H, Giovani, A.N(1997): A stochastic Bass innovation diffusion model for studying the growth of electricity consumption in Greece. Applied Stochastic Models Data and Analysis. Vol. 13, pp.85101. Skiadas, C. H..; (2007): Recent Advances in Stochastic Modeling and Data Analysis. Chania, Greece Nualart, l. D. (1983): Stochastic Processes and their Applications. Recent Advances in Stochastic Modeling and Data Analysis : Chania, Greece,

Table 1: Gutierrez point estimation of the Mean

k
2 k

function Mode Conditional Mode

' k ' k

Conditional Mean
' k

t, s
t, s

Inx0
t t0

t ak
2 k

Inxs
t

t , s ak
2 k

Inx0
t t0

t ak
2 k

Inxs
t

' k

t , s ak
2 k

s
1

Table 2: Simulation and Estimation of the Parameters Simulation Estimation NR Estimation SA 1 2.00005 2.00475 0.32 0.400009 0.432842 0.00024 0.00013 0.00086

Table 3: Forecasting based on ETF and ECTF Times 2010 2011 2012 Data 15.275 17.446 18.274 EET 15.478 17.847 18.845 LL-ETF 14.776 17.346 18.274 UL-ETF 16.578 16.248 17.679 ECTF 14.274 15.762 18.978 LL- ECTF 14.377 16.978 18.367 UL- ECTF 15.985 17.934 18.709

Table 4: Confidence intervals for parameter estimates Forecasting period 1 80% Lower Limit Real Values 80% Upper Limit 13.34 24.65 325.50 2 13.55 25.37 44.46 3 14.83 26.37 45.23 4 15.17 29.39 46.75 5 15.54 29.99 46.90

Figure 1: Fits and predictions made using the ETF and the ECTF

62

This academic article was published by The International Institute for Science, Technology and Education (IISTE). The IISTE is a pioneer in the Open Access Publishing service based in the U.S. and Europe. The aim of the institute is Accelerating Global Knowledge Sharing. More information about the publisher can be found in the IISTEs homepage: http://www.iiste.org CALL FOR JOURNAL PAPERS The IISTE is currently hosting more than 30 peer-reviewed academic journals and collaborating with academic institutions around the world. Theres no deadline for submission. Prospective authors of IISTE journals can find the submission instruction on the following page: http://www.iiste.org/journals/ The IISTE editorial team promises to the review and publish all the qualified submissions in a fast manner. All the journals articles are available online to the readers all over the world without financial, legal, or technical barriers other than those inseparable from gaining access to the internet itself. Printed version of the journals is also available upon request of readers and authors. MORE RESOURCES Book publication information: http://www.iiste.org/book/ Recent conferences: http://www.iiste.org/conference/ IISTE Knowledge Sharing Partners EBSCO, Index Copernicus, Ulrich's Periodicals Directory, JournalTOCS, PKP Open Archives Harvester, Bielefeld Academic Search Engine, Elektronische Zeitschriftenbibliothek EZB, Open J-Gate, OCLC WorldCat, Universe Digtial Library , NewJour, Google Scholar