4G SELF-CONFIGURABLE SYSTEM BASED ON NEURAL NETWORKS

M.C. Juan Antonio Arzaga Silva Universidad De Las Amricas Puebla arizaga@ieee.org
be developed to future, in addition from wireless access from Internet [HUI03]. In this moment, investigations are carried out different to develop the technology that allows to MS and, in general, all wireless communication systems, to recognize the standard used by system to which they enter and configure themselves to be able to offer him to service [HAR00]. 4G will have to offer the capacity to give support to the present systems and to new systems that are developed besides to guaranteed a high QoS (Quality of Service) to the necessities of the user, all this has opened to a way for the sprouting of new technologies [QAD05]. SDR (Software Defined Radio) technology apears to be the best choice to create MS to 4G systems [SDR00]. SDR allows MS work in different environments, systems or different services providers, this kina of MS is called self configurable [MIT93]. Therefore, it is necessary that the 4G transceivers recognizes the wireless system which enter [PAL03]. The location of a certain system can be carried out through different methods already studied. The figure 1,1 shows a diagram block of a 4G transceiver. The control block regulates, based on the data obtained of the antenna signal, the information unloading towards the transceiver to make the autoconfiguracin and give service to the surrounding wireless system. Since the different systems from wireless communication have different frequencies from carriers and different frequency spectrums, it sets out like recognition method, within the transceiver, the use of a neuronal network which can be trained to obtain the capacity to discriminate between the different standars. The work reported in this text, two types of neuronal networks were studied. One more a ampler explanation of this appears in sections II and III. The simulations development for this work is explained in section IV. Section V this dedicated to the results of the simulation verifying if these fulfilled the established requirements. Finally the conclusions of this study are exposed as well as it proposes the directives for later studies

Abstract: This work present the study on two types of neuronal networks for a fourth generation (4G) selfconfigurable wireless communications system. Simulations were made in MATLAB to study the behavior of two types of neuronal networks, Back Propagation Network (BPN) and Radial Basis Function (RBF) trained to discriminate signals taken from three systems of wireless communication of second (2G) and third generation (3G). When the results are observed it seems that designed network BPN, generates a smaller error of recognition in addition of which it contains a smaller number of neurons than network RBF, this reduces the system time response in addition of which it allows a saving in the memory use.

I.

INTRODUCTION

The number of investigations in wireless communications has increased in last years, as resulting from the success that have had the systems of second (2G) and third generation (3G) [HUI03]. While the systems of 2G were developed for transmission of voice and data transmission to low speeds, the systems of 3G were designed for rates of higher data transmission; this with the purpose of offering a greater amount of new services, for example multimedia services [ARR03] [HUI03]. In last decade diverse standard and communication systems were developed during the evolution from 2G to 3G,systems such as GPRS (General Packet Radio Service), IMT 2000 (International Mobile Telecommunications2000), Bluetooth, WLAN (Local Wireless Access Network) and HyperLAN [HUI03].

All these services were designed and developed on the band ISM (Industrialist, Scientific, and Medical Band) whose regulations are not too strict giving like result that most of these incompatible systems is [PAL03].

In the other hang, for future generations (4G) the main idea is to use a single mobile system (MS) , which will give to support to the different actual standards and those that can

17th International Conference on Electronics, Communications and Computers (CONIELECOMP'07) 0-7695-2799-X/07 $20.00 2007

Figure 1.1- Self-configurable wireless System [HUI03], [PAL03].

II. WIRELESS COMMUNICATIONS Due to the success of second (2G) and third (3G) generation cellular telephony systems, diverse investigations has developed around the world within the area of the wireless communications. In order to understand towards that points go these investigations it is necessary to know the development historical these systems. Diverse standards and communications systems arose during the evolution process from 2G to 3G, such as GPRS, IMT 2000, Bluetooth, Radio networks WLAN (Wireless LAN) and HyperLAN [HUI03]. All these services were designed and developed of independent way on the ISM band whose regulations, for being a portion of the spectrum for investigation and development, is not too strict giving like result that most of these systems are incompatible.

4G promises to offer services multimedia of high quality, between which it emphasizes the hi-resolution video, that will allow to the visualization of films and TV in the MS. 4G MSs will be able to transmit data to 20 megabits per second, two thousand times the actual 2G speed and 10 times superior to 3G [HUI03]. III. FOURTH GENERATION SYSTEM TRANSCEIVER For 4G systems is necessary using an universal terminal, which can adapt to the environment that surrounds it allowing the user to be continuously connected to some surrounding wireless system [PAL03]. In order to perform this task in an invisible way to the user and in real time is necessary work in both, the network and the MS. The location of a certain system can be carried out through different methods that have been studied and that use the received signal among with other parameters that must be known. In these studies, statistical analysis of second order becomes necessary [AZZ96], chains of Monte Carlo Markov [DAV00]. A possible solution in the election of a system is monitoring the QoS of the surrounding systems or systems in order to found, within a determined environment, the system that better adapts to the necessities of the user In the case of the terminal (MS Mobile System) it is desired that it recognizes the system which is entering, without knowing a priori. This is knows as blind recognition. One only knows that the system exists and it is present; and only the characteristics of the signal used by the system had to be usedtoperform blind recognition one way is the use of neuronal networks [PAL03], [GRO98]. The transceiver has been proposed following the 1999 SDR Forum guide lines [SDR99]. The system in

Domain imposed by Internet technology in data communications networks has been the main motor for the beginning of a new era in telecommunication. This fact has stimulated the evolution of the Internet protocols. At the same time, and mainly in the last decade, wireless communications networks experienced a strong growth, focused in two main services voice and data [IRA02]. In this scenario, for 4G main idea is to use a single mobile system (MS), which will give to support to the different established standards and those that are developed to future. It is by that at the moment investigations are carried out different to develop the technology that allows the MS, and to all the elements ina wireless communication system , to recognize the standard used by the system which they enter and to configure themselves to be able to offer service him.

17th International Conference on Electronics, Communications and Computers (CONIELECOMP'07) 0-7695-2799-X/07 $20.00 2007

Figure 3,1 uses a control subsystem which is in charge to make the modifications (reconfigurations) necessary in the different stages from the terminal. This figure shows the proposal of the receiving system that is explained in this this work. The transceiver does not

know a priori what is the system which enters, but can establish through diverse processes [PAL03] the antenna frequency band and the ADC (Analog Digital) rate . Once established the frequency band, the data obtained through the antenna is digitized

Figura 3.1. Self-configurable Receiver based in Neural Network.

Figura 3.2. Auto-Configurable System [HUI03] An eight bits code come out from the neuronal As observed in Figure 3.1 the FFT (Fast Fourier network, this is established previously for each Transform) block, which obtains the frequency distribution communication system. Although the transceiver only must from the signal. The neuronal network receives this recognize one system between a universe of three is chosen information, after process it must obtain the information to leave the length of a byte with the purpose of increasing that it indicates which system is emitting the signal. the number of systems that can detect the neuronal network. This will bw done in future works. Neuronal network, primary target of this work, is used to perform this task since it is a system that can Once the control sub system collects the code associate similar patterns in sets or classes through learning from the neuronal network, then download the necessary by examples (Figure 3,1 Figure dotted region). This Software to give service to the Standard this download may characteristic makes ideal to be used like discriminator. be through internal memory, memory card, or even download via PC or Air route (To see Figure 3,2).

17th International Conference on Electronics, Communications and Computers (CONIELECOMP'07) 0-7695-2799-X/07 $20.00 2007

IV. NEURONAL NETWORKS SIMULATION USING MATLAB The study was based on two neuronal networks, BPN (Back Propagation Network) and RBF (Radial Basis Network) those were comprised to know which one has the best performance, measured in terms of network size and the mean error produces discriminating the surrounding wireless system. For this, two neuronal networks were created, to train them was used a training set which contained 128 series of 256 data each one, these data represented information transmitted by GSM, WCDMA and Bluetooth wireless systems. These data were taken from simulations performed in Simulink and after that FFT of each one of them was obtained. A) BPN NEURAL NETWORK

Several tests were carried out during the development of this part of the project, varying the number of neurons in the hidden layer as well as the networks reason learning and the moment learning. At the end, the lower average quadratic error was obtained using 25 neurons in hidden layer. B) RBF NEURAL NETWORK A Radial Basis Function network (RBF) was developed using the Matlabs Neural Network toolbox in order to perform a comparative analysis with BPN Network. There were used the training set and the output set, same as BPN Network Following, the process that Matlab uses to generate RBF network is described: Inputs layer neurons are created equal to given input Vector. Outputs layer neurons are created equal to given objective Vector. First approximation in hidden layer. One Epoch runs, quadratic error in output layer is measured If the average quadratic error is smaller or equal to the predetermined, process finishes, in other way MATLAB adds one more neuron to the hidden layer. This process follows until the predetermined error is obtained. With the use of Neural toolbox MATLAB generated a RBF neuronal network with 256 neurons of input layer 384 neurons in hidden layer and 8 in output layer. V. COMPARATIVE ANALISIS

BPN Neuronal Network was created using MATLAB [ARI05], all the functions were created using C language and compiled to create archives MEX. When the C file is compiled a file DLL (Dinamic Link Library) was generated, that were in order that the simulation was made over the PC operating system and not on the MVJ (Virtual machine of Java) in which MATLAB is based. The algorithms used to create this network took from [DAV91] and the work of [HAY94]. To establish number of input layer neurons, which receives information through a Fast Fourier Transformation block it takes in count that all studied wireless systems actually implement FFT with 256 points or in other cases until of 512 points [OPP98], in this case 256 neurons in the input layer were used. by single definition the neuronal network must have only three outputs. But, actually it has been decided to leave eight output in the network for being the number of minimum of bits contained in a common microcontroller register, FPGA or DSP register; where at least the NN will be programmed in one of those Also this was done to allow the neuronal network can be trained including information to discriminate other systems. Table 4.1 shows the output values for each one of the systems Table 4.1 Output Values by wireless System. SYSTEM output (S1 S8) GSM 10010000 BLUETOOTH 00001001 WCDMA 10101010 In order to determine the optimal size of hidden layer, diverse statistical criteria are mentioned in [HAN90] and [BIS95]. For this study the criteria was to implement the minor number of neurons that allow the network obtain an output with the least average quadratic error.

A) NEURAL NETWORKS PERFORMANCE Next step is verification and validation of studied Networks. A new patterns set, called validation set, is presented to both networks in order to measure the output to observe the behavior, obtaining the answer of the networks to these new patterns. Figure 5,1 shows the BPN network training of whereas Figure 5,2 shows the behavior of the network on the validation set for GSM, WCDMA and Bluetooth. It is observed as the value of the average quadratic error (MSE Mean Square Error) is very low. Table 5.1 shows in summary the MSE produced by the network for both sets, the one of training and the one of validation. Repeating the process used for network BPN validation, the behavior of neuronal network RBF was validated, for this were used both sets generated previously, the training set and the validation set. It was observed that within the training process the behavior of the network

17th International Conference on Electronics, Communications and Computers (CONIELECOMP'07) 0-7695-2799-X/07 $20.00 2007

when working with WCDMA produces in average higher errors (Figure 5,3). This is reflected in the network performance on the validation set being which is observed in Figure 5.4 The explanation of this network behavior may come for the principle and end of set WCDMA is that when applying the FFT to initial and final data those does not keep similarity with the rest from the data that are in the middle of the set. Another type of transformation in frequency and time could be proposed to carry out more information of the received signal.
Table 5.1 MSE in validation process for BPN network Validation Training Set Set MSE 5.54e-006 5.8e-006

Figure 5.3 MSE in training process for BPN network

Figure 5.1 MSE in validation process for BPN network . Figure 5.4 MSE in training process for BPN network

B) ANALYSIS OF RESOURCES USED BY EACH NEURONAL NETWORK Actually the MS are based on digital systems, microcontroller, DSPs or FPGA. Thus it is necessary to know the amount of resources, amount of memory, that neuronal network would use for the autoconfigurable transceiver. The neuronal network weights are floating point numbers which can be of 4 or 8 bytes of length according to the IEEE format. In Table 5.3 a comparison of the amount of memory appears that would occupy both networks using 15 digits decimal of precision (4 bytes). The amount of necessary memory for the RBF is 15 times greater than a network BPN.
Table 5.3 Memory use comparative Conjunto de Entrenamiento Error Promediado 3.4e-026 Conjunto de Validacin 4.0e-004

Figure 5.2 MSE in validation process for RBF network .

Table 5.2 MSE in validation process for RBF network

Red BPN RBF

Bytes de Memoria 26400 405504

17th International Conference on Electronics, Communications and Computers (CONIELECOMP'07) 0-7695-2799-X/07 $20.00 2007

In all computational process, performance its evaluated in terms of time that takes in executing itself, this time is proportional to the number of operations of floating point (flops) (addition, subtractions, multiplications or divisions) made by the same process. Table 5.4 shows comparative in amount of flops used for the operation of the studied networks

VIII.

REFERENCES

[ARI05] Arzaga. J. Alarcn, V. Guerrero, G. Anlisis de Redes neuronales para equipos de cuarte generacin celular UDLAP Cholula, Puebla, Mxico Diciembre 2005. [AZZ96] E. Azzouz and A. K. Nandi, Automatic Modulation Recognition of Communication Signals, Kluwer, 1996. [CHU92] C.K. Chui An introduction to wavelets Boston Academic Press, 1992. [DAV00] M. Davy, C. Doncarli, and J. Y. Tourneret, Supervised Classification Using MCMC Method., ICASSP 00. [DAV91] E. Davalo, P. Nam Neural Networks 1ra Ed. Macmillan Press ltd. Londres UK 1991 [GRO98] A. Grossekatthoefer, Classification of Analog and Digital Modulation Types Based on Artificial Neural Networks. ICT 98, Porto Carras, June 2129, 1998. [HAY94] Haykin, S. Neural Networks a Foundations. Ed. Macmillan USA 1994 Comprehensive

Table 5.4 Comparative of the amount flops used by each Network

Red BPN RBF

FLOPS 6881 103144

VI. CONCLUSIONS Although the training process of the RBF generated by MATLAB is faster than BPN, the designed network contains three times more neurons. And do not obtain the same results that in the BPN network, this can be observed in Table 5.2 In Table 5.3 a comparison of the amount of memory appears that would occupy both networks using 15 digits(4 bytes). The amount of necessary memory for the RBF is 15 times greater than a network BPN. The amount of operations taken by each network (Table 5.4) shows that BPN network obtains a better performance than BRF network. The most important point to is the error in the discrimination of the three studied wireless systems. In this case as it is observed in tables 5.4 and 5.2 the BPN network performance , using less resources allow to a recognition and discrimination better than RBF network.

[HUI03] S. Y. Hui, K. H. Yeung Challenges in the migration to 4G Mobile Systems IEEE Communications Magazine July 2003 [IRA02] Irastorza, J.A. " Abriendo el camino hacia la Cuarta Generacin: Una Nueva Arquitectura de Redes de rea Personal Inalmbricas Departamento de Ingeniera de Comunicaciones, ETSII y Telecomunicacin Universidad de Cantabria, Espaa. 2003. [ISA04] Isasi P.,"Redes neuronales artificiales Un enfoque prctico Pearson Educacin, Madrid 2004 [MIT93] Mitola, J. "Software radios: Survey, critical evaluation and future directions Aerospace and Electronic Systems Magazine, IEEE Volume 8, Issue 4, April 1993 [OPP98] Oppenheim, A. V. Seales y Sistemas 2da ED. P.H.H. Mxico 1998 [PAL03] J. Palicot, C. Roland, A New Concept for Wireless Reconfigurable Receivers IEEE Communications Magazine Julio 2003 [QAD05] Qaddour, J.; Barbour, R.A.C.; Evolution to 4G wireless: problems, solutions, and challenges Computer Systems and Applications, 2005. The 3rd ACS/IEEE International Conference on 2005 [SDR00] http://sdrforum.org/ [SDR99] Software Defined Radio Forum, Technical Report 2.1, Architecture and Elements of Software Defined Radio Systems as Related to Standards, November 1999. [VAS04] Vasco P, Tiago S. Evolution of Mobile Communications: from 1G to 4G Department of Informatics Engineering of the University of Coimbra, Portugal 2004

VII. FUTURE WORK With the purpose to improve the present work and as resulting from itself certain lines of investigation are opened that will have to be retaken in sequence to complete it. Study of BPN neuronal network in real situations implemented in a digital system, FPGA or DSP. Extension of the amount of systems the neuronal network that can discriminate to apply it aver an specific region. Qualitative comparison with other kind of Neural Networks for 4G self-configurable systems. Study of the application of the Wavelet Transform, to obtain the characteristics of the received signa,l instead Fourier Transform [CHU92].

17th International Conference on Electronics, Communications and Computers (CONIELECOMP'07) 0-7695-2799-X/07 $20.00 2007