Escolar Documentos
Profissional Documentos
Cultura Documentos
Research Article
ISSN 1751-956X
Trajectory analysis for parking lot vacancy Received on 31st October 2014
Revised on 8th March 2016
detection system Accepted on 9th May 2016
doi: 10.1049/iet-its.2014.0271
www.ietdl.org
Abstract: Taking a vacant parking lot in crowded metropolitan areas is a major problem especially with the huge number
of vehicles. In this study, the authors provide a vision-based system for real-time management of parking spaces in the
case of outdoor parking. Different real-world challenges may face these systems such as weather conditions,
luminance variation, perspective distortion and inter-spaces occlusion. In this study, they propose a decisional module
based on a tracking approach that determines in real time the state of the parking lots and localises the vacant parking
spaces according to several extracted attributes. This decision is based on local characteristics of the parking spaces as
well as the performed vehicles’ events.
IET Intell. Transp. Syst., 2016, Vol. 10, Iss. 7, pp. 461–468
& The Institution of Engineering and Technology 2016 461
Fig. 1 Proposed process
dispositions independently of the used camera orientation. So, it is information system that provides a real-time update of the parking
important to adapt an approach that can be generalised in different information for further use.
contexts.
As introduced in Fig. 1, our process presents first an off-line phase
of configuration which will define the disposition of the studied 2.1 3D parking modelling
parking. The online phase presents a first step to extract data from
the video sequences, then a decisional module providing the final The first phase is the parking modelling which is an off-line step
decision according to the already extracted results and finally an necessary to be achieved just one time while installing the camera
IET Intell. Transp. Syst., 2016, Vol. 10, Iss. 7, pp. 461–468
462 & The Institution of Engineering and Technology 2016
and the system in a new parking. This phase is crucial and can Table 1 Case of occlusion handling
influence the results of our paper. Fig. 2 presents first the main
Model Occupancy FP FN TP TN
two used models in the existent research, as well as our new
proposed one [13]. ground model (a) O, O, O 0 2 1 0
The first presented model in Fig. 2a is a basic model based on the (b) O, O, O 0 1 2 0
ground tracing of the parking spaces. The adoption of such a model proposed model (a) O, V, V 0 0 1 2
can accentuate the problem of inter-spaces occlusion, where a parked (b) O, O, V 0 0 2 1
car can cover an important part of its adjacent space next to it. The
model presented in Fig. 2b is a 3D model used to determine the
whole volume of each parking space presented as a cube. Fig. 2c Table 2 Temporal integration for parking events definition
presents our introduced ‘on-street surface’ model, which is partially
inspired from the 3D model. In this model, we are only interested st−1 st Event
in the surface of the parking space that is tangent to the street. The
idea is to preserve from the whole 3D cube presenting a parking out out out
out in entering
space, the most important area that can give us reliable results with in in in
a great reduction of the inter-spaces occlusion. Independently of the in out leaving
position of the camera and the disposition of the parking spaces in
the scene, these on-street surfaces, presented in Fig. 2c, can model
the parking lot with a meaningful reduction of the problem of consequently to detect and extract the objects in motion. It has the
occlusion. More details about our introduced model will be more advantage of re-estimating permanently the model of the
explained in Sections 2.3.2 and 2.3.4. background. It is reliable, efficient and can reduce the problems of
Fig. 3 demonstrates a case where a parked car can occlude the noise caused by the illumination changes and diverse weather
parking spaces next to it. To study this case, we perform our tests conditions in the scene at different times of the day. For example,
based on two different parking models. The first results are the apparition of a shadow in the scene and its change of position
obtained with a ground model and the second results are obtained throughout the day do not affect the results of foreground objects
based on our new proposed model. In this sample, we are detection and consequently the phase of tracking and parking state
interested in three successive parking spaces, and we present their detection. As detailed in [14], it presents each pixel of the image
states with ‘O’ if the space is occupied and with ‘V’ if it is vacant. with a mixture of N Gaussians. It estimates parametrically the
Table 1 points the obtained results for these two models and distribution of random variables modelling them as a sum of several
presents for each case the measures of FP: false positive, FN: false Gaussians called a kernel. This model is dynamically updated to
negative, TP: true positive and TN: true negative. We note that the affect each pixel to its corresponding distribution. This permits the
results given by the first model are confused and that each parked separation of the foreground mask of the scene from fixed background.
car hides the space next to it. However, we can conclude that our Each object present in the foreground plan will be extracted
proposed approach can handle this case and overcome the problem separately, and the vehicles are selected based on the dimensions
of occlusion. Since our state decision relies on the detection of the of the object. Thus, we will be able to select and track only the
on-street surface that the vehicle in motion is crossing. vehicles in motion through the scene to explore their behaviour
over time. The tracking is performed using the Kalman filter which
is a recursive approach for estimating the state of a given process.
2.2 Real-time data extraction These steps of objects in motion detection and vehicles tracking
are explained in Algorithm 1 (see Fig. 4).
Providing that our approach should be adapted for different parking
Besides the objects in motion detection and tracking, we locally
dispositions, we aim to introduce a real-time approach for detecting
explore the state of a parking space based on the speeded up
the vacancies of the parking lots independently of a specific
robust features (SURFs) speeded up robust features extraction in
architecture of the parking. Since we admit that our camera
order to strengthen the approach of event detection. As presented
provides fixed scene videos, we propose to detect and track the
in [15], the performed tests prove that the application of the
objects in motion. This allows to instantly analyse its trajectory, to
algorithm of SURF as a features descriptor provides good
detect its actions in the parking based on a temporal integration
performances for the local classification of the parking states. So,
and to calculate its degree of occupancy once it is inside a parking
we opted for the combination of the first approach of events
space (Table 2).
recognition and trajectory analysis with the local invariant features
The first phase is the extraction of the objects that are in motion in
extraction and classification.
the fixed scene. Providing this initial condition, we can opt to the
implementation of an adaptive background subtraction algorithm
that adaptively eliminates the background of the parking video and 2.3 Decisional module
extracts the foreground model containing the vehicles in motion.
In our process, we adapt the Gaussian mixture model algorithm to The final decision for a parking lot is based on a set of several
adaptively subtract the background model of the scene, and attributes that can characterise in real time, whether a local
IET Intell. Transp. Syst., 2016, Vol. 10, Iss. 7, pp. 461–468
& The Institution of Engineering and Technology 2016 463
Fig. 4 Algorithm for vehicles in motion detection and tracking
description of the parking space volume or describe the trajectory of Fig. 5 Algorithm for vehicles’ events detection
an object in motion and its belonging to a parking space. During this
phase, we aim to explore the previously obtained results from the
SURF features extraction and objects in motion tracking in order parking model. The tracking provides real-time information about
to extract the necessary attributes for the final decision module. the object’s position at an instant t. On the basis of this
information, we can determine if the vehicle in motion is
2.3.1 Trajectory analysis: Once we have extracted all the overlapping with a parking space. We can define each of the
objects that are in motion, it is important to follow each one previously defined parking events as a succession of vehicle’s
separately in order to analyse its trajectory over time. This analysis actions over time. So, it is important to perform a temporal
is important for the understanding of each object trajectory integration in order to detect these events while happening.
through the parking. Other than the actual position, a trajectory Tt A car’s position pt at an instant t is defined according to the centre
at an instant t can be characterised by a descriptor vector presented of the bounding box surrounding it. We can verify if it is overlapping
with with our extracted parking model or not according to its position. At
an instant t, a vehicle state st can be ‘Out’ of all parking spaces or ‘In’
Tt = Pt , Dt , Vt (1) a specific parking lot. To calculate this state, we present the on-street
surface of each parking space as a set of four segments (L1; L2; L3;
where Pt is the actual position of the tracked object at the instant L4) as presented in Fig. 2c. A vehicle is considered crossing the
t and Dt represents the direction of motion of the object. Whether on-street surface only if its position is inside the surface delimited
it is passing from the street to the parking spaces or the inverse; Vt with these four segments. The position of a given vehicle at the
is the measure of velocity of the object at t. coordinates (x, y) to the line L1( p11; p12) is calculated as
2.3.2 Parking events detection: The detection of the parking d1 = (p12 · x − p11 · x) × (y − p11 · y) − (p12 · y − p11 · y)
events consists of the detection of the most important actions that
× (x − p11 · x) (2)
can perform a vehicle in a parking. At an instant t, we can
principally specify the event Et as
d2, d3 and d4 can be calculated similarly. The vehicle state st is ‘In’
† Car Out: When a vehicle moves in the street out of the parking and the tracked vehicle is considered crossing a parking on-surface
spaces specified in our parking model. only if these four measurements are positive. By elaborating a
† Car Entering: When a vehicle crosses the on-street surface of a temporal integration of the previous states, we can define four
parking space and enters. essential events of the vehicles in the parking.
† Car In: When a vehicle is inside a parking space. The process of parking events detection, previously described, can
† Car Leaving: When a vehicle quits a parking space and goes to be more detailed in Algorithm 2 (see Fig. 5).
the street. Fig. 6 presents a case where a vehicle passes through three
successive events in the parking. First the vehicle is ‘Out’ of all
The recognition of these events relies on the results of the tracking the parking lots, then it is ‘Entering’ to the first parking space and
of the detected foreground objects as well as the already extracted finally it is ‘In’.
IET Intell. Transp. Syst., 2016, Vol. 10, Iss. 7, pp. 461–468
464 & The Institution of Engineering and Technology 2016
Fig. 8 Regions of interest selection for the SURF extraction
IET Intell. Transp. Syst., 2016, Vol. 10, Iss. 7, pp. 461–468
& The Institution of Engineering and Technology 2016 465
Fig. 12 Mobile phone application
3 Experimental results
IET Intell. Transp. Syst., 2016, Vol. 10, Iss. 7, pp. 461–468
466 & The Institution of Engineering and Technology 2016
we present also the average of computation time in milliseconds as
it was implemented.
4 Conclusion
IET Intell. Transp. Syst., 2016, Vol. 10, Iss. 7, pp. 461–468
& The Institution of Engineering and Technology 2016 467
14 Masmoudi, I., Elarbi, M., Amar, C.B.: ‘Vocabulary tree schema based on SURF 17 Masmoudi, I., Wali, A., Jamoussi, A., et al.: ‘Architecture of parking lots
descriptor for real time object detection and recognition in video’. 13th Int. management system for drivers’ guidance’. IEEE Int. Conf. on Systems, Man,
Conf. on Hybrid Intelligent Systems (HIS 2013), 2013, pp. 135–140 and Cybernetics, 2015, pp. 2974–2978
15 Masmoudi, I., Wali, A., Jamoussi, A., et al.: ‘Vision based system for vacant 18 Oh, S., Hoogs, A., Perera, A., et al.: ‘A large-scale benchmark dataset for event
parking lot detection: Vpld’. Ninth Int. Conf. on Computer Vision, Theory and recognition in surveillance video’. IEEE Conf. Computer Vision and Pattern
Applications, January 2014, vol. 2, pp. 526–533 Recognition, 2011
16 LiorRokach, O.M.: ‘Data mining with decision trees: theory and applications’, 19 Fabian, T.: ‘An algorithm for parking lot occupation detection’. Computer
Series in machine perception and artificial intelligence (World Scientific Information Systems and Industrial Management Applications, 2008,
Publishing Company, Singapore, 2008) pp. 165–170
IET Intell. Transp. Syst., 2016, Vol. 10, Iss. 7, pp. 461–468
468 & The Institution of Engineering and Technology 2016