Escolar Documentos
Profissional Documentos
Cultura Documentos
TABLE OF CONTENTS
Acknowledgement iii
Chapter 1: Introduction
Background and
motivation.1
Chapter 2: Current Scenario
Train-Mounted
GPR..6
Chapter 4: DATA COLLECTION..8
4.1: Image and Video Acquisition8
4.2: Virtual Track Model for Initial Algorithm Development .9
Chapter 7: REFERENCES..21
1.Introduction
1.1 Background and motivation
North American Railways and the United States Department of Transportation (US DOT)
Federal Railroad Administration (FRA) require periodic inspection of railway
infrastructure to ensure the safety of railway operation. This inspection is a critical, but
labor-intensive task resulting in large annual operating expenditures and it has limitations
in speed, quality, objectivity, and scope. A machine vision approach is being developed to
automate inspection of specific components in the track structure. The machine vision
system consists of a video acquisition system for recording digital images of track and
custom designed algorithms to identify defects and symptomatic conditions from these
images, providing a robust solution to facilitate more efficient and effective track
inspection. The main focus of the system is the detection of irregularities and defects in
wood-tie fasteners, rail anchors, and turnout components. An experimental on-track
image acquisition system has been developed and used to acquire video in the field of
different track classes. The machine-vision algorithms use a global-to-local component
recognition approach, in which edge and texture-based detection techniques are used to
narrow the search area where components are likely to be detected. The system will be
designed to evaluate the railway infrastructure in accordance with FRA track safety
regulations, but will be adaptable to railroad-specific track standards. Some of the track
inspections such as measuring the tracks curvature and alignment, as well as the cross
level of the two rails, have already been automated using a track geometry car; however,
other inspections, such as monitoring the spiking and anchor patterns and detecting raised
or missing spikes and anchors, are still manually and visually conducted by rail road track
inspectors. It is, thus, of great interest to railroad companies to enhance the current
manual inspection process using machine vision technology for more efficient, effective,
and objective inspections. It also helps them lower maintenance costs and increase track
capacity
2.Current Scenario
Dept of Electronics and communication, BMSITPage 2
The prompt detection of the conditions in rails that may lead to a crack or rather a break
now plays a critical role in the maintenance of rails worldwide. The understanding of
these mechanisms is constantly improving and the evolution of a range of complementary
(Non Destructive Testing)NDT techniques has resulted in a number of tools for us to
choose from. Among the inspection methods used to ensure rail integrity, the common
ones are visual inspection, ultrasonic inspection and eddy current inspection. It is a
relatively well understood technique and was thought to be the best solution to crack
detection. However, Ultrasonics can only inspect the core of materials; that is, the method
cannot check for surface and near-surface cracking where many of the faults are located.
Eddy currents are used to tide over this limitation associated with ultrasonics. They are
effectively used to check for cracks located at the surface of metals such as rails.
MPI is also used in the rail industry but there are a number of problems inherent with this
technique, some of which are mentioned below:
Surface of the rail or component must first be cleaned of
all coatings, rust and so on.
To get a sensitive reading, contrast paint must first be
applied to the rail, followed by the magnetic particle coating.
The same inspection must then be carried out in two
different directions at a very slow overall speed.
However, in the Indian scenario, we find that the visual form of inspection is widely used,
though it produces the poorest results of all the methods. It is now becoming widely
accepted that even surface cracking often cannot be seen by the naked eye.
received information, a GSM modem has been utilized. The function of the GSM
module being used is to send the current latitude and longitude data to the
relevant authority as an SMS. The robot is driven by four DC motors. If
this system is employed only latitudes and longitudes of the broken
track will only be received so that the exact location cannot be known.
GPRS module is used to get exact location of the broken rail track.
ARM7 controller is also used owning to is low cost and less power
consumption it also decreases the time used in detecting cracks.
space. These features, combined with data archiving and recall capabilities, provide
powerful trending capabilities in addition to the enhanced inspection capability itself.
Some disadvantages of machine vision include difficulties in coping with unusual or
unforeseen circumstances (e.g. unique track components) and the need to control or
augment variable outdoor lighting conditions typical of the railroad environment.
TECHNOLOGY INVOLVED:
Next, we integrate the evidence from multiple information sources, including cameras,
Global Positioning System (GPS), and distance measurement instrument (DMI), and
apply a global optimization approach to further improve the component detection
accuracy. Both the cross-object spatial constraint, as enforced by the sequential structure
of rail tracks, and the cross frame and cross-view constraints in camera streams are
applied during this optimization process. Finally, anchor conditions are assessed.
4. DATA COLLECTION
Dept of Electronics and communication, BMSITPage 7
functional settings. Securing time to test the image acquisition system on active track
during the developmental phases proved difficult, so a virtual track model (VTM) was
created. The VTM used American Railway Engineering and Maintenance-of-Way
Association (AREMA) recommended practices for the design of track components to
model FRA Class 4 and 5 track and included sections of both tangent and curved track.
(AAR clearance plates were incorporated into the VTM to ensure camera placements
were in feasible locations .
The angles of the virtual cameras were then adjusted until they enabled viewing of the
relevant track components and allowed assessment of the conditions of interest that were
conducive to algorithm development. The VTM camera view experimentation resulted in
the selection of two initial camera views: the lateral view (Figure 4A) and the over-therail view (Figure 4B) (1, 2). The lateral view provides a good view of tie plates, spikes
and anchors. The over-the-rail view provides perpendicular views of the spike and
anchors to combine with the lateral view for increasing the accuracy of the
measurements. In addition, it also provides a view of the ties for future inspection tasks.
of high-rail vehicles and mainline track capacity, an experimental data acquisition system
referred to as the Video Track Cart (VTC) was designed for collecting continuous video of
A: Over-the-rail View
Fig. 4
B: Lateral View
detecting objects. We first locate the track components with little variability in
appearance and predictable locations (e.g. the rail), and then locate objects that are
subject to high appearance variability (e.g. spike heads and anchors) in subsequent stages.
This increases the robustness of component detection by restricting the search space for
the smaller components, whose appearances can vary.To further increase robustness to
changing environmental conditions and changes in object appearance (e.g. differing
material types or corrosion), we have selected features that do not rely on a specific
spatial description, but rather a configuration of simple, local features that are known to
be valuable in classification. The simple, local features that we use include edges and
Gabor features. Edges are frequently used to detect objects in machine vision since object
boundaries often generate sharp changes in brightness (21). Image gradients (edges)
should be consistent among differing ties and rails, but unanticipated track obstacles
could create unanticipated edges, causing difficulty for the algorithms. For this reason,
texture information from the ballast, tie, and steel was incorporated into the edge-based
algorithm to improve its robustness. This approach relied on texture classification using
Gabor filters, which produced low-level texture features. Gabor filtering is used to
summarize two-dimensional spatial frequencies, and this can be used in texture
discrimination.
processing.
Figure 5. Template Images of Specific Ballast, Rail, and Tie Textures Used for
Image Processing
After isolating the foreground portion of the tie, an accurate boundary for both the tie
plate and tie must be obtained to determine if an anchor has moved from its proper
position. the dimensions of the tie plate can be compared to the image to calibrate its
scale for defect measurement estimations. In order to capture lateral views of the gauge
side and the field side of both rails, we use four cameras in total. All four cameras are
connected on the same FireWire bus, which controls the time-synchronization between
cam-eras with high accuracy. The field of view of each camera are set to 24 inches to
guarantee 50% overlap of images when traveling at 10 mph. For this camera setting, at
each time point, each side of each tie plate is seen by only one camera, a tie will be seen
by all four cameras, and the anchors will be seen only by the two gauge view cameras.
point we only return the detection results from one selected classifier - the one with the
highest number of detections in the last 50 frames. For each frame, we apply a sliding
window detection ap-proach within a ROI, which is defined to be the horizontal image
stripe covering the region around the lower edge of the rail, where anchors should be
installed. The width of the stripe equals the image width.
Pixel-Inch Calibration
Since shifts and spreads are defined in inches, while the anchor-tie distance is
computed in pixels, we have to be able to reliably convert distances from pixels to
inches in order to accurately detect shifts and spreads. Due to wide angle fisheye
Dept of Electronics and communication, BMSITPage 14
distortion, the pixel to inch mapping is not uniform for all columns in the image. We
take advantage of the fact that the width of the tie plates are fixed at 7:5 inches. We annotate the bounding boxes for roughly 3; 000 tie plates for each gauge-view cameras.
Since were mainly interested in the horizontal distance, we plot the tie plates width
val-ues in pixels with respect to the X coordinate of their loca-tions. We quantize the X
coordinates to 20 different bins. The conversion curve is fitted by performing bin
averaging for each of the 20 bins and followed by linear interpola-tion. The resulted
curve allows us to map an arbitrary im-age pixel to inches, given its column index. The
pixel-inch mapping function roughly approxi-mates a quadratic function. typically be
visible in two frames when traveling at speed, and while the vehicle is still accelerating
components can be detected in many consecutive frames.
Cross-view Matching:
At any time point a tie can be seen by as many as four camera views. When the
expected position of a tie plate moves out of the cameras field of view, we attempt to
match the tie plate with tie plates from other views that have also finished passing the
field of view. Pairs of tie plates are matched by comparing their positions in frames
where both tie plates were present. Tie plates are matched iteratively in an attempt to
build up a set of detections in all four views representing one complete tie. If a
complete set of tie plate detections cannot be found, and some tie plates expected
position moves further outside the field of view we assume tie plate detection failed for
the missing view(s) and report the largest set of tie plates found as a complete tie with
missing data. If anchors were found at all four positions on the combined tie, we say
the tie has boxed anchors and can maintain a count of ties with boxed anchors to
evaluate compliance with railroad safety rules.
For any rail track geographical location, we need to obtain the geo-reference data
which contain the required anchor pattern for that specific geo-location, which is indexed
by milepost and footage, or GPS latitude and longitude. Based on such data, for any given
100-foot track that is captured in the video, we will know exactly what is its target anchor
pattern by matching the GPS data. To detect compliance exception, we first count the
Dept of Electronics and communication, BMSITPage 15
total number of boxed ties for every 100-foot rail track (denoted by C). A boxed tie is a
tie with all 4 anchors in normal (not shifted) condition. We then compare the tie count
with the required number (denoted by R). If the count is smaller than 85% of the
requirement, i.e. (R C)=R >= 15%, then a compliance-level exception is declared.
Experimental Results:
Component
Tie plate
Precision
99:3%
Recall
100%
Tie
Anchor
88.2%
96:5%
82.3%
96.7%
Conclusion
This paper has described our recent engagement with a railroad company to develop a
real-time automatic vision based rail inspection system. Specifically, the system is able to
robustly detect important rail components with high accuracy and efficiency based on
visual, location, DMI, and contextual information. We have further discussed anchor
exception detection at both tie and compliance levels. Quantitative analysis performed on
a large video data set captured with different track and lighting conditions has
demonstrated very encouraging performance. The main challenge for us in the near future
is to handle scenarios in which heavy shadows and light overexposure exist in the videos.
In addition, we believe that our current tie detection approach needs to be further
improved, and the global component optimization approach needs to be evaluated on
other rail objects other than the tie plate. Third, we will conduct more extensive testing
covering longer railroad tracks with varying defect conditions. Inspection for other rail
objects such as spikes, spike holes, and joint bars needs to be developed as well.
Finally, we need to enhance our algorithms with a potentially
modified imaging system to accommodate a faster and more desirable inspection speed
(e.g., 40 km/h). Controlled illumination of the rail infrastructure will be also explored to
avoid ambient lighting artifacts. Finally, we would like to note the following: 1) the
object detection and optimization approaches that we proposed here can be either applied
readily or with minor tunings to other rail fastening systems and 2) while the vision
algorithms that we developed are finely tuned toward rail track structure and components,
the encouraging results we achieved have demonstrated the applicability of machine
vision technology to real applications in the general transportation domain (such as the
advanced driver assistance system).
REFERENCES
[1]